2024-02-28T22:38:27.216 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-28T22:38:27.216 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --verbose --description fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --archive /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601 --name vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi -- /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601/orig.config.yaml 2024-02-28T22:38:27.270 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T22:38:27.355 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601 branch: main description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: vshankar@redhat.com first_in_suite: false job_id: '7575601' kernel: flavor: default kdb: true sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/v18.2.1 ' name: vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 2226 sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 sleep_before_teardown: 0 suite: fs:upgrade:mds_upgrade_sequence suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 targets: smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCyNgqg2EfgR5hFy1wTG8CwC0tZQlzjb5wJpxmohpCzQIDKFZ9yg1Gj+suDYePj9NXbHUMJW47Slj/oO5uHlSgQ= smithi184.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKsVCWnA0iw2FiTVB3UaJyQAby3Nusou4fNkVynGlTFjtnFP1eqU4G7jdttWKjKD6tfUGIRwpMBMwHgNZgvsRp4= tasks: - install: exclude_packages: - ceph-volume tag: v18.2.1 - print: '**** done install task...' - cephadm: compiled_cephadm_branch: reef conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.io/ceph/ceph:v18.2.1 roleless: true - print: '**** done end installing v18.2.1 cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-28_15:21:56 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-02-28T22:38:27.355 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa; will attempt to use it 2024-02-28T22:38:27.356 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks 2024-02-28T22:38:27.356 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-28T22:38:27.357 INFO:teuthology.task.internal:Checking packages... 2024-02-28T22:38:27.381 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1fb5d10608dccee73edd6ef8a2c7b804a097c324' 2024-02-28T22:38:27.381 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-28T22:38:27.381 INFO:teuthology.packaging:ref: None 2024-02-28T22:38:27.381 INFO:teuthology.packaging:tag: None 2024-02-28T22:38:27.381 INFO:teuthology.packaging:branch: main 2024-02-28T22:38:27.381 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T22:38:27.381 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-02-28T22:38:27.631 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1739.g1f09b1e2 2024-02-28T22:38:27.633 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-28T22:38:27.641 INFO:teuthology.task.internal:no buildpackages task found 2024-02-28T22:38:27.641 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-28T22:38:27.654 INFO:teuthology.task.internal:Saving configuration 2024-02-28T22:38:27.674 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-28T22:38:27.682 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T22:38:27.709 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 22:33:06.082633', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCyNgqg2EfgR5hFy1wTG8CwC0tZQlzjb5wJpxmohpCzQIDKFZ9yg1Gj+suDYePj9NXbHUMJW47Slj/oO5uHlSgQ='} 2024-02-28T22:38:27.734 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 22:33:06.081341', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKsVCWnA0iw2FiTVB3UaJyQAby3Nusou4fNkVynGlTFjtnFP1eqU4G7jdttWKjKD6tfUGIRwpMBMwHgNZgvsRp4='} 2024-02-28T22:38:27.734 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-28T22:38:27.742 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-02-28T22:38:27.742 INFO:teuthology.task.internal:roles: ubuntu@smithi184.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-02-28T22:38:27.742 INFO:teuthology.run_tasks:Running task console_log... 2024-02-28T22:38:27.816 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fe3cda16160>, signals=[15]) 2024-02-28T22:38:27.817 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-28T22:38:27.823 INFO:teuthology.task.internal:Opening connections... 2024-02-28T22:38:27.823 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T22:38:27.825 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T22:38:27.917 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi184.front.sepia.ceph.com 2024-02-28T22:38:27.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T22:38:28.010 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-28T22:38:28.019 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-02-28T22:38:28.037 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-02-28T22:38:28.037 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-02-28T22:38:28.092 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T22:38:28.093 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T22:38:28.094 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T22:38:28.094 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-02-28T22:38:28.236 DEBUG:teuthology.orchestra.run.smithi184:> uname -m 2024-02-28T22:38:28.253 INFO:teuthology.orchestra.run.smithi184.stdout:x86_64 2024-02-28T22:38:28.254 DEBUG:teuthology.orchestra.run.smithi184:> cat /etc/os-release 2024-02-28T22:38:28.311 INFO:teuthology.orchestra.run.smithi184.stdout:NAME="CentOS Stream" 2024-02-28T22:38:28.311 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION="9" 2024-02-28T22:38:28.311 INFO:teuthology.orchestra.run.smithi184.stdout:ID="centos" 2024-02-28T22:38:28.311 INFO:teuthology.orchestra.run.smithi184.stdout:ID_LIKE="rhel fedora" 2024-02-28T22:38:28.311 INFO:teuthology.orchestra.run.smithi184.stdout:VERSION_ID="9" 2024-02-28T22:38:28.311 INFO:teuthology.orchestra.run.smithi184.stdout:PLATFORM_ID="platform:el9" 2024-02-28T22:38:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:PRETTY_NAME="CentOS Stream 9" 2024-02-28T22:38:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:ANSI_COLOR="0;31" 2024-02-28T22:38:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:LOGO="fedora-logo-icon" 2024-02-28T22:38:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-02-28T22:38:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:HOME_URL="https://centos.org/" 2024-02-28T22:38:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-28T22:38:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-02-28T22:38:28.312 INFO:teuthology.orchestra.run.smithi184.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-28T22:38:28.312 INFO:teuthology.lock.ops:Updating smithi184.front.sepia.ceph.com on lock server 2024-02-28T22:38:28.340 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-28T22:38:28.348 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-28T22:38:28.353 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-28T22:38:28.353 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2024-02-28T22:38:28.356 DEBUG:teuthology.orchestra.run.smithi184:> test '!' -e /home/ubuntu/cephtest 2024-02-28T22:38:28.372 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-28T22:38:28.377 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-28T22:38:28.377 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2024-02-28T22:38:28.410 DEBUG:teuthology.orchestra.run.smithi184:> test -z $(ls -A /var/lib/ceph) 2024-02-28T22:38:28.526 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-28T22:38:28.582 INFO:teuthology.run_tasks:Running task kernel... 2024-02-28T22:38:28.641 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'} 2024-02-28T22:38:28.642 INFO:teuthology.task.kernel:config {'host.a': {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'}, 'host.b': {'flavor': 'default', 'kdb': True, 'sha1': 'bd7d00fb724897dda560070d01bc6e5c80881f15'}}, timeout 300 2024-02-28T22:38:28.642 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-28T22:38:28.642 DEBUG:teuthology.orchestra.run.smithi184:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-28T22:38:28.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T22:38:28.659 DEBUG:teuthology.task.kernel:sha1 for host.b is bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T22:38:28.659 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "bd7d00fb724897dda560070d01bc6e5c80881f15"... 2024-02-28T22:38:28.659 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-02-28T22:38:28.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T22:38:28.660 DEBUG:teuthology.task.kernel:sha1 for host.a is bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T22:38:28.660 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "bd7d00fb724897dda560070d01bc6e5c80881f15"... 2024-02-28T22:38:28.660 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-02-28T22:38:28.716 INFO:teuthology.orchestra.run.smithi184.stdout:5.14.0-361.el9.x86_64 2024-02-28T22:38:28.716 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T22:38:28.716 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-28T22:38:28.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T22:38:28.720 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-361.el9.x86_64 2024-02-28T22:38:28.721 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T22:38:28.721 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-02-28T22:38:28.721 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T22:38:28.864 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum upgrade -y linux-firmware 2024-02-28T22:38:28.948 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum upgrade -y linux-firmware 2024-02-28T22:38:30.948 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - AppStream 18 MB/s | 8.1 MB 00:00 2024-02-28T22:38:31.202 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - AppStream 16 MB/s | 8.1 MB 00:00 2024-02-28T22:38:32.607 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - BaseOS 7.0 MB/s | 2.5 MB 00:00 2024-02-28T22:38:32.844 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - BaseOS 7.4 MB/s | 2.5 MB 00:00 2024-02-28T22:38:33.514 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-02-28T22:38:33.760 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.0 MB 00:00 2024-02-28T22:38:35.594 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 27 MB/s | 19 MB 00:00 2024-02-28T22:38:36.232 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-02-28T22:38:48.811 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 656 kB/s | 6.1 MB 00:09 2024-02-28T22:38:49.289 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 665 kB/s | 6.1 MB 00:09 2024-02-28T22:38:50.278 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 15 kB 00:00 2024-02-28T22:38:51.190 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 15 kB 00:00 2024-02-28T22:38:51.882 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2024-02-28T22:38:56.921 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-02-28T22:38:59.136 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:38:59.136 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:38:59.136 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:38:59.137 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.137 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:38:59.137 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.137 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:38:59.137 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.137 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:38:59.137 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.137 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:38:59.137 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.137 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:38:59.137 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.138 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:38:59.138 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.138 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:38:59.138 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.138 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:38:59.138 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.138 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:38:59.138 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.138 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:38:59.138 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.138 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:38:59.139 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.139 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:38:59.139 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.139 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:38:59.139 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.139 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:38:59.139 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.139 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:38:59.139 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.139 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:38:59.139 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:38:59.140 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:38:59.141 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:38:59.142 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.143 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:38:59.143 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.143 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.143 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.143 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:38:59.143 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.143 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.143 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.143 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.144 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:38:59.144 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.144 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.144 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.144 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.144 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.144 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.144 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.145 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.146 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.146 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.146 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:38:59.146 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.146 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.146 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.146 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.147 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:38:59.147 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.147 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.147 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.147 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.147 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:38:59.147 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.147 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.147 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.147 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:38:59.636 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:38:59.650 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:38:59.650 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-02-28T22:38:59.650 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:38:59.650 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2024-02-28T22:38:59.651 INFO:teuthology.orchestra.run.smithi159.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-02-28T22:38:59.651 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:38:59.651 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:38:59.651 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:38:59.651 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 1 Package 2024-02-28T22:38:59.651 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:38:59.652 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 376 M 2024-02-28T22:38:59.652 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:39:13.492 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 946 kB/s | 20 MB 00:22 2024-02-28T22:39:18.604 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-02-28T22:39:20.837 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:39:20.837 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:39:20.837 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:39:20.837 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:39:20.838 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:39:20.839 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:39:20.840 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.841 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:39:20.842 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.843 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.844 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.844 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.844 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:39:20.844 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.844 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.844 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.844 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.844 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:39:20.845 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.845 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.845 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.845 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.845 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:39:20.845 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.845 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.846 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.846 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.846 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:39:20.846 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.846 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.846 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.847 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.847 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:39:20.847 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.847 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.847 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.847 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.848 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:39:20.848 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.848 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.848 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:39:20.848 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:39:21.383 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:39:21.393 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:39:21.393 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-28T22:39:21.394 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:39:21.394 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2024-02-28T22:39:21.394 INFO:teuthology.orchestra.run.smithi184.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-02-28T22:39:21.394 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:39:21.394 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:39:21.394 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:39:21.394 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 1 Package 2024-02-28T22:39:21.394 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:39:21.394 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 376 M 2024-02-28T22:39:21.394 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:39:37.751 INFO:teuthology.orchestra.run.smithi159.stdout:linux-firmware-20240219-143.el9.noarch.rpm 9.9 MB/s | 376 MB 00:38 2024-02-28T22:39:37.752 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:39:37.752 INFO:teuthology.orchestra.run.smithi159.stdout:Total 9.9 MB/s | 376 MB 00:38 2024-02-28T22:39:40.795 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:39:40.892 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:39:40.892 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:39:43.886 INFO:teuthology.orchestra.run.smithi184.stdout:linux-firmware-20240219-143.el9.noarch.rpm 17 MB/s | 376 MB 00:22 2024-02-28T22:39:43.887 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:39:43.887 INFO:teuthology.orchestra.run.smithi184.stdout:Total 17 MB/s | 376 MB 00:22 2024-02-28T22:39:44.126 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:39:44.126 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:39:46.927 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:39:47.035 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:39:47.035 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:39:50.500 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:39:50.500 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:39:51.338 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:39:51.693 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T22:39:51.778 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T22:39:52.761 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T22:39:52.762 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T22:39:53.202 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T22:39:53.202 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:39:53.202 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2024-02-28T22:39:53.202 INFO:teuthology.orchestra.run.smithi159.stdout: linux-firmware-20240219-143.el9.noarch 2024-02-28T22:39:53.202 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:39:53.202 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:39:53.499 INFO:teuthology.task.kernel:Downloading kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.a... 2024-02-28T22:39:53.500 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T22:39:53.652 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ 2024-02-28T22:39:53.653 DEBUG:teuthology.orchestra.run.smithi159:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-28T22:39:53.655 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi159.front.sepia.ceph.com to complete... 2024-02-28T22:39:57.734 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:39:58.070 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T22:39:58.155 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T22:39:59.137 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T22:39:59.137 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-02-28T22:39:59.554 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-02-28T22:39:59.554 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:39:59.554 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2024-02-28T22:39:59.554 INFO:teuthology.orchestra.run.smithi184.stdout: linux-firmware-20240219-143.el9.noarch 2024-02-28T22:39:59.554 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:39:59.554 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:39:59.865 INFO:teuthology.task.kernel:Downloading kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.b... 2024-02-28T22:39:59.866 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=bd7d00fb724897dda560070d01bc6e5c80881f15 2024-02-28T22:40:00.020 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ 2024-02-28T22:40:00.020 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/ --input-file=- 2024-02-28T22:40:00.023 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi184.front.sepia.ceph.com to complete... 2024-02-28T22:40:55.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28 22:40:55 URL:https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm [335852831/335852831] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-28T22:40:55.451 INFO:teuthology.orchestra.run.smithi159.stderr:FINISHED --2024-02-28 22:40:55-- 2024-02-28T22:40:55.451 INFO:teuthology.orchestra.run.smithi159.stderr:Total wall clock time: 1m 2s 2024-02-28T22:40:55.451 INFO:teuthology.orchestra.run.smithi159.stderr:Downloaded: 1 files, 320M in 1m 1s (5.23 MB/s) 2024-02-28T22:40:55.454 INFO:teuthology.task.kernel:Installing kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.a... 2024-02-28T22:40:55.455 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-28T22:40:57.396 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying... ######################################## 2024-02-28T22:40:57.472 INFO:teuthology.orchestra.run.smithi159.stdout:Preparing... ######################################## 2024-02-28T22:40:57.552 INFO:teuthology.orchestra.run.smithi159.stdout:Updating / installing... 2024-02-28T22:41:05.113 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-6.8.0_rc6_gbd7d00fb7248-1 ######################################## 2024-02-28T22:41:12.655 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28 22:41:12 URL:https://4.chacra.ceph.com/r/kernel/testing/bd7d00fb724897dda560070d01bc6e5c80881f15/centos/9/flavors/default/x86_64/kernel-6.8.0_rc6_gbd7d00fb7248-1.x86_64.rpm [335852831/335852831] -> "/tmp/kernel.x86_64.rpm" [1] 2024-02-28T22:41:12.656 INFO:teuthology.orchestra.run.smithi184.stderr:FINISHED --2024-02-28 22:41:12-- 2024-02-28T22:41:12.656 INFO:teuthology.orchestra.run.smithi184.stderr:Total wall clock time: 1m 13s 2024-02-28T22:41:12.656 INFO:teuthology.orchestra.run.smithi184.stderr:Downloaded: 1 files, 320M in 1m 12s (4.46 MB/s) 2024-02-28T22:41:12.660 INFO:teuthology.task.kernel:Installing kernel bd7d00fb724897dda560070d01bc6e5c80881f15 on host.b... 2024-02-28T22:41:12.660 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-02-28T22:41:14.609 INFO:teuthology.orchestra.run.smithi184.stdout:Verifying... ######################################## 2024-02-28T22:41:14.682 INFO:teuthology.orchestra.run.smithi184.stdout:Preparing... ######################################## 2024-02-28T22:41:14.762 INFO:teuthology.orchestra.run.smithi184.stdout:Updating / installing... 2024-02-28T22:41:19.240 INFO:teuthology.orchestra.run.smithi159.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-28T22:41:22.344 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-6.8.0_rc6_gbd7d00fb7248-1 ######################################## 2024-02-28T22:41:36.542 INFO:teuthology.orchestra.run.smithi184.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-02-28T22:41:41.759 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-28T22:41:41.760 DEBUG:teuthology.orchestra.run.smithi159:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-28T22:41:41.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:41:41.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/System.map 2024-02-28T22:41:41.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/config 2024-02-28T22:41:41.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel 2024-02-28T22:41:41.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch 2024-02-28T22:41:41.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86 2024-02-28T22:41:41.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto 2024-02-28T22:41:41.836 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-28T22:41:41.837 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-28T22:41:41.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-28T22:41:41.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-28T22:41:41.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-28T22:41:41.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-28T22:41:41.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-28T22:41:41.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-28T22:41:41.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel 2024-02-28T22:41:41.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu 2024-02-28T22:41:41.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce 2024-02-28T22:41:41.838 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm.ko 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ansi_cprng.ko 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/anubis.ko 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/arc4.ko 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_memcpy.ko 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_pq.ko 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-28T22:41:41.839 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_tx.ko 2024-02-28T22:41:41.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_xor.ko 2024-02-28T22:41:41.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/raid6test.ko 2024-02-28T22:41:41.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authenc.ko 2024-02-28T22:41:41.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authencesn.ko 2024-02-28T22:41:41.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blake2b_generic.ko 2024-02-28T22:41:41.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_common.ko 2024-02-28T22:41:41.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_generic.ko 2024-02-28T22:41:41.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/camellia_generic.ko 2024-02-28T22:41:41.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast5_generic.ko 2024-02-28T22:41:41.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast6_generic.ko 2024-02-28T22:41:41.840 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast_common.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ccm.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cmac.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crc32_generic.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_engine.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_user.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cts.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/des_generic.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/dh_generic.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/echainiv.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/essiv.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/fcrypt.ko 2024-02-28T22:41:41.841 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/khazad.ko 2024-02-28T22:41:41.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4.ko 2024-02-28T22:41:41.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4hc.ko 2024-02-28T22:41:41.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/md4.ko 2024-02-28T22:41:41.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/michael_mic.ko 2024-02-28T22:41:41.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcbc.ko 2024-02-28T22:41:41.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcrypt.ko 2024-02-28T22:41:41.842 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/rmd160.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/seed.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/serpent_generic.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tcrypt.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tea.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_common.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_generic.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/vmac.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/wp512.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xcbc.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xor.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xxhash_generic.ko 2024-02-28T22:41:41.843 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers 2024-02-28T22:41:41.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi 2024-02-28T22:41:41.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-28T22:41:41.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_pad.ko 2024-02-28T22:41:41.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/custom_method.ko 2024-02-28T22:41:41.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/ec_sys.ko 2024-02-28T22:41:41.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/platform_profile.ko 2024-02-28T22:41:41.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbs.ko 2024-02-28T22:41:41.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbshc.ko 2024-02-28T22:41:41.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/video.ko 2024-02-28T22:41:41.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata 2024-02-28T22:41:41.844 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/acard-ahci.ko 2024-02-28T22:41:41.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ahci_platform.ko 2024-02-28T22:41:41.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ata_generic.ko 2024-02-28T22:41:41.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/libahci_platform.ko 2024-02-28T22:41:41.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_acpi.ko 2024-02-28T22:41:41.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ali.ko 2024-02-28T22:41:41.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_amd.ko 2024-02-28T22:41:41.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_artop.ko 2024-02-28T22:41:41.845 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atiixp.ko 2024-02-28T22:41:41.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atp867x.ko 2024-02-28T22:41:41.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd640.ko 2024-02-28T22:41:41.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd64x.ko 2024-02-28T22:41:41.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cypress.ko 2024-02-28T22:41:41.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_efar.ko 2024-02-28T22:41:41.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt366.ko 2024-02-28T22:41:41.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt37x.ko 2024-02-28T22:41:41.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-28T22:41:41.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-28T22:41:41.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it8213.ko 2024-02-28T22:41:41.846 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it821x.ko 2024-02-28T22:41:41.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_jmicron.ko 2024-02-28T22:41:41.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_marvell.ko 2024-02-28T22:41:41.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_mpiix.ko 2024-02-28T22:41:41.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_netcell.ko 2024-02-28T22:41:41.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ninja32.ko 2024-02-28T22:41:41.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87410.ko 2024-02-28T22:41:41.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87415.ko 2024-02-28T22:41:41.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_oldpiix.ko 2024-02-28T22:41:41.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_opti.ko 2024-02-28T22:41:41.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_optidma.ko 2024-02-28T22:41:41.847 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pcmcia.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_piccolo.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_rdc.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sch.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_serverworks.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sil680.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sis.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sl82c105.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_triflex.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_via.ko 2024-02-28T22:41:41.848 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pdc_adma.ko 2024-02-28T22:41:41.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_inic162x.ko 2024-02-28T22:41:41.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_mv.ko 2024-02-28T22:41:41.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_nv.ko 2024-02-28T22:41:41.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_promise.ko 2024-02-28T22:41:41.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_qstor.ko 2024-02-28T22:41:41.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil.ko 2024-02-28T22:41:41.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil24.ko 2024-02-28T22:41:41.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sis.ko 2024-02-28T22:41:41.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_svw.ko 2024-02-28T22:41:41.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sx4.ko 2024-02-28T22:41:41.849 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_uli.ko 2024-02-28T22:41:41.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_via.ko 2024-02-28T22:41:41.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_vsc.ko 2024-02-28T22:41:41.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay 2024-02-28T22:41:41.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay/ks0108.ko 2024-02-28T22:41:41.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base 2024-02-28T22:41:41.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap 2024-02-28T22:41:41.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-28T22:41:41.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-28T22:41:41.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma 2024-02-28T22:41:41.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma/bcma.ko 2024-02-28T22:41:41.850 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block 2024-02-28T22:41:41.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe 2024-02-28T22:41:41.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe/aoe.ko 2024-02-28T22:41:41.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/brd.ko 2024-02-28T22:41:41.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd 2024-02-28T22:41:41.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd/drbd.ko 2024-02-28T22:41:41.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/floppy.ko 2024-02-28T22:41:41.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/loop.ko 2024-02-28T22:41:41.851 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/nbd.ko 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk/null_blk.ko 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/pktcdvd.ko 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/rbd.ko 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/virtio_blk.ko 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkfront.ko 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram 2024-02-28T22:41:41.852 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram/zram.ko 2024-02-28T22:41:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char 2024-02-28T22:41:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hangcheck-timer.ko 2024-02-28T22:41:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random 2024-02-28T22:41:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-28T22:41:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-28T22:41:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-28T22:41:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/via-rng.ko 2024-02-28T22:41:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-28T22:41:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi 2024-02-28T22:41:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-28T22:41:41.853 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-28T22:41:41.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-28T22:41:41.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-28T22:41:41.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-28T22:41:41.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-28T22:41:41.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/lp.ko 2024-02-28T22:41:41.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave 2024-02-28T22:41:41.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave/mwave.ko 2024-02-28T22:41:41.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ppdev.ko 2024-02-28T22:41:41.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tlclk.ko 2024-02-28T22:41:41.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm 2024-02-28T22:41:41.854 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm.ko 2024-02-28T22:41:41.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-28T22:41:41.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-28T22:41:41.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-28T22:41:41.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-28T22:41:41.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-28T22:41:41.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/uv_mmtimer.ko 2024-02-28T22:41:41.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/virtio_console.ko 2024-02-28T22:41:41.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq 2024-02-28T22:41:41.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-28T22:41:41.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-28T22:41:41.855 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-28T22:41:41.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-28T22:41:41.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-28T22:41:41.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-28T22:41:41.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto 2024-02-28T22:41:41.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp 2024-02-28T22:41:41.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-28T22:41:41.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp.ko 2024-02-28T22:41:41.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel 2024-02-28T22:41:41.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat 2024-02-28T22:41:41.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common 2024-02-28T22:41:41.856 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-aes.ko 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-sha.ko 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca/dca.ko 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma 2024-02-28T22:41:41.857 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/amd64_edac.ko 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/e752x_edac.ko 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/edac_mce_amd.ko 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3000_edac.ko 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3200_edac.ko 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5100_edac.ko 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5400_edac.ko 2024-02-28T22:41:41.858 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7300_edac.ko 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7core_edac.ko 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i82975x_edac.ko 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/ie31200_edac.ko 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/sb_edac.ko 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/x38_edac.ko 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/edd.ko 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-ich.ko 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-28T22:41:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid 2024-02-28T22:41:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-appleir.ko 2024-02-28T22:41:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-aureal.ko 2024-02-28T22:41:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-axff.ko 2024-02-28T22:41:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-dr.ko 2024-02-28T22:41:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elecom.ko 2024-02-28T22:41:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elo.ko 2024-02-28T22:41:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-emsff.ko 2024-02-28T22:41:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gaff.ko 2024-02-28T22:41:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gt683r.ko 2024-02-28T22:41:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gyration.ko 2024-02-28T22:41:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-28T22:41:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-28T22:41:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtekff.ko 2024-02-28T22:41:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-hyperv.ko 2024-02-28T22:41:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-icade.ko 2024-02-28T22:41:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-keytouch.ko 2024-02-28T22:41:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-kye.ko 2024-02-28T22:41:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lcpower.ko 2024-02-28T22:41:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-led.ko 2024-02-28T22:41:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lenovo.ko 2024-02-28T22:41:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-28T22:41:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-28T22:41:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-multitouch.ko 2024-02-28T22:41:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-ortek.ko 2024-02-28T22:41:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-penmount.ko 2024-02-28T22:41:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-petalynx.ko 2024-02-28T22:41:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-picolcd.ko 2024-02-28T22:41:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-pl.ko 2024-02-28T22:41:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-plantronics.ko 2024-02-28T22:41:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-primax.ko 2024-02-28T22:41:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-rmi.ko 2024-02-28T22:41:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-28T22:41:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-common.ko 2024-02-28T22:41:41.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-28T22:41:41.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-28T22:41:41.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-28T22:41:41.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-28T22:41:41.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-28T22:41:41.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-28T22:41:41.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-28T22:41:41.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-28T22:41:41.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-28T22:41:41.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat.ko 2024-02-28T22:41:41.863 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-saitek.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-samsung.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sjoy.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sony.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-speedlink.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-steelseries.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sunplus.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tivo.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tmff.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-topseed.ko 2024-02-28T22:41:41.864 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-twinhan.ko 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-uclogic.ko 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-waltop.ko 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-wiimote.ko 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-xinmo.ko 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zpff.ko 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zydacron.ko 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/uhid.ko 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/wacom.ko 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_balloon.ko 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_utils.ko 2024-02-28T22:41:41.865 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_vmbus.ko 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru.ko 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru3.ko 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7414.ko 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7418.ko 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adc128d818.ko 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1025.ko 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1026.ko 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1029.ko 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1031.ko 2024-02-28T22:41:41.866 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm9240.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ads7828.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7410.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7411.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7462.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7470.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7475.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7x10.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/amc6821.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/applesmc.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asb100.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asc7621.ko 2024-02-28T22:41:41.867 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-28T22:41:41.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/atxp1.ko 2024-02-28T22:41:41.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/coretemp.ko 2024-02-28T22:41:41.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-28T22:41:41.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dme1737.ko 2024-02-28T22:41:41.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds1621.ko 2024-02-28T22:41:41.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds620.ko 2024-02-28T22:41:41.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc1403.ko 2024-02-28T22:41:41.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc6w201.ko 2024-02-28T22:41:41.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71805f.ko 2024-02-28T22:41:41.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71882fg.ko 2024-02-28T22:41:41.868 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f75375s.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fam15h_power.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fschmd.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g760a.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g762.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl518sm.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl520sm.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5500_temp.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5k_amb.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmaem.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmpex.ko 2024-02-28T22:41:41.869 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina209.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina2xx.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/it87.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k10temp.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k8temp.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lineage-pem.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm63.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm73.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm75.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm77.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm78.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm80.ko 2024-02-28T22:41:41.870 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm83.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm85.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm87.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm90.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm92.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm93.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95234.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95241.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95245.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc2945.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4151.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4215.ko 2024-02-28T22:41:41.871 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4222.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4245.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4260.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4261.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max16065.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1619.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1668.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max197.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6639.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6650.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6697.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/mcp3021.ko 2024-02-28T22:41:41.872 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6683.ko 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775-core.ko 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775.ko 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct7802.ko 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87360.ko 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87427.ko 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pcf8591.ko 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-28T22:41:41.873 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/powr1220.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5627.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5636.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-28T22:41:41.874 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht15.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht21.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/shtc1.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sis5595.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47b397.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m1.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m192.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/thmc50.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp102.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp103.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp401.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp421.ko 2024-02-28T22:41:41.875 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via-cputemp.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via686a.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt1211.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt8231.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627ehf.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627hf.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83781d.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83791d.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83792d.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83793.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83795.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l785ts.ko 2024-02-28T22:41:41.876 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l786ng.ko 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-28T22:41:41.877 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-28T22:41:41.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-28T22:41:41.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-28T22:41:41.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-28T22:41:41.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-28T22:41:41.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-28T22:41:41.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-28T22:41:41.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-28T22:41:41.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-28T22:41:41.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-28T22:41:41.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-28T22:41:41.878 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-dev.ko 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-mux.ko 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-smbus.ko 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-stub.ko 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband 2024-02-28T22:41:41.879 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core 2024-02-28T22:41:41.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-28T22:41:41.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_core.ko 2024-02-28T22:41:41.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-28T22:41:41.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-28T22:41:41.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-28T22:41:41.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-28T22:41:41.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-28T22:41:41.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw 2024-02-28T22:41:41.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4 2024-02-28T22:41:41.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-28T22:41:41.880 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert 2024-02-28T22:41:41.881 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/gameport.ko 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/joydev.ko 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard 2024-02-28T22:41:41.882 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-28T22:41:41.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse 2024-02-28T22:41:41.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/appletouch.ko 2024-02-28T22:41:41.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/bcm5974.ko 2024-02-28T22:41:41.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/cyapatp.ko 2024-02-28T22:41:41.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-28T22:41:41.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/sermouse.ko 2024-02-28T22:41:41.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-28T22:41:41.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-28T22:41:41.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-28T22:41:41.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4 2024-02-28T22:41:41.883 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/altera_ps2.ko 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/arc_ps2.ko 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/serio_raw.ko 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/sparse-keymap.ko 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-blinkm.ko 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lm3530.ko 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lp3944.ko 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-ss4200.ko 2024-02-28T22:41:41.884 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger 2024-02-28T22:41:41.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-28T22:41:41.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-28T22:41:41.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-28T22:41:41.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-28T22:41:41.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-28T22:41:41.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-28T22:41:41.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-28T22:41:41.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-28T22:41:41.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-28T22:41:41.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md 2024-02-28T22:41:41.885 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache/bcache.ko 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-bio-prison.ko 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache-smq.ko 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache.ko 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-crypt.ko 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-delay.ko 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-flakey.ko 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-log-userspace.ko 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-multipath.ko 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-queue-length.ko 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-raid.ko 2024-02-28T22:41:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-round-robin.ko 2024-02-28T22:41:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-service-time.ko 2024-02-28T22:41:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-switch.ko 2024-02-28T22:41:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-thin-pool.ko 2024-02-28T22:41:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-verity.ko 2024-02-28T22:41:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data 2024-02-28T22:41:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-28T22:41:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid0.ko 2024-02-28T22:41:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid1.ko 2024-02-28T22:41:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid10.ko 2024-02-28T22:41:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid456.ko 2024-02-28T22:41:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message 2024-02-28T22:41:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion 2024-02-28T22:41:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptbase.ko 2024-02-28T22:41:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptctl.ko 2024-02-28T22:41:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptfc.ko 2024-02-28T22:41:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptlan.ko 2024-02-28T22:41:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptsas.ko 2024-02-28T22:41:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptscsih.ko 2024-02-28T22:41:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptspi.ko 2024-02-28T22:41:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd 2024-02-28T22:41:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_ich.ko 2024-02-28T22:41:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_sch.ko 2024-02-28T22:41:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/mfd-core.ko 2024-02-28T22:41:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/sm501.ko 2024-02-28T22:41:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/viperboard.ko 2024-02-28T22:41:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/vx855.ko 2024-02-28T22:41:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/wl1273-core.ko 2024-02-28T22:41:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc 2024-02-28T22:41:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl 2024-02-28T22:41:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-28T22:41:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds9802als.ko 2024-02-28T22:41:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds990x.ko 2024-02-28T22:41:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/bh1770glc.ko 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710/cb710.ko 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/at24.ko 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/max6875.ko 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/enclosure.ko 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/hpilo.ko 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29003.ko 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29020.ko 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d 2024-02-28T22:41:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-me.ko 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-txe.ko 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei.ko 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-28T22:41:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_7xx1.ko 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_core.ko 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tsl2550.ko 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_balloon.ko 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding/bonding.ko 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-28T22:41:41.892 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-28T22:41:41.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-28T22:41:41.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx 2024-02-28T22:41:41.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-28T22:41:41.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dummy.ko 2024-02-28T22:41:41.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/eql.ko 2024-02-28T22:41:41.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet 2024-02-28T22:41:41.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com 2024-02-28T22:41:41.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-28T22:41:41.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-28T22:41:41.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-28T22:41:41.893 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-28T22:41:41.894 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-28T22:41:41.895 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-28T22:41:41.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx 2024-02-28T22:41:41.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-28T22:41:41.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-28T22:41:41.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom 2024-02-28T22:41:41.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-28T22:41:41.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-28T22:41:41.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-28T22:41:41.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-28T22:41:41.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-28T22:41:41.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet 2024-02-28T22:41:41.896 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-28T22:41:41.897 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-28T22:41:41.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-28T22:41:41.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-28T22:41:41.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-28T22:41:41.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco 2024-02-28T22:41:41.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic 2024-02-28T22:41:41.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-28T22:41:41.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec 2024-02-28T22:41:41.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip 2024-02-28T22:41:41.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-28T22:41:41.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-28T22:41:41.898 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dnet.ko 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ethoc.ko 2024-02-28T22:41:41.899 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/fealnx.ko 2024-02-28T22:41:41.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel 2024-02-28T22:41:41.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-28T22:41:41.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000 2024-02-28T22:41:41.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-28T22:41:41.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e 2024-02-28T22:41:41.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-28T22:41:41.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k 2024-02-28T22:41:41.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-28T22:41:41.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e 2024-02-28T22:41:41.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-28T22:41:41.900 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/jme.ko 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell 2024-02-28T22:41:41.901 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-28T22:41:41.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-28T22:41:41.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-28T22:41:41.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox 2024-02-28T22:41:41.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-28T22:41:41.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-28T22:41:41.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-28T22:41:41.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-28T22:41:41.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-28T22:41:41.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-28T22:41:41.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel 2024-02-28T22:41:41.902 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines 2024-02-28T22:41:41.903 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-28T22:41:41.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-28T22:41:41.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic 2024-02-28T22:41:41.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-28T22:41:41.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-28T22:41:41.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-28T22:41:41.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-28T22:41:41.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-28T22:41:41.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc 2024-02-28T22:41:41.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-28T22:41:41.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek 2024-02-28T22:41:41.904 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-28T22:41:41.905 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-28T22:41:41.906 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-28T22:41:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-28T22:41:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti 2024-02-28T22:41:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-28T22:41:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti 2024-02-28T22:41:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-28T22:41:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via 2024-02-28T22:41:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-28T22:41:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-28T22:41:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet 2024-02-28T22:41:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-28T22:41:41.907 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/geneve.ko 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ifb.ko 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvlan.ko 2024-02-28T22:41:41.908 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvtap.ko 2024-02-28T22:41:41.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio 2024-02-28T22:41:41.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio.ko 2024-02-28T22:41:41.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-28T22:41:41.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-28T22:41:41.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-28T22:41:41.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mii.ko 2024-02-28T22:41:41.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/net_failover.ko 2024-02-28T22:41:41.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/netconsole.ko 2024-02-28T22:41:41.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/nlmon.ko 2024-02-28T22:41:41.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs 2024-02-28T22:41:41.909 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/amd.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm87xx.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/broadcom.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/cicada.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/davicom.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/dp83640.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/et1011c.ko 2024-02-28T22:41:41.910 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/icplus.ko 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/lxt.ko 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/marvell.ko 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/micrel.ko 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/national.ko 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/phylink.ko 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/qsemi.ko 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/realtek.ko 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/smsc.ko 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/ste10Xp.ko 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/vitesse.ko 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp 2024-02-28T22:41:41.911 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-28T22:41:41.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_async.ko 2024-02-28T22:41:41.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-28T22:41:41.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-28T22:41:41.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-28T22:41:41.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-28T22:41:41.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppoe.ko 2024-02-28T22:41:41.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppox.ko 2024-02-28T22:41:41.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pptp.ko 2024-02-28T22:41:41.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip 2024-02-28T22:41:41.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slhc.ko 2024-02-28T22:41:41.912 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slip.ko 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/sungem_phy.ko 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tap.ko 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team.ko 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_random.ko 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tun.ko 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/veth.ko 2024-02-28T22:41:41.913 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/virtio_net.ko 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan/vxlan.ko 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netfront.ko 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb/ntb.ko 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host 2024-02-28T22:41:41.914 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme-core.ko 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme.ko 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport.ko 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_cs.ko 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_pc.ko 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_serial.ko 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/xen-pcifront.ko 2024-02-28T22:41:41.915 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia 2024-02-28T22:41:41.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/i82092.ko 2024-02-28T22:41:41.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/pd6729.ko 2024-02-28T22:41:41.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-28T22:41:41.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl 2024-02-28T22:41:41.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel 2024-02-28T22:41:41.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-28T22:41:41.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform 2024-02-28T22:41:41.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86 2024-02-28T22:41:41.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-28T22:41:41.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acerhdf.ko 2024-02-28T22:41:41.916 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/hdaps.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel_ips.ko 2024-02-28T22:41:41.917 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-28T22:41:41.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-28T22:41:41.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-28T22:41:41.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-28T22:41:41.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-28T22:41:41.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-28T22:41:41.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-28T22:41:41.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-28T22:41:41.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-28T22:41:41.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi.ko 2024-02-28T22:41:41.918 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps_parport.ko 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/pps_core.ko 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp.ko 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp_kvm.ko 2024-02-28T22:41:41.919 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc 2024-02-28T22:41:41.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-28T22:41:41.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-28T22:41:41.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-28T22:41:41.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-28T22:41:41.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-28T22:41:41.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-28T22:41:41.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-28T22:41:41.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-28T22:41:41.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-28T22:41:41.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-28T22:41:41.920 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-em3027.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-max6900.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-28T22:41:41.921 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-x1205.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-9xxx.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-sas.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-xxxx.ko 2024-02-28T22:41:41.922 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/BusLogic.ko 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/a100u2w.ko 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/advansys.ko 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/am53c974.ko 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/atp870u.ko 2024-02-28T22:41:41.923 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi 2024-02-28T22:41:41.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-28T22:41:41.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa 2024-02-28T22:41:41.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa/bfa.ko 2024-02-28T22:41:41.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc 2024-02-28T22:41:41.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-28T22:41:41.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i 2024-02-28T22:41:41.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-28T22:41:41.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ch.ko 2024-02-28T22:41:41.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor 2024-02-28T22:41:41.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-28T22:41:41.924 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dc395x.ko 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-28T22:41:41.925 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dmx3191d.ko 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esp_scsi.ko 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic/fnic.ko 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hpsa.ko 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hptiop.ko 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hv_storvsc.ko 2024-02-28T22:41:41.926 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/initio.ko 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ipr.ko 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ips.ko 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci/isci.ko 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc/libfc.ko 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi.ko 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas 2024-02-28T22:41:41.927 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas/libsas.ko 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid.ko 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-28T22:41:41.928 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvumi.ko 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pmcraid.ko 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla1280.ko 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/raid_class.ko 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_debug.ko 2024-02-28T22:41:41.929 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ses.ko 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/st.ko 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/stex.ko 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/virtio_scsi.ko 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-28T22:41:41.930 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/wd719x.ko 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb/ssb.ko 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_file.ko 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_iblock.ko 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_mod.ko 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_pscsi.ko 2024-02-28T22:41:41.931 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_user.ko 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-28T22:41:41.932 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-28T22:41:41.933 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_gsm.ko 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_hdlc.ko 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/nozomi.ko 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/arc_uart.ko 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-28T22:41:41.934 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio.ko 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_aec.ko 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_cif.ko 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_pci_generic.ko 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_sercos3.ko 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb 2024-02-28T22:41:41.935 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-acm.ko 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usblp.ko 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usbtmc.ko 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/mdc800.ko 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/microtek.ko 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/adutux.ko 2024-02-28T22:41:41.936 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/appledisplay.ko 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi26.ko 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi62.ko 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ezusb.ko 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/idmouse.ko 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/iowarrior.ko 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ldusb.ko 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/legousbtower.ko 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-28T22:41:41.937 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usb3503.ko 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usblcd.ko 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/uss720.ko 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/yurex.ko 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy/phy-generic.ko 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/aircable.ko 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ark3116.ko 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ch341.ko 2024-02-28T22:41:41.938 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cp210x.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cyberjack.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/empeg.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_ti.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipaq.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipw.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ir-usb.ko 2024-02-28T22:41:41.939 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mct_u232.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7720.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7840.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/navman.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/omninet.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/opticon.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/option.ko 2024-02-28T22:41:41.940 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/oti6858.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/pl2303.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcaux.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcserial.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/quatech2.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/safe_serial.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/sierra.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ssu100.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/symbolserial.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-28T22:41:41.941 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_debug.ko 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/visor.ko 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/whiteheat.ko 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/uas.ko 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-28T22:41:41.942 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-karma.ko 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/usb-storage.ko 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-28T22:41:41.943 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-28T22:41:41.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio 2024-02-28T22:41:41.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci 2024-02-28T22:41:41.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-28T22:41:41.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-28T22:41:41.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio.ko 2024-02-28T22:41:41.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-28T22:41:41.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost 2024-02-28T22:41:41.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost.ko 2024-02-28T22:41:41.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-28T22:41:41.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_net.ko 2024-02-28T22:41:41.944 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_scsi.ko 2024-02-28T22:41:41.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video 2024-02-28T22:41:41.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight 2024-02-28T22:41:41.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/apple_bl.ko 2024-02-28T22:41:41.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/lcd.ko 2024-02-28T22:41:41.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-28T22:41:41.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio 2024-02-28T22:41:41.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio.ko 2024-02-28T22:41:41.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_balloon.ko 2024-02-28T22:41:41.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_mmio.ko 2024-02-28T22:41:41.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci.ko 2024-02-28T22:41:41.945 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_ring.ko 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2482.ko 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2490.ko 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-28T22:41:41.946 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-28T22:41:41.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-28T22:41:41.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-28T22:41:41.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-28T22:41:41.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-28T22:41:41.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-28T22:41:41.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-28T22:41:41.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/wire.ko 2024-02-28T22:41:41.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog 2024-02-28T22:41:41.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-28T22:41:41.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-28T22:41:41.947 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/hpwdt.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/i6300esb.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ib700wdt.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ibmasr.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it87_wdt.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/machzwd.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/nv_tco.ko 2024-02-28T22:41:41.948 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/softdog.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/via_wdt.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/wdt_pci.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/xen_wdt.ko 2024-02-28T22:41:41.949 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-evtchn.ko 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntalloc.ko 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntdev.ko 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-privcmd.ko 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p 2024-02-28T22:41:41.950 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p/9p.ko 2024-02-28T22:41:41.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs 2024-02-28T22:41:41.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs/affs.ko 2024-02-28T22:41:41.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs 2024-02-28T22:41:41.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs/befs.ko 2024-02-28T22:41:41.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/binfmt_misc.ko 2024-02-28T22:41:41.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs 2024-02-28T22:41:41.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs/btrfs.ko 2024-02-28T22:41:41.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles 2024-02-28T22:41:41.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles/cachefiles.ko 2024-02-28T22:41:41.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph 2024-02-28T22:41:41.951 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph/ceph.ko 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda/coda.ko 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs/cramfs.ko 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm/dlm.ko 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs/f2fs.ko 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat 2024-02-28T22:41:41.952 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/fat.ko 2024-02-28T22:41:41.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/msdos.ko 2024-02-28T22:41:41.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/vfat.ko 2024-02-28T22:41:41.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse 2024-02-28T22:41:41.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/cuse.ko 2024-02-28T22:41:41.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/fuse.ko 2024-02-28T22:41:41.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2 2024-02-28T22:41:41.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2/gfs2.ko 2024-02-28T22:41:41.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs 2024-02-28T22:41:41.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs/hfs.ko 2024-02-28T22:41:41.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus 2024-02-28T22:41:41.953 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus/hfsplus.ko 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs/isofs.ko 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs/jfs.ko 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd/lockd.ko 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix/minix.ko 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs/netfs.ko 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs 2024-02-28T22:41:41.954 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfs.ko 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv3.ko 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv4.ko 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/grace.ko 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/nfs_acl.ko 2024-02-28T22:41:41.955 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd 2024-02-28T22:41:41.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd/nfsd.ko 2024-02-28T22:41:41.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2 2024-02-28T22:41:41.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2/nilfs2.ko 2024-02-28T22:41:41.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls 2024-02-28T22:41:41.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-celtic.ko 2024-02-28T22:41:41.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-centeuro.ko 2024-02-28T22:41:41.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-croatian.ko 2024-02-28T22:41:41.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-cyrillic.ko 2024-02-28T22:41:41.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-gaelic.ko 2024-02-28T22:41:41.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-greek.ko 2024-02-28T22:41:41.956 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-iceland.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-inuit.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-roman.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-romanian.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-turkish.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1250.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1251.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1255.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp737.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp775.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp850.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp852.ko 2024-02-28T22:41:41.957 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp855.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp857.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp860.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp861.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp862.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp863.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp864.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp865.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp866.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp869.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp874.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp932.ko 2024-02-28T22:41:41.958 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp936.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp949.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp950.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_euc-jp.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-1.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-13.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-14.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-15.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-2.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-3.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-4.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-5.ko 2024-02-28T22:41:41.959 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-6.ko 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-7.ko 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-9.ko 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-r.ko 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-ru.ko 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-u.ko 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_utf8.ko 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm 2024-02-28T22:41:41.960 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-28T22:41:41.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs 2024-02-28T22:41:41.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-28T22:41:41.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2.ko 2024-02-28T22:41:41.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-28T22:41:41.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-28T22:41:41.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-28T22:41:41.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs 2024-02-28T22:41:41.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs/overlay.ko 2024-02-28T22:41:41.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore 2024-02-28T22:41:41.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore/ramoops.ko 2024-02-28T22:41:41.961 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs/reiserfs.ko 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs/romfs.ko 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client/cifs.ko 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_arc4.ko 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_md4.ko 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs/squashfs.ko 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv 2024-02-28T22:41:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv/sysv.ko 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf/udf.ko 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs/ufs.ko 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs/xfs.ko 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu/rcutorture.ko 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/torture.ko 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace 2024-02-28T22:41:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-28T22:41:41.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib 2024-02-28T22:41:41.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/asn1_encoder.ko 2024-02-28T22:41:41.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc-itu-t.ko 2024-02-28T22:41:41.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc8.ko 2024-02-28T22:41:41.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto 2024-02-28T22:41:41.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libarc4.ko 2024-02-28T22:41:41.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libdes.ko 2024-02-28T22:41:41.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/libcrc32c.ko 2024-02-28T22:41:41.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lru_cache.ko 2024-02-28T22:41:41.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4 2024-02-28T22:41:41.964 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4_compress.ko 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4hc_compress.ko 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math/cordic.ko 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6/raid6_pq.ko 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_bm.ko 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_fsm.ko 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_kmp.ko 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd 2024-02-28T22:41:41.965 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd/zstd_compress.ko 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm/hwpoison-inject.ko 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/6lowpan.ko 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_dest.ko 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_fragment.ko 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_hop.ko 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_mobility.ko 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_routing.ko 2024-02-28T22:41:41.966 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_udp.ko 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/garp.ko 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/mrp.ko 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/p8022.ko 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/psnap.ko 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/stp.ko 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q/8021q.ko 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet.ko 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_fd.ko 2024-02-28T22:41:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_rdma.ko 2024-02-28T22:41:41.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_virtio.ko 2024-02-28T22:41:41.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv 2024-02-28T22:41:41.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv/batman-adv.ko 2024-02-28T22:41:41.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge 2024-02-28T22:41:41.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/br_netfilter.ko 2024-02-28T22:41:41.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/bridge.ko 2024-02-28T22:41:41.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter 2024-02-28T22:41:41.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-28T22:41:41.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-28T22:41:41.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-28T22:41:41.968 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-28T22:41:41.969 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtables.ko 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph/libceph.ko 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/failover.ko 2024-02-28T22:41:41.970 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/pktgen.ko 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp.ko 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_diag.ko 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv4.ko 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv6.ko 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver/dns_resolver.ko 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/dsa_core.ko 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_brcm.ko 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_dsa.ko 2024-02-28T22:41:41.971 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_none.ko 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_trailer.ko 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154.ko 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ah4.ko 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/esp4.ko 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/fou.ko 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/gre.ko 2024-02-28T22:41:41.972 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/inet_diag.ko 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_gre.ko 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_tunnel.ko 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_vti.ko 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipcomp.ko 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipip.ko 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-28T22:41:41.973 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-28T22:41:41.974 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_bic.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_dctcp.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_diag.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_highspeed.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_htcp.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_hybla.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_illinois.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_lp.ko 2024-02-28T22:41:41.975 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_scalable.ko 2024-02-28T22:41:41.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_vegas.ko 2024-02-28T22:41:41.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_veno.ko 2024-02-28T22:41:41.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_westwood.ko 2024-02-28T22:41:41.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_yeah.ko 2024-02-28T22:41:41.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tunnel4.ko 2024-02-28T22:41:41.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_diag.ko 2024-02-28T22:41:41.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_tunnel.ko 2024-02-28T22:41:41.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-28T22:41:41.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6 2024-02-28T22:41:41.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ah6.ko 2024-02-28T22:41:41.976 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/esp6.ko 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/fou6.ko 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_tunnel.ko 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_vti.ko 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ipcomp6.ko 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-28T22:41:41.977 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-28T22:41:41.978 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/sit.ko 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/tunnel6.ko 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key/af_key.ko 2024-02-28T22:41:41.979 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_core.ko 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_eth.ko 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip.ko 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip6.ko 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_netlink.ko 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ppp.ko 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc/llc.ko 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154/mac802154.ko 2024-02-28T22:41:41.980 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls 2024-02-28T22:41:41.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls/mpls_gso.ko 2024-02-28T22:41:41.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter 2024-02-28T22:41:41.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset 2024-02-28T22:41:41.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set.ko 2024-02-28T22:41:41.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-28T22:41:41.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-28T22:41:41.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-28T22:41:41.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-28T22:41:41.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-28T22:41:41.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-28T22:41:41.981 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-28T22:41:41.982 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-28T22:41:41.983 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conncount.ko 2024-02-28T22:41:41.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack.ko 2024-02-28T22:41:41.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-28T22:41:41.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-28T22:41:41.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-28T22:41:41.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-28T22:41:41.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-28T22:41:41.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-28T22:41:41.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-28T22:41:41.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-28T22:41:41.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-28T22:41:41.984 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_log_syslog.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_irc.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_sip.ko 2024-02-28T22:41:41.985 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_tables.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_log.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_chain_nat.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_compat.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_ct.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-28T22:41:41.986 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fib.ko 2024-02-28T22:41:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-28T22:41:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_hash.ko 2024-02-28T22:41:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_limit.ko 2024-02-28T22:41:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_log.ko 2024-02-28T22:41:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_masq.ko 2024-02-28T22:41:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_nat.ko 2024-02-28T22:41:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_numgen.ko 2024-02-28T22:41:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_queue.ko 2024-02-28T22:41:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_quota.ko 2024-02-28T22:41:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_redir.ko 2024-02-28T22:41:41.987 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject_inet.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_socket.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_tunnel.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_AUDIT.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CT.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_DSCP.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HL.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HMARK.ko 2024-02-28T22:41:41.988 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-28T22:41:41.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LED.ko 2024-02-28T22:41:41.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LOG.ko 2024-02-28T22:41:41.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-28T22:41:41.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NETMAP.ko 2024-02-28T22:41:41.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFLOG.ko 2024-02-28T22:41:41.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-28T22:41:41.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_RATEEST.ko 2024-02-28T22:41:41.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-28T22:41:41.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_SECMARK.ko 2024-02-28T22:41:41.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-28T22:41:41.989 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TEE.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TPROXY.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TRACE.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_addrtype.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_bpf.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cgroup.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cluster.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_comment.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connbytes.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlabel.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlimit.ko 2024-02-28T22:41:41.990 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connmark.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_conntrack.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cpu.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dccp.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_devgroup.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dscp.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ecn.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_esp.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hashlimit.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_helper.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hl.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipcomp.ko 2024-02-28T22:41:41.991 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_iprange.ko 2024-02-28T22:41:41.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipvs.ko 2024-02-28T22:41:41.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_l2tp.ko 2024-02-28T22:41:41.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_length.ko 2024-02-28T22:41:41.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_limit.ko 2024-02-28T22:41:41.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mac.ko 2024-02-28T22:41:41.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mark.ko 2024-02-28T22:41:41.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_multiport.ko 2024-02-28T22:41:41.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nat.ko 2024-02-28T22:41:41.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nfacct.ko 2024-02-28T22:41:41.992 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_osf.ko 2024-02-28T22:41:41.993 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_owner.ko 2024-02-28T22:41:41.993 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_physdev.ko 2024-02-28T22:41:41.993 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_pkttype.ko 2024-02-28T22:41:41.993 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_policy.ko 2024-02-28T22:41:41.993 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_quota.ko 2024-02-28T22:41:41.993 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_rateest.ko 2024-02-28T22:41:41.993 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_realm.ko 2024-02-28T22:41:41.993 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_recent.ko 2024-02-28T22:41:41.993 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_sctp.ko 2024-02-28T22:41:41.993 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_set.ko 2024-02-28T22:41:41.993 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_socket.ko 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_state.ko 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_statistic.ko 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_string.ko 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_tcpmss.ko 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_time.ko 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_u32.ko 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink/netlink_diag.ko 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh/nsh.ko 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch 2024-02-28T22:41:41.994 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/openvswitch.ko 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-geneve.ko 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-gre.ko 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-vxlan.ko 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet/af_packet_diag.ko 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds.ko 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_rdma.ko 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_tcp.ko 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_csum.ko 2024-02-28T22:41:41.995 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_gact.ko 2024-02-28T22:41:41.996 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_mirred.ko 2024-02-28T22:41:41.996 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_nat.ko 2024-02-28T22:41:41.996 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_pedit.ko 2024-02-28T22:41:41.996 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_police.ko 2024-02-28T22:41:41.996 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_simple.ko 2024-02-28T22:41:41.996 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_skbedit.ko 2024-02-28T22:41:41.996 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_vlan.ko 2024-02-28T22:41:41.996 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_basic.ko 2024-02-28T22:41:41.996 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_bpf.ko 2024-02-28T22:41:41.996 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_flow.ko 2024-02-28T22:41:41.996 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_fw.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_route.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_u32.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_cmp.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_ipset.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_meta.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_nbyte.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_text.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_u32.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_choke.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_codel.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_drr.ko 2024-02-28T22:41:41.997 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_fq.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_gred.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hfsc.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hhf.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_htb.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_ingress.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio_lib.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_multiq.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_netem.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_pie.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_plug.ko 2024-02-28T22:41:41.998 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_prio.ko 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_qfq.ko 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_red.ko 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfb.ko 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfq.ko 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_tbf.ko 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_teql.ko 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp.ko 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp_diag.ko 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss 2024-02-28T22:41:41.999 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/sunrpc.ko 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/diag.ko 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/tipc.ko 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix/unix_diag.ko 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-28T22:41:42.000 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock.ko 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys/trusted.ko 2024-02-28T22:41:42.001 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib/irqbypass.ko 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias.bin 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.alias.bin 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.bin 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.modinfo 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep.bin 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.devname 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.order 2024-02-28T22:41:42.002 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.softdep 2024-02-28T22:41:42.003 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols 2024-02-28T22:41:42.003 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols.bin 2024-02-28T22:41:42.003 INFO:teuthology.orchestra.run.smithi159.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T22:41:42.008 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:41:42.008 DEBUG:teuthology.orchestra.run.smithi159:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-28T22:41:42.031 INFO:teuthology.orchestra.run.smithi159.stdout:postinstall scriptlet (using /bin/sh): 2024-02-28T22:41:42.031 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-28T22:41:42.031 INFO:teuthology.orchestra.run.smithi159.stdout: /usr/bin/kernel-install add 6.8.0-rc6-gbd7d00fb7248 /lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T22:41:42.031 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2024-02-28T22:41:42.031 INFO:teuthology.orchestra.run.smithi159.stdout:for file in vmlinuz System.map config; do 2024-02-28T22:41:42.031 INFO:teuthology.orchestra.run.smithi159.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248"; then 2024-02-28T22:41:42.032 INFO:teuthology.orchestra.run.smithi159.stdout: cp "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248" 2024-02-28T22:41:42.032 INFO:teuthology.orchestra.run.smithi159.stdout: fi 2024-02-28T22:41:42.032 INFO:teuthology.orchestra.run.smithi159.stdout:done 2024-02-28T22:41:42.032 INFO:teuthology.orchestra.run.smithi159.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-28T22:41:42.032 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-28T22:41:42.032 INFO:teuthology.orchestra.run.smithi159.stdout:new-kernel-pkg --remove 6.8.0-rc6-gbd7d00fb7248 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc6-gbd7d00fb7248.img 2024-02-28T22:41:42.032 INFO:teuthology.orchestra.run.smithi159.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-28T22:41:42.032 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-install remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:41:42.032 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2024-02-28T22:41:42.032 INFO:teuthology.orchestra.run.smithi159.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-28T22:41:42.032 INFO:teuthology.orchestra.run.smithi159.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-28T22:41:42.033 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/update-bootloader --remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:41:42.033 INFO:teuthology.orchestra.run.smithi159.stdout:fi 2024-02-28T22:41:42.033 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -qi grub2-tools 2024-02-28T22:41:42.108 INFO:teuthology.orchestra.run.smithi159.stdout:Name : grub2-tools 2024-02-28T22:41:42.109 INFO:teuthology.orchestra.run.smithi159.stdout:Epoch : 1 2024-02-28T22:41:42.109 INFO:teuthology.orchestra.run.smithi159.stdout:Version : 2.06 2024-02-28T22:41:42.109 INFO:teuthology.orchestra.run.smithi159.stdout:Release : 68.el9 2024-02-28T22:41:42.109 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: x86_64 2024-02-28T22:41:42.109 INFO:teuthology.orchestra.run.smithi159.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-28T22:41:42.109 INFO:teuthology.orchestra.run.smithi159.stdout:Group : Unspecified 2024-02-28T22:41:42.109 INFO:teuthology.orchestra.run.smithi159.stdout:Size : 8264254 2024-02-28T22:41:42.109 INFO:teuthology.orchestra.run.smithi159.stdout:License : GPLv3+ 2024-02-28T22:41:42.109 INFO:teuthology.orchestra.run.smithi159.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-28T22:41:42.109 INFO:teuthology.orchestra.run.smithi159.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-28T22:41:42.109 INFO:teuthology.orchestra.run.smithi159.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout:Packager : builder@centos.org 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout:Vendor : CentOS 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout:Summary : Support tools for GRUB. 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout:Description : 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout:hardware devices. 2024-02-28T22:41:42.110 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:41:42.111 INFO:teuthology.orchestra.run.smithi159.stdout:This subpackage provides tools for support of all platforms. 2024-02-28T22:41:42.112 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-28T22:41:42.112 INFO:teuthology.task.kernel:Updating grub on smithi159 to boot 6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:41:42.112 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-28T22:41:42.716 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2024-02-28T22:41:44.203 INFO:teuthology.orchestra.run.smithi159.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-28T22:41:44.223 INFO:teuthology.orchestra.run.smithi159.stderr:done 2024-02-28T22:41:44.225 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2024-02-28T22:41:44.240 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.pdOLcsrUIQ 2024-02-28T22:41:44.240 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pdOLcsrUIQ 2024-02-28T22:41:44.309 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.pdOLcsrUIQ 2024-02-28T22:41:44.454 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.pdOLcsrUIQ is 6KB 2024-02-28T22:41:44.502 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.pdOLcsrUIQ 2024-02-28T22:41:44.516 DEBUG:teuthology.orchestra.run.smithi159:> sudo /bin/ls /boot/loader/entries || true 2024-02-28T22:41:44.585 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-28T22:41:44.585 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-28T22:41:44.585 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-28T22:41:44.585 INFO:teuthology.orchestra.run.smithi159.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248.conf 2024-02-28T22:41:44.587 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:41:44.729 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2024-02-28T22:41:58.998 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi184.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-02-28T22:41:58.998 DEBUG:teuthology.orchestra.run.smithi184:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-02-28T22:41:59.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:41:59.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/System.map 2024-02-28T22:41:59.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/config 2024-02-28T22:41:59.097 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel 2024-02-28T22:41:59.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch 2024-02-28T22:41:59.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86 2024-02-28T22:41:59.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto 2024-02-28T22:41:59.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-02-28T22:41:59.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-02-28T22:41:59.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-02-28T22:41:59.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-02-28T22:41:59.098 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crc32c-intel.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-avx2.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-02-28T22:41:59.099 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-amd.ko 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm-intel.ko 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/arch/x86/kvm/kvm.ko 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto 2024-02-28T22:41:59.100 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ansi_cprng.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/anubis.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/arc4.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_memcpy.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_pq.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_raid6_recov.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_tx.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/async_xor.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/async_tx/raid6test.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authenc.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/authencesn.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blake2b_generic.ko 2024-02-28T22:41:59.101 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_common.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/blowfish_generic.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/camellia_generic.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast5_generic.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast6_generic.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cast_common.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/ccm.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cmac.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crc32_generic.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_engine.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/crypto_user.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/cts.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/des_generic.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/dh_generic.ko 2024-02-28T22:41:59.102 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/echainiv.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/essiv.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/fcrypt.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/khazad.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/lz4hc.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/md4.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/michael_mic.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcbc.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/pcrypt.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/rmd160.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/seed.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/serpent_generic.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tcrypt.ko 2024-02-28T22:41:59.103 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/tea.ko 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_common.ko 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/twofish_generic.ko 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/vmac.ko 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/wp512.ko 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xcbc.ko 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xor.ko 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/crypto/xxhash_generic.ko 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_ipmi.ko 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/acpi_pad.ko 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/custom_method.ko 2024-02-28T22:41:59.104 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/ec_sys.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/platform_profile.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbs.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/sbshc.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/acpi/video.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/acard-ahci.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ahci_platform.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/ata_generic.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/libahci_platform.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_acpi.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ali.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_amd.ko 2024-02-28T22:41:59.105 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_artop.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atiixp.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_atp867x.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd640.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cmd64x.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_cypress.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_efar.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt366.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt37x.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x2n.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_hpt3x3.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it8213.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_it821x.ko 2024-02-28T22:41:59.106 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_jmicron.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_marvell.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_mpiix.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_netcell.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ninja32.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87410.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_ns87415.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_oldpiix.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_opti.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_optidma.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pcmcia.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc2027x.ko 2024-02-28T22:41:59.107 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_piccolo.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_rdc.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sch.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_serverworks.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sil680.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sis.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_sl82c105.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_triflex.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pata_via.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/pdc_adma.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_inic162x.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_mv.ko 2024-02-28T22:41:59.108 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_nv.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_promise.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_qstor.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sil24.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sis.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_svw.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_sx4.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_uli.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_via.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ata/sata_vsc.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/auxdisplay/ks0108.ko 2024-02-28T22:41:59.109 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-i2c.ko 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/base/regmap/regmap-mmio.ko 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/bcma/bcma.ko 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/aoe/aoe.ko 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/brd.ko 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/drbd/drbd.ko 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/floppy.ko 2024-02-28T22:41:59.110 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/loop.ko 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/nbd.ko 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/null_blk/null_blk.ko 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/pktcdvd.ko 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/rbd.ko 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/virtio_blk.ko 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/xen-blkfront.ko 2024-02-28T22:41:59.111 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/block/zram/zram.ko 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hangcheck-timer.ko 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/amd-rng.ko 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/intel-rng.ko 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/via-rng.ko 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/hw_random/virtio-rng.ko 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-02-28T22:41:59.112 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_si.ko 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/lp.ko 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/mwave/mwave.ko 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/ppdev.ko 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tlclk.ko 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm.ko 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_atmel.ko 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_infineon.ko 2024-02-28T22:41:59.113 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_nsc.ko 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis.ko 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/uv_mmtimer.ko 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/char/virtio_console.ko 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/p4-clockmod.ko 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/powernow-k8.ko 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/cpufreq/speedstep-lib.ko 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp 2024-02-28T22:41:59.114 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/ccp/ccp.ko 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-aes.ko 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/padlock-sha.ko 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dca/dca.ko 2024-02-28T22:41:59.115 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/dw/dw_dmac.ko 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/dma/ioat/ioatdma.ko 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/amd64_edac.ko 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/e752x_edac.ko 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/edac_mce_amd.ko 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3000_edac.ko 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i3200_edac.ko 2024-02-28T22:41:59.116 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5100_edac.ko 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i5400_edac.ko 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7300_edac.ko 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i7core_edac.ko 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/i82975x_edac.ko 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/ie31200_edac.ko 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/sb_edac.ko 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/edac/x38_edac.ko 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/edd.ko 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/firmware/iscsi_ibft.ko 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-ich.ko 2024-02-28T22:41:59.117 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/gpio/gpio-viperboard.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-appleir.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-aureal.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-axff.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-dr.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elecom.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-elo.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-emsff.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gaff.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gt683r.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-gyration.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-kbd.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtek-mouse.ko 2024-02-28T22:41:59.118 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-holtekff.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-hyperv.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-icade.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-keytouch.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-kye.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lcpower.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-led.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-lenovo.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-dj.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-multitouch.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-ortek.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-penmount.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-petalynx.ko 2024-02-28T22:41:59.119 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-picolcd.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-pl.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-plantronics.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-primax.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-rmi.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-arvo.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-common.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-isku.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kone.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-konepure.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-lua.ko 2024-02-28T22:41:59.120 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-pyra.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-ryos.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat-savu.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-roccat.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-saitek.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-samsung.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sensor-hub.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sjoy.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sony.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-speedlink.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-steelseries.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-sunplus.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-thrustmaster.ko 2024-02-28T22:41:59.121 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tivo.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-tmff.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-topseed.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-twinhan.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-uclogic.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-waltop.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-wiimote.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-xinmo.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zpff.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/hid-zydacron.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/uhid.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hid/wacom.ko 2024-02-28T22:41:59.122 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv 2024-02-28T22:41:59.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_balloon.ko 2024-02-28T22:41:59.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_utils.ko 2024-02-28T22:41:59.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hv/hv_vmbus.ko 2024-02-28T22:41:59.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon 2024-02-28T22:41:59.123 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/abituguru3.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/acpi_power_meter.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7414.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ad7418.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adc128d818.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1025.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1026.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1029.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm1031.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adm9240.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ads7828.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7410.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7411.ko 2024-02-28T22:41:59.124 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7462.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7470.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7475.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/adt7x10.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/amc6821.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/applesmc.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asb100.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asc7621.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/asus_atk0110.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/atxp1.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/coretemp.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/dme1737.ko 2024-02-28T22:41:59.125 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds1621.ko 2024-02-28T22:41:59.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ds620.ko 2024-02-28T22:41:59.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc1403.ko 2024-02-28T22:41:59.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/emc6w201.ko 2024-02-28T22:41:59.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71805f.ko 2024-02-28T22:41:59.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f71882fg.ko 2024-02-28T22:41:59.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/f75375s.ko 2024-02-28T22:41:59.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fam15h_power.ko 2024-02-28T22:41:59.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/fschmd.ko 2024-02-28T22:41:59.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g760a.ko 2024-02-28T22:41:59.126 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/g762.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl518sm.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/gl520sm.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/hwmon-vid.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5500_temp.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/i5k_amb.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmaem.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ibmpex.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina209.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ina2xx.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/it87.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k10temp.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/k8temp.ko 2024-02-28T22:41:59.127 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lineage-pem.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm63.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm73.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm75.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm77.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm78.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm80.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm83.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm85.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm87.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm90.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm92.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm93.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95234.ko 2024-02-28T22:41:59.128 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95241.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/lm95245.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc2945.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4151.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4215.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4222.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4245.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4260.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/ltc4261.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max16065.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1619.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max1668.ko 2024-02-28T22:41:59.129 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max197.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6639.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6650.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/max6697.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/mcp3021.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6683.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775-core.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct6775.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/nct7802.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87360.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pc87427.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pcf8591.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-02-28T22:41:59.130 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max16064.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max34440.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/max8688.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/powr1220.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5627.ko 2024-02-28T22:41:59.131 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch5636.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sch56xx-common.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht15.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sht21.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/shtc1.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/sis5595.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47b397.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m1.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/smsc47m192.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/thmc50.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp102.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp103.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp401.ko 2024-02-28T22:41:59.132 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/tmp421.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via-cputemp.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/via686a.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt1211.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/vt8231.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627ehf.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83627hf.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83781d.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83791d.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83792d.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83793.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83795.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l785ts.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/hwmon/w83l786ng.ko 2024-02-28T22:41:59.133 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-02-28T22:41:59.134 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-i801.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-isch.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-parport.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-via.ko 2024-02-28T22:41:59.135 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-dev.ko 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-mux.ko 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-smbus.ko 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/i2c/i2c-stub.ko 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_cm.ko 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_core.ko 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_umad.ko 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-02-28T22:41:59.136 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/iw_cm.ko 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_cm.ko 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp 2024-02-28T22:41:59.137 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/fm801-gp.ko 2024-02-28T22:41:59.138 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/gameport/gameport.ko 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/joydev.ko 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/keyboard/gpio_keys.ko 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/appletouch.ko 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/bcm5974.ko 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/cyapatp.ko 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/elan_i2c.ko 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/sermouse.ko 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/synaptics_usb.ko 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/mouse/vsxxxaa.ko 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4 2024-02-28T22:41:59.139 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/rmi4/rmi_core.ko 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/altera_ps2.ko 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/arc_ps2.ko 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/serio/serio_raw.ko 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/input/sparse-keymap.ko 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-blinkm.ko 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lm3530.ko 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-lp3944.ko 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/leds-ss4200.ko 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-02-28T22:41:59.140 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/bcache/bcache.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-bio-prison.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache-smq.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-cache.ko 2024-02-28T22:41:59.141 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-crypt.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-delay.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-flakey.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-log-userspace.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-multipath.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-queue-length.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-raid.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-round-robin.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-service-time.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-switch.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-thin-pool.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/dm-verity.ko 2024-02-28T22:41:59.142 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid0.ko 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid1.ko 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid10.ko 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/md/raid456.ko 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptbase.ko 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptctl.ko 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptfc.ko 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptlan.ko 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptsas.ko 2024-02-28T22:41:59.143 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptscsih.ko 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/message/fusion/mptspi.ko 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_ich.ko 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/lpc_sch.ko 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/mfd-core.ko 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/sm501.ko 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/viperboard.ko 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/vx855.ko 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/mfd/wl1273-core.ko 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds9802als.ko 2024-02-28T22:41:59.144 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/apds990x.ko 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/bh1770glc.ko 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/cb710/cb710.ko 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/at24.ko 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/eeprom/max6875.ko 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/enclosure.ko 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/hpilo.ko 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29003.ko 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/isl29020.ko 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d 2024-02-28T22:41:59.145 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-me.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei-txe.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/mei/mei.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-gru/gru.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xp.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpc.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_7xx1.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tifm_core.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/tsl2550.ko 2024-02-28T22:41:59.146 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_balloon.ko 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/bonding/bonding.ko 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/b53/b53_common.ko 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/bcm-sf2.ko 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6060.ko 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-02-28T22:41:59.147 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/dummy.ko 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/eql.ko 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/8390.ko 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec 2024-02-28T22:41:59.148 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/agere/et131x.ko 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-02-28T22:41:59.149 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet 2024-02-28T22:41:59.150 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-02-28T22:41:59.151 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-02-28T22:41:59.152 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/dnet.ko 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ethoc.ko 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/fealnx.ko 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e100.ko 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-02-28T22:41:59.153 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-02-28T22:41:59.154 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/jme.ko 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/skge.ko 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-02-28T22:41:59.155 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-02-28T22:41:59.156 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/atp.ko 2024-02-28T22:41:59.157 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis190.ko 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sis/sis900.ko 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-02-28T22:41:59.158 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/cassini.ko 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/niu.ko 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sungem.ko 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti 2024-02-28T22:41:59.159 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/ti/tlan.ko 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/geneve.ko 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154 2024-02-28T22:41:59.160 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ieee802154/fakelb.ko 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ifb.ko 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ipvlan/ipvlan.ko 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvlan.ko 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/macvtap.ko 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio.ko 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mdio/mdio-regmap.ko 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/mii.ko 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/net_failover.ko 2024-02-28T22:41:59.161 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/netconsole.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/nlmon.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs-lynx.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/amd.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm7xxx.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/bcm87xx.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/broadcom.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/cicada.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/davicom.ko 2024-02-28T22:41:59.162 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/dp83640.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/et1011c.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/icplus.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/lxt.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/marvell.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/micrel.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/national.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/phylink.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/qsemi.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/realtek.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/smsc.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/ste10Xp.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/phy/vitesse.ko 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp 2024-02-28T22:41:59.163 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/bsd_comp.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_async.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_deflate.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_generic.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_mppe.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/ppp_synctty.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppoe.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pppox.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/ppp/pptp.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slhc.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/slip/slip.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/sungem_phy.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tap.ko 2024-02-28T22:41:59.164 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team.ko 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_activebackup.ko 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_broadcast.ko 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_random.ko 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/tun.ko 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/veth.ko 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/virtio_net.ko 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan 2024-02-28T22:41:59.165 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/vxlan/vxlan.ko 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netback/xen-netback.ko 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/net/xen-netfront.ko 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ntb/ntb.ko 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme-core.ko 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/nvme/host/nvme.ko 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport.ko 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_cs.ko 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_pc.ko 2024-02-28T22:41:59.166 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/parport/parport_serial.ko 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/pcie/aer_inject.ko 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pci/xen-pcifront.ko 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/i82092.ko 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/pd6729.ko 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pcmcia/yenta_socket.ko 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-02-28T22:41:59.167 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acer-wmi.ko 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/acerhdf.ko 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/apple-gmux.ko 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-laptop.ko 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/asus-wmi.ko 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/classmate-laptop.ko 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-02-28T22:41:59.168 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/hdaps.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/intel_ips.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/msi-wmi.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/mxm-wmi.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-laptop.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/samsung-q10.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/topstar-laptop.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/toshiba_haps.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi-bmof.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/platform/x86/wmi.ko 2024-02-28T22:41:59.169 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap 2024-02-28T22:41:59.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_common.ko 2024-02-28T22:41:59.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/powercap/intel_rapl_msr.ko 2024-02-28T22:41:59.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps 2024-02-28T22:41:59.170 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-gpio.ko 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps-ldisc.ko 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/clients/pps_parport.ko 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/pps/pps_core.ko 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp.ko 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ptp/ptp_kvm.ko 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-bq32k.ko 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1286.ko 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1307.ko 2024-02-28T22:41:59.172 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1374.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1511.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1553.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1672.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds1742.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds2404.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-ds3232.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-em3027.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-fm3130.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl12022.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-isl1208.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m41t80.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t35.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-m48t59.ko 2024-02-28T22:41:59.173 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-max6900.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-msm6242.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf2127.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf85063.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8523.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8563.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-pcf8583.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rp5c01.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rs5c372.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8025.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-rx8581.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-02-28T22:41:59.174 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/rtc/rtc-x1205.ko 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-9xxx.ko 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-sas.ko 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/3w-xxxx.ko 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/BusLogic.ko 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/a100u2w.ko 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aacraid/aacraid.ko 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/advansys.ko 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/am53c974.ko 2024-02-28T22:41:59.175 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/atp870u.ko 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bfa/bfa.ko 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ch.ko 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/csiostor/csiostor.ko 2024-02-28T22:41:59.176 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dc395x.ko 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/dmx3191d.ko 2024-02-28T22:41:59.177 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esas2r/esas2r.ko 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/esp_scsi.ko 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/fcoe.ko 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/fnic/fnic.ko 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hpsa.ko 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hptiop.ko 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/hv_storvsc.ko 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/initio.ko 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ipr.ko 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ips.ko 2024-02-28T22:41:59.178 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/isci/isci.ko 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/iscsi_tcp.ko 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libfc/libfc.ko 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi.ko 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libiscsi_tcp.ko 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/libsas/libsas.ko 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/lpfc/lpfc.ko 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid.ko 2024-02-28T22:41:59.179 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvsas/mvsas.ko 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/mvumi.ko 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/pmcraid.ko 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla1280.ko 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-02-28T22:41:59.180 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/raid_class.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_debug.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_fc.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_sas.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_spi.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/scsi_transport_srp.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/ses.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/st.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/stex.ko 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2 2024-02-28T22:41:59.181 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/virtio_scsi.ko 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/vmw_pvscsi.ko 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/scsi/wd719x.ko 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ssb/ssb.ko 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/loopback/tcm_loop.ko 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_file.ko 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_iblock.ko 2024-02-28T22:41:59.182 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_mod.ko 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_pscsi.ko 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/target_core_user.ko 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-02-28T22:41:59.183 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-02-28T22:41:59.184 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_gsm.ko 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/n_hdlc.ko 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/nozomi.ko 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/arc_uart.ko 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/tty/serial/jsm/jsm.ko 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs 2024-02-28T22:41:59.185 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/core/ufshcd-core.ko 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio.ko 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_aec.ko 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_cif.ko 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_pci_generic.ko 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/uio/uio_sercos3.ko 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-acm.ko 2024-02-28T22:41:59.186 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/cdc-wdm.ko 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usblp.ko 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/class/usbtmc.ko 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/host/sl811-hcd.ko 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/mdc800.ko 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/image/microtek.ko 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/adutux.ko 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/appledisplay.ko 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi26.ko 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/emi62.ko 2024-02-28T22:41:59.187 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ezusb.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/idmouse.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/iowarrior.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/isight_firmware.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/ldusb.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/legousbtower.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/trancevibrator.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usb3503.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usblcd.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/usbsevseg.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/uss720.ko 2024-02-28T22:41:59.188 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/misc/yurex.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/phy/phy-generic.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/aircable.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ark3116.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/belkin_sa.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ch341.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cp210x.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cyberjack.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/cypress_m8.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/digi_acceleport.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/empeg.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ftdi_sio.ko 2024-02-28T22:41:59.189 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/garmin_gps.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_edgeport.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/io_ti.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipaq.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ipw.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ir-usb.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/keyspan_pda.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kl5kusb105.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/kobil_sct.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mct_u232.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7720.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/mos7840.ko 2024-02-28T22:41:59.190 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/navman.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/omninet.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/opticon.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/option.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/oti6858.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/pl2303.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcaux.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/qcserial.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/quatech2.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/safe_serial.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/sierra.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/spcp8x5.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ssu100.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/symbolserial.ko 2024-02-28T22:41:59.191 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_debug.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/usb_wwan.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/visor.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/whiteheat.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/serial/xsens_mt.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/uas.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-alauda.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-cypress.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-datafab.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-freecom.ko 2024-02-28T22:41:59.192 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-isd200.ko 2024-02-28T22:41:59.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-02-28T22:41:59.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-karma.ko 2024-02-28T22:41:59.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-onetouch.ko 2024-02-28T22:41:59.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-realtek.ko 2024-02-28T22:41:59.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr09.ko 2024-02-28T22:41:59.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-sddr55.ko 2024-02-28T22:41:59.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/ums-usbat.ko 2024-02-28T22:41:59.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/storage/usb-storage.ko 2024-02-28T22:41:59.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip 2024-02-28T22:41:59.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-core.ko 2024-02-28T22:41:59.193 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/usbip-host.ko 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/pci/vfio-pci.ko 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio.ko 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost.ko 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_iotlb.ko 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_net.ko 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/vhost/vhost_scsi.ko 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video 2024-02-28T22:41:59.194 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/apple_bl.ko 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/lcd.ko 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/video/backlight/platform_lcd.ko 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio.ko 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_balloon.ko 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_mmio.ko 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci.ko 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/virtio/virtio_ring.ko 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters 2024-02-28T22:41:59.195 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2482.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/masters/ds2490.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_smem.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/slaves/w1_therm.ko 2024-02-28T22:41:59.196 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/w1/wire.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim1535_wdt.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/alim7101_wdt.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/f71808e_wdt.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/hpwdt.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/i6300esb.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/iTCO_wdt.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ib700wdt.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ibmasr.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it8712f_wdt.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/it87_wdt.ko 2024-02-28T22:41:59.197 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/machzwd.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/nv_tco.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_pci.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/pcwd_usb.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sch311x_wdt.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/softdog.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/sp5100_tco.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/via_wdt.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83877f_wdt.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/w83977f_wdt.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/wdt_pci.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/watchdog/xen_wdt.ko 2024-02-28T22:41:59.198 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-acpi-processor.ko 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-evtchn.ko 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntalloc.ko 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-gntdev.ko 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xen-privcmd.ko 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/drivers/xen/xenfs/xenfs.ko 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/9p/9p.ko 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs 2024-02-28T22:41:59.199 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/affs/affs.ko 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/befs/befs.ko 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/binfmt_misc.ko 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/btrfs/btrfs.ko 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cachefiles/cachefiles.ko 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ceph/ceph.ko 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/coda/coda.ko 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/cramfs/cramfs.ko 2024-02-28T22:41:59.200 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/dlm/dlm.ko 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ecryptfs/ecryptfs.ko 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/f2fs/f2fs.ko 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/fat.ko 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/msdos.ko 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fat/vfat.ko 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/cuse.ko 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/fuse/fuse.ko 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2 2024-02-28T22:41:59.201 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/gfs2/gfs2.ko 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfs/hfs.ko 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/hfsplus/hfsplus.ko 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/isofs/isofs.ko 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/jfs/jfs.ko 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/lockd/lockd.ko 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/minix/minix.ko 2024-02-28T22:41:59.202 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/netfs/netfs.ko 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfs.ko 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv3.ko 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs/nfsv4.ko 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/grace.ko 2024-02-28T22:41:59.203 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfs_common/nfs_acl.ko 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nfsd/nfsd.ko 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nilfs2/nilfs2.ko 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-celtic.ko 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-centeuro.ko 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-croatian.ko 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-cyrillic.ko 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-gaelic.ko 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-greek.ko 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-iceland.ko 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-inuit.ko 2024-02-28T22:41:59.204 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-roman.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-romanian.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/mac-turkish.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1250.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1251.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp1255.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp737.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp775.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp850.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp852.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp855.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp857.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp860.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp861.ko 2024-02-28T22:41:59.205 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp862.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp863.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp864.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp865.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp866.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp869.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp874.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp932.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp936.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp949.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_cp950.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_euc-jp.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-1.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-13.ko 2024-02-28T22:41:59.206 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-14.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-15.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-2.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-3.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-4.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-5.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-6.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-7.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_iso8859-9.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-r.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-ru.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_koi8-u.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_ucs2_utils.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/nls/nls_utf8.ko 2024-02-28T22:41:59.207 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2.ko 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/overlayfs/overlay.ko 2024-02-28T22:41:59.208 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/pstore/ramoops.ko 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/reiserfs/reiserfs.ko 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/romfs/romfs.ko 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/client/cifs.ko 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_arc4.ko 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/smb/common/cifs_md4.ko 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/squashfs/squashfs.ko 2024-02-28T22:41:59.209 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/sysv/sysv.ko 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/udf/udf.ko 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/ufs/ufs.ko 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/fs/xfs/xfs.ko 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/rcu/rcutorture.ko 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/torture.ko 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib 2024-02-28T22:41:59.210 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/asn1_encoder.ko 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc-itu-t.ko 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crc8.ko 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libarc4.ko 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/crypto/libdes.ko 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/libcrc32c.ko 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lru_cache.ko 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4_compress.ko 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/lz4/lz4hc_compress.ko 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/math/cordic.ko 2024-02-28T22:41:59.211 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/raid6/raid6_pq.ko 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/reed_solomon/reed_solomon.ko 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_bm.ko 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_fsm.ko 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/ts_kmp.ko 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/lib/zstd/zstd_compress.ko 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/mm/hwpoison-inject.ko 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/6lowpan.ko 2024-02-28T22:41:59.212 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_dest.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_fragment.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_hop.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_ipv6.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_mobility.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_routing.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/6lowpan/nhc_udp.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/garp.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/mrp.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/p8022.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/psnap.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/802/stp.ko 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q 2024-02-28T22:41:59.213 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/8021q/8021q.ko 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet.ko 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_fd.ko 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_rdma.ko 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/9p/9pnet_virtio.ko 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/batman-adv/batman-adv.ko 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/br_netfilter.ko 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/bridge.ko 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_among.ko 2024-02-28T22:41:59.214 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arp.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_limit.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_log.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_snat.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_stp.ko 2024-02-28T22:41:59.215 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/ebtables.ko 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ceph/libceph.ko 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/failover.ko 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/core/pktgen.ko 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp 2024-02-28T22:41:59.216 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp.ko 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_diag.ko 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv4.ko 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dccp/dccp_ipv6.ko 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dns_resolver/dns_resolver.ko 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/dsa_core.ko 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_brcm.ko 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_dsa.ko 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_none.ko 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/dsa/tag_trailer.ko 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan 2024-02-28T22:41:59.217 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ieee802154/ieee802154_socket.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ah4.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/esp4.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/fou.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/gre.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/inet_diag.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_gre.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_tunnel.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ip_vti.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipcomp.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/ipip.ko 2024-02-28T22:41:59.218 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arp_tables.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/iptable_security.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-02-28T22:41:59.219 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_bic.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_dctcp.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_diag.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_highspeed.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_htcp.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_hybla.ko 2024-02-28T22:41:59.220 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_illinois.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_lp.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_scalable.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_vegas.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_veno.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_westwood.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tcp_yeah.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/tunnel4.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_diag.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/udp_tunnel.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv4/xfrm4_tunnel.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ah6.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/esp6.ko 2024-02-28T22:41:59.221 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/fou6.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_tunnel.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ip6_vti.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/ipcomp6.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-02-28T22:41:59.222 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-02-28T22:41:59.223 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-02-28T22:41:59.223 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-02-28T22:41:59.223 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-02-28T22:41:59.223 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-02-28T22:41:59.223 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-02-28T22:41:59.223 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-02-28T22:41:59.223 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-02-28T22:41:59.223 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-02-28T22:41:59.223 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-02-28T22:41:59.223 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-02-28T22:41:59.224 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-02-28T22:41:59.224 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-02-28T22:41:59.224 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-02-28T22:41:59.224 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-02-28T22:41:59.224 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-02-28T22:41:59.224 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/sit.ko 2024-02-28T22:41:59.224 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/tunnel6.ko 2024-02-28T22:41:59.224 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/ipv6/xfrm6_tunnel.ko 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/key/af_key.ko 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_core.ko 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_debugfs.ko 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_eth.ko 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip.ko 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ip6.ko 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_netlink.ko 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/l2tp/l2tp_ppp.ko 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/llc/llc.ko 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154 2024-02-28T22:41:59.225 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mac802154/mac802154.ko 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/mpls/mpls_gso.ko 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set.ko 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-02-28T22:41:59.226 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs.ko 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-02-28T22:41:59.227 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conncount.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-02-28T22:41:59.228 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_h323.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_irc.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sane.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_sip.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_dup_netdev.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_flow_table_inet.ko 2024-02-28T22:41:59.229 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_log_syslog.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_amanda.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_ftp.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_irc.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_sip.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_nat_tftp.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_synproxy_core.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nf_tables.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_acct.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_log.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_osf.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nfnetlink_queue.ko 2024-02-28T22:41:59.230 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_chain_nat.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_compat.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_ct.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_dup_netdev.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fib.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_fwd_netdev.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_hash.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_limit.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_log.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_masq.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_nat.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_numgen.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_queue.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_quota.ko 2024-02-28T22:41:59.231 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_redir.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_reject_inet.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_socket.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/nft_tunnel.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_AUDIT.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CHECKSUM.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CLASSIFY.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_CT.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_DSCP.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HL.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_HMARK.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_IDLETIMER.ko 2024-02-28T22:41:59.232 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LED.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_LOG.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_MASQUERADE.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NETMAP.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFLOG.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_NFQUEUE.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_RATEEST.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_REDIRECT.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_SECMARK.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPMSS.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TEE.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TPROXY.ko 2024-02-28T22:41:59.233 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_TRACE.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_addrtype.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_bpf.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cgroup.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cluster.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_comment.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connbytes.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlabel.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connlimit.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_connmark.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_conntrack.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_cpu.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dccp.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_devgroup.ko 2024-02-28T22:41:59.234 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_dscp.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ecn.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_esp.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hashlimit.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_helper.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_hl.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipcomp.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_iprange.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_ipvs.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_l2tp.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_length.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_limit.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mac.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_mark.ko 2024-02-28T22:41:59.235 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_multiport.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nat.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_nfacct.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_osf.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_owner.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_physdev.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_pkttype.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_policy.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_quota.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_rateest.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_realm.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_recent.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_sctp.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_set.ko 2024-02-28T22:41:59.236 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_socket.ko 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_state.ko 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_statistic.ko 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_string.ko 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_tcpmss.ko 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_time.ko 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netfilter/xt_u32.ko 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/netlink/netlink_diag.ko 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/nsh/nsh.ko 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/openvswitch.ko 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-geneve.ko 2024-02-28T22:41:59.237 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-gre.ko 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/openvswitch/vport-vxlan.ko 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/packet/af_packet_diag.ko 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds.ko 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_rdma.ko 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/rds/rds_tcp.ko 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_csum.ko 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_gact.ko 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_mirred.ko 2024-02-28T22:41:59.238 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_nat.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_pedit.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_police.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_simple.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_skbedit.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/act_vlan.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_basic.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_bpf.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_flow.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_fw.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_route.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/cls_u32.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_cmp.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_ipset.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_meta.ko 2024-02-28T22:41:59.239 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_nbyte.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_text.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/em_u32.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_choke.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_codel.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_drr.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_fq.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_gred.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hfsc.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_hhf.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_htb.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_ingress.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio.ko 2024-02-28T22:41:59.240 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_mqprio_lib.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_multiq.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_netem.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_pie.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_plug.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_prio.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_qfq.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_red.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfb.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_sfq.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_tbf.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sched/sch_teql.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp.ko 2024-02-28T22:41:59.241 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sctp/sctp_diag.ko 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/sunrpc.ko 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/diag.ko 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/tipc/tipc.ko 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/unix/unix_diag.ko 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock 2024-02-28T22:41:59.242 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock.ko 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_diag.ko 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/vmw_vsock/vsock_loopback.ko 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/net/xfrm/xfrm_ipcomp.ko 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/security/keys/trusted-keys/trusted.ko 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib 2024-02-28T22:41:59.243 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/kernel/virt/lib/irqbypass.ko 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.alias.bin 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.alias.bin 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.bin 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.builtin.modinfo 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.dep.bin 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.devname 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.order 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.softdep 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/modules.symbols.bin 2024-02-28T22:41:59.244 INFO:teuthology.orchestra.run.smithi184.stdout:/lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T22:41:59.249 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:41:59.249 DEBUG:teuthology.orchestra.run.smithi184:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-02-28T22:41:59.271 INFO:teuthology.orchestra.run.smithi184.stdout:postinstall scriptlet (using /bin/sh): 2024-02-28T22:41:59.271 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-02-28T22:41:59.271 INFO:teuthology.orchestra.run.smithi184.stdout: /usr/bin/kernel-install add 6.8.0-rc6-gbd7d00fb7248 /lib/modules/6.8.0-rc6-gbd7d00fb7248/vmlinuz 2024-02-28T22:41:59.271 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2024-02-28T22:41:59.271 INFO:teuthology.orchestra.run.smithi184.stdout:for file in vmlinuz System.map config; do 2024-02-28T22:41:59.271 INFO:teuthology.orchestra.run.smithi184.stdout: if ! cmp --silent "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248"; then 2024-02-28T22:41:59.271 INFO:teuthology.orchestra.run.smithi184.stdout: cp "/lib/modules/6.8.0-rc6-gbd7d00fb7248/${file}" "/boot/${file}-6.8.0-rc6-gbd7d00fb7248" 2024-02-28T22:41:59.271 INFO:teuthology.orchestra.run.smithi184.stdout: fi 2024-02-28T22:41:59.271 INFO:teuthology.orchestra.run.smithi184.stdout:done 2024-02-28T22:41:59.272 INFO:teuthology.orchestra.run.smithi184.stdout:preuninstall scriptlet (using /bin/sh): 2024-02-28T22:41:59.272 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-02-28T22:41:59.272 INFO:teuthology.orchestra.run.smithi184.stdout:new-kernel-pkg --remove 6.8.0-rc6-gbd7d00fb7248 --rminitrd --initrdfile=/boot/initramfs-6.8.0-rc6-gbd7d00fb7248.img 2024-02-28T22:41:59.272 INFO:teuthology.orchestra.run.smithi184.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-02-28T22:41:59.272 INFO:teuthology.orchestra.run.smithi184.stdout:kernel-install remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:41:59.272 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2024-02-28T22:41:59.272 INFO:teuthology.orchestra.run.smithi184.stdout:postuninstall scriptlet (using /bin/sh): 2024-02-28T22:41:59.272 INFO:teuthology.orchestra.run.smithi184.stdout:if [ -x /sbin/update-bootloader ]; then 2024-02-28T22:41:59.272 INFO:teuthology.orchestra.run.smithi184.stdout:/sbin/update-bootloader --remove 6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:41:59.272 INFO:teuthology.orchestra.run.smithi184.stdout:fi 2024-02-28T22:41:59.273 DEBUG:teuthology.orchestra.run.smithi184:> sudo rpm -qi grub2-tools 2024-02-28T22:41:59.348 INFO:teuthology.orchestra.run.smithi184.stdout:Name : grub2-tools 2024-02-28T22:41:59.348 INFO:teuthology.orchestra.run.smithi184.stdout:Epoch : 1 2024-02-28T22:41:59.348 INFO:teuthology.orchestra.run.smithi184.stdout:Version : 2.06 2024-02-28T22:41:59.348 INFO:teuthology.orchestra.run.smithi184.stdout:Release : 68.el9 2024-02-28T22:41:59.348 INFO:teuthology.orchestra.run.smithi184.stdout:Architecture: x86_64 2024-02-28T22:41:59.348 INFO:teuthology.orchestra.run.smithi184.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:Group : Unspecified 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:Size : 8264254 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:License : GPLv3+ 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:Packager : builder@centos.org 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:Vendor : CentOS 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:Summary : Support tools for GRUB. 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout:Description : 2024-02-28T22:41:59.349 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:41:59.350 INFO:teuthology.orchestra.run.smithi184.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-28T22:41:59.350 INFO:teuthology.orchestra.run.smithi184.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-28T22:41:59.350 INFO:teuthology.orchestra.run.smithi184.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-28T22:41:59.350 INFO:teuthology.orchestra.run.smithi184.stdout:hardware devices. 2024-02-28T22:41:59.350 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:41:59.350 INFO:teuthology.orchestra.run.smithi184.stdout:This subpackage provides tools for support of all platforms. 2024-02-28T22:41:59.351 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-28T22:41:59.351 INFO:teuthology.task.kernel:Updating grub on smithi184 to boot 6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:41:59.351 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-28T22:41:59.925 INFO:teuthology.orchestra.run.smithi184.stderr:Generating grub configuration file ... 2024-02-28T22:42:01.345 INFO:teuthology.orchestra.run.smithi184.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-02-28T22:42:01.395 INFO:teuthology.orchestra.run.smithi184.stderr:done 2024-02-28T22:42:01.404 DEBUG:teuthology.orchestra.run.smithi184:> mktemp 2024-02-28T22:42:01.419 INFO:teuthology.orchestra.run.smithi184.stdout:/tmp/tmp.pMYqT6ccqS 2024-02-28T22:42:01.419 DEBUG:teuthology.orchestra.run.smithi184:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pMYqT6ccqS 2024-02-28T22:42:01.488 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0666 /tmp/tmp.pMYqT6ccqS 2024-02-28T22:42:01.630 DEBUG:teuthology.orchestra.remote:smithi184:/tmp/tmp.pMYqT6ccqS is 6KB 2024-02-28T22:42:01.650 DEBUG:teuthology.orchestra.run.smithi184:> rm -fr /tmp/tmp.pMYqT6ccqS 2024-02-28T22:42:01.664 DEBUG:teuthology.orchestra.run.smithi184:> sudo /bin/ls /boot/loader/entries || true 2024-02-28T22:42:01.729 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-02-28T22:42:01.729 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-02-28T22:42:01.729 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-02-28T22:42:01.729 INFO:teuthology.orchestra.run.smithi184.stdout:15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248.conf 2024-02-28T22:42:01.730 DEBUG:teuthology.orchestra.run.smithi184:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:42:01.920 DEBUG:teuthology.orchestra.run.smithi184:> sudo shutdown -r now 2024-02-28T22:42:14.741 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-02-28T22:42:14.742 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-02-28T22:42:14.742 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T22:42:31.936 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-02-28T22:42:31.937 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-28T22:42:31.937 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T22:43:14.788 DEBUG:teuthology.orchestra.remote:timed out 2024-02-28T22:43:23.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-02-28T22:43:23.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T22:43:31.944 DEBUG:teuthology.orchestra.remote:timed out 2024-02-28T22:43:39.664 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-02-28T22:43:40.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-02-28T22:43:40.311 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "6.8.0-rc6-gbd7d00fb7248"... 2024-02-28T22:43:40.311 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-02-28T22:43:40.358 INFO:teuthology.orchestra.run.smithi159.stdout:6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:43:40.358 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc6-gbd7d00fb7248 vs 6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:43:40.359 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-28T22:43:40.359 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-28T22:43:40.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-28T22:43:40.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T22:43:41.359 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-02-28T22:43:41.359 DEBUG:teuthology.orchestra.run.smithi159:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-28T22:43:41.462 INFO:teuthology.orchestra.run.smithi159.stdout:ttyS1 2024-02-28T22:43:41.506 DEBUG:teuthology.parallel:result is None 2024-02-28T22:43:48.645 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-02-28T22:43:49.212 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-28T22:43:49.212 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "6.8.0-rc6-gbd7d00fb7248"... 2024-02-28T22:43:49.212 DEBUG:teuthology.orchestra.run.smithi184:> uname -r 2024-02-28T22:43:49.255 INFO:teuthology.orchestra.run.smithi184.stdout:6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:43:49.255 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-rc6-gbd7d00fb7248 vs 6.8.0-rc6-gbd7d00fb7248 2024-02-28T22:43:49.255 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-28T22:43:49.255 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-28T22:43:50.256 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-02-28T22:43:50.256 DEBUG:teuthology.orchestra.run.smithi184:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-28T22:43:50.374 INFO:teuthology.orchestra.run.smithi184.stdout:ttyS1 2024-02-28T22:43:50.405 DEBUG:teuthology.parallel:result is None 2024-02-28T22:43:50.406 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-28T22:43:50.413 INFO:teuthology.task.internal:Creating test directory... 2024-02-28T22:43:50.414 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-28T22:43:50.420 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-28T22:43:50.464 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-28T22:43:50.471 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-28T22:43:50.480 INFO:teuthology.task.internal:Creating archive directory... 2024-02-28T22:43:50.481 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-28T22:43:50.485 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-28T22:43:50.555 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-28T22:43:50.562 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-28T22:43:50.562 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-28T22:43:50.567 DEBUG:teuthology.orchestra.run.smithi184:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-28T22:43:50.636 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T22:43:50.645 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T22:43:50.668 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T22:43:50.678 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-28T22:43:50.682 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-28T22:43:50.691 INFO:teuthology.task.internal:Configuring sudo... 2024-02-28T22:43:50.691 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-28T22:43:50.697 DEBUG:teuthology.orchestra.run.smithi184:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-28T22:43:50.774 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-28T22:43:50.785 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-28T22:43:50.785 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-28T22:43:50.790 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-28T22:43:50.835 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T22:43:50.954 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T22:43:51.051 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T22:43:51.126 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T22:43:51.210 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:43:51.210 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-28T22:43:51.283 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T22:43:51.358 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-28T22:43:51.473 DEBUG:teuthology.orchestra.run.smithi184:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T22:43:51.546 DEBUG:teuthology.orchestra.run.smithi184:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-28T22:43:51.634 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T22:43:51.634 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-28T22:43:51.783 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2024-02-28T22:43:51.791 DEBUG:teuthology.orchestra.run.smithi184:> sudo service rsyslog restart 2024-02-28T22:43:51.908 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T22:43:51.909 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T22:43:52.314 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-28T22:43:52.321 INFO:teuthology.task.internal:Starting timer... 2024-02-28T22:43:52.321 INFO:teuthology.run_tasks:Running task pcp... 2024-02-28T22:43:52.337 INFO:teuthology.run_tasks:Running task selinux... 2024-02-28T22:43:52.345 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-02-28T22:43:52.346 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2024-02-28T22:43:52.555 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2024-02-28T22:43:52.561 DEBUG:teuthology.orchestra.run.smithi184:> sudo service auditd rotate 2024-02-28T22:43:52.682 INFO:teuthology.orchestra.run.smithi184.stdout:Rotating logs: 2024-02-28T22:43:52.686 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-28T22:43:52.686 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2024-02-28T22:43:52.768 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2024-02-28T22:43:52.769 DEBUG:teuthology.orchestra.run.smithi184:> /usr/sbin/getenforce 2024-02-28T22:43:52.827 INFO:teuthology.orchestra.run.smithi184.stdout:Permissive 2024-02-28T22:43:52.827 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi159.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi184.front.sepia.ceph.com': 'permissive'} 2024-02-28T22:43:52.827 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T22:43:52.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T22:43:52.967 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T22:43:53.048 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T22:43:53.048 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-28T22:43:53.048 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2024-02-28T22:43:53.192 DEBUG:teuthology.orchestra.run.smithi184:> sudo /usr/sbin/setenforce permissive 2024-02-28T22:43:53.273 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-28T22:43:53.287 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-28T22:43:53.305 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-28T22:43:53.307 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi159.front.sepia.ceph.com,smithi184.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-28T22:49:56.863 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi159.front.sepia.ceph.com'), Remote(name='ubuntu@smithi184.front.sepia.ceph.com')] 2024-02-28T22:49:56.865 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-02-28T22:49:56.866 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T22:49:57.013 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-02-28T22:49:57.161 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-02-28T22:49:57.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-28T22:49:57.162 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi184.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-28T22:49:57.310 DEBUG:teuthology.orchestra.run.smithi184:> true 2024-02-28T22:49:57.460 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi184.front.sepia.ceph.com' 2024-02-28T22:49:57.461 INFO:teuthology.run_tasks:Running task clock... 2024-02-28T22:49:57.472 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-28T22:49:57.473 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-28T22:49:57.473 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T22:49:57.481 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-28T22:49:57.481 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T22:49:57.578 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-28T22:49:57.579 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-28T22:49:57.629 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-28T22:49:57.630 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-28T22:49:57.727 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2024-02-28T22:49:57.730 INFO:teuthology.orchestra.run.smithi184.stderr:sudo: ntpd: command not found 2024-02-28T22:49:57.768 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2024-02-28T22:49:57.773 INFO:teuthology.orchestra.run.smithi184.stdout:506 Cannot talk to daemon 2024-02-28T22:49:57.819 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-28T22:49:57.825 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-28T22:49:57.872 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-28T22:49:57.874 INFO:teuthology.orchestra.run.smithi184.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-28T22:49:57.999 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-02-28T22:49:58.006 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T22:49:58.007 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-02-28T22:49:58.007 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T22:49:58.007 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T22:49:58.007 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T22:49:58.007 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T22:49:58.007 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-02-28T22:49:58.016 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T22:49:58.016 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-02-28T22:49:58.016 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T22:49:58.016 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T22:49:58.016 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T22:49:58.016 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T22:49:58.018 INFO:teuthology.run_tasks:Running task install... 2024-02-28T22:49:58.026 DEBUG:teuthology.task.install:project ceph 2024-02-28T22:49:58.026 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'}} 2024-02-28T22:49:58.027 DEBUG:teuthology.task.install:config {'exclude_packages': ['ceph-volume'], 'tag': 'v18.2.1', 'flavor': 'default', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-02-28T22:49:58.027 INFO:teuthology.task.install:Using flavor: default 2024-02-28T22:49:58.032 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-02-28T22:49:58.032 INFO:teuthology.task.install:extra packages: [] 2024-02-28T22:49:58.033 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': 'v18.2.1', 'wait_for_package': False} 2024-02-28T22:49:58.033 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T22:49:58.033 INFO:teuthology.packaging:ref: None 2024-02-28T22:49:58.034 INFO:teuthology.packaging:tag: v18.2.1 2024-02-28T22:49:58.034 INFO:teuthology.packaging:branch: None 2024-02-28T22:49:58.034 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T22:49:58.365 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph-ci v18.2.1^{} -> None 2024-02-28T22:49:58.365 INFO:teuthology.packaging:Tag 'v18.2.1' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-28T22:50:00.302 DEBUG:teuthology.repo_utils:git ls-remote https://git.ceph.com/ceph v18.2.1^{} -> 7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-02-28T22:50:00.303 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-02-28T22:50:00.305 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'tag': 'v18.2.1', 'wait_for_package': False} 2024-02-28T22:50:00.305 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T22:50:00.306 INFO:teuthology.packaging:ref: None 2024-02-28T22:50:00.306 INFO:teuthology.packaging:tag: v18.2.1 2024-02-28T22:50:00.306 INFO:teuthology.packaging:branch: None 2024-02-28T22:50:00.306 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T22:50:00.306 INFO:teuthology.packaging:Tag 'v18.2.1' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-28T22:50:00.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-02-28T22:50:00.459 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/ 2024-02-28T22:50:00.460 INFO:teuthology.task.install.rpm:Package version is 18.2.1-0 2024-02-28T22:50:00.490 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-28T22:50:00.490 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:50:00.490 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-28T22:50:00.529 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/ 2024-02-28T22:50:00.529 INFO:teuthology.task.install.rpm:Package version is 18.2.1-0 2024-02-28T22:50:00.555 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/reef/7fe91d5d5842e04be3b4f514d6dd990c54b29c76/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-02-28T22:50:00.556 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T22:50:00.556 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-02-28T22:50:00.588 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-28T22:50:00.589 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T22:50:00.589 INFO:teuthology.packaging:ref: None 2024-02-28T22:50:00.589 INFO:teuthology.packaging:tag: v18.2.1 2024-02-28T22:50:00.589 INFO:teuthology.packaging:branch: None 2024-02-28T22:50:00.589 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T22:50:00.589 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-28T22:50:00.657 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-02-28T22:50:00.658 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T22:50:00.658 INFO:teuthology.packaging:ref: None 2024-02-28T22:50:00.658 INFO:teuthology.packaging:tag: v18.2.1 2024-02-28T22:50:00.658 INFO:teuthology.packaging:branch: None 2024-02-28T22:50:00.658 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T22:50:00.658 DEBUG:teuthology.orchestra.run.smithi184:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/v18.2.1/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-02-28T22:50:00.725 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-28T22:50:00.797 DEBUG:teuthology.orchestra.run.smithi184:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-02-28T22:50:00.854 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-28T22:50:00.931 DEBUG:teuthology.orchestra.run.smithi184:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-02-28T22:50:00.946 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2024-02-28T22:50:00.950 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2024-02-28T22:50:01.021 INFO:teuthology.orchestra.run.smithi184.stdout:check_obsoletes = 1 2024-02-28T22:50:01.025 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum clean all 2024-02-28T22:50:01.318 INFO:teuthology.orchestra.run.smithi159.stdout:74 files removed 2024-02-28T22:50:01.357 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw 2024-02-28T22:50:01.387 INFO:teuthology.orchestra.run.smithi184.stdout:74 files removed 2024-02-28T22:50:01.426 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-radosgw 2024-02-28T22:50:02.028 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 450 kB/s | 76 kB 00:00 2024-02-28T22:50:02.073 INFO:teuthology.orchestra.run.smithi184.stdout:ceph packages for x86_64 518 kB/s | 76 kB 00:00 2024-02-28T22:50:02.262 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 52 kB/s | 9.4 kB 00:00 2024-02-28T22:50:02.265 INFO:teuthology.orchestra.run.smithi184.stdout:ceph noarch packages 62 kB/s | 9.4 kB 00:00 2024-02-28T22:50:02.458 INFO:teuthology.orchestra.run.smithi184.stdout:ceph source packages 14 kB/s | 2.2 kB 00:00 2024-02-28T22:50:02.462 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 13 kB/s | 2.2 kB 00:00 2024-02-28T22:50:03.071 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - AppStream 14 MB/s | 8.1 MB 00:00 2024-02-28T22:50:03.194 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - AppStream 12 MB/s | 8.1 MB 00:00 2024-02-28T22:50:05.052 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS-9 - BaseOS 7.3 MB/s | 2.5 MB 00:00 2024-02-28T22:50:05.064 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.5 MB 00:00 2024-02-28T22:50:06.465 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 8.7 MB/s | 8.0 MB 00:00 2024-02-28T22:50:08.526 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - BaseOS 2.8 MB/s | 8.0 MB 00:02 2024-02-28T22:50:10.841 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-02-28T22:50:12.190 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 4.3 MB/s | 19 MB 00:04 2024-02-28T22:50:15.986 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - CRB 5.3 MB/s | 6.1 MB 00:01 2024-02-28T22:50:17.612 INFO:teuthology.orchestra.run.smithi184.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 15 kB 00:00 2024-02-28T22:50:18.897 INFO:teuthology.orchestra.run.smithi184.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2024-02-28T22:50:24.124 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 791 kB/s | 6.1 MB 00:07 2024-02-28T22:50:24.713 INFO:teuthology.orchestra.run.smithi184.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-02-28T22:50:27.024 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 9.8 kB/s | 15 kB 00:01 2024-02-28T22:50:27.372 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:50:27.372 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:50:27.372 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:50:27.372 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.372 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:50:27.373 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.374 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.375 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:50:27.376 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:50:27.377 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.378 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:50:27.378 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.378 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:50:27.378 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.378 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:50:27.378 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.378 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.378 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.378 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:50:27.378 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.378 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.379 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:50:27.380 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.381 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.381 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.381 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.381 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:50:27.381 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.381 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.381 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.381 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.382 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:50:27.382 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.382 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.382 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:50:27.382 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:50:28.021 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:50:28.028 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:50:28.028 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-28T22:50:28.028 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:50:28.028 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:50:28.028 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw x86_64 2:18.2.1-0.el9 ceph 7.7 M 2024-02-28T22:50:28.028 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrading: 2024-02-28T22:50:28.028 INFO:teuthology.orchestra.run.smithi184.stdout: librados2 x86_64 2:18.2.1-0.el9 ceph 3.3 M 2024-02-28T22:50:28.029 INFO:teuthology.orchestra.run.smithi184.stdout: librbd1 x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-02-28T22:50:28.029 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-28T22:50:28.029 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-28T22:50:28.029 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base x86_64 2:18.2.1-0.el9 ceph 5.2 M 2024-02-28T22:50:28.029 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common x86_64 2:18.2.1-0.el9 ceph 18 M 2024-02-28T22:50:28.029 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux x86_64 2:18.2.1-0.el9 ceph 24 k 2024-02-28T22:50:28.029 INFO:teuthology.orchestra.run.smithi184.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-02-28T22:50:28.029 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-28T22:50:28.029 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-28T22:50:28.029 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-28T22:50:28.029 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2 x86_64 2:18.2.1-0.el9 ceph 658 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1 x86_64 2:18.2.1-0.el9 ceph 474 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2 x86_64 2:18.2.1-0.el9 ceph 4.5 M 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse x86_64 2:18.2.1-0.el9 ceph 45 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common x86_64 2:18.2.1-0.el9 ceph 124 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs x86_64 2:18.2.1-0.el9 ceph 161 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados x86_64 2:18.2.1-0.el9 ceph 321 k 2024-02-28T22:50:28.030 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd x86_64 2:18.2.1-0.el9 ceph 297 k 2024-02-28T22:50:28.031 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw x86_64 2:18.2.1-0.el9 ceph 99 k 2024-02-28T22:50:28.031 INFO:teuthology.orchestra.run.smithi184.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-28T22:50:28.031 INFO:teuthology.orchestra.run.smithi184.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-28T22:50:28.031 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:50:28.031 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:50:28.031 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:50:28.031 INFO:teuthology.orchestra.run.smithi184.stdout:Install 28 Packages 2024-02-28T22:50:28.031 INFO:teuthology.orchestra.run.smithi184.stdout:Upgrade 2 Packages 2024-02-28T22:50:28.031 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:50:28.032 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 53 M 2024-02-28T22:50:28.032 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:50:28.998 INFO:teuthology.orchestra.run.smithi184.stdout:(1/30): ceph-base-18.2.1-0.el9.x86_64.rpm 16 MB/s | 5.2 MB 00:00 2024-02-28T22:50:29.023 INFO:teuthology.orchestra.run.smithi184.stdout:(2/30): ceph-selinux-18.2.1-0.el9.x86_64.rpm 969 kB/s | 24 kB 00:00 2024-02-28T22:50:29.065 INFO:teuthology.orchestra.run.smithi184.stdout:(3/30): libcephfs2-18.2.1-0.el9.x86_64.rpm 16 MB/s | 658 kB 00:00 2024-02-28T22:50:29.107 INFO:teuthology.orchestra.run.smithi184.stdout:(4/30): libradosstriper1-18.2.1-0.el9.x86_64.rp 11 MB/s | 474 kB 00:00 2024-02-28T22:50:29.266 INFO:teuthology.orchestra.run.smithi184.stdout:(5/30): ceph-radosgw-18.2.1-0.el9.x86_64.rpm 13 MB/s | 7.7 MB 00:00 2024-02-28T22:50:29.283 INFO:teuthology.orchestra.run.smithi184.stdout:(6/30): python3-ceph-argparse-18.2.1-0.el9.x86_ 2.8 MB/s | 45 kB 00:00 2024-02-28T22:50:29.316 INFO:teuthology.orchestra.run.smithi184.stdout:(7/30): python3-ceph-common-18.2.1-0.el9.x86_64 3.8 MB/s | 124 kB 00:00 2024-02-28T22:50:29.341 INFO:teuthology.orchestra.run.smithi184.stdout:(8/30): python3-cephfs-18.2.1-0.el9.x86_64.rpm 6.5 MB/s | 161 kB 00:00 2024-02-28T22:50:29.409 INFO:teuthology.orchestra.run.smithi184.stdout:(9/30): python3-rados-18.2.1-0.el9.x86_64.rpm 4.8 MB/s | 321 kB 00:00 2024-02-28T22:50:29.451 INFO:teuthology.orchestra.run.smithi184.stdout:(10/30): python3-rbd-18.2.1-0.el9.x86_64.rpm 7.2 MB/s | 297 kB 00:00 2024-02-28T22:50:29.484 INFO:teuthology.orchestra.run.smithi184.stdout:(11/30): python3-rgw-18.2.1-0.el9.x86_64.rpm 3.0 MB/s | 99 kB 00:00 2024-02-28T22:50:29.601 INFO:teuthology.orchestra.run.smithi184.stdout:(12/30): librgw2-18.2.1-0.el9.x86_64.rpm 9.0 MB/s | 4.5 MB 00:00 2024-02-28T22:50:29.877 INFO:teuthology.orchestra.run.smithi184.stdout:(13/30): ceph-common-18.2.1-0.el9.x86_64.rpm 15 MB/s | 18 MB 00:01 2024-02-28T22:50:30.152 INFO:teuthology.orchestra.run.smithi184.stdout:(14/30): boost-program-options-1.75.0-8.el9.x86 160 kB/s | 107 kB 00:00 2024-02-28T22:50:30.227 INFO:teuthology.orchestra.run.smithi184.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 256 kB/s | 160 kB 00:00 2024-02-28T22:50:30.252 INFO:teuthology.orchestra.run.smithi184.stdout:(16/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 147 kB/s | 45 kB 00:00 2024-02-28T22:50:30.256 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 6.8 MB/s | 20 MB 00:03 2024-02-28T22:50:30.302 INFO:teuthology.orchestra.run.smithi184.stdout:(17/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.4 MB/s | 662 kB 00:00 2024-02-28T22:50:30.370 INFO:teuthology.orchestra.run.smithi184.stdout:(18/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.0 MB/s | 292 kB 00:00 2024-02-28T22:50:30.395 INFO:teuthology.orchestra.run.smithi184.stdout:(19/30): python3-prettytable-0.7.2-27.el9.noarc 299 kB/s | 42 kB 00:00 2024-02-28T22:50:31.103 INFO:teuthology.orchestra.run.smithi184.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 138 kB/s | 111 kB 00:00 2024-02-28T22:50:31.245 INFO:teuthology.orchestra.run.smithi184.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 184 kB/s | 26 kB 00:00 2024-02-28T22:50:31.404 INFO:teuthology.orchestra.run.smithi184.stdout:(22/30): liboath-2.6.7-2.el9.x86_64.rpm 308 kB/s | 49 kB 00:00 2024-02-28T22:50:31.512 INFO:teuthology.orchestra.run.smithi184.stdout:(23/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 270 kB/s | 309 kB 00:01 2024-02-28T22:50:31.671 INFO:teuthology.orchestra.run.smithi184.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 253 kB/s | 67 kB 00:00 2024-02-28T22:50:32.586 INFO:teuthology.orchestra.run.smithi184.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 209 kB/s | 192 kB 00:00 2024-02-28T22:50:33.088 INFO:teuthology.orchestra.run.smithi184.stdout:(26/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 532 kB/s | 838 kB 00:01 2024-02-28T22:50:33.205 INFO:teuthology.orchestra.run.smithi184.stdout:(27/30): librados2-18.2.1-0.el9.x86_64.rpm 28 MB/s | 3.3 MB 00:00 2024-02-28T22:50:33.314 INFO:teuthology.orchestra.run.smithi184.stdout:(28/30): librbd1-18.2.1-0.el9.x86_64.rpm 28 MB/s | 3.0 MB 00:00 2024-02-28T22:50:34.767 INFO:teuthology.orchestra.run.smithi184.stdout:(29/30): thrift-0.15.0-2.el9.x86_64.rpm 743 kB/s | 1.6 MB 00:02 2024-02-28T22:50:36.051 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-02-28T22:50:37.422 INFO:teuthology.orchestra.run.smithi184.stdout:(30/30): libarrow-9.0.0-10.el9.x86_64.rpm 644 kB/s | 4.4 MB 00:07 2024-02-28T22:50:37.437 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:50:37.437 INFO:teuthology.orchestra.run.smithi184.stdout:Total 5.6 MB/s | 53 MB 00:09 2024-02-28T22:50:37.667 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:50:37.747 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:50:37.747 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:50:38.250 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:50:38.250 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:50:38.676 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:50:38.676 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:50:38.676 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:50:38.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.676 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:50:38.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.676 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:50:38.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.676 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:50:38.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:50:38.677 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:50:38.678 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.679 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:50:38.680 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:50:38.681 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.682 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.683 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:50:38.684 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.684 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.684 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.684 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.684 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:50:38.684 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.684 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.684 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.684 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.684 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:50:38.684 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.685 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.685 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:50:38.685 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:50:39.311 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:50:39.317 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:50:39.317 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:18.2.1-0.el9 ceph 7.7 M 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:18.2.1-0.el9 ceph 3.3 M 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:18.2.1-0.el9 ceph 5.2 M 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:18.2.1-0.el9 ceph 18 M 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:18.2.1-0.el9 ceph 24 k 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-02-28T22:50:39.318 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:18.2.1-0.el9 ceph 658 k 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:18.2.1-0.el9 ceph 474 k 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:18.2.1-0.el9 ceph 4.5 M 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:18.2.1-0.el9 ceph 45 k 2024-02-28T22:50:39.319 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:18.2.1-0.el9 ceph 124 k 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:18.2.1-0.el9 ceph 161 k 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:18.2.1-0.el9 ceph 321 k 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:18.2.1-0.el9 ceph 297 k 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:18.2.1-0.el9 ceph 99 k 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout:Install 28 Packages 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 2 Packages 2024-02-28T22:50:39.320 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:50:39.321 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 53 M 2024-02-28T22:50:39.321 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:50:39.695 INFO:teuthology.orchestra.run.smithi159.stdout:(1/30): ceph-base-18.2.1-0.el9.x86_64.rpm 20 MB/s | 5.2 MB 00:00 2024-02-28T22:50:39.719 INFO:teuthology.orchestra.run.smithi159.stdout:(2/30): ceph-selinux-18.2.1-0.el9.x86_64.rpm 985 kB/s | 24 kB 00:00 2024-02-28T22:50:39.761 INFO:teuthology.orchestra.run.smithi159.stdout:(3/30): libcephfs2-18.2.1-0.el9.x86_64.rpm 16 MB/s | 658 kB 00:00 2024-02-28T22:50:39.791 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:50:39.803 INFO:teuthology.orchestra.run.smithi159.stdout:(4/30): libradosstriper1-18.2.1-0.el9.x86_64.rp 11 MB/s | 474 kB 00:00 2024-02-28T22:50:39.889 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-02-28T22:50:39.922 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-02-28T22:50:39.937 INFO:teuthology.orchestra.run.smithi159.stdout:(5/30): ceph-radosgw-18.2.1-0.el9.x86_64.rpm 15 MB/s | 7.7 MB 00:00 2024-02-28T22:50:39.970 INFO:teuthology.orchestra.run.smithi159.stdout:(6/30): python3-ceph-argparse-18.2.1-0.el9.x86_ 1.4 MB/s | 45 kB 00:00 2024-02-28T22:50:40.004 INFO:teuthology.orchestra.run.smithi159.stdout:(7/30): python3-ceph-common-18.2.1-0.el9.x86_64 3.8 MB/s | 124 kB 00:00 2024-02-28T22:50:40.011 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-02-28T22:50:40.038 INFO:teuthology.orchestra.run.smithi159.stdout:(8/30): python3-cephfs-18.2.1-0.el9.x86_64.rpm 4.9 MB/s | 161 kB 00:00 2024-02-28T22:50:40.080 INFO:teuthology.orchestra.run.smithi159.stdout:(9/30): python3-rados-18.2.1-0.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2024-02-28T22:50:40.122 INFO:teuthology.orchestra.run.smithi159.stdout:(10/30): python3-rbd-18.2.1-0.el9.x86_64.rpm 7.1 MB/s | 297 kB 00:00 2024-02-28T22:50:40.155 INFO:teuthology.orchestra.run.smithi159.stdout:(11/30): python3-rgw-18.2.1-0.el9.x86_64.rpm 3.0 MB/s | 99 kB 00:00 2024-02-28T22:50:40.289 INFO:teuthology.orchestra.run.smithi159.stdout:(12/30): librgw2-18.2.1-0.el9.x86_64.rpm 9.2 MB/s | 4.5 MB 00:00 2024-02-28T22:50:40.346 INFO:teuthology.orchestra.run.smithi159.stdout:(13/30): boost-program-options-1.75.0-8.el9.x86 565 kB/s | 107 kB 00:00 2024-02-28T22:50:40.398 INFO:teuthology.orchestra.run.smithi159.stdout:(14/30): librabbitmq-0.11.0-7.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-02-28T22:50:40.406 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-02-28T22:50:40.451 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librados2-2:18.2.1-0.el9.x86_64 5/32 2024-02-28T22:50:40.473 INFO:teuthology.orchestra.run.smithi159.stdout:(15/30): libpmemobj-1.12.1-1.el9.x86_64.rpm 876 kB/s | 160 kB 00:00 2024-02-28T22:50:40.532 INFO:teuthology.orchestra.run.smithi159.stdout:(16/30): librdkafka-1.6.1-102.el9.x86_64.rpm 4.9 MB/s | 662 kB 00:00 2024-02-28T22:50:40.565 INFO:teuthology.orchestra.run.smithi159.stdout:(17/30): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-02-28T22:50:40.575 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:18.2.1-0.el9.x86_64 5/32 2024-02-28T22:50:40.590 INFO:teuthology.orchestra.run.smithi159.stdout:(18/30): python3-prettytable-0.7.2-27.el9.noarc 732 kB/s | 42 kB 00:00 2024-02-28T22:50:40.672 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rados-2:18.2.1-0.el9.x86_64 6/32 2024-02-28T22:50:40.703 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-02-28T22:50:40.820 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-02-28T22:50:40.864 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-02-28T22:50:40.866 INFO:teuthology.orchestra.run.smithi159.stdout:(19/30): ceph-common-18.2.1-0.el9.x86_64.rpm 13 MB/s | 18 MB 00:01 2024-02-28T22:50:40.891 INFO:teuthology.orchestra.run.smithi159.stdout:(20/30): fmt-8.1.1-5.el9.x86_64.rpm 341 kB/s | 111 kB 00:00 2024-02-28T22:50:40.933 INFO:teuthology.orchestra.run.smithi159.stdout:(21/30): libarrow-doc-9.0.0-10.el9.noarch.rpm 632 kB/s | 26 kB 00:00 2024-02-28T22:50:40.945 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 9/32 2024-02-28T22:50:40.959 INFO:teuthology.orchestra.run.smithi159.stdout:(22/30): gperftools-libs-2.9.1-2.el9.x86_64.rpm 841 kB/s | 309 kB 00:00 2024-02-28T22:50:40.975 INFO:teuthology.orchestra.run.smithi159.stdout:(23/30): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-02-28T22:50:41.001 INFO:teuthology.orchestra.run.smithi159.stdout:(24/30): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-02-28T22:50:41.051 INFO:teuthology.orchestra.run.smithi159.stdout:(25/30): re2-20211101-3.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2024-02-28T22:50:41.058 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-02-28T22:50:41.089 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-02-28T22:50:41.110 INFO:teuthology.orchestra.run.smithi159.stdout:(26/30): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.6 MB/s | 838 kB 00:00 2024-02-28T22:50:41.193 INFO:teuthology.orchestra.run.smithi159.stdout:(27/30): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-02-28T22:50:41.232 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-02-28T22:50:41.328 INFO:teuthology.orchestra.run.smithi159.stdout:(28/30): libarrow-9.0.0-10.el9.x86_64.rpm 9.6 MB/s | 4.4 MB 00:00 2024-02-28T22:50:41.402 INFO:teuthology.orchestra.run.smithi159.stdout:(29/30): librados2-18.2.1-0.el9.x86_64.rpm 11 MB/s | 3.3 MB 00:00 2024-02-28T22:50:41.455 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-02-28T22:50:41.486 INFO:teuthology.orchestra.run.smithi159.stdout:(30/30): librbd1-18.2.1-0.el9.x86_64.rpm 10 MB/s | 3.0 MB 00:00 2024-02-28T22:50:41.490 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:50:41.491 INFO:teuthology.orchestra.run.smithi159.stdout:Total 24 MB/s | 53 MB 00:02 2024-02-28T22:50:41.508 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-02-28T22:50:41.564 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-02-28T22:50:41.598 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-02-28T22:50:41.631 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-02-28T22:50:41.689 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-02-28T22:50:41.727 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:50:41.738 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-02-28T22:50:41.806 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:50:41.806 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:50:42.128 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-02-28T22:50:42.161 INFO:teuthology.orchestra.run.smithi184.stdout: Upgrading : librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-02-28T22:50:42.276 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-02-28T22:50:42.310 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rbd-2:18.2.1-0.el9.x86_64 21/32 2024-02-28T22:50:42.326 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:50:42.326 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:50:42.382 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-02-28T22:50:42.872 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-02-28T22:50:42.914 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-02-28T22:50:43.006 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-02-28T22:50:43.109 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rgw-2:18.2.1-0.el9.x86_64 25/32 2024-02-28T22:50:43.150 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ceph-common-2:18.2.1-0.el9.x86_64 26/32 2024-02-28T22:50:43.874 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:50:43.983 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/32 2024-02-28T22:50:44.019 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/32 2024-02-28T22:50:44.113 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/32 2024-02-28T22:50:44.507 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/32 2024-02-28T22:50:44.548 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:18.2.1-0.el9.x86_64 5/32 2024-02-28T22:50:44.673 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:18.2.1-0.el9.x86_64 5/32 2024-02-28T22:50:44.768 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:18.2.1-0.el9.x86_64 6/32 2024-02-28T22:50:44.800 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-02-28T22:50:44.883 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:18.2.1-0.el9.x86_64 7/32 2024-02-28T22:50:44.932 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.7-2.el9.x86_64 8/32 2024-02-28T22:50:45.005 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 9/32 2024-02-28T22:50:45.127 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-02-28T22:50:45.152 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-02-28T22:50:45.244 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:18.2.1-0.el9.x86_64 11/32 2024-02-28T22:50:45.420 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : re2-1:20211101-3.el9.x86_64 12/32 2024-02-28T22:50:45.454 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 13/32 2024-02-28T22:50:45.510 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/32 2024-02-28T22:50:45.552 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 15/32 2024-02-28T22:50:45.593 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 16/32 2024-02-28T22:50:45.643 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fmt-8.1.1-5.el9.x86_64 17/32 2024-02-28T22:50:45.691 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 18/32 2024-02-28T22:50:45.860 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-28T22:50:45.898 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-28T22:50:46.068 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 19/32 2024-02-28T22:50:46.108 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-02-28T22:50:46.219 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:18.2.1-0.el9.x86_64 20/32 2024-02-28T22:50:46.248 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:18.2.1-0.el9.x86_64 21/32 2024-02-28T22:50:46.317 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 22/32 2024-02-28T22:50:46.522 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-28T22:50:46.577 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-02-28T22:50:46.745 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-02-28T22:50:46.745 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-28T22:50:46.746 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-28T22:50:46.746 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:50:46.769 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 23/32 2024-02-28T22:50:46.802 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-02-28T22:50:46.803 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-02-28T22:50:46.898 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:18.2.1-0.el9.x86_64 24/32 2024-02-28T22:50:47.001 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:18.2.1-0.el9.x86_64 25/32 2024-02-28T22:50:47.030 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:18.2.1-0.el9.x86_64 26/32 2024-02-28T22:50:49.526 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-28T22:50:49.561 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-28T22:50:50.195 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:18.2.1-0.el9.x86_64 27/32 2024-02-28T22:50:50.313 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-02-28T22:50:50.528 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:18.2.1-0.el9.x86_64 28/32 2024-02-28T22:50:50.528 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-02-28T22:50:50.528 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-02-28T22:50:50.529 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:50:50.572 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-02-28T22:50:57.479 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-02-28T22:50:57.480 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /sys 2024-02-28T22:50:57.480 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /proc 2024-02-28T22:50:57.480 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /mnt 2024-02-28T22:50:57.480 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /var/tmp 2024-02-28T22:50:57.480 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /home 2024-02-28T22:50:57.480 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /root 2024-02-28T22:50:57.481 INFO:teuthology.orchestra.run.smithi184.stdout:skipping the directory /tmp 2024-02-28T22:50:57.481 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:50:58.342 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-02-28T22:50:58.412 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-02-28T22:50:58.413 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:50:58.413 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-28T22:50:58.413 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T22:50:58.413 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T22:50:58.413 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:50:58.417 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-28T22:50:58.529 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-28T22:50:58.530 INFO:teuthology.orchestra.run.smithi184.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T22:51:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T22:51:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-base-2:18.2.1-0.el9.x86_64 1/32 2024-02-28T22:51:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-common-2:18.2.1-0.el9.x86_64 2/32 2024-02-28T22:51:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-radosgw-2:18.2.1-0.el9.x86_64 3/32 2024-02-28T22:51:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-selinux-2:18.2.1-0.el9.x86_64 4/32 2024-02-28T22:51:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs2-2:18.2.1-0.el9.x86_64 5/32 2024-02-28T22:51:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libradosstriper1-2:18.2.1-0.el9.x86_64 6/32 2024-02-28T22:51:00.063 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librgw2-2:18.2.1-0.el9.x86_64 7/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 8/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ceph-common-2:18.2.1-0.el9.x86_64 9/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rados-2:18.2.1-0.el9.x86_64 11/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rbd-2:18.2.1-0.el9.x86_64 12/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rgw-2:18.2.1-0.el9.x86_64 13/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-02-28T22:51:00.064 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-02-28T22:51:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-02-28T22:51:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-02-28T22:51:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-02-28T22:51:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-02-28T22:51:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-02-28T22:51:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-02-28T22:51:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-02-28T22:51:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-02-28T22:51:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:18.2.1-0.el9.x86_64 29/32 2024-02-28T22:51:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-02-28T22:51:00.065 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:18.2.1-0.el9.x86_64 31/32 2024-02-28T22:51:00.871 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout:Upgraded: 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: librados2-2:18.2.1-0.el9.x86_64 librbd1-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-base-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-common-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-radosgw-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-selinux-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: fmt-8.1.1-5.el9.x86_64 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-28T22:51:00.872 INFO:teuthology.orchestra.run.smithi184.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs2-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: libradosstriper1-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: librgw2-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-argparse-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ceph-common-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.873 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cephfs-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-28T22:51:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rados-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rbd-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rgw-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: re2-1:20211101-3.el9.x86_64 2024-02-28T22:51:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-28T22:51:00.874 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:00.874 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:51:01.279 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-test 2024-02-28T22:51:01.431 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:18.2.1-0.el9.x86_64 29/32 2024-02-28T22:51:01.431 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2024-02-28T22:51:01.431 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2024-02-28T22:51:01.432 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2024-02-28T22:51:01.432 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2024-02-28T22:51:01.432 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2024-02-28T22:51:01.432 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /root 2024-02-28T22:51:01.432 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2024-02-28T22:51:01.432 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:02.161 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:38 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:51:02.275 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-02-28T22:51:02.348 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-0.el9.x86_64 30/32 2024-02-28T22:51:02.348 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:51:02.348 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-02-28T22:51:02.348 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T22:51:02.348 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-02-28T22:51:02.348 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:02.353 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-28T22:51:02.471 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 31/32 2024-02-28T22:51:02.471 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T22:51:02.473 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:51:02.473 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:51:02.473 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:51:02.473 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.473 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:51:02.473 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.473 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:51:02.473 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:51:02.474 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.475 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.476 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.477 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.478 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.479 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.480 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:02.555 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:51:02.556 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:02.556 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-28T22:51:02.556 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:02.556 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:51:02.556 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test x86_64 2:18.2.1-0.el9 ceph 40 M 2024-02-28T22:51:02.556 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-28T22:51:02.557 INFO:teuthology.orchestra.run.smithi184.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-28T22:51:02.557 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite x86_64 2:18.2.1-0.el9 ceph 165 k 2024-02-28T22:51:02.557 INFO:teuthology.orchestra.run.smithi184.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-28T22:51:02.557 INFO:teuthology.orchestra.run.smithi184.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-28T22:51:02.557 INFO:teuthology.orchestra.run.smithi184.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-28T22:51:02.557 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:02.557 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:51:02.557 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:02.557 INFO:teuthology.orchestra.run.smithi184.stdout:Install 6 Packages 2024-02-28T22:51:02.557 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:02.558 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 41 M 2024-02-28T22:51:02.558 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 167 M 2024-02-28T22:51:02.558 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:51:03.140 INFO:teuthology.orchestra.run.smithi184.stdout:(1/6): libcephsqlite-18.2.1-0.el9.x86_64.rpm 1.0 MB/s | 165 kB 00:00 2024-02-28T22:51:03.798 INFO:teuthology.orchestra.run.smithi184.stdout:(2/6): ceph-test-18.2.1-0.el9.x86_64.rpm 49 MB/s | 40 MB 00:00 2024-02-28T22:51:03.831 INFO:teuthology.orchestra.run.smithi184.stdout:(3/6): jq-1.6-16.el9.x86_64.rpm 221 kB/s | 187 kB 00:00 2024-02-28T22:51:03.857 INFO:teuthology.orchestra.run.smithi184.stdout:(4/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 304 kB/s | 218 kB 00:00 2024-02-28T22:51:04.049 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:18.2.1-0.el9.x86_64 1/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:18.2.1-0.el9.x86_64 2/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:18.2.1-0.el9.x86_64 3/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:18.2.1-0.el9.x86_64 4/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:18.2.1-0.el9.x86_64 5/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:18.2.1-0.el9.x86_64 6/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:18.2.1-0.el9.x86_64 7/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:18.2.1-0.el9.x86_64 8/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:18.2.1-0.el9.x86_64 9/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:18.2.1-0.el9.x86_64 10/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:18.2.1-0.el9.x86_64 11/32 2024-02-28T22:51:04.050 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:18.2.1-0.el9.x86_64 12/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:18.2.1-0.el9.x86_64 13/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 20/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 21/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 22/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 23/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 24/32 2024-02-28T22:51:04.051 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 25/32 2024-02-28T22:51:04.052 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 26/32 2024-02-28T22:51:04.052 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : re2-1:20211101-3.el9.x86_64 27/32 2024-02-28T22:51:04.052 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 28/32 2024-02-28T22:51:04.052 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:18.2.1-0.el9.x86_64 29/32 2024-02-28T22:51:04.052 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 30/32 2024-02-28T22:51:04.052 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:18.2.1-0.el9.x86_64 31/32 2024-02-28T22:51:04.591 INFO:teuthology.orchestra.run.smithi184.stdout:(5/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 84 kB/s | 64 kB 00:00 2024-02-28T22:51:04.832 INFO:teuthology.orchestra.run.smithi184.stdout:(6/6): socat-1.7.4.1-5.el9.x86_64.rpm 295 kB/s | 305 kB 00:01 2024-02-28T22:51:04.837 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:51:04.838 INFO:teuthology.orchestra.run.smithi184.stdout:Total 18 MB/s | 41 MB 00:02 2024-02-28T22:51:04.985 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:51:04.985 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 32/32 2024-02-28T22:51:04.985 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:18.2.1-0.el9.x86_64 librbd1-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: fmt-8.1.1-5.el9.x86_64 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-9.0.0-10.el9.x86_64 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.986 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.7-2.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.6.2-1.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.987 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.988 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:04.988 INFO:teuthology.orchestra.run.smithi159.stdout: re2-1:20211101-3.el9.x86_64 2024-02-28T22:51:04.988 INFO:teuthology.orchestra.run.smithi159.stdout: thrift-0.15.0-2.el9.x86_64 2024-02-28T22:51:04.988 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:04.988 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:51:05.036 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:51:05.036 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:51:05.443 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-test 2024-02-28T22:51:05.463 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:51:05.463 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:51:06.090 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:51:06.211 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-02-28T22:51:06.273 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-02-28T22:51:06.313 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:31 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:51:06.314 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-02-28T22:51:06.379 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-02-28T22:51:06.410 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephsqlite-2:18.2.1-0.el9.x86_64 5/6 2024-02-28T22:51:06.624 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:51:06.624 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:51:06.624 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:51:06.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:06.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.631 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:06.632 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.632 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.632 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.632 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.632 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:06.632 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.632 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.632 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.632 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:06.699 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:51:06.700 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:06.700 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-02-28T22:51:06.700 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:06.700 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:51:06.700 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:18.2.1-0.el9 ceph 40 M 2024-02-28T22:51:06.700 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-02-28T22:51:06.700 INFO:teuthology.orchestra.run.smithi159.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-02-28T22:51:06.700 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:18.2.1-0.el9 ceph 165 k 2024-02-28T22:51:06.700 INFO:teuthology.orchestra.run.smithi159.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-02-28T22:51:06.701 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-02-28T22:51:06.701 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-02-28T22:51:06.701 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:06.701 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:51:06.701 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:06.701 INFO:teuthology.orchestra.run.smithi159.stdout:Install 6 Packages 2024-02-28T22:51:06.701 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:06.702 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 41 M 2024-02-28T22:51:06.702 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 167 M 2024-02-28T22:51:06.702 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:51:06.984 INFO:teuthology.orchestra.run.smithi159.stdout:(1/6): libcephsqlite-18.2.1-0.el9.x86_64.rpm 1.2 MB/s | 165 kB 00:00 2024-02-28T22:51:07.651 INFO:teuthology.orchestra.run.smithi159.stdout:(2/6): ceph-test-18.2.1-0.el9.x86_64.rpm 50 MB/s | 40 MB 00:00 2024-02-28T22:51:07.809 INFO:teuthology.orchestra.run.smithi159.stdout:(3/6): socat-1.7.4.1-5.el9.x86_64.rpm 1.9 MB/s | 305 kB 00:00 2024-02-28T22:51:07.851 INFO:teuthology.orchestra.run.smithi159.stdout:(4/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-02-28T22:51:07.952 INFO:teuthology.orchestra.run.smithi159.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 170 kB/s | 187 kB 00:01 2024-02-28T22:51:08.202 INFO:teuthology.orchestra.run.smithi159.stdout:(6/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 179 kB/s | 218 kB 00:01 2024-02-28T22:51:08.206 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:51:08.207 INFO:teuthology.orchestra.run.smithi159.stdout:Total 27 MB/s | 41 MB 00:01 2024-02-28T22:51:08.353 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:51:08.407 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:51:08.407 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:51:08.827 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:51:08.827 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:51:09.500 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:51:09.592 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-02-28T22:51:09.639 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-02-28T22:51:09.682 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-02-28T22:51:09.746 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-02-28T22:51:09.772 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:18.2.1-0.el9.x86_64 5/6 2024-02-28T22:51:10.554 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephsqlite-2:18.2.1-0.el9.x86_64 5/6 2024-02-28T22:51:10.680 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-test-2:18.2.1-0.el9.x86_64 6/6 2024-02-28T22:51:12.818 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-test-2:18.2.1-0.el9.x86_64 6/6 2024-02-28T22:51:12.818 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-test-2:18.2.1-0.el9.x86_64 1/6 2024-02-28T22:51:12.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephsqlite-2:18.2.1-0.el9.x86_64 2/6 2024-02-28T22:51:12.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-02-28T22:51:12.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-02-28T22:51:12.819 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-02-28T22:51:13.269 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-02-28T22:51:13.269 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:13.269 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:51:13.269 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-test-2:18.2.1-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-02-28T22:51:13.269 INFO:teuthology.orchestra.run.smithi184.stdout: libcephsqlite-2:18.2.1-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-02-28T22:51:13.270 INFO:teuthology.orchestra.run.smithi184.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-02-28T22:51:13.270 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:13.270 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:51:13.629 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph 2024-02-28T22:51:13.925 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:18.2.1-0.el9.x86_64 5/6 2024-02-28T22:51:14.022 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:18.2.1-0.el9.x86_64 6/6 2024-02-28T22:51:14.536 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:00:50 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:51:14.858 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:51:14.858 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.859 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:51:14.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:51:14.862 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:51:14.863 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:51:14.863 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:51:14.863 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:51:14.863 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:51:14.863 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.866 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:14.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.866 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:14.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.868 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:14.935 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:51:14.937 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout: ceph x86_64 2:18.2.1-0.el9 ceph 6.4 k 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds x86_64 2:18.2.1-0.el9 ceph 2.1 M 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr x86_64 2:18.2.1-0.el9 ceph 1.4 M 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core noarch 2:18.2.1-0.el9 ceph-noarch 242 k 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon x86_64 2:18.2.1-0.el9 ceph 4.4 M 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd x86_64 2:18.2.1-0.el9 ceph 18 M 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-28T22:51:14.938 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-28T22:51:14.939 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:14.940 INFO:teuthology.orchestra.run.smithi184.stdout:Install 33 Packages 2024-02-28T22:51:14.941 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:14.941 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 30 M 2024-02-28T22:51:14.941 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 110 M 2024-02-28T22:51:14.941 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:51:16.063 INFO:teuthology.orchestra.run.smithi184.stdout:(1/33): ceph-18.2.1-0.el9.x86_64.rpm 28 kB/s | 6.4 kB 00:00 2024-02-28T22:51:16.143 INFO:teuthology.orchestra.run.smithi184.stdout:(2/33): ceph-mgr-18.2.1-0.el9.x86_64.rpm 4.7 MB/s | 1.4 MB 00:00 2024-02-28T22:51:16.210 INFO:teuthology.orchestra.run.smithi184.stdout:(3/33): ceph-mds-18.2.1-0.el9.x86_64.rpm 5.6 MB/s | 2.1 MB 00:00 2024-02-28T22:51:16.244 INFO:teuthology.orchestra.run.smithi184.stdout:(4/33): ceph-mgr-modules-core-18.2.1-0.el9.noar 7.2 MB/s | 242 kB 00:00 2024-02-28T22:51:16.353 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-test-2:18.2.1-0.el9.x86_64 6/6 2024-02-28T22:51:16.353 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:18.2.1-0.el9.x86_64 1/6 2024-02-28T22:51:16.353 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:18.2.1-0.el9.x86_64 2/6 2024-02-28T22:51:16.353 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : jq-1.6-16.el9.x86_64 3/6 2024-02-28T22:51:16.353 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 4/6 2024-02-28T22:51:16.353 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 5/6 2024-02-28T22:51:16.369 INFO:teuthology.orchestra.run.smithi184.stdout:(5/33): ceph-mon-18.2.1-0.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2024-02-28T22:51:16.494 INFO:teuthology.orchestra.run.smithi184.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.0 MB/s | 253 kB 00:00 2024-02-28T22:51:16.545 INFO:teuthology.orchestra.run.smithi184.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-02-28T22:51:16.587 INFO:teuthology.orchestra.run.smithi184.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-02-28T22:51:16.645 INFO:teuthology.orchestra.run.smithi184.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 4.5 MB/s | 1.2 MB 00:00 2024-02-28T22:51:16.679 INFO:teuthology.orchestra.run.smithi184.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.3 MB/s | 125 kB 00:00 2024-02-28T22:51:16.713 INFO:teuthology.orchestra.run.smithi184.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.2 MB/s | 215 kB 00:00 2024-02-28T22:51:16.715 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 6/6 2024-02-28T22:51:16.715 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:16.715 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:51:16.715 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:18.2.1-0.el9.x86_64 jq-1.6-16.el9.x86_64 2024-02-28T22:51:16.715 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:18.2.1-0.el9.x86_64 oniguruma-6.9.6-1.el9.5.x86_64 2024-02-28T22:51:16.715 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-5.el9.x86_64 xmlstarlet-1.6.1-20.el9.x86_64 2024-02-28T22:51:16.715 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:16.715 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:51:16.996 INFO:teuthology.orchestra.run.smithi184.stdout:(12/33): ceph-osd-18.2.1-0.el9.x86_64.rpm 21 MB/s | 18 MB 00:00 2024-02-28T22:51:17.013 INFO:teuthology.orchestra.run.smithi184.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 116 kB/s | 35 kB 00:00 2024-02-28T22:51:17.149 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph 2024-02-28T22:51:17.238 INFO:teuthology.orchestra.run.smithi184.stdout:(14/33): python3-toml-0.10.2-6.el9.noarch.rpm 185 kB/s | 42 kB 00:00 2024-02-28T22:51:17.272 INFO:teuthology.orchestra.run.smithi184.stdout:(15/33): python3-mako-1.1.4-6.el9.noarch.rpm 291 kB/s | 172 kB 00:00 2024-02-28T22:51:17.464 INFO:teuthology.orchestra.run.smithi184.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 109 kB/s | 51 kB 00:00 2024-02-28T22:51:17.681 INFO:teuthology.orchestra.run.smithi184.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 98 kB/s | 43 kB 00:00 2024-02-28T22:51:17.798 INFO:teuthology.orchestra.run.smithi184.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 92 kB/s | 11 kB 00:00 2024-02-28T22:51:17.890 INFO:teuthology.orchestra.run.smithi184.stdout:(19/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 278 kB/s | 172 kB 00:00 2024-02-28T22:51:17.915 INFO:teuthology.orchestra.run.smithi184.stdout:(20/33): python3-jaraco-classes-3.2.1-5.el9.noa 152 kB/s | 18 kB 00:00 2024-02-28T22:51:18.036 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:43 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:51:18.040 INFO:teuthology.orchestra.run.smithi184.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 155 kB/s | 23 kB 00:00 2024-02-28T22:51:18.065 INFO:teuthology.orchestra.run.smithi184.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 130 kB/s | 19 kB 00:00 2024-02-28T22:51:18.158 INFO:teuthology.orchestra.run.smithi184.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 169 kB/s | 20 kB 00:00 2024-02-28T22:51:18.216 INFO:teuthology.orchestra.run.smithi184.stdout:(24/33): python3-cherrypy-18.6.1-2.el9.noarch.r 478 kB/s | 358 kB 00:00 2024-02-28T22:51:18.242 INFO:teuthology.orchestra.run.smithi184.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 264 kB/s | 46 kB 00:00 2024-02-28T22:51:18.283 INFO:teuthology.orchestra.run.smithi184.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 633 kB/s | 79 kB 00:00 2024-02-28T22:51:18.345 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:51:18.346 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:51:18.347 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:51:18.348 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:51:18.349 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.350 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.351 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.352 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:18.353 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.354 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:18.355 INFO:teuthology.orchestra.run.smithi184.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 152 kB/s | 16 kB 00:00 2024-02-28T22:51:18.375 INFO:teuthology.orchestra.run.smithi184.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-02-28T22:51:18.401 INFO:teuthology.orchestra.run.smithi184.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 771 kB/s | 90 kB 00:00 2024-02-28T22:51:18.420 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:18.2.1-0.el9 ceph 6.4 k 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:18.2.1-0.el9 ceph 2.1 M 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:18.2.1-0.el9 ceph 1.4 M 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:18.2.1-0.el9 ceph-noarch 242 k 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:18.2.1-0.el9 ceph 4.4 M 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:18.2.1-0.el9 ceph 18 M 2024-02-28T22:51:18.423 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-02-28T22:51:18.424 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-02-28T22:51:18.425 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-02-28T22:51:18.426 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:18.426 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:51:18.426 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:18.426 INFO:teuthology.orchestra.run.smithi159.stdout:Install 33 Packages 2024-02-28T22:51:18.426 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:18.426 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 30 M 2024-02-28T22:51:18.426 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 110 M 2024-02-28T22:51:18.427 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:51:18.484 INFO:teuthology.orchestra.run.smithi184.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 268 kB/s | 36 kB 00:00 2024-02-28T22:51:18.518 INFO:teuthology.orchestra.run.smithi184.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-02-28T22:51:18.602 INFO:teuthology.orchestra.run.smithi184.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 172 kB/s | 20 kB 00:00 2024-02-28T22:51:18.652 INFO:teuthology.orchestra.run.smithi184.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.7 MB/s | 427 kB 00:00 2024-02-28T22:51:18.661 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:51:18.661 INFO:teuthology.orchestra.run.smithi184.stdout:Total 8.1 MB/s | 30 MB 00:03 2024-02-28T22:51:19.019 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:51:19.056 INFO:teuthology.orchestra.run.smithi159.stdout:(1/33): ceph-18.2.1-0.el9.x86_64.rpm 32 kB/s | 6.4 kB 00:00 2024-02-28T22:51:19.105 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:51:19.105 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:51:19.131 INFO:teuthology.orchestra.run.smithi159.stdout:(2/33): ceph-mgr-18.2.1-0.el9.x86_64.rpm 5.2 MB/s | 1.4 MB 00:00 2024-02-28T22:51:19.190 INFO:teuthology.orchestra.run.smithi159.stdout:(3/33): ceph-mds-18.2.1-0.el9.x86_64.rpm 6.2 MB/s | 2.1 MB 00:00 2024-02-28T22:51:19.231 INFO:teuthology.orchestra.run.smithi159.stdout:(4/33): ceph-mgr-modules-core-18.2.1-0.el9.noar 5.8 MB/s | 242 kB 00:00 2024-02-28T22:51:19.357 INFO:teuthology.orchestra.run.smithi159.stdout:(5/33): ceph-mon-18.2.1-0.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-02-28T22:51:19.432 INFO:teuthology.orchestra.run.smithi159.stdout:(6/33): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-02-28T22:51:19.482 INFO:teuthology.orchestra.run.smithi159.stdout:(7/33): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-02-28T22:51:19.533 INFO:teuthology.orchestra.run.smithi159.stdout:(8/33): python3-pycparser-2.20-6.el9.noarch.rpm 2.7 MB/s | 135 kB 00:00 2024-02-28T22:51:19.550 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:51:19.551 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:51:19.583 INFO:teuthology.orchestra.run.smithi159.stdout:(9/33): python3-cryptography-36.0.1-4.el9.x86_6 5.5 MB/s | 1.2 MB 00:00 2024-02-28T22:51:19.616 INFO:teuthology.orchestra.run.smithi159.stdout:(10/33): python3-requests-2.25.1-8.el9.noarch.r 1.5 MB/s | 125 kB 00:00 2024-02-28T22:51:19.650 INFO:teuthology.orchestra.run.smithi159.stdout:(11/33): python3-urllib3-1.26.5-5.el9.noarch.rp 3.2 MB/s | 215 kB 00:00 2024-02-28T22:51:19.926 INFO:teuthology.orchestra.run.smithi159.stdout:(12/33): ceph-osd-18.2.1-0.el9.x86_64.rpm 22 MB/s | 18 MB 00:00 2024-02-28T22:51:19.942 INFO:teuthology.orchestra.run.smithi159.stdout:(13/33): python3-markupsafe-1.1.1-12.el9.x86_64 119 kB/s | 35 kB 00:00 2024-02-28T22:51:20.009 INFO:teuthology.orchestra.run.smithi159.stdout:(14/33): python3-mako-1.1.4-6.el9.noarch.rpm 440 kB/s | 172 kB 00:00 2024-02-28T22:51:20.026 INFO:teuthology.orchestra.run.smithi159.stdout:(15/33): python3-toml-0.10.2-6.el9.noarch.rpm 503 kB/s | 42 kB 00:00 2024-02-28T22:51:20.043 INFO:teuthology.orchestra.run.smithi159.stdout:(16/33): python3-pytz-2021.1-5.el9.noarch.rpm 438 kB/s | 51 kB 00:00 2024-02-28T22:51:20.110 INFO:teuthology.orchestra.run.smithi159.stdout:(17/33): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 435 kB/s | 43 kB 00:00 2024-02-28T22:51:20.144 INFO:teuthology.orchestra.run.smithi159.stdout:(18/33): python3-jaraco-8.2.1-3.el9.noarch.rpm 329 kB/s | 11 kB 00:00 2024-02-28T22:51:20.186 INFO:teuthology.orchestra.run.smithi159.stdout:(19/33): python3-jaraco-classes-3.2.1-5.el9.noa 432 kB/s | 18 kB 00:00 2024-02-28T22:51:20.211 INFO:teuthology.orchestra.run.smithi159.stdout:(20/33): python3-cheroot-8.6.0-4.el9.noarch.rpm 936 kB/s | 172 kB 00:00 2024-02-28T22:51:20.261 INFO:teuthology.orchestra.run.smithi159.stdout:(21/33): python3-jaraco-collections-3.0.0-8.el9 311 kB/s | 23 kB 00:00 2024-02-28T22:51:20.287 INFO:teuthology.orchestra.run.smithi159.stdout:(22/33): python3-jaraco-functools-3.5.0-2.el9.n 261 kB/s | 19 kB 00:00 2024-02-28T22:51:20.312 INFO:teuthology.orchestra.run.smithi159.stdout:(23/33): python3-jaraco-text-3.2.0-6.el9.noarch 396 kB/s | 20 kB 00:00 2024-02-28T22:51:20.346 INFO:teuthology.orchestra.run.smithi159.stdout:(24/33): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-02-28T22:51:20.371 INFO:teuthology.orchestra.run.smithi159.stdout:(25/33): python3-logutils-0.3.5-21.el9.noarch.r 556 kB/s | 46 kB 00:00 2024-02-28T22:51:20.421 INFO:teuthology.orchestra.run.smithi159.stdout:(26/33): python3-more-itertools-8.12.0-2.el9.no 728 kB/s | 79 kB 00:00 2024-02-28T22:51:20.447 INFO:teuthology.orchestra.run.smithi159.stdout:(27/33): python3-portend-3.1.0-2.el9.noarch.rpm 220 kB/s | 16 kB 00:00 2024-02-28T22:51:20.480 INFO:teuthology.orchestra.run.smithi159.stdout:(28/33): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-02-28T22:51:20.505 INFO:teuthology.orchestra.run.smithi159.stdout:(29/33): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.1 MB/s | 90 kB 00:00 2024-02-28T22:51:20.531 INFO:teuthology.orchestra.run.smithi159.stdout:(30/33): python3-tempora-5.0.0-2.el9.noarch.rpm 430 kB/s | 36 kB 00:00 2024-02-28T22:51:20.573 INFO:teuthology.orchestra.run.smithi159.stdout:(31/33): python3-webob-1.8.7-6.el9.noarch.rpm 2.5 MB/s | 230 kB 00:00 2024-02-28T22:51:20.598 INFO:teuthology.orchestra.run.smithi159.stdout:(32/33): python3-zc-lockfile-2.0-10.el9.noarch. 301 kB/s | 20 kB 00:00 2024-02-28T22:51:20.656 INFO:teuthology.orchestra.run.smithi159.stdout:(33/33): python3-werkzeug-2.0.3-3.el9.1.noarch. 2.8 MB/s | 427 kB 00:00 2024-02-28T22:51:20.659 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:51:20.660 INFO:teuthology.orchestra.run.smithi159.stdout:Total 13 MB/s | 30 MB 00:02 2024-02-28T22:51:20.891 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:51:20.955 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-28T22:51:20.991 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-28T22:51:21.017 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:51:21.034 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-28T22:51:21.102 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:51:21.102 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:51:21.171 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-28T22:51:21.312 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-28T22:51:21.370 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-28T22:51:21.412 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-28T22:51:21.448 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-02-28T22:51:21.511 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-02-28T22:51:21.564 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-02-28T22:51:21.572 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:51:21.573 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:51:21.628 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-02-28T22:51:21.696 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-02-28T22:51:21.740 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-02-28T22:51:21.809 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-02-28T22:51:21.947 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-02-28T22:51:22.131 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-02-28T22:51:22.237 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-02-28T22:51:22.297 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-02-28T22:51:22.340 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-02-28T22:51:22.411 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-02-28T22:51:22.485 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-02-28T22:51:22.751 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-02-28T22:51:22.811 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-02-28T22:51:22.901 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-02-28T22:51:23.019 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-02-28T22:51:23.025 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:51:23.075 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-02-28T22:51:23.110 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/33 2024-02-28T22:51:23.150 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/33 2024-02-28T22:51:23.202 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/33 2024-02-28T22:51:23.240 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-02-28T22:51:23.354 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/33 2024-02-28T22:51:23.418 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 28/33 2024-02-28T22:51:23.445 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/33 2024-02-28T22:51:23.457 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-02-28T22:51:23.526 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 6/33 2024-02-28T22:51:23.529 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-02-28T22:51:23.529 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:51:23.529 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-28T22:51:23.529 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T22:51:23.529 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T22:51:23.529 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:23.575 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/33 2024-02-28T22:51:23.612 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/33 2024-02-28T22:51:23.650 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/33 2024-02-28T22:51:23.692 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/33 2024-02-28T22:51:23.765 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/33 2024-02-28T22:51:23.833 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/33 2024-02-28T22:51:23.877 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/33 2024-02-28T22:51:23.948 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/33 2024-02-28T22:51:24.103 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 15/33 2024-02-28T22:51:24.296 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 16/33 2024-02-28T22:51:24.400 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 17/33 2024-02-28T22:51:24.486 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 18/33 2024-02-28T22:51:24.529 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 19/33 2024-02-28T22:51:24.597 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ply-3.11-14.el9.noarch 20/33 2024-02-28T22:51:24.668 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 21/33 2024-02-28T22:51:24.929 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 22/33 2024-02-28T22:51:24.983 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 23/33 2024-02-28T22:51:25.074 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 24/33 2024-02-28T22:51:25.175 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-02-28T22:51:25.193 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 25/33 2024-02-28T22:51:25.249 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 26/33 2024-02-28T22:51:25.254 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-02-28T22:51:25.254 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:51:25.254 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-28T22:51:25.254 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T22:51:25.254 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T22:51:25.255 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:25.401 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 27/33 2024-02-28T22:51:25.584 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 28/33 2024-02-28T22:51:25.623 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-02-28T22:51:25.697 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:18.2.1-0.el9.x86_64 29/33 2024-02-28T22:51:25.698 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:51:25.698 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-02-28T22:51:25.698 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T22:51:25.698 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-02-28T22:51:25.698 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:25.759 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-02-28T22:51:25.829 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-02-28T22:51:25.830 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:51:25.830 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-28T22:51:25.830 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T22:51:25.830 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T22:51:25.830 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:26.059 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-02-28T22:51:26.127 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-02-28T22:51:26.127 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:51:26.128 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-28T22:51:26.128 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T22:51:26.128 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T22:51:26.128 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:26.191 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-2:18.2.1-0.el9.x86_64 33/33 2024-02-28T22:51:26.304 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-2:18.2.1-0.el9.x86_64 33/33 2024-02-28T22:51:26.304 INFO:teuthology.orchestra.run.smithi184.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-28T22:51:26.304 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:27.341 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-02-28T22:51:27.417 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:18.2.1-0.el9.x86_64 30/33 2024-02-28T22:51:27.417 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:51:27.417 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-02-28T22:51:27.418 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T22:51:27.418 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-02-28T22:51:27.418 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:27.908 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-02-28T22:51:27.993 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:18.2.1-0.el9.x86_64 31/33 2024-02-28T22:51:27.993 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:51:27.993 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-02-28T22:51:27.993 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T22:51:27.993 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-02-28T22:51:27.993 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:28.218 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-02-28T22:51:28.258 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-2:18.2.1-0.el9.x86_64 1/33 2024-02-28T22:51:28.258 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mds-2:18.2.1-0.el9.x86_64 2/33 2024-02-28T22:51:28.258 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-2:18.2.1-0.el9.x86_64 3/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mon-2:18.2.1-0.el9.x86_64 4/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-osd-2:18.2.1-0.el9.x86_64 5/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 6/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-02-28T22:51:28.259 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-28T22:51:28.260 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-28T22:51:28.260 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-28T22:51:28.260 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-28T22:51:28.260 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-28T22:51:28.260 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-28T22:51:28.260 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-28T22:51:28.260 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-28T22:51:28.260 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-28T22:51:28.260 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-28T22:51:28.260 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-28T22:51:28.260 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-28T22:51:28.261 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-28T22:51:28.261 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-28T22:51:28.261 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-28T22:51:28.261 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-28T22:51:28.261 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-28T22:51:28.285 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:18.2.1-0.el9.x86_64 32/33 2024-02-28T22:51:28.285 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:51:28.285 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-02-28T22:51:28.285 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T22:51:28.285 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-02-28T22:51:28.285 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:28.357 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:18.2.1-0.el9.x86_64 33/33 2024-02-28T22:51:28.454 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-2:18.2.1-0.el9.x86_64 33/33 2024-02-28T22:51:28.455 INFO:teuthology.orchestra.run.smithi159.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-02-28T22:51:28.455 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:29.309 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-28T22:51:29.309 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:29.309 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:51:29.309 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:29.309 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mds-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:29.309 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:29.309 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 2024-02-28T22:51:29.309 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mon-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:29.310 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-osd-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:29.310 INFO:teuthology.orchestra.run.smithi184.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-28T22:51:29.310 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-28T22:51:29.310 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-28T22:51:29.310 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-28T22:51:29.310 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-28T22:51:29.310 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-28T22:51:29.310 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-28T22:51:29.310 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-28T22:51:29.310 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-28T22:51:29.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-28T22:51:29.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-28T22:51:29.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-28T22:51:29.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-28T22:51:29.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-28T22:51:29.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-28T22:51:29.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-ply-3.11-14.el9.noarch 2024-02-28T22:51:29.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-28T22:51:29.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-28T22:51:29.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-28T22:51:29.311 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-28T22:51:29.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-28T22:51:29.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-28T22:51:29.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-28T22:51:29.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-28T22:51:29.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-28T22:51:29.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-28T22:51:29.312 INFO:teuthology.orchestra.run.smithi184.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-28T22:51:29.312 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:29.312 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:51:29.690 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-base 2024-02-28T22:51:30.423 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:18.2.1-0.el9.x86_64 1/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:18.2.1-0.el9.x86_64 2/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:18.2.1-0.el9.x86_64 3/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:18.2.1-0.el9.x86_64 4/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:18.2.1-0.el9.x86_64 5/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 6/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 12/33 2024-02-28T22:51:30.424 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 15/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 16/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 17/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 18/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 19/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 20/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 21/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 22/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 23/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 24/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 25/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 26/33 2024-02-28T22:51:30.425 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 27/33 2024-02-28T22:51:30.426 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 28/33 2024-02-28T22:51:30.426 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 29/33 2024-02-28T22:51:30.426 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 30/33 2024-02-28T22:51:30.426 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 31/33 2024-02-28T22:51:30.426 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 32/33 2024-02-28T22:51:30.547 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:06 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:51:30.859 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:51:30.860 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:51:30.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:51:30.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:51:30.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:51:30.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:51:30.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.860 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:51:30.860 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:51:30.861 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.862 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:51:30.862 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.862 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:51:30.862 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.862 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:51:30.862 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.862 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:51:30.862 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:51:30.863 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:51:30.863 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:51:30.863 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:51:30.863 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:51:30.863 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.863 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.864 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.865 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.866 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.867 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:30.868 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.869 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.869 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.869 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.869 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:30.869 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.869 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.869 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.869 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:30.869 INFO:teuthology.orchestra.run.smithi184.stdout:Package ceph-base-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:51:30.935 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:51:30.936 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-28T22:51:30.936 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:51:31.014 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install cephadm 2024-02-28T22:51:31.473 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 33/33 2024-02-28T22:51:31.473 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:31.473 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:51:31.473 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:31.473 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:18.2.1-0.el9.noarch 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-02-28T22:51:31.474 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.1.4-6.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply-3.11-14.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-3.1.0-2.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.20-6.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2021.1-5.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-2.25.1-8.el9.noarch 2024-02-28T22:51:31.475 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-02-28T22:51:31.476 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml-0.10.2-6.el9.noarch 2024-02-28T22:51:31.476 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-02-28T22:51:31.476 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.7-6.el9.noarch 2024-02-28T22:51:31.476 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-02-28T22:51:31.476 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-02-28T22:51:31.476 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:31.476 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:51:31.832 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-base 2024-02-28T22:51:31.873 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:07 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:51:32.185 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:51:32.185 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:51:32.185 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:51:32.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:51:32.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:51:32.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.189 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.190 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.191 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.192 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:32.193 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.194 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:32.259 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:51:32.259 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:32.259 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-28T22:51:32.259 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:32.259 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:51:32.259 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm noarch 2:18.2.1-0.el9 ceph-noarch 221 k 2024-02-28T22:51:32.259 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:32.260 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:51:32.260 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:32.260 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-28T22:51:32.260 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:32.260 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 221 k 2024-02-28T22:51:32.260 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 213 k 2024-02-28T22:51:32.260 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:51:32.341 INFO:teuthology.orchestra.run.smithi184.stdout:cephadm-18.2.1-0.el9.noarch.rpm 2.7 MB/s | 221 kB 00:00 2024-02-28T22:51:32.342 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:51:32.342 INFO:teuthology.orchestra.run.smithi184.stdout:Total 2.6 MB/s | 221 kB 00:00 2024-02-28T22:51:32.343 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:51:32.348 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:51:32.349 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:51:32.352 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:51:32.352 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:51:32.442 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:51:32.703 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:57 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:51:33.017 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:51:33.017 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.018 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:51:33.019 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:51:33.020 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.021 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.022 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.023 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.024 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.025 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.026 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.027 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.027 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:33.027 INFO:teuthology.orchestra.run.smithi159.stdout:Package ceph-base-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:51:33.077 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-28T22:51:33.091 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:51:33.092 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-02-28T22:51:33.092 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:51:33.166 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install cephadm 2024-02-28T22:51:33.195 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-28T22:51:33.741 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-28T22:51:34.015 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:00:59 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:51:34.095 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-28T22:51:34.095 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:34.095 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:51:34.095 INFO:teuthology.orchestra.run.smithi184.stdout: cephadm-2:18.2.1-0.el9.noarch 2024-02-28T22:51:34.095 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:34.096 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:51:34.327 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:51:34.327 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:51:34.328 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:51:34.328 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.328 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:51:34.328 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.328 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:51:34.329 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.329 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:51:34.329 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.329 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:51:34.329 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.329 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:51:34.329 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.330 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:51:34.330 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.330 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:51:34.330 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.330 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:51:34.330 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.330 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:51:34.330 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.330 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:51:34.331 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.331 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:51:34.331 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.331 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:51:34.331 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.331 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.332 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.333 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.334 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:51:34.335 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.336 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.336 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.336 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.336 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.336 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.336 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:34.339 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.339 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.339 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.340 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.340 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:34.340 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.340 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.340 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.341 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.341 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:34.341 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.341 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.341 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.341 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.342 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:34.342 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.342 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.342 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.342 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.342 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:34.342 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.343 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.343 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.343 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.343 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:34.343 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.343 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.343 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.343 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:34.383 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-immutable-object-cache 2024-02-28T22:51:34.401 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:51:34.402 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-02-28T22:51:34.402 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:34.402 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:51:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:18.2.1-0.el9 ceph-noarch 221 k 2024-02-28T22:51:34.402 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:34.402 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:51:34.402 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:34.403 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-02-28T22:51:34.403 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:34.403 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 221 k 2024-02-28T22:51:34.403 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 213 k 2024-02-28T22:51:34.403 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:51:34.483 INFO:teuthology.orchestra.run.smithi159.stdout:cephadm-18.2.1-0.el9.noarch.rpm 2.7 MB/s | 221 kB 00:00 2024-02-28T22:51:34.484 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:51:34.484 INFO:teuthology.orchestra.run.smithi159.stdout:Total 2.6 MB/s | 221 kB 00:00 2024-02-28T22:51:34.485 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:51:34.491 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:51:34.491 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:51:34.494 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:51:34.495 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:51:34.589 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:51:35.215 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-28T22:51:35.259 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:11 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:51:35.333 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-28T22:51:35.568 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:51:35.568 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:51:35.568 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:51:35.568 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.568 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:51:35.568 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.569 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:51:35.570 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.571 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.572 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.573 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.574 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.575 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.576 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:35.577 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.577 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.577 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.577 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:35.636 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:51:35.637 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:35.637 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repo Size 2024-02-28T22:51:35.637 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:35.637 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:51:35.637 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-0.el9 ceph 142 k 2024-02-28T22:51:35.637 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:35.637 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:51:35.637 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:35.637 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-28T22:51:35.638 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:35.638 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 142 k 2024-02-28T22:51:35.638 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 395 k 2024-02-28T22:51:35.638 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:51:35.706 INFO:teuthology.orchestra.run.smithi184.stdout:ceph-immutable-object-cache-18.2.1-0.el9.x86_64 2.1 MB/s | 142 kB 00:00 2024-02-28T22:51:35.706 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:51:35.706 INFO:teuthology.orchestra.run.smithi184.stdout:Total 2.0 MB/s | 142 kB 00:00 2024-02-28T22:51:35.707 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:51:35.716 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:51:35.716 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:51:35.773 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:51:35.773 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:51:35.831 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-28T22:51:35.932 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:51:35.998 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:51:36.067 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:51:36.068 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:51:36.068 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-28T22:51:36.068 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:36.158 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:18.2.1-0.el9.noarch 1/1 2024-02-28T22:51:36.158 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:51:36.158 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:18.2.1-0.el9.noarch 2024-02-28T22:51:36.158 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:51:36.428 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-immutable-object-cache 2024-02-28T22:51:37.313 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:02 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:51:37.415 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:51:37.415 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:37.415 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:51:37.415 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:37.415 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:37.415 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:51:37.623 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:51:37.623 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:51:37.623 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:51:37.623 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.623 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:51:37.623 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.623 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:51:37.623 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.623 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:51:37.624 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.624 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:51:37.624 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.624 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:51:37.624 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.624 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:51:37.624 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.624 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:51:37.624 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.624 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:51:37.624 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:51:37.625 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.626 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:51:37.627 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.628 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.629 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.630 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.631 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.632 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:37.691 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:51:37.692 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:37.692 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repo Size 2024-02-28T22:51:37.692 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:37.693 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:51:37.693 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-0.el9 ceph 142 k 2024-02-28T22:51:37.693 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:37.693 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:51:37.693 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:37.693 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-02-28T22:51:37.693 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:37.693 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 142 k 2024-02-28T22:51:37.693 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 395 k 2024-02-28T22:51:37.693 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:51:37.707 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr 2024-02-28T22:51:37.766 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-immutable-object-cache-18.2.1-0.el9.x86_64 1.9 MB/s | 142 kB 00:00 2024-02-28T22:51:37.766 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:51:37.767 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.9 MB/s | 142 kB 00:00 2024-02-28T22:51:37.767 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:51:37.775 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:51:37.776 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:51:37.833 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:51:37.833 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:51:38.005 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:51:38.066 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:51:38.139 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:51:38.139 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:51:38.139 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-02-28T22:51:38.139 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:38.566 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:14 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:51:38.876 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.877 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.878 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:51:38.879 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.880 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.881 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.882 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.883 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.884 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:38.885 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.885 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.885 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.885 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.885 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:38.885 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.885 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.885 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.885 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:38.885 INFO:teuthology.orchestra.run.smithi184.stdout:Package ceph-mgr-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:51:38.949 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:51:38.951 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-28T22:51:38.951 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:51:39.021 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-dashboard 2024-02-28T22:51:39.438 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:51:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:51:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:18.2.1-0.el9.x86_64 2024-02-28T22:51:39.439 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:39.439 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:51:39.773 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr 2024-02-28T22:51:39.872 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:15 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:51:40.180 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:51:40.180 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:51:40.180 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:51:40.180 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.180 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:51:40.180 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.180 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:51:40.180 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.180 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.181 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:51:40.182 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.183 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.184 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:51:40.185 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.186 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.187 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:40.188 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.189 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:40.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.189 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.250 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:51:40.251 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:40.251 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-28T22:51:40.251 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard noarch 2:18.2.1-0.el9 ceph-noarch 1.8 M 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards noarch 2:18.2.1-0.el9 ceph-noarch 23 k 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts noarch 2:18.2.1-0.el9 ceph-noarch 15 k 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout:Installing weak dependencies: 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:40.252 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:51:40.253 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:40.253 INFO:teuthology.orchestra.run.smithi184.stdout:Install 7 Packages 2024-02-28T22:51:40.253 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:40.253 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 2.1 M 2024-02-28T22:51:40.253 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 8.5 M 2024-02-28T22:51:40.253 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:51:40.660 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:05 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:51:40.709 INFO:teuthology.orchestra.run.smithi184.stdout:(1/7): ceph-grafana-dashboards-18.2.1-0.el9.noa 117 kB/s | 23 kB 00:00 2024-02-28T22:51:40.734 INFO:teuthology.orchestra.run.smithi184.stdout:(2/7): ceph-prometheus-alerts-18.2.1-0.el9.noar 66 kB/s | 15 kB 00:00 2024-02-28T22:51:40.802 INFO:teuthology.orchestra.run.smithi184.stdout:(3/7): ceph-mgr-dashboard-18.2.1-0.el9.noarch.r 6.1 MB/s | 1.8 MB 00:00 2024-02-28T22:51:40.971 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:51:40.972 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:51:40.972 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:51:40.972 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.972 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:51:40.972 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.972 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:51:40.972 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.972 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:51:40.972 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:51:40.973 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:51:40.974 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:51:40.975 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:51:40.976 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.977 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:51:40.978 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.979 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.980 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.980 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.980 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:40.980 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.980 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.980 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.980 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.980 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:40.980 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.980 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.980 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.981 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.981 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:40.981 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.981 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.981 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.981 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.981 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:40.981 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.981 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.981 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.981 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:40.982 INFO:teuthology.orchestra.run.smithi159.stdout:Package ceph-mgr-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:51:41.035 INFO:teuthology.orchestra.run.smithi184.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 28 kB/s | 9.0 kB 00:00 2024-02-28T22:51:41.045 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:51:41.047 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-02-28T22:51:41.047 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:51:41.123 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-dashboard 2024-02-28T22:51:41.160 INFO:teuthology.orchestra.run.smithi184.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 96 kB/s | 41 kB 00:00 2024-02-28T22:51:41.185 INFO:teuthology.orchestra.run.smithi184.stdout:(6/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 108 kB/s | 31 kB 00:00 2024-02-28T22:51:41.311 INFO:teuthology.orchestra.run.smithi184.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 684 kB/s | 188 kB 00:00 2024-02-28T22:51:41.320 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:51:41.321 INFO:teuthology.orchestra.run.smithi184.stdout:Total 1.9 MB/s | 2.1 MB 00:01 2024-02-28T22:51:41.322 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:51:41.348 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:51:41.349 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:51:41.475 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:51:41.475 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:51:41.827 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:51:41.921 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-28T22:51:41.966 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-28T22:51:41.967 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:06 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:51:42.049 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-28T22:51:42.094 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-28T22:51:42.140 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 5/7 2024-02-28T22:51:42.276 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:51:42.276 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:51:42.276 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:51:42.276 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.276 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:51:42.276 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.276 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:51:42.276 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.277 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:51:42.278 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.279 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:51:42.280 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.281 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.282 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.283 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:42.284 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.285 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.285 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.285 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:42.348 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:18.2.1-0.el9 ceph-noarch 1.8 M 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:18.2.1-0.el9 ceph-noarch 23 k 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:18.2.1-0.el9 ceph-noarch 15 k 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-02-28T22:51:42.349 INFO:teuthology.orchestra.run.smithi159.stdout:Installing weak dependencies: 2024-02-28T22:51:42.350 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-02-28T22:51:42.350 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:42.350 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:51:42.350 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:42.350 INFO:teuthology.orchestra.run.smithi159.stdout:Install 7 Packages 2024-02-28T22:51:42.350 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:42.351 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 2.1 M 2024-02-28T22:51:42.351 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 8.5 M 2024-02-28T22:51:42.351 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:51:42.451 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 6/7 2024-02-28T22:51:42.489 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-02-28T22:51:42.544 INFO:teuthology.orchestra.run.smithi159.stdout:(1/7): ceph-grafana-dashboards-18.2.1-0.el9.noa 175 kB/s | 23 kB 00:00 2024-02-28T22:51:42.569 INFO:teuthology.orchestra.run.smithi159.stdout:(2/7): ceph-prometheus-alerts-18.2.1-0.el9.noar 93 kB/s | 15 kB 00:00 2024-02-28T22:51:42.645 INFO:teuthology.orchestra.run.smithi159.stdout:(3/7): ceph-mgr-dashboard-18.2.1-0.el9.noarch.r 7.6 MB/s | 1.8 MB 00:00 2024-02-28T22:51:42.712 INFO:teuthology.orchestra.run.smithi159.stdout:(4/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 54 kB/s | 9.0 kB 00:00 2024-02-28T22:51:42.762 INFO:teuthology.orchestra.run.smithi159.stdout:(5/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 264 kB/s | 31 kB 00:00 2024-02-28T22:51:42.787 INFO:teuthology.orchestra.run.smithi159.stdout:(6/7): python3-jwt-2.4.0-1.el9.noarch.rpm 188 kB/s | 41 kB 00:00 2024-02-28T22:51:42.904 INFO:teuthology.orchestra.run.smithi159.stdout:(7/7): python3-routes-2.5.1-5.el9.noarch.rpm 985 kB/s | 188 kB 00:00 2024-02-28T22:51:42.909 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:51:42.910 INFO:teuthology.orchestra.run.smithi159.stdout:Total 3.7 MB/s | 2.1 MB 00:00 2024-02-28T22:51:42.910 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:51:42.937 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:51:42.937 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:51:43.078 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:51:43.079 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:51:43.088 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-02-28T22:51:43.088 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 1/7 2024-02-28T22:51:43.088 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2/7 2024-02-28T22:51:43.088 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 3/7 2024-02-28T22:51:43.088 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-28T22:51:43.088 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-28T22:51:43.088 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-28T22:51:43.473 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:51:43.490 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-28T22:51:43.490 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:43.490 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:51:43.490 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 2024-02-28T22:51:43.490 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2024-02-28T22:51:43.490 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 2024-02-28T22:51:43.490 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-28T22:51:43.490 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-28T22:51:43.491 INFO:teuthology.orchestra.run.smithi184.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-28T22:51:43.491 INFO:teuthology.orchestra.run.smithi184.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-28T22:51:43.491 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:43.491 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:51:43.564 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-02-28T22:51:43.616 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-02-28T22:51:43.711 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-02-28T22:51:43.754 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-02-28T22:51:43.785 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-28T22:51:43.802 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 5/7 2024-02-28T22:51:44.123 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 6/7 2024-02-28T22:51:44.158 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-02-28T22:51:44.671 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:20 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:51:44.808 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 7/7 2024-02-28T22:51:44.808 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 1/7 2024-02-28T22:51:44.808 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2/7 2024-02-28T22:51:44.808 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 3/7 2024-02-28T22:51:44.808 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-02-28T22:51:44.808 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-02-28T22:51:44.808 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-02-28T22:51:44.990 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:51:44.990 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:51:44.990 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:51:44.990 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.990 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:51:44.990 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.990 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:51:44.990 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:51:44.991 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:51:44.992 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.993 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:51:44.994 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.994 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:51:44.994 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.994 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:51:44.994 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.994 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:51:44.994 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.994 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:51:44.994 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.994 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:51:44.994 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.995 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:51:44.995 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.995 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:51:44.995 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.995 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:51:44.995 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.995 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:51:44.995 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.995 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:44.996 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:44.997 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.998 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:44.999 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:45.000 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:45.068 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:51:45.069 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:45.069 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-28T22:51:45.069 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:45.069 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:51:45.070 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-0.el9 ceph-noarch 7.4 M 2024-02-28T22:51:45.070 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-28T22:51:45.070 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-28T22:51:45.070 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-28T22:51:45.070 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-28T22:51:45.070 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-28T22:51:45.070 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-28T22:51:45.070 INFO:teuthology.orchestra.run.smithi184.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-28T22:51:45.070 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-28T22:51:45.071 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-28T22:51:45.071 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-28T22:51:45.071 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-28T22:51:45.071 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-28T22:51:45.071 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:45.071 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:51:45.071 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:51:45.071 INFO:teuthology.orchestra.run.smithi184.stdout:Install 12 Packages 2024-02-28T22:51:45.071 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:51:45.072 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 38 M 2024-02-28T22:51:45.072 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 209 M 2024-02-28T22:51:45.072 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:51:45.254 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-02-28T22:51:45.255 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:45.255 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:51:45.255 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:18.2.1-0.el9.noarch 2024-02-28T22:51:45.255 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:18.2.1-0.el9.noarch 2024-02-28T22:51:45.255 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:18.2.1-0.el9.noarch 2024-02-28T22:51:45.255 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-02-28T22:51:45.255 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-02-28T22:51:45.255 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-02-28T22:51:45.255 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.5.1-5.el9.noarch 2024-02-28T22:51:45.255 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:45.255 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:51:45.535 INFO:teuthology.orchestra.run.smithi184.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.1-0. 34 MB/s | 7.4 MB 00:00 2024-02-28T22:51:45.544 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-diskprediction-local 2024-02-28T22:51:45.860 INFO:teuthology.orchestra.run.smithi184.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 101 kB/s | 33 kB 00:00 2024-02-28T22:51:45.927 INFO:teuthology.orchestra.run.smithi184.stdout:(3/12): libquadmath-11.4.1-3.el9.x86_64.rpm 322 kB/s | 195 kB 00:00 2024-02-28T22:51:46.044 INFO:teuthology.orchestra.run.smithi184.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 158 kB/s | 18 kB 00:00 2024-02-28T22:51:46.186 INFO:teuthology.orchestra.run.smithi184.stdout:(5/12): openblas-0.3.21-2.el9.x86_64.rpm 249 kB/s | 35 kB 00:00 2024-02-28T22:51:46.253 INFO:teuthology.orchestra.run.smithi184.stdout:(6/12): libgfortran-11.4.1-3.el9.x86_64.rpm 861 kB/s | 803 kB 00:00 2024-02-28T22:51:46.370 INFO:teuthology.orchestra.run.smithi184.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2024-02-28T22:51:46.420 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:11 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:51:46.731 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.732 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.733 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.734 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:51:46.735 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.736 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.737 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.738 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.739 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.740 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.741 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.741 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:51:46.806 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:51:46.808 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-02-28T22:51:46.808 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:46.808 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:51:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-0.el9 ceph-noarch 7.4 M 2024-02-28T22:51:46.808 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-02-28T22:51:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-02-28T22:51:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-02-28T22:51:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-02-28T22:51:46.808 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout:Install 12 Packages 2024-02-28T22:51:46.809 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:51:46.810 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 38 M 2024-02-28T22:51:46.810 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 209 M 2024-02-28T22:51:46.810 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:51:47.054 INFO:teuthology.orchestra.run.smithi184.stdout:(8/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 5.5 MB/s | 4.7 MB 00:00 2024-02-28T22:51:47.338 INFO:teuthology.orchestra.run.smithi184.stdout:(9/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.0 MB/s | 3.0 MB 00:01 2024-02-28T22:51:47.371 INFO:teuthology.orchestra.run.smithi184.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 792 kB/s | 250 kB 00:00 2024-02-28T22:51:47.486 INFO:teuthology.orchestra.run.smithi159.stdout:(1/12): ceph-mgr-diskprediction-local-18.2.1-0. 22 MB/s | 7.4 MB 00:00 2024-02-28T22:51:47.661 INFO:teuthology.orchestra.run.smithi159.stdout:(2/12): libquadmath-11.4.1-3.el9.x86_64.rpm 387 kB/s | 195 kB 00:00 2024-02-28T22:51:47.837 INFO:teuthology.orchestra.run.smithi159.stdout:(3/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 803 kB 00:00 2024-02-28T22:51:48.445 INFO:teuthology.orchestra.run.smithi159.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 34 kB/s | 33 kB 00:00 2024-02-28T22:51:48.712 INFO:teuthology.orchestra.run.smithi159.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 23 kB/s | 18 kB 00:00 2024-02-28T22:51:49.048 INFO:teuthology.orchestra.run.smithi184.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 1.9 MB/s | 5.1 MB 00:02 2024-02-28T22:51:49.280 INFO:teuthology.orchestra.run.smithi159.stdout:(6/12): openblas-0.3.21-2.el9.x86_64.rpm 42 kB/s | 35 kB 00:00 2024-02-28T22:51:50.321 INFO:teuthology.orchestra.run.smithi159.stdout:(7/12): python3-devel-3.9.17-2.el9.x86_64.rpm 236 kB/s | 245 kB 00:01 2024-02-28T22:51:50.329 INFO:teuthology.orchestra.run.smithi184.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 5.4 MB/s | 16 MB 00:02 2024-02-28T22:51:50.331 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:51:50.332 INFO:teuthology.orchestra.run.smithi184.stdout:Total 7.2 MB/s | 38 MB 00:05 2024-02-28T22:51:50.968 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:51:51.047 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:51:51.047 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:51:51.647 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:51:51.648 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:51:52.557 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:51:52.627 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-02-28T22:51:52.688 INFO:teuthology.orchestra.run.smithi159.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 609 kB/s | 3.0 MB 00:05 2024-02-28T22:51:52.688 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-02-28T22:51:52.854 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-02-28T22:51:52.905 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-28T22:51:53.153 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-28T22:51:53.186 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-28T22:51:53.298 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-28T22:51:53.663 INFO:teuthology.orchestra.run.smithi159.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 258 kB/s | 250 kB 00:00 2024-02-28T22:51:54.133 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-28T22:51:54.287 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-28T22:51:55.638 INFO:teuthology.orchestra.run.smithi159.stdout:(10/12): openblas-openmp-0.3.21-2.el9.x86_64.rp 701 kB/s | 4.7 MB 00:06 2024-02-28T22:51:55.836 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T22:51:56.987 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-28T22:51:57.028 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-02-28T22:51:57.529 INFO:teuthology.orchestra.run.smithi159.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 724 kB/s | 5.1 MB 00:07 2024-02-28T22:51:59.645 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-02-28T22:51:59.645 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 1/12 2024-02-28T22:51:59.645 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-28T22:51:59.645 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-02-28T22:51:59.646 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-02-28T22:51:59.646 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-02-28T22:51:59.646 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-02-28T22:51:59.646 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-02-28T22:51:59.646 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-02-28T22:51:59.646 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-02-28T22:51:59.646 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T22:51:59.646 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-02-28T22:52:00.176 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarch 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-28T22:52:00.177 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-28T22:52:00.178 INFO:teuthology.orchestra.run.smithi184.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-28T22:52:00.178 INFO:teuthology.orchestra.run.smithi184.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-28T22:52:00.178 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:00.178 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:00.605 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-rook 2024-02-28T22:52:01.485 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:37 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:01.795 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:01.795 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:01.795 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:01.795 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.795 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.796 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:01.797 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:01.798 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.799 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.800 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.801 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.802 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:01.803 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.804 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:01.871 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:01.872 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:01.872 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-28T22:52:01.872 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:01.872 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:52:01.872 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook noarch 2:18.2.1-0.el9 ceph-noarch 50 k 2024-02-28T22:52:01.872 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-28T22:52:01.872 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-28T22:52:01.873 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-28T22:52:01.873 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-02-28T22:52:01.873 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-28T22:52:01.873 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-28T22:52:01.873 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-28T22:52:01.873 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-28T22:52:01.873 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-28T22:52:01.873 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-28T22:52:01.874 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-28T22:52:01.874 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-28T22:52:01.874 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-28T22:52:01.874 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:01.874 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:52:01.874 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:01.874 INFO:teuthology.orchestra.run.smithi184.stdout:Install 13 Packages 2024-02-28T22:52:01.874 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:01.875 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 2.2 M 2024-02-28T22:52:01.875 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 26 M 2024-02-28T22:52:01.875 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:52:02.177 INFO:teuthology.orchestra.run.smithi184.stdout:(1/13): ceph-mgr-rook-18.2.1-0.el9.noarch.rpm 539 kB/s | 50 kB 00:00 2024-02-28T22:52:02.202 INFO:teuthology.orchestra.run.smithi184.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 217 kB/s | 26 kB 00:00 2024-02-28T22:52:02.227 INFO:teuthology.orchestra.run.smithi184.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 134 kB/s | 19 kB 00:00 2024-02-28T22:52:02.319 INFO:teuthology.orchestra.run.smithi184.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 222 kB 00:00 2024-02-28T22:52:02.353 INFO:teuthology.orchestra.run.smithi184.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-02-28T22:52:02.386 INFO:teuthology.orchestra.run.smithi184.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.7 MB/s | 279 kB 00:00 2024-02-28T22:52:02.420 INFO:teuthology.orchestra.run.smithi184.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 538 kB/s | 54 kB 00:00 2024-02-28T22:52:02.454 INFO:teuthology.orchestra.run.smithi184.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 323 kB/s | 32 kB 00:00 2024-02-28T22:52:02.479 INFO:teuthology.orchestra.run.smithi184.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 164 kB/s | 15 kB 00:00 2024-02-28T22:52:02.546 INFO:teuthology.orchestra.run.smithi184.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 898 kB/s | 59 kB 00:00 2024-02-28T22:52:02.579 INFO:teuthology.orchestra.run.smithi184.stdout:(11/13): python3-google-auth-2.28.0-1.el9.noarc 1.3 MB/s | 203 kB 00:00 2024-02-28T22:52:02.613 INFO:teuthology.orchestra.run.smithi184.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.3 MB/s | 90 kB 00:00 2024-02-28T22:52:02.663 INFO:teuthology.orchestra.run.smithi184.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 4.9 MB/s | 1.0 MB 00:00 2024-02-28T22:52:02.665 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:02.666 INFO:teuthology.orchestra.run.smithi184.stdout:Total 2.8 MB/s | 2.2 MB 00:00 2024-02-28T22:52:02.879 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:52:02.924 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:52:02.924 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:52:03.082 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:52:03.082 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:52:03.727 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:52:03.943 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-28T22:52:04.014 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-28T22:52:04.087 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-28T22:52:04.126 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-28T22:52:04.173 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-28T22:52:04.299 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-28T22:52:04.439 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 7/13 2024-02-28T22:52:04.499 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-28T22:52:05.425 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-28T22:52:05.482 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-28T22:52:05.516 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-28T22:52:05.571 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-28T22:52:05.600 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-02-28T22:52:06.470 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-rook-2:18.2.1-0.el9.noarch 1/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 10/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-28T22:52:06.471 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-28T22:52:06.933 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-28T22:52:06.933 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:06.934 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:52:06.934 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-rook-2:18.2.1-0.el9.noarch 2024-02-28T22:52:06.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-28T22:52:06.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-28T22:52:06.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-02-28T22:52:06.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-28T22:52:06.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-28T22:52:06.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-28T22:52:06.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-28T22:52:06.934 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-28T22:52:06.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-28T22:52:06.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-28T22:52:06.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-28T22:52:06.935 INFO:teuthology.orchestra.run.smithi184.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-28T22:52:06.935 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:06.935 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:07.262 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-mgr-cephadm 2024-02-28T22:52:08.123 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:44 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:08.429 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:08.429 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:08.429 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:08.429 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.429 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:08.429 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.430 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:08.431 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.431 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:08.431 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.431 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:08.431 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.431 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:08.431 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.431 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:08.431 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.432 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:08.432 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.432 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:08.432 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.432 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:08.432 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.432 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:08.432 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.432 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:08.433 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.433 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:08.433 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.433 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:08.433 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.433 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:08.433 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.434 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:08.434 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.434 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:08.434 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.434 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:08.434 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.434 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:08.435 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.435 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:08.435 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.435 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:08.435 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.435 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:08.435 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.436 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:08.436 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.436 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:08.436 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.436 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:08.436 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.437 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:08.437 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.437 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:08.437 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.437 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:08.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.438 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:08.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.438 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:08.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.439 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:08.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.439 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:08.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.441 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:08.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.441 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:08.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.443 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.443 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:08.443 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.443 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.443 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.443 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:08.502 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:08.502 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:08.502 INFO:teuthology.orchestra.run.smithi184.stdout: Package Arch Version Repository Size 2024-02-28T22:52:08.502 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm noarch 2:18.2.1-0.el9 ceph-noarch 132 k 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout:Install 6 Packages 2024-02-28T22:52:08.503 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:08.504 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 7.0 M 2024-02-28T22:52:08.504 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 33 M 2024-02-28T22:52:08.504 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:52:08.759 INFO:teuthology.orchestra.run.smithi184.stdout:(1/6): ceph-mgr-cephadm-18.2.1-0.el9.noarch.rpm 1.5 MB/s | 132 kB 00:00 2024-02-28T22:52:08.926 INFO:teuthology.orchestra.run.smithi184.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 974 kB/s | 248 kB 00:00 2024-02-28T22:52:09.276 INFO:teuthology.orchestra.run.smithi184.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 165 kB/s | 58 kB 00:00 2024-02-28T22:52:09.318 INFO:teuthology.orchestra.run.smithi184.stdout:(4/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 981 kB/s | 548 kB 00:00 2024-02-28T22:52:09.385 INFO:teuthology.orchestra.run.smithi184.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 478 kB/s | 51 kB 00:00 2024-02-28T22:52:09.718 INFO:teuthology.orchestra.run.smithi184.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 5.7 MB/s | 6.0 MB 00:01 2024-02-28T22:52:09.723 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:09.723 INFO:teuthology.orchestra.run.smithi184.stdout:Total 5.7 MB/s | 7.0 MB 00:01 2024-02-28T22:52:09.848 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:52:09.885 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:52:09.885 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:52:10.041 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:52:10.042 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:52:10.455 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:52:10.662 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-28T22:52:10.725 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-28T22:52:11.393 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-28T22:52:11.497 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-28T22:52:11.589 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-28T22:52:11.624 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-02-28T22:52:12.522 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-02-28T22:52:12.522 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 1/6 2024-02-28T22:52:12.522 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-28T22:52:12.522 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-28T22:52:12.523 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-28T22:52:12.523 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-28T22:52:12.960 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-28T22:52:12.961 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:12.961 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:52:12.961 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 2024-02-28T22:52:12.961 INFO:teuthology.orchestra.run.smithi184.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-28T22:52:12.961 INFO:teuthology.orchestra.run.smithi184.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-28T22:52:12.961 INFO:teuthology.orchestra.run.smithi184.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-28T22:52:12.961 INFO:teuthology.orchestra.run.smithi184.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-28T22:52:12.961 INFO:teuthology.orchestra.run.smithi184.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-28T22:52:12.961 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:12.961 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:13.284 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install ceph-fuse 2024-02-28T22:52:14.101 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:50 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:14.409 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:14.409 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:14.409 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:14.409 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.409 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.410 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:14.411 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:14.412 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.413 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.414 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.415 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.416 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.417 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:14.418 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.418 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.418 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.418 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:14.484 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:14.484 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:14.484 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-28T22:52:14.485 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:14.485 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:52:14.485 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse x86_64 2:18.2.1-0.el9 ceph 839 k 2024-02-28T22:52:14.485 INFO:teuthology.orchestra.run.smithi184.stdout:Installing dependencies: 2024-02-28T22:52:14.485 INFO:teuthology.orchestra.run.smithi184.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-28T22:52:14.485 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:14.485 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:52:14.485 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:14.485 INFO:teuthology.orchestra.run.smithi184.stdout:Install 2 Packages 2024-02-28T22:52:14.485 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:14.486 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 920 k 2024-02-28T22:52:14.486 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 2.7 M 2024-02-28T22:52:14.486 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:52:14.637 INFO:teuthology.orchestra.run.smithi184.stdout:(1/2): ceph-fuse-18.2.1-0.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-02-28T22:52:14.994 INFO:teuthology.orchestra.run.smithi159.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 780 kB/s | 16 MB 00:21 2024-02-28T22:52:14.996 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:14.997 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.3 MB/s | 38 MB 00:28 2024-02-28T22:52:15.096 INFO:teuthology.orchestra.run.smithi184.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 150 kB/s | 80 kB 00:00 2024-02-28T22:52:15.097 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:15.098 INFO:teuthology.orchestra.run.smithi184.stdout:Total 1.5 MB/s | 920 kB 00:00 2024-02-28T22:52:15.137 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:52:15.209 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:52:15.210 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:52:15.307 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:52:15.307 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:52:15.564 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:52:15.637 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:52:15.716 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:52:15.716 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:52:15.728 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-28T22:52:15.814 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-02-28T22:52:16.330 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:52:16.330 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:52:16.732 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-02-28T22:52:16.732 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : ceph-fuse-2:18.2.1-0.el9.x86_64 1/2 2024-02-28T22:52:17.089 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-28T22:52:17.090 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:17.091 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:52:17.091 INFO:teuthology.orchestra.run.smithi184.stdout: ceph-fuse-2:18.2.1-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-28T22:52:17.091 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:17.091 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:17.217 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:52:17.293 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-02-28T22:52:17.346 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 2/12 2024-02-28T22:52:17.418 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librados-devel 2024-02-28T22:52:17.498 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 3/12 2024-02-28T22:52:17.536 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-02-28T22:52:17.785 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-02-28T22:52:17.818 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-02-28T22:52:18.036 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-02-28T22:52:18.331 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:54 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:18.655 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:18.655 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:18.655 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:18.655 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.655 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:18.656 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.657 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.658 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:18.659 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:18.660 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.661 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.662 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.663 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.664 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:18.734 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:18.735 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:18.735 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-28T22:52:18.735 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:18.735 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:52:18.735 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel x86_64 2:18.2.1-0.el9 ceph 127 k 2024-02-28T22:52:18.735 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:18.735 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:52:18.735 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:18.736 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-28T22:52:18.736 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:18.736 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 127 k 2024-02-28T22:52:18.736 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 456 k 2024-02-28T22:52:18.736 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:52:18.817 INFO:teuthology.orchestra.run.smithi184.stdout:librados-devel-18.2.1-0.el9.x86_64.rpm 1.5 MB/s | 127 kB 00:00 2024-02-28T22:52:18.818 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:18.818 INFO:teuthology.orchestra.run.smithi184.stdout:Total 1.5 MB/s | 127 kB 00:00 2024-02-28T22:52:18.819 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:52:18.825 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:52:18.825 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:52:18.892 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:52:18.892 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:52:18.927 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-02-28T22:52:19.060 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-02-28T22:52:19.085 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:52:19.194 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:19.752 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:20.102 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:20.102 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:20.102 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:52:20.102 INFO:teuthology.orchestra.run.smithi184.stdout: librados-devel-2:18.2.1-0.el9.x86_64 2024-02-28T22:52:20.103 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:20.103 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:20.469 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install libcephfs2 2024-02-28T22:52:20.634 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T22:52:21.378 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:57 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:21.692 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:21.692 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:21.692 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:21.692 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.692 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:21.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:21.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.696 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.697 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.700 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.701 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.701 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.701 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:21.701 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.701 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.701 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.701 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:21.701 INFO:teuthology.orchestra.run.smithi184.stdout:Package libcephfs2-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:21.767 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:21.769 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-28T22:52:21.769 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:21.791 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-02-28T22:52:21.842 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install libcephfs-devel 2024-02-28T22:52:21.854 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-02-28T22:52:22.669 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:01:58 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:22.979 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:22.979 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:22.979 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:22.979 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.979 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:22.979 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:22.980 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.981 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.982 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:22.983 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:22.984 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.985 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.986 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.987 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:22.988 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.988 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.988 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:22.988 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:23.053 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:23.053 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel x86_64 2:18.2.1-0.el9 ceph 31 k 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 31 k 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 139 k 2024-02-28T22:52:23.054 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:52:23.129 INFO:teuthology.orchestra.run.smithi184.stdout:libcephfs-devel-18.2.1-0.el9.x86_64.rpm 418 kB/s | 31 kB 00:00 2024-02-28T22:52:23.130 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:23.130 INFO:teuthology.orchestra.run.smithi184.stdout:Total 407 kB/s | 31 kB 00:00 2024-02-28T22:52:23.130 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:52:23.135 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:52:23.135 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:52:23.173 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:52:23.174 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:52:23.323 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:52:23.483 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:23.983 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:24.273 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:24.274 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:24.274 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:52:24.274 INFO:teuthology.orchestra.run.smithi184.stdout: libcephfs-devel-2:18.2.1-0.el9.x86_64 2024-02-28T22:52:24.274 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:24.274 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:24.471 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 12/12 2024-02-28T22:52:24.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarc 1/12 2024-02-28T22:52:24.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-02-28T22:52:24.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 3/12 2024-02-28T22:52:24.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-02-28T22:52:24.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-02-28T22:52:24.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-02-28T22:52:24.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 7/12 2024-02-28T22:52:24.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 8/12 2024-02-28T22:52:24.471 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 9/12 2024-02-28T22:52:24.472 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-02-28T22:52:24.472 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-02-28T22:52:24.530 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librados2 2024-02-28T22:52:24.998 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-02-28T22:52:24.998 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:24.998 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:52:24.998 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:18.2.1-0.el9.noarch 2024-02-28T22:52:24.998 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.21-2.el9.x86_64 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:24.999 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:25.383 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:01 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:25.466 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-rook 2024-02-28T22:52:25.690 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:25.690 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:25.690 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:25.690 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.691 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:25.692 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.692 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:25.692 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.692 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:25.692 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.692 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:25.692 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.692 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:25.692 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.692 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:25.692 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.693 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:25.694 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.695 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.696 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:25.697 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.698 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.699 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:25.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.699 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:25.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.699 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:25.700 INFO:teuthology.orchestra.run.smithi184.stdout:Package librados2-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:25.765 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:25.766 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-28T22:52:25.766 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:25.846 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install librbd1 2024-02-28T22:52:26.356 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:51 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:26.667 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:26.667 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:26.667 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:26.667 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.667 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:26.667 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.667 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:26.667 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.667 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:26.668 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:26.669 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.670 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.671 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:26.672 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.673 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.674 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.675 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.675 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:26.675 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.675 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.675 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.675 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.675 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:26.675 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.675 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.675 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.675 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.676 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:26.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.676 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:26.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.676 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:26.695 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:02 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:26.743 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:26.744 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-02-28T22:52:26.744 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:26.744 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:52:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:18.2.1-0.el9 ceph-noarch 50 k 2024-02-28T22:52:26.744 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-02-28T22:52:26.744 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:26.745 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:52:26.746 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:26.746 INFO:teuthology.orchestra.run.smithi159.stdout:Install 13 Packages 2024-02-28T22:52:26.746 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:26.746 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 2.2 M 2024-02-28T22:52:26.746 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 26 M 2024-02-28T22:52:26.746 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:52:26.927 INFO:teuthology.orchestra.run.smithi159.stdout:(1/13): ceph-mgr-rook-18.2.1-0.el9.noarch.rpm 682 kB/s | 50 kB 00:00 2024-02-28T22:52:26.953 INFO:teuthology.orchestra.run.smithi159.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 260 kB/s | 26 kB 00:00 2024-02-28T22:52:26.978 INFO:teuthology.orchestra.run.smithi159.stdout:(3/13): python3-jsonpointer-2.0-4.el9.noarch.rp 155 kB/s | 19 kB 00:00 2024-02-28T22:52:27.003 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:27.003 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:27.003 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:27.003 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.003 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:27.004 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.004 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:27.004 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.004 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:27.004 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.004 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:27.004 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.004 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:27.004 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.004 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:27.005 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.005 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:27.005 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.005 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:27.005 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.005 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:27.005 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.005 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:27.005 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.005 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:27.005 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.006 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:27.006 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.006 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:27.006 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.006 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:27.006 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.006 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:27.006 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.006 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:27.006 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.007 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:27.007 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.007 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:27.007 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.007 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:27.007 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.007 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:27.007 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.007 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:27.007 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.007 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:27.008 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.008 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:27.008 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.008 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:27.008 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.008 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:27.008 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.008 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:27.008 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.008 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:27.009 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.009 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:27.009 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.009 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:27.009 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.009 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:27.009 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.009 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:27.009 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.009 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:27.009 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.010 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:27.010 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.010 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:27.010 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.010 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:27.010 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.010 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.010 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.010 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:27.010 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.010 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.011 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.012 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.012 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.012 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:27.012 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.012 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.012 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.013 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.013 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:27.013 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.013 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.013 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.013 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.013 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:27.013 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.013 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.014 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.014 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.014 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:27.014 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.014 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.014 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.014 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.014 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:27.014 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.014 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.014 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.015 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:27.015 INFO:teuthology.orchestra.run.smithi184.stdout:Package librbd1-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:27.077 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:27.079 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-28T22:52:27.079 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:27.095 INFO:teuthology.orchestra.run.smithi159.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-02-28T22:52:27.148 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rados 2024-02-28T22:52:27.153 INFO:teuthology.orchestra.run.smithi159.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 985 kB/s | 222 kB 00:00 2024-02-28T22:52:27.196 INFO:teuthology.orchestra.run.smithi159.stdout:(6/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.3 MB/s | 279 kB 00:00 2024-02-28T22:52:27.246 INFO:teuthology.orchestra.run.smithi159.stdout:(7/13): python3-requests-oauthlib-1.3.0-12.el9. 358 kB/s | 54 kB 00:00 2024-02-28T22:52:27.454 INFO:teuthology.orchestra.run.smithi159.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 107 kB/s | 32 kB 00:00 2024-02-28T22:52:27.496 INFO:teuthology.orchestra.run.smithi159.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 50 kB/s | 15 kB 00:00 2024-02-28T22:52:27.588 INFO:teuthology.orchestra.run.smithi159.stdout:(10/13): python3-google-auth-2.28.0-1.el9.noarc 914 kB/s | 203 kB 00:00 2024-02-28T22:52:27.622 INFO:teuthology.orchestra.run.smithi159.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 476 kB/s | 59 kB 00:00 2024-02-28T22:52:27.722 INFO:teuthology.orchestra.run.smithi159.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 3.8 MB/s | 1.0 MB 00:00 2024-02-28T22:52:27.747 INFO:teuthology.orchestra.run.smithi159.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 569 kB/s | 90 kB 00:00 2024-02-28T22:52:27.754 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:27.754 INFO:teuthology.orchestra.run.smithi159.stdout:Total 2.2 MB/s | 2.2 MB 00:01 2024-02-28T22:52:27.973 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:52:28.019 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:52:28.019 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:52:28.023 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:04 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:28.175 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:52:28.176 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:52:28.330 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:28.330 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:28.330 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:28.330 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.330 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:28.330 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.331 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:28.332 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.333 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:28.334 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.335 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.336 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.337 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.337 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.337 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:28.337 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.337 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.339 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.339 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.339 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:28.339 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.339 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.339 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.339 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.339 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:28.339 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.339 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.339 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.340 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:28.341 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.341 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.341 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.341 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:28.341 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rados-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:28.405 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:28.406 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-28T22:52:28.407 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:28.477 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rgw 2024-02-28T22:52:28.844 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:52:29.051 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-02-28T22:52:29.149 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-02-28T22:52:29.227 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-02-28T22:52:29.270 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-02-28T22:52:29.326 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-02-28T22:52:29.352 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:05 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:29.464 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-02-28T22:52:29.606 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 7/13 2024-02-28T22:52:29.669 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:29.670 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:29.670 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:29.670 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.670 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:29.670 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.670 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:29.670 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.670 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:29.670 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.670 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:29.670 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:29.671 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.672 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:29.672 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.672 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:29.672 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.672 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:29.672 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.672 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:29.672 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.672 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:29.672 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.672 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:29.673 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.674 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.675 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.676 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.677 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.678 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:29.678 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.678 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.678 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.678 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.678 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:29.678 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.678 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.678 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.678 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:29.679 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-02-28T22:52:29.679 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rgw-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:29.748 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:29.750 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-28T22:52:29.750 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:29.828 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-cephfs 2024-02-28T22:52:30.608 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-02-28T22:52:30.659 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:06 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:30.667 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-02-28T22:52:30.700 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-02-28T22:52:30.756 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-02-28T22:52:30.785 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-02-28T22:52:30.966 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:30.966 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:30.966 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:30.966 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.966 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:30.966 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.966 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:30.966 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:30.967 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.968 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.969 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.970 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.971 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.972 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:30.973 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.973 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.973 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.973 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.973 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:30.973 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.973 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:30.974 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.975 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.975 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.975 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.975 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:30.975 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.975 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.975 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.975 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:30.977 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-cephfs-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:31.042 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:31.043 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-28T22:52:31.043 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:31.124 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install python3-rbd 2024-02-28T22:52:31.750 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-0.el9.noarch 13/13 2024-02-28T22:52:31.750 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:18.2.1-0.el9.noarch 1/13 2024-02-28T22:52:31.750 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-02-28T22:52:31.750 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-02-28T22:52:31.750 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-02-28T22:52:31.750 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-02-28T22:52:31.750 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-02-28T22:52:31.750 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-02-28T22:52:31.750 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-02-28T22:52:31.750 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-02-28T22:52:31.750 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 10/13 2024-02-28T22:52:31.751 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-02-28T22:52:31.751 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-02-28T22:52:31.980 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:07 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:32.242 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-02-28T22:52:32.243 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:32.243 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:52:32.243 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:18.2.1-0.el9.noarch 2024-02-28T22:52:32.243 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-02-28T22:52:32.243 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-02-28T22:52:32.243 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-02-28T22:52:32.243 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-02-28T22:52:32.243 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-02-28T22:52:32.243 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-02-28T22:52:32.243 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-02-28T22:52:32.243 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-02-28T22:52:32.244 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-02-28T22:52:32.244 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-02-28T22:52:32.244 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el9.noarch 2024-02-28T22:52:32.244 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-02-28T22:52:32.244 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:32.244 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:32.287 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.288 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.289 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:32.290 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:32.291 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.292 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.293 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.294 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.295 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:32.296 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.296 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.296 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.296 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.296 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:32.296 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.296 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.296 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.296 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:32.297 INFO:teuthology.orchestra.run.smithi184.stdout:Package python3-rbd-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:32.366 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:32.367 INFO:teuthology.orchestra.run.smithi184.stdout:Nothing to do. 2024-02-28T22:52:32.367 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:32.448 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-fuse 2024-02-28T22:52:32.594 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-mgr-cephadm 2024-02-28T22:52:33.272 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:09 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:33.480 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:01:58 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:33.579 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:33.579 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:33.579 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:33.579 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.579 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:33.579 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.579 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:33.579 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:33.580 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.581 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.582 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:33.583 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.584 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.585 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.586 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.587 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:33.588 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.588 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.588 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.588 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.653 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:33.654 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:33.654 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-28T22:52:33.654 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:33.654 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:52:33.654 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse x86_64 2:18.2.1-0.el9 ceph 86 k 2024-02-28T22:52:33.655 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:33.655 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:52:33.655 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:33.655 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-28T22:52:33.655 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:33.655 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 86 k 2024-02-28T22:52:33.655 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 226 k 2024-02-28T22:52:33.655 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:52:33.740 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-fuse-18.2.1-0.el9.x86_64.rpm 1.0 MB/s | 86 kB 00:00 2024-02-28T22:52:33.741 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:33.741 INFO:teuthology.orchestra.run.smithi184.stdout:Total 996 kB/s | 86 kB 00:00 2024-02-28T22:52:33.741 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:52:33.749 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:52:33.749 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:52:33.796 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:33.796 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:33.796 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:33.796 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.796 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:33.796 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:33.797 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.798 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:33.799 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.800 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:33.801 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.802 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:33.802 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.802 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.802 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.802 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:33.802 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.802 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.802 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.803 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.803 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:33.803 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.803 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.803 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.803 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.803 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.804 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.804 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:33.804 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.804 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.804 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.804 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.804 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:33.804 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.804 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.804 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.804 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.805 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.806 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.806 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:33.806 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.806 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.806 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.806 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:33.815 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:52:33.815 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:52:33.873 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:18.2.1-0.el9 ceph-noarch 132 k 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-02-28T22:52:33.874 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:33.875 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:52:33.875 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:33.875 INFO:teuthology.orchestra.run.smithi159.stdout:Install 6 Packages 2024-02-28T22:52:33.875 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:33.875 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 7.0 M 2024-02-28T22:52:33.875 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 33 M 2024-02-28T22:52:33.875 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:52:33.959 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:52:34.068 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:34.400 INFO:teuthology.orchestra.run.smithi159.stdout:(1/6): ceph-mgr-cephadm-18.2.1-0.el9.noarch.rpm 1.1 MB/s | 132 kB 00:00 2024-02-28T22:52:34.596 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:34.675 INFO:teuthology.orchestra.run.smithi159.stdout:(2/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 630 kB/s | 248 kB 00:00 2024-02-28T22:52:34.834 INFO:teuthology.orchestra.run.smithi159.stdout:(3/6): python3-asyncssh-2.13.2-4.el9.noarch.rpm 1.2 MB/s | 548 kB 00:00 2024-02-28T22:52:34.903 INFO:teuthology.orchestra.run.smithi159.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 799 kB/s | 51 kB 00:00 2024-02-28T22:52:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:34.960 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:52:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-fuse-2:18.2.1-0.el9.x86_64 2024-02-28T22:52:34.960 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:34.961 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:34.967 INFO:teuthology.orchestra.run.smithi159.stdout:(5/6): python3-natsort-7.1.1-5.el9.noarch.rpm 198 kB/s | 58 kB 00:00 2024-02-28T22:52:35.085 INFO:teuthology.orchestra.run.smithi159.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 7.4 MB/s | 6.0 MB 00:00 2024-02-28T22:52:35.089 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:35.090 INFO:teuthology.orchestra.run.smithi159.stdout:Total 5.7 MB/s | 7.0 MB 00:01 2024-02-28T22:52:35.218 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:52:35.255 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:52:35.256 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:52:35.260 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-mirror 2024-02-28T22:52:35.405 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:52:35.407 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:52:35.805 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:52:36.002 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-02-28T22:52:36.072 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 2/6 2024-02-28T22:52:36.174 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:12 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:36.481 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:36.481 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:36.481 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:36.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.481 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:36.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.481 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:36.481 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:36.482 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.483 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.484 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:36.485 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.486 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.487 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.488 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.489 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.490 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.490 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:36.558 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 3.0 M 2024-02-28T22:52:36.559 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 12 M 2024-02-28T22:52:36.560 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:52:36.669 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-mirror-18.2.1-0.el9.x86_64.rpm 28 MB/s | 3.0 MB 00:00 2024-02-28T22:52:36.669 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:36.670 INFO:teuthology.orchestra.run.smithi184.stdout:Total 27 MB/s | 3.0 MB 00:00 2024-02-28T22:52:36.670 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:52:36.681 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:52:36.681 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:52:36.719 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-02-28T22:52:36.764 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:52:36.765 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:52:36.835 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-02-28T22:52:36.913 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-02-28T22:52:36.940 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-02-28T22:52:37.219 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:52:37.311 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:37.400 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:37.400 INFO:teuthology.orchestra.run.smithi184.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:52:37.400 INFO:teuthology.orchestra.run.smithi184.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-28T22:52:37.400 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T22:52:37.400 INFO:teuthology.orchestra.run.smithi184.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T22:52:37.400 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:37.806 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 6/6 2024-02-28T22:52:37.806 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 1/6 2024-02-28T22:52:37.806 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-02-28T22:52:37.806 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-02-28T22:52:37.807 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 4/6 2024-02-28T22:52:37.807 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-02-28T22:52:38.197 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-02-28T22:52:38.198 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:38.198 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:52:38.198 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:18.2.1-0.el9.noarch 2024-02-28T22:52:38.198 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-02-28T22:52:38.198 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.9.1-2.el9.noarch 2024-02-28T22:52:38.198 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-02-28T22:52:38.198 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-02-28T22:52:38.198 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-02-28T22:52:38.198 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:38.198 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:38.533 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-fuse 2024-02-28T22:52:38.951 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:38.951 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:38.951 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:52:38.951 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-mirror-2:18.2.1-0.el9.x86_64 2024-02-28T22:52:38.952 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:38.952 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:39.223 DEBUG:teuthology.orchestra.run.smithi184:> sudo yum -y install rbd-nbd 2024-02-28T22:52:39.399 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:04 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:39.707 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:39.707 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:39.707 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:39.708 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.708 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:39.708 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.708 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:39.708 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.708 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:39.708 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.708 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:39.708 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.708 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:39.708 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.709 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:39.709 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.709 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:39.709 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.709 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:39.709 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.709 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:39.709 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.709 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:39.709 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.709 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:39.710 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.710 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:39.710 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.710 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:39.710 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.710 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:39.710 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.710 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:39.710 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.710 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:39.710 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:39.711 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.712 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:39.712 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.712 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:39.712 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.712 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:39.712 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.712 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:39.712 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.712 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:39.712 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.712 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:39.713 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.713 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:39.713 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.713 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:39.713 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.713 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:39.713 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.713 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:39.713 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.713 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:39.713 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.714 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:39.714 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.714 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:39.714 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.714 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.714 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.714 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:39.714 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.714 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.714 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.714 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.715 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.716 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:39.716 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.716 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.716 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.716 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.716 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:39.716 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.716 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.716 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.716 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.716 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:39.717 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.717 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.717 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.717 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.717 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:39.717 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.717 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.717 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.717 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.717 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:39.717 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.718 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.718 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.718 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:39.781 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:39.782 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:39.782 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-02-28T22:52:39.782 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:39.782 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:52:39.782 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:18.2.1-0.el9 ceph 839 k 2024-02-28T22:52:39.782 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-02-28T22:52:39.782 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-02-28T22:52:39.782 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:52:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:Install 2 Packages 2024-02-28T22:52:39.783 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 920 k 2024-02-28T22:52:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 2.7 M 2024-02-28T22:52:39.783 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:52:39.977 INFO:teuthology.orchestra.run.smithi159.stdout:(1/2): ceph-fuse-18.2.1-0.el9.x86_64.rpm 6.9 MB/s | 839 kB 00:00 2024-02-28T22:52:40.020 INFO:teuthology.orchestra.run.smithi159.stdout:(2/2): fuse-2.9.9-15.el9.x86_64.rpm 495 kB/s | 80 kB 00:00 2024-02-28T22:52:40.021 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:40.022 INFO:teuthology.orchestra.run.smithi159.stdout:Total 3.8 MB/s | 920 kB 00:00 2024-02-28T22:52:40.056 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:52:40.124 INFO:teuthology.orchestra.run.smithi184.stdout:Last metadata expiration check: 0:02:16 ago on Wed 28 Feb 2024 10:50:24 PM UTC. 2024-02-28T22:52:40.125 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:52:40.125 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:52:40.223 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:52:40.223 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:52:40.433 INFO:teuthology.orchestra.run.smithi184.stderr:Modular dependency problems: 2024-02-28T22:52:40.433 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T22:52:40.433 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 1: conflicting requests 2024-02-28T22:52:40.433 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.433 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 2: conflicting requests 2024-02-28T22:52:40.433 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 3: conflicting requests 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 4: conflicting requests 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 5: conflicting requests 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 6: conflicting requests 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 7: conflicting requests 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 8: conflicting requests 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.434 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 9: conflicting requests 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 10: conflicting requests 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 11: conflicting requests 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 12: conflicting requests 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 13: conflicting requests 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 14: conflicting requests 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.435 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 15: conflicting requests 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 16: conflicting requests 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 17: conflicting requests 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 18: conflicting requests 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 19: conflicting requests 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 20: conflicting requests 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 21: conflicting requests 2024-02-28T22:52:40.436 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 22: conflicting requests 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 23: conflicting requests 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 24: conflicting requests 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 25: conflicting requests 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 26: conflicting requests 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 27: conflicting requests 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.437 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 28: conflicting requests 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 29: conflicting requests 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 30: conflicting requests 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 31: conflicting requests 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 32: conflicting requests 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 33: conflicting requests 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 34: conflicting requests 2024-02-28T22:52:40.438 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 35: conflicting requests 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 36: conflicting requests 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 38: conflicting requests 2024-02-28T22:52:40.439 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.440 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:40.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.440 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.440 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:40.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.441 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:40.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.441 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.442 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.443 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.443 INFO:teuthology.orchestra.run.smithi184.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:40.473 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:52:40.508 INFO:teuthology.orchestra.run.smithi184.stdout:Dependencies resolved. 2024-02-28T22:52:40.508 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout: Package Architecture Version Repository Size 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout:Installing: 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd x86_64 2:18.2.1-0.el9 ceph 171 k 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction Summary 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout:================================================================================ 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout:Install 1 Package 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout:Total download size: 171 k 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout:Installed size: 494 k 2024-02-28T22:52:40.509 INFO:teuthology.orchestra.run.smithi184.stdout:Downloading Packages: 2024-02-28T22:52:40.606 INFO:teuthology.orchestra.run.smithi184.stdout:rbd-nbd-18.2.1-0.el9.x86_64.rpm 1.7 MB/s | 171 kB 00:00 2024-02-28T22:52:40.606 INFO:teuthology.orchestra.run.smithi184.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:40.607 INFO:teuthology.orchestra.run.smithi184.stdout:Total 1.7 MB/s | 171 kB 00:00 2024-02-28T22:52:40.607 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction check 2024-02-28T22:52:40.616 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction check succeeded. 2024-02-28T22:52:40.616 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction test 2024-02-28T22:52:40.634 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-02-28T22:52:40.681 INFO:teuthology.orchestra.run.smithi184.stdout:Transaction test succeeded. 2024-02-28T22:52:40.682 INFO:teuthology.orchestra.run.smithi184.stdout:Running transaction 2024-02-28T22:52:40.707 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-02-28T22:52:40.852 INFO:teuthology.orchestra.run.smithi184.stdout: Preparing : 1/1 2024-02-28T22:52:40.939 INFO:teuthology.orchestra.run.smithi184.stdout: Installing : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:41.519 INFO:teuthology.orchestra.run.smithi184.stdout: Running scriptlet: rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:41.691 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-fuse-2:18.2.1-0.el9.x86_64 2/2 2024-02-28T22:52:41.691 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:18.2.1-0.el9.x86_64 1/2 2024-02-28T22:52:41.879 INFO:teuthology.orchestra.run.smithi184.stdout: Verifying : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:41.879 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:41.879 INFO:teuthology.orchestra.run.smithi184.stdout:Installed: 2024-02-28T22:52:41.879 INFO:teuthology.orchestra.run.smithi184.stdout: rbd-nbd-2:18.2.1-0.el9.x86_64 2024-02-28T22:52:41.879 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:52:41.879 INFO:teuthology.orchestra.run.smithi184.stdout:Complete! 2024-02-28T22:52:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-02-28T22:52:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:42.087 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:52:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:18.2.1-0.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-02-28T22:52:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:42.087 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:42.156 DEBUG:teuthology.parallel:result is None 2024-02-28T22:52:42.416 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install librados-devel 2024-02-28T22:52:43.289 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:08 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:43.598 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:43.598 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:43.599 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:43.599 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.599 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:43.599 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.599 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:43.599 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.599 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:43.599 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.599 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:43.599 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.599 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:43.600 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.600 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:43.600 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.600 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:43.600 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.600 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:43.600 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.600 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:43.600 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.600 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:43.600 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.601 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:43.601 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.601 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:43.601 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.601 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:43.601 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.601 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:43.601 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.601 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:43.601 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.601 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:43.602 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.602 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:43.602 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.602 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:43.602 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.602 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:43.602 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.602 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:43.602 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.602 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:43.602 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:43.603 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.604 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:43.604 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.604 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:43.604 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.604 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:43.604 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.604 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:43.604 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.604 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:43.604 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.604 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.605 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.606 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.607 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:43.607 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.607 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.607 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.607 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.607 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:43.607 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.607 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.607 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.607 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.607 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.608 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.609 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.609 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:43.672 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:43.673 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:43.673 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-02-28T22:52:43.673 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:43.673 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:52:43.673 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:18.2.1-0.el9 ceph 127 k 2024-02-28T22:52:43.673 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:43.673 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:52:43.673 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:43.674 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-02-28T22:52:43.674 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:43.674 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 127 k 2024-02-28T22:52:43.674 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 456 k 2024-02-28T22:52:43.674 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:52:43.744 INFO:teuthology.orchestra.run.smithi159.stdout:librados-devel-18.2.1-0.el9.x86_64.rpm 1.8 MB/s | 127 kB 00:00 2024-02-28T22:52:43.744 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:43.745 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.7 MB/s | 127 kB 00:00 2024-02-28T22:52:43.745 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:52:43.752 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:52:43.752 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:52:43.818 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:52:43.819 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:52:43.993 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:52:44.100 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:44.646 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:44.973 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:44.973 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:44.973 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:52:44.974 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:18.2.1-0.el9.x86_64 2024-02-28T22:52:44.974 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:44.974 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:45.337 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install libcephfs2 2024-02-28T22:52:46.235 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:11 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:46.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:46.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:46.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.549 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:46.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.553 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.553 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.553 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:46.553 INFO:teuthology.orchestra.run.smithi159.stdout:Package libcephfs2-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:46.618 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:46.620 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-02-28T22:52:46.620 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:46.690 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install libcephfs-devel 2024-02-28T22:52:47.519 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:12 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:47.826 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:47.827 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:47.827 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:47.827 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.827 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:47.828 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.828 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:47.828 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.828 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:47.828 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.829 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:47.829 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.829 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:47.829 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.829 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:47.829 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.829 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:47.829 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.830 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:47.830 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.830 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:47.830 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.830 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:47.830 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.830 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:47.830 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.831 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:47.831 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.831 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:47.831 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.831 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:47.831 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.831 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:47.831 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.831 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:47.832 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.832 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:47.832 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.832 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:47.832 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.832 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:47.833 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.833 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:47.833 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.833 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:47.833 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.833 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:47.833 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.833 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:47.834 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.835 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:47.835 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.835 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:47.835 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.835 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:47.835 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.835 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:47.835 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.835 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:47.835 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.836 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.837 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.838 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:47.839 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.839 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.839 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.839 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.839 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:47.839 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.839 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.839 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.839 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:47.900 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:47.901 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:47.901 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-02-28T22:52:47.901 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:47.901 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:52:47.901 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:18.2.1-0.el9 ceph 31 k 2024-02-28T22:52:47.901 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:47.902 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:52:47.902 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:47.902 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-02-28T22:52:47.902 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:47.902 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 31 k 2024-02-28T22:52:47.902 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 139 k 2024-02-28T22:52:47.902 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:52:47.981 INFO:teuthology.orchestra.run.smithi159.stdout:libcephfs-devel-18.2.1-0.el9.x86_64.rpm 393 kB/s | 31 kB 00:00 2024-02-28T22:52:47.982 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:47.982 INFO:teuthology.orchestra.run.smithi159.stdout:Total 385 kB/s | 31 kB 00:00 2024-02-28T22:52:47.982 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:52:47.986 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:52:47.986 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:52:48.042 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:52:48.043 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:52:48.175 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:52:48.318 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:48.796 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:49.157 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:49.158 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:49.158 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:52:49.158 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:18.2.1-0.el9.x86_64 2024-02-28T22:52:49.158 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:49.158 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:49.380 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install librados2 2024-02-28T22:52:50.220 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:15 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:50.526 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:50.526 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:50.526 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:50.526 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.526 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:50.526 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.526 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:50.527 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.527 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:50.527 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.527 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:50.527 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.527 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:50.527 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.527 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:50.527 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.527 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:50.527 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.528 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:50.528 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.528 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:50.528 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.528 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:50.528 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.528 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:50.528 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.528 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:50.528 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.529 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:50.529 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.529 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:50.529 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.529 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:50.529 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.529 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:50.529 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.529 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:50.529 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.529 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:50.530 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:50.531 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.532 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:50.532 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.532 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:50.532 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.532 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:50.532 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.532 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:50.532 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.532 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.532 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.532 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:50.533 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.533 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.533 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.533 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.533 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:50.533 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.533 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.533 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.533 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.533 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.533 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:50.534 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.535 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:50.536 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.536 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.536 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.536 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:50.536 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:50.600 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:50.602 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-02-28T22:52:50.602 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:50.684 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install librbd1 2024-02-28T22:52:51.527 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:16 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:51.847 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:51.847 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:51.847 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:51.847 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.847 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:51.847 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.848 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:51.848 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.848 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:51.848 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.848 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:51.848 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.848 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:51.848 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.848 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:51.848 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.848 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:51.849 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.849 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:51.849 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.849 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:51.849 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.849 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:51.849 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.849 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:51.849 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.849 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:51.850 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.850 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:51.850 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.850 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:51.850 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.850 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:51.850 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.850 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:51.850 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.851 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:51.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.851 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:51.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.851 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:51.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.851 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:51.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.851 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:51.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:51.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:51.853 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:51.853 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:51.853 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:51.853 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:51.853 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:51.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.854 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:51.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.854 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:51.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.854 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:51.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.855 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:51.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.856 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:51.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.856 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:51.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.857 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:51.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.857 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:51.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.858 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:51.858 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.858 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.858 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.858 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.858 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:51.858 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.858 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.858 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.858 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:51.859 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:51.921 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:51.922 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-02-28T22:52:51.922 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:51.993 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-rados 2024-02-28T22:52:52.893 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:17 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:53.218 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:53.218 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:53.218 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:53.218 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.218 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:53.218 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.218 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:53.219 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.220 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:53.221 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.222 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.223 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:53.224 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:53.225 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.226 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.227 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.227 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:53.227 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.227 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.227 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.227 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.227 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:53.227 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.227 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.227 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.227 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:53.228 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-rados-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:53.297 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:53.298 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-02-28T22:52:53.298 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:53.368 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-rgw 2024-02-28T22:52:54.230 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:19 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:54.543 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:54.543 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:54.543 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:54.543 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.543 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:54.543 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.543 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:54.543 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:54.544 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:54.545 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.546 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.547 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:54.548 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.549 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.550 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.551 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.552 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:54.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.552 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:54.553 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-rgw-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:54.618 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:54.619 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-02-28T22:52:54.619 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:54.692 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-cephfs 2024-02-28T22:52:55.523 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:20 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:55.848 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:55.849 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.850 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:55.851 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:55.852 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:55.853 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.854 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.855 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.856 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.857 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.858 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.858 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:55.858 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-cephfs-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:55.925 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:55.926 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-02-28T22:52:55.926 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:56.002 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install python3-rbd 2024-02-28T22:52:56.859 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:21 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:57.172 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.173 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:57.174 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.175 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.176 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:57.177 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.178 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.179 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.180 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.181 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.182 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.182 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:57.182 INFO:teuthology.orchestra.run.smithi159.stdout:Package python3-rbd-2:18.2.1-0.el9.x86_64 is already installed. 2024-02-28T22:52:57.247 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:57.248 INFO:teuthology.orchestra.run.smithi159.stdout:Nothing to do. 2024-02-28T22:52:57.248 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:52:57.317 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install rbd-fuse 2024-02-28T22:52:58.192 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:23 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:52:58.499 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:52:58.499 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:52:58.500 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:52:58.500 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.500 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:52:58.500 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.500 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:52:58.500 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.500 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:52:58.500 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.500 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:52:58.500 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.500 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:52:58.501 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:52:58.502 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:52:58.503 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:52:58.504 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.505 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:52:58.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.509 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.509 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:52:58.574 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:52:58.575 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:58.575 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-02-28T22:52:58.575 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:58.575 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:52:58.575 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:18.2.1-0.el9 ceph 86 k 2024-02-28T22:52:58.575 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:58.575 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:52:58.575 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:52:58.576 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-02-28T22:52:58.576 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:52:58.576 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 86 k 2024-02-28T22:52:58.576 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 226 k 2024-02-28T22:52:58.576 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:52:58.651 INFO:teuthology.orchestra.run.smithi159.stdout:rbd-fuse-18.2.1-0.el9.x86_64.rpm 1.1 MB/s | 86 kB 00:00 2024-02-28T22:52:58.651 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:52:58.651 INFO:teuthology.orchestra.run.smithi159.stdout:Total 1.1 MB/s | 86 kB 00:00 2024-02-28T22:52:58.652 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:52:58.660 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:52:58.660 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:52:58.726 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:52:58.727 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:52:58.908 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:52:59.013 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:52:59.630 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:53:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:53:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:53:00.001 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:53:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:18.2.1-0.el9.x86_64 2024-02-28T22:53:00.001 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:53:00.001 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:53:00.281 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install rbd-mirror 2024-02-28T22:53:01.181 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:26 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:53:01.490 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:53:01.490 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:53:01.490 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:53:01.490 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.490 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:53:01.490 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.490 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:53:01.490 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.490 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:53:01.490 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.491 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:53:01.492 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.493 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:53:01.494 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.495 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.496 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.497 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:53:01.498 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.499 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.499 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.499 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:53:01.564 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:53:01.565 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:53:01.565 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-02-28T22:53:01.565 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:53:01.565 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:53:01.565 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:18.2.1-0.el9 ceph 3.0 M 2024-02-28T22:53:01.565 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:53:01.566 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:53:01.566 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:53:01.566 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-02-28T22:53:01.566 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:53:01.566 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 3.0 M 2024-02-28T22:53:01.566 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 12 M 2024-02-28T22:53:01.566 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:53:01.689 INFO:teuthology.orchestra.run.smithi159.stdout:rbd-mirror-18.2.1-0.el9.x86_64.rpm 24 MB/s | 3.0 MB 00:00 2024-02-28T22:53:01.691 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:53:01.691 INFO:teuthology.orchestra.run.smithi159.stdout:Total 24 MB/s | 3.0 MB 00:00 2024-02-28T22:53:01.691 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:53:01.702 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:53:01.702 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:53:01.788 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:53:01.789 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:53:02.252 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:53:02.314 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:53:02.387 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:53:02.388 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-02-28T22:53:02.388 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-02-28T22:53:02.388 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T22:53:02.388 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-02-28T22:53:02.388 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:53:04.025 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:53:04.025 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:53:04.025 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:53:04.025 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:18.2.1-0.el9.x86_64 2024-02-28T22:53:04.025 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:53:04.025 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:53:04.340 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install rbd-nbd 2024-02-28T22:53:05.198 INFO:teuthology.orchestra.run.smithi159.stdout:Last metadata expiration check: 0:02:30 ago on Wed 28 Feb 2024 10:50:35 PM UTC. 2024-02-28T22:53:05.506 INFO:teuthology.orchestra.run.smithi159.stderr:Modular dependency problems: 2024-02-28T22:53:05.506 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T22:53:05.506 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 1: conflicting requests 2024-02-28T22:53:05.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240221162200:20125149.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.506 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 2: conflicting requests 2024-02-28T22:53:05.506 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.506 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 3: conflicting requests 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 4: conflicting requests 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 5: conflicting requests 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240213202549:b754926a.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 6: conflicting requests 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 7: conflicting requests 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module idm:client:820231122122737:49cc9d1b.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 8: conflicting requests 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.507 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 9: conflicting requests 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 10: conflicting requests 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 11: conflicting requests 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 12: conflicting requests 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 13: conflicting requests 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 14: conflicting requests 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.508 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 15: conflicting requests 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 16: conflicting requests 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 17: conflicting requests 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 18: conflicting requests 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 19: conflicting requests 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 20: conflicting requests 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 21: conflicting requests 2024-02-28T22:53:05.509 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 22: conflicting requests 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 23: conflicting requests 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 24: conflicting requests 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 25: conflicting requests 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 26: conflicting requests 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 27: conflicting requests 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.510 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 28: conflicting requests 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 29: conflicting requests 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 30: conflicting requests 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 31: conflicting requests 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240214183150:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 32: conflicting requests 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 33: conflicting requests 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 34: conflicting requests 2024-02-28T22:53:05.511 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 35: conflicting requests 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240226094445:9edba152.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 36: conflicting requests 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 37: cannot install the best candidate for the job 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 38: conflicting requests 2024-02-28T22:53:05.512 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 39: cannot install the best candidate for the job 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 40: cannot install the best candidate for the job 2024-02-28T22:53:05.513 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 41: cannot install the best candidate for the job 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 42: cannot install the best candidate for the job 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.514 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.515 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 43: cannot install the best candidate for the job 2024-02-28T22:53:05.515 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.515 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.515 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.515 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.515 INFO:teuthology.orchestra.run.smithi159.stderr: Problem 44: cannot install the best candidate for the job 2024-02-28T22:53:05.515 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.515 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.515 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.515 INFO:teuthology.orchestra.run.smithi159.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-02-28T22:53:05.579 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:18.2.1-0.el9 ceph 171 k 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout:Install 1 Package 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 171 k 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 494 k 2024-02-28T22:53:05.581 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-02-28T22:53:05.659 INFO:teuthology.orchestra.run.smithi159.stdout:rbd-nbd-18.2.1-0.el9.x86_64.rpm 2.2 MB/s | 171 kB 00:00 2024-02-28T22:53:05.659 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:53:05.660 INFO:teuthology.orchestra.run.smithi159.stdout:Total 2.1 MB/s | 171 kB 00:00 2024-02-28T22:53:05.660 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-02-28T22:53:05.669 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-02-28T22:53:05.669 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-02-28T22:53:05.736 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-02-28T22:53:05.736 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-02-28T22:53:05.906 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-02-28T22:53:06.065 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:53:06.581 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:53:06.935 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:18.2.1-0.el9.x86_64 1/1 2024-02-28T22:53:06.935 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:53:06.935 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-02-28T22:53:06.935 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:18.2.1-0.el9.x86_64 2024-02-28T22:53:06.935 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:53:06.935 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-02-28T22:53:07.230 DEBUG:teuthology.parallel:result is None 2024-02-28T22:53:07.230 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T22:53:07.231 INFO:teuthology.packaging:ref: None 2024-02-28T22:53:07.231 INFO:teuthology.packaging:tag: v18.2.1 2024-02-28T22:53:07.231 INFO:teuthology.packaging:branch: None 2024-02-28T22:53:07.231 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T22:53:07.231 INFO:teuthology.packaging:Tag 'v18.2.1' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-28T22:53:07.232 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-02-28T22:53:07.553 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-28T22:53:07.622 INFO:teuthology.orchestra.run.smithi159.stdout:18.2.1-0.el9 2024-02-28T22:53:07.622 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-0.el9 2024-02-28T22:53:07.622 INFO:teuthology.task.install:The correct ceph version 18.2.1-0 is installed. 2024-02-28T22:53:07.624 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using tag 2024-02-28T22:53:07.624 INFO:teuthology.packaging:ref: None 2024-02-28T22:53:07.624 INFO:teuthology.packaging:tag: v18.2.1 2024-02-28T22:53:07.624 INFO:teuthology.packaging:branch: None 2024-02-28T22:53:07.625 INFO:teuthology.packaging:sha1: 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T22:53:07.625 INFO:teuthology.packaging:Tag 'v18.2.1' not found in https://git.ceph.com/ceph-ci; will also look in https://git.ceph.com/ceph 2024-02-28T22:53:07.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=7fe91d5d5842e04be3b4f514d6dd990c54b29c76 2024-02-28T22:53:07.900 DEBUG:teuthology.orchestra.run.smithi184:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-02-28T22:53:07.971 INFO:teuthology.orchestra.run.smithi184.stdout:18.2.1-0.el9 2024-02-28T22:53:07.971 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-0.el9 2024-02-28T22:53:07.971 INFO:teuthology.task.install:The correct ceph version 18.2.1-0 is installed. 2024-02-28T22:53:07.973 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-02-28T22:53:07.973 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:53:07.973 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-28T22:53:08.081 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T22:53:08.082 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-02-28T22:53:08.182 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-02-28T22:53:08.182 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:53:08.182 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2024-02-28T22:53:08.281 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-28T22:53:08.371 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T22:53:08.371 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/daemon-helper 2024-02-28T22:53:08.462 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-02-28T22:53:08.592 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-02-28T22:53:08.592 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:53:08.592 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-28T22:53:08.691 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-28T22:53:08.820 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T22:53:08.821 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/adjust-ulimits 2024-02-28T22:53:08.896 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-02-28T22:53:09.017 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-02-28T22:53:09.017 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:53:09.017 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2024-02-28T22:53:09.114 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-28T22:53:09.207 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T22:53:09.207 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/usr/bin/stdin-killer 2024-02-28T22:53:09.303 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-02-28T22:53:09.389 INFO:teuthology.run_tasks:Running task print... 2024-02-28T22:53:09.399 INFO:teuthology.task.print:**** done install task... 2024-02-28T22:53:09.399 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-28T22:53:09.519 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'reef', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.io/ceph/ceph:v18.2.1', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324'} 2024-02-28T22:53:09.519 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v18.2.1 2024-02-28T22:53:09.520 INFO:tasks.cephadm:Cluster fsid is 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:53:09.520 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-28T22:53:09.520 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-02-28T22:53:09.520 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi159': '172.21.15.159', 'mon.smithi184': '172.21.15.184'} 2024-02-28T22:53:09.520 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-28T22:53:09.520 DEBUG:teuthology.orchestra.run.smithi159:> sudo hostname $(hostname -s) 2024-02-28T22:53:09.623 DEBUG:teuthology.orchestra.run.smithi184:> sudo hostname $(hostname -s) 2024-02-28T22:53:09.705 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for reef 2024-02-28T22:53:09.706 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T22:53:10.079 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1fb5d10608dccee73edd6ef8a2c7b804a097c324', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77042/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-1670-g1fb5d106', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-1670.g1fb5d106'}, 'url': 'https://2.chacra.ceph.com/r/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-02-23 17:21:14.966217', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'main', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/main/1fb5d10608dccee73edd6ef8a2c7b804a097c324/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-02-28T22:53:10.287 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref reef, sha1 5f501fe72171f96fdc52b866d0d69821e8192eb9 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=reef 2024-02-28T22:53:10.288 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/reef/5f501fe72171f96fdc52b866d0d69821e8192eb9/centos/9/x86_64/flavors/default/cephadm 2024-02-28T22:53:10.289 DEBUG:teuthology.orchestra.run.smithi159:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/5f501fe72171f96fdc52b866d0d69821e8192eb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-28T22:53:11.601 INFO:teuthology.orchestra.run.smithi159.stdout:-rw-r--r--. 1 ubuntu ubuntu 214738 Feb 28 22:53 /home/ubuntu/cephtest/cephadm 2024-02-28T22:53:11.601 DEBUG:teuthology.orchestra.run.smithi184:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/reef/5f501fe72171f96fdc52b866d0d69821e8192eb9/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-28T22:53:12.202 INFO:teuthology.orchestra.run.smithi184.stdout:-rw-r--r--. 1 ubuntu ubuntu 214738 Feb 28 22:53 /home/ubuntu/cephtest/cephadm 2024-02-28T22:53:12.203 DEBUG:teuthology.orchestra.run.smithi159:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-28T22:53:12.261 DEBUG:teuthology.orchestra.run.smithi184:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-28T22:53:12.333 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v18.2.1 on all hosts... 2024-02-28T22:53:12.333 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 pull 2024-02-28T22:53:12.339 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 pull 2024-02-28T22:53:13.445 INFO:teuthology.orchestra.run.smithi184.stderr:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-02-28T22:53:13.534 INFO:teuthology.orchestra.run.smithi159.stderr:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-02-28T22:53:53.257 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-02-28T22:53:53.257 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-02-28T22:53:53.258 INFO:teuthology.orchestra.run.smithi184.stdout: "image_id": "5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf", 2024-02-28T22:53:53.258 INFO:teuthology.orchestra.run.smithi184.stdout: "repo_digests": [ 2024-02-28T22:53:53.258 INFO:teuthology.orchestra.run.smithi184.stdout: "quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8", 2024-02-28T22:53:53.258 INFO:teuthology.orchestra.run.smithi184.stdout: "quay.io/ceph/ceph@sha256:e8e55db8b4fd270dbec25bc764437a2a3abb707971c4dba5f559fb83018049dc" 2024-02-28T22:53:53.258 INFO:teuthology.orchestra.run.smithi184.stdout: ] 2024-02-28T22:53:53.258 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-02-28T22:53:54.772 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T22:53:54.772 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-02-28T22:53:54.773 INFO:teuthology.orchestra.run.smithi159.stdout: "image_id": "5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf", 2024-02-28T22:53:54.773 INFO:teuthology.orchestra.run.smithi159.stdout: "repo_digests": [ 2024-02-28T22:53:54.773 INFO:teuthology.orchestra.run.smithi159.stdout: "quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8", 2024-02-28T22:53:54.773 INFO:teuthology.orchestra.run.smithi159.stdout: "quay.io/ceph/ceph@sha256:e8e55db8b4fd270dbec25bc764437a2a3abb707971c4dba5f559fb83018049dc" 2024-02-28T22:53:54.773 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-02-28T22:53:54.773 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T22:53:54.805 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph 2024-02-28T22:53:54.898 DEBUG:teuthology.orchestra.run.smithi184:> sudo mkdir -p /etc/ceph 2024-02-28T22:53:54.989 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /etc/ceph 2024-02-28T22:53:55.088 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 777 /etc/ceph 2024-02-28T22:53:55.183 INFO:tasks.cephadm:Writing seed config... 2024-02-28T22:53:55.184 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-02-28T22:53:55.185 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [client] debug client = 20 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-02-28T22:53:55.186 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-02-28T22:53:55.187 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-02-28T22:53:55.187 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-02-28T22:53:55.187 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-02-28T22:53:55.187 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-02-28T22:53:55.187 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-02-28T22:53:55.187 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-28T22:53:55.187 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-28T22:53:55.187 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-28T22:53:55.187 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-28T22:53:55.187 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-28T22:53:55.187 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-02-28T22:53:55.188 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:53:55.188 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-28T22:53:55.246 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 24bd0fca-d68c-11ee-95c3-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-02-28T22:53:55.247 DEBUG:teuthology.orchestra.run.smithi159:mon.smithi159> sudo journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi159.service 2024-02-28T22:53:55.294 INFO:tasks.cephadm:Bootstrapping... 2024-02-28T22:53:55.294 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 -v bootstrap --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.159 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-28T22:53:55.533 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-02-28T22:53:55.533 INFO:teuthology.orchestra.run.smithi159.stdout:cephadm ['--image', 'quay.io/ceph/ceph:v18.2.1', '-v', 'bootstrap', '--fsid', '24bd0fca-d68c-11ee-95c3-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.159', '--skip-admin-label'] 2024-02-28T22:53:55.585 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T22:53:55.585 INFO:teuthology.orchestra.run.smithi159.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-02-28T22:53:55.586 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying podman|docker is present... 2024-02-28T22:53:55.639 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T22:53:55.639 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying lvm2 is present... 2024-02-28T22:53:55.639 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying time synchronization is in place... 2024-02-28T22:53:55.654 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-28T22:53:55.654 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-28T22:53:55.669 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-28T22:53:55.669 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-02-28T22:53:55.690 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout enabled 2024-02-28T22:53:55.711 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout active 2024-02-28T22:53:55.711 INFO:teuthology.orchestra.run.smithi159.stdout:Unit chronyd.service is enabled and running 2024-02-28T22:53:55.711 INFO:teuthology.orchestra.run.smithi159.stdout:Repeating the final host check... 2024-02-28T22:53:55.767 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stdout 4.9.3-dev 2024-02-28T22:53:55.767 INFO:teuthology.orchestra.run.smithi159.stdout:podman (/bin/podman) version 4.9.3 is present 2024-02-28T22:53:55.767 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl is present 2024-02-28T22:53:55.767 INFO:teuthology.orchestra.run.smithi159.stdout:lvcreate is present 2024-02-28T22:53:55.783 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-02-28T22:53:55.783 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-28T22:53:55.800 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-02-28T22:53:55.800 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-02-28T22:53:55.822 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout enabled 2024-02-28T22:53:55.841 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout active 2024-02-28T22:53:55.841 INFO:teuthology.orchestra.run.smithi159.stdout:Unit chronyd.service is enabled and running 2024-02-28T22:53:55.841 INFO:teuthology.orchestra.run.smithi159.stdout:Host looks OK 2024-02-28T22:53:55.842 INFO:teuthology.orchestra.run.smithi159.stdout:Cluster fsid: 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:53:55.843 INFO:teuthology.orchestra.run.smithi159.stdout:Acquiring lock 139988535407376 on /run/cephadm/24bd0fca-d68c-11ee-95c3-87774f69a715.lock 2024-02-28T22:53:55.843 INFO:teuthology.orchestra.run.smithi159.stdout:Lock 139988535407376 acquired on /run/cephadm/24bd0fca-d68c-11ee-95c3-87774f69a715.lock 2024-02-28T22:53:55.844 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying IP 172.21.15.159 port 3300 ... 2024-02-28T22:53:55.845 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying IP 172.21.15.159 port 6789 ... 2024-02-28T22:53:55.846 INFO:teuthology.orchestra.run.smithi159.stdout:Base mon IP(s) is [172.21.15.159:3300, 172.21.15.159:6789], mon addrv is [v2:172.21.15.159:3300,v1:172.21.15.159:6789] 2024-02-28T22:53:55.860 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.159 metric 100 2024-02-28T22:53:55.860 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.159 metric 100 2024-02-28T22:53:55.872 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-02-28T22:53:55.872 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-02-28T22:53:55.872 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1763sec hoplimit 64 pref medium 2024-02-28T22:53:55.882 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-02-28T22:53:55.883 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-02-28T22:53:55.883 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-28T22:53:55.883 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-02-28T22:53:55.883 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2024-02-28T22:53:55.883 INFO:teuthology.orchestra.run.smithi159.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-02-28T22:53:55.885 INFO:teuthology.orchestra.run.smithi159.stdout:Mon IP `172.21.15.159` is in CIDR network `172.21.0.0/20` 2024-02-28T22:53:55.885 INFO:teuthology.orchestra.run.smithi159.stdout:Mon IP `172.21.15.159` is in CIDR network `172.21.0.0/20` 2024-02-28T22:53:55.885 INFO:teuthology.orchestra.run.smithi159.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-02-28T22:53:55.887 INFO:teuthology.orchestra.run.smithi159.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-02-28T22:53:55.890 INFO:teuthology.orchestra.run.smithi159.stdout:Pulling container image quay.io/ceph/ceph:v18.2.1... 2024-02-28T22:53:56.923 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stdout 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf 2024-02-28T22:53:56.923 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Trying to pull quay.io/ceph/ceph:v18.2.1... 2024-02-28T22:53:56.923 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Getting image source signatures 2024-02-28T22:53:56.924 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Copying blob sha256:a733d3c618b71f19c168ebecd1953429dce2c1631835ca182e9551c36dce5989 2024-02-28T22:53:56.924 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Copying blob sha256:7feca07754707458c3945cf0062cf4dabc512f6d90fe1a9a1370b362b6011124 2024-02-28T22:53:56.924 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Copying config sha256:5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf 2024-02-28T22:53:56.924 INFO:teuthology.orchestra.run.smithi159.stdout:/bin/podman: stderr Writing manifest to image destination 2024-02-28T22:53:58.140 INFO:teuthology.orchestra.run.smithi159.stdout:ceph: stdout ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable) 2024-02-28T22:53:58.140 INFO:teuthology.orchestra.run.smithi159.stdout:Ceph version: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable) 2024-02-28T22:53:58.140 INFO:teuthology.orchestra.run.smithi159.stdout:Extracting ceph user uid/gid from container image... 2024-02-28T22:53:59.429 INFO:teuthology.orchestra.run.smithi159.stdout:stat: stdout 167 167 2024-02-28T22:53:59.429 INFO:teuthology.orchestra.run.smithi159.stdout:Creating initial keys... 2024-02-28T22:54:00.630 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph-authtool: stdout AQCHud9lNFMVOBAAa5vE7XHEhZHgBHRQciFlOw== 2024-02-28T22:54:01.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph-authtool: stdout AQCJud9loY8YBxAAgkjOfW0zg/TScg1oAvCNKw== 2024-02-28T22:54:02.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph-authtool: stdout AQCKud9lN24MEBAAvLhbQ8vqnzP0ynGzO4FAkA== 2024-02-28T22:54:02.891 INFO:teuthology.orchestra.run.smithi159.stdout:Creating initial monmap... 2024-02-28T22:54:03.952 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-28T22:54:03.952 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2024-02-28T22:54:03.952 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:54:03.952 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-28T22:54:03.952 INFO:teuthology.orchestra.run.smithi159.stdout:monmaptool for smithi159 [v2:172.21.15.159:3300,v1:172.21.15.159:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-28T22:54:03.952 INFO:teuthology.orchestra.run.smithi159.stdout:setting min_mon_release = pacific 2024-02-28T22:54:03.952 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: set fsid to 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:54:03.952 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-28T22:54:03.952 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:54:03.953 INFO:teuthology.orchestra.run.smithi159.stdout:Creating mon... 2024-02-28T22:54:05.068 INFO:teuthology.orchestra.run.smithi159.stdout:create mon.smithi159 on 2024-02-28T22:54:05.413 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-02-28T22:54:05.651 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-28T22:54:05.940 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-24bd0fca-d68c-11ee-95c3-87774f69a715.target → /etc/systemd/system/ceph-24bd0fca-d68c-11ee-95c3-87774f69a715.target. 2024-02-28T22:54:05.940 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-24bd0fca-d68c-11ee-95c3-87774f69a715.target → /etc/systemd/system/ceph-24bd0fca-d68c-11ee-95c3-87774f69a715.target. 2024-02-28T22:54:06.264 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi159 2024-02-28T22:54:06.264 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Failed to reset failed state of unit ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi159.service: Unit ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi159.service not loaded. 2024-02-28T22:54:06.554 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-24bd0fca-d68c-11ee-95c3-87774f69a715.target.wants/ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi159.service → /etc/systemd/system/ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@.service. 2024-02-28T22:54:07.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:07 smithi159 podman[28417]: 2024-02-28 22:54:07.181311581 +0000 UTC m=+0.370916254 container start 07f221a2bf39a368ad818aedf05237310ec27635c5d40470c2efa6f1e7aa0aa1 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, RELEASE=HEAD) 2024-02-28T22:54:07.281 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T22:54:07.281 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout disabled 2024-02-28T22:54:07.296 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T22:54:07.296 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-02-28T22:54:07.296 INFO:teuthology.orchestra.run.smithi159.stdout:firewalld.service is not enabled 2024-02-28T22:54:07.296 INFO:teuthology.orchestra.run.smithi159.stdout:Not possible to enable service . firewalld.service is not available 2024-02-28T22:54:07.297 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mon to start... 2024-02-28T22:54:07.297 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mon... 2024-02-28T22:54:07.584 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:07 smithi159 bash[28417]: 07f221a2bf39a368ad818aedf05237310ec27635c5d40470c2efa6f1e7aa0aa1 2024-02-28T22:54:07.584 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:07 smithi159 systemd[1]: Started Ceph mon.smithi159 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T22:54:07.584 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:07 smithi159 ceph-mon[28436]: mkfs 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:54:07.584 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:07 smithi159 ceph-mon[28436]: mon.smithi159 is new leader, mons smithi159 in quorum (ranks 0) 2024-02-28T22:54:08.593 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:08 smithi159 ceph-mon[28436]: mon.smithi159 is new leader, mons smithi159 in quorum (ranks 0) 2024-02-28T22:54:08.593 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:08 smithi159 ceph-mon[28436]: monmap e1: 1 mons at {smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T22:54:08.593 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:08 smithi159 ceph-mon[28436]: fsmap 2024-02-28T22:54:08.593 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:08 smithi159 ceph-mon[28436]: osdmap e1: 0 total, 0 up, 0 in 2024-02-28T22:54:08.593 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:08 smithi159 ceph-mon[28436]: mgrmap e1: no daemons active 2024-02-28T22:54:08.593 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:08 smithi159 ceph-mon[28436]: from='client.? 172.21.15.159:0/1131696246' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-28T22:54:08.615 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout cluster: 2024-02-28T22:54:08.615 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout id: 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:54:08.615 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-02-28T22:54:08.615 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:08.615 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout services: 2024-02-28T22:54:08.615 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi159 (age 0.708734s) 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout data: 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout pgs: 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.875+0000 7f9502e00700 1 Processor -- start 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.875+0000 7f9502e00700 1 -- start start 2024-02-28T22:54:08.616 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.876+0000 7f9502e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc10e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.876+0000 7f9502e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc10ea20 con 0x7f94fc10e030 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.877+0000 7f94fbe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc10e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.877+0000 7f94fbe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc10e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37302/0 (socket says 172.21.15.159:37302) 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.877+0000 7f94fbe00700 1 -- 172.21.15.159:0/1889592501 learned_addr learned my addr 172.21.15.159:0/1889592501 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.877+0000 7f94fbe00700 1 -- 172.21.15.159:0/1889592501 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94fc10eb60 con 0x7f94fc10e030 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.877+0000 7f94fbe00700 1 --2- 172.21.15.159:0/1889592501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc10e450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0098a0 tx=0x7f94ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7638f667d2903393 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.878+0000 7f94faa00700 1 -- 172.21.15.159:0/1889592501 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94ec004180 con 0x7f94fc10e030 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.878+0000 7f94faa00700 1 -- 172.21.15.159:0/1889592501 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec0042e0 con 0x7f94fc10e030 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.878+0000 7f94faa00700 1 -- 172.21.15.159:0/1889592501 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94ec0036a0 con 0x7f94fc10e030 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.878+0000 7f9502e00700 1 -- 172.21.15.159:0/1889592501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 msgr2=0x7f94fc10e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.878+0000 7f9502e00700 1 --2- 172.21.15.159:0/1889592501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc10e450 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0098a0 tx=0x7f94ec009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:08.617 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.879+0000 7f9502e00700 1 -- 172.21.15.159:0/1889592501 shutdown_connections 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.879+0000 7f9502e00700 1 --2- 172.21.15.159:0/1889592501 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc10e450 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.879+0000 7f9502e00700 1 -- 172.21.15.159:0/1889592501 >> 172.21.15.159:0/1889592501 conn(0x7f94fc07bb20 msgr2=0x7f94fc07df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.879+0000 7f9502e00700 1 -- 172.21.15.159:0/1889592501 shutdown_connections 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.879+0000 7f9502e00700 1 -- 172.21.15.159:0/1889592501 wait complete. 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.880+0000 7f9502e00700 1 Processor -- start 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.880+0000 7f9502e00700 1 -- start start 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.880+0000 7f9502e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc19fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.880+0000 7f9502e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94fc1a03e0 con 0x7f94fc10e030 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.881+0000 7f94fbe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc19fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.881+0000 7f94fbe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc19fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37312/0 (socket says 172.21.15.159:37312) 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.881+0000 7f94fbe00700 1 -- 172.21.15.159:0/1131696246 learned_addr learned my addr 172.21.15.159:0/1131696246 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:08.618 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.881+0000 7f94fbe00700 1 -- 172.21.15.159:0/1131696246 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec009550 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.882+0000 7f94fbe00700 1 --2- 172.21.15.159:0/1131696246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc19fea0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f94ec004000 tx=0x7f94ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.882+0000 7f94f8c00700 1 -- 172.21.15.159:0/1131696246 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94ec003ce0 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.882+0000 7f94f8c00700 1 -- 172.21.15.159:0/1131696246 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec020070 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.882+0000 7f94f8c00700 1 -- 172.21.15.159:0/1131696246 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f94ec011630 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.882+0000 7f9502e00700 1 -- 172.21.15.159:0/1131696246 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94fc1a05e0 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.882+0000 7f9502e00700 1 -- 172.21.15.159:0/1131696246 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94fc1a0a80 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.882+0000 7f94f8c00700 1 -- 172.21.15.159:0/1131696246 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f94ec022030 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.882+0000 7f94f8c00700 1 -- 172.21.15.159:0/1131696246 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f94ec025d40 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.883+0000 7f9502e00700 1 -- 172.21.15.159:0/1131696246 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94fc199770 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.886+0000 7f94f8c00700 1 -- 172.21.15.159:0/1131696246 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f94fc10eb60 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.965+0000 7f9502e00700 1 -- 172.21.15.159:0/1131696246 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f94fc02cc70 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.966+0000 7f94f8c00700 1 -- 172.21.15.159:0/1131696246 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f94ec025480 con 0x7f94fc10e030 2024-02-28T22:54:08.619 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.967+0000 7f9502e00700 1 -- 172.21.15.159:0/1131696246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 msgr2=0x7f94fc19fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:08.620 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.967+0000 7f9502e00700 1 --2- 172.21.15.159:0/1131696246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc19fea0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f94ec004000 tx=0x7f94ec004750 comp rx=0 tx=0).stop 2024-02-28T22:54:08.620 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.967+0000 7f9502e00700 1 -- 172.21.15.159:0/1131696246 shutdown_connections 2024-02-28T22:54:08.620 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.967+0000 7f9502e00700 1 --2- 172.21.15.159:0/1131696246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f94fc10e030 0x7f94fc19fea0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:08.620 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.967+0000 7f9502e00700 1 -- 172.21.15.159:0/1131696246 >> 172.21.15.159:0/1131696246 conn(0x7f94fc07bb20 msgr2=0x7f94fc1944b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:08.620 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.967+0000 7f9502e00700 1 -- 172.21.15.159:0/1131696246 shutdown_connections 2024-02-28T22:54:08.620 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:07.968+0000 7f9502e00700 1 -- 172.21.15.159:0/1131696246 wait complete. 2024-02-28T22:54:08.620 INFO:teuthology.orchestra.run.smithi159.stdout:mon is available 2024-02-28T22:54:08.620 INFO:teuthology.orchestra.run.smithi159.stdout:Assimilating anything we can from ceph.conf... 2024-02-28T22:54:09.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:09 smithi159 ceph-mon[28436]: from='client.? 172.21.15.159:0/3270308333' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-28T22:54:09.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:09 smithi159 ceph-mon[28436]: from='client.? 172.21.15.159:0/3270308333' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-28T22:54:09.881 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:09.881 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [global] 2024-02-28T22:54:09.881 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout fsid = 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:54:09.881 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.159:3300,v1:172.21.15.159:6789] 2024-02-28T22:54:09.881 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-28T22:54:09.881 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-28T22:54:09.881 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-28T22:54:09.881 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [osd] 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.200+0000 7fb73de00700 1 Processor -- start 2024-02-28T22:54:09.882 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.200+0000 7fb73de00700 1 -- start start 2024-02-28T22:54:09.883 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.200+0000 7fb73de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb738105760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:09.883 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.200+0000 7fb73de00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb738105d30 con 0x7fb738105340 2024-02-28T22:54:09.883 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.201+0000 7fb736a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb738105760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:09.883 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.201+0000 7fb736a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb738105760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37318/0 (socket says 172.21.15.159:37318) 2024-02-28T22:54:09.883 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.201+0000 7fb736a00700 1 -- 172.21.15.159:0/1564989268 learned_addr learned my addr 172.21.15.159:0/1564989268 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:09.883 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.201+0000 7fb736a00700 1 -- 172.21.15.159:0/1564989268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb738106540 con 0x7fb738105340 2024-02-28T22:54:09.883 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.202+0000 7fb736a00700 1 --2- 172.21.15.159:0/1564989268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb738105760 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb7280098a0 tx=0x7fb728009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d91e90b366e9fcf server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:09.883 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.202+0000 7fb736000700 1 -- 172.21.15.159:0/1564989268 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb728004180 con 0x7fb738105340 2024-02-28T22:54:09.883 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.202+0000 7fb736000700 1 -- 172.21.15.159:0/1564989268 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7280042e0 con 0x7fb738105340 2024-02-28T22:54:09.883 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.202+0000 7fb736000700 1 -- 172.21.15.159:0/1564989268 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7280036a0 con 0x7fb738105340 2024-02-28T22:54:09.883 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.203+0000 7fb73de00700 1 -- 172.21.15.159:0/1564989268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 msgr2=0x7fb738105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.203+0000 7fb73de00700 1 --2- 172.21.15.159:0/1564989268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb738105760 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fb7280098a0 tx=0x7fb728009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.203+0000 7fb73de00700 1 -- 172.21.15.159:0/1564989268 shutdown_connections 2024-02-28T22:54:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.203+0000 7fb73de00700 1 --2- 172.21.15.159:0/1564989268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb738105760 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.203+0000 7fb73de00700 1 -- 172.21.15.159:0/1564989268 >> 172.21.15.159:0/1564989268 conn(0x7fb7381008c0 msgr2=0x7fb738102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.203+0000 7fb73de00700 1 -- 172.21.15.159:0/1564989268 shutdown_connections 2024-02-28T22:54:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.203+0000 7fb73de00700 1 -- 172.21.15.159:0/1564989268 wait complete. 2024-02-28T22:54:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.204+0000 7fb73de00700 1 Processor -- start 2024-02-28T22:54:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.204+0000 7fb73de00700 1 -- start start 2024-02-28T22:54:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.204+0000 7fb73de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb73819ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.204+0000 7fb73de00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73819bfd0 con 0x7fb738105340 2024-02-28T22:54:09.884 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.205+0000 7fb736a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb73819ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:09.885 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.205+0000 7fb736a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb73819ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37322/0 (socket says 172.21.15.159:37322) 2024-02-28T22:54:09.885 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.205+0000 7fb736a00700 1 -- 172.21.15.159:0/3270308333 learned_addr learned my addr 172.21.15.159:0/3270308333 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:09.885 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.205+0000 7fb736a00700 1 -- 172.21.15.159:0/3270308333 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb728009550 con 0x7fb738105340 2024-02-28T22:54:09.885 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.205+0000 7fb736a00700 1 --2- 172.21.15.159:0/3270308333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb73819ba90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb728004000 tx=0x7fb728004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:09.885 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.206+0000 7fb73ca00700 1 -- 172.21.15.159:0/3270308333 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb728003ce0 con 0x7fb738105340 2024-02-28T22:54:09.885 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.206+0000 7fb73ca00700 1 -- 172.21.15.159:0/3270308333 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb728020070 con 0x7fb738105340 2024-02-28T22:54:09.885 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.206+0000 7fb73ca00700 1 -- 172.21.15.159:0/3270308333 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb728011630 con 0x7fb738105340 2024-02-28T22:54:09.885 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.206+0000 7fb73de00700 1 -- 172.21.15.159:0/3270308333 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73819c1d0 con 0x7fb738105340 2024-02-28T22:54:09.885 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.206+0000 7fb73de00700 1 -- 172.21.15.159:0/3270308333 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73819c670 con 0x7fb738105340 2024-02-28T22:54:09.885 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.207+0000 7fb73ca00700 1 -- 172.21.15.159:0/3270308333 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb728022030 con 0x7fb738105340 2024-02-28T22:54:09.885 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.207+0000 7fb73ca00700 1 -- 172.21.15.159:0/3270308333 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb728025d40 con 0x7fb738105340 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.207+0000 7fb73de00700 1 -- 172.21.15.159:0/3270308333 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7380623c0 con 0x7fb738105340 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.210+0000 7fb73ca00700 1 -- 172.21.15.159:0/3270308333 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fb728025480 con 0x7fb738105340 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.284+0000 7fb73de00700 1 -- 172.21.15.159:0/3270308333 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fb73819f3f0 con 0x7fb738105340 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.294+0000 7fb73ca00700 1 -- 172.21.15.159:0/3270308333 <== mon.0 v2:172.21.15.159:3300/0 7 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb728011c20 con 0x7fb738105340 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.294+0000 7fb73ca00700 1 -- 172.21.15.159:0/3270308333 <== mon.0 v2:172.21.15.159:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7fb7280375d0 con 0x7fb738105340 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.296+0000 7fb73de00700 1 -- 172.21.15.159:0/3270308333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 msgr2=0x7fb73819ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.296+0000 7fb73de00700 1 --2- 172.21.15.159:0/3270308333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb73819ba90 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fb728004000 tx=0x7fb728004750 comp rx=0 tx=0).stop 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.296+0000 7fb73de00700 1 -- 172.21.15.159:0/3270308333 shutdown_connections 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.296+0000 7fb73de00700 1 --2- 172.21.15.159:0/3270308333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb738105340 0x7fb73819ba90 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.296+0000 7fb73de00700 1 -- 172.21.15.159:0/3270308333 >> 172.21.15.159:0/3270308333 conn(0x7fb7381008c0 msgr2=0x7fb738074030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.296+0000 7fb73de00700 1 -- 172.21.15.159:0/3270308333 shutdown_connections 2024-02-28T22:54:09.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:09.296+0000 7fb73de00700 1 -- 172.21.15.159:0/3270308333 wait complete. 2024-02-28T22:54:09.887 INFO:teuthology.orchestra.run.smithi159.stdout:Generating new minimal ceph.conf... 2024-02-28T22:54:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:10 smithi159 ceph-mon[28436]: from='client.? 172.21.15.159:0/69275647' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:54:17.323 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.455+0000 7f071ae00700 1 Processor -- start 2024-02-28T22:54:17.323 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.455+0000 7f071ae00700 1 -- start start 2024-02-28T22:54:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.456+0000 7f071ae00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f071410e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.456+0000 7f071ae00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f071410ea20 con 0x7f071410e030 2024-02-28T22:54:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.456+0000 7f0713e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f071410e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.456+0000 7f0713e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f071410e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37338/0 (socket says 172.21.15.159:37338) 2024-02-28T22:54:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.456+0000 7f0713e00700 1 -- 172.21.15.159:0/4276664304 learned_addr learned my addr 172.21.15.159:0/4276664304 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.457+0000 7f0713e00700 1 -- 172.21.15.159:0/4276664304 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071410eb60 con 0x7f071410e030 2024-02-28T22:54:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.457+0000 7f0713e00700 1 --2- 172.21.15.159:0/4276664304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f071410e450 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f07040098a0 tx=0x7f0704009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d77a52e1e390fc server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.457+0000 7f0712a00700 1 -- 172.21.15.159:0/4276664304 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0704004180 con 0x7f071410e030 2024-02-28T22:54:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.457+0000 7f0712a00700 1 -- 172.21.15.159:0/4276664304 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f07040042e0 con 0x7f071410e030 2024-02-28T22:54:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.457+0000 7f0712a00700 1 -- 172.21.15.159:0/4276664304 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0704011a50 con 0x7f071410e030 2024-02-28T22:54:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.458+0000 7f071ae00700 1 -- 172.21.15.159:0/4276664304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 msgr2=0x7f071410e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.458+0000 7f071ae00700 1 --2- 172.21.15.159:0/4276664304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f071410e450 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f07040098a0 tx=0x7f0704009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.458+0000 7f071ae00700 1 -- 172.21.15.159:0/4276664304 shutdown_connections 2024-02-28T22:54:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.458+0000 7f071ae00700 1 --2- 172.21.15.159:0/4276664304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f071410e450 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:17.326 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.458+0000 7f071ae00700 1 -- 172.21.15.159:0/4276664304 >> 172.21.15.159:0/4276664304 conn(0x7f071407bb20 msgr2=0x7f071407df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:17.326 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.458+0000 7f071ae00700 1 -- 172.21.15.159:0/4276664304 shutdown_connections 2024-02-28T22:54:17.326 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.458+0000 7f071ae00700 1 -- 172.21.15.159:0/4276664304 wait complete. 2024-02-28T22:54:17.326 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.459+0000 7f071ae00700 1 Processor -- start 2024-02-28T22:54:17.326 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.459+0000 7f071ae00700 1 -- start start 2024-02-28T22:54:17.326 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.460+0000 7f071ae00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f07141a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:17.326 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.460+0000 7f071ae00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07141a0c80 con 0x7f071410e030 2024-02-28T22:54:17.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.460+0000 7f0713e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f07141a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:17.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.460+0000 7f0713e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f07141a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37344/0 (socket says 172.21.15.159:37344) 2024-02-28T22:54:17.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.460+0000 7f0713e00700 1 -- 172.21.15.159:0/69275647 learned_addr learned my addr 172.21.15.159:0/69275647 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:17.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.460+0000 7f0713e00700 1 -- 172.21.15.159:0/69275647 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0704009550 con 0x7f071410e030 2024-02-28T22:54:17.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.461+0000 7f0713e00700 1 --2- 172.21.15.159:0/69275647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f07141a0740 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0704003de0 tx=0x7f0704011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:17.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.461+0000 7f0710c00700 1 -- 172.21.15.159:0/69275647 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0704003930 con 0x7f071410e030 2024-02-28T22:54:17.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.461+0000 7f0710c00700 1 -- 172.21.15.159:0/69275647 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f0704003a90 con 0x7f071410e030 2024-02-28T22:54:17.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.461+0000 7f0710c00700 1 -- 172.21.15.159:0/69275647 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f07040196c0 con 0x7f071410e030 2024-02-28T22:54:17.328 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.461+0000 7f071ae00700 1 -- 172.21.15.159:0/69275647 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07141a0e80 con 0x7f071410e030 2024-02-28T22:54:17.328 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.461+0000 7f071ae00700 1 -- 172.21.15.159:0/69275647 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07141a1320 con 0x7f071410e030 2024-02-28T22:54:17.328 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.461+0000 7f0710c00700 1 -- 172.21.15.159:0/69275647 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0704019c80 con 0x7f071410e030 2024-02-28T22:54:17.328 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.461+0000 7f0710c00700 1 -- 172.21.15.159:0/69275647 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f070402c3a0 con 0x7f071410e030 2024-02-28T22:54:17.328 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.463+0000 7f071ae00700 1 -- 172.21.15.159:0/69275647 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07140623c0 con 0x7f071410e030 2024-02-28T22:54:17.328 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.465+0000 7f0710c00700 1 -- 172.21.15.159:0/69275647 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f071410eb60 con 0x7f071410e030 2024-02-28T22:54:17.328 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.540+0000 7f071ae00700 1 -- 172.21.15.159:0/69275647 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f071410d930 con 0x7f071410e030 2024-02-28T22:54:17.329 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.541+0000 7f0710c00700 1 -- 172.21.15.159:0/69275647 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f070401abc0 con 0x7f071410e030 2024-02-28T22:54:17.329 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.543+0000 7f071ae00700 1 -- 172.21.15.159:0/69275647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 msgr2=0x7f07141a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:17.329 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.543+0000 7f071ae00700 1 --2- 172.21.15.159:0/69275647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f07141a0740 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0704003de0 tx=0x7f0704011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:17.329 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.543+0000 7f071ae00700 1 -- 172.21.15.159:0/69275647 shutdown_connections 2024-02-28T22:54:17.329 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.543+0000 7f071ae00700 1 --2- 172.21.15.159:0/69275647 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f071410e030 0x7f07141a0740 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:17.329 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.543+0000 7f071ae00700 1 -- 172.21.15.159:0/69275647 >> 172.21.15.159:0/69275647 conn(0x7f071407bb20 msgr2=0x7f071407e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:17.330 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.543+0000 7f071ae00700 1 -- 172.21.15.159:0/69275647 shutdown_connections 2024-02-28T22:54:17.330 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:10.543+0000 7f071ae00700 1 -- 172.21.15.159:0/69275647 wait complete. 2024-02-28T22:54:17.330 INFO:teuthology.orchestra.run.smithi159.stdout:Restarting the monitor... 2024-02-28T22:54:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:17 smithi159 systemd[1]: Stopping Ceph mon.smithi159 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T22:54:20.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:20 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159[28432]: 2024-02-28T22:54:20.381+0000 7f159fe00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi159 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T22:54:20.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:20 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159[28432]: 2024-02-28T22:54:20.381+0000 7f159fe00700 -1 mon.smithi159@0(leader) e1 *** Got Signal Terminated *** 2024-02-28T22:54:20.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:20 smithi159 podman[28679]: 2024-02-28 22:54:20.443868079 +0000 UTC m=+2.794385995 container died 07f221a2bf39a368ad818aedf05237310ec27635c5d40470c2efa6f1e7aa0aa1 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, org.label-schema.build-date=20240222, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.29.1) 2024-02-28T22:54:21.906 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:21 smithi159 podman[28679]: 2024-02-28 22:54:21.673941124 +0000 UTC m=+4.024459071 container cleanup 07f221a2bf39a368ad818aedf05237310ec27635c5d40470c2efa6f1e7aa0aa1 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-02-28T22:54:21.906 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:21 smithi159 bash[28679]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159 2024-02-28T22:54:22.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:21 smithi159 podman[28693]: 2024-02-28 22:54:21.907836744 +0000 UTC m=+1.447889754 container remove 07f221a2bf39a368ad818aedf05237310ec27635c5d40470c2efa6f1e7aa0aa1 (image=quay.io/ceph/ceph:v18.2.1, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.29.1) 2024-02-28T22:54:22.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:22 smithi159 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi159.service: Deactivated successfully. 2024-02-28T22:54:22.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:22 smithi159 systemd[1]: Stopped Ceph mon.smithi159 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T22:54:22.690 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:22 smithi159 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi159.service: Consumed 1.803s CPU time. 2024-02-28T22:54:22.691 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:22 smithi159 systemd[1]: Starting Ceph mon.smithi159 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T22:54:22.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:22 smithi159 podman[28784]: 2024-02-28 22:54:22.596462066 +0000 UTC m=+0.031485423 image pull 5be31c24972a920012b90a9769e8313e2490c82aee752aefd49af9cf4c0f3fcf quay.io/ceph/ceph:v18.2.1 2024-02-28T22:54:22.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:22 smithi159 podman[28784]: 2024-02-28 22:54:22.742394547 +0000 UTC m=+0.177417941 container create 6bdfab2318d019cec76fedab091e3beef74fcf53ee086976a0cf5fd06217f36f (image=quay.io/ceph/ceph:v18.2.1, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=HEAD, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-28T22:54:23.068 INFO:teuthology.orchestra.run.smithi159.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-02-28T22:54:23.326 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:22 smithi159 podman[28784]: 2024-02-28 22:54:22.98153407 +0000 UTC m=+0.416557474 container init 6bdfab2318d019cec76fedab091e3beef74fcf53ee086976a0cf5fd06217f36f (image=quay.io/ceph/ceph:v18.2.1, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, ceph=True, RELEASE=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.29.1, GIT_BRANCH=HEAD) 2024-02-28T22:54:23.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:22 smithi159 podman[28784]: 2024-02-28 22:54:22.993022984 +0000 UTC m=+0.428046360 container start 6bdfab2318d019cec76fedab091e3beef74fcf53ee086976a0cf5fd06217f36f (image=quay.io/ceph/ceph:v18.2.1, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-02-28T22:54:23.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T22:54:23.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable), process ceph-mon, pid 2 2024-02-28T22:54:23.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: pidfile_write: ignore empty --pid-file 2024-02-28T22:54:23.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: load: jerasure load: lrc 2024-02-28T22:54:23.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: RocksDB version: 7.9.2 2024-02-28T22:54:23.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Git sha 0 2024-02-28T22:54:23.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Compile date 2023-12-11 22:07:34 2024-02-28T22:54:23.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: DB SUMMARY 2024-02-28T22:54:23.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: DB Session ID: IFQFZZL52AM40IHDQ6HO 2024-02-28T22:54:23.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: CURRENT file: CURRENT 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi159/store.db dir, Total Num: 1, files: 000008.sst 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi159/store.db: 000009.log size: 98521 ; 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.error_if_exists: 0 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.create_if_missing: 0 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.paranoid_checks: 1 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.env: 0x55ab9fdc9720 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.fs: PosixFileSystem 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.info_log: 0x55aba21cd2e0 2024-02-28T22:54:23.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T22:54:23.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.statistics: (nil) 2024-02-28T22:54:23.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.use_fsync: 0 2024-02-28T22:54:23.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_log_file_size: 0 2024-02-28T22:54:23.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T22:54:23.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T22:54:23.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T22:54:23.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T22:54:23.329 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.allow_fallocate: 1 2024-02-28T22:54:23.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T22:54:23.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T22:54:23.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.use_direct_reads: 0 2024-02-28T22:54:23.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T22:54:23.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T22:54:23.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.db_log_dir: 2024-02-28T22:54:23.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.wal_dir: 2024-02-28T22:54:23.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T22:54:23.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T22:54:23.330 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.write_buffer_manager: 0x55aba143e140 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T22:54:23.331 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T22:54:23.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.unordered_write: 0 2024-02-28T22:54:23.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T22:54:23.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T22:54:23.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T22:54:23.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T22:54:23.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.row_cache: None 2024-02-28T22:54:23.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.wal_filter: None 2024-02-28T22:54:23.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T22:54:23.332 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T22:54:23.333 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.two_write_queues: 0 2024-02-28T22:54:23.333 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T22:54:23.333 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.wal_compression: 0 2024-02-28T22:54:23.333 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.atomic_flush: 0 2024-02-28T22:54:23.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T22:54:23.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T22:54:23.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T22:54:23.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.log_readahead_size: 0 2024-02-28T22:54:23.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T22:54:23.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T22:54:23.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T22:54:23.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T22:54:23.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T22:54:23.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T22:54:23.334 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_background_jobs: 2 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_background_compactions: -1 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_subcompactions: 1 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T22:54:23.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_open_files: -1 2024-02-28T22:54:23.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T22:54:23.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T22:54:23.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T22:54:23.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T22:54:23.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_background_flushes: -1 2024-02-28T22:54:23.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Compression algorithms supported: 2024-02-28T22:54:23.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T22:54:23.336 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: kZSTD supported: 0 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: kXpressCompression supported: 0 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: kZlibCompression supported: 1 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: kSnappyCompression supported: 1 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: kLZ4Compression supported: 1 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: kBZip2Compression supported: 0 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000010 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.merge_operator: 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_filter: None 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T22:54:23.337 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55aba21cd3e0) 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: cache_index_and_filter_blocks: 1 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: pin_top_level_index_and_filter: 1 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_type: 0 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_block_index_type: 0 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_shortening: 1 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: checksum: 4 2024-02-28T22:54:23.338 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: no_block_cache: 0 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache: 0x55aba14df350 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_name: BinnedLRUCache 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_options: 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: capacity : 536870912 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: num_shard_bits : 4 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: strict_capacity_limit : 0 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: high_pri_pool_ratio: 0.000 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_compressed: (nil) 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: persistent_cache: (nil) 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_size: 4096 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_size_deviation: 10 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_restart_interval: 16 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_block_restart_interval: 1 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: metadata_block_size: 4096 2024-02-28T22:54:23.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: partition_filters: 0 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: use_delta_encoding: 1 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: filter_policy: bloomfilter 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: whole_key_filtering: 1 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: verify_compression: 0 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: read_amp_bytes_per_bit: 0 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: format_version: 5 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: enable_index_compression: 1 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_align: 0 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_auto_readahead_size: 262144 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: prepopulate_block_cache: 0 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: initial_auto_readahead_size: 8192 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: num_file_reads_for_auto_readahead: 2 2024-02-28T22:54:23.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compression: NoCompression 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.num_levels: 7 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T22:54:23.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-28T22:54:23.342 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T22:54:23.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T22:54:23.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T22:54:23.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T22:54:23.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T22:54:23.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T22:54:23.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T22:54:23.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T22:54:23.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T22:54:23.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T22:54:23.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T22:54:23.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T22:54:23.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T22:54:23.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T22:54:23.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T22:54:23.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T22:54:23.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T22:54:23.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.arena_block_size: 1048576 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T22:54:23.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T22:54:23.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.table_properties_collectors: 2024-02-28T22:54:23.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.inplace_update_support: 0 2024-02-28T22:54:23.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T22:54:23.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T22:54:23.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T22:54:23.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T22:54:23.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.bloom_locality: 0 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.max_successive_merges: 0 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.ttl: 2592000 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.enable_blob_files: false 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.min_blob_size: 0 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T22:54:23.347 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.blob_file_starting_level: 0 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7ea593f4-d031-4554-ad32-a9bca24b6cbd 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709160863052228, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709160863054806, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93377, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 91394, "index_size": 265, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13388, "raw_average_key_size": 49, "raw_value_size": 84082, "raw_average_value_size": 310, "num_data_blocks": 11, "num_entries": 271, "num_filter_entries": 271, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709160863, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7ea593f4-d031-4554-ad32-a9bca24b6cbd", "db_session_id": "IFQFZZL52AM40IHDQ6HO", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709160863055015, "job": 1, "event": "recovery_finished"} 2024-02-28T22:54:23.348 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi159/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55aba157c000 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: DB pointer 0x55aba1568000 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** DB Stats ** 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T22:54:23.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: L0 2/0 93.06 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Sum 2/0 93.06 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 63.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 63.1 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T22:54:23.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative compaction: 0.00 GB write, 9.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval compaction: 0.00 GB write, 9.94 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Block cache BinnedLRUCache@0x55aba14df350#2 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T22:54:23.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: starting mon.smithi159 rank 0 at public addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] at bind addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi159 fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 bash[28784]: 6bdfab2318d019cec76fedab091e3beef74fcf53ee086976a0cf5fd06217f36f 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: mon.smithi159@-1(???) e1 preinit fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: mon.smithi159@-1(???).mds e1 new map 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: mon.smithi159@-1(???).mds e1 print_map 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: e1 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: legacy client fscid: -1 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: No filesystems configured 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: mon.smithi159@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: mon.smithi159@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T22:54:23.352 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: mon.smithi159@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T22:54:23.353 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: mon.smithi159@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-28T22:54:23.353 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: mon.smithi159@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-28T22:54:23.353 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 systemd[1]: Started Ceph mon.smithi159 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T22:54:23.353 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: mon.smithi159 is new leader, mons smithi159 in quorum (ranks 0) 2024-02-28T22:54:23.353 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: monmap e1: 1 mons at {smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T22:54:23.353 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: fsmap 2024-02-28T22:54:23.353 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: osdmap e1: 0 total, 0 up, 0 in 2024-02-28T22:54:23.353 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:23 smithi159 ceph-mon[28802]: mgrmap e1: no daemons active 2024-02-28T22:54:24.452 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.622+0000 7f04d2400700 1 Processor -- start 2024-02-28T22:54:24.453 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.622+0000 7f04d2400700 1 -- start start 2024-02-28T22:54:24.453 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.622+0000 7f04d2400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc1092a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:24.453 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.622+0000 7f04d2400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc074680 con 0x7f04cc106eb0 2024-02-28T22:54:24.453 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.623+0000 7f04cb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc1092a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:24.453 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.624+0000 7f04cb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc1092a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43154/0 (socket says 172.21.15.159:43154) 2024-02-28T22:54:24.453 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.624+0000 7f04cb400700 1 -- 172.21.15.159:0/3355400317 learned_addr learned my addr 172.21.15.159:0/3355400317 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:24.453 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.624+0000 7f04cb400700 1 -- 172.21.15.159:0/3355400317 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc1097e0 con 0x7f04cc106eb0 2024-02-28T22:54:24.453 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.625+0000 7f04cb400700 1 --2- 172.21.15.159:0/3355400317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc1092a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0098a0 tx=0x7f04bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b944a9d2b0c2db39 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:24.453 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.625+0000 7f04ca000700 1 -- 172.21.15.159:0/3355400317 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04bc004180 con 0x7f04cc106eb0 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.625+0000 7f04ca000700 1 -- 172.21.15.159:0/3355400317 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f04bc0042e0 con 0x7f04cc106eb0 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.625+0000 7f04ca000700 1 -- 172.21.15.159:0/3355400317 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04bc011a50 con 0x7f04cc106eb0 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.626+0000 7f04d2400700 1 -- 172.21.15.159:0/3355400317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 msgr2=0x7f04cc1092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.626+0000 7f04d2400700 1 --2- 172.21.15.159:0/3355400317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc1092a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0098a0 tx=0x7f04bc009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.626+0000 7f04d2400700 1 -- 172.21.15.159:0/3355400317 shutdown_connections 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.626+0000 7f04d2400700 1 --2- 172.21.15.159:0/3355400317 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc1092a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.626+0000 7f04d2400700 1 -- 172.21.15.159:0/3355400317 >> 172.21.15.159:0/3355400317 conn(0x7f04cc1008c0 msgr2=0x7f04cc102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.626+0000 7f04d2400700 1 -- 172.21.15.159:0/3355400317 shutdown_connections 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.626+0000 7f04d2400700 1 -- 172.21.15.159:0/3355400317 wait complete. 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.627+0000 7f04d2400700 1 Processor -- start 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.627+0000 7f04d2400700 1 -- start start 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.627+0000 7f04d2400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc19a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:24.454 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.627+0000 7f04d2400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc19a650 con 0x7f04cc106eb0 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.628+0000 7f04cb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc19a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.628+0000 7f04cb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc19a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43162/0 (socket says 172.21.15.159:43162) 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.628+0000 7f04cb400700 1 -- 172.21.15.159:0/3382843059 learned_addr learned my addr 172.21.15.159:0/3382843059 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.628+0000 7f04cb400700 1 -- 172.21.15.159:0/3382843059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04bc009550 con 0x7f04cc106eb0 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.628+0000 7f04cb400700 1 --2- 172.21.15.159:0/3382843059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc19a110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f04bc003de0 tx=0x7f04bc011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.629+0000 7f04c3e00700 1 -- 172.21.15.159:0/3382843059 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04bc003930 con 0x7f04cc106eb0 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.629+0000 7f04c3e00700 1 -- 172.21.15.159:0/3382843059 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f04bc003a90 con 0x7f04cc106eb0 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.629+0000 7f04d2400700 1 -- 172.21.15.159:0/3382843059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04cc19a850 con 0x7f04cc106eb0 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.629+0000 7f04c3e00700 1 -- 172.21.15.159:0/3382843059 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f04bc019730 con 0x7f04cc106eb0 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.629+0000 7f04d2400700 1 -- 172.21.15.159:0/3382843059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc19acf0 con 0x7f04cc106eb0 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.629+0000 7f04c3e00700 1 -- 172.21.15.159:0/3382843059 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f04bc019cb0 con 0x7f04cc106eb0 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.629+0000 7f04c3e00700 1 -- 172.21.15.159:0/3382843059 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f04bc02c3a0 con 0x7f04cc106eb0 2024-02-28T22:54:24.455 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.630+0000 7f04d2400700 1 -- 172.21.15.159:0/3382843059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04cc0623c0 con 0x7f04cc106eb0 2024-02-28T22:54:24.456 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.633+0000 7f04c3e00700 1 -- 172.21.15.159:0/3382843059 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f04bc01abc0 con 0x7f04cc106eb0 2024-02-28T22:54:24.456 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.708+0000 7f04d2400700 1 -- 172.21.15.159:0/3382843059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f04cc19daf0 con 0x7f04cc106eb0 2024-02-28T22:54:24.456 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.711+0000 7f04c3e00700 1 -- 172.21.15.159:0/3382843059 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f04bc005a20 con 0x7f04cc106eb0 2024-02-28T22:54:24.456 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.712+0000 7f04d2400700 1 -- 172.21.15.159:0/3382843059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 msgr2=0x7f04cc19a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:24.456 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.712+0000 7f04d2400700 1 --2- 172.21.15.159:0/3382843059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc19a110 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f04bc003de0 tx=0x7f04bc011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:24.456 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.712+0000 7f04d2400700 1 -- 172.21.15.159:0/3382843059 shutdown_connections 2024-02-28T22:54:24.456 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.712+0000 7f04d2400700 1 --2- 172.21.15.159:0/3382843059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04cc106eb0 0x7f04cc19a110 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:24.456 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.712+0000 7f04d2400700 1 -- 172.21.15.159:0/3382843059 >> 172.21.15.159:0/3382843059 conn(0x7f04cc1008c0 msgr2=0x7f04cc101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:24.456 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.712+0000 7f04d2400700 1 -- 172.21.15.159:0/3382843059 shutdown_connections 2024-02-28T22:54:24.457 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:23.713+0000 7f04d2400700 1 -- 172.21.15.159:0/3382843059 wait complete. 2024-02-28T22:54:24.457 INFO:teuthology.orchestra.run.smithi159.stdout:Wrote config to /etc/ceph/ceph.conf 2024-02-28T22:54:24.481 INFO:teuthology.orchestra.run.smithi159.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-28T22:54:24.481 INFO:teuthology.orchestra.run.smithi159.stdout:Creating mgr... 2024-02-28T22:54:24.482 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying port 0.0.0.0:9283 ... 2024-02-28T22:54:24.483 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying port 0.0.0.0:8765 ... 2024-02-28T22:54:24.483 INFO:teuthology.orchestra.run.smithi159.stdout:Verifying port 0.0.0.0:8443 ... 2024-02-28T22:54:24.720 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:24 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3382843059' entity='client.admin' 2024-02-28T22:54:24.926 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mgr.smithi159.pobewk 2024-02-28T22:54:24.926 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Failed to reset failed state of unit ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mgr.smithi159.pobewk.service: Unit ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mgr.smithi159.pobewk.service not loaded. 2024-02-28T22:54:25.182 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-24bd0fca-d68c-11ee-95c3-87774f69a715.target.wants/ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mgr.smithi159.pobewk.service → /etc/systemd/system/ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@.service. 2024-02-28T22:54:26.793 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T22:54:26.793 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout disabled 2024-02-28T22:54:26.807 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T22:54:26.807 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-02-28T22:54:26.807 INFO:teuthology.orchestra.run.smithi159.stdout:firewalld.service is not enabled 2024-02-28T22:54:26.807 INFO:teuthology.orchestra.run.smithi159.stdout:Not possible to enable service . firewalld.service is not available 2024-02-28T22:54:26.827 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T22:54:26.828 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout disabled 2024-02-28T22:54:26.845 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T22:54:26.845 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-02-28T22:54:26.846 INFO:teuthology.orchestra.run.smithi159.stdout:firewalld.service is not enabled 2024-02-28T22:54:26.846 INFO:teuthology.orchestra.run.smithi159.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-02-28T22:54:26.846 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mgr to start... 2024-02-28T22:54:26.847 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mgr... 2024-02-28T22:54:27.949 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:27 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/29471118' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T22:54:28.306 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-02-28T22:54:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsid": "24bd0fca-d68c-11ee-95c3-87774f69a715", 2024-02-28T22:54:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T22:54:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T22:54:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T22:54:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T22:54:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T22:54:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T22:54:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 0 2024-02-28T22:54:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "smithi159" 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_age": 4, 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T22:54:28.308 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T22:54:28.309 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T22:54:28.310 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T22:54:07.260167+0000", 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.492+0000 7fccb1600700 1 Processor -- start 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.492+0000 7fccb1600700 1 -- start start 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.492+0000 7fccb1600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac106850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:28.311 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.492+0000 7fccb1600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac106e20 con 0x7fccac106430 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.493+0000 7fccaaa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.493+0000 7fccaaa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43192/0 (socket says 172.21.15.159:43192) 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.493+0000 7fccaaa00700 1 -- 172.21.15.159:0/3845094149 learned_addr learned my addr 172.21.15.159:0/3845094149 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.493+0000 7fccaaa00700 1 -- 172.21.15.159:0/3845094149 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac107630 con 0x7fccac106430 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.494+0000 7fccaaa00700 1 --2- 172.21.15.159:0/3845094149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac106850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0098a0 tx=0x7fcc9c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62cd5b1da4fe1c9e server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.494+0000 7fcca9600700 1 -- 172.21.15.159:0/3845094149 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc9c004180 con 0x7fccac106430 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.494+0000 7fcca9600700 1 -- 172.21.15.159:0/3845094149 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcc9c0042e0 con 0x7fccac106430 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.494+0000 7fcca9600700 1 -- 172.21.15.159:0/3845094149 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc9c011a50 con 0x7fccac106430 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.495+0000 7fccb1600700 1 -- 172.21.15.159:0/3845094149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 msgr2=0x7fccac106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.495+0000 7fccb1600700 1 --2- 172.21.15.159:0/3845094149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac106850 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c0098a0 tx=0x7fcc9c009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.495+0000 7fccb1600700 1 -- 172.21.15.159:0/3845094149 shutdown_connections 2024-02-28T22:54:28.312 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.495+0000 7fccb1600700 1 --2- 172.21.15.159:0/3845094149 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac106850 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.495+0000 7fccb1600700 1 -- 172.21.15.159:0/3845094149 >> 172.21.15.159:0/3845094149 conn(0x7fccac1019b0 msgr2=0x7fccac103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.495+0000 7fccb1600700 1 -- 172.21.15.159:0/3845094149 shutdown_connections 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.495+0000 7fccb1600700 1 -- 172.21.15.159:0/3845094149 wait complete. 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.496+0000 7fccb1600700 1 Processor -- start 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.496+0000 7fccb1600700 1 -- start start 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.496+0000 7fccb1600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac07ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.496+0000 7fccb1600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccac07b090 con 0x7fccac106430 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.497+0000 7fccaaa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac07ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.497+0000 7fccaaa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac07ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43204/0 (socket says 172.21.15.159:43204) 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.497+0000 7fccaaa00700 1 -- 172.21.15.159:0/29471118 learned_addr learned my addr 172.21.15.159:0/29471118 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.497+0000 7fccaaa00700 1 -- 172.21.15.159:0/29471118 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc9c009550 con 0x7fccac106430 2024-02-28T22:54:28.313 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.497+0000 7fccaaa00700 1 --2- 172.21.15.159:0/29471118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac07ab50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009520 tx=0x7fcc9c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:28.314 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.498+0000 7fcca3400700 1 -- 172.21.15.159:0/29471118 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc9c003a80 con 0x7fccac106430 2024-02-28T22:54:28.314 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.498+0000 7fcca3400700 1 -- 172.21.15.159:0/29471118 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcc9c003be0 con 0x7fccac106430 2024-02-28T22:54:28.314 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.498+0000 7fcca3400700 1 -- 172.21.15.159:0/29471118 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcc9c0197b0 con 0x7fccac106430 2024-02-28T22:54:28.314 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.498+0000 7fccb1600700 1 -- 172.21.15.159:0/29471118 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccac0791a0 con 0x7fccac106430 2024-02-28T22:54:28.314 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.498+0000 7fccb1600700 1 -- 172.21.15.159:0/29471118 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccac079640 con 0x7fccac106430 2024-02-28T22:54:28.314 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.498+0000 7fcca3400700 1 -- 172.21.15.159:0/29471118 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcc9c02d440 con 0x7fccac106430 2024-02-28T22:54:28.314 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.498+0000 7fcca3400700 1 -- 172.21.15.159:0/29471118 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fcc9c024800 con 0x7fccac106430 2024-02-28T22:54:28.314 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.499+0000 7fccb1600700 1 -- 172.21.15.159:0/29471118 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccac0623c0 con 0x7fccac106430 2024-02-28T22:54:28.314 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.502+0000 7fcca3400700 1 -- 172.21.15.159:0/29471118 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7fcc9c01ac30 con 0x7fccac106430 2024-02-28T22:54:28.314 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.580+0000 7fccb1600700 1 -- 172.21.15.159:0/29471118 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fccac10a860 con 0x7fccac106430 2024-02-28T22:54:28.315 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.581+0000 7fcca3400700 1 -- 172.21.15.159:0/29471118 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fcc9c024a60 con 0x7fccac106430 2024-02-28T22:54:28.315 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.582+0000 7fccb1600700 1 -- 172.21.15.159:0/29471118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 msgr2=0x7fccac07ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:28.315 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.582+0000 7fccb1600700 1 --2- 172.21.15.159:0/29471118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac07ab50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c009520 tx=0x7fcc9c011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:28.315 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.582+0000 7fccb1600700 1 -- 172.21.15.159:0/29471118 shutdown_connections 2024-02-28T22:54:28.315 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.582+0000 7fccb1600700 1 --2- 172.21.15.159:0/29471118 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fccac106430 0x7fccac07ab50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:28.315 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.582+0000 7fccb1600700 1 -- 172.21.15.159:0/29471118 >> 172.21.15.159:0/29471118 conn(0x7fccac1019b0 msgr2=0x7fccac1030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:28.315 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.582+0000 7fccb1600700 1 -- 172.21.15.159:0/29471118 shutdown_connections 2024-02-28T22:54:28.315 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:27.582+0000 7fccb1600700 1 -- 172.21.15.159:0/29471118 wait complete. 2024-02-28T22:54:28.315 INFO:teuthology.orchestra.run.smithi159.stdout:mgr not available, waiting (1/15)... 2024-02-28T22:54:31.195 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:31 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1712172275' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T22:54:31.797 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:31.798 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-02-28T22:54:31.798 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsid": "24bd0fca-d68c-11ee-95c3-87774f69a715", 2024-02-28T22:54:31.798 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T22:54:31.801 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T22:54:31.801 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T22:54:31.801 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T22:54:31.801 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:31.801 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T22:54:31.801 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T22:54:31.801 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 0 2024-02-28T22:54:31.801 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:31.801 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T22:54:31.801 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "smithi159" 2024-02-28T22:54:31.801 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T22:54:31.802 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:31.803 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T22:54:31.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T22:54:31.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T22:54:31.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T22:54:31.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T22:54:31.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T22:54:31.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T22:54:31.812 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T22:54:31.813 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T22:54:31.813 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:31.813 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T22:54:31.813 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:31.813 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T22:54:31.813 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:31.813 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T22:54:07.260167+0000", 2024-02-28T22:54:31.813 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T22:54:31.813 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:31.813 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T22:54:31.814 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-02-28T22:54:31.814 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.930+0000 7f83cee00700 1 Processor -- start 2024-02-28T22:54:31.814 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.930+0000 7f83cee00700 1 -- start start 2024-02-28T22:54:31.814 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.931+0000 7f83cee00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c80791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:31.814 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.931+0000 7f83cee00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8079790 con 0x7f83c807ad60 2024-02-28T22:54:31.814 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.931+0000 7f83c7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c80791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:31.814 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.931+0000 7f83c7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c80791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38284/0 (socket says 172.21.15.159:38284) 2024-02-28T22:54:31.814 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.931+0000 7f83c7e00700 1 -- 172.21.15.159:0/172938071 learned_addr learned my addr 172.21.15.159:0/172938071 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.932+0000 7f83c7e00700 1 -- 172.21.15.159:0/172938071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c80798d0 con 0x7f83c807ad60 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.932+0000 7f83c7e00700 1 --2- 172.21.15.159:0/172938071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c80791c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f83b80098a0 tx=0x7f83b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeef2ee17623b250 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.932+0000 7f83c7400700 1 -- 172.21.15.159:0/172938071 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83b8004180 con 0x7f83c807ad60 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.932+0000 7f83c7400700 1 -- 172.21.15.159:0/172938071 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f83b80042e0 con 0x7f83c807ad60 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.932+0000 7f83c7400700 1 -- 172.21.15.159:0/172938071 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83b8011a50 con 0x7f83c807ad60 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.933+0000 7f83cee00700 1 -- 172.21.15.159:0/172938071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 msgr2=0x7f83c80791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.933+0000 7f83cee00700 1 --2- 172.21.15.159:0/172938071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c80791c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f83b80098a0 tx=0x7f83b8009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.933+0000 7f83cee00700 1 -- 172.21.15.159:0/172938071 shutdown_connections 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.933+0000 7f83cee00700 1 --2- 172.21.15.159:0/172938071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c80791c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.933+0000 7f83cee00700 1 -- 172.21.15.159:0/172938071 >> 172.21.15.159:0/172938071 conn(0x7f83c81019b0 msgr2=0x7f83c8103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.933+0000 7f83cee00700 1 -- 172.21.15.159:0/172938071 shutdown_connections 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.933+0000 7f83cee00700 1 -- 172.21.15.159:0/172938071 wait complete. 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.934+0000 7f83cee00700 1 Processor -- start 2024-02-28T22:54:31.815 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.934+0000 7f83cee00700 1 -- start start 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.935+0000 7f83cee00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c819c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.935+0000 7f83cee00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c819c830 con 0x7f83c807ad60 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.935+0000 7f83c7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c819c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.935+0000 7f83c7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c819c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38288/0 (socket says 172.21.15.159:38288) 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.935+0000 7f83c7e00700 1 -- 172.21.15.159:0/1712172275 learned_addr learned my addr 172.21.15.159:0/1712172275 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.935+0000 7f83c7e00700 1 -- 172.21.15.159:0/1712172275 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8009550 con 0x7f83c807ad60 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.936+0000 7f83c7e00700 1 --2- 172.21.15.159:0/1712172275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c819c2f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83b8003f80 tx=0x7f83b8011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.936+0000 7f83c5600700 1 -- 172.21.15.159:0/1712172275 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83b8003a80 con 0x7f83c807ad60 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.936+0000 7f83c5600700 1 -- 172.21.15.159:0/1712172275 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f83b8003be0 con 0x7f83c807ad60 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.936+0000 7f83cee00700 1 -- 172.21.15.159:0/1712172275 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c819ca30 con 0x7f83c807ad60 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.936+0000 7f83c5600700 1 -- 172.21.15.159:0/1712172275 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f83b8019820 con 0x7f83c807ad60 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.936+0000 7f83cee00700 1 -- 172.21.15.159:0/1712172275 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c819ced0 con 0x7f83c807ad60 2024-02-28T22:54:31.816 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.937+0000 7f83c5600700 1 -- 172.21.15.159:0/1712172275 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f83b8019ac0 con 0x7f83c807ad60 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.937+0000 7f83c5600700 1 -- 172.21.15.159:0/1712172275 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f83b8024730 con 0x7f83c807ad60 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.938+0000 7f83cee00700 1 -- 172.21.15.159:0/1712172275 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c810c770 con 0x7f83c807ad60 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:30.940+0000 7f83c5600700 1 -- 172.21.15.159:0/1712172275 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7f83b801acc0 con 0x7f83c807ad60 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:31.017+0000 7f83cee00700 1 -- 172.21.15.159:0/1712172275 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f83c810c960 con 0x7f83c807ad60 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:31.018+0000 7f83c5600700 1 -- 172.21.15.159:0/1712172275 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7f83b8019d70 con 0x7f83c807ad60 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:31.019+0000 7f83cee00700 1 -- 172.21.15.159:0/1712172275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 msgr2=0x7f83c819c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:31.019+0000 7f83cee00700 1 --2- 172.21.15.159:0/1712172275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c819c2f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f83b8003f80 tx=0x7f83b8011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:31.020+0000 7f83cee00700 1 -- 172.21.15.159:0/1712172275 shutdown_connections 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:31.020+0000 7f83cee00700 1 --2- 172.21.15.159:0/1712172275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c807ad60 0x7f83c819c2f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:31.020+0000 7f83cee00700 1 -- 172.21.15.159:0/1712172275 >> 172.21.15.159:0/1712172275 conn(0x7f83c81019b0 msgr2=0x7f83c81030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:31.020+0000 7f83cee00700 1 -- 172.21.15.159:0/1712172275 shutdown_connections 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:31.020+0000 7f83cee00700 1 -- 172.21.15.159:0/1712172275 wait complete. 2024-02-28T22:54:31.817 INFO:teuthology.orchestra.run.smithi159.stdout:mgr not available, waiting (2/15)... 2024-02-28T22:54:34.560 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: Activating manager daemon smithi159.pobewk 2024-02-28T22:54:34.560 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: mgrmap e2: smithi159.pobewk(active, starting, since 0.0103235s) 2024-02-28T22:54:34.560 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T22:54:34.560 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T22:54:34.560 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T22:54:34.560 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T22:54:34.560 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T22:54:34.560 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T22:54:34.560 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T22:54:34.560 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi159.pobewk", "id": "smithi159.pobewk"}]: dispatch 2024-02-28T22:54:34.560 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: Manager daemon smithi159.pobewk is now available 2024-02-28T22:54:34.561 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/mirror_snapshot_schedule"}]: dispatch 2024-02-28T22:54:34.561 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' 2024-02-28T22:54:34.561 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/trash_purge_schedule"}]: dispatch 2024-02-28T22:54:34.561 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:34 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' 2024-02-28T22:54:35.239 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:35.239 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-02-28T22:54:35.239 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsid": "24bd0fca-d68c-11ee-95c3-87774f69a715", 2024-02-28T22:54:35.239 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T22:54:35.239 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T22:54:35.239 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T22:54:35.239 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T22:54:35.239 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:35.239 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T22:54:35.239 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T22:54:35.239 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 0 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "smithi159" 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T22:54:35.240 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T22:54:35.241 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T22:54:35.241 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T22:54:35.249 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T22:54:35.249 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T22:54:35.249 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:35.249 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T22:54:35.249 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T22:54:35.249 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T22:54:35.249 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T22:54:35.249 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T22:54:35.249 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T22:54:35.249 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "available": false, 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T22:54:35.250 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T22:54:07.260167+0000", 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.459+0000 7ff9fa000700 1 Processor -- start 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.459+0000 7ff9fa000700 1 -- start start 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.459+0000 7ff9fa000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f4105150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:35.251 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.459+0000 7ff9fa000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f4079e40 con 0x7ff9f4104d30 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.460+0000 7ff9f3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f4105150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.460+0000 7ff9f3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f4105150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38300/0 (socket says 172.21.15.159:38300) 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.460+0000 7ff9f3400700 1 -- 172.21.15.159:0/1433607721 learned_addr learned my addr 172.21.15.159:0/1433607721 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.460+0000 7ff9f3400700 1 -- 172.21.15.159:0/1433607721 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9f4105690 con 0x7ff9f4104d30 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.461+0000 7ff9f3400700 1 --2- 172.21.15.159:0/1433607721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f4105150 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40098a0 tx=0x7ff9e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e260bd9470fd431f server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.461+0000 7ff9f2000700 1 -- 172.21.15.159:0/1433607721 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9e4004180 con 0x7ff9f4104d30 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.461+0000 7ff9f2000700 1 -- 172.21.15.159:0/1433607721 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff9e40042e0 con 0x7ff9f4104d30 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.461+0000 7ff9f2000700 1 -- 172.21.15.159:0/1433607721 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9e4011a50 con 0x7ff9f4104d30 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.461+0000 7ff9fa000700 1 -- 172.21.15.159:0/1433607721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 msgr2=0x7ff9f4105150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.461+0000 7ff9fa000700 1 --2- 172.21.15.159:0/1433607721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f4105150 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff9e40098a0 tx=0x7ff9e4009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.462+0000 7ff9fa000700 1 -- 172.21.15.159:0/1433607721 shutdown_connections 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.462+0000 7ff9fa000700 1 --2- 172.21.15.159:0/1433607721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f4105150 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.462+0000 7ff9fa000700 1 -- 172.21.15.159:0/1433607721 >> 172.21.15.159:0/1433607721 conn(0x7ff9f41008d0 msgr2=0x7ff9f4102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:35.252 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.462+0000 7ff9fa000700 1 -- 172.21.15.159:0/1433607721 shutdown_connections 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.462+0000 7ff9fa000700 1 -- 172.21.15.159:0/1433607721 wait complete. 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.463+0000 7ff9fa000700 1 Processor -- start 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.463+0000 7ff9fa000700 1 -- start start 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.463+0000 7ff9fa000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f419c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.463+0000 7ff9fa000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9f419c810 con 0x7ff9f4104d30 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.464+0000 7ff9f3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f419c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.464+0000 7ff9f3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f419c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38320/0 (socket says 172.21.15.159:38320) 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.464+0000 7ff9f3400700 1 -- 172.21.15.159:0/2993292360 learned_addr learned my addr 172.21.15.159:0/2993292360 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.464+0000 7ff9f3400700 1 -- 172.21.15.159:0/2993292360 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e4009550 con 0x7ff9f4104d30 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.464+0000 7ff9f3400700 1 --2- 172.21.15.159:0/2993292360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f419c2d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4003de0 tx=0x7ff9e4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.465+0000 7ff9ebe00700 1 -- 172.21.15.159:0/2993292360 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9e4003930 con 0x7ff9f4104d30 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.465+0000 7ff9ebe00700 1 -- 172.21.15.159:0/2993292360 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff9e4003a90 con 0x7ff9f4104d30 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.465+0000 7ff9ebe00700 1 -- 172.21.15.159:0/2993292360 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9e4019730 con 0x7ff9f4104d30 2024-02-28T22:54:35.253 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.465+0000 7ff9fa000700 1 -- 172.21.15.159:0/2993292360 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9f419ca10 con 0x7ff9f4104d30 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.465+0000 7ff9fa000700 1 -- 172.21.15.159:0/2993292360 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9f419ceb0 con 0x7ff9f4104d30 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.466+0000 7ff9ebe00700 1 -- 172.21.15.159:0/2993292360 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 2) v1 ==== 45039+0+0 (secure 0 0 0) 0x7ff9e401a430 con 0x7ff9f4104d30 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.466+0000 7ff9fa000700 1 -- 172.21.15.159:0/2993292360 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9f4195bd0 con 0x7ff9f4104d30 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.467+0000 7ff9ebe00700 1 -- 172.21.15.159:0/2993292360 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff9e404bca0 con 0x7ff9f4104d30 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.470+0000 7ff9ebe00700 1 -- 172.21.15.159:0/2993292360 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72446 (secure 0 0 0) 0x7ff9e401a6e0 con 0x7ff9f4104d30 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.554+0000 7ff9fa000700 1 -- 172.21.15.159:0/2993292360 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff9f402cc70 con 0x7ff9f4104d30 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.555+0000 7ff9ebe00700 1 -- 172.21.15.159:0/2993292360 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7ff9e40281c0 con 0x7ff9f4104d30 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.557+0000 7ff9fa000700 1 -- 172.21.15.159:0/2993292360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 msgr2=0x7ff9f419c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.557+0000 7ff9fa000700 1 --2- 172.21.15.159:0/2993292360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f419c2d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4003de0 tx=0x7ff9e4011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.557+0000 7ff9fa000700 1 -- 172.21.15.159:0/2993292360 shutdown_connections 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.557+0000 7ff9fa000700 1 --2- 172.21.15.159:0/2993292360 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9f4104d30 0x7ff9f419c2d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.557+0000 7ff9fa000700 1 -- 172.21.15.159:0/2993292360 >> 172.21.15.159:0/2993292360 conn(0x7ff9f41008d0 msgr2=0x7ff9f41908f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.557+0000 7ff9fa000700 1 -- 172.21.15.159:0/2993292360 shutdown_connections 2024-02-28T22:54:35.254 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:34.557+0000 7ff9fa000700 1 -- 172.21.15.159:0/2993292360 wait complete. 2024-02-28T22:54:35.255 INFO:teuthology.orchestra.run.smithi159.stdout:mgr not available, waiting (3/15)... 2024-02-28T22:54:35.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:35 smithi159 ceph-mon[28802]: from='mgr.14100 172.21.15.159:0/3762976315' entity='mgr.smithi159.pobewk' 2024-02-28T22:54:35.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:35 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2993292360' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T22:54:35.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:35 smithi159 ceph-mon[28802]: mgrmap e3: smithi159.pobewk(active, since 1.01966s) 2024-02-28T22:54:37.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:37 smithi159 ceph-mon[28802]: mgrmap e4: smithi159.pobewk(active, since 2s) 2024-02-28T22:54:38.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:38.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-02-28T22:54:38.807 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsid": "24bd0fca-d68c-11ee-95c3-87774f69a715", 2024-02-28T22:54:38.808 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "health": { 2024-02-28T22:54:38.810 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-02-28T22:54:38.810 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-02-28T22:54:38.810 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-02-28T22:54:38.810 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:38.810 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-02-28T22:54:38.810 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-02-28T22:54:38.810 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 0 2024-02-28T22:54:38.810 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:38.810 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "smithi159" 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "quorum_age": 15, 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "monmap": { 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-02-28T22:54:38.811 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-02-28T22:54:38.820 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-02-28T22:54:38.820 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-02-28T22:54:38.820 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:38.821 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modules": [ 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "iostat", 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "nfs", 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "restful" 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ], 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-02-28T22:54:38.822 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "modified": "2024-02-28T22:54:07.260167+0000", 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "services": {} 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout }, 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.801+0000 7fe24de00700 1 Processor -- start 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.801+0000 7fe24de00700 1 -- start start 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.801+0000 7fe24de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe248108aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.801+0000 7fe24de00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe248109070 con 0x7fe248108680 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.802+0000 7fe246a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe248108aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.802+0000 7fe246a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe248108aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38386/0 (socket says 172.21.15.159:38386) 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.802+0000 7fe246a00700 1 -- 172.21.15.159:0/526872628 learned_addr learned my addr 172.21.15.159:0/526872628 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:38.823 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.802+0000 7fe246a00700 1 -- 172.21.15.159:0/526872628 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe248109830 con 0x7fe248108680 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.803+0000 7fe246a00700 1 --2- 172.21.15.159:0/526872628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe248108aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe2380098a0 tx=0x7fe238009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeada9d35c1e1899 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.803+0000 7fe245600700 1 -- 172.21.15.159:0/526872628 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe238004180 con 0x7fe248108680 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.803+0000 7fe245600700 1 -- 172.21.15.159:0/526872628 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe2380042e0 con 0x7fe248108680 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.803+0000 7fe245600700 1 -- 172.21.15.159:0/526872628 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe238011a50 con 0x7fe248108680 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.804+0000 7fe24de00700 1 -- 172.21.15.159:0/526872628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 msgr2=0x7fe248108aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.804+0000 7fe24de00700 1 --2- 172.21.15.159:0/526872628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe248108aa0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fe2380098a0 tx=0x7fe238009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.804+0000 7fe24de00700 1 -- 172.21.15.159:0/526872628 shutdown_connections 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.804+0000 7fe24de00700 1 --2- 172.21.15.159:0/526872628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe248108aa0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.804+0000 7fe24de00700 1 -- 172.21.15.159:0/526872628 >> 172.21.15.159:0/526872628 conn(0x7fe24807bb20 msgr2=0x7fe2481064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.804+0000 7fe24de00700 1 -- 172.21.15.159:0/526872628 shutdown_connections 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.804+0000 7fe24de00700 1 -- 172.21.15.159:0/526872628 wait complete. 2024-02-28T22:54:38.824 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.805+0000 7fe24de00700 1 Processor -- start 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.805+0000 7fe24de00700 1 -- start start 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.806+0000 7fe24de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe24819c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.806+0000 7fe24de00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24819c890 con 0x7fe248108680 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.806+0000 7fe246a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe24819c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.806+0000 7fe246a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe24819c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38398/0 (socket says 172.21.15.159:38398) 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.806+0000 7fe246a00700 1 -- 172.21.15.159:0/2699836587 learned_addr learned my addr 172.21.15.159:0/2699836587 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.807+0000 7fe246a00700 1 -- 172.21.15.159:0/2699836587 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe238009550 con 0x7fe248108680 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.807+0000 7fe246a00700 1 --2- 172.21.15.159:0/2699836587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe24819c350 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe238003de0 tx=0x7fe238011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.807+0000 7fe24ca00700 1 -- 172.21.15.159:0/2699836587 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe238003930 con 0x7fe248108680 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.807+0000 7fe24ca00700 1 -- 172.21.15.159:0/2699836587 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fe238003a90 con 0x7fe248108680 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.807+0000 7fe24de00700 1 -- 172.21.15.159:0/2699836587 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24819ca90 con 0x7fe248108680 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.807+0000 7fe24ca00700 1 -- 172.21.15.159:0/2699836587 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe2380196c0 con 0x7fe248108680 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.807+0000 7fe24de00700 1 -- 172.21.15.159:0/2699836587 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24819cf30 con 0x7fe248108680 2024-02-28T22:54:38.825 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.808+0000 7fe24ca00700 1 -- 172.21.15.159:0/2699836587 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7fe23801abc0 con 0x7fe248108680 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.809+0000 7fe24de00700 1 -- 172.21.15.159:0/2699836587 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe248196450 con 0x7fe248108680 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.809+0000 7fe24ca00700 1 --2- 172.21.15.159:0/2699836587 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fe22c0382d0 0x7fe22c03a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.809+0000 7fe24ca00700 1 -- 172.21.15.159:0/2699836587 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe23804c050 con 0x7fe248108680 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.809+0000 7fe246000700 1 --2- 172.21.15.159:0/2699836587 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fe22c0382d0 0x7fe22c03a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.810+0000 7fe246000700 1 --2- 172.21.15.159:0/2699836587 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fe22c0382d0 0x7fe22c03a790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe234006fd0 tx=0x7fe234006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:37.815+0000 7fe24ca00700 1 -- 172.21.15.159:0/2699836587 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe23807f0e0 con 0x7fe248108680 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.103+0000 7fe24de00700 1 -- 172.21.15.159:0/2699836587 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe24802d090 con 0x7fe248108680 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.104+0000 7fe24ca00700 1 -- 172.21.15.159:0/2699836587 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1246 (secure 0 0 0) 0x7fe238010790 con 0x7fe248108680 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.107+0000 7fe24de00700 1 -- 172.21.15.159:0/2699836587 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fe22c0382d0 msgr2=0x7fe22c03a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.107+0000 7fe24de00700 1 --2- 172.21.15.159:0/2699836587 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fe22c0382d0 0x7fe22c03a790 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fe234006fd0 tx=0x7fe234006e40 comp rx=0 tx=0).stop 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.107+0000 7fe24de00700 1 -- 172.21.15.159:0/2699836587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 msgr2=0x7fe24819c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.107+0000 7fe24de00700 1 --2- 172.21.15.159:0/2699836587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe24819c350 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fe238003de0 tx=0x7fe238011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:38.826 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.107+0000 7fe24de00700 1 -- 172.21.15.159:0/2699836587 shutdown_connections 2024-02-28T22:54:38.827 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.107+0000 7fe24de00700 1 --2- 172.21.15.159:0/2699836587 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fe22c0382d0 0x7fe22c03a790 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:38.827 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.107+0000 7fe24de00700 1 --2- 172.21.15.159:0/2699836587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe248108680 0x7fe24819c350 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:38.827 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.107+0000 7fe24de00700 1 -- 172.21.15.159:0/2699836587 >> 172.21.15.159:0/2699836587 conn(0x7fe24807bb20 msgr2=0x7fe248106820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:38.827 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.107+0000 7fe24de00700 1 -- 172.21.15.159:0/2699836587 shutdown_connections 2024-02-28T22:54:38.827 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:38.107+0000 7fe24de00700 1 -- 172.21.15.159:0/2699836587 wait complete. 2024-02-28T22:54:38.827 INFO:teuthology.orchestra.run.smithi159.stdout:mgr is available 2024-02-28T22:54:39.344 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:39 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2699836587' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-28T22:54:40.339 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:40 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2003839623' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-28T22:54:40.362 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:40.362 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [global] 2024-02-28T22:54:40.362 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout fsid = 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:54:40.362 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-02-28T22:54:40.362 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-02-28T22:54:40.362 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [mgr] 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout [osd] 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.424+0000 7f10aba00700 1 Processor -- start 2024-02-28T22:54:40.363 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.424+0000 7f10aba00700 1 -- start start 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.424+0000 7f10aba00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a410e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.424+0000 7f10aba00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a410ea20 con 0x7f10a410e030 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.425+0000 7f10a9000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a410e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.425+0000 7f10a9000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a410e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51756/0 (socket says 172.21.15.159:51756) 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.425+0000 7f10a9000700 1 -- 172.21.15.159:0/1684149164 learned_addr learned my addr 172.21.15.159:0/1684149164 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.425+0000 7f10a9000700 1 -- 172.21.15.159:0/1684149164 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a410eb60 con 0x7f10a410e030 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.426+0000 7f10a9000700 1 --2- 172.21.15.159:0/1684149164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a410e450 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f10980098a0 tx=0x7f1098009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af33adad16d27be9 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.426+0000 7f10a3400700 1 -- 172.21.15.159:0/1684149164 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1098004180 con 0x7f10a410e030 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.426+0000 7f10a3400700 1 -- 172.21.15.159:0/1684149164 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f10980042e0 con 0x7f10a410e030 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.426+0000 7f10a3400700 1 -- 172.21.15.159:0/1684149164 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1098011a50 con 0x7f10a410e030 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.427+0000 7f10aba00700 1 -- 172.21.15.159:0/1684149164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 msgr2=0x7f10a410e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.427+0000 7f10aba00700 1 --2- 172.21.15.159:0/1684149164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a410e450 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f10980098a0 tx=0x7f1098009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:40.364 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.427+0000 7f10aba00700 1 -- 172.21.15.159:0/1684149164 shutdown_connections 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.427+0000 7f10aba00700 1 --2- 172.21.15.159:0/1684149164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a410e450 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.427+0000 7f10aba00700 1 -- 172.21.15.159:0/1684149164 >> 172.21.15.159:0/1684149164 conn(0x7f10a407bb20 msgr2=0x7f10a407df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.427+0000 7f10aba00700 1 -- 172.21.15.159:0/1684149164 shutdown_connections 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.427+0000 7f10aba00700 1 -- 172.21.15.159:0/1684149164 wait complete. 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.428+0000 7f10aba00700 1 Processor -- start 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.428+0000 7f10aba00700 1 -- start start 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.428+0000 7f10aba00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a41a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.428+0000 7f10aba00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41a0c80 con 0x7f10a410e030 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.429+0000 7f10a9000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a41a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.429+0000 7f10a9000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a41a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51770/0 (socket says 172.21.15.159:51770) 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.429+0000 7f10a9000700 1 -- 172.21.15.159:0/2003839623 learned_addr learned my addr 172.21.15.159:0/2003839623 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.429+0000 7f10a9000700 1 -- 172.21.15.159:0/2003839623 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1098009550 con 0x7f10a410e030 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.429+0000 7f10a9000700 1 --2- 172.21.15.159:0/2003839623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a41a0740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1098003de0 tx=0x7f1098011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:40.365 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.429+0000 7f10a1600700 1 -- 172.21.15.159:0/2003839623 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1098003930 con 0x7f10a410e030 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.430+0000 7f10a1600700 1 -- 172.21.15.159:0/2003839623 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f1098003a90 con 0x7f10a410e030 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.430+0000 7f10a1600700 1 -- 172.21.15.159:0/2003839623 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f10980196c0 con 0x7f10a410e030 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.430+0000 7f10aba00700 1 -- 172.21.15.159:0/2003839623 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a41a0e80 con 0x7f10a410e030 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.430+0000 7f10aba00700 1 -- 172.21.15.159:0/2003839623 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a41a1320 con 0x7f10a410e030 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.431+0000 7f10aba00700 1 -- 172.21.15.159:0/2003839623 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a40623c0 con 0x7f10a410e030 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.431+0000 7f10a1600700 1 -- 172.21.15.159:0/2003839623 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7f109801abc0 con 0x7f10a410e030 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.432+0000 7f10a1600700 1 --2- 172.21.15.159:0/2003839623 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f108c038320 0x7f108c03a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.432+0000 7f10a1600700 1 -- 172.21.15.159:0/2003839623 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f109804be20 con 0x7f10a410e030 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.432+0000 7f10a3e00700 1 --2- 172.21.15.159:0/2003839623 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f108c038320 0x7f108c03a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.433+0000 7f10a3e00700 1 --2- 172.21.15.159:0/2003839623 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f108c038320 0x7f108c03a7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1090006fd0 tx=0x7f1090006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.437+0000 7f10a1600700 1 -- 172.21.15.159:0/2003839623 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f10980189a0 con 0x7f10a410e030 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.651+0000 7f10aba00700 1 -- 172.21.15.159:0/2003839623 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f10a410eb60 con 0x7f10a410e030 2024-02-28T22:54:40.366 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.654+0000 7f10a1600700 1 -- 172.21.15.159:0/2003839623 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f10a410eb60 con 0x7f10a410e030 2024-02-28T22:54:40.367 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.657+0000 7f10aba00700 1 -- 172.21.15.159:0/2003839623 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f108c038320 msgr2=0x7f108c03a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:40.367 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.657+0000 7f10aba00700 1 --2- 172.21.15.159:0/2003839623 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f108c038320 0x7f108c03a7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1090006fd0 tx=0x7f1090006e40 comp rx=0 tx=0).stop 2024-02-28T22:54:40.367 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.657+0000 7f10aba00700 1 -- 172.21.15.159:0/2003839623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 msgr2=0x7f10a41a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:40.367 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.657+0000 7f10aba00700 1 --2- 172.21.15.159:0/2003839623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a41a0740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1098003de0 tx=0x7f1098011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:40.367 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.657+0000 7f10aba00700 1 -- 172.21.15.159:0/2003839623 shutdown_connections 2024-02-28T22:54:40.367 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.657+0000 7f10aba00700 1 --2- 172.21.15.159:0/2003839623 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f108c038320 0x7f108c03a7e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:40.367 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.657+0000 7f10aba00700 1 --2- 172.21.15.159:0/2003839623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10a410e030 0x7f10a41a0740 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:40.367 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.657+0000 7f10aba00700 1 -- 172.21.15.159:0/2003839623 >> 172.21.15.159:0/2003839623 conn(0x7f10a407bb20 msgr2=0x7f10a407e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:40.367 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.657+0000 7f10aba00700 1 -- 172.21.15.159:0/2003839623 shutdown_connections 2024-02-28T22:54:40.367 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:39.657+0000 7f10aba00700 1 -- 172.21.15.159:0/2003839623 wait complete. 2024-02-28T22:54:40.368 INFO:teuthology.orchestra.run.smithi159.stdout:Enabling cephadm module... 2024-02-28T22:54:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:41 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1212625740' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-28T22:54:42.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.973+0000 7f7c66200700 1 Processor -- start 2024-02-28T22:54:42.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.973+0000 7f7c66200700 1 -- start start 2024-02-28T22:54:42.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.974+0000 7f7c66200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c60079220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:42.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.974+0000 7f7c66200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c600797f0 con 0x7f7c6007adc0 2024-02-28T22:54:42.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.974+0000 7f7c5f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c60079220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.974+0000 7f7c5f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c60079220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51782/0 (socket says 172.21.15.159:51782) 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.974+0000 7f7c5f400700 1 -- 172.21.15.159:0/220871928 learned_addr learned my addr 172.21.15.159:0/220871928 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.975+0000 7f7c5f400700 1 -- 172.21.15.159:0/220871928 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c60079930 con 0x7f7c6007adc0 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.975+0000 7f7c5f400700 1 --2- 172.21.15.159:0/220871928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c60079220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009e80 tx=0x7f7c5000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3301d22aad133767 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.975+0000 7f7c5e000700 1 -- 172.21.15.159:0/220871928 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c5000e070 con 0x7f7c6007adc0 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.975+0000 7f7c5e000700 1 -- 172.21.15.159:0/220871928 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7c50003e90 con 0x7f7c6007adc0 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.975+0000 7f7c5e000700 1 -- 172.21.15.159:0/220871928 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c50004380 con 0x7f7c6007adc0 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.976+0000 7f7c66200700 1 -- 172.21.15.159:0/220871928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 msgr2=0x7f7c60079220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.976+0000 7f7c66200700 1 --2- 172.21.15.159:0/220871928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c60079220 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009e80 tx=0x7f7c5000b330 comp rx=0 tx=0).stop 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.976+0000 7f7c66200700 1 -- 172.21.15.159:0/220871928 shutdown_connections 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.976+0000 7f7c66200700 1 --2- 172.21.15.159:0/220871928 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c60079220 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.976+0000 7f7c66200700 1 -- 172.21.15.159:0/220871928 >> 172.21.15.159:0/220871928 conn(0x7f7c601019b0 msgr2=0x7f7c60103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:42.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.976+0000 7f7c66200700 1 -- 172.21.15.159:0/220871928 shutdown_connections 2024-02-28T22:54:42.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.977+0000 7f7c66200700 1 -- 172.21.15.159:0/220871928 wait complete. 2024-02-28T22:54:42.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.977+0000 7f7c66200700 1 Processor -- start 2024-02-28T22:54:42.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.978+0000 7f7c66200700 1 -- start start 2024-02-28T22:54:42.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.978+0000 7f7c66200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c6019c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:42.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.978+0000 7f7c66200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6019c810 con 0x7f7c6007adc0 2024-02-28T22:54:42.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.978+0000 7f7c5f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c6019c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:42.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.978+0000 7f7c5f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c6019c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51792/0 (socket says 172.21.15.159:51792) 2024-02-28T22:54:42.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.978+0000 7f7c5f400700 1 -- 172.21.15.159:0/1212625740 learned_addr learned my addr 172.21.15.159:0/1212625740 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.979+0000 7f7c5f400700 1 -- 172.21.15.159:0/1212625740 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c50009b30 con 0x7f7c6007adc0 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.979+0000 7f7c5f400700 1 --2- 172.21.15.159:0/1212625740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c6019c2d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009e50 tx=0x7f7c50004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.979+0000 7f7c57e00700 1 -- 172.21.15.159:0/1212625740 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c5000e040 con 0x7f7c6007adc0 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.979+0000 7f7c66200700 1 -- 172.21.15.159:0/1212625740 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6019ca10 con 0x7f7c6007adc0 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.979+0000 7f7c57e00700 1 -- 172.21.15.159:0/1212625740 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f7c50003cf0 con 0x7f7c6007adc0 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.979+0000 7f7c57e00700 1 -- 172.21.15.159:0/1212625740 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7c5001b770 con 0x7f7c6007adc0 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.979+0000 7f7c66200700 1 -- 172.21.15.159:0/1212625740 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6019cf10 con 0x7f7c6007adc0 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.980+0000 7f7c57e00700 1 -- 172.21.15.159:0/1212625740 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) v1 ==== 45272+0+0 (secure 0 0 0) 0x7f7c50019040 con 0x7f7c6007adc0 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.980+0000 7f7c66200700 1 -- 172.21.15.159:0/1212625740 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6010c770 con 0x7f7c6007adc0 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.981+0000 7f7c57e00700 1 --2- 172.21.15.159:0/1212625740 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f7c440382d0 0x7f7c4403a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.981+0000 7f7c57e00700 1 -- 172.21.15.159:0/1212625740 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7c5004bbb0 con 0x7f7c6007adc0 2024-02-28T22:54:42.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.981+0000 7f7c5ea00700 1 --2- 172.21.15.159:0/1212625740 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f7c440382d0 0x7f7c4403a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.982+0000 7f7c5ea00700 1 --2- 172.21.15.159:0/1212625740 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f7c440382d0 0x7f7c4403a790 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c006fd0 tx=0x7f7c4c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:40.986+0000 7f7c57e00700 1 -- 172.21.15.159:0/1212625740 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7c50023be0 con 0x7f7c6007adc0 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.257+0000 7f7c66200700 1 -- 172.21.15.159:0/1212625740 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f7c6010c960 con 0x7f7c6007adc0 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.314+0000 7f7c57e00700 1 -- 172.21.15.159:0/1212625740 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f7c50019d50 con 0x7f7c6007adc0 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.316+0000 7f7c57e00700 1 -- 172.21.15.159:0/1212625740 <== mon.0 v2:172.21.15.159:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f7c5004b5d0 con 0x7f7c6007adc0 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.320+0000 7f7c66200700 1 -- 172.21.15.159:0/1212625740 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f7c440382d0 msgr2=0x7f7c4403a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.320+0000 7f7c66200700 1 --2- 172.21.15.159:0/1212625740 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f7c440382d0 0x7f7c4403a790 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c006fd0 tx=0x7f7c4c006e40 comp rx=0 tx=0).stop 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.320+0000 7f7c66200700 1 -- 172.21.15.159:0/1212625740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 msgr2=0x7f7c6019c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.320+0000 7f7c66200700 1 --2- 172.21.15.159:0/1212625740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c6019c2d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7c50009e50 tx=0x7f7c50004920 comp rx=0 tx=0).stop 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.320+0000 7f7c66200700 1 -- 172.21.15.159:0/1212625740 shutdown_connections 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.320+0000 7f7c66200700 1 --2- 172.21.15.159:0/1212625740 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7f7c440382d0 0x7f7c4403a790 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.320+0000 7f7c66200700 1 --2- 172.21.15.159:0/1212625740 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c6007adc0 0x7f7c6019c2d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:42.061 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.320+0000 7f7c66200700 1 -- 172.21.15.159:0/1212625740 >> 172.21.15.159:0/1212625740 conn(0x7f7c601019b0 msgr2=0x7f7c601027d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:42.062 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.320+0000 7f7c66200700 1 -- 172.21.15.159:0/1212625740 shutdown_connections 2024-02-28T22:54:42.062 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:41.320+0000 7f7c66200700 1 -- 172.21.15.159:0/1212625740 wait complete. 2024-02-28T22:54:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:42 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1212625740' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-28T22:54:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:42 smithi159 ceph-mon[28802]: mgrmap e5: smithi159.pobewk(active, since 6s) 2024-02-28T22:54:44.072 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "active_name": "smithi159.pobewk", 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.011+0000 7fb4e6000700 1 Processor -- start 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.012+0000 7fb4e6000700 1 -- start start 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.012+0000 7fb4e6000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0104b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.012+0000 7fb4e6000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0105120 con 0x7fb4e0104730 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.012+0000 7fb4df400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0104b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.012+0000 7fb4df400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0104b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51832/0 (socket says 172.21.15.159:51832) 2024-02-28T22:54:44.073 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.012+0000 7fb4df400700 1 -- 172.21.15.159:0/2765412716 learned_addr learned my addr 172.21.15.159:0/2765412716 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.012+0000 7fb4df400700 1 -- 172.21.15.159:0/2765412716 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e01076c0 con 0x7fb4e0104730 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.012+0000 7fb4df400700 1 --2- 172.21.15.159:0/2765412716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0104b50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00098a0 tx=0x7fb4d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686477cf965b83ce server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.012+0000 7fb4de000700 1 -- 172.21.15.159:0/2765412716 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb4d0004180 con 0x7fb4e0104730 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.012+0000 7fb4de000700 1 -- 172.21.15.159:0/2765412716 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb4d00042e0 con 0x7fb4e0104730 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.012+0000 7fb4de000700 1 -- 172.21.15.159:0/2765412716 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb4d0011a50 con 0x7fb4e0104730 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.013+0000 7fb4e6000700 1 -- 172.21.15.159:0/2765412716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 msgr2=0x7fb4e0104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.013+0000 7fb4e6000700 1 --2- 172.21.15.159:0/2765412716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0104b50 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00098a0 tx=0x7fb4d0009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.013+0000 7fb4e6000700 1 -- 172.21.15.159:0/2765412716 shutdown_connections 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.013+0000 7fb4e6000700 1 --2- 172.21.15.159:0/2765412716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0104b50 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.013+0000 7fb4e6000700 1 -- 172.21.15.159:0/2765412716 >> 172.21.15.159:0/2765412716 conn(0x7fb4e0100040 msgr2=0x7fb4e01024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.013+0000 7fb4e6000700 1 -- 172.21.15.159:0/2765412716 shutdown_connections 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.013+0000 7fb4e6000700 1 -- 172.21.15.159:0/2765412716 wait complete. 2024-02-28T22:54:44.074 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.014+0000 7fb4e6000700 1 Processor -- start 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.014+0000 7fb4e6000700 1 -- start start 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.015+0000 7fb4e6000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0107020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.015+0000 7fb4e6000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e0107560 con 0x7fb4e0104730 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.015+0000 7fb4df400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0107020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.015+0000 7fb4df400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0107020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51838/0 (socket says 172.21.15.159:51838) 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.015+0000 7fb4df400700 1 -- 172.21.15.159:0/2117815439 learned_addr learned my addr 172.21.15.159:0/2117815439 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.015+0000 7fb4df400700 1 -- 172.21.15.159:0/2117815439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4d0009550 con 0x7fb4e0104730 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.015+0000 7fb4df400700 1 --2- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0107020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0003de0 tx=0x7fb4d0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.016+0000 7fb4d7e00700 1 -- 172.21.15.159:0/2117815439 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb4d0003930 con 0x7fb4e0104730 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.016+0000 7fb4d7e00700 1 -- 172.21.15.159:0/2117815439 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fb4d0003a90 con 0x7fb4e0104730 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.016+0000 7fb4d7e00700 1 -- 172.21.15.159:0/2117815439 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb4d00196c0 con 0x7fb4e0104730 2024-02-28T22:54:44.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.016+0000 7fb4e6000700 1 -- 172.21.15.159:0/2117815439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e0105670 con 0x7fb4e0104730 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.016+0000 7fb4e6000700 1 -- 172.21.15.159:0/2117815439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e0105b10 con 0x7fb4e0104730 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.017+0000 7fb4d7e00700 1 -- 172.21.15.159:0/2117815439 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fb4d001abc0 con 0x7fb4e0104730 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.017+0000 7fb4d7e00700 1 --2- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fb4c4038370 0x7fb4c403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.017+0000 7fb4d7e00700 1 -- 172.21.15.159:0/2117815439 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb4d004c140 con 0x7fb4e0104730 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.017+0000 7fb4dea00700 1 -- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fb4c4038370 msgr2=0x7fb4c403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/1882871978 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.017+0000 7fb4d5600700 1 -- 172.21.15.159:0/2117815439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4b80052f0 con 0x7fb4e0104730 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.017+0000 7fb4dea00700 1 --2- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fb4c4038370 0x7fb4c403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.024+0000 7fb4d7e00700 1 -- 172.21.15.159:0/2117815439 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb4d001a430 con 0x7fb4e0104730 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.219+0000 7fb4dea00700 1 -- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fb4c4038370 msgr2=0x7fb4c403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/1882871978 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.219+0000 7fb4dea00700 1 --2- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fb4c4038370 0x7fb4c403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.307+0000 7fb4d5600700 1 -- 172.21.15.159:0/2117815439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fb4b80061d0 con 0x7fb4e0104730 2024-02-28T22:54:44.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.308+0000 7fb4d7e00700 1 -- 172.21.15.159:0/2117815439 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fb4d0010380 con 0x7fb4e0104730 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.311+0000 7fb4d5600700 1 -- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fb4c4038370 msgr2=0x7fb4c403a830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.311+0000 7fb4d5600700 1 --2- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fb4c4038370 0x7fb4c403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.311+0000 7fb4d5600700 1 -- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 msgr2=0x7fb4e0107020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.311+0000 7fb4d5600700 1 --2- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0107020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0003de0 tx=0x7fb4d0011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.311+0000 7fb4d5600700 1 -- 172.21.15.159:0/2117815439 shutdown_connections 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.311+0000 7fb4d5600700 1 --2- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7fb4c4038370 0x7fb4c403a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.311+0000 7fb4d5600700 1 --2- 172.21.15.159:0/2117815439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0104730 0x7fb4e0107020 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.311+0000 7fb4d5600700 1 -- 172.21.15.159:0/2117815439 >> 172.21.15.159:0/2117815439 conn(0x7fb4e0100040 msgr2=0x7fb4e0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.312+0000 7fb4d5600700 1 -- 172.21.15.159:0/2117815439 shutdown_connections 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:43.312+0000 7fb4d5600700 1 -- 172.21.15.159:0/2117815439 wait complete. 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for the mgr to restart... 2024-02-28T22:54:44.077 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mgr epoch 5... 2024-02-28T22:54:44.371 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:44 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2117815439' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-28T22:54:50.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:50 smithi159 ceph-mon[28802]: Active manager daemon smithi159.pobewk restarted 2024-02-28T22:54:50.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:50 smithi159 ceph-mon[28802]: Activating manager daemon smithi159.pobewk 2024-02-28T22:54:50.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:50 smithi159 ceph-mon[28802]: osdmap e2: 0 total, 0 up, 0 in 2024-02-28T22:54:50.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:50 smithi159 ceph-mon[28802]: mgrmap e6: smithi159.pobewk(active, starting, since 0.00999892s) 2024-02-28T22:54:50.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:50 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T22:54:50.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:50 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi159.pobewk", "id": "smithi159.pobewk"}]: dispatch 2024-02-28T22:54:50.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:50 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T22:54:50.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:50 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T22:54:50.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:50 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T22:54:50.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:50 smithi159 ceph-mon[28802]: Manager daemon smithi159.pobewk is now available 2024-02-28T22:54:50.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:50 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:54:51.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:51 smithi159 ceph-mon[28802]: Found migration_current of "None". Setting to last migration. 2024-02-28T22:54:51.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:51 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:54:51.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:51 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:54:51.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:51 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:54:51.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:51 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:54:51.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:51 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/mirror_snapshot_schedule"}]: dispatch 2024-02-28T22:54:51.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:51 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/trash_purge_schedule"}]: dispatch 2024-02-28T22:54:51.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:51 smithi159 ceph-mon[28802]: mgrmap e7: smithi159.pobewk(active, since 1.01247s) 2024-02-28T22:54:51.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:51 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:54:51.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:51 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:54:51.712 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-02-28T22:54:51.712 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-02-28T22:54:51.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-28T22:54:51.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-02-28T22:54:51.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.677+0000 7ff966e00700 1 Processor -- start 2024-02-28T22:54:51.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.678+0000 7ff966e00700 1 -- start start 2024-02-28T22:54:51.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.678+0000 7ff966e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff9600791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:51.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.678+0000 7ff966e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff960079790 con 0x7ff96007ad60 2024-02-28T22:54:51.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.678+0000 7ff95fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff9600791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:51.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.678+0000 7ff95fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff9600791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51854/0 (socket says 172.21.15.159:51854) 2024-02-28T22:54:51.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.678+0000 7ff95fe00700 1 -- 172.21.15.159:0/2137460935 learned_addr learned my addr 172.21.15.159:0/2137460935 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:51.713 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.679+0000 7ff95fe00700 1 -- 172.21.15.159:0/2137460935 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9600798d0 con 0x7ff96007ad60 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.679+0000 7ff95fe00700 1 --2- 172.21.15.159:0/2137460935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff9600791c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff9500098a0 tx=0x7ff950009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3407e1351285f0fd server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.680+0000 7ff95f400700 1 -- 172.21.15.159:0/2137460935 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff950004180 con 0x7ff96007ad60 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.680+0000 7ff95f400700 1 -- 172.21.15.159:0/2137460935 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff9500042e0 con 0x7ff96007ad60 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.680+0000 7ff95f400700 1 -- 172.21.15.159:0/2137460935 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff950011a00 con 0x7ff96007ad60 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.680+0000 7ff966e00700 1 -- 172.21.15.159:0/2137460935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 msgr2=0x7ff9600791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.680+0000 7ff966e00700 1 --2- 172.21.15.159:0/2137460935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff9600791c0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff9500098a0 tx=0x7ff950009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.680+0000 7ff966e00700 1 -- 172.21.15.159:0/2137460935 shutdown_connections 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.680+0000 7ff966e00700 1 --2- 172.21.15.159:0/2137460935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff9600791c0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.680+0000 7ff966e00700 1 -- 172.21.15.159:0/2137460935 >> 172.21.15.159:0/2137460935 conn(0x7ff9601019b0 msgr2=0x7ff960103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.680+0000 7ff966e00700 1 -- 172.21.15.159:0/2137460935 shutdown_connections 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.681+0000 7ff966e00700 1 -- 172.21.15.159:0/2137460935 wait complete. 2024-02-28T22:54:51.714 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.681+0000 7ff966e00700 1 Processor -- start 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.682+0000 7ff966e00700 1 -- start start 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.682+0000 7ff966e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff96019c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.682+0000 7ff966e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96019c830 con 0x7ff96007ad60 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.682+0000 7ff95fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff96019c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.682+0000 7ff95fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff96019c2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51866/0 (socket says 172.21.15.159:51866) 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.682+0000 7ff95fe00700 1 -- 172.21.15.159:0/2058924292 learned_addr learned my addr 172.21.15.159:0/2058924292 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.683+0000 7ff95fe00700 1 -- 172.21.15.159:0/2058924292 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff950009550 con 0x7ff96007ad60 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.683+0000 7ff95fe00700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff96019c2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff950003f80 tx=0x7ff950011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.683+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff950003b00 con 0x7ff96007ad60 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.683+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7ff95001a8a0 con 0x7ff96007ad60 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.683+0000 7ff966e00700 1 -- 172.21.15.159:0/2058924292 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff96019ca30 con 0x7ff96007ad60 2024-02-28T22:54:51.715 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.683+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff9500198d0 con 0x7ff96007ad60 2024-02-28T22:54:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.683+0000 7ff966e00700 1 -- 172.21.15.159:0/2058924292 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff96019ced0 con 0x7ff96007ad60 2024-02-28T22:54:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.684+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) v1 ==== 45283+0+0 (secure 0 0 0) 0x7ff95001a430 con 0x7ff96007ad60 2024-02-28T22:54:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.685+0000 7ff95d600700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 0x7ff94403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.685+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 --> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff94403af40 con 0x7ff944038370 2024-02-28T22:54:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.685+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff95004c530 con 0x7ff96007ad60 2024-02-28T22:54:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.685+0000 7ff957400700 1 -- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 msgr2=0x7ff94403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/1882871978 2024-02-28T22:54:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.685+0000 7ff957400700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 0x7ff94403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T22:54:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.886+0000 7ff957400700 1 -- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 msgr2=0x7ff94403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/1882871978 2024-02-28T22:54:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:44.886+0000 7ff957400700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 0x7ff94403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T22:54:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:45.287+0000 7ff957400700 1 -- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 msgr2=0x7ff94403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/1882871978 2024-02-28T22:54:51.716 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:45.287+0000 7ff957400700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 0x7ff94403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:46.088+0000 7ff957400700 1 -- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 msgr2=0x7ff94403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/1882871978 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:46.088+0000 7ff957400700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 0x7ff94403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:47.690+0000 7ff957400700 1 -- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 msgr2=0x7ff94403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/1882871978 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:47.690+0000 7ff957400700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 0x7ff94403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:49.976+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mgrmap(e 6) v1 ==== 45050+0+0 (secure 0 0 0) 0x7ff95002d960 con 0x7ff96007ad60 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:49.976+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 msgr2=0x7ff94403a830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:49.976+0000 7ff95d600700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 0x7ff94403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.980+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 7) v1 ==== 45177+0+0 (secure 0 0 0) 0x7ff95004e4d0 con 0x7ff96007ad60 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.980+0000 7ff95d600700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7ff94403bc50 0x7ff94403e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.980+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff94403af40 con 0x7ff94403bc50 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.982+0000 7ff957400700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7ff94403bc50 0x7ff94403e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:51.717 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.984+0000 7ff957400700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7ff94403bc50 0x7ff94403e040 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff948003a10 tx=0x7ff9480092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.985+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7ff94403af40 con 0x7ff94403bc50 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.993+0000 7ff966e00700 1 -- 172.21.15.159:0/2058924292 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ff96019d630 con 0x7ff94403bc50 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.993+0000 7ff95d600700 1 -- 172.21.15.159:0/2058924292 <== mgr.14120 v2:172.21.15.159:6800/2133007913 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ff96019d630 con 0x7ff94403bc50 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.994+0000 7ff966e00700 1 -- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7ff94403bc50 msgr2=0x7ff94403e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.994+0000 7ff966e00700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7ff94403bc50 0x7ff94403e040 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff948003a10 tx=0x7ff9480092b0 comp rx=0 tx=0).stop 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.994+0000 7ff966e00700 1 -- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 msgr2=0x7ff96019c2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.994+0000 7ff966e00700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff96019c2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff950003f80 tx=0x7ff950011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.994+0000 7ff966e00700 1 -- 172.21.15.159:0/2058924292 shutdown_connections 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.994+0000 7ff966e00700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff96007ad60 0x7ff96019c2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.994+0000 7ff966e00700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7ff94403bc50 0x7ff94403e040 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.994+0000 7ff966e00700 1 --2- 172.21.15.159:0/2058924292 >> [v2:172.21.15.159:6800/1882871978,v1:172.21.15.159:6801/1882871978] conn(0x7ff944038370 0x7ff94403a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:51.718 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.994+0000 7ff966e00700 1 -- 172.21.15.159:0/2058924292 >> 172.21.15.159:0/2058924292 conn(0x7ff9601019b0 msgr2=0x7ff9601030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:51.719 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.995+0000 7ff966e00700 1 -- 172.21.15.159:0/2058924292 shutdown_connections 2024-02-28T22:54:51.719 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:50.995+0000 7ff966e00700 1 -- 172.21.15.159:0/2058924292 wait complete. 2024-02-28T22:54:51.719 INFO:teuthology.orchestra.run.smithi159.stdout:mgr epoch 5 is available 2024-02-28T22:54:51.719 INFO:teuthology.orchestra.run.smithi159.stdout:Setting orchestrator backend to cephadm... 2024-02-28T22:54:52.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:52 smithi159 ceph-mon[28802]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-28T22:54:52.312 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:52 smithi159 ceph-mon[28802]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-28T22:54:53.315 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:53 smithi159 ceph-mon[28802]: [28/Feb/2024:22:54:51] ENGINE Bus STARTING 2024-02-28T22:54:53.315 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:53 smithi159 ceph-mon[28802]: [28/Feb/2024:22:54:51] ENGINE Serving on http://172.21.15.159:8765 2024-02-28T22:54:53.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:53 smithi159 ceph-mon[28802]: [28/Feb/2024:22:54:52] ENGINE Serving on https://172.21.15.159:7150 2024-02-28T22:54:53.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:53 smithi159 ceph-mon[28802]: [28/Feb/2024:22:54:52] ENGINE Bus STARTED 2024-02-28T22:54:53.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:53 smithi159 ceph-mon[28802]: mgrmap e8: smithi159.pobewk(active, since 2s) 2024-02-28T22:54:53.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:53 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:54:53.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:53 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:54:53.316 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:53 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:54:53.340 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.386+0000 7fa18b200700 1 Processor -- start 2024-02-28T22:54:53.340 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.386+0000 7fa18b200700 1 -- start start 2024-02-28T22:54:53.340 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.386+0000 7fa18b200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c108890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:53.340 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.386+0000 7fa18b200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c108e60 con 0x7fa18c108470 2024-02-28T22:54:53.340 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.387+0000 7fa189e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c108890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:53.340 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.387+0000 7fa189e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c108890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54712/0 (socket says 172.21.15.159:54712) 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.387+0000 7fa189e00700 1 -- 172.21.15.159:0/4107997127 learned_addr learned my addr 172.21.15.159:0/4107997127 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.387+0000 7fa189e00700 1 -- 172.21.15.159:0/4107997127 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa18c109670 con 0x7fa18c108470 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.387+0000 7fa189e00700 1 --2- 172.21.15.159:0/4107997127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c108890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098a0 tx=0x7fa17c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=845d7ac018d80ed1 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.388+0000 7fa188a00700 1 -- 172.21.15.159:0/4107997127 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa17c004180 con 0x7fa18c108470 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.388+0000 7fa188a00700 1 -- 172.21.15.159:0/4107997127 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa17c0042e0 con 0x7fa18c108470 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.388+0000 7fa188a00700 1 -- 172.21.15.159:0/4107997127 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa17c011a50 con 0x7fa18c108470 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.388+0000 7fa18b200700 1 -- 172.21.15.159:0/4107997127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 msgr2=0x7fa18c108890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.388+0000 7fa18b200700 1 --2- 172.21.15.159:0/4107997127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c108890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa17c0098a0 tx=0x7fa17c009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.388+0000 7fa18b200700 1 -- 172.21.15.159:0/4107997127 shutdown_connections 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.388+0000 7fa18b200700 1 --2- 172.21.15.159:0/4107997127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c108890 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.388+0000 7fa18b200700 1 -- 172.21.15.159:0/4107997127 >> 172.21.15.159:0/4107997127 conn(0x7fa18c07b850 msgr2=0x7fa18c1064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.388+0000 7fa18b200700 1 -- 172.21.15.159:0/4107997127 shutdown_connections 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.389+0000 7fa18b200700 1 -- 172.21.15.159:0/4107997127 wait complete. 2024-02-28T22:54:53.341 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.389+0000 7fa18b200700 1 Processor -- start 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.390+0000 7fa18b200700 1 -- start start 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.390+0000 7fa18b200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c19c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.390+0000 7fa18b200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa18c19c6d0 con 0x7fa18c108470 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.390+0000 7fa189e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c19c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.390+0000 7fa189e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c19c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54728/0 (socket says 172.21.15.159:54728) 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.390+0000 7fa189e00700 1 -- 172.21.15.159:0/3031059982 learned_addr learned my addr 172.21.15.159:0/3031059982 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.390+0000 7fa189e00700 1 -- 172.21.15.159:0/3031059982 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17c009550 con 0x7fa18c108470 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.391+0000 7fa189e00700 1 --2- 172.21.15.159:0/3031059982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c19c190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa17c003de0 tx=0x7fa17c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.391+0000 7fa182a00700 1 -- 172.21.15.159:0/3031059982 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa17c003930 con 0x7fa18c108470 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.391+0000 7fa182a00700 1 -- 172.21.15.159:0/3031059982 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa17c003a90 con 0x7fa18c108470 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.391+0000 7fa18b200700 1 -- 172.21.15.159:0/3031059982 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa18c19c8d0 con 0x7fa18c108470 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.391+0000 7fa182a00700 1 -- 172.21.15.159:0/3031059982 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa17c0196c0 con 0x7fa18c108470 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.391+0000 7fa18b200700 1 -- 172.21.15.159:0/3031059982 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa18c19cd70 con 0x7fa18c108470 2024-02-28T22:54:53.342 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.392+0000 7fa18b200700 1 -- 172.21.15.159:0/3031059982 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa18c0623c0 con 0x7fa18c108470 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.392+0000 7fa182a00700 1 -- 172.21.15.159:0/3031059982 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fa17c01a430 con 0x7fa18c108470 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.392+0000 7fa182a00700 1 --2- 172.21.15.159:0/3031059982 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa170038370 0x7fa17003a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.393+0000 7fa182a00700 1 -- 172.21.15.159:0/3031059982 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa17c04c3a0 con 0x7fa18c108470 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.393+0000 7fa189400700 1 --2- 172.21.15.159:0/3031059982 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa170038370 0x7fa17003a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.393+0000 7fa189400700 1 --2- 172.21.15.159:0/3031059982 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa170038370 0x7fa17003a830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa174006fd0 tx=0x7fa174006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.398+0000 7fa182a00700 1 -- 172.21.15.159:0/3031059982 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa17c010380 con 0x7fa18c108470 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.625+0000 7fa18b200700 1 -- 172.21.15.159:0/3031059982 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fa18c1073c0 con 0x7fa170038370 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.633+0000 7fa182a00700 1 -- 172.21.15.159:0/3031059982 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fa18c1073c0 con 0x7fa170038370 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.636+0000 7fa18b200700 1 -- 172.21.15.159:0/3031059982 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa170038370 msgr2=0x7fa17003a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.636+0000 7fa18b200700 1 --2- 172.21.15.159:0/3031059982 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa170038370 0x7fa17003a830 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa174006fd0 tx=0x7fa174006e40 comp rx=0 tx=0).stop 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.636+0000 7fa18b200700 1 -- 172.21.15.159:0/3031059982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 msgr2=0x7fa18c19c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.636+0000 7fa18b200700 1 --2- 172.21.15.159:0/3031059982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c19c190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa17c003de0 tx=0x7fa17c011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:53.343 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.636+0000 7fa18b200700 1 -- 172.21.15.159:0/3031059982 shutdown_connections 2024-02-28T22:54:53.344 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.636+0000 7fa18b200700 1 --2- 172.21.15.159:0/3031059982 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa170038370 0x7fa17003a830 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:53.344 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.636+0000 7fa18b200700 1 --2- 172.21.15.159:0/3031059982 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa18c108470 0x7fa18c19c190 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:53.344 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.636+0000 7fa18b200700 1 -- 172.21.15.159:0/3031059982 >> 172.21.15.159:0/3031059982 conn(0x7fa18c07b850 msgr2=0x7fa18c1067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:53.344 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.637+0000 7fa18b200700 1 -- 172.21.15.159:0/3031059982 shutdown_connections 2024-02-28T22:54:53.344 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:52.637+0000 7fa18b200700 1 -- 172.21.15.159:0/3031059982 wait complete. 2024-02-28T22:54:54.207 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:54 smithi159 ceph-mon[28802]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:54:54.977 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout value unchanged 2024-02-28T22:54:54.977 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.956+0000 7f5c8a800700 1 Processor -- start 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.956+0000 7f5c8a800700 1 -- start start 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.957+0000 7f5c8a800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c841088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.957+0000 7f5c8a800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c84108ea0 con 0x7f5c841084b0 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.957+0000 7f5c89400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c841088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.957+0000 7f5c89400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c841088d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54730/0 (socket says 172.21.15.159:54730) 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.957+0000 7f5c89400700 1 -- 172.21.15.159:0/747384949 learned_addr learned my addr 172.21.15.159:0/747384949 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.958+0000 7f5c89400700 1 -- 172.21.15.159:0/747384949 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c84109660 con 0x7f5c841084b0 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.958+0000 7f5c89400700 1 --2- 172.21.15.159:0/747384949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c841088d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c780098a0 tx=0x7f5c78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc5f2cd467772576 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.959+0000 7f5c83e00700 1 -- 172.21.15.159:0/747384949 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c78004180 con 0x7f5c841084b0 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.959+0000 7f5c83e00700 1 -- 172.21.15.159:0/747384949 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c780042e0 con 0x7f5c841084b0 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.959+0000 7f5c83e00700 1 -- 172.21.15.159:0/747384949 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c78011a50 con 0x7f5c841084b0 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.959+0000 7f5c8a800700 1 -- 172.21.15.159:0/747384949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 msgr2=0x7f5c841088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.959+0000 7f5c8a800700 1 --2- 172.21.15.159:0/747384949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c841088d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f5c780098a0 tx=0x7f5c78009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:54.978 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.959+0000 7f5c8a800700 1 -- 172.21.15.159:0/747384949 shutdown_connections 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.959+0000 7f5c8a800700 1 --2- 172.21.15.159:0/747384949 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c841088d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.959+0000 7f5c8a800700 1 -- 172.21.15.159:0/747384949 >> 172.21.15.159:0/747384949 conn(0x7f5c8407b8b0 msgr2=0x7f5c841064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.960+0000 7f5c8a800700 1 -- 172.21.15.159:0/747384949 shutdown_connections 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.960+0000 7f5c8a800700 1 -- 172.21.15.159:0/747384949 wait complete. 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.961+0000 7f5c8a800700 1 Processor -- start 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.961+0000 7f5c8a800700 1 -- start start 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.961+0000 7f5c8a800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c8419c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.961+0000 7f5c8a800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8419c6e0 con 0x7f5c841084b0 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.962+0000 7f5c89400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c8419c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.962+0000 7f5c89400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c8419c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54732/0 (socket says 172.21.15.159:54732) 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.962+0000 7f5c89400700 1 -- 172.21.15.159:0/3086488390 learned_addr learned my addr 172.21.15.159:0/3086488390 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.962+0000 7f5c89400700 1 -- 172.21.15.159:0/3086488390 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c78009550 con 0x7f5c841084b0 2024-02-28T22:54:54.979 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.962+0000 7f5c89400700 1 --2- 172.21.15.159:0/3086488390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c8419c1a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5c78003de0 tx=0x7f5c78011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.962+0000 7f5c82000700 1 -- 172.21.15.159:0/3086488390 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c78003930 con 0x7f5c841084b0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.963+0000 7f5c82000700 1 -- 172.21.15.159:0/3086488390 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f5c78003a90 con 0x7f5c841084b0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.963+0000 7f5c8a800700 1 -- 172.21.15.159:0/3086488390 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c8419c8e0 con 0x7f5c841084b0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.963+0000 7f5c82000700 1 -- 172.21.15.159:0/3086488390 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5c780196c0 con 0x7f5c841084b0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.963+0000 7f5c8a800700 1 -- 172.21.15.159:0/3086488390 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8419cd80 con 0x7f5c841084b0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.964+0000 7f5c82000700 1 -- 172.21.15.159:0/3086488390 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f5c7801abc0 con 0x7f5c841084b0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.964+0000 7f5c8a800700 1 -- 172.21.15.159:0/3086488390 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c840623c0 con 0x7f5c841084b0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.964+0000 7f5c82000700 1 --2- 172.21.15.159:0/3086488390 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f5c6c038370 0x7f5c6c03a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.964+0000 7f5c82000700 1 -- 172.21.15.159:0/3086488390 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f5c7804c3b0 con 0x7f5c841084b0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.964+0000 7f5c88a00700 1 --2- 172.21.15.159:0/3086488390 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f5c6c038370 0x7f5c6c03a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.965+0000 7f5c88a00700 1 --2- 172.21.15.159:0/3086488390 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f5c6c038370 0x7f5c6c03a830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c70006fd0 tx=0x7f5c70006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:53.970+0000 7f5c82000700 1 -- 172.21.15.159:0/3086488390 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5c78010790 con 0x7f5c841084b0 2024-02-28T22:54:54.980 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.186+0000 7f5c8a800700 1 -- 172.21.15.159:0/3086488390 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c841073e0 con 0x7f5c6c038370 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.188+0000 7f5c82000700 1 -- 172.21.15.159:0/3086488390 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f5c841073e0 con 0x7f5c6c038370 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.191+0000 7f5c8a800700 1 -- 172.21.15.159:0/3086488390 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f5c6c038370 msgr2=0x7f5c6c03a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.191+0000 7f5c8a800700 1 --2- 172.21.15.159:0/3086488390 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f5c6c038370 0x7f5c6c03a830 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5c70006fd0 tx=0x7f5c70006e40 comp rx=0 tx=0).stop 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.191+0000 7f5c8a800700 1 -- 172.21.15.159:0/3086488390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 msgr2=0x7f5c8419c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.191+0000 7f5c8a800700 1 --2- 172.21.15.159:0/3086488390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c8419c1a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f5c78003de0 tx=0x7f5c78011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.192+0000 7f5c8a800700 1 -- 172.21.15.159:0/3086488390 shutdown_connections 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.192+0000 7f5c8a800700 1 --2- 172.21.15.159:0/3086488390 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f5c6c038370 0x7f5c6c03a830 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.192+0000 7f5c8a800700 1 --2- 172.21.15.159:0/3086488390 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c841084b0 0x7f5c8419c1a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.192+0000 7f5c8a800700 1 -- 172.21.15.159:0/3086488390 >> 172.21.15.159:0/3086488390 conn(0x7f5c8407b8b0 msgr2=0x7f5c841067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.192+0000 7f5c8a800700 1 -- 172.21.15.159:0/3086488390 shutdown_connections 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:54.192+0000 7f5c8a800700 1 -- 172.21.15.159:0/3086488390 wait complete. 2024-02-28T22:54:54.981 INFO:teuthology.orchestra.run.smithi159.stdout:Generating ssh key... 2024-02-28T22:54:55.189 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:55 smithi159 ceph-mon[28802]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:54:56.750 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.621+0000 7fcbdae00700 1 Processor -- start 2024-02-28T22:54:56.750 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.621+0000 7fcbdae00700 1 -- start start 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.622+0000 7fcbdae00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd4079200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.622+0000 7fcbdae00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd40797d0 con 0x7fcbd407ada0 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.622+0000 7fcbd3e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd4079200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.622+0000 7fcbd3e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd4079200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54748/0 (socket says 172.21.15.159:54748) 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.622+0000 7fcbd3e00700 1 -- 172.21.15.159:0/887065264 learned_addr learned my addr 172.21.15.159:0/887065264 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.622+0000 7fcbd3e00700 1 -- 172.21.15.159:0/887065264 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4079910 con 0x7fcbd407ada0 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.623+0000 7fcbd3e00700 1 --2- 172.21.15.159:0/887065264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd4079200 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40098a0 tx=0x7fcbc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b729e8df646d9a1 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.623+0000 7fcbd2a00700 1 -- 172.21.15.159:0/887065264 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbc4004180 con 0x7fcbd407ada0 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.623+0000 7fcbd2a00700 1 -- 172.21.15.159:0/887065264 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcbc40042e0 con 0x7fcbd407ada0 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.623+0000 7fcbd2a00700 1 -- 172.21.15.159:0/887065264 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbc4011a50 con 0x7fcbd407ada0 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.624+0000 7fcbdae00700 1 -- 172.21.15.159:0/887065264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 msgr2=0x7fcbd4079200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.624+0000 7fcbdae00700 1 --2- 172.21.15.159:0/887065264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd4079200 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcbc40098a0 tx=0x7fcbc4009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.624+0000 7fcbdae00700 1 -- 172.21.15.159:0/887065264 shutdown_connections 2024-02-28T22:54:56.751 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.624+0000 7fcbdae00700 1 --2- 172.21.15.159:0/887065264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd4079200 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.624+0000 7fcbdae00700 1 -- 172.21.15.159:0/887065264 >> 172.21.15.159:0/887065264 conn(0x7fcbd41019b0 msgr2=0x7fcbd4103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.624+0000 7fcbdae00700 1 -- 172.21.15.159:0/887065264 shutdown_connections 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.624+0000 7fcbdae00700 1 -- 172.21.15.159:0/887065264 wait complete. 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.625+0000 7fcbdae00700 1 Processor -- start 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.625+0000 7fcbdae00700 1 -- start start 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.626+0000 7fcbdae00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd419c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.626+0000 7fcbdae00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd419c870 con 0x7fcbd407ada0 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.626+0000 7fcbd3e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd419c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.626+0000 7fcbd3e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd419c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54750/0 (socket says 172.21.15.159:54750) 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.626+0000 7fcbd3e00700 1 -- 172.21.15.159:0/169888037 learned_addr learned my addr 172.21.15.159:0/169888037 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.626+0000 7fcbd3e00700 1 -- 172.21.15.159:0/169888037 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc4009550 con 0x7fcbd407ada0 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.627+0000 7fcbd3e00700 1 --2- 172.21.15.159:0/169888037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd419c330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4003de0 tx=0x7fcbc4011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:56.752 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.627+0000 7fcbd0c00700 1 -- 172.21.15.159:0/169888037 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbc4003930 con 0x7fcbd407ada0 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.627+0000 7fcbd0c00700 1 -- 172.21.15.159:0/169888037 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fcbc4003a90 con 0x7fcbd407ada0 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.627+0000 7fcbd0c00700 1 -- 172.21.15.159:0/169888037 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbc40196c0 con 0x7fcbd407ada0 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.627+0000 7fcbdae00700 1 -- 172.21.15.159:0/169888037 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd419ca70 con 0x7fcbd407ada0 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.627+0000 7fcbdae00700 1 -- 172.21.15.159:0/169888037 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd419cf10 con 0x7fcbd407ada0 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.628+0000 7fcbd0c00700 1 -- 172.21.15.159:0/169888037 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fcbc401abc0 con 0x7fcbd407ada0 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.629+0000 7fcbdae00700 1 -- 172.21.15.159:0/169888037 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd410c790 con 0x7fcbd407ada0 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.629+0000 7fcbd0c00700 1 --2- 172.21.15.159:0/169888037 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fcbb8038370 0x7fcbb803a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.629+0000 7fcbd0c00700 1 -- 172.21.15.159:0/169888037 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fcbc404c4a0 con 0x7fcbd407ada0 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.629+0000 7fcbd3400700 1 --2- 172.21.15.159:0/169888037 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fcbb8038370 0x7fcbb803a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.630+0000 7fcbd3400700 1 --2- 172.21.15.159:0/169888037 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fcbb8038370 0x7fcbb803a830 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0006fd0 tx=0x7fcbc0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.634+0000 7fcbd0c00700 1 -- 172.21.15.159:0/169888037 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcbc401a430 con 0x7fcbd407ada0 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:55.848+0000 7fcbdae00700 1 -- 172.21.15.159:0/169888037 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbd4103d20 con 0x7fcbb8038370 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:56.069+0000 7fcbd0c00700 1 -- 172.21.15.159:0/169888037 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcbd4103d20 con 0x7fcbb8038370 2024-02-28T22:54:56.753 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:56.072+0000 7fcbdae00700 1 -- 172.21.15.159:0/169888037 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fcbb8038370 msgr2=0x7fcbb803a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:56.754 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:56.072+0000 7fcbdae00700 1 --2- 172.21.15.159:0/169888037 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fcbb8038370 0x7fcbb803a830 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fcbc0006fd0 tx=0x7fcbc0006e40 comp rx=0 tx=0).stop 2024-02-28T22:54:56.754 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:56.072+0000 7fcbdae00700 1 -- 172.21.15.159:0/169888037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 msgr2=0x7fcbd419c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:56.754 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:56.072+0000 7fcbdae00700 1 --2- 172.21.15.159:0/169888037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd419c330 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4003de0 tx=0x7fcbc4011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:56.754 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:56.072+0000 7fcbdae00700 1 -- 172.21.15.159:0/169888037 shutdown_connections 2024-02-28T22:54:56.754 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:56.072+0000 7fcbdae00700 1 --2- 172.21.15.159:0/169888037 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fcbb8038370 0x7fcbb803a830 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:56.754 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:56.072+0000 7fcbdae00700 1 --2- 172.21.15.159:0/169888037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbd407ada0 0x7fcbd419c330 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:56.754 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:56.072+0000 7fcbdae00700 1 -- 172.21.15.159:0/169888037 >> 172.21.15.159:0/169888037 conn(0x7fcbd41019b0 msgr2=0x7fcbd4103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:56.754 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:56.073+0000 7fcbdae00700 1 -- 172.21.15.159:0/169888037 shutdown_connections 2024-02-28T22:54:56.754 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:56.073+0000 7fcbdae00700 1 -- 172.21.15.159:0/169888037 wait complete. 2024-02-28T22:54:57.302 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:57 smithi159 ceph-mon[28802]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:54:57.302 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:57 smithi159 ceph-mon[28802]: Generating ssh key... 2024-02-28T22:54:57.302 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:57 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:54:57.302 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:57 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:54:58.223 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzrYe7N805mt9YObUnp2VhU1klm0MJmPyI9xpNuHHoTIXypPXcjzu7GxL0rgNVjmLCk1i7PY75v/or8yOPVGLmcL2OOmzbQSAqqI/wwefh8UxI9UwMIXQFoetW39oZ2AXSoHcaBYHSP+ifsQx9TAvgLfl+4o0iLLCuZfv9vkDWF2JdYlfhBr2gNUPR/JbdhhEQS+vA+ut+ee3Jsue72yBk/Gv34/5atsdBPx+vcNJlOn6voIZKMzbk6/LIPgn3zp6ZI9Mhvo2MlGtj0qZ35j2ljqmP+FVz0WOlO7JmREtin94Ox4lscCOhGYiBUtVZx8oGRMeLcajtLBTy8eCRHD1FNwMKmcAvctjPXmKLYoFs65JXjiLA3oneQ6jyAMfeDOuupKVdWr+ZVSavkmBFpnZXeKSxYXwkQ6mXPNCSMzPzBvZTJZ16x+Qn+wNDO7PbAeD8cJyOUStU3QY5qyukb6odfFOkOhbguKJH4bYXafd4hAhsgxdykTllj1+7Q0sQDms= ceph-24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:54:58.223 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.303+0000 7f9ac1600700 1 Processor -- start 2024-02-28T22:54:58.223 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.303+0000 7f9ac1600700 1 -- start start 2024-02-28T22:54:58.223 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.303+0000 7f9ac1600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc108a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:58.223 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.303+0000 7f9ac1600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc109020 con 0x7f9abc108630 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.304+0000 7f9abaa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc108a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.304+0000 7f9abaa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc108a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54766/0 (socket says 172.21.15.159:54766) 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.304+0000 7f9abaa00700 1 -- 172.21.15.159:0/3214993867 learned_addr learned my addr 172.21.15.159:0/3214993867 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.305+0000 7f9abaa00700 1 -- 172.21.15.159:0/3214993867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc109830 con 0x7f9abc108630 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.305+0000 7f9abaa00700 1 --2- 172.21.15.159:0/3214993867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc108a50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0098a0 tx=0x7f9aac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc154661812daeec server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.305+0000 7f9ab9600700 1 -- 172.21.15.159:0/3214993867 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9aac004180 con 0x7f9abc108630 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.305+0000 7f9ab9600700 1 -- 172.21.15.159:0/3214993867 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9aac0042e0 con 0x7f9abc108630 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.305+0000 7f9ab9600700 1 -- 172.21.15.159:0/3214993867 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9aac011a50 con 0x7f9abc108630 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.306+0000 7f9ac1600700 1 -- 172.21.15.159:0/3214993867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 msgr2=0x7f9abc108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.306+0000 7f9ac1600700 1 --2- 172.21.15.159:0/3214993867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc108a50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0098a0 tx=0x7f9aac009bb0 comp rx=0 tx=0).stop 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.306+0000 7f9ac1600700 1 -- 172.21.15.159:0/3214993867 shutdown_connections 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.306+0000 7f9ac1600700 1 --2- 172.21.15.159:0/3214993867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc108a50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:58.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.306+0000 7f9ac1600700 1 -- 172.21.15.159:0/3214993867 >> 172.21.15.159:0/3214993867 conn(0x7f9abc103c10 msgr2=0x7f9abc106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.306+0000 7f9ac1600700 1 -- 172.21.15.159:0/3214993867 shutdown_connections 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.306+0000 7f9ac1600700 1 -- 172.21.15.159:0/3214993867 wait complete. 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.307+0000 7f9ac1600700 1 Processor -- start 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.307+0000 7f9ac1600700 1 -- start start 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.308+0000 7f9ac1600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc19c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.308+0000 7f9ac1600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9abc19c8b0 con 0x7f9abc108630 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.308+0000 7f9abaa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc19c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.308+0000 7f9abaa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc19c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54768/0 (socket says 172.21.15.159:54768) 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.308+0000 7f9abaa00700 1 -- 172.21.15.159:0/849353343 learned_addr learned my addr 172.21.15.159:0/849353343 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.308+0000 7f9abaa00700 1 -- 172.21.15.159:0/849353343 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac009550 con 0x7f9abc108630 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.308+0000 7f9abaa00700 1 --2- 172.21.15.159:0/849353343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc19c370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9aac003de0 tx=0x7f9aac011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.309+0000 7f9ab3400700 1 -- 172.21.15.159:0/849353343 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9aac003930 con 0x7f9abc108630 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.309+0000 7f9ab3400700 1 -- 172.21.15.159:0/849353343 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7f9aac003a90 con 0x7f9abc108630 2024-02-28T22:54:58.225 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.309+0000 7f9ab3400700 1 -- 172.21.15.159:0/849353343 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9aac0196c0 con 0x7f9abc108630 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.309+0000 7f9ac1600700 1 -- 172.21.15.159:0/849353343 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9abc19cab0 con 0x7f9abc108630 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.309+0000 7f9ac1600700 1 -- 172.21.15.159:0/849353343 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9abc19cf50 con 0x7f9abc108630 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.310+0000 7f9ab3400700 1 -- 172.21.15.159:0/849353343 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f9aac01abc0 con 0x7f9abc108630 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.310+0000 7f9ac1600700 1 -- 172.21.15.159:0/849353343 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9abc0623c0 con 0x7f9abc108630 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.310+0000 7f9ab3400700 1 --2- 172.21.15.159:0/849353343 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f9aa00383c0 0x7f9aa003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.310+0000 7f9ab3400700 1 -- 172.21.15.159:0/849353343 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9aac04c4a0 con 0x7f9abc108630 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.311+0000 7f9aba000700 1 --2- 172.21.15.159:0/849353343 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f9aa00383c0 0x7f9aa003a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.311+0000 7f9aba000700 1 --2- 172.21.15.159:0/849353343 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f9aa00383c0 0x7f9aa003a880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8006fd0 tx=0x7f9aa8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.315+0000 7f9ab3400700 1 -- 172.21.15.159:0/849353343 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9aac019930 con 0x7f9abc108630 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.527+0000 7f9ac1600700 1 -- 172.21.15.159:0/849353343 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f9abc105f40 con 0x7f9aa00383c0 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.529+0000 7f9ab3400700 1 -- 172.21.15.159:0/849353343 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f9abc105f40 con 0x7f9aa00383c0 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.532+0000 7f9ac1600700 1 -- 172.21.15.159:0/849353343 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f9aa00383c0 msgr2=0x7f9aa003a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:58.226 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.532+0000 7f9ac1600700 1 --2- 172.21.15.159:0/849353343 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f9aa00383c0 0x7f9aa003a880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9aa8006fd0 tx=0x7f9aa8006e40 comp rx=0 tx=0).stop 2024-02-28T22:54:58.227 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.532+0000 7f9ac1600700 1 -- 172.21.15.159:0/849353343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 msgr2=0x7f9abc19c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:54:58.227 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.532+0000 7f9ac1600700 1 --2- 172.21.15.159:0/849353343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc19c370 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9aac003de0 tx=0x7f9aac011ab0 comp rx=0 tx=0).stop 2024-02-28T22:54:58.227 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.532+0000 7f9ac1600700 1 -- 172.21.15.159:0/849353343 shutdown_connections 2024-02-28T22:54:58.227 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.532+0000 7f9ac1600700 1 --2- 172.21.15.159:0/849353343 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f9aa00383c0 0x7f9aa003a880 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:58.227 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.532+0000 7f9ac1600700 1 --2- 172.21.15.159:0/849353343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9abc108630 0x7f9abc19c370 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:54:58.227 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.532+0000 7f9ac1600700 1 -- 172.21.15.159:0/849353343 >> 172.21.15.159:0/849353343 conn(0x7f9abc103c10 msgr2=0x7f9abc105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:54:58.227 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.532+0000 7f9ac1600700 1 -- 172.21.15.159:0/849353343 shutdown_connections 2024-02-28T22:54:58.227 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:57.532+0000 7f9ac1600700 1 -- 172.21.15.159:0/849353343 wait complete. 2024-02-28T22:54:58.227 INFO:teuthology.orchestra.run.smithi159.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-02-28T22:54:58.227 INFO:teuthology.orchestra.run.smithi159.stdout:Adding key to root@localhost authorized_keys... 2024-02-28T22:54:58.228 INFO:teuthology.orchestra.run.smithi159.stdout:Adding host smithi159... 2024-02-28T22:54:59.327 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:54:59 smithi159 ceph-mon[28802]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:00.452 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:00 smithi159 ceph-mon[28802]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi159", "addr": "172.21.15.159", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:01.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:01 smithi159 ceph-mon[28802]: Deploying cephadm binary to smithi159 2024-02-28T22:55:04.391 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Added host 'smithi159' with addr '172.21.15.159' 2024-02-28T22:55:04.391 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.812+0000 7fd6b4e00700 1 Processor -- start 2024-02-28T22:55:04.391 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.812+0000 7fd6b4e00700 1 -- start start 2024-02-28T22:55:04.391 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.812+0000 7fd6b4e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b0108890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:04.391 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.813+0000 7fd6b4e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b0108e60 con 0x7fd6b0108470 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.813+0000 7fd6af400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b0108890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.813+0000 7fd6af400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b0108890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59678/0 (socket says 172.21.15.159:59678) 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.813+0000 7fd6af400700 1 -- 172.21.15.159:0/1607057550 learned_addr learned my addr 172.21.15.159:0/1607057550 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.813+0000 7fd6af400700 1 -- 172.21.15.159:0/1607057550 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b0109670 con 0x7fd6b0108470 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.814+0000 7fd6af400700 1 --2- 172.21.15.159:0/1607057550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b0108890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00098a0 tx=0x7fd6a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a2e98b8a9a3a9e server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.814+0000 7fd6ae000700 1 -- 172.21.15.159:0/1607057550 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6a0004180 con 0x7fd6b0108470 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.814+0000 7fd6ae000700 1 -- 172.21.15.159:0/1607057550 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd6a00042e0 con 0x7fd6b0108470 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.814+0000 7fd6ae000700 1 -- 172.21.15.159:0/1607057550 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6a0011a50 con 0x7fd6b0108470 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.815+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1607057550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 msgr2=0x7fd6b0108890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.815+0000 7fd6b4e00700 1 --2- 172.21.15.159:0/1607057550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b0108890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd6a00098a0 tx=0x7fd6a0009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.815+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1607057550 shutdown_connections 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.815+0000 7fd6b4e00700 1 --2- 172.21.15.159:0/1607057550 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b0108890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:04.392 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.815+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1607057550 >> 172.21.15.159:0/1607057550 conn(0x7fd6b007b850 msgr2=0x7fd6b01064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.815+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1607057550 shutdown_connections 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.815+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1607057550 wait complete. 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.816+0000 7fd6b4e00700 1 Processor -- start 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.816+0000 7fd6b4e00700 1 -- start start 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.817+0000 7fd6b4e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b019c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.817+0000 7fd6b4e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b019c6d0 con 0x7fd6b0108470 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.817+0000 7fd6af400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b019c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.817+0000 7fd6af400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b019c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59686/0 (socket says 172.21.15.159:59686) 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.817+0000 7fd6af400700 1 -- 172.21.15.159:0/1212197545 learned_addr learned my addr 172.21.15.159:0/1212197545 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.817+0000 7fd6af400700 1 -- 172.21.15.159:0/1212197545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a0009550 con 0x7fd6b0108470 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.817+0000 7fd6af400700 1 --2- 172.21.15.159:0/1212197545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b019c190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0003de0 tx=0x7fd6a0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.818+0000 7fd6a7e00700 1 -- 172.21.15.159:0/1212197545 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6a0003930 con 0x7fd6b0108470 2024-02-28T22:55:04.393 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.818+0000 7fd6a7e00700 1 -- 172.21.15.159:0/1212197545 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fd6a0003a90 con 0x7fd6b0108470 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.818+0000 7fd6a7e00700 1 -- 172.21.15.159:0/1212197545 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd6a00196c0 con 0x7fd6b0108470 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.818+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1212197545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b019c8d0 con 0x7fd6b0108470 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.818+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1212197545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b019cd70 con 0x7fd6b0108470 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.819+0000 7fd6a7e00700 1 -- 172.21.15.159:0/1212197545 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fd6a001abc0 con 0x7fd6b0108470 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.819+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1212197545 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b00623c0 con 0x7fd6b0108470 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.820+0000 7fd6a7e00700 1 --2- 172.21.15.159:0/1212197545 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fd694038370 0x7fd69403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.820+0000 7fd6a7e00700 1 -- 172.21.15.159:0/1212197545 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fd6a004c3e0 con 0x7fd6b0108470 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.820+0000 7fd6aea00700 1 --2- 172.21.15.159:0/1212197545 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fd694038370 0x7fd69403a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.821+0000 7fd6aea00700 1 --2- 172.21.15.159:0/1212197545 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fd694038370 0x7fd69403a830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd69c006fd0 tx=0x7fd69c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:58.825+0000 7fd6a7e00700 1 -- 172.21.15.159:0/1212197545 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd6a0010770 con 0x7fd6b0108470 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:54:59.044+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1212197545 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi159", "addr": "172.21.15.159", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6b01073c0 con 0x7fd694038370 2024-02-28T22:55:04.394 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:03.696+0000 7fd6a7e00700 1 -- 172.21.15.159:0/1212197545 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fd6b01073c0 con 0x7fd694038370 2024-02-28T22:55:04.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:03.700+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1212197545 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fd694038370 msgr2=0x7fd69403a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:04.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:03.700+0000 7fd6b4e00700 1 --2- 172.21.15.159:0/1212197545 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fd694038370 0x7fd69403a830 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd69c006fd0 tx=0x7fd69c006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:04.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:03.700+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1212197545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 msgr2=0x7fd6b019c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:04.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:03.700+0000 7fd6b4e00700 1 --2- 172.21.15.159:0/1212197545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b019c190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0003de0 tx=0x7fd6a0011ab0 comp rx=0 tx=0).stop 2024-02-28T22:55:04.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:03.701+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1212197545 shutdown_connections 2024-02-28T22:55:04.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:03.701+0000 7fd6b4e00700 1 --2- 172.21.15.159:0/1212197545 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fd694038370 0x7fd69403a830 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:04.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:03.701+0000 7fd6b4e00700 1 --2- 172.21.15.159:0/1212197545 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b0108470 0x7fd6b019c190 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:04.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:03.701+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1212197545 >> 172.21.15.159:0/1212197545 conn(0x7fd6b007b850 msgr2=0x7fd6b01067a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:04.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:03.701+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1212197545 shutdown_connections 2024-02-28T22:55:04.395 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:03.701+0000 7fd6b4e00700 1 -- 172.21.15.159:0/1212197545 wait complete. 2024-02-28T22:55:04.395 INFO:teuthology.orchestra.run.smithi159.stdout:Deploying mon service with default placement... 2024-02-28T22:55:04.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:04 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:04.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:04 smithi159 ceph-mon[28802]: Added host smithi159 2024-02-28T22:55:04.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:04 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:55:06.221 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-02-28T22:55:06.223 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.250+0000 7fa7adc00700 1 Processor -- start 2024-02-28T22:55:06.223 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.250+0000 7fa7adc00700 1 -- start start 2024-02-28T22:55:06.223 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.251+0000 7fa7adc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a8106850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:06.223 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.251+0000 7fa7adc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a8106e20 con 0x7fa7a8106430 2024-02-28T22:55:06.223 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.251+0000 7fa7a6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a8106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:06.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.251+0000 7fa7a6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a8106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59698/0 (socket says 172.21.15.159:59698) 2024-02-28T22:55:06.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.251+0000 7fa7a6a00700 1 -- 172.21.15.159:0/908788833 learned_addr learned my addr 172.21.15.159:0/908788833 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:06.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.252+0000 7fa7a6a00700 1 -- 172.21.15.159:0/908788833 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a8107630 con 0x7fa7a8106430 2024-02-28T22:55:06.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.252+0000 7fa7a6a00700 1 --2- 172.21.15.159:0/908788833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a8106850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7980098a0 tx=0x7fa798009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a97331b8ede4290 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:06.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.253+0000 7fa7a5600700 1 -- 172.21.15.159:0/908788833 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa798004180 con 0x7fa7a8106430 2024-02-28T22:55:06.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.253+0000 7fa7a5600700 1 -- 172.21.15.159:0/908788833 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa7980042e0 con 0x7fa7a8106430 2024-02-28T22:55:06.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.253+0000 7fa7a5600700 1 -- 172.21.15.159:0/908788833 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa798011a50 con 0x7fa7a8106430 2024-02-28T22:55:06.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.253+0000 7fa7adc00700 1 -- 172.21.15.159:0/908788833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 msgr2=0x7fa7a8106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:06.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.253+0000 7fa7adc00700 1 --2- 172.21.15.159:0/908788833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a8106850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa7980098a0 tx=0x7fa798009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:06.224 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.254+0000 7fa7adc00700 1 -- 172.21.15.159:0/908788833 shutdown_connections 2024-02-28T22:55:06.228 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.254+0000 7fa7adc00700 1 --2- 172.21.15.159:0/908788833 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a8106850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:06.228 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.254+0000 7fa7adc00700 1 -- 172.21.15.159:0/908788833 >> 172.21.15.159:0/908788833 conn(0x7fa7a81019b0 msgr2=0x7fa7a8103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.254+0000 7fa7adc00700 1 -- 172.21.15.159:0/908788833 shutdown_connections 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.254+0000 7fa7adc00700 1 -- 172.21.15.159:0/908788833 wait complete. 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.255+0000 7fa7adc00700 1 Processor -- start 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.255+0000 7fa7adc00700 1 -- start start 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.255+0000 7fa7adc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a819c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.255+0000 7fa7adc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a819c880 con 0x7fa7a8106430 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.256+0000 7fa7a6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a819c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.256+0000 7fa7a6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a819c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59712/0 (socket says 172.21.15.159:59712) 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.256+0000 7fa7a6a00700 1 -- 172.21.15.159:0/2599760728 learned_addr learned my addr 172.21.15.159:0/2599760728 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.256+0000 7fa7a6a00700 1 -- 172.21.15.159:0/2599760728 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa798009550 con 0x7fa7a8106430 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.256+0000 7fa7a6a00700 1 --2- 172.21.15.159:0/2599760728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a819c340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa798003de0 tx=0x7fa798011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.256+0000 7fa79f400700 1 -- 172.21.15.159:0/2599760728 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa798003930 con 0x7fa7a8106430 2024-02-28T22:55:06.229 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.257+0000 7fa7adc00700 1 -- 172.21.15.159:0/2599760728 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7a819ca80 con 0x7fa7a8106430 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.257+0000 7fa79f400700 1 -- 172.21.15.159:0/2599760728 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1037+0+0 (secure 0 0 0) 0x7fa798003a90 con 0x7fa7a8106430 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.257+0000 7fa79f400700 1 -- 172.21.15.159:0/2599760728 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa7980196c0 con 0x7fa7a8106430 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.257+0000 7fa7adc00700 1 -- 172.21.15.159:0/2599760728 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7a819cf20 con 0x7fa7a8106430 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.258+0000 7fa79f400700 1 -- 172.21.15.159:0/2599760728 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fa798019930 con 0x7fa7a8106430 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.258+0000 7fa7adc00700 1 -- 172.21.15.159:0/2599760728 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7a80623c0 con 0x7fa7a8106430 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.258+0000 7fa79f400700 1 --2- 172.21.15.159:0/2599760728 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa78c038370 0x7fa78c03a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.258+0000 7fa79f400700 1 -- 172.21.15.159:0/2599760728 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa79804c4d0 con 0x7fa7a8106430 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.259+0000 7fa7a6000700 1 --2- 172.21.15.159:0/2599760728 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa78c038370 0x7fa78c03a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.259+0000 7fa7a6000700 1 --2- 172.21.15.159:0/2599760728 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa78c038370 0x7fa78c03a830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa794006fd0 tx=0x7fa794006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.264+0000 7fa79f400700 1 -- 172.21.15.159:0/2599760728 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa798010de0 con 0x7fa7a8106430 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.496+0000 7fa7adc00700 1 -- 172.21.15.159:0/2599760728 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fa7a8103cc0 con 0x7fa78c038370 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.506+0000 7fa79f400700 1 -- 172.21.15.159:0/2599760728 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fa7a8103cc0 con 0x7fa78c038370 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.509+0000 7fa7adc00700 1 -- 172.21.15.159:0/2599760728 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa78c038370 msgr2=0x7fa78c03a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:06.230 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.509+0000 7fa7adc00700 1 --2- 172.21.15.159:0/2599760728 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa78c038370 0x7fa78c03a830 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa794006fd0 tx=0x7fa794006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:06.231 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.509+0000 7fa7adc00700 1 -- 172.21.15.159:0/2599760728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 msgr2=0x7fa7a819c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:06.231 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.509+0000 7fa7adc00700 1 --2- 172.21.15.159:0/2599760728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a819c340 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa798003de0 tx=0x7fa798011ab0 comp rx=0 tx=0).stop 2024-02-28T22:55:06.231 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.509+0000 7fa7adc00700 1 -- 172.21.15.159:0/2599760728 shutdown_connections 2024-02-28T22:55:06.231 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.509+0000 7fa7adc00700 1 --2- 172.21.15.159:0/2599760728 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fa78c038370 0x7fa78c03a830 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:06.231 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.509+0000 7fa7adc00700 1 --2- 172.21.15.159:0/2599760728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa7a8106430 0x7fa7a819c340 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:06.231 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.509+0000 7fa7adc00700 1 -- 172.21.15.159:0/2599760728 >> 172.21.15.159:0/2599760728 conn(0x7fa7a81019b0 msgr2=0x7fa7a8103060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:06.231 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.509+0000 7fa7adc00700 1 -- 172.21.15.159:0/2599760728 shutdown_connections 2024-02-28T22:55:06.231 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:05.510+0000 7fa7adc00700 1 -- 172.21.15.159:0/2599760728 wait complete. 2024-02-28T22:55:06.231 INFO:teuthology.orchestra.run.smithi159.stdout:Deploying mgr service with default placement... 2024-02-28T22:55:06.719 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:06 smithi159 ceph-mon[28802]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:06.720 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:06 smithi159 ceph-mon[28802]: Saving service mon spec with placement count:5 2024-02-28T22:55:06.720 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:06 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:07.907 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:07 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:07.907 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:07 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:07.907 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:07 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:08.184 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.274+0000 7f3a7e600700 1 Processor -- start 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.274+0000 7f3a7e600700 1 -- start start 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.275+0000 7f3a7e600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a78105760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.275+0000 7f3a7e600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78105d30 con 0x7f3a78105340 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.275+0000 7f3a77400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a78105760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.275+0000 7f3a77400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a78105760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59728/0 (socket says 172.21.15.159:59728) 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.275+0000 7f3a77400700 1 -- 172.21.15.159:0/960158580 learned_addr learned my addr 172.21.15.159:0/960158580 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.276+0000 7f3a77400700 1 -- 172.21.15.159:0/960158580 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78106540 con 0x7f3a78105340 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.276+0000 7f3a77400700 1 --2- 172.21.15.159:0/960158580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a78105760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a680098a0 tx=0x7f3a68009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60db97005dc05198 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.276+0000 7f3a76000700 1 -- 172.21.15.159:0/960158580 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a68004180 con 0x7f3a78105340 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.276+0000 7f3a76000700 1 -- 172.21.15.159:0/960158580 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3a680042e0 con 0x7f3a78105340 2024-02-28T22:55:08.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.276+0000 7f3a76000700 1 -- 172.21.15.159:0/960158580 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a68011af0 con 0x7f3a78105340 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.277+0000 7f3a7e600700 1 -- 172.21.15.159:0/960158580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 msgr2=0x7f3a78105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.277+0000 7f3a7e600700 1 --2- 172.21.15.159:0/960158580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a78105760 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3a680098a0 tx=0x7f3a68009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.277+0000 7f3a7e600700 1 -- 172.21.15.159:0/960158580 shutdown_connections 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.277+0000 7f3a7e600700 1 --2- 172.21.15.159:0/960158580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a78105760 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.277+0000 7f3a7e600700 1 -- 172.21.15.159:0/960158580 >> 172.21.15.159:0/960158580 conn(0x7f3a781008c0 msgr2=0x7f3a78102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.277+0000 7f3a7e600700 1 -- 172.21.15.159:0/960158580 shutdown_connections 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.277+0000 7f3a7e600700 1 -- 172.21.15.159:0/960158580 wait complete. 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.278+0000 7f3a7e600700 1 Processor -- start 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.279+0000 7f3a7e600700 1 -- start start 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.279+0000 7f3a7e600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a7819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.279+0000 7f3a7e600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a7819a6e0 con 0x7f3a78105340 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.279+0000 7f3a77400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a7819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:08.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.279+0000 7f3a77400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a7819a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59734/0 (socket says 172.21.15.159:59734) 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.279+0000 7f3a77400700 1 -- 172.21.15.159:0/808219217 learned_addr learned my addr 172.21.15.159:0/808219217 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.280+0000 7f3a77400700 1 -- 172.21.15.159:0/808219217 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a68009550 con 0x7f3a78105340 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.280+0000 7f3a77400700 1 --2- 172.21.15.159:0/808219217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a7819a1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a68011670 tx=0x7f3a68011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.280+0000 7f3a6fe00700 1 -- 172.21.15.159:0/808219217 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a680039c0 con 0x7f3a78105340 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.280+0000 7f3a6fe00700 1 -- 172.21.15.159:0/808219217 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3a68003b20 con 0x7f3a78105340 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.280+0000 7f3a7e600700 1 -- 172.21.15.159:0/808219217 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7819a8e0 con 0x7f3a78105340 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.280+0000 7f3a6fe00700 1 -- 172.21.15.159:0/808219217 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3a680247f0 con 0x7f3a78105340 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.280+0000 7f3a7e600700 1 -- 172.21.15.159:0/808219217 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a7819acc0 con 0x7f3a78105340 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.281+0000 7f3a7e600700 1 -- 172.21.15.159:0/808219217 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a780623c0 con 0x7f3a78105340 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.282+0000 7f3a6fe00700 1 -- 172.21.15.159:0/808219217 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f3a6801ac70 con 0x7f3a78105340 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.283+0000 7f3a6fe00700 1 --2- 172.21.15.159:0/808219217 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3a5c0382e0 0x7f3a5c03a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.283+0000 7f3a6fe00700 1 -- 172.21.15.159:0/808219217 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3a6804c350 con 0x7f3a78105340 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.283+0000 7f3a76a00700 1 --2- 172.21.15.159:0/808219217 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3a5c0382e0 0x7f3a5c03a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:08.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.284+0000 7f3a76a00700 1 --2- 172.21.15.159:0/808219217 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3a5c0382e0 0x7f3a5c03a7a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a64006fd0 tx=0x7f3a64006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.291+0000 7f3a6fe00700 1 -- 172.21.15.159:0/808219217 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3a68018740 con 0x7f3a78105340 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.541+0000 7f3a7e600700 1 -- 172.21.15.159:0/808219217 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a78102b30 con 0x7f3a5c0382e0 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.547+0000 7f3a6fe00700 1 -- 172.21.15.159:0/808219217 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3a78102b30 con 0x7f3a5c0382e0 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.550+0000 7f3a7e600700 1 -- 172.21.15.159:0/808219217 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3a5c0382e0 msgr2=0x7f3a5c03a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.550+0000 7f3a7e600700 1 --2- 172.21.15.159:0/808219217 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3a5c0382e0 0x7f3a5c03a7a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a64006fd0 tx=0x7f3a64006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.550+0000 7f3a7e600700 1 -- 172.21.15.159:0/808219217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 msgr2=0x7f3a7819a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.550+0000 7f3a7e600700 1 --2- 172.21.15.159:0/808219217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a7819a1a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3a68011670 tx=0x7f3a68011aa0 comp rx=0 tx=0).stop 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.550+0000 7f3a7e600700 1 -- 172.21.15.159:0/808219217 shutdown_connections 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.550+0000 7f3a7e600700 1 --2- 172.21.15.159:0/808219217 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3a5c0382e0 0x7f3a5c03a7a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.550+0000 7f3a7e600700 1 --2- 172.21.15.159:0/808219217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3a78105340 0x7f3a7819a1a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.550+0000 7f3a7e600700 1 -- 172.21.15.159:0/808219217 >> 172.21.15.159:0/808219217 conn(0x7f3a781008c0 msgr2=0x7f3a78074050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.550+0000 7f3a7e600700 1 -- 172.21.15.159:0/808219217 shutdown_connections 2024-02-28T22:55:08.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:07.550+0000 7f3a7e600700 1 -- 172.21.15.159:0/808219217 wait complete. 2024-02-28T22:55:08.189 INFO:teuthology.orchestra.run.smithi159.stdout:Deploying crash service with default placement... 2024-02-28T22:55:09.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:09 smithi159 ceph-mon[28802]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:09.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:09 smithi159 ceph-mon[28802]: Saving service mgr spec with placement count:2 2024-02-28T22:55:09.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:09 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:10.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-02-28T22:55:10.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.795+0000 7efff0a00700 1 Processor -- start 2024-02-28T22:55:10.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.795+0000 7efff0a00700 1 -- start start 2024-02-28T22:55:10.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.795+0000 7efff0a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec105140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:10.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.795+0000 7efff0a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec074600 con 0x7effec104d20 2024-02-28T22:55:10.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.796+0000 7effe9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec105140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:10.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.796+0000 7effe9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec105140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55112/0 (socket says 172.21.15.159:55112) 2024-02-28T22:55:10.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.796+0000 7effe9e00700 1 -- 172.21.15.159:0/969374076 learned_addr learned my addr 172.21.15.159:0/969374076 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:10.185 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.796+0000 7effe9e00700 1 -- 172.21.15.159:0/969374076 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effec105680 con 0x7effec104d20 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.797+0000 7effe9e00700 1 --2- 172.21.15.159:0/969374076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec105140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effdc0098a0 tx=0x7effdc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0f5f359a2daa3d server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.797+0000 7effe8a00700 1 -- 172.21.15.159:0/969374076 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7effdc004180 con 0x7effec104d20 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.797+0000 7effe8a00700 1 -- 172.21.15.159:0/969374076 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7effdc0042e0 con 0x7effec104d20 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.797+0000 7effe8a00700 1 -- 172.21.15.159:0/969374076 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7effdc011af0 con 0x7effec104d20 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.798+0000 7efff0a00700 1 -- 172.21.15.159:0/969374076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 msgr2=0x7effec105140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.798+0000 7efff0a00700 1 --2- 172.21.15.159:0/969374076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec105140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7effdc0098a0 tx=0x7effdc009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.798+0000 7efff0a00700 1 -- 172.21.15.159:0/969374076 shutdown_connections 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.798+0000 7efff0a00700 1 --2- 172.21.15.159:0/969374076 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec105140 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.798+0000 7efff0a00700 1 -- 172.21.15.159:0/969374076 >> 172.21.15.159:0/969374076 conn(0x7effec1008c0 msgr2=0x7effec102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.798+0000 7efff0a00700 1 -- 172.21.15.159:0/969374076 shutdown_connections 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.799+0000 7efff0a00700 1 -- 172.21.15.159:0/969374076 wait complete. 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.800+0000 7efff0a00700 1 Processor -- start 2024-02-28T22:55:10.186 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.800+0000 7efff0a00700 1 -- start start 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.801+0000 7efff0a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec19c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.801+0000 7efff0a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effec19c870 con 0x7effec104d20 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.801+0000 7effe9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec19c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.801+0000 7effe9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec19c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55118/0 (socket says 172.21.15.159:55118) 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.801+0000 7effe9e00700 1 -- 172.21.15.159:0/3151302132 learned_addr learned my addr 172.21.15.159:0/3151302132 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.802+0000 7effe9e00700 1 -- 172.21.15.159:0/3151302132 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effdc009550 con 0x7effec104d20 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.802+0000 7effe9e00700 1 --2- 172.21.15.159:0/3151302132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec19c330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7effdc011670 tx=0x7effdc011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.802+0000 7effe2a00700 1 -- 172.21.15.159:0/3151302132 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7effdc003a40 con 0x7effec104d20 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.802+0000 7effe2a00700 1 -- 172.21.15.159:0/3151302132 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7effdc003ba0 con 0x7effec104d20 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.802+0000 7efff0a00700 1 -- 172.21.15.159:0/3151302132 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effec19ca70 con 0x7effec104d20 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.803+0000 7efff0a00700 1 -- 172.21.15.159:0/3151302132 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effec19cf10 con 0x7effec104d20 2024-02-28T22:55:10.187 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.803+0000 7effe2a00700 1 -- 172.21.15.159:0/3151302132 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7effdc024790 con 0x7effec104d20 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.804+0000 7efff0a00700 1 -- 172.21.15.159:0/3151302132 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effcc005320 con 0x7effec104d20 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.804+0000 7effe2a00700 1 -- 172.21.15.159:0/3151302132 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7effdc01a430 con 0x7effec104d20 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.804+0000 7effe2a00700 1 --2- 172.21.15.159:0/3151302132 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7effd0038370 0x7effd003a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.804+0000 7effe2a00700 1 -- 172.21.15.159:0/3151302132 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7effdc04c3f0 con 0x7effec104d20 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.805+0000 7effe9400700 1 --2- 172.21.15.159:0/3151302132 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7effd0038370 0x7effd003a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.805+0000 7effe9400700 1 --2- 172.21.15.159:0/3151302132 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7effd0038370 0x7effd003a830 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7effd8006fd0 tx=0x7effd8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:08.810+0000 7effe2a00700 1 -- 172.21.15.159:0/3151302132 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7effdc01ac50 con 0x7effec104d20 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.051+0000 7efff0a00700 1 -- 172.21.15.159:0/3151302132 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7effcc000bf0 con 0x7effd0038370 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.058+0000 7effe2a00700 1 -- 172.21.15.159:0/3151302132 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7effcc000bf0 con 0x7effd0038370 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.061+0000 7efff0a00700 1 -- 172.21.15.159:0/3151302132 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7effd0038370 msgr2=0x7effd003a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.061+0000 7efff0a00700 1 --2- 172.21.15.159:0/3151302132 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7effd0038370 0x7effd003a830 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7effd8006fd0 tx=0x7effd8006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.061+0000 7efff0a00700 1 -- 172.21.15.159:0/3151302132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 msgr2=0x7effec19c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:10.188 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.061+0000 7efff0a00700 1 --2- 172.21.15.159:0/3151302132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec19c330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7effdc011670 tx=0x7effdc011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:10.189 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.061+0000 7efff0a00700 1 -- 172.21.15.159:0/3151302132 shutdown_connections 2024-02-28T22:55:10.189 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.061+0000 7efff0a00700 1 --2- 172.21.15.159:0/3151302132 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7effd0038370 0x7effd003a830 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:10.189 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.061+0000 7efff0a00700 1 --2- 172.21.15.159:0/3151302132 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7effec104d20 0x7effec19c330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:10.189 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.061+0000 7efff0a00700 1 -- 172.21.15.159:0/3151302132 >> 172.21.15.159:0/3151302132 conn(0x7effec1008c0 msgr2=0x7effec1908e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:10.189 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.061+0000 7efff0a00700 1 -- 172.21.15.159:0/3151302132 shutdown_connections 2024-02-28T22:55:10.189 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:09.061+0000 7efff0a00700 1 -- 172.21.15.159:0/3151302132 wait complete. 2024-02-28T22:55:10.189 INFO:teuthology.orchestra.run.smithi159.stdout:Deploying ceph-exporter service with default placement... 2024-02-28T22:55:10.221 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:10 smithi159 ceph-mon[28802]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:10.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:10 smithi159 ceph-mon[28802]: Saving service crash spec with placement * 2024-02-28T22:55:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:11 smithi159 ceph-mon[28802]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:55:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:11 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:11 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:11.850 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-02-28T22:55:11.850 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.811+0000 7f1744600700 1 Processor -- start 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.811+0000 7f1744600700 1 -- start start 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.812+0000 7f1744600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c0791e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.812+0000 7f1744600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c0797b0 con 0x7f173c07ad80 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.813+0000 7f1741c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c0791e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.813+0000 7f1741c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c0791e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55134/0 (socket says 172.21.15.159:55134) 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.813+0000 7f1741c00700 1 -- 172.21.15.159:0/1006025201 learned_addr learned my addr 172.21.15.159:0/1006025201 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.813+0000 7f1741c00700 1 -- 172.21.15.159:0/1006025201 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c0798f0 con 0x7f173c07ad80 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.813+0000 7f1741c00700 1 --2- 172.21.15.159:0/1006025201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c0791e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17300098a0 tx=0x7f1730009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3767f35e35bdad3 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.814+0000 7f173be00700 1 -- 172.21.15.159:0/1006025201 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1730004180 con 0x7f173c07ad80 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.814+0000 7f173be00700 1 -- 172.21.15.159:0/1006025201 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17300042e0 con 0x7f173c07ad80 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.814+0000 7f173be00700 1 -- 172.21.15.159:0/1006025201 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1730011af0 con 0x7f173c07ad80 2024-02-28T22:55:11.851 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.815+0000 7f1744600700 1 -- 172.21.15.159:0/1006025201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 msgr2=0x7f173c0791e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.815+0000 7f1744600700 1 --2- 172.21.15.159:0/1006025201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c0791e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f17300098a0 tx=0x7f1730009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.815+0000 7f1744600700 1 -- 172.21.15.159:0/1006025201 shutdown_connections 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.815+0000 7f1744600700 1 --2- 172.21.15.159:0/1006025201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c0791e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.815+0000 7f1744600700 1 -- 172.21.15.159:0/1006025201 >> 172.21.15.159:0/1006025201 conn(0x7f173c1019b0 msgr2=0x7f173c103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.815+0000 7f1744600700 1 -- 172.21.15.159:0/1006025201 shutdown_connections 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.815+0000 7f1744600700 1 -- 172.21.15.159:0/1006025201 wait complete. 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.816+0000 7f1744600700 1 Processor -- start 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.816+0000 7f1744600700 1 -- start start 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.817+0000 7f1744600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c19c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.817+0000 7f1744600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173c19c860 con 0x7f173c07ad80 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.817+0000 7f1741c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c19c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.817+0000 7f1741c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c19c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55148/0 (socket says 172.21.15.159:55148) 2024-02-28T22:55:11.852 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.817+0000 7f1741c00700 1 -- 172.21.15.159:0/1226266900 learned_addr learned my addr 172.21.15.159:0/1226266900 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.817+0000 7f1741c00700 1 -- 172.21.15.159:0/1226266900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1730009550 con 0x7f173c07ad80 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.818+0000 7f1741c00700 1 --2- 172.21.15.159:0/1226266900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c19c320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1730011670 tx=0x7f1730011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.818+0000 7f173a000700 1 -- 172.21.15.159:0/1226266900 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1730003a40 con 0x7f173c07ad80 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.818+0000 7f173a000700 1 -- 172.21.15.159:0/1226266900 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1730003ba0 con 0x7f173c07ad80 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.818+0000 7f1744600700 1 -- 172.21.15.159:0/1226266900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f173c19ca60 con 0x7f173c07ad80 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.818+0000 7f173a000700 1 -- 172.21.15.159:0/1226266900 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1730024790 con 0x7f173c07ad80 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.818+0000 7f1744600700 1 -- 172.21.15.159:0/1226266900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f173c19cf00 con 0x7f173c07ad80 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.819+0000 7f173a000700 1 -- 172.21.15.159:0/1226266900 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f173002d3f0 con 0x7f173c07ad80 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.820+0000 7f172f400700 1 -- 172.21.15.159:0/1226266900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17180052f0 con 0x7f173c07ad80 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.820+0000 7f173a000700 1 --2- 172.21.15.159:0/1226266900 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1724038320 0x7f172403a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.820+0000 7f173a000700 1 -- 172.21.15.159:0/1226266900 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f173004c690 con 0x7f173c07ad80 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.820+0000 7f1741200700 1 --2- 172.21.15.159:0/1226266900 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1724038320 0x7f172403a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:11.853 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.821+0000 7f1741200700 1 --2- 172.21.15.159:0/1226266900 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1724038320 0x7f172403a7e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1728006fd0 tx=0x7f1728006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:10.825+0000 7f173a000700 1 -- 172.21.15.159:0/1226266900 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1730010c00 con 0x7f173c07ad80 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.118+0000 7f172f400700 1 -- 172.21.15.159:0/1226266900 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f1718000bc0 con 0x7f1724038320 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.124+0000 7f173a000700 1 -- 172.21.15.159:0/1226266900 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f1718000bc0 con 0x7f1724038320 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.126+0000 7f172f400700 1 -- 172.21.15.159:0/1226266900 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1724038320 msgr2=0x7f172403a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.126+0000 7f172f400700 1 --2- 172.21.15.159:0/1226266900 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1724038320 0x7f172403a7e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1728006fd0 tx=0x7f1728006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.127+0000 7f172f400700 1 -- 172.21.15.159:0/1226266900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 msgr2=0x7f173c19c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.127+0000 7f172f400700 1 --2- 172.21.15.159:0/1226266900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c19c320 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f1730011670 tx=0x7f1730011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.127+0000 7f172f400700 1 -- 172.21.15.159:0/1226266900 shutdown_connections 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.127+0000 7f172f400700 1 --2- 172.21.15.159:0/1226266900 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1724038320 0x7f172403a7e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.127+0000 7f172f400700 1 --2- 172.21.15.159:0/1226266900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f173c07ad80 0x7f173c19c320 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.127+0000 7f172f400700 1 -- 172.21.15.159:0/1226266900 >> 172.21.15.159:0/1226266900 conn(0x7f173c1019b0 msgr2=0x7f173c1030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.127+0000 7f172f400700 1 -- 172.21.15.159:0/1226266900 shutdown_connections 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:11.127+0000 7f172f400700 1 -- 172.21.15.159:0/1226266900 wait complete. 2024-02-28T22:55:11.854 INFO:teuthology.orchestra.run.smithi159.stdout:Deploying prometheus service with default placement... 2024-02-28T22:55:12.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:12 smithi159 ceph-mon[28802]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:12.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:12 smithi159 ceph-mon[28802]: Saving service ceph-exporter spec with placement * 2024-02-28T22:55:12.423 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:12 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:13.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:13 smithi159 ceph-mon[28802]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:55:13.692 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:13 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:14.508 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.423+0000 7f3edfe00700 1 Processor -- start 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.423+0000 7f3edfe00700 1 -- start start 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.424+0000 7f3edfe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed8079200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.424+0000 7f3edfe00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed80797d0 con 0x7f3ed807ada0 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.424+0000 7f3edd400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed8079200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.424+0000 7f3edd400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed8079200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55162/0 (socket says 172.21.15.159:55162) 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.424+0000 7f3edd400700 1 -- 172.21.15.159:0/621311309 learned_addr learned my addr 172.21.15.159:0/621311309 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.424+0000 7f3edd400700 1 -- 172.21.15.159:0/621311309 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8079910 con 0x7f3ed807ada0 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.425+0000 7f3edd400700 1 --2- 172.21.15.159:0/621311309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed8079200 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0098a0 tx=0x7f3ecc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aefd06840f87776 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.425+0000 7f3ed7e00700 1 -- 172.21.15.159:0/621311309 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ecc004180 con 0x7f3ed807ada0 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.425+0000 7f3ed7e00700 1 -- 172.21.15.159:0/621311309 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ecc0042e0 con 0x7f3ed807ada0 2024-02-28T22:55:14.509 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.425+0000 7f3ed7e00700 1 -- 172.21.15.159:0/621311309 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ecc011af0 con 0x7f3ed807ada0 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.426+0000 7f3edfe00700 1 -- 172.21.15.159:0/621311309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 msgr2=0x7f3ed8079200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.426+0000 7f3edfe00700 1 --2- 172.21.15.159:0/621311309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed8079200 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc0098a0 tx=0x7f3ecc009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.426+0000 7f3edfe00700 1 -- 172.21.15.159:0/621311309 shutdown_connections 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.426+0000 7f3edfe00700 1 --2- 172.21.15.159:0/621311309 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed8079200 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.426+0000 7f3edfe00700 1 -- 172.21.15.159:0/621311309 >> 172.21.15.159:0/621311309 conn(0x7f3ed81019b0 msgr2=0x7f3ed8103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.426+0000 7f3edfe00700 1 -- 172.21.15.159:0/621311309 shutdown_connections 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.426+0000 7f3edfe00700 1 -- 172.21.15.159:0/621311309 wait complete. 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.427+0000 7f3edfe00700 1 Processor -- start 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.427+0000 7f3edfe00700 1 -- start start 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.427+0000 7f3edfe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.427+0000 7f3edfe00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed819c8b0 con 0x7f3ed807ada0 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.428+0000 7f3edd400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.428+0000 7f3edd400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed819c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55176/0 (socket says 172.21.15.159:55176) 2024-02-28T22:55:14.510 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.428+0000 7f3edd400700 1 -- 172.21.15.159:0/519451253 learned_addr learned my addr 172.21.15.159:0/519451253 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.428+0000 7f3edd400700 1 -- 172.21.15.159:0/519451253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ecc009550 con 0x7f3ed807ada0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.428+0000 7f3edd400700 1 --2- 172.21.15.159:0/519451253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed819c370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc011670 tx=0x7f3ecc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.429+0000 7f3ed6000700 1 -- 172.21.15.159:0/519451253 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ecc0039c0 con 0x7f3ed807ada0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.429+0000 7f3ed6000700 1 -- 172.21.15.159:0/519451253 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3ecc003b20 con 0x7f3ed807ada0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.429+0000 7f3ed6000700 1 -- 172.21.15.159:0/519451253 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3ecc0247f0 con 0x7f3ed807ada0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.429+0000 7f3edfe00700 1 -- 172.21.15.159:0/519451253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed819cab0 con 0x7f3ed807ada0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.429+0000 7f3edfe00700 1 -- 172.21.15.159:0/519451253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed819cf50 con 0x7f3ed807ada0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.430+0000 7f3ed6000700 1 -- 172.21.15.159:0/519451253 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f3ecc01ac70 con 0x7f3ed807ada0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.430+0000 7f3edfe00700 1 -- 172.21.15.159:0/519451253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed810c7f0 con 0x7f3ed807ada0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.430+0000 7f3ed6000700 1 --2- 172.21.15.159:0/519451253 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3ec0038330 0x7f3ec003a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.430+0000 7f3ed6000700 1 -- 172.21.15.159:0/519451253 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f3ecc04c330 con 0x7f3ed807ada0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.431+0000 7f3edca00700 1 --2- 172.21.15.159:0/519451253 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3ec0038330 0x7f3ec003a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.431+0000 7f3edca00700 1 --2- 172.21.15.159:0/519451253 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3ec0038330 0x7f3ec003a7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4006fd0 tx=0x7f3ec4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:14.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.435+0000 7f3ed6000700 1 -- 172.21.15.159:0/519451253 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3ecc024a60 con 0x7f3ed807ada0 2024-02-28T22:55:14.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.693+0000 7f3edfe00700 1 -- 172.21.15.159:0/519451253 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f3ed8103d20 con 0x7f3ec0038330 2024-02-28T22:55:14.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.700+0000 7f3ed6000700 1 -- 172.21.15.159:0/519451253 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f3ed8103d20 con 0x7f3ec0038330 2024-02-28T22:55:14.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.702+0000 7f3edfe00700 1 -- 172.21.15.159:0/519451253 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3ec0038330 msgr2=0x7f3ec003a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:14.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.702+0000 7f3edfe00700 1 --2- 172.21.15.159:0/519451253 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3ec0038330 0x7f3ec003a7f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3ec4006fd0 tx=0x7f3ec4006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:14.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.702+0000 7f3edfe00700 1 -- 172.21.15.159:0/519451253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 msgr2=0x7f3ed819c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:14.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.702+0000 7f3edfe00700 1 --2- 172.21.15.159:0/519451253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed819c370 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3ecc011670 tx=0x7f3ecc011aa0 comp rx=0 tx=0).stop 2024-02-28T22:55:14.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.703+0000 7f3edfe00700 1 -- 172.21.15.159:0/519451253 shutdown_connections 2024-02-28T22:55:14.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.703+0000 7f3edfe00700 1 --2- 172.21.15.159:0/519451253 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f3ec0038330 0x7f3ec003a7f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:14.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.703+0000 7f3edfe00700 1 --2- 172.21.15.159:0/519451253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ed807ada0 0x7f3ed819c370 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:14.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.703+0000 7f3edfe00700 1 -- 172.21.15.159:0/519451253 >> 172.21.15.159:0/519451253 conn(0x7f3ed81019b0 msgr2=0x7f3ed8103100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:14.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.703+0000 7f3edfe00700 1 -- 172.21.15.159:0/519451253 shutdown_connections 2024-02-28T22:55:14.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:12.703+0000 7f3edfe00700 1 -- 172.21.15.159:0/519451253 wait complete. 2024-02-28T22:55:14.513 INFO:teuthology.orchestra.run.smithi159.stdout:Deploying grafana service with default placement... 2024-02-28T22:55:14.661 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:14 smithi159 ceph-mon[28802]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:14.661 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:14 smithi159 ceph-mon[28802]: Saving service prometheus spec with placement count:1 2024-02-28T22:55:15.710 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:15 smithi159 ceph-mon[28802]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:55:15.711 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:15 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:16.050 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-02-28T22:55:16.050 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.082+0000 7fe436200700 1 Processor -- start 2024-02-28T22:55:16.050 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.082+0000 7fe436200700 1 -- start start 2024-02-28T22:55:16.050 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.082+0000 7fe436200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe430106850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:16.051 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.082+0000 7fe436200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe430106e20 con 0x7fe430106430 2024-02-28T22:55:16.051 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.082+0000 7fe42f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe430106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:16.051 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.083+0000 7fe42f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe430106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55190/0 (socket says 172.21.15.159:55190) 2024-02-28T22:55:16.051 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.083+0000 7fe42f400700 1 -- 172.21.15.159:0/4139731452 learned_addr learned my addr 172.21.15.159:0/4139731452 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:16.051 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.083+0000 7fe42f400700 1 -- 172.21.15.159:0/4139731452 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430107630 con 0x7fe430106430 2024-02-28T22:55:16.051 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.083+0000 7fe42f400700 1 --2- 172.21.15.159:0/4139731452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe430106850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe420009e80 tx=0x7fe42000b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33b557923e3c0030 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:16.051 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.084+0000 7fe42ea00700 1 -- 172.21.15.159:0/4139731452 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe42000e070 con 0x7fe430106430 2024-02-28T22:55:16.051 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.084+0000 7fe42ea00700 1 -- 172.21.15.159:0/4139731452 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe42000b8c0 con 0x7fe430106430 2024-02-28T22:55:16.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.084+0000 7fe42ea00700 1 -- 172.21.15.159:0/4139731452 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe4200044d0 con 0x7fe430106430 2024-02-28T22:55:16.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.084+0000 7fe436200700 1 -- 172.21.15.159:0/4139731452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 msgr2=0x7fe430106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:16.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.084+0000 7fe436200700 1 --2- 172.21.15.159:0/4139731452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe430106850 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe420009e80 tx=0x7fe42000b330 comp rx=0 tx=0).stop 2024-02-28T22:55:16.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.085+0000 7fe436200700 1 -- 172.21.15.159:0/4139731452 shutdown_connections 2024-02-28T22:55:16.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.085+0000 7fe436200700 1 --2- 172.21.15.159:0/4139731452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe430106850 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:16.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.085+0000 7fe436200700 1 -- 172.21.15.159:0/4139731452 >> 172.21.15.159:0/4139731452 conn(0x7fe4301019b0 msgr2=0x7fe430103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:16.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.085+0000 7fe436200700 1 -- 172.21.15.159:0/4139731452 shutdown_connections 2024-02-28T22:55:16.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.085+0000 7fe436200700 1 -- 172.21.15.159:0/4139731452 wait complete. 2024-02-28T22:55:16.057 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.086+0000 7fe436200700 1 Processor -- start 2024-02-28T22:55:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.086+0000 7fe436200700 1 -- start start 2024-02-28T22:55:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.087+0000 7fe436200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe43019c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.087+0000 7fe436200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe43019c8a0 con 0x7fe430106430 2024-02-28T22:55:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.087+0000 7fe42f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe43019c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.087+0000 7fe42f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe43019c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55194/0 (socket says 172.21.15.159:55194) 2024-02-28T22:55:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.087+0000 7fe42f400700 1 -- 172.21.15.159:0/3268703898 learned_addr learned my addr 172.21.15.159:0/3268703898 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.088+0000 7fe42f400700 1 -- 172.21.15.159:0/3268703898 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe420009b30 con 0x7fe430106430 2024-02-28T22:55:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.088+0000 7fe42f400700 1 --2- 172.21.15.159:0/3268703898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe43019c360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe420004940 tx=0x7fe420004a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.088+0000 7fe42cc00700 1 -- 172.21.15.159:0/3268703898 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe42000e040 con 0x7fe430106430 2024-02-28T22:55:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.088+0000 7fe42cc00700 1 -- 172.21.15.159:0/3268703898 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe42000bc40 con 0x7fe430106430 2024-02-28T22:55:16.058 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.088+0000 7fe436200700 1 -- 172.21.15.159:0/3268703898 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe43019caa0 con 0x7fe430106430 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.088+0000 7fe42cc00700 1 -- 172.21.15.159:0/3268703898 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe420012670 con 0x7fe430106430 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.088+0000 7fe436200700 1 -- 172.21.15.159:0/3268703898 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe43019cfa0 con 0x7fe430106430 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.089+0000 7fe42cc00700 1 -- 172.21.15.159:0/3268703898 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7fe420019040 con 0x7fe430106430 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.089+0000 7fe436200700 1 -- 172.21.15.159:0/3268703898 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4300623c0 con 0x7fe430106430 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.090+0000 7fe42cc00700 1 --2- 172.21.15.159:0/3268703898 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fe414038370 0x7fe41403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.090+0000 7fe42cc00700 1 -- 172.21.15.159:0/3268703898 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fe42004bc60 con 0x7fe430106430 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.090+0000 7fe426a00700 1 --2- 172.21.15.159:0/3268703898 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fe414038370 0x7fe41403a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.091+0000 7fe426a00700 1 --2- 172.21.15.159:0/3268703898 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fe414038370 0x7fe41403a830 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe418006fd0 tx=0x7fe418006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.096+0000 7fe42cc00700 1 -- 172.21.15.159:0/3268703898 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe42001a570 con 0x7fe430106430 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.332+0000 7fe436200700 1 -- 172.21.15.159:0/3268703898 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fe43010a830 con 0x7fe414038370 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.341+0000 7fe42cc00700 1 -- 172.21.15.159:0/3268703898 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fe43010a830 con 0x7fe414038370 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.344+0000 7fe436200700 1 -- 172.21.15.159:0/3268703898 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fe414038370 msgr2=0x7fe41403a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:16.059 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.344+0000 7fe436200700 1 --2- 172.21.15.159:0/3268703898 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fe414038370 0x7fe41403a830 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fe418006fd0 tx=0x7fe418006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:16.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.344+0000 7fe436200700 1 -- 172.21.15.159:0/3268703898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 msgr2=0x7fe43019c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:16.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.344+0000 7fe436200700 1 --2- 172.21.15.159:0/3268703898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe43019c360 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe420004940 tx=0x7fe420004a20 comp rx=0 tx=0).stop 2024-02-28T22:55:16.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.344+0000 7fe436200700 1 -- 172.21.15.159:0/3268703898 shutdown_connections 2024-02-28T22:55:16.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.344+0000 7fe436200700 1 --2- 172.21.15.159:0/3268703898 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fe414038370 0x7fe41403a830 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:16.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.344+0000 7fe436200700 1 --2- 172.21.15.159:0/3268703898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe430106430 0x7fe43019c360 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:16.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.344+0000 7fe436200700 1 -- 172.21.15.159:0/3268703898 >> 172.21.15.159:0/3268703898 conn(0x7fe4301019b0 msgr2=0x7fe4301030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:16.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.345+0000 7fe436200700 1 -- 172.21.15.159:0/3268703898 shutdown_connections 2024-02-28T22:55:16.060 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:15.345+0000 7fe436200700 1 -- 172.21.15.159:0/3268703898 wait complete. 2024-02-28T22:55:16.060 INFO:teuthology.orchestra.run.smithi159.stdout:Deploying node-exporter service with default placement... 2024-02-28T22:55:16.628 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:16 smithi159 ceph-mon[28802]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:16.629 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:16 smithi159 ceph-mon[28802]: Saving service grafana spec with placement count:1 2024-02-28T22:55:17.570 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:17 smithi159 ceph-mon[28802]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:55:17.570 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:17 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:17.585 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-02-28T22:55:17.585 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.629+0000 7f1d5f800700 1 Processor -- start 2024-02-28T22:55:17.585 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.629+0000 7f1d5f800700 1 -- start start 2024-02-28T22:55:17.585 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.630+0000 7f1d5f800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d58106840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:17.585 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.630+0000 7f1d5f800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d58106e10 con 0x7f1d58106420 2024-02-28T22:55:17.585 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.630+0000 7f1d5ce00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d58106840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:17.586 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.630+0000 7f1d5ce00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d58106840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55204/0 (socket says 172.21.15.159:55204) 2024-02-28T22:55:17.586 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.630+0000 7f1d5ce00700 1 -- 172.21.15.159:0/2427692349 learned_addr learned my addr 172.21.15.159:0/2427692349 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:17.586 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.630+0000 7f1d5ce00700 1 -- 172.21.15.159:0/2427692349 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d58107620 con 0x7f1d58106420 2024-02-28T22:55:17.586 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.631+0000 7f1d5ce00700 1 --2- 172.21.15.159:0/2427692349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d58106840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0098a0 tx=0x7f1d4c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c80a77ff322b7f server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:17.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.631+0000 7f1d57400700 1 -- 172.21.15.159:0/2427692349 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d4c004180 con 0x7f1d58106420 2024-02-28T22:55:17.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.631+0000 7f1d57400700 1 -- 172.21.15.159:0/2427692349 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d4c0042e0 con 0x7f1d58106420 2024-02-28T22:55:17.587 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.631+0000 7f1d57400700 1 -- 172.21.15.159:0/2427692349 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d4c011af0 con 0x7f1d58106420 2024-02-28T22:55:17.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.632+0000 7f1d5f800700 1 -- 172.21.15.159:0/2427692349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 msgr2=0x7f1d58106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:17.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.632+0000 7f1d5f800700 1 --2- 172.21.15.159:0/2427692349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d58106840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c0098a0 tx=0x7f1d4c009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:17.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.632+0000 7f1d5f800700 1 -- 172.21.15.159:0/2427692349 shutdown_connections 2024-02-28T22:55:17.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.632+0000 7f1d5f800700 1 --2- 172.21.15.159:0/2427692349 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d58106840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:17.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.632+0000 7f1d5f800700 1 -- 172.21.15.159:0/2427692349 >> 172.21.15.159:0/2427692349 conn(0x7f1d58101a00 msgr2=0x7f1d58103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:17.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.632+0000 7f1d5f800700 1 -- 172.21.15.159:0/2427692349 shutdown_connections 2024-02-28T22:55:17.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.632+0000 7f1d5f800700 1 -- 172.21.15.159:0/2427692349 wait complete. 2024-02-28T22:55:17.588 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.633+0000 7f1d5f800700 1 Processor -- start 2024-02-28T22:55:17.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.633+0000 7f1d5f800700 1 -- start start 2024-02-28T22:55:17.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.634+0000 7f1d5f800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d5807bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:17.589 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.634+0000 7f1d5f800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5807c150 con 0x7f1d58106420 2024-02-28T22:55:17.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.634+0000 7f1d5ce00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d5807bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:17.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.634+0000 7f1d5ce00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d5807bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55206/0 (socket says 172.21.15.159:55206) 2024-02-28T22:55:17.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.634+0000 7f1d5ce00700 1 -- 172.21.15.159:0/4247910662 learned_addr learned my addr 172.21.15.159:0/4247910662 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:17.590 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.634+0000 7f1d5ce00700 1 -- 172.21.15.159:0/4247910662 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d4c009550 con 0x7f1d58106420 2024-02-28T22:55:17.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.635+0000 7f1d5ce00700 1 --2- 172.21.15.159:0/4247910662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d5807bc10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c000c00 tx=0x7f1d4c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:17.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.635+0000 7f1d55600700 1 -- 172.21.15.159:0/4247910662 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d4c003a70 con 0x7f1d58106420 2024-02-28T22:55:17.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.635+0000 7f1d55600700 1 -- 172.21.15.159:0/4247910662 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1d4c003bd0 con 0x7f1d58106420 2024-02-28T22:55:17.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.635+0000 7f1d55600700 1 -- 172.21.15.159:0/4247910662 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1d4c0238c0 con 0x7f1d58106420 2024-02-28T22:55:17.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.635+0000 7f1d5f800700 1 -- 172.21.15.159:0/4247910662 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d5807a2b0 con 0x7f1d58106420 2024-02-28T22:55:17.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.635+0000 7f1d5f800700 1 -- 172.21.15.159:0/4247910662 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d5807a7b0 con 0x7f1d58106420 2024-02-28T22:55:17.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.636+0000 7f1d5f800700 1 -- 172.21.15.159:0/4247910662 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d580623c0 con 0x7f1d58106420 2024-02-28T22:55:17.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.637+0000 7f1d55600700 1 -- 172.21.15.159:0/4247910662 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f1d4c023b30 con 0x7f1d58106420 2024-02-28T22:55:17.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.637+0000 7f1d55600700 1 --2- 172.21.15.159:0/4247910662 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1d40038370 0x7f1d4003a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:17.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.637+0000 7f1d55600700 1 -- 172.21.15.159:0/4247910662 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1d4c04c5c0 con 0x7f1d58106420 2024-02-28T22:55:17.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.638+0000 7f1d57e00700 1 --2- 172.21.15.159:0/4247910662 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1d40038370 0x7f1d4003a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:17.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.638+0000 7f1d57e00700 1 --2- 172.21.15.159:0/4247910662 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1d40038370 0x7f1d4003a830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1d44006fd0 tx=0x7f1d44006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:17.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.642+0000 7f1d55600700 1 -- 172.21.15.159:0/4247910662 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1d4c018350 con 0x7f1d58106420 2024-02-28T22:55:17.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.868+0000 7f1d5f800700 1 -- 172.21.15.159:0/4247910662 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d5810a820 con 0x7f1d40038370 2024-02-28T22:55:17.594 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.875+0000 7f1d55600700 1 -- 172.21.15.159:0/4247910662 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f1d5810a820 con 0x7f1d40038370 2024-02-28T22:55:17.595 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.878+0000 7f1d5f800700 1 -- 172.21.15.159:0/4247910662 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1d40038370 msgr2=0x7f1d4003a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:17.595 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.878+0000 7f1d5f800700 1 --2- 172.21.15.159:0/4247910662 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1d40038370 0x7f1d4003a830 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f1d44006fd0 tx=0x7f1d44006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:17.595 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.878+0000 7f1d5f800700 1 -- 172.21.15.159:0/4247910662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 msgr2=0x7f1d5807bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:17.595 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.878+0000 7f1d5f800700 1 --2- 172.21.15.159:0/4247910662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d5807bc10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c000c00 tx=0x7f1d4c011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:17.595 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.878+0000 7f1d5f800700 1 -- 172.21.15.159:0/4247910662 shutdown_connections 2024-02-28T22:55:17.595 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.878+0000 7f1d5f800700 1 --2- 172.21.15.159:0/4247910662 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f1d40038370 0x7f1d4003a830 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:17.595 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.878+0000 7f1d5f800700 1 --2- 172.21.15.159:0/4247910662 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d58106420 0x7f1d5807bc10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:17.595 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.878+0000 7f1d5f800700 1 -- 172.21.15.159:0/4247910662 >> 172.21.15.159:0/4247910662 conn(0x7f1d58101a00 msgr2=0x7f1d581030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:17.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.878+0000 7f1d5f800700 1 -- 172.21.15.159:0/4247910662 shutdown_connections 2024-02-28T22:55:17.596 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:16.879+0000 7f1d5f800700 1 -- 172.21.15.159:0/4247910662 wait complete. 2024-02-28T22:55:17.596 INFO:teuthology.orchestra.run.smithi159.stdout:Deploying alertmanager service with default placement... 2024-02-28T22:55:18.393 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:18 smithi159 ceph-mon[28802]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:18.393 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:18 smithi159 ceph-mon[28802]: Saving service node-exporter spec with placement * 2024-02-28T22:55:19.013 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-02-28T22:55:19.013 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.142+0000 7f2918e00700 1 Processor -- start 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.142+0000 7f2918e00700 1 -- start start 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.142+0000 7f2918e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f2914108aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.142+0000 7f2918e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2914109070 con 0x7f2914108680 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.143+0000 7f2911e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f2914108aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.143+0000 7f2911e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f2914108aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60600/0 (socket says 172.21.15.159:60600) 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.143+0000 7f2911e00700 1 -- 172.21.15.159:0/3551923285 learned_addr learned my addr 172.21.15.159:0/3551923285 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.143+0000 7f2911e00700 1 -- 172.21.15.159:0/3551923285 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2914109830 con 0x7f2914108680 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.144+0000 7f2911e00700 1 --2- 172.21.15.159:0/3551923285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f2914108aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29040098a0 tx=0x7f2904009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7add00849bd598 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.144+0000 7f2911400700 1 -- 172.21.15.159:0/3551923285 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2904004180 con 0x7f2914108680 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.144+0000 7f2911400700 1 -- 172.21.15.159:0/3551923285 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f29040042e0 con 0x7f2914108680 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.144+0000 7f2911400700 1 -- 172.21.15.159:0/3551923285 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2904011af0 con 0x7f2914108680 2024-02-28T22:55:19.014 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.145+0000 7f2918e00700 1 -- 172.21.15.159:0/3551923285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 msgr2=0x7f2914108aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.145+0000 7f2918e00700 1 --2- 172.21.15.159:0/3551923285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f2914108aa0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f29040098a0 tx=0x7f2904009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.145+0000 7f2918e00700 1 -- 172.21.15.159:0/3551923285 shutdown_connections 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.145+0000 7f2918e00700 1 --2- 172.21.15.159:0/3551923285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f2914108aa0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.145+0000 7f2918e00700 1 -- 172.21.15.159:0/3551923285 >> 172.21.15.159:0/3551923285 conn(0x7f291407bb20 msgr2=0x7f29141064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.145+0000 7f2918e00700 1 -- 172.21.15.159:0/3551923285 shutdown_connections 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.145+0000 7f2918e00700 1 -- 172.21.15.159:0/3551923285 wait complete. 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.146+0000 7f2918e00700 1 Processor -- start 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.146+0000 7f2918e00700 1 -- start start 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.146+0000 7f2918e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f291419c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.146+0000 7f2918e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291419c8e0 con 0x7f2914108680 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.146+0000 7f2911e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f291419c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:19.015 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.147+0000 7f2911e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f291419c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60606/0 (socket says 172.21.15.159:60606) 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.147+0000 7f2911e00700 1 -- 172.21.15.159:0/938041284 learned_addr learned my addr 172.21.15.159:0/938041284 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.147+0000 7f2911e00700 1 -- 172.21.15.159:0/938041284 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2904009550 con 0x7f2914108680 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.147+0000 7f2911e00700 1 --2- 172.21.15.159:0/938041284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f291419c3a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2904011670 tx=0x7f2904011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.147+0000 7f290aa00700 1 -- 172.21.15.159:0/938041284 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29040039f0 con 0x7f2914108680 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.147+0000 7f290aa00700 1 -- 172.21.15.159:0/938041284 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2904003b50 con 0x7f2914108680 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.147+0000 7f2918e00700 1 -- 172.21.15.159:0/938041284 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291419cae0 con 0x7f2914108680 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.147+0000 7f290aa00700 1 -- 172.21.15.159:0/938041284 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f29040247c0 con 0x7f2914108680 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.148+0000 7f2918e00700 1 -- 172.21.15.159:0/938041284 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f291419cf80 con 0x7f2914108680 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.149+0000 7f290aa00700 1 -- 172.21.15.159:0/938041284 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f290401ac00 con 0x7f2914108680 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.149+0000 7f2903e00700 1 -- 172.21.15.159:0/938041284 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29140623c0 con 0x7f2914108680 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.149+0000 7f290aa00700 1 --2- 172.21.15.159:0/938041284 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f28f8038370 0x7f28f803a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.149+0000 7f290aa00700 1 -- 172.21.15.159:0/938041284 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f290404c470 con 0x7f2914108680 2024-02-28T22:55:19.016 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.150+0000 7f290be00700 1 --2- 172.21.15.159:0/938041284 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f28f8038370 0x7f28f803a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.150+0000 7f290be00700 1 --2- 172.21.15.159:0/938041284 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f28f8038370 0x7f28f803a830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f28fc006fd0 tx=0x7f28fc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.155+0000 7f290aa00700 1 -- 172.21.15.159:0/938041284 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f290401a430 con 0x7f2914108680 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.382+0000 7f2903e00700 1 -- 172.21.15.159:0/938041284 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f291410ca60 con 0x7f28f8038370 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.390+0000 7f290aa00700 1 -- 172.21.15.159:0/938041284 <== mgr.14120 v2:172.21.15.159:6800/2133007913 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f291410ca60 con 0x7f28f8038370 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.393+0000 7f2903e00700 1 -- 172.21.15.159:0/938041284 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f28f8038370 msgr2=0x7f28f803a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.393+0000 7f2903e00700 1 --2- 172.21.15.159:0/938041284 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f28f8038370 0x7f28f803a830 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f28fc006fd0 tx=0x7f28fc006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.393+0000 7f2903e00700 1 -- 172.21.15.159:0/938041284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 msgr2=0x7f291419c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.393+0000 7f2903e00700 1 --2- 172.21.15.159:0/938041284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f291419c3a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2904011670 tx=0x7f2904011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.393+0000 7f2903e00700 1 -- 172.21.15.159:0/938041284 shutdown_connections 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.393+0000 7f2903e00700 1 --2- 172.21.15.159:0/938041284 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f28f8038370 0x7f28f803a830 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.393+0000 7f2903e00700 1 --2- 172.21.15.159:0/938041284 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2914108680 0x7f291419c3a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.393+0000 7f2903e00700 1 -- 172.21.15.159:0/938041284 >> 172.21.15.159:0/938041284 conn(0x7f291407bb20 msgr2=0x7f2914106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.394+0000 7f2903e00700 1 -- 172.21.15.159:0/938041284 shutdown_connections 2024-02-28T22:55:19.017 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:18.394+0000 7f2903e00700 1 -- 172.21.15.159:0/938041284 wait complete. 2024-02-28T22:55:19.607 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:19 smithi159 ceph-mon[28802]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:55:19.607 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:19 smithi159 ceph-mon[28802]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:19.607 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:19 smithi159 ceph-mon[28802]: Saving service alertmanager spec with placement count:1 2024-02-28T22:55:19.607 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:19 smithi159 ceph-mon[28802]: from='mgr.14120 172.21.15.159:0/3298065576' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:20.469 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.607+0000 7f60c6600700 1 Processor -- start 2024-02-28T22:55:20.470 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.607+0000 7f60c6600700 1 -- start start 2024-02-28T22:55:20.470 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.607+0000 7f60c6600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c0108890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:20.470 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.607+0000 7f60c6600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c0108e60 con 0x7f60c0108470 2024-02-28T22:55:20.471 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.608+0000 7f60c5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c0108890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:20.471 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.608+0000 7f60c5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c0108890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60616/0 (socket says 172.21.15.159:60616) 2024-02-28T22:55:20.471 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.608+0000 7f60c5200700 1 -- 172.21.15.159:0/3170496287 learned_addr learned my addr 172.21.15.159:0/3170496287 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:20.471 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.608+0000 7f60c5200700 1 -- 172.21.15.159:0/3170496287 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c0109670 con 0x7f60c0108470 2024-02-28T22:55:20.471 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.608+0000 7f60c5200700 1 --2- 172.21.15.159:0/3170496287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c0108890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f60b40098a0 tx=0x7f60b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc88375ef3b91129 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:20.471 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.609+0000 7f60bf400700 1 -- 172.21.15.159:0/3170496287 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b4004180 con 0x7f60c0108470 2024-02-28T22:55:20.472 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.609+0000 7f60bf400700 1 -- 172.21.15.159:0/3170496287 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f60b40042e0 con 0x7f60c0108470 2024-02-28T22:55:20.472 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.609+0000 7f60bf400700 1 -- 172.21.15.159:0/3170496287 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b4011af0 con 0x7f60c0108470 2024-02-28T22:55:20.472 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.610+0000 7f60c6600700 1 -- 172.21.15.159:0/3170496287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 msgr2=0x7f60c0108890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:20.472 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.610+0000 7f60c6600700 1 --2- 172.21.15.159:0/3170496287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c0108890 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f60b40098a0 tx=0x7f60b4009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:20.473 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.610+0000 7f60c6600700 1 -- 172.21.15.159:0/3170496287 shutdown_connections 2024-02-28T22:55:20.473 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.610+0000 7f60c6600700 1 --2- 172.21.15.159:0/3170496287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c0108890 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:20.473 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.610+0000 7f60c6600700 1 -- 172.21.15.159:0/3170496287 >> 172.21.15.159:0/3170496287 conn(0x7f60c007b850 msgr2=0x7f60c01064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:20.474 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.610+0000 7f60c6600700 1 -- 172.21.15.159:0/3170496287 shutdown_connections 2024-02-28T22:55:20.474 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.610+0000 7f60c6600700 1 -- 172.21.15.159:0/3170496287 wait complete. 2024-02-28T22:55:20.474 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.611+0000 7f60c6600700 1 Processor -- start 2024-02-28T22:55:20.474 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.611+0000 7f60c6600700 1 -- start start 2024-02-28T22:55:20.474 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.611+0000 7f60c6600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c019c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:20.475 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.612+0000 7f60c6600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c019c720 con 0x7f60c0108470 2024-02-28T22:55:20.475 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.612+0000 7f60c5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c019c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:20.475 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.612+0000 7f60c5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c019c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60622/0 (socket says 172.21.15.159:60622) 2024-02-28T22:55:20.475 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.612+0000 7f60c5200700 1 -- 172.21.15.159:0/3554109779 learned_addr learned my addr 172.21.15.159:0/3554109779 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:20.475 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.612+0000 7f60c5200700 1 -- 172.21.15.159:0/3554109779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b4009550 con 0x7f60c0108470 2024-02-28T22:55:20.476 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.613+0000 7f60c5200700 1 --2- 172.21.15.159:0/3554109779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c019c1e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f60b4011670 tx=0x7f60b4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:20.476 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.613+0000 7f60bd600700 1 -- 172.21.15.159:0/3554109779 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b40039f0 con 0x7f60c0108470 2024-02-28T22:55:20.476 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.613+0000 7f60bd600700 1 -- 172.21.15.159:0/3554109779 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f60b4003b50 con 0x7f60c0108470 2024-02-28T22:55:20.477 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.613+0000 7f60c6600700 1 -- 172.21.15.159:0/3554109779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c019c920 con 0x7f60c0108470 2024-02-28T22:55:20.477 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.613+0000 7f60bd600700 1 -- 172.21.15.159:0/3554109779 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f60b40247c0 con 0x7f60c0108470 2024-02-28T22:55:20.477 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.613+0000 7f60c6600700 1 -- 172.21.15.159:0/3554109779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c019cdc0 con 0x7f60c0108470 2024-02-28T22:55:20.477 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.614+0000 7f60bd600700 1 -- 172.21.15.159:0/3554109779 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f60b402d3f0 con 0x7f60c0108470 2024-02-28T22:55:20.478 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.614+0000 7f60c6600700 1 -- 172.21.15.159:0/3554109779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c01962b0 con 0x7f60c0108470 2024-02-28T22:55:20.478 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.615+0000 7f60bd600700 1 --2- 172.21.15.159:0/3554109779 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f60a8038370 0x7f60a803a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:20.478 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.615+0000 7f60bd600700 1 -- 172.21.15.159:0/3554109779 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f60b404c590 con 0x7f60c0108470 2024-02-28T22:55:20.479 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.615+0000 7f60bfe00700 1 --2- 172.21.15.159:0/3554109779 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f60a8038370 0x7f60a803a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:20.479 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.616+0000 7f60bfe00700 1 --2- 172.21.15.159:0/3554109779 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f60a8038370 0x7f60a803a830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60ac006fd0 tx=0x7f60ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:20.479 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.620+0000 7f60bd600700 1 -- 172.21.15.159:0/3554109779 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f60b4010970 con 0x7f60c0108470 2024-02-28T22:55:20.479 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.831+0000 7f60c6600700 1 -- 172.21.15.159:0/3554109779 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f60c002d090 con 0x7f60c0108470 2024-02-28T22:55:20.479 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.839+0000 7f60bd600700 1 -- 172.21.15.159:0/3554109779 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f60b4010380 con 0x7f60c0108470 2024-02-28T22:55:20.479 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.842+0000 7f60c6600700 1 -- 172.21.15.159:0/3554109779 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f60a8038370 msgr2=0x7f60a803a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:20.480 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.842+0000 7f60c6600700 1 --2- 172.21.15.159:0/3554109779 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f60a8038370 0x7f60a803a830 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60ac006fd0 tx=0x7f60ac006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:20.480 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.842+0000 7f60c6600700 1 -- 172.21.15.159:0/3554109779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 msgr2=0x7f60c019c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:20.480 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.842+0000 7f60c6600700 1 --2- 172.21.15.159:0/3554109779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c019c1e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f60b4011670 tx=0x7f60b4011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:20.480 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.842+0000 7f60c6600700 1 -- 172.21.15.159:0/3554109779 shutdown_connections 2024-02-28T22:55:20.480 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.842+0000 7f60c6600700 1 --2- 172.21.15.159:0/3554109779 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f60a8038370 0x7f60a803a830 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:20.480 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.842+0000 7f60c6600700 1 --2- 172.21.15.159:0/3554109779 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f60c0108470 0x7f60c019c1e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:20.481 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.842+0000 7f60c6600700 1 -- 172.21.15.159:0/3554109779 >> 172.21.15.159:0/3554109779 conn(0x7f60c007b850 msgr2=0x7f60c0106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:20.481 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.843+0000 7f60c6600700 1 -- 172.21.15.159:0/3554109779 shutdown_connections 2024-02-28T22:55:20.481 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:19.843+0000 7f60c6600700 1 -- 172.21.15.159:0/3554109779 wait complete. 2024-02-28T22:55:21.102 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:20 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3554109779' entity='client.admin' 2024-02-28T22:55:21.103 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:20 smithi159 ceph-mon[28802]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:55:22.075 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.103+0000 7f50e2800700 1 Processor -- start 2024-02-28T22:55:22.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.103+0000 7f50e2800700 1 -- start start 2024-02-28T22:55:22.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.103+0000 7f50e2800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc106680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:22.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.103+0000 7f50e2800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc106c50 con 0x7f50dc106260 2024-02-28T22:55:22.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.104+0000 7f50e1400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc106680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:22.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.104+0000 7f50e1400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc106680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60630/0 (socket says 172.21.15.159:60630) 2024-02-28T22:55:22.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.104+0000 7f50e1400700 1 -- 172.21.15.159:0/1485360453 learned_addr learned my addr 172.21.15.159:0/1485360453 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:22.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.104+0000 7f50e1400700 1 -- 172.21.15.159:0/1485360453 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc107460 con 0x7f50dc106260 2024-02-28T22:55:22.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.105+0000 7f50e1400700 1 --2- 172.21.15.159:0/1485360453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc106680 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50d00098a0 tx=0x7f50d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b84d633ce04a00a server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:22.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.105+0000 7f50dbe00700 1 -- 172.21.15.159:0/1485360453 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50d0004180 con 0x7f50dc106260 2024-02-28T22:55:22.076 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.105+0000 7f50dbe00700 1 -- 172.21.15.159:0/1485360453 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f50d00042e0 con 0x7f50dc106260 2024-02-28T22:55:22.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.105+0000 7f50dbe00700 1 -- 172.21.15.159:0/1485360453 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50d0011af0 con 0x7f50dc106260 2024-02-28T22:55:22.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.106+0000 7f50e2800700 1 -- 172.21.15.159:0/1485360453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 msgr2=0x7f50dc106680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:22.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.106+0000 7f50e2800700 1 --2- 172.21.15.159:0/1485360453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc106680 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f50d00098a0 tx=0x7f50d0009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:22.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.106+0000 7f50e2800700 1 -- 172.21.15.159:0/1485360453 shutdown_connections 2024-02-28T22:55:22.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.106+0000 7f50e2800700 1 --2- 172.21.15.159:0/1485360453 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc106680 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:22.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.106+0000 7f50e2800700 1 -- 172.21.15.159:0/1485360453 >> 172.21.15.159:0/1485360453 conn(0x7f50dc101800 msgr2=0x7f50dc103c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:22.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.106+0000 7f50e2800700 1 -- 172.21.15.159:0/1485360453 shutdown_connections 2024-02-28T22:55:22.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.106+0000 7f50e2800700 1 -- 172.21.15.159:0/1485360453 wait complete. 2024-02-28T22:55:22.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.107+0000 7f50e2800700 1 Processor -- start 2024-02-28T22:55:22.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.107+0000 7f50e2800700 1 -- start start 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.108+0000 7f50e2800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc19c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.108+0000 7f50e2800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc19c730 con 0x7f50dc106260 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.108+0000 7f50e1400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc19c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.108+0000 7f50e1400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc19c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60634/0 (socket says 172.21.15.159:60634) 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.108+0000 7f50e1400700 1 -- 172.21.15.159:0/2477369066 learned_addr learned my addr 172.21.15.159:0/2477369066 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.108+0000 7f50e1400700 1 -- 172.21.15.159:0/2477369066 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50d0009550 con 0x7f50dc106260 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.109+0000 7f50e1400700 1 --2- 172.21.15.159:0/2477369066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc19c1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f50d0011670 tx=0x7f50d0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.109+0000 7f50da000700 1 -- 172.21.15.159:0/2477369066 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50d00039f0 con 0x7f50dc106260 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.109+0000 7f50da000700 1 -- 172.21.15.159:0/2477369066 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f50d0003b50 con 0x7f50dc106260 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.109+0000 7f50da000700 1 -- 172.21.15.159:0/2477369066 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f50d00247c0 con 0x7f50dc106260 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.109+0000 7f50e2800700 1 -- 172.21.15.159:0/2477369066 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc19c930 con 0x7f50dc106260 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.109+0000 7f50e2800700 1 -- 172.21.15.159:0/2477369066 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc19cdd0 con 0x7f50dc106260 2024-02-28T22:55:22.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.110+0000 7f50da000700 1 -- 172.21.15.159:0/2477369066 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f50d001ac00 con 0x7f50dc106260 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.110+0000 7f50e2800700 1 -- 172.21.15.159:0/2477369066 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc0623c0 con 0x7f50dc106260 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.111+0000 7f50da000700 1 --2- 172.21.15.159:0/2477369066 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f50c4038370 0x7f50c403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.111+0000 7f50da000700 1 -- 172.21.15.159:0/2477369066 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f50d004c430 con 0x7f50dc106260 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.111+0000 7f50e0a00700 1 --2- 172.21.15.159:0/2477369066 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f50c4038370 0x7f50c403a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.112+0000 7f50e0a00700 1 --2- 172.21.15.159:0/2477369066 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f50c4038370 0x7f50c403a830 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f50c8006fd0 tx=0x7f50c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.116+0000 7f50da000700 1 -- 172.21.15.159:0/2477369066 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f50d0010380 con 0x7f50dc106260 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.327+0000 7f50e2800700 1 -- 172.21.15.159:0/2477369066 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f50dc19fc10 con 0x7f50dc106260 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.334+0000 7f50da000700 1 -- 172.21.15.159:0/2477369066 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f50d0018b40 con 0x7f50dc106260 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.337+0000 7f50e2800700 1 -- 172.21.15.159:0/2477369066 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f50c4038370 msgr2=0x7f50c403a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.337+0000 7f50e2800700 1 --2- 172.21.15.159:0/2477369066 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f50c4038370 0x7f50c403a830 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f50c8006fd0 tx=0x7f50c8006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.337+0000 7f50e2800700 1 -- 172.21.15.159:0/2477369066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 msgr2=0x7f50dc19c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.337+0000 7f50e2800700 1 --2- 172.21.15.159:0/2477369066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc19c1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f50d0011670 tx=0x7f50d0011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:22.083 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.337+0000 7f50e2800700 1 -- 172.21.15.159:0/2477369066 shutdown_connections 2024-02-28T22:55:22.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.337+0000 7f50e2800700 1 --2- 172.21.15.159:0/2477369066 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f50c4038370 0x7f50c403a830 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:22.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.337+0000 7f50e2800700 1 --2- 172.21.15.159:0/2477369066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50dc106260 0x7f50dc19c1f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:22.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.337+0000 7f50e2800700 1 -- 172.21.15.159:0/2477369066 >> 172.21.15.159:0/2477369066 conn(0x7f50dc101800 msgr2=0x7f50dc102ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:22.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.338+0000 7f50e2800700 1 -- 172.21.15.159:0/2477369066 shutdown_connections 2024-02-28T22:55:22.084 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:21.338+0000 7f50e2800700 1 -- 172.21.15.159:0/2477369066 wait complete. 2024-02-28T22:55:22.084 INFO:teuthology.orchestra.run.smithi159.stdout:Enabling the dashboard module... 2024-02-28T22:55:22.601 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:22 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2477369066' entity='client.admin' 2024-02-28T22:55:23.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:23 smithi159 ceph-mon[28802]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:55:23.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:23 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3300351166' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-28T22:55:24.078 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.682+0000 7f25b2e00700 1 Processor -- start 2024-02-28T22:55:24.078 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.682+0000 7f25b2e00700 1 -- start start 2024-02-28T22:55:24.078 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.682+0000 7f25b2e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac108a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:24.078 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.682+0000 7f25b2e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac109020 con 0x7f25ac108630 2024-02-28T22:55:24.078 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.683+0000 7f25abe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac108a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:24.078 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.683+0000 7f25abe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac108a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60648/0 (socket says 172.21.15.159:60648) 2024-02-28T22:55:24.078 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.683+0000 7f25abe00700 1 -- 172.21.15.159:0/1674633727 learned_addr learned my addr 172.21.15.159:0/1674633727 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:24.078 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.683+0000 7f25abe00700 1 -- 172.21.15.159:0/1674633727 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac109830 con 0x7f25ac108630 2024-02-28T22:55:24.078 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.684+0000 7f25abe00700 1 --2- 172.21.15.159:0/1674633727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac108a50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f259c0098a0 tx=0x7f259c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc64adb87a14e60 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:24.078 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.684+0000 7f25aaa00700 1 -- 172.21.15.159:0/1674633727 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f259c004180 con 0x7f25ac108630 2024-02-28T22:55:24.078 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.684+0000 7f25aaa00700 1 -- 172.21.15.159:0/1674633727 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f259c0042e0 con 0x7f25ac108630 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.684+0000 7f25aaa00700 1 -- 172.21.15.159:0/1674633727 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f259c011af0 con 0x7f25ac108630 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.685+0000 7f25b2e00700 1 -- 172.21.15.159:0/1674633727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 msgr2=0x7f25ac108a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.685+0000 7f25b2e00700 1 --2- 172.21.15.159:0/1674633727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac108a50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f259c0098a0 tx=0x7f259c009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.685+0000 7f25b2e00700 1 -- 172.21.15.159:0/1674633727 shutdown_connections 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.685+0000 7f25b2e00700 1 --2- 172.21.15.159:0/1674633727 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac108a50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.685+0000 7f25b2e00700 1 -- 172.21.15.159:0/1674633727 >> 172.21.15.159:0/1674633727 conn(0x7f25ac103c10 msgr2=0x7f25ac106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.685+0000 7f25b2e00700 1 -- 172.21.15.159:0/1674633727 shutdown_connections 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.685+0000 7f25b2e00700 1 -- 172.21.15.159:0/1674633727 wait complete. 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.686+0000 7f25b2e00700 1 Processor -- start 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.687+0000 7f25b2e00700 1 -- start start 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.687+0000 7f25b2e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.687+0000 7f25b2e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ac19c900 con 0x7f25ac108630 2024-02-28T22:55:24.079 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.687+0000 7f25abe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.687+0000 7f25abe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac19c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60658/0 (socket says 172.21.15.159:60658) 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.687+0000 7f25abe00700 1 -- 172.21.15.159:0/3300351166 learned_addr learned my addr 172.21.15.159:0/3300351166 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.687+0000 7f25abe00700 1 -- 172.21.15.159:0/3300351166 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f259c009550 con 0x7f25ac108630 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.688+0000 7f25abe00700 1 --2- 172.21.15.159:0/3300351166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac19c3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f259c011670 tx=0x7f259c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.688+0000 7f25a8c00700 1 -- 172.21.15.159:0/3300351166 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f259c0039f0 con 0x7f25ac108630 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.688+0000 7f25a8c00700 1 -- 172.21.15.159:0/3300351166 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f259c003b50 con 0x7f25ac108630 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.688+0000 7f25a8c00700 1 -- 172.21.15.159:0/3300351166 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f259c0247c0 con 0x7f25ac108630 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.688+0000 7f25b2e00700 1 -- 172.21.15.159:0/3300351166 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ac19cb00 con 0x7f25ac108630 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.688+0000 7f25b2e00700 1 -- 172.21.15.159:0/3300351166 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ac19cfa0 con 0x7f25ac108630 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.689+0000 7f25b2e00700 1 -- 172.21.15.159:0/3300351166 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ac0623c0 con 0x7f25ac108630 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.690+0000 7f25a8c00700 1 -- 172.21.15.159:0/3300351166 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) v1 ==== 45283+0+0 (secure 0 0 0) 0x7f259c01ac00 con 0x7f25ac108630 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.690+0000 7f25a8c00700 1 --2- 172.21.15.159:0/3300351166 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f2590038370 0x7f259003a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:24.080 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.690+0000 7f25a8c00700 1 -- 172.21.15.159:0/3300351166 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f259c04c430 con 0x7f25ac108630 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.690+0000 7f25ab400700 1 --2- 172.21.15.159:0/3300351166 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f2590038370 0x7f259003a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.691+0000 7f25ab400700 1 --2- 172.21.15.159:0/3300351166 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f2590038370 0x7f259003a830 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2598006fd0 tx=0x7f2598006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.695+0000 7f25a8c00700 1 -- 172.21.15.159:0/3300351166 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f259c010380 con 0x7f25ac108630 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:22.969+0000 7f25b2e00700 1 -- 172.21.15.159:0/3300351166 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f25ac10ca60 con 0x7f25ac108630 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.340+0000 7f25a8c00700 1 -- 172.21.15.159:0/3300351166 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f259c02d770 con 0x7f25ac108630 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.343+0000 7f25a8c00700 1 -- 172.21.15.159:0/3300351166 <== mon.0 v2:172.21.15.159:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f259c02cc30 con 0x7f25ac108630 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.347+0000 7f25b2e00700 1 -- 172.21.15.159:0/3300351166 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f2590038370 msgr2=0x7f259003a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.347+0000 7f25b2e00700 1 --2- 172.21.15.159:0/3300351166 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f2590038370 0x7f259003a830 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2598006fd0 tx=0x7f2598006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.347+0000 7f25b2e00700 1 -- 172.21.15.159:0/3300351166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 msgr2=0x7f25ac19c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.347+0000 7f25b2e00700 1 --2- 172.21.15.159:0/3300351166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac19c3c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f259c011670 tx=0x7f259c011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.347+0000 7f25b2e00700 1 -- 172.21.15.159:0/3300351166 shutdown_connections 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.347+0000 7f25b2e00700 1 --2- 172.21.15.159:0/3300351166 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7f2590038370 0x7f259003a830 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.347+0000 7f25b2e00700 1 --2- 172.21.15.159:0/3300351166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac108630 0x7f25ac19c3c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:24.081 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.347+0000 7f25b2e00700 1 -- 172.21.15.159:0/3300351166 >> 172.21.15.159:0/3300351166 conn(0x7f25ac103c10 msgr2=0x7f25ac105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:24.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.348+0000 7f25b2e00700 1 -- 172.21.15.159:0/3300351166 shutdown_connections 2024-02-28T22:55:24.082 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:23.348+0000 7f25b2e00700 1 -- 172.21.15.159:0/3300351166 wait complete. 2024-02-28T22:55:24.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:24 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3300351166' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-28T22:55:24.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:24 smithi159 ceph-mon[28802]: mgrmap e9: smithi159.pobewk(active, since 33s) 2024-02-28T22:55:25.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:25 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/249568680' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-02-28T22:55:25.677 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-02-28T22:55:25.684 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "available": true, 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "active_name": "smithi159.pobewk", 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.703+0000 7fed98000700 1 Processor -- start 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.703+0000 7fed98000700 1 -- start start 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.704+0000 7fed98000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed90106850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.704+0000 7fed98000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed90106e20 con 0x7fed90106430 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.704+0000 7fed95600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed90106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.704+0000 7fed95600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed90106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60692/0 (socket says 172.21.15.159:60692) 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.704+0000 7fed95600700 1 -- 172.21.15.159:0/3718075819 learned_addr learned my addr 172.21.15.159:0/3718075819 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.705+0000 7fed95600700 1 -- 172.21.15.159:0/3718075819 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed90107630 con 0x7fed90106430 2024-02-28T22:55:25.685 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.705+0000 7fed95600700 1 --2- 172.21.15.159:0/3718075819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed90106850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed840098a0 tx=0x7fed84009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f72f0b68067353bf server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.705+0000 7fed8fe00700 1 -- 172.21.15.159:0/3718075819 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed84004180 con 0x7fed90106430 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.705+0000 7fed8fe00700 1 -- 172.21.15.159:0/3718075819 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed840042e0 con 0x7fed90106430 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.705+0000 7fed8fe00700 1 -- 172.21.15.159:0/3718075819 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed84011af0 con 0x7fed90106430 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.706+0000 7fed98000700 1 -- 172.21.15.159:0/3718075819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 msgr2=0x7fed90106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.706+0000 7fed98000700 1 --2- 172.21.15.159:0/3718075819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed90106850 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fed840098a0 tx=0x7fed84009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.706+0000 7fed98000700 1 -- 172.21.15.159:0/3718075819 shutdown_connections 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.706+0000 7fed98000700 1 --2- 172.21.15.159:0/3718075819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed90106850 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.706+0000 7fed98000700 1 -- 172.21.15.159:0/3718075819 >> 172.21.15.159:0/3718075819 conn(0x7fed901019b0 msgr2=0x7fed90103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.706+0000 7fed98000700 1 -- 172.21.15.159:0/3718075819 shutdown_connections 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.707+0000 7fed98000700 1 -- 172.21.15.159:0/3718075819 wait complete. 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.708+0000 7fed98000700 1 Processor -- start 2024-02-28T22:55:25.686 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.708+0000 7fed98000700 1 -- start start 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.709+0000 7fed98000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed9019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.709+0000 7fed98000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9019a6b0 con 0x7fed90106430 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.709+0000 7fed95600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed9019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.709+0000 7fed95600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed9019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60706/0 (socket says 172.21.15.159:60706) 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.709+0000 7fed95600700 1 -- 172.21.15.159:0/249568680 learned_addr learned my addr 172.21.15.159:0/249568680 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.709+0000 7fed95600700 1 -- 172.21.15.159:0/249568680 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84009550 con 0x7fed90106430 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.709+0000 7fed95600700 1 --2- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed9019a170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed84011670 tx=0x7fed84011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.710+0000 7fed8e000700 1 -- 172.21.15.159:0/249568680 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed840039c0 con 0x7fed90106430 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.710+0000 7fed98000700 1 -- 172.21.15.159:0/249568680 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9019a8b0 con 0x7fed90106430 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.710+0000 7fed8e000700 1 -- 172.21.15.159:0/249568680 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fed84003b20 con 0x7fed90106430 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.710+0000 7fed8e000700 1 -- 172.21.15.159:0/249568680 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fed840247f0 con 0x7fed90106430 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.710+0000 7fed98000700 1 -- 172.21.15.159:0/249568680 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9019ad50 con 0x7fed90106430 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.711+0000 7fed8e000700 1 -- 172.21.15.159:0/249568680 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7fed84024ab0 con 0x7fed90106430 2024-02-28T22:55:25.687 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.711+0000 7fed98000700 1 -- 172.21.15.159:0/249568680 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed900623c0 con 0x7fed90106430 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.711+0000 7fed8e000700 1 --2- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fed78038380 0x7fed7803a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.711+0000 7fed8e000700 1 -- 172.21.15.159:0/249568680 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fed8404c570 con 0x7fed90106430 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.712+0000 7fed94c00700 1 -- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fed78038380 msgr2=0x7fed7803a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2133007913 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.712+0000 7fed94c00700 1 --2- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fed78038380 0x7fed7803a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.717+0000 7fed8e000700 1 -- 172.21.15.159:0/249568680 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fed840189a0 con 0x7fed90106430 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.913+0000 7fed94c00700 1 -- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fed78038380 msgr2=0x7fed7803a840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2133007913 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.913+0000 7fed94c00700 1 --2- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fed78038380 0x7fed7803a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.985+0000 7fed98000700 1 -- 172.21.15.159:0/249568680 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fed9010a860 con 0x7fed90106430 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.986+0000 7fed8e000700 1 -- 172.21.15.159:0/249568680 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fed84018350 con 0x7fed90106430 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.988+0000 7fed98000700 1 -- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fed78038380 msgr2=0x7fed7803a840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.988+0000 7fed98000700 1 --2- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fed78038380 0x7fed7803a840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.988+0000 7fed98000700 1 -- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 msgr2=0x7fed9019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:25.688 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.988+0000 7fed98000700 1 --2- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed9019a170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fed84011670 tx=0x7fed84011aa0 comp rx=0 tx=0).stop 2024-02-28T22:55:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.989+0000 7fed98000700 1 -- 172.21.15.159:0/249568680 shutdown_connections 2024-02-28T22:55:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.989+0000 7fed98000700 1 --2- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fed78038380 0x7fed7803a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.989+0000 7fed98000700 1 --2- 172.21.15.159:0/249568680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fed90106430 0x7fed9019a170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.989+0000 7fed98000700 1 -- 172.21.15.159:0/249568680 >> 172.21.15.159:0/249568680 conn(0x7fed901019b0 msgr2=0x7fed901030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.989+0000 7fed98000700 1 -- 172.21.15.159:0/249568680 shutdown_connections 2024-02-28T22:55:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:24.989+0000 7fed98000700 1 -- 172.21.15.159:0/249568680 wait complete. 2024-02-28T22:55:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for the mgr to restart... 2024-02-28T22:55:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:Waiting for mgr epoch 9... 2024-02-28T22:55:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:32 smithi159 ceph-mon[28802]: Active manager daemon smithi159.pobewk restarted 2024-02-28T22:55:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:32 smithi159 ceph-mon[28802]: Activating manager daemon smithi159.pobewk 2024-02-28T22:55:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:32 smithi159 ceph-mon[28802]: osdmap e3: 0 total, 0 up, 0 in 2024-02-28T22:55:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:32 smithi159 ceph-mon[28802]: mgrmap e10: smithi159.pobewk(active, starting, since 0.00909626s) 2024-02-28T22:55:32.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:32 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T22:55:32.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:32 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi159.pobewk", "id": "smithi159.pobewk"}]: dispatch 2024-02-28T22:55:32.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:32 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T22:55:32.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:32 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T22:55:32.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:32 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T22:55:32.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:32 smithi159 ceph-mon[28802]: Manager daemon smithi159.pobewk is now available 2024-02-28T22:55:32.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:32 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:55:33.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:33 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:55:33.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:33 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/mirror_snapshot_schedule"}]: dispatch 2024-02-28T22:55:33.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:33 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/trash_purge_schedule"}]: dispatch 2024-02-28T22:55:33.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:33 smithi159 ceph-mon[28802]: [28/Feb/2024:22:55:32] ENGINE Bus STARTING 2024-02-28T22:55:33.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:33 smithi159 ceph-mon[28802]: mgrmap e11: smithi159.pobewk(active, since 1.01062s) 2024-02-28T22:55:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:34 smithi159 ceph-mon[28802]: [28/Feb/2024:22:55:32] ENGINE Serving on https://172.21.15.159:7150 2024-02-28T22:55:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:34 smithi159 ceph-mon[28802]: [28/Feb/2024:22:55:32] ENGINE Serving on http://172.21.15.159:8765 2024-02-28T22:55:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:34 smithi159 ceph-mon[28802]: [28/Feb/2024:22:55:32] ENGINE Bus STARTED 2024-02-28T22:55:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:34 smithi159 ceph-mon[28802]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-02-28T22:55:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:34 smithi159 ceph-mon[28802]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-02-28T22:55:34.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout { 2024-02-28T22:55:34.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-02-28T22:55:34.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout "initialized": true 2024-02-28T22:55:34.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout } 2024-02-28T22:55:34.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.271+0000 7fdf84e00700 1 Processor -- start 2024-02-28T22:55:34.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.271+0000 7fdf84e00700 1 -- start start 2024-02-28T22:55:34.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.271+0000 7fdf84e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf80106850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:34.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.271+0000 7fdf84e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf80106e20 con 0x7fdf80106430 2024-02-28T22:55:34.591 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.272+0000 7fdf7de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf80106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.272+0000 7fdf7de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf80106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60716/0 (socket says 172.21.15.159:60716) 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.272+0000 7fdf7de00700 1 -- 172.21.15.159:0/1195537598 learned_addr learned my addr 172.21.15.159:0/1195537598 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.272+0000 7fdf7de00700 1 -- 172.21.15.159:0/1195537598 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf80107630 con 0x7fdf80106430 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.272+0000 7fdf7de00700 1 --2- 172.21.15.159:0/1195537598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf80106850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf700098a0 tx=0x7fdf70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=166b3639d7bdb36a server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.273+0000 7fdf7ca00700 1 -- 172.21.15.159:0/1195537598 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf70004180 con 0x7fdf80106430 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.273+0000 7fdf7ca00700 1 -- 172.21.15.159:0/1195537598 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdf700042e0 con 0x7fdf80106430 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.273+0000 7fdf7ca00700 1 -- 172.21.15.159:0/1195537598 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf70011af0 con 0x7fdf80106430 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.273+0000 7fdf84e00700 1 -- 172.21.15.159:0/1195537598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 msgr2=0x7fdf80106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.273+0000 7fdf84e00700 1 --2- 172.21.15.159:0/1195537598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf80106850 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdf700098a0 tx=0x7fdf70009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.274+0000 7fdf84e00700 1 -- 172.21.15.159:0/1195537598 shutdown_connections 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.274+0000 7fdf84e00700 1 --2- 172.21.15.159:0/1195537598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf80106850 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.274+0000 7fdf84e00700 1 -- 172.21.15.159:0/1195537598 >> 172.21.15.159:0/1195537598 conn(0x7fdf801019b0 msgr2=0x7fdf80103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:34.592 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.274+0000 7fdf84e00700 1 -- 172.21.15.159:0/1195537598 shutdown_connections 2024-02-28T22:55:34.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.274+0000 7fdf84e00700 1 -- 172.21.15.159:0/1195537598 wait complete. 2024-02-28T22:55:34.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.275+0000 7fdf84e00700 1 Processor -- start 2024-02-28T22:55:34.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.275+0000 7fdf84e00700 1 -- start start 2024-02-28T22:55:34.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.276+0000 7fdf84e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf8019a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:34.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.276+0000 7fdf84e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8019a6b0 con 0x7fdf80106430 2024-02-28T22:55:34.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.276+0000 7fdf7de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf8019a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:34.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.276+0000 7fdf7de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf8019a170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60718/0 (socket says 172.21.15.159:60718) 2024-02-28T22:55:34.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.276+0000 7fdf7de00700 1 -- 172.21.15.159:0/3053411368 learned_addr learned my addr 172.21.15.159:0/3053411368 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:34.593 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.276+0000 7fdf7de00700 1 -- 172.21.15.159:0/3053411368 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf70009550 con 0x7fdf80106430 2024-02-28T22:55:34.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.276+0000 7fdf7de00700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf8019a170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdf70011670 tx=0x7fdf70011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:34.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.277+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf700039f0 con 0x7fdf80106430 2024-02-28T22:55:34.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.277+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdf70003b50 con 0x7fdf80106430 2024-02-28T22:55:34.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.277+0000 7fdf84e00700 1 -- 172.21.15.159:0/3053411368 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8019a8b0 con 0x7fdf80106430 2024-02-28T22:55:34.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.277+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf700247c0 con 0x7fdf80106430 2024-02-28T22:55:34.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.277+0000 7fdf84e00700 1 -- 172.21.15.159:0/3053411368 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8019ad50 con 0x7fdf80106430 2024-02-28T22:55:34.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.278+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 9) v1 ==== 45296+0+0 (secure 0 0 0) 0x7fdf7002d3f0 con 0x7fdf80106430 2024-02-28T22:55:34.597 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.279+0000 7fdf76a00700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 0x7fdf6403a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.279+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 --> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf6403af40 con 0x7fdf64038370 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.279+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fdf7004c490 con 0x7fdf80106430 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.279+0000 7fdf7d400700 1 -- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 msgr2=0x7fdf6403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2133007913 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.279+0000 7fdf7d400700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 0x7fdf6403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.480+0000 7fdf7d400700 1 -- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 msgr2=0x7fdf6403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2133007913 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.480+0000 7fdf7d400700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 0x7fdf6403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.881+0000 7fdf7d400700 1 -- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 msgr2=0x7fdf6403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2133007913 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:26.881+0000 7fdf7d400700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 0x7fdf6403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:27.682+0000 7fdf7d400700 1 -- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 msgr2=0x7fdf6403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2133007913 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:27.682+0000 7fdf7d400700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 0x7fdf6403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:29.284+0000 7fdf7d400700 1 -- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 msgr2=0x7fdf6403a830 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2133007913 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:29.284+0000 7fdf7d400700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 0x7fdf6403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-02-28T22:55:34.598 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:32.108+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mgrmap(e 10) v1 ==== 45063+0+0 (secure 0 0 0) 0x7fdf7002d920 con 0x7fdf80106430 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:32.109+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 msgr2=0x7fdf6403a830 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:32.109+0000 7fdf76a00700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 0x7fdf6403a830 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.110+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 11) v1 ==== 45190+0+0 (secure 0 0 0) 0x7fdf7004e040 con 0x7fdf80106430 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.110+0000 7fdf76a00700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fdf6403bde0 0x7fdf6403e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.110+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 --> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf6403af40 con 0x7fdf6403bde0 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.111+0000 7fdf7d400700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fdf6403bde0 0x7fdf6403e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.111+0000 7fdf7d400700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fdf6403bde0 0x7fdf6403e1d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c003a10 tx=0x7fdf6c0092b0 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.112+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 <== mgr.14164 v2:172.21.15.159:6800/2559284946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fdf6403af40 con 0x7fdf6403bde0 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.120+0000 7fdf84e00700 1 -- 172.21.15.159:0/3053411368 --> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fdf8019b4b0 con 0x7fdf6403bde0 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.120+0000 7fdf76a00700 1 -- 172.21.15.159:0/3053411368 <== mgr.14164 v2:172.21.15.159:6800/2559284946 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fdf8019b4b0 con 0x7fdf6403bde0 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.120+0000 7fdf84e00700 1 -- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fdf6403bde0 msgr2=0x7fdf6403e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.120+0000 7fdf84e00700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fdf6403bde0 0x7fdf6403e1d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c003a10 tx=0x7fdf6c0092b0 comp rx=0 tx=0).stop 2024-02-28T22:55:34.599 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.120+0000 7fdf84e00700 1 -- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 msgr2=0x7fdf8019a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:34.600 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.120+0000 7fdf84e00700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf8019a170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdf70011670 tx=0x7fdf70011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:34.600 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.121+0000 7fdf84e00700 1 -- 172.21.15.159:0/3053411368 shutdown_connections 2024-02-28T22:55:34.600 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.121+0000 7fdf84e00700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdf80106430 0x7fdf8019a170 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:34.600 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.121+0000 7fdf84e00700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fdf6403bde0 0x7fdf6403e1d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:34.600 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.121+0000 7fdf84e00700 1 --2- 172.21.15.159:0/3053411368 >> [v2:172.21.15.159:6800/2133007913,v1:172.21.15.159:6801/2133007913] conn(0x7fdf64038370 0x7fdf6403a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:34.600 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.121+0000 7fdf84e00700 1 -- 172.21.15.159:0/3053411368 >> 172.21.15.159:0/3053411368 conn(0x7fdf801019b0 msgr2=0x7fdf801030c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:34.600 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.121+0000 7fdf84e00700 1 -- 172.21.15.159:0/3053411368 shutdown_connections 2024-02-28T22:55:34.600 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:33.121+0000 7fdf84e00700 1 -- 172.21.15.159:0/3053411368 wait complete. 2024-02-28T22:55:34.600 INFO:teuthology.orchestra.run.smithi159.stdout:mgr epoch 9 is available 2024-02-28T22:55:34.600 INFO:teuthology.orchestra.run.smithi159.stdout:Generating a dashboard self-signed certificate... 2024-02-28T22:55:35.453 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:35 smithi159 ceph-mon[28802]: mgrmap e12: smithi159.pobewk(active, since 2s) 2024-02-28T22:55:35.453 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:35 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:36.154 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.135+0000 7f0c17e00700 1 Processor -- start 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.136+0000 7f0c17e00700 1 -- start start 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.136+0000 7f0c17e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c1007a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.136+0000 7f0c17e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c1007a920 con 0x7f0c1007bef0 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.136+0000 7f0c15400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c1007a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.136+0000 7f0c15400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c1007a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40202/0 (socket says 172.21.15.159:40202) 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.136+0000 7f0c15400700 1 -- 172.21.15.159:0/556233421 learned_addr learned my addr 172.21.15.159:0/556233421 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.137+0000 7f0c15400700 1 -- 172.21.15.159:0/556233421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c1007aa60 con 0x7f0c1007bef0 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.137+0000 7f0c15400700 1 --2- 172.21.15.159:0/556233421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c1007a350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c040098a0 tx=0x7f0c04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4911a78927d96ab server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.138+0000 7f0c0fe00700 1 -- 172.21.15.159:0/556233421 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c04004180 con 0x7f0c1007bef0 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.138+0000 7f0c0fe00700 1 -- 172.21.15.159:0/556233421 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0c040042e0 con 0x7f0c1007bef0 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.138+0000 7f0c0fe00700 1 -- 172.21.15.159:0/556233421 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c04011af0 con 0x7f0c1007bef0 2024-02-28T22:55:36.155 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.138+0000 7f0c17e00700 1 -- 172.21.15.159:0/556233421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 msgr2=0x7f0c1007a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.138+0000 7f0c17e00700 1 --2- 172.21.15.159:0/556233421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c1007a350 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0c040098a0 tx=0x7f0c04009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.138+0000 7f0c17e00700 1 -- 172.21.15.159:0/556233421 shutdown_connections 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.138+0000 7f0c17e00700 1 --2- 172.21.15.159:0/556233421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c1007a350 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.139+0000 7f0c17e00700 1 -- 172.21.15.159:0/556233421 >> 172.21.15.159:0/556233421 conn(0x7f0c10101a00 msgr2=0x7f0c10103e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.139+0000 7f0c17e00700 1 -- 172.21.15.159:0/556233421 shutdown_connections 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.139+0000 7f0c17e00700 1 -- 172.21.15.159:0/556233421 wait complete. 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.140+0000 7f0c17e00700 1 Processor -- start 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.140+0000 7f0c17e00700 1 -- start start 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.140+0000 7f0c17e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c101a06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.140+0000 7f0c17e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c101a0c30 con 0x7f0c1007bef0 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.141+0000 7f0c15400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c101a06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.141+0000 7f0c15400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c101a06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40208/0 (socket says 172.21.15.159:40208) 2024-02-28T22:55:36.156 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.141+0000 7f0c15400700 1 -- 172.21.15.159:0/1578008998 learned_addr learned my addr 172.21.15.159:0/1578008998 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.141+0000 7f0c15400700 1 -- 172.21.15.159:0/1578008998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c04009550 con 0x7f0c1007bef0 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.141+0000 7f0c15400700 1 --2- 172.21.15.159:0/1578008998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c101a06f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c04000c00 tx=0x7f0c04011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.142+0000 7f0c0e000700 1 -- 172.21.15.159:0/1578008998 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c04003a70 con 0x7f0c1007bef0 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.142+0000 7f0c0e000700 1 -- 172.21.15.159:0/1578008998 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0c04003bd0 con 0x7f0c1007bef0 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.142+0000 7f0c0e000700 1 -- 172.21.15.159:0/1578008998 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c040238c0 con 0x7f0c1007bef0 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.142+0000 7f0c17e00700 1 -- 172.21.15.159:0/1578008998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c101a0e30 con 0x7f0c1007bef0 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.142+0000 7f0c17e00700 1 -- 172.21.15.159:0/1578008998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c101a12d0 con 0x7f0c1007bef0 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.143+0000 7f0c0e000700 1 -- 172.21.15.159:0/1578008998 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 12) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f0c04023b30 con 0x7f0c1007bef0 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.143+0000 7f0c17e00700 1 -- 172.21.15.159:0/1578008998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c101083e0 con 0x7f0c1007bef0 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.144+0000 7f0c0e000700 1 --2- 172.21.15.159:0/1578008998 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f0bf80383c0 0x7f0bf803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.144+0000 7f0c0e000700 1 -- 172.21.15.159:0/1578008998 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f0c0404c2b0 con 0x7f0c1007bef0 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.145+0000 7f0c14a00700 1 --2- 172.21.15.159:0/1578008998 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f0bf80383c0 0x7f0bf803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:36.157 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.145+0000 7f0c14a00700 1 --2- 172.21.15.159:0/1578008998 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f0bf80383c0 0x7f0bf803a880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc006fd0 tx=0x7f0bfc006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.150+0000 7f0c0e000700 1 -- 172.21.15.159:0/1578008998 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0c04010380 con 0x7f0c1007bef0 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.372+0000 7f0c17e00700 1 -- 172.21.15.159:0/1578008998 --> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f0c10103680 con 0x7f0bf80383c0 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.454+0000 7f0c0e000700 1 -- 172.21.15.159:0/1578008998 <== mgr.14164 v2:172.21.15.159:6800/2559284946 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f0c10103680 con 0x7f0bf80383c0 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.457+0000 7f0c17e00700 1 -- 172.21.15.159:0/1578008998 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f0bf80383c0 msgr2=0x7f0bf803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.457+0000 7f0c17e00700 1 --2- 172.21.15.159:0/1578008998 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f0bf80383c0 0x7f0bf803a880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc006fd0 tx=0x7f0bfc006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.457+0000 7f0c17e00700 1 -- 172.21.15.159:0/1578008998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 msgr2=0x7f0c101a06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.457+0000 7f0c17e00700 1 --2- 172.21.15.159:0/1578008998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c101a06f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c04000c00 tx=0x7f0c04011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.457+0000 7f0c17e00700 1 -- 172.21.15.159:0/1578008998 shutdown_connections 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.457+0000 7f0c17e00700 1 --2- 172.21.15.159:0/1578008998 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f0bf80383c0 0x7f0bf803a880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.457+0000 7f0c17e00700 1 --2- 172.21.15.159:0/1578008998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c1007bef0 0x7f0c101a06f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.457+0000 7f0c17e00700 1 -- 172.21.15.159:0/1578008998 >> 172.21.15.159:0/1578008998 conn(0x7f0c10101a00 msgr2=0x7f0c10107610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.458+0000 7f0c17e00700 1 -- 172.21.15.159:0/1578008998 shutdown_connections 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:35.458+0000 7f0c17e00700 1 -- 172.21.15.159:0/1578008998 wait complete. 2024-02-28T22:55:36.158 INFO:teuthology.orchestra.run.smithi159.stdout:Creating initial admin user... 2024-02-28T22:55:36.714 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:36 smithi159 ceph-mon[28802]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:36.714 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:36 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:36.714 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:36 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:36.714 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:36 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:38.347 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Xgh4OSUNFcbrKcjlVVs8Ve/eVrPR9ar1TVpweuzv2hbQTGRcVMuKu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1709160937, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-28T22:55:38.347 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.740+0000 7f2356c00700 1 Processor -- start 2024-02-28T22:55:38.347 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.740+0000 7f2356c00700 1 -- start start 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.741+0000 7f2356c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f23500791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.741+0000 7f2356c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2350079790 con 0x7f235007ad60 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.741+0000 7f234fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f23500791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.741+0000 7f234fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f23500791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40222/0 (socket says 172.21.15.159:40222) 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.741+0000 7f234fe00700 1 -- 172.21.15.159:0/1589879860 learned_addr learned my addr 172.21.15.159:0/1589879860 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.742+0000 7f234fe00700 1 -- 172.21.15.159:0/1589879860 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23500798d0 con 0x7f235007ad60 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.742+0000 7f234fe00700 1 --2- 172.21.15.159:0/1589879860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f23500791c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23400098a0 tx=0x7f2340009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e756475a05776d72 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.742+0000 7f234ea00700 1 -- 172.21.15.159:0/1589879860 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2340004180 con 0x7f235007ad60 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.742+0000 7f234ea00700 1 -- 172.21.15.159:0/1589879860 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f23400042e0 con 0x7f235007ad60 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.742+0000 7f234ea00700 1 -- 172.21.15.159:0/1589879860 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2340011af0 con 0x7f235007ad60 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.743+0000 7f2356c00700 1 -- 172.21.15.159:0/1589879860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 msgr2=0x7f23500791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.743+0000 7f2356c00700 1 --2- 172.21.15.159:0/1589879860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f23500791c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23400098a0 tx=0x7f2340009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:38.348 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.743+0000 7f2356c00700 1 -- 172.21.15.159:0/1589879860 shutdown_connections 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.743+0000 7f2356c00700 1 --2- 172.21.15.159:0/1589879860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f23500791c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.743+0000 7f2356c00700 1 -- 172.21.15.159:0/1589879860 >> 172.21.15.159:0/1589879860 conn(0x7f23501019b0 msgr2=0x7f2350103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.743+0000 7f2356c00700 1 -- 172.21.15.159:0/1589879860 shutdown_connections 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.743+0000 7f2356c00700 1 -- 172.21.15.159:0/1589879860 wait complete. 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.744+0000 7f2356c00700 1 Processor -- start 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.744+0000 7f2356c00700 1 -- start start 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.745+0000 7f2356c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f235019c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.745+0000 7f2356c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235019c8c0 con 0x7f235007ad60 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.745+0000 7f234fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f235019c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.745+0000 7f234fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f235019c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40234/0 (socket says 172.21.15.159:40234) 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.745+0000 7f234fe00700 1 -- 172.21.15.159:0/3387563258 learned_addr learned my addr 172.21.15.159:0/3387563258 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.745+0000 7f234fe00700 1 -- 172.21.15.159:0/3387563258 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2340009550 con 0x7f235007ad60 2024-02-28T22:55:38.349 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.746+0000 7f234fe00700 1 --2- 172.21.15.159:0/3387563258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f235019c380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2340011670 tx=0x7f2340011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.746+0000 7f234cc00700 1 -- 172.21.15.159:0/3387563258 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2340003a40 con 0x7f235007ad60 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.746+0000 7f234cc00700 1 -- 172.21.15.159:0/3387563258 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2340003ba0 con 0x7f235007ad60 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.746+0000 7f2356c00700 1 -- 172.21.15.159:0/3387563258 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f235019cac0 con 0x7f235007ad60 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.746+0000 7f234cc00700 1 -- 172.21.15.159:0/3387563258 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2340024790 con 0x7f235007ad60 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.746+0000 7f2356c00700 1 -- 172.21.15.159:0/3387563258 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235019cf60 con 0x7f235007ad60 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.747+0000 7f234cc00700 1 -- 172.21.15.159:0/3387563258 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 12) v1 ==== 45296+0+0 (secure 0 0 0) 0x7f234002d3f0 con 0x7f235007ad60 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.747+0000 7f2356c00700 1 -- 172.21.15.159:0/3387563258 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235010c7d0 con 0x7f235007ad60 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.748+0000 7f234cc00700 1 --2- 172.21.15.159:0/3387563258 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f2334038410 0x7f233403a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.748+0000 7f234cc00700 1 -- 172.21.15.159:0/3387563258 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f234004c790 con 0x7f235007ad60 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.748+0000 7f234f400700 1 --2- 172.21.15.159:0/3387563258 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f2334038410 0x7f233403a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.749+0000 7f234f400700 1 --2- 172.21.15.159:0/3387563258 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f2334038410 0x7f233403a8d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f233c006fd0 tx=0x7f233c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:36.753+0000 7f234cc00700 1 -- 172.21.15.159:0/3387563258 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2340010bd0 con 0x7f235007ad60 2024-02-28T22:55:38.350 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.023+0000 7f2356c00700 1 -- 172.21.15.159:0/3387563258 --> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f235010c9f0 con 0x7f2334038410 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.265+0000 7f234cc00700 1 -- 172.21.15.159:0/3387563258 <== mgr.14164 v2:172.21.15.159:6800/2559284946 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f235010c9f0 con 0x7f2334038410 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.267+0000 7f2356c00700 1 -- 172.21.15.159:0/3387563258 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f2334038410 msgr2=0x7f233403a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.267+0000 7f2356c00700 1 --2- 172.21.15.159:0/3387563258 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f2334038410 0x7f233403a8d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f233c006fd0 tx=0x7f233c006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.267+0000 7f2356c00700 1 -- 172.21.15.159:0/3387563258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 msgr2=0x7f235019c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.267+0000 7f2356c00700 1 --2- 172.21.15.159:0/3387563258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f235019c380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2340011670 tx=0x7f2340011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.268+0000 7f2356c00700 1 -- 172.21.15.159:0/3387563258 shutdown_connections 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.268+0000 7f2356c00700 1 --2- 172.21.15.159:0/3387563258 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f2334038410 0x7f233403a8d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.268+0000 7f2356c00700 1 --2- 172.21.15.159:0/3387563258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f235007ad60 0x7f235019c380 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.268+0000 7f2356c00700 1 -- 172.21.15.159:0/3387563258 >> 172.21.15.159:0/3387563258 conn(0x7f23501019b0 msgr2=0x7f2350103110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.268+0000 7f2356c00700 1 -- 172.21.15.159:0/3387563258 shutdown_connections 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:37.268+0000 7f2356c00700 1 -- 172.21.15.159:0/3387563258 wait complete. 2024-02-28T22:55:38.351 INFO:teuthology.orchestra.run.smithi159.stdout:Fetching dashboard port number... 2024-02-28T22:55:38.558 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:38 smithi159 ceph-mon[28802]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:38.558 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:38 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:40.313 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:40 smithi159 ceph-mon[28802]: mgrmap e13: smithi159.pobewk(active, since 6s) 2024-02-28T22:55:40.313 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:40 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3927888335' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-28T22:55:40.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stdout 8443 2024-02-28T22:55:40.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.343+0000 7f7621e00700 1 Processor -- start 2024-02-28T22:55:40.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.343+0000 7f7621e00700 1 -- start start 2024-02-28T22:55:40.327 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.344+0000 7f7621e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c108a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:40.332 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.344+0000 7f7621e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c109010 con 0x7f761c108620 2024-02-28T22:55:40.332 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.344+0000 7f761aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c108a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.344+0000 7f761aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c108a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52616/0 (socket says 172.21.15.159:52616) 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.344+0000 7f761aa00700 1 -- 172.21.15.159:0/1099092054 learned_addr learned my addr 172.21.15.159:0/1099092054 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.345+0000 7f761aa00700 1 -- 172.21.15.159:0/1099092054 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f761c109820 con 0x7f761c108620 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.345+0000 7f761aa00700 1 --2- 172.21.15.159:0/1099092054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c108a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f760c0098a0 tx=0x7f760c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1103b4efd3827f server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.345+0000 7f7619600700 1 -- 172.21.15.159:0/1099092054 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f760c004180 con 0x7f761c108620 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.345+0000 7f7619600700 1 -- 172.21.15.159:0/1099092054 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f760c0042e0 con 0x7f761c108620 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.345+0000 7f7619600700 1 -- 172.21.15.159:0/1099092054 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f760c011af0 con 0x7f761c108620 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.346+0000 7f7621e00700 1 -- 172.21.15.159:0/1099092054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 msgr2=0x7f761c108a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.346+0000 7f7621e00700 1 --2- 172.21.15.159:0/1099092054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c108a40 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f760c0098a0 tx=0x7f760c009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.346+0000 7f7621e00700 1 -- 172.21.15.159:0/1099092054 shutdown_connections 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.346+0000 7f7621e00700 1 --2- 172.21.15.159:0/1099092054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c108a40 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:40.333 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.346+0000 7f7621e00700 1 -- 172.21.15.159:0/1099092054 >> 172.21.15.159:0/1099092054 conn(0x7f761c07bb20 msgr2=0x7f761c1064e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.346+0000 7f7621e00700 1 -- 172.21.15.159:0/1099092054 shutdown_connections 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.346+0000 7f7621e00700 1 -- 172.21.15.159:0/1099092054 wait complete. 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.348+0000 7f7621e00700 1 Processor -- start 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.348+0000 7f7621e00700 1 -- start start 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.348+0000 7f7621e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c19c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.348+0000 7f7621e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761c19c920 con 0x7f761c108620 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.348+0000 7f761aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c19c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.348+0000 7f761aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c19c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52624/0 (socket says 172.21.15.159:52624) 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.348+0000 7f761aa00700 1 -- 172.21.15.159:0/3927888335 learned_addr learned my addr 172.21.15.159:0/3927888335 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.349+0000 7f761aa00700 1 -- 172.21.15.159:0/3927888335 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f760c009550 con 0x7f761c108620 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.349+0000 7f761aa00700 1 --2- 172.21.15.159:0/3927888335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c19c3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f760c011670 tx=0x7f760c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.349+0000 7f7620a00700 1 -- 172.21.15.159:0/3927888335 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f760c0039f0 con 0x7f761c108620 2024-02-28T22:55:40.334 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.349+0000 7f7620a00700 1 -- 172.21.15.159:0/3927888335 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f760c003b50 con 0x7f761c108620 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.349+0000 7f7620a00700 1 -- 172.21.15.159:0/3927888335 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f760c0247c0 con 0x7f761c108620 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.349+0000 7f7621e00700 1 -- 172.21.15.159:0/3927888335 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f761c19cb20 con 0x7f761c108620 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.350+0000 7f7621e00700 1 -- 172.21.15.159:0/3927888335 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f761c19cfc0 con 0x7f761c108620 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.351+0000 7f7620a00700 1 -- 172.21.15.159:0/3927888335 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f760c01ac00 con 0x7f761c108620 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.351+0000 7f7621e00700 1 -- 172.21.15.159:0/3927888335 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f761c0623c0 con 0x7f761c108620 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.351+0000 7f7620a00700 1 --2- 172.21.15.159:0/3927888335 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f7600038460 0x7f760003a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.351+0000 7f7620a00700 1 -- 172.21.15.159:0/3927888335 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f760c04c660 con 0x7f761c108620 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.351+0000 7f761a000700 1 --2- 172.21.15.159:0/3927888335 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f7600038460 0x7f760003a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.352+0000 7f761a000700 1 --2- 172.21.15.159:0/3927888335 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f7600038460 0x7f760003a920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7608006fd0 tx=0x7f7608006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.357+0000 7f7620a00700 1 -- 172.21.15.159:0/3927888335 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f760c01a430 con 0x7f761c108620 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.569+0000 7f7621e00700 1 -- 172.21.15.159:0/3927888335 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f761c19fec0 con 0x7f761c108620 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.570+0000 7f7620a00700 1 -- 172.21.15.159:0/3927888335 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f760c018b40 con 0x7f761c108620 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.574+0000 7f7621e00700 1 -- 172.21.15.159:0/3927888335 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f7600038460 msgr2=0x7f760003a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:40.335 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.574+0000 7f7621e00700 1 --2- 172.21.15.159:0/3927888335 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f7600038460 0x7f760003a920 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7608006fd0 tx=0x7f7608006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:40.336 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.574+0000 7f7621e00700 1 -- 172.21.15.159:0/3927888335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 msgr2=0x7f761c19c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:40.336 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.574+0000 7f7621e00700 1 --2- 172.21.15.159:0/3927888335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c19c3e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f760c011670 tx=0x7f760c011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:40.336 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.574+0000 7f7621e00700 1 -- 172.21.15.159:0/3927888335 shutdown_connections 2024-02-28T22:55:40.336 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.574+0000 7f7621e00700 1 --2- 172.21.15.159:0/3927888335 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f7600038460 0x7f760003a920 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:40.336 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.574+0000 7f7621e00700 1 --2- 172.21.15.159:0/3927888335 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f761c108620 0x7f761c19c3e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:40.336 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.574+0000 7f7621e00700 1 -- 172.21.15.159:0/3927888335 >> 172.21.15.159:0/3927888335 conn(0x7f761c07bb20 msgr2=0x7f761c1067c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:40.336 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.574+0000 7f7621e00700 1 -- 172.21.15.159:0/3927888335 shutdown_connections 2024-02-28T22:55:40.336 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:39.574+0000 7f7621e00700 1 -- 172.21.15.159:0/3927888335 wait complete. 2024-02-28T22:55:40.362 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-02-28T22:55:40.362 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout disabled 2024-02-28T22:55:40.384 INFO:teuthology.orchestra.run.smithi159.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-02-28T22:55:40.384 INFO:teuthology.orchestra.run.smithi159.stdout:systemctl: stdout inactive 2024-02-28T22:55:40.384 INFO:teuthology.orchestra.run.smithi159.stdout:firewalld.service is not enabled 2024-02-28T22:55:40.385 INFO:teuthology.orchestra.run.smithi159.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-02-28T22:55:40.391 INFO:teuthology.orchestra.run.smithi159.stdout:Ceph Dashboard is now available at: 2024-02-28T22:55:40.391 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:55:40.391 INFO:teuthology.orchestra.run.smithi159.stdout: URL: https://smithi159.front.sepia.ceph.com:8443/ 2024-02-28T22:55:40.392 INFO:teuthology.orchestra.run.smithi159.stdout: User: admin 2024-02-28T22:55:40.392 INFO:teuthology.orchestra.run.smithi159.stdout: Password: kazscxywiu 2024-02-28T22:55:40.392 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:55:40.393 INFO:teuthology.orchestra.run.smithi159.stdout:Saving cluster configuration to /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config directory 2024-02-28T22:55:40.395 INFO:teuthology.orchestra.run.smithi159.stdout:Enabling autotune for osd_memory_target 2024-02-28T22:55:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.964+0000 7fd5b8000700 1 Processor -- start 2024-02-28T22:55:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.965+0000 7fd5b8000700 1 -- start start 2024-02-28T22:55:41.886 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.965+0000 7fd5b8000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b010e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.965+0000 7fd5b8000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b010ea20 con 0x7fd5b010e030 2024-02-28T22:55:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.965+0000 7fd5b5600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b010e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.966+0000 7fd5b5600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b010e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52630/0 (socket says 172.21.15.159:52630) 2024-02-28T22:55:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.966+0000 7fd5b5600700 1 -- 172.21.15.159:0/3037011301 learned_addr learned my addr 172.21.15.159:0/3037011301 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.966+0000 7fd5b5600700 1 -- 172.21.15.159:0/3037011301 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b010eb60 con 0x7fd5b010e030 2024-02-28T22:55:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.966+0000 7fd5b5600700 1 --2- 172.21.15.159:0/3037011301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b010e450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40098a0 tx=0x7fd5a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff98e40f9ee9f4f1 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.967+0000 7fd5afe00700 1 -- 172.21.15.159:0/3037011301 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5a4004180 con 0x7fd5b010e030 2024-02-28T22:55:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.967+0000 7fd5afe00700 1 -- 172.21.15.159:0/3037011301 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd5a40042e0 con 0x7fd5b010e030 2024-02-28T22:55:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.967+0000 7fd5afe00700 1 -- 172.21.15.159:0/3037011301 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5a4011af0 con 0x7fd5b010e030 2024-02-28T22:55:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.967+0000 7fd5b8000700 1 -- 172.21.15.159:0/3037011301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 msgr2=0x7fd5b010e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:41.887 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.967+0000 7fd5b8000700 1 --2- 172.21.15.159:0/3037011301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b010e450 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd5a40098a0 tx=0x7fd5a4009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.967+0000 7fd5b8000700 1 -- 172.21.15.159:0/3037011301 shutdown_connections 2024-02-28T22:55:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.967+0000 7fd5b8000700 1 --2- 172.21.15.159:0/3037011301 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b010e450 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.967+0000 7fd5b8000700 1 -- 172.21.15.159:0/3037011301 >> 172.21.15.159:0/3037011301 conn(0x7fd5b007bb20 msgr2=0x7fd5b007df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.967+0000 7fd5b8000700 1 -- 172.21.15.159:0/3037011301 shutdown_connections 2024-02-28T22:55:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.967+0000 7fd5b8000700 1 -- 172.21.15.159:0/3037011301 wait complete. 2024-02-28T22:55:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.968+0000 7fd5b8000700 1 Processor -- start 2024-02-28T22:55:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.969+0000 7fd5b8000700 1 -- start start 2024-02-28T22:55:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.969+0000 7fd5b8000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b01a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.969+0000 7fd5b8000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b01a0d20 con 0x7fd5b010e030 2024-02-28T22:55:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.969+0000 7fd5b5600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b01a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:41.888 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.969+0000 7fd5b5600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b01a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52638/0 (socket says 172.21.15.159:52638) 2024-02-28T22:55:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.969+0000 7fd5b5600700 1 -- 172.21.15.159:0/2771120405 learned_addr learned my addr 172.21.15.159:0/2771120405 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.969+0000 7fd5b5600700 1 -- 172.21.15.159:0/2771120405 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a4009550 con 0x7fd5b010e030 2024-02-28T22:55:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.970+0000 7fd5b5600700 1 --2- 172.21.15.159:0/2771120405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b01a07e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4011670 tx=0x7fd5a4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.970+0000 7fd5ae000700 1 -- 172.21.15.159:0/2771120405 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5a40039f0 con 0x7fd5b010e030 2024-02-28T22:55:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.970+0000 7fd5ae000700 1 -- 172.21.15.159:0/2771120405 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd5a4003b50 con 0x7fd5b010e030 2024-02-28T22:55:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.970+0000 7fd5b8000700 1 -- 172.21.15.159:0/2771120405 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b01a0f20 con 0x7fd5b010e030 2024-02-28T22:55:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.970+0000 7fd5ae000700 1 -- 172.21.15.159:0/2771120405 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd5a4024690 con 0x7fd5b010e030 2024-02-28T22:55:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.970+0000 7fd5b8000700 1 -- 172.21.15.159:0/2771120405 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b01a13c0 con 0x7fd5b010e030 2024-02-28T22:55:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.971+0000 7fd5ae000700 1 -- 172.21.15.159:0/2771120405 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7fd5a401ab00 con 0x7fd5b010e030 2024-02-28T22:55:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.971+0000 7fd5b8000700 1 -- 172.21.15.159:0/2771120405 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b019a8b0 con 0x7fd5b010e030 2024-02-28T22:55:41.889 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.972+0000 7fd5ae000700 1 --2- 172.21.15.159:0/2771120405 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fd598038410 0x7fd59803a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.972+0000 7fd5ae000700 1 -- 172.21.15.159:0/2771120405 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd5a404c3b0 con 0x7fd5b010e030 2024-02-28T22:55:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.972+0000 7fd5b4c00700 1 --2- 172.21.15.159:0/2771120405 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fd598038410 0x7fd59803a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.973+0000 7fd5b4c00700 1 --2- 172.21.15.159:0/2771120405 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fd598038410 0x7fd59803a8d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd59c006fd0 tx=0x7fd59c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:40.977+0000 7fd5ae000700 1 -- 172.21.15.159:0/2771120405 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd5a4018350 con 0x7fd5b010e030 2024-02-28T22:55:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.188+0000 7fd5b8000700 1 -- 172.21.15.159:0/2771120405 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fd5b010eb60 con 0x7fd5b010e030 2024-02-28T22:55:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.189+0000 7fd5ae000700 1 -- 172.21.15.159:0/2771120405 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fd5b010eb60 con 0x7fd5b010e030 2024-02-28T22:55:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.191+0000 7fd5b8000700 1 -- 172.21.15.159:0/2771120405 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fd598038410 msgr2=0x7fd59803a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.191+0000 7fd5b8000700 1 --2- 172.21.15.159:0/2771120405 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fd598038410 0x7fd59803a8d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd59c006fd0 tx=0x7fd59c006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.191+0000 7fd5b8000700 1 -- 172.21.15.159:0/2771120405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 msgr2=0x7fd5b01a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.191+0000 7fd5b8000700 1 --2- 172.21.15.159:0/2771120405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b01a07e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4011670 tx=0x7fd5a4011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:41.890 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.191+0000 7fd5b8000700 1 -- 172.21.15.159:0/2771120405 shutdown_connections 2024-02-28T22:55:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.191+0000 7fd5b8000700 1 --2- 172.21.15.159:0/2771120405 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fd598038410 0x7fd59803a8d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.191+0000 7fd5b8000700 1 --2- 172.21.15.159:0/2771120405 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5b010e030 0x7fd5b01a07e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.191+0000 7fd5b8000700 1 -- 172.21.15.159:0/2771120405 >> 172.21.15.159:0/2771120405 conn(0x7fd5b007bb20 msgr2=0x7fd5b007e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.192+0000 7fd5b8000700 1 -- 172.21.15.159:0/2771120405 shutdown_connections 2024-02-28T22:55:41.891 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:41.192+0000 7fd5b8000700 1 -- 172.21.15.159:0/2771120405 wait complete. 2024-02-28T22:55:43.500 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.477+0000 7f9622e00700 1 Processor -- start 2024-02-28T22:55:43.501 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.477+0000 7f9622e00700 1 -- start start 2024-02-28T22:55:43.502 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.478+0000 7f9622e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c106850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:43.502 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.478+0000 7f9622e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c106e20 con 0x7f961c106430 2024-02-28T22:55:43.502 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.478+0000 7f961be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c106850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:43.502 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.478+0000 7f961be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c106850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52646/0 (socket says 172.21.15.159:52646) 2024-02-28T22:55:43.504 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.478+0000 7f961be00700 1 -- 172.21.15.159:0/1877162239 learned_addr learned my addr 172.21.15.159:0/1877162239 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:43.504 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.479+0000 7f961be00700 1 -- 172.21.15.159:0/1877162239 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f961c107630 con 0x7f961c106430 2024-02-28T22:55:43.504 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.479+0000 7f961be00700 1 --2- 172.21.15.159:0/1877162239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c106850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f960c0098a0 tx=0x7f960c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c37eb35e5875044 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:43.504 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.480+0000 7f961aa00700 1 -- 172.21.15.159:0/1877162239 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f960c004180 con 0x7f961c106430 2024-02-28T22:55:43.504 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.480+0000 7f961aa00700 1 -- 172.21.15.159:0/1877162239 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f960c0042e0 con 0x7f961c106430 2024-02-28T22:55:43.504 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.480+0000 7f961aa00700 1 -- 172.21.15.159:0/1877162239 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f960c011af0 con 0x7f961c106430 2024-02-28T22:55:43.504 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.481+0000 7f9622e00700 1 -- 172.21.15.159:0/1877162239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 msgr2=0x7f961c106850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:43.504 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.481+0000 7f9622e00700 1 --2- 172.21.15.159:0/1877162239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c106850 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f960c0098a0 tx=0x7f960c009bb0 comp rx=0 tx=0).stop 2024-02-28T22:55:43.504 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.481+0000 7f9622e00700 1 -- 172.21.15.159:0/1877162239 shutdown_connections 2024-02-28T22:55:43.505 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.481+0000 7f9622e00700 1 --2- 172.21.15.159:0/1877162239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c106850 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:43.506 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.481+0000 7f9622e00700 1 -- 172.21.15.159:0/1877162239 >> 172.21.15.159:0/1877162239 conn(0x7f961c1019b0 msgr2=0x7f961c103e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:43.506 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.481+0000 7f9622e00700 1 -- 172.21.15.159:0/1877162239 shutdown_connections 2024-02-28T22:55:43.506 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.481+0000 7f9622e00700 1 -- 172.21.15.159:0/1877162239 wait complete. 2024-02-28T22:55:43.507 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.482+0000 7f9622e00700 1 Processor -- start 2024-02-28T22:55:43.507 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.482+0000 7f9622e00700 1 -- start start 2024-02-28T22:55:43.507 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.482+0000 7f9622e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c19c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:43.507 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.482+0000 7f9622e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961c19c8e0 con 0x7f961c106430 2024-02-28T22:55:43.507 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.482+0000 7f961be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c19c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:43.507 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.483+0000 7f961be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c19c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52660/0 (socket says 172.21.15.159:52660) 2024-02-28T22:55:43.507 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.483+0000 7f961be00700 1 -- 172.21.15.159:0/2314697761 learned_addr learned my addr 172.21.15.159:0/2314697761 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:43.507 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.483+0000 7f961be00700 1 -- 172.21.15.159:0/2314697761 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c009550 con 0x7f961c106430 2024-02-28T22:55:43.507 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.483+0000 7f961be00700 1 --2- 172.21.15.159:0/2314697761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c19c3a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f960c011670 tx=0x7f960c011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:43.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.483+0000 7f9618c00700 1 -- 172.21.15.159:0/2314697761 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f960c0039f0 con 0x7f961c106430 2024-02-28T22:55:43.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.483+0000 7f9618c00700 1 -- 172.21.15.159:0/2314697761 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f960c003b50 con 0x7f961c106430 2024-02-28T22:55:43.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.484+0000 7f9622e00700 1 -- 172.21.15.159:0/2314697761 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961c19cae0 con 0x7f961c106430 2024-02-28T22:55:43.511 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.484+0000 7f9618c00700 1 -- 172.21.15.159:0/2314697761 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f960c0247c0 con 0x7f961c106430 2024-02-28T22:55:43.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.484+0000 7f9622e00700 1 -- 172.21.15.159:0/2314697761 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961c19cf80 con 0x7f961c106430 2024-02-28T22:55:43.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.485+0000 7f9618c00700 1 -- 172.21.15.159:0/2314697761 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f960c01a430 con 0x7f961c106430 2024-02-28T22:55:43.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.485+0000 7f9622e00700 1 -- 172.21.15.159:0/2314697761 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f961c0623c0 con 0x7f961c106430 2024-02-28T22:55:43.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.485+0000 7f9618c00700 1 --2- 172.21.15.159:0/2314697761 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f9600038460 0x7f960003a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:43.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.485+0000 7f9618c00700 1 -- 172.21.15.159:0/2314697761 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f960c04c670 con 0x7f961c106430 2024-02-28T22:55:43.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.485+0000 7f961b400700 1 --2- 172.21.15.159:0/2314697761 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f9600038460 0x7f960003a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:43.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.486+0000 7f961b400700 1 --2- 172.21.15.159:0/2314697761 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f9600038460 0x7f960003a920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9608006fd0 tx=0x7f9608006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:43.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.490+0000 7f9618c00700 1 -- 172.21.15.159:0/2314697761 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f960c01ac00 con 0x7f961c106430 2024-02-28T22:55:43.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.811+0000 7f9622e00700 1 -- 172.21.15.159:0/2314697761 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f961c19fdc0 con 0x7f961c106430 2024-02-28T22:55:43.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.816+0000 7f9618c00700 1 -- 172.21.15.159:0/2314697761 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v34)=0 set mgr/dashboard/cluster/status v34) v1 ==== 153+0+0 (secure 0 0 0) 0x7f960c018b40 con 0x7f961c106430 2024-02-28T22:55:43.512 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.819+0000 7f9622e00700 1 -- 172.21.15.159:0/2314697761 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f9600038460 msgr2=0x7f960003a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:43.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.819+0000 7f9622e00700 1 --2- 172.21.15.159:0/2314697761 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f9600038460 0x7f960003a920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9608006fd0 tx=0x7f9608006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:43.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.819+0000 7f9622e00700 1 -- 172.21.15.159:0/2314697761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 msgr2=0x7f961c19c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:43.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.819+0000 7f9622e00700 1 --2- 172.21.15.159:0/2314697761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c19c3a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f960c011670 tx=0x7f960c011b50 comp rx=0 tx=0).stop 2024-02-28T22:55:43.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.819+0000 7f9622e00700 1 -- 172.21.15.159:0/2314697761 shutdown_connections 2024-02-28T22:55:43.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.819+0000 7f9622e00700 1 --2- 172.21.15.159:0/2314697761 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f9600038460 0x7f960003a920 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:43.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.819+0000 7f9622e00700 1 --2- 172.21.15.159:0/2314697761 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f961c106430 0x7f961c19c3a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:43.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.819+0000 7f9622e00700 1 -- 172.21.15.159:0/2314697761 >> 172.21.15.159:0/2314697761 conn(0x7f961c1019b0 msgr2=0x7f961c1030a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:43.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.819+0000 7f9622e00700 1 -- 172.21.15.159:0/2314697761 shutdown_connections 2024-02-28T22:55:43.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr 2024-02-28T22:55:42.820+0000 7f9622e00700 1 -- 172.21.15.159:0/2314697761 wait complete. 2024-02-28T22:55:43.513 INFO:teuthology.orchestra.run.smithi159.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout:Or, if you are only running a single cluster on this host: 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout:Please consider enabling telemetry to help improve Ceph: 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: ceph telemetry on 2024-02-28T22:55:43.514 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:55:43.515 INFO:teuthology.orchestra.run.smithi159.stdout:For more information see: 2024-02-28T22:55:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:55:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-02-28T22:55:43.515 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:55:43.515 INFO:teuthology.orchestra.run.smithi159.stdout:Bootstrap complete. 2024-02-28T22:55:43.600 INFO:tasks.cephadm:Fetching config... 2024-02-28T22:55:43.601 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:55:43.601 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-28T22:55:43.650 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-28T22:55:43.650 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:55:43.650 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-28T22:55:43.729 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-28T22:55:43.729 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:55:43.729 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/keyring of=/dev/stdout 2024-02-28T22:55:43.855 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-28T22:55:43.855 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:55:43.856 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-28T22:55:43.951 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-28T22:55:43.951 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzrYe7N805mt9YObUnp2VhU1klm0MJmPyI9xpNuHHoTIXypPXcjzu7GxL0rgNVjmLCk1i7PY75v/or8yOPVGLmcL2OOmzbQSAqqI/wwefh8UxI9UwMIXQFoetW39oZ2AXSoHcaBYHSP+ifsQx9TAvgLfl+4o0iLLCuZfv9vkDWF2JdYlfhBr2gNUPR/JbdhhEQS+vA+ut+ee3Jsue72yBk/Gv34/5atsdBPx+vcNJlOn6voIZKMzbk6/LIPgn3zp6ZI9Mhvo2MlGtj0qZ35j2ljqmP+FVz0WOlO7JmREtin94Ox4lscCOhGYiBUtVZx8oGRMeLcajtLBTy8eCRHD1FNwMKmcAvctjPXmKLYoFs65JXjiLA3oneQ6jyAMfeDOuupKVdWr+ZVSavkmBFpnZXeKSxYXwkQ6mXPNCSMzPzBvZTJZ16x+Qn+wNDO7PbAeD8cJyOUStU3QY5qyukb6odfFOkOhbguKJH4bYXafd4hAhsgxdykTllj1+7Q0sQDms= ceph-24bd0fca-d68c-11ee-95c3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-28T22:55:44.059 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:43 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2314697761' entity='client.admin' 2024-02-28T22:55:44.067 INFO:teuthology.orchestra.run.smithi159.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzrYe7N805mt9YObUnp2VhU1klm0MJmPyI9xpNuHHoTIXypPXcjzu7GxL0rgNVjmLCk1i7PY75v/or8yOPVGLmcL2OOmzbQSAqqI/wwefh8UxI9UwMIXQFoetW39oZ2AXSoHcaBYHSP+ifsQx9TAvgLfl+4o0iLLCuZfv9vkDWF2JdYlfhBr2gNUPR/JbdhhEQS+vA+ut+ee3Jsue72yBk/Gv34/5atsdBPx+vcNJlOn6voIZKMzbk6/LIPgn3zp6ZI9Mhvo2MlGtj0qZ35j2ljqmP+FVz0WOlO7JmREtin94Ox4lscCOhGYiBUtVZx8oGRMeLcajtLBTy8eCRHD1FNwMKmcAvctjPXmKLYoFs65JXjiLA3oneQ6jyAMfeDOuupKVdWr+ZVSavkmBFpnZXeKSxYXwkQ6mXPNCSMzPzBvZTJZ16x+Qn+wNDO7PbAeD8cJyOUStU3QY5qyukb6odfFOkOhbguKJH4bYXafd4hAhsgxdykTllj1+7Q0sQDms= ceph-24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:55:44.134 DEBUG:teuthology.orchestra.run.smithi184:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzrYe7N805mt9YObUnp2VhU1klm0MJmPyI9xpNuHHoTIXypPXcjzu7GxL0rgNVjmLCk1i7PY75v/or8yOPVGLmcL2OOmzbQSAqqI/wwefh8UxI9UwMIXQFoetW39oZ2AXSoHcaBYHSP+ifsQx9TAvgLfl+4o0iLLCuZfv9vkDWF2JdYlfhBr2gNUPR/JbdhhEQS+vA+ut+ee3Jsue72yBk/Gv34/5atsdBPx+vcNJlOn6voIZKMzbk6/LIPgn3zp6ZI9Mhvo2MlGtj0qZ35j2ljqmP+FVz0WOlO7JmREtin94Ox4lscCOhGYiBUtVZx8oGRMeLcajtLBTy8eCRHD1FNwMKmcAvctjPXmKLYoFs65JXjiLA3oneQ6jyAMfeDOuupKVdWr+ZVSavkmBFpnZXeKSxYXwkQ6mXPNCSMzPzBvZTJZ16x+Qn+wNDO7PbAeD8cJyOUStU3QY5qyukb6odfFOkOhbguKJH4bYXafd4hAhsgxdykTllj1+7Q0sQDms= ceph-24bd0fca-d68c-11ee-95c3-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-28T22:55:44.267 INFO:teuthology.orchestra.run.smithi184.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzrYe7N805mt9YObUnp2VhU1klm0MJmPyI9xpNuHHoTIXypPXcjzu7GxL0rgNVjmLCk1i7PY75v/or8yOPVGLmcL2OOmzbQSAqqI/wwefh8UxI9UwMIXQFoetW39oZ2AXSoHcaBYHSP+ifsQx9TAvgLfl+4o0iLLCuZfv9vkDWF2JdYlfhBr2gNUPR/JbdhhEQS+vA+ut+ee3Jsue72yBk/Gv34/5atsdBPx+vcNJlOn6voIZKMzbk6/LIPgn3zp6ZI9Mhvo2MlGtj0qZ35j2ljqmP+FVz0WOlO7JmREtin94Ox4lscCOhGYiBUtVZx8oGRMeLcajtLBTy8eCRHD1FNwMKmcAvctjPXmKLYoFs65JXjiLA3oneQ6jyAMfeDOuupKVdWr+ZVSavkmBFpnZXeKSxYXwkQ6mXPNCSMzPzBvZTJZ16x+Qn+wNDO7PbAeD8cJyOUStU3QY5qyukb6odfFOkOhbguKJH4bYXafd4hAhsgxdykTllj1+7Q0sQDms= ceph-24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:55:44.333 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-02-28T22:55:44.694 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:55:47.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.444+0000 7f8c13e00700 1 -- 172.21.15.159:0/1248175536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0ff120 msgr2=0x7f8c0c0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:47.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.444+0000 7f8c13e00700 1 --2- 172.21.15.159:0/1248175536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0ff120 0x7f8c0c0ff540 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8c0000b0a0 tx=0x7f8c0000b3b0 comp rx=0 tx=0).stop 2024-02-28T22:55:47.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.444+0000 7f8c13e00700 1 -- 172.21.15.159:0/1248175536 shutdown_connections 2024-02-28T22:55:47.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.444+0000 7f8c13e00700 1 --2- 172.21.15.159:0/1248175536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0ff120 0x7f8c0c0ff540 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:47.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.444+0000 7f8c13e00700 1 -- 172.21.15.159:0/1248175536 >> 172.21.15.159:0/1248175536 conn(0x7f8c0c0fad20 msgr2=0x7f8c0c0fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:47.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.444+0000 7f8c13e00700 1 -- 172.21.15.159:0/1248175536 shutdown_connections 2024-02-28T22:55:47.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.444+0000 7f8c13e00700 1 -- 172.21.15.159:0/1248175536 wait complete. 2024-02-28T22:55:47.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.445+0000 7f8c13e00700 1 Processor -- start 2024-02-28T22:55:47.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.445+0000 7f8c13e00700 1 -- start start 2024-02-28T22:55:47.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.446+0000 7f8c13e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0ff120 0x7f8c0c197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:47.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.446+0000 7f8c13e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0c1980d0 con 0x7f8c0c0ff120 2024-02-28T22:55:47.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.446+0000 7f8c11400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0ff120 0x7f8c0c197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:47.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.446+0000 7f8c11400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0ff120 0x7f8c0c197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52684/0 (socket says 172.21.15.159:52684) 2024-02-28T22:55:47.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.446+0000 7f8c11400700 1 -- 172.21.15.159:0/1553875696 learned_addr learned my addr 172.21.15.159:0/1553875696 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:47.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.446+0000 7f8c11400700 1 -- 172.21.15.159:0/1553875696 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c00009d00 con 0x7f8c0c0ff120 2024-02-28T22:55:47.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.447+0000 7f8c11400700 1 --2- 172.21.15.159:0/1553875696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0ff120 0x7f8c0c197b90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009fd0 tx=0x7f8c0000bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:47.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.447+0000 7f8c0a000700 1 -- 172.21.15.159:0/1553875696 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c0000e040 con 0x7f8c0c0ff120 2024-02-28T22:55:47.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.447+0000 7f8c0a000700 1 -- 172.21.15.159:0/1553875696 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8c0000bdc0 con 0x7f8c0c0ff120 2024-02-28T22:55:47.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.447+0000 7f8c0a000700 1 -- 172.21.15.159:0/1553875696 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8c0001da40 con 0x7f8c0c0ff120 2024-02-28T22:55:47.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.447+0000 7f8c13e00700 1 -- 172.21.15.159:0/1553875696 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0c1982d0 con 0x7f8c0c0ff120 2024-02-28T22:55:47.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.447+0000 7f8c13e00700 1 -- 172.21.15.159:0/1553875696 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0c1986f0 con 0x7f8c0c0ff120 2024-02-28T22:55:47.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.448+0000 7f8c0a000700 1 -- 172.21.15.159:0/1553875696 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f8c0001d480 con 0x7f8c0c0ff120 2024-02-28T22:55:47.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.448+0000 7f8c13e00700 1 -- 172.21.15.159:0/1553875696 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0c1916b0 con 0x7f8c0c0ff120 2024-02-28T22:55:47.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.449+0000 7f8c0a000700 1 --2- 172.21.15.159:0/1553875696 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8bf4038460 0x7f8bf403a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:47.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.449+0000 7f8c0a000700 1 -- 172.21.15.159:0/1553875696 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f8c0004c8f0 con 0x7f8c0c0ff120 2024-02-28T22:55:47.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.449+0000 7f8c10a00700 1 --2- 172.21.15.159:0/1553875696 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8bf4038460 0x7f8bf403a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:47.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.450+0000 7f8c10a00700 1 --2- 172.21.15.159:0/1553875696 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8bf4038460 0x7f8bf403a920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8006fd0 tx=0x7f8bf8006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:47.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.454+0000 7f8c0a000700 1 -- 172.21.15.159:0/1553875696 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8c0001c9b0 con 0x7f8c0c0ff120 2024-02-28T22:55:47.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.671+0000 7f8c13e00700 1 -- 172.21.15.159:0/1553875696 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f8c0c02cc70 con 0x7f8c0c0ff120 2024-02-28T22:55:47.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.676+0000 7f8c0a000700 1 -- 172.21.15.159:0/1553875696 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8c0001c3e0 con 0x7f8c0c0ff120 2024-02-28T22:55:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.679+0000 7f8c13e00700 1 -- 172.21.15.159:0/1553875696 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8bf4038460 msgr2=0x7f8bf403a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.679+0000 7f8c13e00700 1 --2- 172.21.15.159:0/1553875696 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8bf4038460 0x7f8bf403a920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8bf8006fd0 tx=0x7f8bf8006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.679+0000 7f8c13e00700 1 -- 172.21.15.159:0/1553875696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0ff120 msgr2=0x7f8c0c197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.679+0000 7f8c13e00700 1 --2- 172.21.15.159:0/1553875696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0ff120 0x7f8c0c197b90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8c00009fd0 tx=0x7f8c0000bb10 comp rx=0 tx=0).stop 2024-02-28T22:55:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.679+0000 7f8c13e00700 1 -- 172.21.15.159:0/1553875696 shutdown_connections 2024-02-28T22:55:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.679+0000 7f8c13e00700 1 --2- 172.21.15.159:0/1553875696 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8bf4038460 0x7f8bf403a920 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.679+0000 7f8c13e00700 1 --2- 172.21.15.159:0/1553875696 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c0c0ff120 0x7f8c0c197b90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:47.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.679+0000 7f8c13e00700 1 -- 172.21.15.159:0/1553875696 >> 172.21.15.159:0/1553875696 conn(0x7f8c0c0fad20 msgr2=0x7f8c0c0fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:47.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.680+0000 7f8c13e00700 1 -- 172.21.15.159:0/1553875696 shutdown_connections 2024-02-28T22:55:47.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:47.680+0000 7f8c13e00700 1 -- 172.21.15.159:0/1553875696 wait complete. 2024-02-28T22:55:47.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:47 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:47.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:47 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:47.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:47 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-02-28T22:55:47.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:47 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:47.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:47 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T22:55:47.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:47 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T22:55:47.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:47 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:55:47.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:47 smithi159 ceph-mon[28802]: Deploying daemon ceph-exporter.smithi159 on smithi159 2024-02-28T22:55:48.431 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-02-28T22:55:48.431 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-02-28T22:55:48.794 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:55:48.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:48 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1553875696' entity='client.admin' 2024-02-28T22:55:52.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.409+0000 7ff6c8200700 1 -- 172.21.15.159:0/119841879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c0106fa0 msgr2=0x7ff6c01073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:52.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.409+0000 7ff6c8200700 1 --2- 172.21.15.159:0/119841879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c0106fa0 0x7ff6c01073c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4009910 tx=0x7ff6b4009c20 comp rx=0 tx=0).stop 2024-02-28T22:55:52.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.409+0000 7ff6c8200700 1 -- 172.21.15.159:0/119841879 shutdown_connections 2024-02-28T22:55:52.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.409+0000 7ff6c8200700 1 --2- 172.21.15.159:0/119841879 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c0106fa0 0x7ff6c01073c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:52.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.409+0000 7ff6c8200700 1 -- 172.21.15.159:0/119841879 >> 172.21.15.159:0/119841879 conn(0x7ff6c0075ff0 msgr2=0x7ff6c0078450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:52.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.409+0000 7ff6c8200700 1 -- 172.21.15.159:0/119841879 shutdown_connections 2024-02-28T22:55:52.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.409+0000 7ff6c8200700 1 -- 172.21.15.159:0/119841879 wait complete. 2024-02-28T22:55:52.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.410+0000 7ff6c8200700 1 Processor -- start 2024-02-28T22:55:52.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.411+0000 7ff6c8200700 1 -- start start 2024-02-28T22:55:52.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.411+0000 7ff6c8200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c0106fa0 0x7ff6c019bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:52.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.411+0000 7ff6c8200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c019c4e0 con 0x7ff6c0106fa0 2024-02-28T22:55:52.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.411+0000 7ff6c5800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c0106fa0 0x7ff6c019bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:52.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.411+0000 7ff6c5800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c0106fa0 0x7ff6c019bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50680/0 (socket says 172.21.15.159:50680) 2024-02-28T22:55:52.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.411+0000 7ff6c5800700 1 -- 172.21.15.159:0/1800982584 learned_addr learned my addr 172.21.15.159:0/1800982584 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:52.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.412+0000 7ff6c5800700 1 -- 172.21.15.159:0/1800982584 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b40095f0 con 0x7ff6c0106fa0 2024-02-28T22:55:52.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.412+0000 7ff6c5800700 1 --2- 172.21.15.159:0/1800982584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c0106fa0 0x7ff6c019bfa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4005b40 tx=0x7ff6b4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:52.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.412+0000 7ff6be000700 1 -- 172.21.15.159:0/1800982584 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6b401d070 con 0x7ff6c0106fa0 2024-02-28T22:55:52.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.412+0000 7ff6be000700 1 -- 172.21.15.159:0/1800982584 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff6b400be10 con 0x7ff6c0106fa0 2024-02-28T22:55:52.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.412+0000 7ff6c8200700 1 -- 172.21.15.159:0/1800982584 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c019c6e0 con 0x7ff6c0106fa0 2024-02-28T22:55:52.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.412+0000 7ff6be000700 1 -- 172.21.15.159:0/1800982584 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff6b400f460 con 0x7ff6c0106fa0 2024-02-28T22:55:52.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.413+0000 7ff6c8200700 1 -- 172.21.15.159:0/1800982584 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c019cb80 con 0x7ff6c0106fa0 2024-02-28T22:55:52.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.414+0000 7ff6be000700 1 -- 172.21.15.159:0/1800982584 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7ff6b40227e0 con 0x7ff6c0106fa0 2024-02-28T22:55:52.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.414+0000 7ff6c8200700 1 -- 172.21.15.159:0/1800982584 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c0195a20 con 0x7ff6c0106fa0 2024-02-28T22:55:52.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.414+0000 7ff6be000700 1 --2- 172.21.15.159:0/1800982584 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7ff6a80383c0 0x7ff6a803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:52.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.414+0000 7ff6be000700 1 -- 172.21.15.159:0/1800982584 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff6b404c3f0 con 0x7ff6c0106fa0 2024-02-28T22:55:52.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.414+0000 7ff6c4e00700 1 --2- 172.21.15.159:0/1800982584 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7ff6a80383c0 0x7ff6a803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:52.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.415+0000 7ff6c4e00700 1 --2- 172.21.15.159:0/1800982584 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7ff6a80383c0 0x7ff6a803a880 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac006fd0 tx=0x7ff6ac006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:52.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.420+0000 7ff6be000700 1 -- 172.21.15.159:0/1800982584 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff6b402bba0 con 0x7ff6c0106fa0 2024-02-28T22:55:52.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.678+0000 7ff6c8200700 1 -- 172.21.15.159:0/1800982584 --> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6c0061260 con 0x7ff6a80383c0 2024-02-28T22:55:52.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.686+0000 7ff6be000700 1 -- 172.21.15.159:0/1800982584 <== mgr.14164 v2:172.21.15.159:6800/2559284946 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff6c0061260 con 0x7ff6a80383c0 2024-02-28T22:55:52.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.689+0000 7ff6c8200700 1 -- 172.21.15.159:0/1800982584 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7ff6a80383c0 msgr2=0x7ff6a803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:52.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.689+0000 7ff6c8200700 1 --2- 172.21.15.159:0/1800982584 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7ff6a80383c0 0x7ff6a803a880 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff6ac006fd0 tx=0x7ff6ac006e40 comp rx=0 tx=0).stop 2024-02-28T22:55:52.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.689+0000 7ff6c8200700 1 -- 172.21.15.159:0/1800982584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c0106fa0 msgr2=0x7ff6c019bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:52.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.689+0000 7ff6c8200700 1 --2- 172.21.15.159:0/1800982584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c0106fa0 0x7ff6c019bfa0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6b4005b40 tx=0x7ff6b4004740 comp rx=0 tx=0).stop 2024-02-28T22:55:52.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.689+0000 7ff6c8200700 1 -- 172.21.15.159:0/1800982584 shutdown_connections 2024-02-28T22:55:52.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.689+0000 7ff6c8200700 1 --2- 172.21.15.159:0/1800982584 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7ff6a80383c0 0x7ff6a803a880 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:52.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.689+0000 7ff6c8200700 1 --2- 172.21.15.159:0/1800982584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6c0106fa0 0x7ff6c019bfa0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:52.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.689+0000 7ff6c8200700 1 -- 172.21.15.159:0/1800982584 >> 172.21.15.159:0/1800982584 conn(0x7ff6c0075ff0 msgr2=0x7ff6c0076cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:52.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.689+0000 7ff6c8200700 1 -- 172.21.15.159:0/1800982584 shutdown_connections 2024-02-28T22:55:52.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:52.690+0000 7ff6c8200700 1 -- 172.21.15.159:0/1800982584 wait complete. 2024-02-28T22:55:53.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:53 smithi159 ceph-mon[28802]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:55:53.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:53 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:53.506 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi184 2024-02-28T22:55:53.507 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T22:55:53.507 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.conf 2024-02-28T22:55:53.562 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T22:55:53.562 DEBUG:teuthology.orchestra.run.smithi184:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T22:55:53.657 INFO:tasks.cephadm:Adding host smithi184 to orchestrator... 2024-02-28T22:55:53.657 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph orch host add smithi184 2024-02-28T22:55:54.252 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:55:54.396 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:54 smithi159 ceph-mon[28802]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:55.374 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:55 smithi159 ceph-mon[28802]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:55:55.375 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:55 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:55.375 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:55 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:55.375 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:55 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:55.375 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:55 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:55.375 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:55 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T22:55:55.375 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:55 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-28T22:55:55.375 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:55 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:55:55.375 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:55 smithi159 ceph-mon[28802]: Deploying daemon crash.smithi159 on smithi159 2024-02-28T22:55:56.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.392+0000 7f47df200700 1 -- 172.21.15.159:0/997224744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47d8074dc0 msgr2=0x7f47d8073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:55:56.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.392+0000 7f47df200700 1 --2- 172.21.15.159:0/997224744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47d8074dc0 0x7f47d8073220 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f47c8009910 tx=0x7f47c8009c20 comp rx=0 tx=0).stop 2024-02-28T22:55:56.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.392+0000 7f47df200700 1 -- 172.21.15.159:0/997224744 shutdown_connections 2024-02-28T22:55:56.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.392+0000 7f47df200700 1 --2- 172.21.15.159:0/997224744 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47d8074dc0 0x7f47d8073220 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:55:56.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.392+0000 7f47df200700 1 -- 172.21.15.159:0/997224744 >> 172.21.15.159:0/997224744 conn(0x7f47d80fbe30 msgr2=0x7f47d80fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:55:56.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.392+0000 7f47df200700 1 -- 172.21.15.159:0/997224744 shutdown_connections 2024-02-28T22:55:56.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.392+0000 7f47df200700 1 -- 172.21.15.159:0/997224744 wait complete. 2024-02-28T22:55:56.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.393+0000 7f47df200700 1 Processor -- start 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.394+0000 7f47df200700 1 -- start start 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.394+0000 7f47df200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47d8074dc0 0x7f47d8197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.394+0000 7f47df200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8198120 con 0x7f47d8074dc0 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.394+0000 7f47d7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47d8074dc0 0x7f47d8197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.394+0000 7f47d7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47d8074dc0 0x7f47d8197be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50698/0 (socket says 172.21.15.159:50698) 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.394+0000 7f47d7e00700 1 -- 172.21.15.159:0/3129630139 learned_addr learned my addr 172.21.15.159:0/3129630139 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.395+0000 7f47d7e00700 1 -- 172.21.15.159:0/3129630139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c80095f0 con 0x7f47d8074dc0 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.395+0000 7f47d7e00700 1 --2- 172.21.15.159:0/3129630139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47d8074dc0 0x7f47d8197be0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f47c8005950 tx=0x7f47c8009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.395+0000 7f47d4c00700 1 -- 172.21.15.159:0/3129630139 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f47c801d070 con 0x7f47d8074dc0 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.395+0000 7f47d4c00700 1 -- 172.21.15.159:0/3129630139 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f47c800be10 con 0x7f47d8074dc0 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.395+0000 7f47df200700 1 -- 172.21.15.159:0/3129630139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d8198320 con 0x7f47d8074dc0 2024-02-28T22:55:56.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.395+0000 7f47d4c00700 1 -- 172.21.15.159:0/3129630139 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f47c800f460 con 0x7f47d8074dc0 2024-02-28T22:55:56.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.396+0000 7f47df200700 1 -- 172.21.15.159:0/3129630139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d81987c0 con 0x7f47d8074dc0 2024-02-28T22:55:56.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.397+0000 7f47df200700 1 -- 172.21.15.159:0/3129630139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d81916e0 con 0x7f47d8074dc0 2024-02-28T22:55:56.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.397+0000 7f47d4c00700 1 -- 172.21.15.159:0/3129630139 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f47c80227c0 con 0x7f47d8074dc0 2024-02-28T22:55:56.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.398+0000 7f47d4c00700 1 --2- 172.21.15.159:0/3129630139 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f47bc038410 0x7f47bc03a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:55:56.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.398+0000 7f47d4c00700 1 -- 172.21.15.159:0/3129630139 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f47c804cb20 con 0x7f47d8074dc0 2024-02-28T22:55:56.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.398+0000 7f47d7400700 1 --2- 172.21.15.159:0/3129630139 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f47bc038410 0x7f47bc03a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:55:56.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.399+0000 7f47d7400700 1 --2- 172.21.15.159:0/3129630139 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f47bc038410 0x7f47bc03a8d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47c4006fd0 tx=0x7f47c4006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:55:56.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.402+0000 7f47d4c00700 1 -- 172.21.15.159:0/3129630139 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f47c8005c00 con 0x7f47d8074dc0 2024-02-28T22:55:56.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:55:56.635+0000 7f47df200700 1 -- 172.21.15.159:0/3129630139 --> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}) v1 -- 0x7f47d80611d0 con 0x7f47bc038410 2024-02-28T22:55:57.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:57 smithi159 ceph-mon[28802]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:55:57.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:57 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:58.510 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:58 smithi159 ceph-mon[28802]: from='client.14191 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi184", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:55:59.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:59 smithi159 ceph-mon[28802]: Deploying cephadm binary to smithi184 2024-02-28T22:55:59.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:59 smithi159 ceph-mon[28802]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:55:59.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:59 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:59.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:59 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:59.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:59 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:55:59.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:55:59 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:00.667 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:00 smithi159 ceph-mon[28802]: Deploying daemon node-exporter.smithi159 on smithi159 2024-02-28T22:56:01.229 INFO:teuthology.orchestra.run.smithi159.stdout:Added host 'smithi184' with addr '172.21.15.184' 2024-02-28T22:56:01.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:01.227+0000 7f47d4c00700 1 -- 172.21.15.159:0/3129630139 <== mgr.14164 v2:172.21.15.159:6800/2559284946 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f47d80611d0 con 0x7f47bc038410 2024-02-28T22:56:01.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:01.231+0000 7f47df200700 1 -- 172.21.15.159:0/3129630139 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f47bc038410 msgr2=0x7f47bc03a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:01.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:01.231+0000 7f47df200700 1 --2- 172.21.15.159:0/3129630139 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f47bc038410 0x7f47bc03a8d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f47c4006fd0 tx=0x7f47c4006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:01.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:01.231+0000 7f47df200700 1 -- 172.21.15.159:0/3129630139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47d8074dc0 msgr2=0x7f47d8197be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:01.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:01.231+0000 7f47df200700 1 --2- 172.21.15.159:0/3129630139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47d8074dc0 0x7f47d8197be0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f47c8005950 tx=0x7f47c8009e60 comp rx=0 tx=0).stop 2024-02-28T22:56:01.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:01.232+0000 7f47df200700 1 -- 172.21.15.159:0/3129630139 shutdown_connections 2024-02-28T22:56:01.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:01.232+0000 7f47df200700 1 --2- 172.21.15.159:0/3129630139 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f47bc038410 0x7f47bc03a8d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:01.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:01.232+0000 7f47df200700 1 --2- 172.21.15.159:0/3129630139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47d8074dc0 0x7f47d8197be0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:01.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:01.232+0000 7f47df200700 1 -- 172.21.15.159:0/3129630139 >> 172.21.15.159:0/3129630139 conn(0x7f47d80fbe30 msgr2=0x7f47d80fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:01.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:01.232+0000 7f47df200700 1 -- 172.21.15.159:0/3129630139 shutdown_connections 2024-02-28T22:56:01.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:01.232+0000 7f47df200700 1 -- 172.21.15.159:0/3129630139 wait complete. 2024-02-28T22:56:01.720 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:01 smithi159 ceph-mon[28802]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:01.720 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:01 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:02.247 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph orch host ls --format=json 2024-02-28T22:56:02.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:02 smithi159 ceph-mon[28802]: Added host smithi184 2024-02-28T22:56:02.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:02 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:03.255 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:56:03.594 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:03 smithi159 ceph-mon[28802]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:05 smithi159 ceph-mon[28802]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:06.601 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:06 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:06.601 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:06 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:06.601 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:06 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:06.601 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:06 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:06.602 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:06 smithi159 ceph-mon[28802]: Deploying daemon alertmanager.smithi159 on smithi159 2024-02-28T22:56:06.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.681+0000 7fe82bc00700 1 -- 172.21.15.159:0/1874009327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8240ff180 msgr2=0x7fe8240ff5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:06.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.681+0000 7fe82bc00700 1 --2- 172.21.15.159:0/1874009327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8240ff180 0x7fe8240ff5a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe818009910 tx=0x7fe818009c20 comp rx=0 tx=0).stop 2024-02-28T22:56:06.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.681+0000 7fe82bc00700 1 -- 172.21.15.159:0/1874009327 shutdown_connections 2024-02-28T22:56:06.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.681+0000 7fe82bc00700 1 --2- 172.21.15.159:0/1874009327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8240ff180 0x7fe8240ff5a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:06.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.681+0000 7fe82bc00700 1 -- 172.21.15.159:0/1874009327 >> 172.21.15.159:0/1874009327 conn(0x7fe8240fad20 msgr2=0x7fe8240fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:06.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.681+0000 7fe82bc00700 1 -- 172.21.15.159:0/1874009327 shutdown_connections 2024-02-28T22:56:06.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.681+0000 7fe82bc00700 1 -- 172.21.15.159:0/1874009327 wait complete. 2024-02-28T22:56:06.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.683+0000 7fe82bc00700 1 Processor -- start 2024-02-28T22:56:06.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.683+0000 7fe82bc00700 1 -- start start 2024-02-28T22:56:06.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.683+0000 7fe82bc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8240ff180 0x7fe824197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:06.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.683+0000 7fe82bc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8241980d0 con 0x7fe8240ff180 2024-02-28T22:56:06.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.684+0000 7fe829200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8240ff180 0x7fe824197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:06.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.684+0000 7fe829200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8240ff180 0x7fe824197b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56562/0 (socket says 172.21.15.159:56562) 2024-02-28T22:56:06.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.684+0000 7fe829200700 1 -- 172.21.15.159:0/27216863 learned_addr learned my addr 172.21.15.159:0/27216863 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:56:06.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.684+0000 7fe829200700 1 -- 172.21.15.159:0/27216863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8180095f0 con 0x7fe8240ff180 2024-02-28T22:56:06.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.684+0000 7fe829200700 1 --2- 172.21.15.159:0/27216863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8240ff180 0x7fe824197b90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8180092e0 tx=0x7fe818009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:06.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.685+0000 7fe821600700 1 -- 172.21.15.159:0/27216863 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe81801d070 con 0x7fe8240ff180 2024-02-28T22:56:06.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.685+0000 7fe821600700 1 -- 172.21.15.159:0/27216863 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe81800be10 con 0x7fe8240ff180 2024-02-28T22:56:06.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.685+0000 7fe82bc00700 1 -- 172.21.15.159:0/27216863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8241982d0 con 0x7fe8240ff180 2024-02-28T22:56:06.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.685+0000 7fe821600700 1 -- 172.21.15.159:0/27216863 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe81800f460 con 0x7fe8240ff180 2024-02-28T22:56:06.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.685+0000 7fe82bc00700 1 -- 172.21.15.159:0/27216863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe824198770 con 0x7fe8240ff180 2024-02-28T22:56:06.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.686+0000 7fe821600700 1 -- 172.21.15.159:0/27216863 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7fe81800f5c0 con 0x7fe8240ff180 2024-02-28T22:56:06.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.686+0000 7fe82bc00700 1 -- 172.21.15.159:0/27216863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8241916b0 con 0x7fe8240ff180 2024-02-28T22:56:06.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.687+0000 7fe821600700 1 --2- 172.21.15.159:0/27216863 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fe80c038410 0x7fe80c03a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:06.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.687+0000 7fe821600700 1 -- 172.21.15.159:0/27216863 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe81804c500 con 0x7fe8240ff180 2024-02-28T22:56:06.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.687+0000 7fe823e00700 1 --2- 172.21.15.159:0/27216863 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fe80c038410 0x7fe80c03a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:06.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.688+0000 7fe823e00700 1 --2- 172.21.15.159:0/27216863 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fe80c038410 0x7fe80c03a8d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe810006fd0 tx=0x7fe810006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:06.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.692+0000 7fe821600700 1 -- 172.21.15.159:0/27216863 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe818005c00 con 0x7fe8240ff180 2024-02-28T22:56:06.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.919+0000 7fe82bc00700 1 -- 172.21.15.159:0/27216863 --> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8240611d0 con 0x7fe80c038410 2024-02-28T22:56:06.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.922+0000 7fe821600700 1 -- 172.21.15.159:0/27216863 <== mgr.14164 v2:172.21.15.159:6800/2559284946 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7fe8240611d0 con 0x7fe80c038410 2024-02-28T22:56:06.921 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T22:56:06.922 INFO:teuthology.orchestra.run.smithi159.stdout:[{"addr": "172.21.15.159", "hostname": "smithi159", "labels": [], "status": ""}, {"addr": "172.21.15.184", "hostname": "smithi184", "labels": [], "status": ""}] 2024-02-28T22:56:06.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.925+0000 7fe82bc00700 1 -- 172.21.15.159:0/27216863 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fe80c038410 msgr2=0x7fe80c03a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:06.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.925+0000 7fe82bc00700 1 --2- 172.21.15.159:0/27216863 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fe80c038410 0x7fe80c03a8d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fe810006fd0 tx=0x7fe810006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:06.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.925+0000 7fe82bc00700 1 -- 172.21.15.159:0/27216863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8240ff180 msgr2=0x7fe824197b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:06.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.925+0000 7fe82bc00700 1 --2- 172.21.15.159:0/27216863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8240ff180 0x7fe824197b90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe8180092e0 tx=0x7fe818009e60 comp rx=0 tx=0).stop 2024-02-28T22:56:06.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.925+0000 7fe82bc00700 1 -- 172.21.15.159:0/27216863 shutdown_connections 2024-02-28T22:56:06.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.925+0000 7fe82bc00700 1 --2- 172.21.15.159:0/27216863 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7fe80c038410 0x7fe80c03a8d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:06.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.925+0000 7fe82bc00700 1 --2- 172.21.15.159:0/27216863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe8240ff180 0x7fe824197b90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:06.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.925+0000 7fe82bc00700 1 -- 172.21.15.159:0/27216863 >> 172.21.15.159:0/27216863 conn(0x7fe8240fad20 msgr2=0x7fe8240fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:06.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.926+0000 7fe82bc00700 1 -- 172.21.15.159:0/27216863 shutdown_connections 2024-02-28T22:56:06.926 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:06.926+0000 7fe82bc00700 1 -- 172.21.15.159:0/27216863 wait complete. 2024-02-28T22:56:07.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:07 smithi159 ceph-mon[28802]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:07.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:07 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:07.699 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-28T22:56:07.700 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd crush tunables default 2024-02-28T22:56:08.118 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:56:08.561 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:08 smithi159 ceph-mon[28802]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T22:56:09.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:09 smithi159 ceph-mon[28802]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:11.660 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:11 smithi159 ceph-mon[28802]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:12.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.395+0000 7f117f200700 1 -- 172.21.15.159:0/345987038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11801006e0 msgr2=0x7f1180100b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:12.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.395+0000 7f117f200700 1 --2- 172.21.15.159:0/345987038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11801006e0 0x7f1180100b00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1170009910 tx=0x7f1170009c20 comp rx=0 tx=0).stop 2024-02-28T22:56:12.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.395+0000 7f117f200700 1 -- 172.21.15.159:0/345987038 shutdown_connections 2024-02-28T22:56:12.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.395+0000 7f117f200700 1 --2- 172.21.15.159:0/345987038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11801006e0 0x7f1180100b00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:12.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.395+0000 7f117f200700 1 -- 172.21.15.159:0/345987038 >> 172.21.15.159:0/345987038 conn(0x7f11800fbca0 msgr2=0x7f11800fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:12.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.396+0000 7f117f200700 1 -- 172.21.15.159:0/345987038 shutdown_connections 2024-02-28T22:56:12.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.396+0000 7f117f200700 1 -- 172.21.15.159:0/345987038 wait complete. 2024-02-28T22:56:12.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.398+0000 7f117f200700 1 Processor -- start 2024-02-28T22:56:12.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.398+0000 7f117f200700 1 -- start start 2024-02-28T22:56:12.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.398+0000 7f117f200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11801006e0 0x7f1180195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:12.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.398+0000 7f117f200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1180195d40 con 0x7f11801006e0 2024-02-28T22:56:12.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.398+0000 7f117de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11801006e0 0x7f1180195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:12.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.399+0000 7f117de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11801006e0 0x7f1180195800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34470/0 (socket says 172.21.15.159:34470) 2024-02-28T22:56:12.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.399+0000 7f117de00700 1 -- 172.21.15.159:0/1599490266 learned_addr learned my addr 172.21.15.159:0/1599490266 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:56:12.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.399+0000 7f117de00700 1 -- 172.21.15.159:0/1599490266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11700095f0 con 0x7f11801006e0 2024-02-28T22:56:12.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.399+0000 7f117de00700 1 --2- 172.21.15.159:0/1599490266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11801006e0 0x7f1180195800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1170005950 tx=0x7f1170009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:12.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.399+0000 7f1176a00700 1 -- 172.21.15.159:0/1599490266 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f117001d070 con 0x7f11801006e0 2024-02-28T22:56:12.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.399+0000 7f1176a00700 1 -- 172.21.15.159:0/1599490266 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f117000be10 con 0x7f11801006e0 2024-02-28T22:56:12.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.399+0000 7f117f200700 1 -- 172.21.15.159:0/1599490266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1180195f40 con 0x7f11801006e0 2024-02-28T22:56:12.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.399+0000 7f1176a00700 1 -- 172.21.15.159:0/1599490266 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f117000f460 con 0x7f11801006e0 2024-02-28T22:56:12.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.400+0000 7f117f200700 1 -- 172.21.15.159:0/1599490266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11801963e0 con 0x7f11801006e0 2024-02-28T22:56:12.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.401+0000 7f1176a00700 1 -- 172.21.15.159:0/1599490266 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f11700227c0 con 0x7f11801006e0 2024-02-28T22:56:12.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.401+0000 7f117f200700 1 -- 172.21.15.159:0/1599490266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f118018f300 con 0x7f11801006e0 2024-02-28T22:56:12.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.401+0000 7f1176a00700 1 --2- 172.21.15.159:0/1599490266 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f1164038410 0x7f116403a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:12.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.401+0000 7f1176a00700 1 -- 172.21.15.159:0/1599490266 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f117004c560 con 0x7f11801006e0 2024-02-28T22:56:12.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.402+0000 7f117d400700 1 --2- 172.21.15.159:0/1599490266 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f1164038410 0x7f116403a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:12.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.402+0000 7f117d400700 1 --2- 172.21.15.159:0/1599490266 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f1164038410 0x7f116403a8d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f116c006fd0 tx=0x7f116c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:12.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.407+0000 7f1176a00700 1 -- 172.21.15.159:0/1599490266 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f117002ba00 con 0x7f11801006e0 2024-02-28T22:56:12.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:12.627+0000 7f117f200700 1 -- 172.21.15.159:0/1599490266 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f118002cc70 con 0x7f11801006e0 2024-02-28T22:56:13.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:13.417+0000 7f1176a00700 1 -- 172.21.15.159:0/1599490266 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1170027070 con 0x7f11801006e0 2024-02-28T22:56:13.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:13.421+0000 7f117f200700 1 -- 172.21.15.159:0/1599490266 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f1164038410 msgr2=0x7f116403a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:13.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:13.421+0000 7f117f200700 1 --2- 172.21.15.159:0/1599490266 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f1164038410 0x7f116403a8d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f116c006fd0 tx=0x7f116c006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:13.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:13.421+0000 7f117f200700 1 -- 172.21.15.159:0/1599490266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11801006e0 msgr2=0x7f1180195800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:13.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:13.421+0000 7f117f200700 1 --2- 172.21.15.159:0/1599490266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11801006e0 0x7f1180195800 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1170005950 tx=0x7f1170009e60 comp rx=0 tx=0).stop 2024-02-28T22:56:13.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:13.421+0000 7f117f200700 1 -- 172.21.15.159:0/1599490266 shutdown_connections 2024-02-28T22:56:13.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:13.421+0000 7f117f200700 1 --2- 172.21.15.159:0/1599490266 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f1164038410 0x7f116403a8d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:13.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:13.421+0000 7f117f200700 1 --2- 172.21.15.159:0/1599490266 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11801006e0 0x7f1180195800 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:13.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:13.421+0000 7f117f200700 1 -- 172.21.15.159:0/1599490266 >> 172.21.15.159:0/1599490266 conn(0x7f11800fbca0 msgr2=0x7f11800fc910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:13.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:13.421+0000 7f117f200700 1 -- 172.21.15.159:0/1599490266 shutdown_connections 2024-02-28T22:56:13.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:56:13.421+0000 7f117f200700 1 -- 172.21.15.159:0/1599490266 wait complete. 2024-02-28T22:56:13.422 INFO:teuthology.orchestra.run.smithi159.stderr:adjusted tunables profile to default 2024-02-28T22:56:13.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:13 smithi159 ceph-mon[28802]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:13.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:13 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1599490266' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-28T22:56:14.164 INFO:tasks.cephadm:Adding mon.smithi159 on smithi159 2024-02-28T22:56:14.165 INFO:tasks.cephadm:Adding mon.smithi184 on smithi184 2024-02-28T22:56:14.165 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph orch apply mon '2;smithi159:172.21.15.159=smithi159;smithi184:172.21.15.184=smithi184' 2024-02-28T22:56:14.548 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:14.653 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:14 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1599490266' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-28T22:56:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:14 smithi159 ceph-mon[28802]: osdmap e4: 0 total, 0 up, 0 in 2024-02-28T22:56:15.683 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:15 smithi159 ceph-mon[28802]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:17.247 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.248+0000 7f6056000700 1 -- 172.21.15.184:0/4198442588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6050102a90 msgr2=0x7f6050102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:17.247 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.248+0000 7f6056000700 1 --2- 172.21.15.184:0/4198442588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6050102a90 0x7f6050102eb0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f604000b0a0 tx=0x7f604000b3b0 comp rx=0 tx=0).stop 2024-02-28T22:56:17.247 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.248+0000 7f6056000700 1 -- 172.21.15.184:0/4198442588 shutdown_connections 2024-02-28T22:56:17.247 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.248+0000 7f6056000700 1 --2- 172.21.15.184:0/4198442588 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6050102a90 0x7f6050102eb0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:17.247 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.248+0000 7f6056000700 1 -- 172.21.15.184:0/4198442588 >> 172.21.15.184:0/4198442588 conn(0x7f60500fe010 msgr2=0x7f6050100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:17.247 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.248+0000 7f6056000700 1 -- 172.21.15.184:0/4198442588 shutdown_connections 2024-02-28T22:56:17.248 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.248+0000 7f6056000700 1 -- 172.21.15.184:0/4198442588 wait complete. 2024-02-28T22:56:17.248 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.249+0000 7f6056000700 1 Processor -- start 2024-02-28T22:56:17.248 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.249+0000 7f6056000700 1 -- start start 2024-02-28T22:56:17.248 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.249+0000 7f6056000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6050102a90 0x7f6050197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:17.249 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.249+0000 7f6056000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60501980f0 con 0x7f6050102a90 2024-02-28T22:56:17.249 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.250+0000 7f604f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6050102a90 0x7f6050197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:17.249 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.250+0000 7f604f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6050102a90 0x7f6050197bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:38696/0 (socket says 172.21.15.184:38696) 2024-02-28T22:56:17.249 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.250+0000 7f604f400700 1 -- 172.21.15.184:0/3007911319 learned_addr learned my addr 172.21.15.184:0/3007911319 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:56:17.249 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.251+0000 7f604f400700 1 -- 172.21.15.184:0/3007911319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6040009d00 con 0x7f6050102a90 2024-02-28T22:56:17.250 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.251+0000 7f604f400700 1 --2- 172.21.15.184:0/3007911319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6050102a90 0x7f6050197bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f604000b830 tx=0x7f604000bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:17.250 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.251+0000 7f604cc00700 1 -- 172.21.15.184:0/3007911319 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f604000e040 con 0x7f6050102a90 2024-02-28T22:56:17.250 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.251+0000 7f6056000700 1 -- 172.21.15.184:0/3007911319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60501982f0 con 0x7f6050102a90 2024-02-28T22:56:17.250 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.252+0000 7f6056000700 1 -- 172.21.15.184:0/3007911319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6050198710 con 0x7f6050102a90 2024-02-28T22:56:17.250 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.252+0000 7f604cc00700 1 -- 172.21.15.184:0/3007911319 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6040012af0 con 0x7f6050102a90 2024-02-28T22:56:17.250 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.252+0000 7f604cc00700 1 -- 172.21.15.184:0/3007911319 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f604001d9a0 con 0x7f6050102a90 2024-02-28T22:56:17.250 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.252+0000 7f6056000700 1 -- 172.21.15.184:0/3007911319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60501916b0 con 0x7f6050102a90 2024-02-28T22:56:17.251 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.253+0000 7f604cc00700 1 -- 172.21.15.184:0/3007911319 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f6040012c60 con 0x7f6050102a90 2024-02-28T22:56:17.251 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.253+0000 7f604cc00700 1 --2- 172.21.15.184:0/3007911319 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f60340383c0 0x7f603403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:17.251 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.254+0000 7f604cc00700 1 -- 172.21.15.184:0/3007911319 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f604004ce30 con 0x7f6050102a90 2024-02-28T22:56:17.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.254+0000 7f6046a00700 1 --2- 172.21.15.184:0/3007911319 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f60340383c0 0x7f603403a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:17.253 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.255+0000 7f6046a00700 1 --2- 172.21.15.184:0/3007911319 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f60340383c0 0x7f603403a880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6038006fd0 tx=0x7f6038006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:17.266 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.268+0000 7f604cc00700 1 -- 172.21.15.184:0/3007911319 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f60400265a0 con 0x7f6050102a90 2024-02-28T22:56:17.495 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.497+0000 7f6056000700 1 -- 172.21.15.184:0/3007911319 --> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi159:172.21.15.159=smithi159;smithi184:172.21.15.184=smithi184", "target": ["mon-mgr", ""]}) v1 -- 0x7f6050061280 con 0x7f60340383c0 2024-02-28T22:56:17.510 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.512+0000 7f604cc00700 1 -- 172.21.15.184:0/3007911319 <== mgr.14164 v2:172.21.15.159:6800/2559284946 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f6050061280 con 0x7f60340383c0 2024-02-28T22:56:17.510 INFO:teuthology.orchestra.run.smithi184.stdout:Scheduled mon update... 2024-02-28T22:56:17.513 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.515+0000 7f6056000700 1 -- 172.21.15.184:0/3007911319 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f60340383c0 msgr2=0x7f603403a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:17.513 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.515+0000 7f6056000700 1 --2- 172.21.15.184:0/3007911319 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f60340383c0 0x7f603403a880 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f6038006fd0 tx=0x7f6038006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:17.513 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.515+0000 7f6056000700 1 -- 172.21.15.184:0/3007911319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6050102a90 msgr2=0x7f6050197bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:17.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.515+0000 7f6056000700 1 --2- 172.21.15.184:0/3007911319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6050102a90 0x7f6050197bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f604000b830 tx=0x7f604000bd40 comp rx=0 tx=0).stop 2024-02-28T22:56:17.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.515+0000 7f6056000700 1 -- 172.21.15.184:0/3007911319 shutdown_connections 2024-02-28T22:56:17.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.515+0000 7f6056000700 1 --2- 172.21.15.184:0/3007911319 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f60340383c0 0x7f603403a880 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:17.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.515+0000 7f6056000700 1 --2- 172.21.15.184:0/3007911319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6050102a90 0x7f6050197bb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:17.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.515+0000 7f6056000700 1 -- 172.21.15.184:0/3007911319 >> 172.21.15.184:0/3007911319 conn(0x7f60500fe010 msgr2=0x7f60500fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:17.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.515+0000 7f6056000700 1 -- 172.21.15.184:0/3007911319 shutdown_connections 2024-02-28T22:56:17.514 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:17.515+0000 7f6056000700 1 -- 172.21.15.184:0/3007911319 wait complete. 2024-02-28T22:56:17.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:17 smithi159 ceph-mon[28802]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:18.221 DEBUG:teuthology.orchestra.run.smithi184:mon.smithi184> sudo journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi184.service 2024-02-28T22:56:18.228 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:56:18.228 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:56:18.613 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:18.715 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:18.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='client.14197 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi159:172.21.15.159=smithi159;smithi184:172.21.15.184=smithi184", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:56:18.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: Saving service mon spec with placement smithi159:172.21.15.159=smithi159;smithi184:172.21.15.184=smithi184;count:2 2024-02-28T22:56:18.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:18.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:18.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: Regenerating cephadm self-signed grafana TLS certificates 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:18.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:18 smithi159 ceph-mon[28802]: Deploying daemon grafana.smithi159 on smithi159 2024-02-28T22:56:20.595 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.596+0000 7f98ae000700 1 -- 172.21.15.184:0/120456496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a8106fa0 msgr2=0x7f98a81073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:20.595 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.596+0000 7f98ae000700 1 --2- 172.21.15.184:0/120456496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a8106fa0 0x7f98a81073c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9898009910 tx=0x7f9898009c20 comp rx=0 tx=0).stop 2024-02-28T22:56:20.595 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.596+0000 7f98ae000700 1 -- 172.21.15.184:0/120456496 shutdown_connections 2024-02-28T22:56:20.595 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.596+0000 7f98ae000700 1 --2- 172.21.15.184:0/120456496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a8106fa0 0x7f98a81073c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:20.595 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.596+0000 7f98ae000700 1 -- 172.21.15.184:0/120456496 >> 172.21.15.184:0/120456496 conn(0x7f98a8075ff0 msgr2=0x7f98a8078450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:20.595 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.596+0000 7f98ae000700 1 -- 172.21.15.184:0/120456496 shutdown_connections 2024-02-28T22:56:20.596 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.596+0000 7f98ae000700 1 -- 172.21.15.184:0/120456496 wait complete. 2024-02-28T22:56:20.596 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.598+0000 7f98ae000700 1 Processor -- start 2024-02-28T22:56:20.596 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.598+0000 7f98ae000700 1 -- start start 2024-02-28T22:56:20.596 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.598+0000 7f98ae000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a8106fa0 0x7f98a819bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:20.597 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.598+0000 7f98ae000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98a819c4e0 con 0x7f98a8106fa0 2024-02-28T22:56:20.597 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.599+0000 7f98a7400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a8106fa0 0x7f98a819bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:20.597 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.599+0000 7f98a7400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a8106fa0 0x7f98a819bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:40838/0 (socket says 172.21.15.184:40838) 2024-02-28T22:56:20.597 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.599+0000 7f98a7400700 1 -- 172.21.15.184:0/1535363645 learned_addr learned my addr 172.21.15.184:0/1535363645 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:56:20.598 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.600+0000 7f98a7400700 1 -- 172.21.15.184:0/1535363645 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98980095f0 con 0x7f98a8106fa0 2024-02-28T22:56:20.598 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.600+0000 7f98a7400700 1 --2- 172.21.15.184:0/1535363645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a8106fa0 0x7f98a819bfa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f98980092e0 tx=0x7f9898009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:20.599 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.601+0000 7f989fe00700 1 -- 172.21.15.184:0/1535363645 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f989801d070 con 0x7f98a8106fa0 2024-02-28T22:56:20.599 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.601+0000 7f98ae000700 1 -- 172.21.15.184:0/1535363645 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a819c6e0 con 0x7f98a8106fa0 2024-02-28T22:56:20.599 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.601+0000 7f98ae000700 1 -- 172.21.15.184:0/1535363645 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98a819cb80 con 0x7f98a8106fa0 2024-02-28T22:56:20.599 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.601+0000 7f989fe00700 1 -- 172.21.15.184:0/1535363645 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f989800be10 con 0x7f98a8106fa0 2024-02-28T22:56:20.599 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.601+0000 7f989fe00700 1 -- 172.21.15.184:0/1535363645 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f989800f460 con 0x7f98a8106fa0 2024-02-28T22:56:20.600 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.602+0000 7f98ae000700 1 -- 172.21.15.184:0/1535363645 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9888005320 con 0x7f98a8106fa0 2024-02-28T22:56:20.601 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.603+0000 7f989fe00700 1 -- 172.21.15.184:0/1535363645 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f9898022470 con 0x7f98a8106fa0 2024-02-28T22:56:20.601 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.603+0000 7f989fe00700 1 --2- 172.21.15.184:0/1535363645 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f988c038460 0x7f988c03a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:20.602 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.604+0000 7f989fe00700 1 -- 172.21.15.184:0/1535363645 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f989804c370 con 0x7f98a8106fa0 2024-02-28T22:56:20.603 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.605+0000 7f98a6a00700 1 --2- 172.21.15.184:0/1535363645 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f988c038460 0x7f988c03a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:20.604 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.606+0000 7f98a6a00700 1 --2- 172.21.15.184:0/1535363645 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f988c038460 0x7f988c03a920 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9894006fd0 tx=0x7f9894006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:20.619 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.621+0000 7f989fe00700 1 -- 172.21.15.184:0/1535363645 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f989800b960 con 0x7f98a8106fa0 2024-02-28T22:56:20.909 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.911+0000 7f98ae000700 1 -- 172.21.15.184:0/1535363645 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9888005190 con 0x7f98a8106fa0 2024-02-28T22:56:20.911 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.913+0000 7f989fe00700 1 -- 172.21.15.184:0/1535363645 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f9898027020 con 0x7f98a8106fa0 2024-02-28T22:56:20.911 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:56:20.911 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:56:20.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.915+0000 7f98ae000700 1 -- 172.21.15.184:0/1535363645 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f988c038460 msgr2=0x7f988c03a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:20.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.915+0000 7f98ae000700 1 --2- 172.21.15.184:0/1535363645 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f988c038460 0x7f988c03a920 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9894006fd0 tx=0x7f9894006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:20.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.915+0000 7f98ae000700 1 -- 172.21.15.184:0/1535363645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a8106fa0 msgr2=0x7f98a819bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:20.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.915+0000 7f98ae000700 1 --2- 172.21.15.184:0/1535363645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a8106fa0 0x7f98a819bfa0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f98980092e0 tx=0x7f9898009e60 comp rx=0 tx=0).stop 2024-02-28T22:56:20.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.915+0000 7f98ae000700 1 -- 172.21.15.184:0/1535363645 shutdown_connections 2024-02-28T22:56:20.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.915+0000 7f98ae000700 1 --2- 172.21.15.184:0/1535363645 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f988c038460 0x7f988c03a920 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:20.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.915+0000 7f98ae000700 1 --2- 172.21.15.184:0/1535363645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98a8106fa0 0x7f98a819bfa0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:20.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.915+0000 7f98ae000700 1 -- 172.21.15.184:0/1535363645 >> 172.21.15.184:0/1535363645 conn(0x7f98a8075ff0 msgr2=0x7f98a8076cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:20.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.916+0000 7f98ae000700 1 -- 172.21.15.184:0/1535363645 shutdown_connections 2024-02-28T22:56:20.914 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:20.916+0000 7f98ae000700 1 -- 172.21.15.184:0/1535363645 wait complete. 2024-02-28T22:56:20.915 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:56:21.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:21 smithi159 ceph-mon[28802]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:21.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:21 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/1535363645' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:56:22.621 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:56:22.621 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:56:23.004 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:23.097 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:23.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:23 smithi159 ceph-mon[28802]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:23.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:23 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:25.230 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.232+0000 7f8724c00700 1 -- 172.21.15.184:0/2600405175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8720102a90 msgr2=0x7f8720102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:25.230 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.232+0000 7f8724c00700 1 --2- 172.21.15.184:0/2600405175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8720102a90 0x7f8720102eb0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8710009910 tx=0x7f8710009c20 comp rx=0 tx=0).stop 2024-02-28T22:56:25.230 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.232+0000 7f8724c00700 1 -- 172.21.15.184:0/2600405175 shutdown_connections 2024-02-28T22:56:25.231 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.232+0000 7f8724c00700 1 --2- 172.21.15.184:0/2600405175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8720102a90 0x7f8720102eb0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:25.231 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.232+0000 7f8724c00700 1 -- 172.21.15.184:0/2600405175 >> 172.21.15.184:0/2600405175 conn(0x7f87200fe010 msgr2=0x7f8720100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:25.231 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.232+0000 7f8724c00700 1 -- 172.21.15.184:0/2600405175 shutdown_connections 2024-02-28T22:56:25.231 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.232+0000 7f8724c00700 1 -- 172.21.15.184:0/2600405175 wait complete. 2024-02-28T22:56:25.231 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.233+0000 7f8724c00700 1 Processor -- start 2024-02-28T22:56:25.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.233+0000 7f8724c00700 1 -- start start 2024-02-28T22:56:25.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.233+0000 7f8724c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8720102a90 0x7f8720197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:25.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.233+0000 7f8724c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87201980f0 con 0x7f8720102a90 2024-02-28T22:56:25.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.234+0000 7f871de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8720102a90 0x7f8720197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:25.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.234+0000 7f871de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8720102a90 0x7f8720197bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:40842/0 (socket says 172.21.15.184:40842) 2024-02-28T22:56:25.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.234+0000 7f871de00700 1 -- 172.21.15.184:0/3922788621 learned_addr learned my addr 172.21.15.184:0/3922788621 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:56:25.233 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.235+0000 7f871de00700 1 -- 172.21.15.184:0/3922788621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100095f0 con 0x7f8720102a90 2024-02-28T22:56:25.233 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.235+0000 7f871de00700 1 --2- 172.21.15.184:0/3922788621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8720102a90 0x7f8720197bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8710005950 tx=0x7f8710009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:25.234 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.236+0000 7f8716a00700 1 -- 172.21.15.184:0/3922788621 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f871001d070 con 0x7f8720102a90 2024-02-28T22:56:25.234 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.236+0000 7f8724c00700 1 -- 172.21.15.184:0/3922788621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87201982f0 con 0x7f8720102a90 2024-02-28T22:56:25.234 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.236+0000 7f8716a00700 1 -- 172.21.15.184:0/3922788621 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f871000be10 con 0x7f8720102a90 2024-02-28T22:56:25.234 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.236+0000 7f8716a00700 1 -- 172.21.15.184:0/3922788621 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f871000f460 con 0x7f8720102a90 2024-02-28T22:56:25.234 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.236+0000 7f8724c00700 1 -- 172.21.15.184:0/3922788621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8720198790 con 0x7f8720102a90 2024-02-28T22:56:25.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.237+0000 7f8724c00700 1 -- 172.21.15.184:0/3922788621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87201916b0 con 0x7f8720102a90 2024-02-28T22:56:25.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.238+0000 7f8716a00700 1 -- 172.21.15.184:0/3922788621 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f87100227c0 con 0x7f8720102a90 2024-02-28T22:56:25.236 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.238+0000 7f8716a00700 1 --2- 172.21.15.184:0/3922788621 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f87040383c0 0x7f870403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:25.236 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.238+0000 7f8716a00700 1 -- 172.21.15.184:0/3922788621 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f871004c4e0 con 0x7f8720102a90 2024-02-28T22:56:25.237 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.239+0000 7f871d400700 1 --2- 172.21.15.184:0/3922788621 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f87040383c0 0x7f870403a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:25.238 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.240+0000 7f871d400700 1 --2- 172.21.15.184:0/3922788621 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f87040383c0 0x7f870403a880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f870c006fd0 tx=0x7f870c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:25.252 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.254+0000 7f8716a00700 1 -- 172.21.15.184:0/3922788621 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f871002bba0 con 0x7f8720102a90 2024-02-28T22:56:25.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:25 smithi159 ceph-mon[28802]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:25.528 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.530+0000 7f8724c00700 1 -- 172.21.15.184:0/3922788621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f872002cc70 con 0x7f8720102a90 2024-02-28T22:56:25.529 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.531+0000 7f8716a00700 1 -- 172.21.15.184:0/3922788621 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f8710027030 con 0x7f8720102a90 2024-02-28T22:56:25.529 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:56:25.530 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:56:25.532 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.534+0000 7f8724c00700 1 -- 172.21.15.184:0/3922788621 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f87040383c0 msgr2=0x7f870403a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:25.532 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.534+0000 7f8724c00700 1 --2- 172.21.15.184:0/3922788621 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f87040383c0 0x7f870403a880 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f870c006fd0 tx=0x7f870c006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:25.532 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.534+0000 7f8724c00700 1 -- 172.21.15.184:0/3922788621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8720102a90 msgr2=0x7f8720197bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:25.532 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.534+0000 7f8724c00700 1 --2- 172.21.15.184:0/3922788621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8720102a90 0x7f8720197bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8710005950 tx=0x7f8710009e60 comp rx=0 tx=0).stop 2024-02-28T22:56:25.533 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.534+0000 7f8724c00700 1 -- 172.21.15.184:0/3922788621 shutdown_connections 2024-02-28T22:56:25.533 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.534+0000 7f8724c00700 1 --2- 172.21.15.184:0/3922788621 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f87040383c0 0x7f870403a880 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:25.533 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.534+0000 7f8724c00700 1 --2- 172.21.15.184:0/3922788621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8720102a90 0x7f8720197bb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:25.533 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.534+0000 7f8724c00700 1 -- 172.21.15.184:0/3922788621 >> 172.21.15.184:0/3922788621 conn(0x7f87200fe010 msgr2=0x7f87200fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:25.533 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.534+0000 7f8724c00700 1 -- 172.21.15.184:0/3922788621 shutdown_connections 2024-02-28T22:56:25.533 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:25.534+0000 7f8724c00700 1 -- 172.21.15.184:0/3922788621 wait complete. 2024-02-28T22:56:25.533 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:56:26.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:26 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/3922788621' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:56:27.466 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:56:27.466 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:56:27.471 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:27 smithi159 ceph-mon[28802]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:27.839 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:27.935 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:29 smithi159 ceph-mon[28802]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:29.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.941+0000 7f74f8c00700 1 -- 172.21.15.184:0/3697649378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f4102a90 msgr2=0x7f74f4102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:29.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.941+0000 7f74f8c00700 1 --2- 172.21.15.184:0/3697649378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f4102a90 0x7f74f4102eb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74e4009910 tx=0x7f74e4009c20 comp rx=0 tx=0).stop 2024-02-28T22:56:29.941 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.942+0000 7f74f8c00700 1 -- 172.21.15.184:0/3697649378 shutdown_connections 2024-02-28T22:56:29.942 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.942+0000 7f74f8c00700 1 --2- 172.21.15.184:0/3697649378 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f4102a90 0x7f74f4102eb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:29.942 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.942+0000 7f74f8c00700 1 -- 172.21.15.184:0/3697649378 >> 172.21.15.184:0/3697649378 conn(0x7f74f40fe010 msgr2=0x7f74f4100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:29.942 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.942+0000 7f74f8c00700 1 -- 172.21.15.184:0/3697649378 shutdown_connections 2024-02-28T22:56:29.942 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.942+0000 7f74f8c00700 1 -- 172.21.15.184:0/3697649378 wait complete. 2024-02-28T22:56:29.942 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.943+0000 7f74f8c00700 1 Processor -- start 2024-02-28T22:56:29.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.943+0000 7f74f8c00700 1 -- start start 2024-02-28T22:56:29.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.943+0000 7f74f8c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f4102a90 0x7f74f4197bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:29.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.944+0000 7f74f8c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74f41980f0 con 0x7f74f4102a90 2024-02-28T22:56:29.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.944+0000 7f74f1e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f4102a90 0x7f74f4197bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:29.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.944+0000 7f74f1e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f4102a90 0x7f74f4197bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:39214/0 (socket says 172.21.15.184:39214) 2024-02-28T22:56:29.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.944+0000 7f74f1e00700 1 -- 172.21.15.184:0/727389117 learned_addr learned my addr 172.21.15.184:0/727389117 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:56:29.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.944+0000 7f74f1e00700 1 -- 172.21.15.184:0/727389117 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e40095f0 con 0x7f74f4102a90 2024-02-28T22:56:29.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.945+0000 7f74f1e00700 1 --2- 172.21.15.184:0/727389117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f4102a90 0x7f74f4197bb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74e4005b40 tx=0x7f74e4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:29.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.945+0000 7f74eaa00700 1 -- 172.21.15.184:0/727389117 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74e401d070 con 0x7f74f4102a90 2024-02-28T22:56:29.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.945+0000 7f74f8c00700 1 -- 172.21.15.184:0/727389117 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f41982f0 con 0x7f74f4102a90 2024-02-28T22:56:29.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.945+0000 7f74eaa00700 1 -- 172.21.15.184:0/727389117 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f74e400be10 con 0x7f74f4102a90 2024-02-28T22:56:29.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.945+0000 7f74eaa00700 1 -- 172.21.15.184:0/727389117 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f74e400f460 con 0x7f74f4102a90 2024-02-28T22:56:29.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.946+0000 7f74f8c00700 1 -- 172.21.15.184:0/727389117 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f4198790 con 0x7f74f4102a90 2024-02-28T22:56:29.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.947+0000 7f74f8c00700 1 -- 172.21.15.184:0/727389117 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74f41916b0 con 0x7f74f4102a90 2024-02-28T22:56:29.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.947+0000 7f74eaa00700 1 -- 172.21.15.184:0/727389117 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f74e40227e0 con 0x7f74f4102a90 2024-02-28T22:56:29.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.947+0000 7f74eaa00700 1 --2- 172.21.15.184:0/727389117 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f74d80383c0 0x7f74d803a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:29.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.948+0000 7f74eaa00700 1 -- 172.21.15.184:0/727389117 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f74e404c560 con 0x7f74f4102a90 2024-02-28T22:56:29.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.948+0000 7f74f1400700 1 --2- 172.21.15.184:0/727389117 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f74d80383c0 0x7f74d803a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:29.948 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.949+0000 7f74f1400700 1 --2- 172.21.15.184:0/727389117 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f74d80383c0 0x7f74d803a880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f74e0006fd0 tx=0x7f74e0006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:29.964 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:29.965+0000 7f74eaa00700 1 -- 172.21.15.184:0/727389117 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f74e402bba0 con 0x7f74f4102a90 2024-02-28T22:56:30.258 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.259+0000 7f74f8c00700 1 -- 172.21.15.184:0/727389117 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f74f402cc70 con 0x7f74f4102a90 2024-02-28T22:56:30.259 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.260+0000 7f74eaa00700 1 -- 172.21.15.184:0/727389117 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f74e4027020 con 0x7f74f4102a90 2024-02-28T22:56:30.259 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:56:30.259 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:56:30.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.262+0000 7f74f8c00700 1 -- 172.21.15.184:0/727389117 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f74d80383c0 msgr2=0x7f74d803a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:30.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.262+0000 7f74f8c00700 1 --2- 172.21.15.184:0/727389117 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f74d80383c0 0x7f74d803a880 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f74e0006fd0 tx=0x7f74e0006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:30.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.262+0000 7f74f8c00700 1 -- 172.21.15.184:0/727389117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f4102a90 msgr2=0x7f74f4197bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:30.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.262+0000 7f74f8c00700 1 --2- 172.21.15.184:0/727389117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f4102a90 0x7f74f4197bb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f74e4005b40 tx=0x7f74e4004740 comp rx=0 tx=0).stop 2024-02-28T22:56:30.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.262+0000 7f74f8c00700 1 -- 172.21.15.184:0/727389117 shutdown_connections 2024-02-28T22:56:30.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.262+0000 7f74f8c00700 1 --2- 172.21.15.184:0/727389117 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f74d80383c0 0x7f74d803a880 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:30.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.262+0000 7f74f8c00700 1 --2- 172.21.15.184:0/727389117 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f74f4102a90 0x7f74f4197bb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:30.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.262+0000 7f74f8c00700 1 -- 172.21.15.184:0/727389117 >> 172.21.15.184:0/727389117 conn(0x7f74f40fe010 msgr2=0x7f74f40fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:30.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.263+0000 7f74f8c00700 1 -- 172.21.15.184:0/727389117 shutdown_connections 2024-02-28T22:56:30.263 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:30.263+0000 7f74f8c00700 1 -- 172.21.15.184:0/727389117 wait complete. 2024-02-28T22:56:30.263 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:56:31.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:31 smithi159 ceph-mon[28802]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:31.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:31 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/727389117' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:56:32.013 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:56:32.014 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:56:32.394 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:32.503 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:33.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:33 smithi159 ceph-mon[28802]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:34.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.436+0000 7f824ac00700 1 -- 172.21.15.184:0/1377549479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82441008b0 msgr2=0x7f8244100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:34.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.436+0000 7f824ac00700 1 --2- 172.21.15.184:0/1377549479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82441008b0 0x7f8244100cd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8234009910 tx=0x7f8234009c20 comp rx=0 tx=0).stop 2024-02-28T22:56:34.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.436+0000 7f824ac00700 1 -- 172.21.15.184:0/1377549479 shutdown_connections 2024-02-28T22:56:34.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.436+0000 7f824ac00700 1 --2- 172.21.15.184:0/1377549479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82441008b0 0x7f8244100cd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:34.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.436+0000 7f824ac00700 1 -- 172.21.15.184:0/1377549479 >> 172.21.15.184:0/1377549479 conn(0x7f82440fbe30 msgr2=0x7f82440fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:34.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.436+0000 7f824ac00700 1 -- 172.21.15.184:0/1377549479 shutdown_connections 2024-02-28T22:56:34.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.436+0000 7f824ac00700 1 -- 172.21.15.184:0/1377549479 wait complete. 2024-02-28T22:56:34.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.437+0000 7f824ac00700 1 Processor -- start 2024-02-28T22:56:34.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.437+0000 7f824ac00700 1 -- start start 2024-02-28T22:56:34.437 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.438+0000 7f824ac00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82441008b0 0x7f8244197bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:34.437 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.438+0000 7f824ac00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8244198110 con 0x7f82441008b0 2024-02-28T22:56:34.437 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.438+0000 7f8243e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82441008b0 0x7f8244197bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:34.438 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.438+0000 7f8243e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82441008b0 0x7f8244197bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:39238/0 (socket says 172.21.15.184:39238) 2024-02-28T22:56:34.438 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.438+0000 7f8243e00700 1 -- 172.21.15.184:0/207287952 learned_addr learned my addr 172.21.15.184:0/207287952 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:56:34.438 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.439+0000 7f8243e00700 1 -- 172.21.15.184:0/207287952 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340095f0 con 0x7f82441008b0 2024-02-28T22:56:34.438 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.439+0000 7f8243e00700 1 --2- 172.21.15.184:0/207287952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82441008b0 0x7f8244197bd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8234005950 tx=0x7f8234009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:34.439 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.440+0000 7f8240c00700 1 -- 172.21.15.184:0/207287952 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f823401d070 con 0x7f82441008b0 2024-02-28T22:56:34.439 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.440+0000 7f8240c00700 1 -- 172.21.15.184:0/207287952 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f823400be10 con 0x7f82441008b0 2024-02-28T22:56:34.439 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.440+0000 7f8240c00700 1 -- 172.21.15.184:0/207287952 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f823400f460 con 0x7f82441008b0 2024-02-28T22:56:34.439 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.440+0000 7f824ac00700 1 -- 172.21.15.184:0/207287952 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8244198310 con 0x7f82441008b0 2024-02-28T22:56:34.439 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.440+0000 7f824ac00700 1 -- 172.21.15.184:0/207287952 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82441987b0 con 0x7f82441008b0 2024-02-28T22:56:34.440 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.441+0000 7f824ac00700 1 -- 172.21.15.184:0/207287952 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82441918d0 con 0x7f82441008b0 2024-02-28T22:56:34.441 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.442+0000 7f8240c00700 1 -- 172.21.15.184:0/207287952 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f82340227c0 con 0x7f82441008b0 2024-02-28T22:56:34.441 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.442+0000 7f8240c00700 1 --2- 172.21.15.184:0/207287952 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8228038410 0x7f822803a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:34.441 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.442+0000 7f8240c00700 1 -- 172.21.15.184:0/207287952 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f823404c520 con 0x7f82441008b0 2024-02-28T22:56:34.442 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.443+0000 7f8243400700 1 --2- 172.21.15.184:0/207287952 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8228038410 0x7f822803a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:34.443 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.444+0000 7f8243400700 1 --2- 172.21.15.184:0/207287952 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8228038410 0x7f822803a8d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8230006fd0 tx=0x7f8230006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:34.456 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.457+0000 7f8240c00700 1 -- 172.21.15.184:0/207287952 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f823402ba00 con 0x7f82441008b0 2024-02-28T22:56:34.754 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.754+0000 7f824ac00700 1 -- 172.21.15.184:0/207287952 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f824402cc70 con 0x7f82441008b0 2024-02-28T22:56:34.755 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.755+0000 7f8240c00700 1 -- 172.21.15.184:0/207287952 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f8234027030 con 0x7f82441008b0 2024-02-28T22:56:34.755 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:56:34.755 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:56:34.757 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.758+0000 7f824ac00700 1 -- 172.21.15.184:0/207287952 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8228038410 msgr2=0x7f822803a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:34.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.758+0000 7f824ac00700 1 --2- 172.21.15.184:0/207287952 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8228038410 0x7f822803a8d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8230006fd0 tx=0x7f8230006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:34.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.758+0000 7f824ac00700 1 -- 172.21.15.184:0/207287952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82441008b0 msgr2=0x7f8244197bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:34.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.758+0000 7f824ac00700 1 --2- 172.21.15.184:0/207287952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82441008b0 0x7f8244197bd0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8234005950 tx=0x7f8234009e60 comp rx=0 tx=0).stop 2024-02-28T22:56:34.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.758+0000 7f824ac00700 1 -- 172.21.15.184:0/207287952 shutdown_connections 2024-02-28T22:56:34.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.758+0000 7f824ac00700 1 --2- 172.21.15.184:0/207287952 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f8228038410 0x7f822803a8d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:34.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.758+0000 7f824ac00700 1 --2- 172.21.15.184:0/207287952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f82441008b0 0x7f8244197bd0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:34.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.758+0000 7f824ac00700 1 -- 172.21.15.184:0/207287952 >> 172.21.15.184:0/207287952 conn(0x7f82440fbe30 msgr2=0x7f82440fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:34.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.758+0000 7f824ac00700 1 -- 172.21.15.184:0/207287952 shutdown_connections 2024-02-28T22:56:34.758 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:34.759+0000 7f824ac00700 1 -- 172.21.15.184:0/207287952 wait complete. 2024-02-28T22:56:34.759 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:56:35.450 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:35 smithi159 ceph-mon[28802]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:35.450 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:35 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/207287952' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:56:36.472 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:56:36.472 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:56:36.841 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:36.939 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:37.439 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:37 smithi159 ceph-mon[28802]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:38.448 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:38 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:38.449 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:38 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:38.449 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:38 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:38.449 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:38 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:38.449 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:38 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:38.449 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:38 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:38.449 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:38 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:38.449 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:38 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:38.799 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.800+0000 7f14a1c00700 1 -- 172.21.15.184:0/3773509092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f149c106fa0 msgr2=0x7f149c1073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:38.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.800+0000 7f14a1c00700 1 --2- 172.21.15.184:0/3773509092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f149c106fa0 0x7f149c1073c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f148c009910 tx=0x7f148c009c20 comp rx=0 tx=0).stop 2024-02-28T22:56:38.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.800+0000 7f14a1c00700 1 -- 172.21.15.184:0/3773509092 shutdown_connections 2024-02-28T22:56:38.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.800+0000 7f14a1c00700 1 --2- 172.21.15.184:0/3773509092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f149c106fa0 0x7f149c1073c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:38.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.800+0000 7f14a1c00700 1 -- 172.21.15.184:0/3773509092 >> 172.21.15.184:0/3773509092 conn(0x7f149c075ff0 msgr2=0x7f149c078450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:38.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.800+0000 7f14a1c00700 1 -- 172.21.15.184:0/3773509092 shutdown_connections 2024-02-28T22:56:38.800 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.800+0000 7f14a1c00700 1 -- 172.21.15.184:0/3773509092 wait complete. 2024-02-28T22:56:38.801 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.801+0000 7f14a1c00700 1 Processor -- start 2024-02-28T22:56:38.801 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.801+0000 7f14a1c00700 1 -- start start 2024-02-28T22:56:38.801 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.802+0000 7f14a1c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f149c106fa0 0x7f149c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:38.801 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.802+0000 7f14a1c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f149c19c4e0 con 0x7f149c106fa0 2024-02-28T22:56:38.801 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.802+0000 7f149aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f149c106fa0 0x7f149c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:38.801 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.802+0000 7f149aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f149c106fa0 0x7f149c19bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:36782/0 (socket says 172.21.15.184:36782) 2024-02-28T22:56:38.801 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.802+0000 7f149aa00700 1 -- 172.21.15.184:0/379808535 learned_addr learned my addr 172.21.15.184:0/379808535 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:56:38.802 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.803+0000 7f149aa00700 1 -- 172.21.15.184:0/379808535 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c0095f0 con 0x7f149c106fa0 2024-02-28T22:56:38.802 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.803+0000 7f149aa00700 1 --2- 172.21.15.184:0/379808535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f149c106fa0 0x7f149c19bfa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f148c005b40 tx=0x7f148c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:38.803 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.803+0000 7f1493400700 1 -- 172.21.15.184:0/379808535 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f148c01d070 con 0x7f149c106fa0 2024-02-28T22:56:38.803 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.804+0000 7f1493400700 1 -- 172.21.15.184:0/379808535 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f148c00be10 con 0x7f149c106fa0 2024-02-28T22:56:38.803 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.804+0000 7f14a1c00700 1 -- 172.21.15.184:0/379808535 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149c19c6e0 con 0x7f149c106fa0 2024-02-28T22:56:38.803 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.804+0000 7f1493400700 1 -- 172.21.15.184:0/379808535 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f148c00f460 con 0x7f149c106fa0 2024-02-28T22:56:38.803 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.804+0000 7f14a1c00700 1 -- 172.21.15.184:0/379808535 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f149c19cb80 con 0x7f149c106fa0 2024-02-28T22:56:38.804 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.805+0000 7f14a1c00700 1 -- 172.21.15.184:0/379808535 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f149c195a20 con 0x7f149c106fa0 2024-02-28T22:56:38.804 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.805+0000 7f1493400700 1 -- 172.21.15.184:0/379808535 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f148c0227e0 con 0x7f149c106fa0 2024-02-28T22:56:38.805 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.806+0000 7f1493400700 1 --2- 172.21.15.184:0/379808535 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f14800383c0 0x7f148003a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:38.805 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.806+0000 7f1493400700 1 -- 172.21.15.184:0/379808535 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f148c04cfd0 con 0x7f149c106fa0 2024-02-28T22:56:38.805 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.807+0000 7f149a000700 1 --2- 172.21.15.184:0/379808535 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f14800383c0 0x7f148003a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:38.806 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.808+0000 7f149a000700 1 --2- 172.21.15.184:0/379808535 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f14800383c0 0x7f148003a880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1488006fd0 tx=0x7f1488006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:38.820 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:38.821+0000 7f1493400700 1 -- 172.21.15.184:0/379808535 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f148c03dbc0 con 0x7f149c106fa0 2024-02-28T22:56:39.109 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.110+0000 7f14a1c00700 1 -- 172.21.15.184:0/379808535 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f149c02cc70 con 0x7f149c106fa0 2024-02-28T22:56:39.112 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.113+0000 7f1493400700 1 -- 172.21.15.184:0/379808535 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f148c027300 con 0x7f149c106fa0 2024-02-28T22:56:39.112 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:56:39.112 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:56:39.114 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.115+0000 7f14a1c00700 1 -- 172.21.15.184:0/379808535 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f14800383c0 msgr2=0x7f148003a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:39.115 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.115+0000 7f14a1c00700 1 --2- 172.21.15.184:0/379808535 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f14800383c0 0x7f148003a880 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1488006fd0 tx=0x7f1488006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:39.115 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.115+0000 7f14a1c00700 1 -- 172.21.15.184:0/379808535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f149c106fa0 msgr2=0x7f149c19bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:39.115 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.115+0000 7f14a1c00700 1 --2- 172.21.15.184:0/379808535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f149c106fa0 0x7f149c19bfa0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f148c005b40 tx=0x7f148c004740 comp rx=0 tx=0).stop 2024-02-28T22:56:39.115 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.115+0000 7f14a1c00700 1 -- 172.21.15.184:0/379808535 shutdown_connections 2024-02-28T22:56:39.115 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.115+0000 7f14a1c00700 1 --2- 172.21.15.184:0/379808535 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f14800383c0 0x7f148003a880 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:39.115 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.115+0000 7f14a1c00700 1 --2- 172.21.15.184:0/379808535 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f149c106fa0 0x7f149c19bfa0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:39.115 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.115+0000 7f14a1c00700 1 -- 172.21.15.184:0/379808535 >> 172.21.15.184:0/379808535 conn(0x7f149c075ff0 msgr2=0x7f149c076cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:39.115 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.115+0000 7f14a1c00700 1 -- 172.21.15.184:0/379808535 shutdown_connections 2024-02-28T22:56:39.115 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:39.116+0000 7f14a1c00700 1 -- 172.21.15.184:0/379808535 wait complete. 2024-02-28T22:56:39.116 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:56:39.538 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:39 smithi159 ceph-mon[28802]: Deploying daemon prometheus.smithi159 on smithi159 2024-02-28T22:56:39.539 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:39 smithi159 ceph-mon[28802]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:39.539 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:39 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/379808535' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:56:40.811 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:56:40.815 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:56:41.187 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:41.289 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:41 smithi159 ceph-mon[28802]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:43.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.180+0000 7f705f000700 1 -- 172.21.15.184:0/1093355088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7058102a90 msgr2=0x7f7058102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:43.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.180+0000 7f705f000700 1 --2- 172.21.15.184:0/1093355088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7058102a90 0x7f7058102eb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7048009910 tx=0x7f7048009c20 comp rx=0 tx=0).stop 2024-02-28T22:56:43.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.180+0000 7f705f000700 1 -- 172.21.15.184:0/1093355088 shutdown_connections 2024-02-28T22:56:43.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.180+0000 7f705f000700 1 --2- 172.21.15.184:0/1093355088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7058102a90 0x7f7058102eb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:43.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.180+0000 7f705f000700 1 -- 172.21.15.184:0/1093355088 >> 172.21.15.184:0/1093355088 conn(0x7f70580fe010 msgr2=0x7f7058100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:43.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.180+0000 7f705f000700 1 -- 172.21.15.184:0/1093355088 shutdown_connections 2024-02-28T22:56:43.180 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.180+0000 7f705f000700 1 -- 172.21.15.184:0/1093355088 wait complete. 2024-02-28T22:56:43.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.181+0000 7f705f000700 1 Processor -- start 2024-02-28T22:56:43.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.181+0000 7f705f000700 1 -- start start 2024-02-28T22:56:43.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.182+0000 7f705f000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7058102a90 0x7f7058197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:43.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.182+0000 7f705f000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7058198080 con 0x7f7058102a90 2024-02-28T22:56:43.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.182+0000 7f7057e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7058102a90 0x7f7058197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:43.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.182+0000 7f7057e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7058102a90 0x7f7058197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:36808/0 (socket says 172.21.15.184:36808) 2024-02-28T22:56:43.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.182+0000 7f7057e00700 1 -- 172.21.15.184:0/2068766353 learned_addr learned my addr 172.21.15.184:0/2068766353 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:56:43.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.183+0000 7f7057e00700 1 -- 172.21.15.184:0/2068766353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70480095f0 con 0x7f7058102a90 2024-02-28T22:56:43.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.184+0000 7f7057e00700 1 --2- 172.21.15.184:0/2068766353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7058102a90 0x7f7058197b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7048005950 tx=0x7f7048009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:43.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.184+0000 7f7054c00700 1 -- 172.21.15.184:0/2068766353 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f704801d070 con 0x7f7058102a90 2024-02-28T22:56:43.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.184+0000 7f705f000700 1 -- 172.21.15.184:0/2068766353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7058198280 con 0x7f7058102a90 2024-02-28T22:56:43.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.184+0000 7f7054c00700 1 -- 172.21.15.184:0/2068766353 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f704800be10 con 0x7f7058102a90 2024-02-28T22:56:43.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.184+0000 7f7054c00700 1 -- 172.21.15.184:0/2068766353 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f704800f460 con 0x7f7058102a90 2024-02-28T22:56:43.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.184+0000 7f705f000700 1 -- 172.21.15.184:0/2068766353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7058198720 con 0x7f7058102a90 2024-02-28T22:56:43.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.185+0000 7f705f000700 1 -- 172.21.15.184:0/2068766353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70581916b0 con 0x7f7058102a90 2024-02-28T22:56:43.185 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.186+0000 7f7054c00700 1 -- 172.21.15.184:0/2068766353 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f70480227c0 con 0x7f7058102a90 2024-02-28T22:56:43.185 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.186+0000 7f7054c00700 1 --2- 172.21.15.184:0/2068766353 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f703c0383c0 0x7f703c03a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:43.185 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.186+0000 7f7054c00700 1 -- 172.21.15.184:0/2068766353 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f704804c420 con 0x7f7058102a90 2024-02-28T22:56:43.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.187+0000 7f7057400700 1 --2- 172.21.15.184:0/2068766353 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f703c0383c0 0x7f703c03a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:43.187 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.188+0000 7f7057400700 1 --2- 172.21.15.184:0/2068766353 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f703c0383c0 0x7f703c03a880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7044006fd0 tx=0x7f7044006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:43.194 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.195+0000 7f7054c00700 1 -- 172.21.15.184:0/2068766353 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f704802bba0 con 0x7f7058102a90 2024-02-28T22:56:43.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:43 smithi159 ceph-mon[28802]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:43.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:43 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:43.492 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.493+0000 7f705f000700 1 -- 172.21.15.184:0/2068766353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f705802cc70 con 0x7f7058102a90 2024-02-28T22:56:43.493 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.494+0000 7f7054c00700 1 -- 172.21.15.184:0/2068766353 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f7048027070 con 0x7f7058102a90 2024-02-28T22:56:43.494 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:56:43.494 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:56:43.496 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.497+0000 7f705f000700 1 -- 172.21.15.184:0/2068766353 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f703c0383c0 msgr2=0x7f703c03a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:43.496 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.497+0000 7f705f000700 1 --2- 172.21.15.184:0/2068766353 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f703c0383c0 0x7f703c03a880 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7044006fd0 tx=0x7f7044006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.497+0000 7f705f000700 1 -- 172.21.15.184:0/2068766353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7058102a90 msgr2=0x7f7058197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.497+0000 7f705f000700 1 --2- 172.21.15.184:0/2068766353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7058102a90 0x7f7058197b40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7048005950 tx=0x7f7048009e60 comp rx=0 tx=0).stop 2024-02-28T22:56:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.497+0000 7f705f000700 1 -- 172.21.15.184:0/2068766353 shutdown_connections 2024-02-28T22:56:43.497 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.497+0000 7f705f000700 1 --2- 172.21.15.184:0/2068766353 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f703c0383c0 0x7f703c03a880 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:43.498 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.497+0000 7f705f000700 1 --2- 172.21.15.184:0/2068766353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7058102a90 0x7f7058197b40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:43.498 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.497+0000 7f705f000700 1 -- 172.21.15.184:0/2068766353 >> 172.21.15.184:0/2068766353 conn(0x7f70580fe010 msgr2=0x7f70580fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:43.498 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.497+0000 7f705f000700 1 -- 172.21.15.184:0/2068766353 shutdown_connections 2024-02-28T22:56:43.498 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:43.497+0000 7f705f000700 1 -- 172.21.15.184:0/2068766353 wait complete. 2024-02-28T22:56:43.498 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:56:44.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:44 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/2068766353' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:56:45.216 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:56:45.217 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:56:45.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:45 smithi159 ceph-mon[28802]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:45.591 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:45.693 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:47.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:47 smithi159 ceph-mon[28802]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:47.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.657+0000 7f5174a00700 1 -- 172.21.15.184:0/3299409351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5170074dc0 msgr2=0x7f5170073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:47.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.657+0000 7f5174a00700 1 --2- 172.21.15.184:0/3299409351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5170074dc0 0x7f5170073220 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5160009910 tx=0x7f5160009c20 comp rx=0 tx=0).stop 2024-02-28T22:56:47.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.657+0000 7f5174a00700 1 -- 172.21.15.184:0/3299409351 shutdown_connections 2024-02-28T22:56:47.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.657+0000 7f5174a00700 1 --2- 172.21.15.184:0/3299409351 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5170074dc0 0x7f5170073220 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:47.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.657+0000 7f5174a00700 1 -- 172.21.15.184:0/3299409351 >> 172.21.15.184:0/3299409351 conn(0x7f51700fbc90 msgr2=0x7f51700fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:47.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.657+0000 7f5174a00700 1 -- 172.21.15.184:0/3299409351 shutdown_connections 2024-02-28T22:56:47.657 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.657+0000 7f5174a00700 1 -- 172.21.15.184:0/3299409351 wait complete. 2024-02-28T22:56:47.658 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.658+0000 7f5174a00700 1 Processor -- start 2024-02-28T22:56:47.658 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.659+0000 7f5174a00700 1 -- start start 2024-02-28T22:56:47.658 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.659+0000 7f5174a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5170074dc0 0x7f51701979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:47.658 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.659+0000 7f5174a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5170197f00 con 0x7f5170074dc0 2024-02-28T22:56:47.659 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.660+0000 7f516e800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5170074dc0 0x7f51701979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:47.659 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.660+0000 7f516e800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5170074dc0 0x7f51701979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:36832/0 (socket says 172.21.15.184:36832) 2024-02-28T22:56:47.659 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.660+0000 7f516e800700 1 -- 172.21.15.184:0/3063220555 learned_addr learned my addr 172.21.15.184:0/3063220555 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:56:47.660 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.660+0000 7f516e800700 1 -- 172.21.15.184:0/3063220555 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51600095f0 con 0x7f5170074dc0 2024-02-28T22:56:47.660 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.661+0000 7f516e800700 1 --2- 172.21.15.184:0/3063220555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5170074dc0 0x7f51701979c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5160005b40 tx=0x7f5160004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:47.660 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.661+0000 7f5167400700 1 -- 172.21.15.184:0/3063220555 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f516001d070 con 0x7f5170074dc0 2024-02-28T22:56:47.660 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.661+0000 7f5174a00700 1 -- 172.21.15.184:0/3063220555 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5170198100 con 0x7f5170074dc0 2024-02-28T22:56:47.661 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.661+0000 7f5167400700 1 -- 172.21.15.184:0/3063220555 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f516000be10 con 0x7f5170074dc0 2024-02-28T22:56:47.661 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.661+0000 7f5167400700 1 -- 172.21.15.184:0/3063220555 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f516000f460 con 0x7f5170074dc0 2024-02-28T22:56:47.661 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.661+0000 7f5174a00700 1 -- 172.21.15.184:0/3063220555 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51701985a0 con 0x7f5170074dc0 2024-02-28T22:56:47.661 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.662+0000 7f5174a00700 1 -- 172.21.15.184:0/3063220555 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5170191500 con 0x7f5170074dc0 2024-02-28T22:56:47.661 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.663+0000 7f5167400700 1 -- 172.21.15.184:0/3063220555 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f51600227e0 con 0x7f5170074dc0 2024-02-28T22:56:47.662 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.663+0000 7f5167400700 1 --2- 172.21.15.184:0/3063220555 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f51540383c0 0x7f515403a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:47.662 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.663+0000 7f5167400700 1 -- 172.21.15.184:0/3063220555 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f516004c3b0 con 0x7f5170074dc0 2024-02-28T22:56:47.662 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.664+0000 7f516de00700 1 --2- 172.21.15.184:0/3063220555 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f51540383c0 0x7f515403a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:47.664 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.665+0000 7f516de00700 1 --2- 172.21.15.184:0/3063220555 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f51540383c0 0x7f515403a880 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f515c006fd0 tx=0x7f515c006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:47.676 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.678+0000 7f5167400700 1 -- 172.21.15.184:0/3063220555 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f516002bba0 con 0x7f5170074dc0 2024-02-28T22:56:47.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.974+0000 7f5174a00700 1 -- 172.21.15.184:0/3063220555 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f517002cc70 con 0x7f5170074dc0 2024-02-28T22:56:47.975 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.976+0000 7f5167400700 1 -- 172.21.15.184:0/3063220555 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f5160027030 con 0x7f5170074dc0 2024-02-28T22:56:47.975 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:56:47.975 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:56:47.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.978+0000 7f5174a00700 1 -- 172.21.15.184:0/3063220555 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f51540383c0 msgr2=0x7f515403a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:47.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.978+0000 7f5174a00700 1 --2- 172.21.15.184:0/3063220555 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f51540383c0 0x7f515403a880 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f515c006fd0 tx=0x7f515c006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:47.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.978+0000 7f5174a00700 1 -- 172.21.15.184:0/3063220555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5170074dc0 msgr2=0x7f51701979c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:47.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.978+0000 7f5174a00700 1 --2- 172.21.15.184:0/3063220555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5170074dc0 0x7f51701979c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5160005b40 tx=0x7f5160004740 comp rx=0 tx=0).stop 2024-02-28T22:56:47.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.978+0000 7f5174a00700 1 -- 172.21.15.184:0/3063220555 shutdown_connections 2024-02-28T22:56:47.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.978+0000 7f5174a00700 1 --2- 172.21.15.184:0/3063220555 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f51540383c0 0x7f515403a880 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:47.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.978+0000 7f5174a00700 1 --2- 172.21.15.184:0/3063220555 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5170074dc0 0x7f51701979c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:47.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.978+0000 7f5174a00700 1 -- 172.21.15.184:0/3063220555 >> 172.21.15.184:0/3063220555 conn(0x7f51700fbc90 msgr2=0x7f51700fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:47.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.978+0000 7f5174a00700 1 -- 172.21.15.184:0/3063220555 shutdown_connections 2024-02-28T22:56:47.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:47.978+0000 7f5174a00700 1 -- 172.21.15.184:0/3063220555 wait complete. 2024-02-28T22:56:47.979 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:56:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:48 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/3063220555' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:56:49.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:49 smithi159 ceph-mon[28802]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:49.712 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:56:49.713 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:56:50.097 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:50.190 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:51 smithi159 ceph-mon[28802]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:52.092 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.092+0000 7f4d3f600700 1 -- 172.21.15.184:0/1595442270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d381008b0 msgr2=0x7f4d38100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:52.092 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.092+0000 7f4d3f600700 1 --2- 172.21.15.184:0/1595442270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d381008b0 0x7f4d38100cd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c009910 tx=0x7f4d2c009c20 comp rx=0 tx=0).stop 2024-02-28T22:56:52.092 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.092+0000 7f4d3f600700 1 -- 172.21.15.184:0/1595442270 shutdown_connections 2024-02-28T22:56:52.092 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.092+0000 7f4d3f600700 1 --2- 172.21.15.184:0/1595442270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d381008b0 0x7f4d38100cd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:52.093 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.092+0000 7f4d3f600700 1 -- 172.21.15.184:0/1595442270 >> 172.21.15.184:0/1595442270 conn(0x7f4d380fbe30 msgr2=0x7f4d380fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:52.093 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.093+0000 7f4d3f600700 1 -- 172.21.15.184:0/1595442270 shutdown_connections 2024-02-28T22:56:52.093 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.093+0000 7f4d3f600700 1 -- 172.21.15.184:0/1595442270 wait complete. 2024-02-28T22:56:52.094 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.094+0000 7f4d3f600700 1 Processor -- start 2024-02-28T22:56:52.094 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.094+0000 7f4d3f600700 1 -- start start 2024-02-28T22:56:52.094 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.094+0000 7f4d3f600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d381008b0 0x7f4d3818f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:52.094 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.094+0000 7f4d3f600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3818fbd0 con 0x7f4d381008b0 2024-02-28T22:56:52.094 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.095+0000 7f4d3cc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d381008b0 0x7f4d3818f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:52.094 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.095+0000 7f4d3cc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d381008b0 0x7f4d3818f690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:57822/0 (socket says 172.21.15.184:57822) 2024-02-28T22:56:52.094 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.095+0000 7f4d3cc00700 1 -- 172.21.15.184:0/4199865018 learned_addr learned my addr 172.21.15.184:0/4199865018 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:56:52.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.095+0000 7f4d3cc00700 1 -- 172.21.15.184:0/4199865018 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d2c0095f0 con 0x7f4d381008b0 2024-02-28T22:56:52.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.095+0000 7f4d3cc00700 1 --2- 172.21.15.184:0/4199865018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d381008b0 0x7f4d3818f690 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c005b40 tx=0x7f4d2c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:52.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.096+0000 7f4d35600700 1 -- 172.21.15.184:0/4199865018 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d2c01d070 con 0x7f4d381008b0 2024-02-28T22:56:52.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.096+0000 7f4d3f600700 1 -- 172.21.15.184:0/4199865018 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3818fdd0 con 0x7f4d381008b0 2024-02-28T22:56:52.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.096+0000 7f4d35600700 1 -- 172.21.15.184:0/4199865018 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4d2c00be10 con 0x7f4d381008b0 2024-02-28T22:56:52.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.096+0000 7f4d35600700 1 -- 172.21.15.184:0/4199865018 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4d2c00f460 con 0x7f4d381008b0 2024-02-28T22:56:52.095 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.096+0000 7f4d3f600700 1 -- 172.21.15.184:0/4199865018 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3818c340 con 0x7f4d381008b0 2024-02-28T22:56:52.096 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.097+0000 7f4d3f600700 1 -- 172.21.15.184:0/4199865018 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d380623c0 con 0x7f4d381008b0 2024-02-28T22:56:52.096 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.097+0000 7f4d35600700 1 -- 172.21.15.184:0/4199865018 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) v1 ==== 45340+0+0 (secure 0 0 0) 0x7f4d2c0227e0 con 0x7f4d381008b0 2024-02-28T22:56:52.097 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.098+0000 7f4d35600700 1 --2- 172.21.15.184:0/4199865018 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f4d20038410 0x7f4d2003a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:52.097 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.098+0000 7f4d35600700 1 -- 172.21.15.184:0/4199865018 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f4d2c04c420 con 0x7f4d381008b0 2024-02-28T22:56:52.097 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.098+0000 7f4d37e00700 1 --2- 172.21.15.184:0/4199865018 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f4d20038410 0x7f4d2003a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:52.098 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.099+0000 7f4d37e00700 1 --2- 172.21.15.184:0/4199865018 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f4d20038410 0x7f4d2003a8d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4d24006fd0 tx=0x7f4d24006e40 comp rx=0 tx=0).ready entity=mgr.14164 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:52.106 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.108+0000 7f4d35600700 1 -- 172.21.15.184:0/4199865018 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4d2c02ba00 con 0x7f4d381008b0 2024-02-28T22:56:52.401 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.402+0000 7f4d3f600700 1 -- 172.21.15.184:0/4199865018 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4d381910e0 con 0x7f4d381008b0 2024-02-28T22:56:52.402 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.403+0000 7f4d35600700 1 -- 172.21.15.184:0/4199865018 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f4d2c027020 con 0x7f4d381008b0 2024-02-28T22:56:52.402 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:56:52.403 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:56:52.405 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.407+0000 7f4d3f600700 1 -- 172.21.15.184:0/4199865018 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f4d20038410 msgr2=0x7f4d2003a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:52.405 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.407+0000 7f4d3f600700 1 --2- 172.21.15.184:0/4199865018 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f4d20038410 0x7f4d2003a8d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4d24006fd0 tx=0x7f4d24006e40 comp rx=0 tx=0).stop 2024-02-28T22:56:52.405 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.407+0000 7f4d3f600700 1 -- 172.21.15.184:0/4199865018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d381008b0 msgr2=0x7f4d3818f690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:52.405 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.407+0000 7f4d3f600700 1 --2- 172.21.15.184:0/4199865018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d381008b0 0x7f4d3818f690 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c005b40 tx=0x7f4d2c004740 comp rx=0 tx=0).stop 2024-02-28T22:56:52.405 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.407+0000 7f4d3f600700 1 -- 172.21.15.184:0/4199865018 shutdown_connections 2024-02-28T22:56:52.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.407+0000 7f4d3f600700 1 --2- 172.21.15.184:0/4199865018 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f4d20038410 0x7f4d2003a8d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:52.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.407+0000 7f4d3f600700 1 --2- 172.21.15.184:0/4199865018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d381008b0 0x7f4d3818f690 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:52.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.407+0000 7f4d3f600700 1 -- 172.21.15.184:0/4199865018 >> 172.21.15.184:0/4199865018 conn(0x7f4d380fbe30 msgr2=0x7f4d380fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:52.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.407+0000 7f4d3f600700 1 -- 172.21.15.184:0/4199865018 shutdown_connections 2024-02-28T22:56:52.406 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:52.407+0000 7f4d3f600700 1 -- 172.21.15.184:0/4199865018 wait complete. 2024-02-28T22:56:52.407 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:56:53.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:53 smithi159 ceph-mon[28802]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:53.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:53 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/4199865018' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:56:54.110 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:56:54.110 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:56:54.485 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:54.593 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:55.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:55 smithi159 ceph-mon[28802]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:56:56.401 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.402+0000 7f55a3e00700 1 -- 172.21.15.184:0/83021338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a40fefb0 msgr2=0x7f55a40ff3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:56.401 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.402+0000 7f55a3e00700 1 --2- 172.21.15.184:0/83021338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a40fefb0 0x7f55a40ff3d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5594009910 tx=0x7f5594009c20 comp rx=0 tx=0).stop 2024-02-28T22:56:56.401 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.402+0000 7f55a3e00700 1 -- 172.21.15.184:0/83021338 shutdown_connections 2024-02-28T22:56:56.401 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.402+0000 7f55a3e00700 1 --2- 172.21.15.184:0/83021338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a40fefb0 0x7f55a40ff3d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:56.401 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.402+0000 7f55a3e00700 1 -- 172.21.15.184:0/83021338 >> 172.21.15.184:0/83021338 conn(0x7f55a40fab90 msgr2=0x7f55a40fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:56.402 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.403+0000 7f55a3e00700 1 -- 172.21.15.184:0/83021338 shutdown_connections 2024-02-28T22:56:56.402 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.403+0000 7f55a3e00700 1 -- 172.21.15.184:0/83021338 wait complete. 2024-02-28T22:56:56.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.404+0000 7f55a3e00700 1 Processor -- start 2024-02-28T22:56:56.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.404+0000 7f55a3e00700 1 -- start start 2024-02-28T22:56:56.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.404+0000 7f55a3e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a40fefb0 0x7f55a4197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:56.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.404+0000 7f55a3e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a4197ec0 con 0x7f55a40fefb0 2024-02-28T22:56:56.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.404+0000 7f55a2a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a40fefb0 0x7f55a4197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:56:56.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.404+0000 7f55a2a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a40fefb0 0x7f55a4197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:57846/0 (socket says 172.21.15.184:57846) 2024-02-28T22:56:56.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.404+0000 7f55a2a00700 1 -- 172.21.15.184:0/2871920321 learned_addr learned my addr 172.21.15.184:0/2871920321 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:56:56.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.405+0000 7f55a2a00700 1 -- 172.21.15.184:0/2871920321 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55940095f0 con 0x7f55a40fefb0 2024-02-28T22:56:56.403 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.405+0000 7f55a2a00700 1 --2- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a40fefb0 0x7f55a4197980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f55940092e0 tx=0x7f5594009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:56:56.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.405+0000 7f559b400700 1 -- 172.21.15.184:0/2871920321 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f559401d070 con 0x7f55a40fefb0 2024-02-28T22:56:56.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.405+0000 7f55a3e00700 1 -- 172.21.15.184:0/2871920321 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a41980c0 con 0x7f55a40fefb0 2024-02-28T22:56:56.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.405+0000 7f55a3e00700 1 -- 172.21.15.184:0/2871920321 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a4198560 con 0x7f55a40fefb0 2024-02-28T22:56:56.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.405+0000 7f559b400700 1 -- 172.21.15.184:0/2871920321 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f559400be10 con 0x7f55a40fefb0 2024-02-28T22:56:56.404 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.405+0000 7f559b400700 1 -- 172.21.15.184:0/2871920321 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f559400f460 con 0x7f55a40fefb0 2024-02-28T22:56:56.405 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.406+0000 7f55a3e00700 1 -- 172.21.15.184:0/2871920321 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a41914e0 con 0x7f55a40fefb0 2024-02-28T22:56:56.405 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.406+0000 7f559b400700 1 -- 172.21.15.184:0/2871920321 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 14) v1 ==== 45354+0+0 (secure 0 0 0) 0x7f5594022470 con 0x7f55a40fefb0 2024-02-28T22:56:56.405 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.407+0000 7f559b400700 1 --2- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f5588038460 0x7f558803a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:56:56.405 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.407+0000 7f559b400700 1 -- 172.21.15.184:0/2871920321 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f559404c410 con 0x7f55a40fefb0 2024-02-28T22:56:56.424 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.420+0000 7f55a2000700 1 -- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f5588038460 msgr2=0x7f558803a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk reading from fd=16 : -104 Unknown error -104 2024-02-28T22:56:56.425 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.420+0000 7f55a2000700 1 -- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f5588038460 msgr2=0x7f558803a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-28T22:56:56.425 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.420+0000 7f55a2000700 1 --2- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f5588038460 0x7f558803a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2024-02-28T22:56:56.425 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.420+0000 7f55a2000700 1 --2- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f5588038460 0x7f558803a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T22:56:56.425 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.424+0000 7f559b400700 1 -- 172.21.15.184:0/2871920321 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f559400b960 con 0x7f55a40fefb0 2024-02-28T22:56:56.619 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.621+0000 7f55a2000700 1 -- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f5588038460 msgr2=0x7f558803a920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2559284946 2024-02-28T22:56:56.619 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.621+0000 7f55a2000700 1 --2- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f5588038460 0x7f558803a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T22:56:56.679 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:56 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:56.679 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:56 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:56.679 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:56 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' 2024-02-28T22:56:56.679 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:56 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-02-28T22:56:56.729 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.731+0000 7f55a3e00700 1 -- 172.21.15.184:0/2871920321 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f55a402cc70 con 0x7f55a40fefb0 2024-02-28T22:56:56.730 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.732+0000 7f559b400700 1 -- 172.21.15.184:0/2871920321 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f5594027070 con 0x7f55a40fefb0 2024-02-28T22:56:56.730 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:56:56.730 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:56:56.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.734+0000 7f55a3e00700 1 -- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f5588038460 msgr2=0x7f558803a920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T22:56:56.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.734+0000 7f55a3e00700 1 --2- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f5588038460 0x7f558803a920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:56.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.734+0000 7f55a3e00700 1 -- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a40fefb0 msgr2=0x7f55a4197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:56:56.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.734+0000 7f55a3e00700 1 --2- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a40fefb0 0x7f55a4197980 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f55940092e0 tx=0x7f5594009e60 comp rx=0 tx=0).stop 2024-02-28T22:56:56.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.735+0000 7f55a3e00700 1 -- 172.21.15.184:0/2871920321 shutdown_connections 2024-02-28T22:56:56.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.735+0000 7f55a3e00700 1 --2- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f5588038460 0x7f558803a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:56.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.735+0000 7f55a3e00700 1 --2- 172.21.15.184:0/2871920321 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55a40fefb0 0x7f55a4197980 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:56:56.733 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.735+0000 7f55a3e00700 1 -- 172.21.15.184:0/2871920321 >> 172.21.15.184:0/2871920321 conn(0x7f55a40fab90 msgr2=0x7f55a40fb800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:56:56.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.735+0000 7f55a3e00700 1 -- 172.21.15.184:0/2871920321 shutdown_connections 2024-02-28T22:56:56.734 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:56:56.735+0000 7f55a3e00700 1 -- 172.21.15.184:0/2871920321 wait complete. 2024-02-28T22:56:56.734 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:56:57.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:57 smithi159 ceph-mon[28802]: from='mgr.14164 172.21.15.159:0/800035452' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-02-28T22:56:57.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:57 smithi159 ceph-mon[28802]: mgrmap e14: smithi159.pobewk(active, since 84s) 2024-02-28T22:56:57.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:56:57 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/2871920321' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:56:58.441 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:56:58.441 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:56:58.812 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:56:58.907 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:57:00.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.981+0000 7f140d800700 1 -- 172.21.15.184:0/3774567010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14081008b0 msgr2=0x7f1408100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:00.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.981+0000 7f140d800700 1 --2- 172.21.15.184:0/3774567010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14081008b0 0x7f1408100cd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f13f800b0a0 tx=0x7f13f800b3b0 comp rx=0 tx=0).stop 2024-02-28T22:57:00.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.981+0000 7f140d800700 1 -- 172.21.15.184:0/3774567010 shutdown_connections 2024-02-28T22:57:00.980 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.981+0000 7f140d800700 1 --2- 172.21.15.184:0/3774567010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14081008b0 0x7f1408100cd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:00.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.982+0000 7f140d800700 1 -- 172.21.15.184:0/3774567010 >> 172.21.15.184:0/3774567010 conn(0x7f14080fbe30 msgr2=0x7f14080fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:00.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.982+0000 7f140d800700 1 -- 172.21.15.184:0/3774567010 shutdown_connections 2024-02-28T22:57:00.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.982+0000 7f140d800700 1 -- 172.21.15.184:0/3774567010 wait complete. 2024-02-28T22:57:00.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.983+0000 7f140d800700 1 Processor -- start 2024-02-28T22:57:00.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.983+0000 7f140d800700 1 -- start start 2024-02-28T22:57:00.981 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.983+0000 7f140d800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14081008b0 0x7f1408197c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:00.982 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.983+0000 7f140d800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1408198150 con 0x7f14081008b0 2024-02-28T22:57:00.982 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.984+0000 7f1406a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14081008b0 0x7f1408197c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:00.982 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.984+0000 7f1406a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14081008b0 0x7f1408197c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:53764/0 (socket says 172.21.15.184:53764) 2024-02-28T22:57:00.982 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.984+0000 7f1406a00700 1 -- 172.21.15.184:0/1040181168 learned_addr learned my addr 172.21.15.184:0/1040181168 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:57:00.982 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.984+0000 7f1406a00700 1 -- 172.21.15.184:0/1040181168 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f8009d00 con 0x7f14081008b0 2024-02-28T22:57:00.983 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.985+0000 7f1406a00700 1 --2- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14081008b0 0x7f1408197c10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009fd0 tx=0x7f13f800bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:00.984 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.985+0000 7f13ff400700 1 -- 172.21.15.184:0/1040181168 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13f800e040 con 0x7f14081008b0 2024-02-28T22:57:00.984 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.985+0000 7f13ff400700 1 -- 172.21.15.184:0/1040181168 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f13f800bdc0 con 0x7f14081008b0 2024-02-28T22:57:00.984 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.985+0000 7f13ff400700 1 -- 172.21.15.184:0/1040181168 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f13f801da40 con 0x7f14081008b0 2024-02-28T22:57:00.984 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.985+0000 7f140d800700 1 -- 172.21.15.184:0/1040181168 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1408198350 con 0x7f14081008b0 2024-02-28T22:57:00.984 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.986+0000 7f140d800700 1 -- 172.21.15.184:0/1040181168 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1408198770 con 0x7f14081008b0 2024-02-28T22:57:00.984 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.987+0000 7f140d800700 1 -- 172.21.15.184:0/1040181168 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14081918d0 con 0x7f14081008b0 2024-02-28T22:57:00.985 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.987+0000 7f13ff400700 1 -- 172.21.15.184:0/1040181168 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 14) v1 ==== 45354+0+0 (secure 0 0 0) 0x7f13f801d480 con 0x7f14081008b0 2024-02-28T22:57:00.986 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.987+0000 7f13ff400700 1 --2- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f13ec0384b0 0x7f13ec03a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:00.986 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.988+0000 7f13ff400700 1 -- 172.21.15.184:0/1040181168 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f13f804c8a0 con 0x7f14081008b0 2024-02-28T22:57:00.986 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.988+0000 7f13ffe00700 1 -- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f13ec0384b0 msgr2=0x7f13ec03a970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2559284946 2024-02-28T22:57:00.986 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:00.988+0000 7f13ffe00700 1 --2- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f13ec0384b0 0x7f13ec03a970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T22:57:01.000 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.002+0000 7f13ff400700 1 -- 172.21.15.184:0/1040181168 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f13f801c9b0 con 0x7f14081008b0 2024-02-28T22:57:01.187 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.189+0000 7f13ffe00700 1 -- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f13ec0384b0 msgr2=0x7f13ec03a970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.159:6800/2559284946 2024-02-28T22:57:01.187 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.189+0000 7f13ffe00700 1 --2- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f13ec0384b0 0x7f13ec03a970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-02-28T22:57:01.297 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.299+0000 7f140d800700 1 -- 172.21.15.184:0/1040181168 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f140802cc70 con 0x7f14081008b0 2024-02-28T22:57:01.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.300+0000 7f13ff400700 1 -- 172.21.15.184:0/1040181168 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f13f801c3e0 con 0x7f14081008b0 2024-02-28T22:57:01.299 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:57:01.299 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:57:01.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.303+0000 7f140d800700 1 -- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f13ec0384b0 msgr2=0x7f13ec03a970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T22:57:01.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.303+0000 7f140d800700 1 --2- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f13ec0384b0 0x7f13ec03a970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:01.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.303+0000 7f140d800700 1 -- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14081008b0 msgr2=0x7f1408197c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:01.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.303+0000 7f140d800700 1 --2- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14081008b0 0x7f1408197c10 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f13f8009fd0 tx=0x7f13f800bb10 comp rx=0 tx=0).stop 2024-02-28T22:57:01.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.303+0000 7f140d800700 1 -- 172.21.15.184:0/1040181168 shutdown_connections 2024-02-28T22:57:01.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.303+0000 7f140d800700 1 --2- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:6800/2559284946,v1:172.21.15.159:6801/2559284946] conn(0x7f13ec0384b0 0x7f13ec03a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:01.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.303+0000 7f140d800700 1 --2- 172.21.15.184:0/1040181168 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14081008b0 0x7f1408197c10 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:01.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.303+0000 7f140d800700 1 -- 172.21.15.184:0/1040181168 >> 172.21.15.184:0/1040181168 conn(0x7f14080fbe30 msgr2=0x7f14080fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:01.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.304+0000 7f140d800700 1 -- 172.21.15.184:0/1040181168 shutdown_connections 2024-02-28T22:57:01.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:01.304+0000 7f140d800700 1 -- 172.21.15.184:0/1040181168 wait complete. 2024-02-28T22:57:01.303 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:57:01.429 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:01 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/1040181168' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:57:03.051 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:57:03.052 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:57:03.414 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:57:03.519 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:57:05.187 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:04 smithi159 ceph-mon[28802]: Active manager daemon smithi159.pobewk restarted 2024-02-28T22:57:05.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:04 smithi159 ceph-mon[28802]: Activating manager daemon smithi159.pobewk 2024-02-28T22:57:05.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:04 smithi159 ceph-mon[28802]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T22:57:05.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:04 smithi159 ceph-mon[28802]: mgrmap e15: smithi159.pobewk(active, starting, since 0.00950018s) 2024-02-28T22:57:05.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:04 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T22:57:05.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:04 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi159.pobewk", "id": "smithi159.pobewk"}]: dispatch 2024-02-28T22:57:05.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:04 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T22:57:05.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:04 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T22:57:05.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:04 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T22:57:05.188 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:04 smithi159 ceph-mon[28802]: Manager daemon smithi159.pobewk is now available 2024-02-28T22:57:05.432 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.433+0000 7fe0ba400700 1 -- 172.21.15.184:0/3481706583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b40ff7a0 msgr2=0x7fe0b40ffbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:05.432 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.433+0000 7fe0ba400700 1 --2- 172.21.15.184:0/3481706583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b40ff7a0 0x7fe0b40ffbc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4009910 tx=0x7fe0a4009c20 comp rx=0 tx=0).stop 2024-02-28T22:57:05.432 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.433+0000 7fe0ba400700 1 -- 172.21.15.184:0/3481706583 shutdown_connections 2024-02-28T22:57:05.432 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.433+0000 7fe0ba400700 1 --2- 172.21.15.184:0/3481706583 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b40ff7a0 0x7fe0b40ffbc0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:05.432 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.433+0000 7fe0ba400700 1 -- 172.21.15.184:0/3481706583 >> 172.21.15.184:0/3481706583 conn(0x7fe0b40fad20 msgr2=0x7fe0b40fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:05.432 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.433+0000 7fe0ba400700 1 -- 172.21.15.184:0/3481706583 shutdown_connections 2024-02-28T22:57:05.432 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.433+0000 7fe0ba400700 1 -- 172.21.15.184:0/3481706583 wait complete. 2024-02-28T22:57:05.433 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.434+0000 7fe0ba400700 1 Processor -- start 2024-02-28T22:57:05.433 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.435+0000 7fe0ba400700 1 -- start start 2024-02-28T22:57:05.433 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.435+0000 7fe0ba400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b40ff7a0 0x7fe0b4197be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:05.433 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.435+0000 7fe0ba400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b4198120 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.433 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.435+0000 7fe0b3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b40ff7a0 0x7fe0b4197be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:05.433 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.435+0000 7fe0b3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b40ff7a0 0x7fe0b4197be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:53788/0 (socket says 172.21.15.184:53788) 2024-02-28T22:57:05.433 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.435+0000 7fe0b3400700 1 -- 172.21.15.184:0/267629418 learned_addr learned my addr 172.21.15.184:0/267629418 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:57:05.434 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.436+0000 7fe0b3400700 1 -- 172.21.15.184:0/267629418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a40095f0 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.434 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.436+0000 7fe0b3400700 1 --2- 172.21.15.184:0/267629418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b40ff7a0 0x7fe0b4197be0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4005950 tx=0x7fe0a4009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:05.434 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.436+0000 7fe0abe00700 1 -- 172.21.15.184:0/267629418 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0a401d070 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.436+0000 7fe0abe00700 1 -- 172.21.15.184:0/267629418 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe0a400be10 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.436+0000 7fe0ba400700 1 -- 172.21.15.184:0/267629418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b4198320 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.436+0000 7fe0abe00700 1 -- 172.21.15.184:0/267629418 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0a400f460 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.436+0000 7fe0ba400700 1 -- 172.21.15.184:0/267629418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b41987c0 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.437+0000 7fe0abe00700 1 -- 172.21.15.184:0/267629418 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 15) v1 ==== 45077+0+0 (secure 0 0 0) 0x7fe0a400f5c0 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.435 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.437+0000 7fe0ba400700 1 -- 172.21.15.184:0/267629418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b41055e0 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.436 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.438+0000 7fe0abe00700 1 -- 172.21.15.184:0/267629418 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fe0a404c380 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.442 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.444+0000 7fe0abe00700 1 -- 172.21.15.184:0/267629418 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe0a402a360 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.742+0000 7fe0ba400700 1 -- 172.21.15.184:0/267629418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe0b41057d0 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.740 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.742+0000 7fe0abe00700 1 -- 172.21.15.184:0/267629418 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fe0a4027020 con 0x7fe0b40ff7a0 2024-02-28T22:57:05.741 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:57:05.741 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:57:05.743 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.745+0000 7fe0ba400700 1 -- 172.21.15.184:0/267629418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b40ff7a0 msgr2=0x7fe0b4197be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:05.743 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.745+0000 7fe0ba400700 1 --2- 172.21.15.184:0/267629418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b40ff7a0 0x7fe0b4197be0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe0a4005950 tx=0x7fe0a4009e60 comp rx=0 tx=0).stop 2024-02-28T22:57:05.744 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.745+0000 7fe0ba400700 1 -- 172.21.15.184:0/267629418 shutdown_connections 2024-02-28T22:57:05.744 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.745+0000 7fe0ba400700 1 --2- 172.21.15.184:0/267629418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0b40ff7a0 0x7fe0b4197be0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:05.744 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.745+0000 7fe0ba400700 1 -- 172.21.15.184:0/267629418 >> 172.21.15.184:0/267629418 conn(0x7fe0b40fad20 msgr2=0x7fe0b40fba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:05.744 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.745+0000 7fe0ba400700 1 -- 172.21.15.184:0/267629418 shutdown_connections 2024-02-28T22:57:05.744 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:05.746+0000 7fe0ba400700 1 -- 172.21.15.184:0/267629418 wait complete. 2024-02-28T22:57:05.745 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:57:06.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:57:06.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:57:06.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:06.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:57:06.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/mirror_snapshot_schedule"}]: dispatch 2024-02-28T22:57:06.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/trash_purge_schedule"}]: dispatch 2024-02-28T22:57:06.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:05 smithi159 ceph-mon[28802]: [28/Feb/2024:22:57:05] ENGINE Bus STARTING 2024-02-28T22:57:06.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:05 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/267629418' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:57:06.311 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:05 smithi159 ceph-mon[28802]: mgrmap e16: smithi159.pobewk(active, since 1.01285s) 2024-02-28T22:57:07.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:06 smithi159 ceph-mon[28802]: [28/Feb/2024:22:57:05] ENGINE Serving on http://172.21.15.159:8765 2024-02-28T22:57:07.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:06 smithi159 ceph-mon[28802]: [28/Feb/2024:22:57:05] ENGINE Serving on https://172.21.15.159:7150 2024-02-28T22:57:07.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:06 smithi159 ceph-mon[28802]: [28/Feb/2024:22:57:05] ENGINE Bus STARTED 2024-02-28T22:57:07.318 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:06 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:07.404 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:57:07.405 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:57:07.756 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:57:07.854 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:57:08.648 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:08 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:08.648 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:08 smithi159 ceph-mon[28802]: mgrmap e17: smithi159.pobewk(active, since 2s) 2024-02-28T22:57:09.661 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.663+0000 7f1391000700 1 -- 172.21.15.184:0/1658276332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f138c101330 msgr2=0x7f138c103720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:09.662 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.663+0000 7f1391000700 1 --2- 172.21.15.184:0/1658276332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f138c101330 0x7f138c103720 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f137c009910 tx=0x7f137c009c20 comp rx=0 tx=0).stop 2024-02-28T22:57:09.662 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.663+0000 7f1391000700 1 -- 172.21.15.184:0/1658276332 shutdown_connections 2024-02-28T22:57:09.662 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.663+0000 7f1391000700 1 --2- 172.21.15.184:0/1658276332 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f138c101330 0x7f138c103720 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:09.662 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.663+0000 7f1391000700 1 -- 172.21.15.184:0/1658276332 >> 172.21.15.184:0/1658276332 conn(0x7f138c0fad20 msgr2=0x7f138c0fd180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:09.662 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.663+0000 7f1391000700 1 -- 172.21.15.184:0/1658276332 shutdown_connections 2024-02-28T22:57:09.662 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.663+0000 7f1391000700 1 -- 172.21.15.184:0/1658276332 wait complete. 2024-02-28T22:57:09.662 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.664+0000 7f1391000700 1 Processor -- start 2024-02-28T22:57:09.663 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.665+0000 7f1391000700 1 -- start start 2024-02-28T22:57:09.663 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.665+0000 7f1391000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f138c101330 0x7f138c193770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:09.663 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.665+0000 7f1391000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138c193cb0 con 0x7f138c101330 2024-02-28T22:57:09.663 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.665+0000 7f1389e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f138c101330 0x7f138c193770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:09.664 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.665+0000 7f1389e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f138c101330 0x7f138c193770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:56212/0 (socket says 172.21.15.184:56212) 2024-02-28T22:57:09.664 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.665+0000 7f1389e00700 1 -- 172.21.15.184:0/1182798311 learned_addr learned my addr 172.21.15.184:0/1182798311 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:57:09.664 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.666+0000 7f1389e00700 1 -- 172.21.15.184:0/1182798311 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f137c0095f0 con 0x7f138c101330 2024-02-28T22:57:09.664 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.666+0000 7f1389e00700 1 --2- 172.21.15.184:0/1182798311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f138c101330 0x7f138c193770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f137c005b40 tx=0x7f137c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:09.665 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.666+0000 7f1382a00700 1 -- 172.21.15.184:0/1182798311 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f137c01d070 con 0x7f138c101330 2024-02-28T22:57:09.665 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.666+0000 7f1382a00700 1 -- 172.21.15.184:0/1182798311 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f137c00be10 con 0x7f138c101330 2024-02-28T22:57:09.665 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.666+0000 7f1391000700 1 -- 172.21.15.184:0/1182798311 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138c193eb0 con 0x7f138c101330 2024-02-28T22:57:09.665 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.666+0000 7f1382a00700 1 -- 172.21.15.184:0/1182798311 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f137c00f460 con 0x7f138c101330 2024-02-28T22:57:09.665 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.667+0000 7f1391000700 1 -- 172.21.15.184:0/1182798311 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138c194350 con 0x7f138c101330 2024-02-28T22:57:09.665 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.668+0000 7f1382a00700 1 -- 172.21.15.184:0/1182798311 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7f137c00f5c0 con 0x7f138c101330 2024-02-28T22:57:09.666 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.668+0000 7f1391000700 1 -- 172.21.15.184:0/1182798311 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f138c18d2c0 con 0x7f138c101330 2024-02-28T22:57:09.666 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.668+0000 7f1382a00700 1 --2- 172.21.15.184:0/1182798311 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f137003c960 0x7f137003ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:09.666 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.668+0000 7f1382a00700 1 -- 172.21.15.184:0/1182798311 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f137c04c610 con 0x7f138c101330 2024-02-28T22:57:09.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.669+0000 7f1389400700 1 --2- 172.21.15.184:0/1182798311 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f137003c960 0x7f137003ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:09.667 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.669+0000 7f1389400700 1 --2- 172.21.15.184:0/1182798311 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f137003c960 0x7f137003ee20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1378006fd0 tx=0x7f1378006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:09.673 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.675+0000 7f1382a00700 1 -- 172.21.15.184:0/1182798311 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f137c020550 con 0x7f138c101330 2024-02-28T22:57:09.982 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.984+0000 7f1391000700 1 -- 172.21.15.184:0/1182798311 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f138c02cc70 con 0x7f138c101330 2024-02-28T22:57:09.983 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.985+0000 7f1382a00700 1 -- 172.21.15.184:0/1182798311 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f137c027030 con 0x7f138c101330 2024-02-28T22:57:09.984 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:57:09.984 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:57:09.986 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.988+0000 7f1391000700 1 -- 172.21.15.184:0/1182798311 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f137003c960 msgr2=0x7f137003ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:09.986 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.988+0000 7f1391000700 1 --2- 172.21.15.184:0/1182798311 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f137003c960 0x7f137003ee20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1378006fd0 tx=0x7f1378006e40 comp rx=0 tx=0).stop 2024-02-28T22:57:09.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.988+0000 7f1391000700 1 -- 172.21.15.184:0/1182798311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f138c101330 msgr2=0x7f138c193770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:09.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.988+0000 7f1391000700 1 --2- 172.21.15.184:0/1182798311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f138c101330 0x7f138c193770 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f137c005b40 tx=0x7f137c004740 comp rx=0 tx=0).stop 2024-02-28T22:57:09.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.988+0000 7f1391000700 1 -- 172.21.15.184:0/1182798311 shutdown_connections 2024-02-28T22:57:09.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.988+0000 7f1391000700 1 --2- 172.21.15.184:0/1182798311 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f137003c960 0x7f137003ee20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:09.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.988+0000 7f1391000700 1 --2- 172.21.15.184:0/1182798311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f138c101330 0x7f138c193770 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:09.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.988+0000 7f1391000700 1 -- 172.21.15.184:0/1182798311 >> 172.21.15.184:0/1182798311 conn(0x7f138c0fad20 msgr2=0x7f138c0fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:09.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.988+0000 7f1391000700 1 -- 172.21.15.184:0/1182798311 shutdown_connections 2024-02-28T22:57:09.987 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:09.988+0000 7f1391000700 1 -- 172.21.15.184:0/1182798311 wait complete. 2024-02-28T22:57:09.987 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:57:10.409 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:10 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:10.409 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:10 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/1182798311' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:57:12.024 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:57:12.024 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:57:12.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:11 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:12.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:11 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:12.395 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:57:12.499 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /etc/ceph/ceph.conf 2024-02-28T22:57:13.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:13 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:13.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:13 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:13.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:13 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd/host:smithi159", "name": "osd_memory_target"}]: dispatch 2024-02-28T22:57:14.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.971+0000 7f66af200700 1 -- 172.21.15.184:0/3637257860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a81008b0 msgr2=0x7f66a8100cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:14.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.971+0000 7f66af200700 1 --2- 172.21.15.184:0/3637257860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a81008b0 0x7f66a8100cd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6698009910 tx=0x7f6698009c20 comp rx=0 tx=0).stop 2024-02-28T22:57:14.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.971+0000 7f66af200700 1 -- 172.21.15.184:0/3637257860 shutdown_connections 2024-02-28T22:57:14.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.971+0000 7f66af200700 1 --2- 172.21.15.184:0/3637257860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a81008b0 0x7f66a8100cd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:14.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.971+0000 7f66af200700 1 -- 172.21.15.184:0/3637257860 >> 172.21.15.184:0/3637257860 conn(0x7f66a80fbe30 msgr2=0x7f66a80fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:14.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.971+0000 7f66af200700 1 -- 172.21.15.184:0/3637257860 shutdown_connections 2024-02-28T22:57:14.970 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.972+0000 7f66af200700 1 -- 172.21.15.184:0/3637257860 wait complete. 2024-02-28T22:57:14.971 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.972+0000 7f66af200700 1 Processor -- start 2024-02-28T22:57:14.971 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.973+0000 7f66af200700 1 -- start start 2024-02-28T22:57:14.971 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.973+0000 7f66af200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a81008b0 0x7f66a81959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:14.971 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.973+0000 7f66af200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a8195f20 con 0x7f66a81008b0 2024-02-28T22:57:14.972 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.973+0000 7f66a7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a81008b0 0x7f66a81959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:14.972 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.973+0000 7f66a7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a81008b0 0x7f66a81959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:56236/0 (socket says 172.21.15.184:56236) 2024-02-28T22:57:14.972 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.973+0000 7f66a7e00700 1 -- 172.21.15.184:0/1884711604 learned_addr learned my addr 172.21.15.184:0/1884711604 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:57:14.972 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.974+0000 7f66a7e00700 1 -- 172.21.15.184:0/1884711604 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66980095f0 con 0x7f66a81008b0 2024-02-28T22:57:14.972 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.974+0000 7f66a7e00700 1 --2- 172.21.15.184:0/1884711604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a81008b0 0x7f66a81959e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6698005b40 tx=0x7f6698004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:14.972 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.974+0000 7f66a4c00700 1 -- 172.21.15.184:0/1884711604 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f669801d070 con 0x7f66a81008b0 2024-02-28T22:57:14.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.975+0000 7f66af200700 1 -- 172.21.15.184:0/1884711604 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66a8196120 con 0x7f66a81008b0 2024-02-28T22:57:14.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.975+0000 7f66af200700 1 -- 172.21.15.184:0/1884711604 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66a81965c0 con 0x7f66a81008b0 2024-02-28T22:57:14.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.975+0000 7f66a4c00700 1 -- 172.21.15.184:0/1884711604 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f669800be10 con 0x7f66a81008b0 2024-02-28T22:57:14.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.975+0000 7f66a4c00700 1 -- 172.21.15.184:0/1884711604 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6698022da0 con 0x7f66a81008b0 2024-02-28T22:57:14.974 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.976+0000 7f66af200700 1 -- 172.21.15.184:0/1884711604 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66a818f4d0 con 0x7f66a81008b0 2024-02-28T22:57:14.974 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.976+0000 7f66a4c00700 1 -- 172.21.15.184:0/1884711604 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7f66980227c0 con 0x7f66a81008b0 2024-02-28T22:57:14.975 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.977+0000 7f66a4c00700 1 --2- 172.21.15.184:0/1884711604 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f668c0384b0 0x7f668c03a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:14.975 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.977+0000 7f66a4c00700 1 -- 172.21.15.184:0/1884711604 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f669804c470 con 0x7f66a81008b0 2024-02-28T22:57:14.975 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.977+0000 7f66a7400700 1 --2- 172.21.15.184:0/1884711604 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f668c0384b0 0x7f668c03a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:14.976 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:14.978+0000 7f66a7400700 1 --2- 172.21.15.184:0/1884711604 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f668c0384b0 0x7f668c03a970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6694006fd0 tx=0x7f6694006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:14.999 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.001+0000 7f66a4c00700 1 -- 172.21.15.184:0/1884711604 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f669800f460 con 0x7f66a81008b0 2024-02-28T22:57:15.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.299+0000 7f66af200700 1 -- 172.21.15.184:0/1884711604 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f66a802cc70 con 0x7f66a81008b0 2024-02-28T22:57:15.298 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.300+0000 7f66a4c00700 1 -- 172.21.15.184:0/1884711604 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f6698027070 con 0x7f66a81008b0 2024-02-28T22:57:15.299 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:57:15.299 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:57:15.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.304+0000 7f66af200700 1 -- 172.21.15.184:0/1884711604 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f668c0384b0 msgr2=0x7f668c03a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:15.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.304+0000 7f66af200700 1 --2- 172.21.15.184:0/1884711604 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f668c0384b0 0x7f668c03a970 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6694006fd0 tx=0x7f6694006e40 comp rx=0 tx=0).stop 2024-02-28T22:57:15.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.304+0000 7f66af200700 1 -- 172.21.15.184:0/1884711604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a81008b0 msgr2=0x7f66a81959e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:15.302 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.304+0000 7f66af200700 1 --2- 172.21.15.184:0/1884711604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a81008b0 0x7f66a81959e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6698005b40 tx=0x7f6698004740 comp rx=0 tx=0).stop 2024-02-28T22:57:15.303 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.304+0000 7f66af200700 1 -- 172.21.15.184:0/1884711604 shutdown_connections 2024-02-28T22:57:15.303 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.304+0000 7f66af200700 1 --2- 172.21.15.184:0/1884711604 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f668c0384b0 0x7f668c03a970 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:15.303 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.304+0000 7f66af200700 1 --2- 172.21.15.184:0/1884711604 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66a81008b0 0x7f66a81959e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:15.303 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.304+0000 7f66af200700 1 -- 172.21.15.184:0/1884711604 >> 172.21.15.184:0/1884711604 conn(0x7f66a80fbe30 msgr2=0x7f66a80fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:15.303 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.304+0000 7f66af200700 1 -- 172.21.15.184:0/1884711604 shutdown_connections 2024-02-28T22:57:15.303 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:15.304+0000 7f66af200700 1 -- 172.21.15.184:0/1884711604 wait complete. 2024-02-28T22:57:15.304 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:57:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:15 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:15 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:15 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:15 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:15 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd/host:smithi184", "name": "osd_memory_target"}]: dispatch 2024-02-28T22:57:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:15 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:15 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T22:57:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:15 smithi159 ceph-mon[28802]: Updating smithi159:/etc/ceph/ceph.conf 2024-02-28T22:57:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:15 smithi159 ceph-mon[28802]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-28T22:57:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:15 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/1884711604' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:57:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:16 smithi159 ceph-mon[28802]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T22:57:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:16 smithi159 ceph-mon[28802]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T22:57:17.129 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:57:17.129 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:57:17.492 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T22:57:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:17 smithi159 ceph-mon[28802]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-02-28T22:57:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:17 smithi159 ceph-mon[28802]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-02-28T22:57:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:17 smithi159 ceph-mon[28802]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T22:57:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:17 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:17 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:18 smithi159 ceph-mon[28802]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T22:57:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:18.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T22:57:18.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T22:57:18.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:19.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:19 smithi159 ceph-mon[28802]: Deploying daemon ceph-exporter.smithi184 on smithi184 2024-02-28T22:57:20.335 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.335+0000 7fa01de00700 1 -- 172.21.15.184:0/2848444187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018106830 msgr2=0x7fa018106c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:20.335 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.335+0000 7fa01de00700 1 --2- 172.21.15.184:0/2848444187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018106830 0x7fa018106c10 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fa008009910 tx=0x7fa008009c20 comp rx=0 tx=0).stop 2024-02-28T22:57:20.335 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.335+0000 7fa01de00700 1 -- 172.21.15.184:0/2848444187 shutdown_connections 2024-02-28T22:57:20.335 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.335+0000 7fa01de00700 1 --2- 172.21.15.184:0/2848444187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018106830 0x7fa018106c10 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:20.335 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.335+0000 7fa01de00700 1 -- 172.21.15.184:0/2848444187 >> 172.21.15.184:0/2848444187 conn(0x7fa0180fc380 msgr2=0x7fa0180fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:20.335 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.335+0000 7fa01de00700 1 -- 172.21.15.184:0/2848444187 shutdown_connections 2024-02-28T22:57:20.335 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.335+0000 7fa01de00700 1 -- 172.21.15.184:0/2848444187 wait complete. 2024-02-28T22:57:20.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.336+0000 7fa01de00700 1 Processor -- start 2024-02-28T22:57:20.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.336+0000 7fa01de00700 1 -- start start 2024-02-28T22:57:20.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.337+0000 7fa01de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018106830 0x7fa018197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:20.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.337+0000 7fa01de00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018198460 con 0x7fa018106830 2024-02-28T22:57:20.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.337+0000 7fa016a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018106830 0x7fa018197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:20.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.337+0000 7fa016a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018106830 0x7fa018197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:60614/0 (socket says 172.21.15.184:60614) 2024-02-28T22:57:20.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.337+0000 7fa016a00700 1 -- 172.21.15.184:0/775340237 learned_addr learned my addr 172.21.15.184:0/775340237 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:57:20.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.338+0000 7fa016a00700 1 -- 172.21.15.184:0/775340237 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0080095f0 con 0x7fa018106830 2024-02-28T22:57:20.337 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.338+0000 7fa016a00700 1 --2- 172.21.15.184:0/775340237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018106830 0x7fa018197f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa008005b40 tx=0x7fa008004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:20.338 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.339+0000 7fa01ca00700 1 -- 172.21.15.184:0/775340237 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa00801d070 con 0x7fa018106830 2024-02-28T22:57:20.338 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.339+0000 7fa01de00700 1 -- 172.21.15.184:0/775340237 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa018198660 con 0x7fa018106830 2024-02-28T22:57:20.338 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.339+0000 7fa01ca00700 1 -- 172.21.15.184:0/775340237 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa0080044d0 con 0x7fa018106830 2024-02-28T22:57:20.338 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.339+0000 7fa01ca00700 1 -- 172.21.15.184:0/775340237 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa008003910 con 0x7fa018106830 2024-02-28T22:57:20.338 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.339+0000 7fa01de00700 1 -- 172.21.15.184:0/775340237 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa018198ae0 con 0x7fa018106830 2024-02-28T22:57:20.339 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.340+0000 7fa01de00700 1 -- 172.21.15.184:0/775340237 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0180623c0 con 0x7fa018106830 2024-02-28T22:57:20.340 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.341+0000 7fa01ca00700 1 -- 172.21.15.184:0/775340237 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7fa00800b960 con 0x7fa018106830 2024-02-28T22:57:20.340 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.341+0000 7fa01ca00700 1 --2- 172.21.15.184:0/775340237 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9ffc038500 0x7f9ffc03a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:20.340 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.342+0000 7fa01ca00700 1 -- 172.21.15.184:0/775340237 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa00804c470 con 0x7fa018106830 2024-02-28T22:57:20.341 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.342+0000 7fa016000700 1 --2- 172.21.15.184:0/775340237 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9ffc038500 0x7f9ffc03a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:20.342 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.343+0000 7fa016000700 1 --2- 172.21.15.184:0/775340237 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9ffc038500 0x7f9ffc03a9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa004006fd0 tx=0x7fa004006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:20.356 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.357+0000 7fa01ca00700 1 -- 172.21.15.184:0/775340237 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa00802a540 con 0x7fa018106830 2024-02-28T22:57:20.679 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.679+0000 7fa01de00700 1 -- 172.21.15.184:0/775340237 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa01819cad0 con 0x7fa018106830 2024-02-28T22:57:20.679 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.680+0000 7fa01ca00700 1 -- 172.21.15.184:0/775340237 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fa00802a360 con 0x7fa018106830 2024-02-28T22:57:20.679 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:57:20.680 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:57:20.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.683+0000 7fa01de00700 1 -- 172.21.15.184:0/775340237 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9ffc038500 msgr2=0x7f9ffc03a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:20.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.683+0000 7fa01de00700 1 --2- 172.21.15.184:0/775340237 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9ffc038500 0x7f9ffc03a9c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa004006fd0 tx=0x7fa004006e40 comp rx=0 tx=0).stop 2024-02-28T22:57:20.682 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.683+0000 7fa01de00700 1 -- 172.21.15.184:0/775340237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018106830 msgr2=0x7fa018197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:20.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.683+0000 7fa01de00700 1 --2- 172.21.15.184:0/775340237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018106830 0x7fa018197f20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fa008005b40 tx=0x7fa008004c80 comp rx=0 tx=0).stop 2024-02-28T22:57:20.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.683+0000 7fa01de00700 1 -- 172.21.15.184:0/775340237 shutdown_connections 2024-02-28T22:57:20.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.683+0000 7fa01de00700 1 --2- 172.21.15.184:0/775340237 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9ffc038500 0x7f9ffc03a9c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:20.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.683+0000 7fa01de00700 1 --2- 172.21.15.184:0/775340237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa018106830 0x7fa018197f20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:20.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.683+0000 7fa01de00700 1 -- 172.21.15.184:0/775340237 >> 172.21.15.184:0/775340237 conn(0x7fa0180fc380 msgr2=0x7fa018108bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:20.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.683+0000 7fa01de00700 1 -- 172.21.15.184:0/775340237 shutdown_connections 2024-02-28T22:57:20.683 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:20.683+0000 7fa01de00700 1 -- 172.21.15.184:0/775340237 wait complete. 2024-02-28T22:57:20.683 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:57:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:57:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:21 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/775340237' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:57:22.439 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:57:22.440 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:57:22.825 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T22:57:23.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:23.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:23.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:23.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:23.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T22:57:23.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-02-28T22:57:23.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:23.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:23 smithi159 ceph-mon[28802]: Deploying daemon crash.smithi184 on smithi184 2024-02-28T22:57:25.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.845+0000 7f0082000700 1 -- 172.21.15.184:0/3712454681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0731c0 msgr2=0x7f007c0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:25.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.845+0000 7f0082000700 1 --2- 172.21.15.184:0/3712454681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0731c0 0x7f007c0735a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f006c00b0a0 tx=0x7f006c00b3b0 comp rx=0 tx=0).stop 2024-02-28T22:57:25.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.846+0000 7f0082000700 1 -- 172.21.15.184:0/3712454681 shutdown_connections 2024-02-28T22:57:25.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.846+0000 7f0082000700 1 --2- 172.21.15.184:0/3712454681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0731c0 0x7f007c0735a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:25.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.846+0000 7f0082000700 1 -- 172.21.15.184:0/3712454681 >> 172.21.15.184:0/3712454681 conn(0x7f007c0fc380 msgr2=0x7f007c0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:25.579 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.846+0000 7f0082000700 1 -- 172.21.15.184:0/3712454681 shutdown_connections 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.846+0000 7f0082000700 1 -- 172.21.15.184:0/3712454681 wait complete. 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.847+0000 7f0082000700 1 Processor -- start 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.847+0000 7f0082000700 1 -- start start 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.847+0000 7f0082000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0731c0 0x7f007c197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.847+0000 7f0082000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c198510 con 0x7f007c0731c0 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.848+0000 7f007b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0731c0 0x7f007c197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.848+0000 7f007b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0731c0 0x7f007c197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:60638/0 (socket says 172.21.15.184:60638) 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.848+0000 7f007b400700 1 -- 172.21.15.184:0/701414816 learned_addr learned my addr 172.21.15.184:0/701414816 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.849+0000 7f007b400700 1 -- 172.21.15.184:0/701414816 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009d00 con 0x7f007c0731c0 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.849+0000 7f007b400700 1 --2- 172.21.15.184:0/701414816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0731c0 0x7f007c197fd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f006c009fd0 tx=0x7f006c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.850+0000 7f0078c00700 1 -- 172.21.15.184:0/701414816 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f006c00e040 con 0x7f007c0731c0 2024-02-28T22:57:25.580 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.850+0000 7f0082000700 1 -- 172.21.15.184:0/701414816 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c198710 con 0x7f007c0731c0 2024-02-28T22:57:25.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.850+0000 7f0078c00700 1 -- 172.21.15.184:0/701414816 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f006c004040 con 0x7f007c0731c0 2024-02-28T22:57:25.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.850+0000 7f0078c00700 1 -- 172.21.15.184:0/701414816 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f006c01d440 con 0x7f007c0731c0 2024-02-28T22:57:25.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.850+0000 7f0082000700 1 -- 172.21.15.184:0/701414816 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c198b90 con 0x7f007c0731c0 2024-02-28T22:57:25.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.851+0000 7f0082000700 1 -- 172.21.15.184:0/701414816 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c0623c0 con 0x7f007c0731c0 2024-02-28T22:57:25.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.851+0000 7f0078c00700 1 -- 172.21.15.184:0/701414816 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7f006c0045b0 con 0x7f007c0731c0 2024-02-28T22:57:25.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.852+0000 7f0078c00700 1 --2- 172.21.15.184:0/701414816 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0060038500 0x7f006003a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:25.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.852+0000 7f0078c00700 1 -- 172.21.15.184:0/701414816 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f006c04c0c0 con 0x7f007c0731c0 2024-02-28T22:57:25.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.852+0000 7f0072a00700 1 --2- 172.21.15.184:0/701414816 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0060038500 0x7f006003a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:25.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.853+0000 7f0072a00700 1 --2- 172.21.15.184:0/701414816 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0060038500 0x7f006003a9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0064006fd0 tx=0x7f0064006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:25.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:24.866+0000 7f0078c00700 1 -- 172.21.15.184:0/701414816 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f006c01cdb0 con 0x7f007c0731c0 2024-02-28T22:57:25.581 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.172+0000 7f0082000700 1 -- 172.21.15.184:0/701414816 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f007c109d90 con 0x7f007c0731c0 2024-02-28T22:57:25.582 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:57:25.582 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:57:25.582 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.173+0000 7f0078c00700 1 -- 172.21.15.184:0/701414816 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f006c01cbd0 con 0x7f007c0731c0 2024-02-28T22:57:25.582 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.176+0000 7f0082000700 1 -- 172.21.15.184:0/701414816 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0060038500 msgr2=0x7f006003a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:25.582 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.176+0000 7f0082000700 1 --2- 172.21.15.184:0/701414816 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0060038500 0x7f006003a9c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0064006fd0 tx=0x7f0064006e40 comp rx=0 tx=0).stop 2024-02-28T22:57:25.582 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.176+0000 7f0082000700 1 -- 172.21.15.184:0/701414816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0731c0 msgr2=0x7f007c197fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:25.582 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.176+0000 7f0082000700 1 --2- 172.21.15.184:0/701414816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0731c0 0x7f007c197fd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f006c009fd0 tx=0x7f006c009800 comp rx=0 tx=0).stop 2024-02-28T22:57:25.582 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.177+0000 7f0082000700 1 -- 172.21.15.184:0/701414816 shutdown_connections 2024-02-28T22:57:25.583 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.177+0000 7f0082000700 1 --2- 172.21.15.184:0/701414816 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0060038500 0x7f006003a9c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:25.583 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.177+0000 7f0082000700 1 --2- 172.21.15.184:0/701414816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c0731c0 0x7f007c197fd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:25.583 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.177+0000 7f0082000700 1 -- 172.21.15.184:0/701414816 >> 172.21.15.184:0/701414816 conn(0x7f007c0fc380 msgr2=0x7f007c107370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:25.583 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.177+0000 7f0082000700 1 -- 172.21.15.184:0/701414816 shutdown_connections 2024-02-28T22:57:25.583 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:25.177+0000 7f0082000700 1 -- 172.21.15.184:0/701414816 wait complete. 2024-02-28T22:57:25.583 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:57:26.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:26 smithi159 ceph-mon[28802]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:26.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:26 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:26.300 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:26 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/701414816' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:57:27.395 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:57:27.395 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:57:27.760 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T22:57:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:28 smithi159 ceph-mon[28802]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:28.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:28 smithi159 ceph-mon[28802]: Deploying daemon node-exporter.smithi184 on smithi184 2024-02-28T22:57:29.668 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.667+0000 7f4bc2400700 1 -- 172.21.15.184:0/1268465754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc105710 msgr2=0x7f4bbc105af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:29.668 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.667+0000 7f4bc2400700 1 --2- 172.21.15.184:0/1268465754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc105710 0x7f4bbc105af0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4bac009910 tx=0x7f4bac009c20 comp rx=0 tx=0).stop 2024-02-28T22:57:29.668 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.667+0000 7f4bc2400700 1 -- 172.21.15.184:0/1268465754 shutdown_connections 2024-02-28T22:57:29.668 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.667+0000 7f4bc2400700 1 --2- 172.21.15.184:0/1268465754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc105710 0x7f4bbc105af0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:29.668 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.667+0000 7f4bc2400700 1 -- 172.21.15.184:0/1268465754 >> 172.21.15.184:0/1268465754 conn(0x7f4bbc0fb220 msgr2=0x7f4bbc0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:29.668 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.667+0000 7f4bc2400700 1 -- 172.21.15.184:0/1268465754 shutdown_connections 2024-02-28T22:57:29.669 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.667+0000 7f4bc2400700 1 -- 172.21.15.184:0/1268465754 wait complete. 2024-02-28T22:57:29.669 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.668+0000 7f4bc2400700 1 Processor -- start 2024-02-28T22:57:29.669 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.669+0000 7f4bc2400700 1 -- start start 2024-02-28T22:57:29.669 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.669+0000 7f4bc2400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc105710 0x7f4bbc0fb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:29.669 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.669+0000 7f4bc2400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bbc0fd650 con 0x7f4bbc105710 2024-02-28T22:57:29.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.670+0000 7f4bbb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc105710 0x7f4bbc0fb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:29.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.670+0000 7f4bbb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc105710 0x7f4bbc0fb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:40094/0 (socket says 172.21.15.184:40094) 2024-02-28T22:57:29.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.670+0000 7f4bbb400700 1 -- 172.21.15.184:0/2648545515 learned_addr learned my addr 172.21.15.184:0/2648545515 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:57:29.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.670+0000 7f4bbb400700 1 -- 172.21.15.184:0/2648545515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0095f0 con 0x7f4bbc105710 2024-02-28T22:57:29.670 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.671+0000 7f4bbb400700 1 --2- 172.21.15.184:0/2648545515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc105710 0x7f4bbc0fb6d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0092e0 tx=0x7f4bac004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:29.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.671+0000 7f4bb3e00700 1 -- 172.21.15.184:0/2648545515 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4bac01d070 con 0x7f4bbc105710 2024-02-28T22:57:29.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.671+0000 7f4bc2400700 1 -- 172.21.15.184:0/2648545515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bbc0fbc10 con 0x7f4bbc105710 2024-02-28T22:57:29.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.671+0000 7f4bb3e00700 1 -- 172.21.15.184:0/2648545515 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4bac00be10 con 0x7f4bbc105710 2024-02-28T22:57:29.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.671+0000 7f4bb3e00700 1 -- 172.21.15.184:0/2648545515 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4bac022e10 con 0x7f4bbc105710 2024-02-28T22:57:29.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.671+0000 7f4bc2400700 1 -- 172.21.15.184:0/2648545515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bbc0fc090 con 0x7f4bbc105710 2024-02-28T22:57:29.671 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.672+0000 7f4bc2400700 1 -- 172.21.15.184:0/2648545515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bbc0623c0 con 0x7f4bbc105710 2024-02-28T22:57:29.672 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.673+0000 7f4bb3e00700 1 -- 172.21.15.184:0/2648545515 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7f4bac022470 con 0x7f4bbc105710 2024-02-28T22:57:29.673 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.674+0000 7f4bb3e00700 1 --2- 172.21.15.184:0/2648545515 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4ba0038460 0x7f4ba003a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:29.673 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.674+0000 7f4bb3e00700 1 -- 172.21.15.184:0/2648545515 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f4bac04d0c0 con 0x7f4bbc105710 2024-02-28T22:57:29.673 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.674+0000 7f4bbaa00700 1 --2- 172.21.15.184:0/2648545515 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4ba0038460 0x7f4ba003a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:29.674 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.675+0000 7f4bbaa00700 1 --2- 172.21.15.184:0/2648545515 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4ba0038460 0x7f4ba003a920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8006fd0 tx=0x7f4ba8006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:29.687 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:29.688+0000 7f4bb3e00700 1 -- 172.21.15.184:0/2648545515 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f4bac02bdb0 con 0x7f4bbc105710 2024-02-28T22:57:30.016 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.016+0000 7f4bc2400700 1 -- 172.21.15.184:0/2648545515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4bbc0fc430 con 0x7f4bbc105710 2024-02-28T22:57:30.016 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.017+0000 7f4bb3e00700 1 -- 172.21.15.184:0/2648545515 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7f4bac027030 con 0x7f4bbc105710 2024-02-28T22:57:30.016 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:57:30.016 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:57:30.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.020+0000 7f4bc2400700 1 -- 172.21.15.184:0/2648545515 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4ba0038460 msgr2=0x7f4ba003a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:30.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.020+0000 7f4bc2400700 1 --2- 172.21.15.184:0/2648545515 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4ba0038460 0x7f4ba003a920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4ba8006fd0 tx=0x7f4ba8006e40 comp rx=0 tx=0).stop 2024-02-28T22:57:30.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.020+0000 7f4bc2400700 1 -- 172.21.15.184:0/2648545515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc105710 msgr2=0x7f4bbc0fb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:30.019 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.020+0000 7f4bc2400700 1 --2- 172.21.15.184:0/2648545515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc105710 0x7f4bbc0fb6d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0092e0 tx=0x7f4bac004c80 comp rx=0 tx=0).stop 2024-02-28T22:57:30.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.020+0000 7f4bc2400700 1 -- 172.21.15.184:0/2648545515 shutdown_connections 2024-02-28T22:57:30.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.020+0000 7f4bc2400700 1 --2- 172.21.15.184:0/2648545515 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4ba0038460 0x7f4ba003a920 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:30.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.020+0000 7f4bc2400700 1 --2- 172.21.15.184:0/2648545515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4bbc105710 0x7f4bbc0fb6d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:30.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.020+0000 7f4bc2400700 1 -- 172.21.15.184:0/2648545515 >> 172.21.15.184:0/2648545515 conn(0x7f4bbc0fb220 msgr2=0x7f4bbc107280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:30.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.020+0000 7f4bc2400700 1 -- 172.21.15.184:0/2648545515 shutdown_connections 2024-02-28T22:57:30.020 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:30.020+0000 7f4bc2400700 1 -- 172.21.15.184:0/2648545515 wait complete. 2024-02-28T22:57:30.020 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:57:30.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:30 smithi159 ceph-mon[28802]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:30.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:30 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:30.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:30 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/2648545515' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:57:32.008 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:57:32.008 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:57:32.372 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T22:57:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:32 smithi159 ceph-mon[28802]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:34 smithi159 ceph-mon[28802]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:34 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:34 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:34 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:34.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:34 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:34.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:34 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.quvmnx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T22:57:34.903 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.904+0000 7fb0e1a00700 1 -- 172.21.15.184:0/2950694208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0dc073160 msgr2=0x7fb0dc073540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:34.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.904+0000 7fb0e1a00700 1 --2- 172.21.15.184:0/2950694208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0dc073160 0x7fb0dc073540 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009910 tx=0x7fb0cc009c20 comp rx=0 tx=0).stop 2024-02-28T22:57:34.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.904+0000 7fb0e1a00700 1 -- 172.21.15.184:0/2950694208 shutdown_connections 2024-02-28T22:57:34.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.904+0000 7fb0e1a00700 1 --2- 172.21.15.184:0/2950694208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0dc073160 0x7fb0dc073540 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:34.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.904+0000 7fb0e1a00700 1 -- 172.21.15.184:0/2950694208 >> 172.21.15.184:0/2950694208 conn(0x7fb0dc0fc320 msgr2=0x7fb0dc0fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:34.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.904+0000 7fb0e1a00700 1 -- 172.21.15.184:0/2950694208 shutdown_connections 2024-02-28T22:57:34.904 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.904+0000 7fb0e1a00700 1 -- 172.21.15.184:0/2950694208 wait complete. 2024-02-28T22:57:34.909 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.906+0000 7fb0e1a00700 1 Processor -- start 2024-02-28T22:57:34.909 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.906+0000 7fb0e1a00700 1 -- start start 2024-02-28T22:57:34.909 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.906+0000 7fb0e1a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0dc073160 0x7fb0dc197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:34.909 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.906+0000 7fb0e1a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0dc1984f0 con 0x7fb0dc073160 2024-02-28T22:57:34.909 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.907+0000 7fb0daa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0dc073160 0x7fb0dc197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:34.909 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.907+0000 7fb0daa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0dc073160 0x7fb0dc197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:40114/0 (socket says 172.21.15.184:40114) 2024-02-28T22:57:34.909 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.907+0000 7fb0daa00700 1 -- 172.21.15.184:0/860665399 learned_addr learned my addr 172.21.15.184:0/860665399 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:57:34.909 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.908+0000 7fb0daa00700 1 -- 172.21.15.184:0/860665399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0cc0095f0 con 0x7fb0dc073160 2024-02-28T22:57:34.910 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.908+0000 7fb0daa00700 1 --2- 172.21.15.184:0/860665399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0dc073160 0x7fb0dc197fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0092e0 tx=0x7fb0cc004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:34.910 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.908+0000 7fb0d3400700 1 -- 172.21.15.184:0/860665399 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0cc01d070 con 0x7fb0dc073160 2024-02-28T22:57:34.910 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.908+0000 7fb0e1a00700 1 -- 172.21.15.184:0/860665399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0dc1986f0 con 0x7fb0dc073160 2024-02-28T22:57:34.910 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.909+0000 7fb0d3400700 1 -- 172.21.15.184:0/860665399 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb0cc00be10 con 0x7fb0dc073160 2024-02-28T22:57:34.910 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.909+0000 7fb0d3400700 1 -- 172.21.15.184:0/860665399 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb0cc022e10 con 0x7fb0dc073160 2024-02-28T22:57:34.910 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.909+0000 7fb0e1a00700 1 -- 172.21.15.184:0/860665399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0dc198b10 con 0x7fb0dc073160 2024-02-28T22:57:34.910 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.910+0000 7fb0d3400700 1 -- 172.21.15.184:0/860665399 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7fb0cc00b960 con 0x7fb0dc073160 2024-02-28T22:57:34.910 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.910+0000 7fb0e1a00700 1 -- 172.21.15.184:0/860665399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0dc0623c0 con 0x7fb0dc073160 2024-02-28T22:57:34.910 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.911+0000 7fb0d3400700 1 --2- 172.21.15.184:0/860665399 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb0c0038460 0x7fb0c003a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:34.911 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.911+0000 7fb0d3400700 1 -- 172.21.15.184:0/860665399 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fb0cc04c470 con 0x7fb0dc073160 2024-02-28T22:57:34.911 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.911+0000 7fb0da000700 1 --2- 172.21.15.184:0/860665399 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb0c0038460 0x7fb0c003a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:34.911 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.912+0000 7fb0da000700 1 --2- 172.21.15.184:0/860665399 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb0c0038460 0x7fb0c003a920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8006fd0 tx=0x7fb0c8006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:34.924 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:34.926+0000 7fb0d3400700 1 -- 172.21.15.184:0/860665399 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb0cc00f460 con 0x7fb0dc073160 2024-02-28T22:57:35.231 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.231+0000 7fb0e1a00700 1 -- 172.21.15.184:0/860665399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb0dc109d50 con 0x7fb0dc073160 2024-02-28T22:57:35.232 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.233+0000 7fb0d3400700 1 -- 172.21.15.184:0/860665399 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fb0cc027030 con 0x7fb0dc073160 2024-02-28T22:57:35.232 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:57:35.232 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:57:35.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.235+0000 7fb0e1a00700 1 -- 172.21.15.184:0/860665399 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb0c0038460 msgr2=0x7fb0c003a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:35.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.235+0000 7fb0e1a00700 1 --2- 172.21.15.184:0/860665399 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb0c0038460 0x7fb0c003a920 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8006fd0 tx=0x7fb0c8006e40 comp rx=0 tx=0).stop 2024-02-28T22:57:35.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.235+0000 7fb0e1a00700 1 -- 172.21.15.184:0/860665399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0dc073160 msgr2=0x7fb0dc197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:35.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.235+0000 7fb0e1a00700 1 --2- 172.21.15.184:0/860665399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0dc073160 0x7fb0dc197fb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0092e0 tx=0x7fb0cc004c80 comp rx=0 tx=0).stop 2024-02-28T22:57:35.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.235+0000 7fb0e1a00700 1 -- 172.21.15.184:0/860665399 shutdown_connections 2024-02-28T22:57:35.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.235+0000 7fb0e1a00700 1 --2- 172.21.15.184:0/860665399 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb0c0038460 0x7fb0c003a920 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:35.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.235+0000 7fb0e1a00700 1 --2- 172.21.15.184:0/860665399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0dc073160 0x7fb0dc197fb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:35.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.235+0000 7fb0e1a00700 1 -- 172.21.15.184:0/860665399 >> 172.21.15.184:0/860665399 conn(0x7fb0dc0fc320 msgr2=0x7fb0dc1073b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:35.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.235+0000 7fb0e1a00700 1 -- 172.21.15.184:0/860665399 shutdown_connections 2024-02-28T22:57:35.235 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:35.236+0000 7fb0e1a00700 1 -- 172.21.15.184:0/860665399 wait complete. 2024-02-28T22:57:35.236 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:57:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.quvmnx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-28T22:57:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T22:57:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:35 smithi159 ceph-mon[28802]: Deploying daemon mgr.smithi184.quvmnx on smithi184 2024-02-28T22:57:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:57:35.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:36 smithi159 ceph-mon[28802]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:36 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/860665399' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:57:37.788 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:57:37.788 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:57:38.189 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T22:57:38.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:38 smithi159 ceph-mon[28802]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T22:57:39.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:39.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:39 smithi159 ceph-mon[28802]: Deploying daemon mon.smithi184 on smithi184 2024-02-28T22:57:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:40 smithi159 ceph-mon[28802]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:40 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:41.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.595+0000 7fc9c0000700 1 -- 172.21.15.184:0/4128116407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b8106830 msgr2=0x7fc9b8106c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:41.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.595+0000 7fc9c0000700 1 --2- 172.21.15.184:0/4128116407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b8106830 0x7fc9b8106c10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac009910 tx=0x7fc9ac009c20 comp rx=0 tx=0).stop 2024-02-28T22:57:41.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.595+0000 7fc9c0000700 1 -- 172.21.15.184:0/4128116407 shutdown_connections 2024-02-28T22:57:41.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.595+0000 7fc9c0000700 1 --2- 172.21.15.184:0/4128116407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b8106830 0x7fc9b8106c10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:41.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.595+0000 7fc9c0000700 1 -- 172.21.15.184:0/4128116407 >> 172.21.15.184:0/4128116407 conn(0x7fc9b80fc380 msgr2=0x7fc9b80fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:41.886 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.596+0000 7fc9c0000700 1 -- 172.21.15.184:0/4128116407 shutdown_connections 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.596+0000 7fc9c0000700 1 -- 172.21.15.184:0/4128116407 wait complete. 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.597+0000 7fc9c0000700 1 Processor -- start 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.597+0000 7fc9c0000700 1 -- start start 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.597+0000 7fc9c0000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b8106830 0x7fc9b8197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.597+0000 7fc9c0000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9b8198460 con 0x7fc9b8106830 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.598+0000 7fc9bd600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b8106830 0x7fc9b8197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.598+0000 7fc9bd600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b8106830 0x7fc9b8197f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:60832/0 (socket says 172.21.15.184:60832) 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.598+0000 7fc9bd600700 1 -- 172.21.15.184:0/3179565717 learned_addr learned my addr 172.21.15.184:0/3179565717 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.598+0000 7fc9bd600700 1 -- 172.21.15.184:0/3179565717 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9ac0095f0 con 0x7fc9b8106830 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.599+0000 7fc9bd600700 1 --2- 172.21.15.184:0/3179565717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b8106830 0x7fc9b8197f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0092e0 tx=0x7fc9ac004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.599+0000 7fc9b6000700 1 -- 172.21.15.184:0/3179565717 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9ac01d070 con 0x7fc9b8106830 2024-02-28T22:57:41.887 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.599+0000 7fc9c0000700 1 -- 172.21.15.184:0/3179565717 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9b81986c0 con 0x7fc9b8106830 2024-02-28T22:57:41.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.599+0000 7fc9c0000700 1 -- 172.21.15.184:0/3179565717 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9b8198b40 con 0x7fc9b8106830 2024-02-28T22:57:41.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.599+0000 7fc9b6000700 1 -- 172.21.15.184:0/3179565717 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc9ac00be10 con 0x7fc9b8106830 2024-02-28T22:57:41.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.599+0000 7fc9b6000700 1 -- 172.21.15.184:0/3179565717 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc9ac022e10 con 0x7fc9b8106830 2024-02-28T22:57:41.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.600+0000 7fc9c0000700 1 -- 172.21.15.184:0/3179565717 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc998005320 con 0x7fc9b8106830 2024-02-28T22:57:41.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.601+0000 7fc9b6000700 1 -- 172.21.15.184:0/3179565717 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) v1 ==== 45398+0+0 (secure 0 0 0) 0x7fc9ac00b960 con 0x7fc9b8106830 2024-02-28T22:57:41.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.601+0000 7fc9b6000700 1 --2- 172.21.15.184:0/3179565717 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc9a0038460 0x7fc9a003a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:41.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.601+0000 7fc9b6000700 1 -- 172.21.15.184:0/3179565717 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc9ac04cd30 con 0x7fc9b8106830 2024-02-28T22:57:41.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.602+0000 7fc9bcc00700 1 --2- 172.21.15.184:0/3179565717 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc9a0038460 0x7fc9a003a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:41.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.603+0000 7fc9bcc00700 1 --2- 172.21.15.184:0/3179565717 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc9a0038460 0x7fc9a003a920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4006fd0 tx=0x7fc9a4006e40 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:41.888 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.616+0000 7fc9b6000700 1 -- 172.21.15.184:0/3179565717 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc9ac03d5a0 con 0x7fc9b8106830 2024-02-28T22:57:41.973 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.974+0000 7fc9c0000700 1 -- 172.21.15.184:0/3179565717 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fc9980059f0 con 0x7fc9b8106830 2024-02-28T22:57:41.974 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.975+0000 7fc9b6000700 1 -- 172.21.15.184:0/3179565717 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+748 (secure 0 0 0) 0x7fc9ac034300 con 0x7fc9b8106830 2024-02-28T22:57:41.975 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:57:41.975 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":1,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:54:03.362687Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-02-28T22:57:41.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.978+0000 7fc9c0000700 1 -- 172.21.15.184:0/3179565717 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc9a0038460 msgr2=0x7fc9a003a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:41.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.978+0000 7fc9c0000700 1 --2- 172.21.15.184:0/3179565717 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc9a0038460 0x7fc9a003a920 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc9a4006fd0 tx=0x7fc9a4006e40 comp rx=0 tx=0).stop 2024-02-28T22:57:41.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.978+0000 7fc9c0000700 1 -- 172.21.15.184:0/3179565717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b8106830 msgr2=0x7fc9b8197f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:41.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.978+0000 7fc9c0000700 1 --2- 172.21.15.184:0/3179565717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b8106830 0x7fc9b8197f20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fc9ac0092e0 tx=0x7fc9ac004c80 comp rx=0 tx=0).stop 2024-02-28T22:57:41.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.978+0000 7fc9c0000700 1 -- 172.21.15.184:0/3179565717 shutdown_connections 2024-02-28T22:57:41.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.978+0000 7fc9c0000700 1 --2- 172.21.15.184:0/3179565717 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc9a0038460 0x7fc9a003a920 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:41.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.979+0000 7fc9c0000700 1 --2- 172.21.15.184:0/3179565717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9b8106830 0x7fc9b8197f20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:41.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.979+0000 7fc9c0000700 1 -- 172.21.15.184:0/3179565717 >> 172.21.15.184:0/3179565717 conn(0x7fc9b80fc380 msgr2=0x7fc9b8108bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:41.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.979+0000 7fc9c0000700 1 -- 172.21.15.184:0/3179565717 shutdown_connections 2024-02-28T22:57:41.978 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:41.979+0000 7fc9c0000700 1 -- 172.21.15.184:0/3179565717 wait complete. 2024-02-28T22:57:41.979 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 1 2024-02-28T22:57:42.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:42 smithi159 ceph-mon[28802]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:42.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:42 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/3179565717' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:57:44.113 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-28T22:57:44.114 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mon dump -f json 2024-02-28T22:57:44.488 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi184/config 2024-02-28T22:57:49.370 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.370+0000 7f2953200700 1 -- 172.21.15.184:0/3859098028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29300035c0 msgr2=0x7f2930005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:49.370 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.370+0000 7f2953200700 1 --2- 172.21.15.184:0/3859098028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29300035c0 0x7f2930005a50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f294c068e60 tx=0x7f293c00feb0 comp rx=0 tx=0).stop 2024-02-28T22:57:49.370 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.371+0000 7f2953200700 1 -- 172.21.15.184:0/3859098028 shutdown_connections 2024-02-28T22:57:49.370 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.371+0000 7f2953200700 1 --2- 172.21.15.184:0/3859098028 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29300035c0 0x7f2930005a50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:49.370 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.371+0000 7f2953200700 1 -- 172.21.15.184:0/3859098028 >> 172.21.15.184:0/3859098028 conn(0x7f294c0fb350 msgr2=0x7f294c0fd770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:49.370 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.371+0000 7f2953200700 1 -- 172.21.15.184:0/3859098028 shutdown_connections 2024-02-28T22:57:49.370 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.371+0000 7f2953200700 1 -- 172.21.15.184:0/3859098028 wait complete. 2024-02-28T22:57:49.371 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.373+0000 7f2953200700 1 Processor -- start 2024-02-28T22:57:49.371 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.373+0000 7f2953200700 1 -- start start 2024-02-28T22:57:49.371 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.373+0000 7f2953200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29300035c0 0x7f294c198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:49.372 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.373+0000 7f2953200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f294c1987d0 0x7f294c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:49.372 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.373+0000 7f2953200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c198df0 con 0x7f29300035c0 2024-02-28T22:57:49.372 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.373+0000 7f2953200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f294c198f60 con 0x7f294c1987d0 2024-02-28T22:57:49.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.374+0000 7f294be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29300035c0 0x7f294c198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:49.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.374+0000 7f294b400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f294c1987d0 0x7f294c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:49.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.374+0000 7f294be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29300035c0 0x7f294c198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.184:55682/0 (socket says 172.21.15.184:55682) 2024-02-28T22:57:49.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.374+0000 7f294be00700 1 -- 172.21.15.184:0/3783637478 learned_addr learned my addr 172.21.15.184:0/3783637478 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T22:57:49.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.374+0000 7f294b400700 1 -- 172.21.15.184:0/3783637478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f294c1987d0 msgr2=0x7f294c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-02-28T22:57:49.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.374+0000 7f294b400700 1 -- 172.21.15.184:0/3783637478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f294c1987d0 msgr2=0x7f294c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-02-28T22:57:49.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.374+0000 7f294b400700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f294c1987d0 0x7f294c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-02-28T22:57:49.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.374+0000 7f294b400700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f294c1987d0 0x7f294c19cc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-02-28T22:57:49.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.375+0000 7f294be00700 1 -- 172.21.15.184:0/3783637478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f294c1987d0 msgr2=0x7f294c19cc40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-02-28T22:57:49.373 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.375+0000 7f294be00700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f294c1987d0 0x7f294c19cc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:49.374 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.375+0000 7f294be00700 1 -- 172.21.15.184:0/3783637478 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c00f900 con 0x7f29300035c0 2024-02-28T22:57:49.374 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.375+0000 7f294be00700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29300035c0 0x7f294c198290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f293c001eb0 tx=0x7f293c011590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:49.374 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.376+0000 7f2948c00700 1 -- 172.21.15.184:0/3783637478 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f293c013b30 con 0x7f29300035c0 2024-02-28T22:57:49.374 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.376+0000 7f2953200700 1 -- 172.21.15.184:0/3783637478 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294c19d240 con 0x7f29300035c0 2024-02-28T22:57:49.375 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.376+0000 7f2953200700 1 -- 172.21.15.184:0/3783637478 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294c19d790 con 0x7f29300035c0 2024-02-28T22:57:49.375 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.376+0000 7f2948c00700 1 -- 172.21.15.184:0/3783637478 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f293c004b40 con 0x7f29300035c0 2024-02-28T22:57:49.375 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.376+0000 7f2948c00700 1 -- 172.21.15.184:0/3783637478 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f293c011c30 con 0x7f29300035c0 2024-02-28T22:57:49.376 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.378+0000 7f2953200700 1 -- 172.21.15.184:0/3783637478 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2930002170 con 0x7f29300035c0 2024-02-28T22:57:49.377 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.379+0000 7f2948c00700 1 -- 172.21.15.184:0/3783637478 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) v1 ==== 90258+0+0 (secure 0 0 0) 0x7f293c011d90 con 0x7f29300035c0 2024-02-28T22:57:49.378 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.380+0000 7f2948c00700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f292c06c560 0x7f292c06ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:49.378 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.380+0000 7f2948c00700 1 -- 172.21.15.184:0/3783637478 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7f293c000e40 con 0x7f29300035c0 2024-02-28T22:57:49.379 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.381+0000 7f294b400700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f292c06c560 0x7f292c06ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:49.380 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.382+0000 7f294b400700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f292c06c560 0x7f292c06ea20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2938009850 tx=0x7f2938008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:49.400 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.402+0000 7f2948c00700 1 -- 172.21.15.184:0/3783637478 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f293c058d80 con 0x7f29300035c0 2024-02-28T22:57:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T22:57:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T22:57:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: mon.smithi159 calling monitor election 2024-02-28T22:57:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T22:57:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T22:57:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T22:57:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: mon.smithi184 calling monitor election 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/82812655' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/crt"}]: dispatch 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: mon.smithi159 is new leader, mons smithi159,smithi184 in quorum (ranks 0,1) 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: monmap e2: 2 mons at {smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0],smithi184=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: fsmap 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: osdmap e5: 0 total, 0 up, 0 in 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: mgrmap e17: smithi159.pobewk(active, since 44s) 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: Standby manager daemon smithi184.quvmnx started 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/82812655' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: overall HEALTH_OK 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/82812655' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/key"}]: dispatch 2024-02-28T22:57:49.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:49.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/82812655' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T22:57:49.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:49 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:49.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.702+0000 7f2953200700 1 -- 172.21.15.184:0/3783637478 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2930001fe0 con 0x7f29300035c0 2024-02-28T22:57:49.701 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.703+0000 7f2948c00700 1 -- 172.21.15.184:0/3783637478 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1026 (secure 0 0 0) 0x7f293c00eea0 con 0x7f29300035c0 2024-02-28T22:57:49.702 INFO:teuthology.orchestra.run.smithi184.stdout: 2024-02-28T22:57:49.702 INFO:teuthology.orchestra.run.smithi184.stdout:{"epoch":2,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","modified":"2024-02-28T22:57:44.071737Z","created":"2024-02-28T22:54:03.362687Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"smithi159","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:3300","nonce":0},{"type":"v1","addr":"172.21.15.159:6789","nonce":0}]},"addr":"172.21.15.159:6789/0","public_addr":"172.21.15.159:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi184","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:3300","nonce":0},{"type":"v1","addr":"172.21.15.184:6789","nonce":0}]},"addr":"172.21.15.184:6789/0","public_addr":"172.21.15.184:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-02-28T22:57:49.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.706+0000 7f2953200700 1 -- 172.21.15.184:0/3783637478 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f292c06c560 msgr2=0x7f292c06ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:49.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.706+0000 7f2953200700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f292c06c560 0x7f292c06ea20 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2938009850 tx=0x7f2938008040 comp rx=0 tx=0).stop 2024-02-28T22:57:49.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.706+0000 7f2953200700 1 -- 172.21.15.184:0/3783637478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29300035c0 msgr2=0x7f294c198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:49.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.706+0000 7f2953200700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29300035c0 0x7f294c198290 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f293c001eb0 tx=0x7f293c011590 comp rx=0 tx=0).stop 2024-02-28T22:57:49.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.706+0000 7f2953200700 1 -- 172.21.15.184:0/3783637478 shutdown_connections 2024-02-28T22:57:49.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.706+0000 7f2953200700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f292c06c560 0x7f292c06ea20 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:49.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.706+0000 7f2953200700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f29300035c0 0x7f294c198290 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:49.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.706+0000 7f2953200700 1 --2- 172.21.15.184:0/3783637478 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f294c1987d0 0x7f294c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:49.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.706+0000 7f2953200700 1 -- 172.21.15.184:0/3783637478 >> 172.21.15.184:0/3783637478 conn(0x7f294c0fb350 msgr2=0x7f294c0fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:49.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.706+0000 7f2953200700 1 -- 172.21.15.184:0/3783637478 shutdown_connections 2024-02-28T22:57:49.705 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T22:57:49.706+0000 7f2953200700 1 -- 172.21.15.184:0/3783637478 wait complete. 2024-02-28T22:57:49.706 INFO:teuthology.orchestra.run.smithi184.stderr:dumped monmap epoch 2 2024-02-28T22:57:50.348 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T22:57:50.387 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-28T22:57:50.387 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph config generate-minimal-conf 2024-02-28T22:57:50.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:50 smithi159 ceph-mon[28802]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:50.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:50 smithi159 ceph-mon[28802]: mgrmap e18: smithi159.pobewk(active, since 44s), standbys: smithi184.quvmnx 2024-02-28T22:57:50.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi184.quvmnx", "id": "smithi184.quvmnx"}]: dispatch 2024-02-28T22:57:50.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:50.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:50.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:50.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:57:50.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:50 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/3783637478' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-28T22:57:50.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:57:50.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:50.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T22:57:50.805 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:57:52.391 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:52 smithi159 ceph-mon[28802]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:52.496 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:52 smithi184 ceph-mon[36198]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:52.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.869+0000 7fc0d2000700 1 -- 172.21.15.159:0/2097857767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0cc106830 msgr2=0x7fc0cc106c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:52.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.869+0000 7fc0d2000700 1 --2- 172.21.15.159:0/2097857767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0cc106830 0x7fc0cc106c10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc009910 tx=0x7fc0bc009c20 comp rx=0 tx=0).stop 2024-02-28T22:57:52.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.869+0000 7fc0d2000700 1 -- 172.21.15.159:0/2097857767 shutdown_connections 2024-02-28T22:57:52.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.869+0000 7fc0d2000700 1 --2- 172.21.15.159:0/2097857767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0cc106830 0x7fc0cc106c10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:52.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.869+0000 7fc0d2000700 1 -- 172.21.15.159:0/2097857767 >> 172.21.15.159:0/2097857767 conn(0x7fc0cc0fc380 msgr2=0x7fc0cc0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:52.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.869+0000 7fc0d2000700 1 -- 172.21.15.159:0/2097857767 shutdown_connections 2024-02-28T22:57:52.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.870+0000 7fc0d2000700 1 -- 172.21.15.159:0/2097857767 wait complete. 2024-02-28T22:57:52.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.871+0000 7fc0d2000700 1 Processor -- start 2024-02-28T22:57:52.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.871+0000 7fc0d2000700 1 -- start start 2024-02-28T22:57:52.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.872+0000 7fc0d2000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0cc106830 0x7fc0cc195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:52.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.872+0000 7fc0d2000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0cc1963e0 0x7fc0cc19a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:52.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.872+0000 7fc0d2000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc196a00 con 0x7fc0cc1963e0 2024-02-28T22:57:52.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.872+0000 7fc0d2000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc196b70 con 0x7fc0cc106830 2024-02-28T22:57:52.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.872+0000 7fc0caa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0cc1963e0 0x7fc0cc19a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:52.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.872+0000 7fc0caa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0cc1963e0 0x7fc0cc19a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55694/0 (socket says 172.21.15.159:55694) 2024-02-28T22:57:52.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.872+0000 7fc0caa00700 1 -- 172.21.15.159:0/3000753481 learned_addr learned my addr 172.21.15.159:0/3000753481 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:57:52.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.872+0000 7fc0caa00700 1 -- 172.21.15.159:0/3000753481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0cc106830 msgr2=0x7fc0cc195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:52.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.872+0000 7fc0caa00700 1 --2- 172.21.15.159:0/3000753481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0cc106830 0x7fc0cc195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:52.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.872+0000 7fc0caa00700 1 -- 172.21.15.159:0/3000753481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0bc0095f0 con 0x7fc0cc1963e0 2024-02-28T22:57:52.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.873+0000 7fc0caa00700 1 --2- 172.21.15.159:0/3000753481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0cc1963e0 0x7fc0cc19a850 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800b700 tx=0x7fc0b800bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:52.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.873+0000 7fc0c3e00700 1 -- 172.21.15.159:0/3000753481 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0b8011800 con 0x7fc0cc1963e0 2024-02-28T22:57:52.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.873+0000 7fc0c3e00700 1 -- 172.21.15.159:0/3000753481 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc0b8011e10 con 0x7fc0cc1963e0 2024-02-28T22:57:52.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.873+0000 7fc0c3e00700 1 -- 172.21.15.159:0/3000753481 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0b800f2e0 con 0x7fc0cc1963e0 2024-02-28T22:57:52.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.873+0000 7fc0d2000700 1 -- 172.21.15.159:0/3000753481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc19ae50 con 0x7fc0cc1963e0 2024-02-28T22:57:52.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.873+0000 7fc0d2000700 1 -- 172.21.15.159:0/3000753481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc19b3a0 con 0x7fc0cc1963e0 2024-02-28T22:57:52.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.875+0000 7fc0d2000700 1 -- 172.21.15.159:0/3000753481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0cc19b670 con 0x7fc0cc1963e0 2024-02-28T22:57:52.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.875+0000 7fc0c3e00700 1 -- 172.21.15.159:0/3000753481 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) v1 ==== 90258+0+0 (secure 0 0 0) 0x7fc0b8010380 con 0x7fc0cc1963e0 2024-02-28T22:57:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.876+0000 7fc0c3e00700 1 --2- 172.21.15.159:0/3000753481 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc0b006c5c0 0x7fc0b006ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:57:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.877+0000 7fc0c3e00700 1 -- 172.21.15.159:0/3000753481 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fc0b808a340 con 0x7fc0cc1963e0 2024-02-28T22:57:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.877+0000 7fc0cb400700 1 --2- 172.21.15.159:0/3000753481 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc0b006c5c0 0x7fc0b006ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:57:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.877+0000 7fc0cb400700 1 --2- 172.21.15.159:0/3000753481 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc0b006c5c0 0x7fc0b006ea80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc006010 tx=0x7fc0bc00b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:57:52.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:52.881+0000 7fc0c3e00700 1 -- 172.21.15.159:0/3000753481 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc0b8055c00 con 0x7fc0cc1963e0 2024-02-28T22:57:53.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.116+0000 7fc0d2000700 1 -- 172.21.15.159:0/3000753481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fc0cc1a0af0 con 0x7fc0cc1963e0 2024-02-28T22:57:53.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.117+0000 7fc0c3e00700 1 -- 172.21.15.159:0/3000753481 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+227 (secure 0 0 0) 0x7fc0b8015100 con 0x7fc0cc1963e0 2024-02-28T22:57:53.117 INFO:teuthology.orchestra.run.smithi159.stdout:# minimal ceph.conf for 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:57:53.117 INFO:teuthology.orchestra.run.smithi159.stdout:[global] 2024-02-28T22:57:53.117 INFO:teuthology.orchestra.run.smithi159.stdout: fsid = 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T22:57:53.117 INFO:teuthology.orchestra.run.smithi159.stdout: mon_host = [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] 2024-02-28T22:57:53.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.120+0000 7fc0d2000700 1 -- 172.21.15.159:0/3000753481 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc0b006c5c0 msgr2=0x7fc0b006ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:53.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.120+0000 7fc0d2000700 1 --2- 172.21.15.159:0/3000753481 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc0b006c5c0 0x7fc0b006ea80 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc006010 tx=0x7fc0bc00b540 comp rx=0 tx=0).stop 2024-02-28T22:57:53.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.120+0000 7fc0d2000700 1 -- 172.21.15.159:0/3000753481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0cc1963e0 msgr2=0x7fc0cc19a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:57:53.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.120+0000 7fc0d2000700 1 --2- 172.21.15.159:0/3000753481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0cc1963e0 0x7fc0cc19a850 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc0b800b700 tx=0x7fc0b800bac0 comp rx=0 tx=0).stop 2024-02-28T22:57:53.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.120+0000 7fc0d2000700 1 -- 172.21.15.159:0/3000753481 shutdown_connections 2024-02-28T22:57:53.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.120+0000 7fc0d2000700 1 --2- 172.21.15.159:0/3000753481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc0cc106830 0x7fc0cc195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:53.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.120+0000 7fc0d2000700 1 --2- 172.21.15.159:0/3000753481 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc0b006c5c0 0x7fc0b006ea80 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:53.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.120+0000 7fc0d2000700 1 --2- 172.21.15.159:0/3000753481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc0cc1963e0 0x7fc0cc19a850 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:57:53.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.120+0000 7fc0d2000700 1 -- 172.21.15.159:0/3000753481 >> 172.21.15.159:0/3000753481 conn(0x7fc0cc0fc380 msgr2=0x7fc0cc102330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:57:53.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.121+0000 7fc0d2000700 1 -- 172.21.15.159:0/3000753481 shutdown_connections 2024-02-28T22:57:53.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:57:53.121+0000 7fc0d2000700 1 -- 172.21.15.159:0/3000753481 wait complete. 2024-02-28T22:57:53.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:53 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:53 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:53 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:53 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T22:57:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:53 smithi159 ceph-mon[28802]: Updating smithi159:/etc/ceph/ceph.conf 2024-02-28T22:57:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:53 smithi159 ceph-mon[28802]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-28T22:57:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:53 smithi159 ceph-mon[28802]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:53 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3000753481' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:53 smithi159 ceph-mon[28802]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T22:57:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:53 smithi159 ceph-mon[28802]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T22:57:54.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:53 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:54.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:53 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:54.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:53 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:54.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:53 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T22:57:54.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:53 smithi184 ceph-mon[36198]: Updating smithi159:/etc/ceph/ceph.conf 2024-02-28T22:57:54.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:53 smithi184 ceph-mon[36198]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-28T22:57:54.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:53 smithi184 ceph-mon[36198]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:54.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:53 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3000753481' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:54.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:53 smithi184 ceph-mon[36198]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T22:57:54.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:53 smithi184 ceph-mon[36198]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T22:57:54.127 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-28T22:57:54.127 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:57:54.127 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.conf 2024-02-28T22:57:54.201 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:57:54.201 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T22:57:54.325 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T22:57:54.325 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.conf 2024-02-28T22:57:54.410 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T22:57:54.410 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-28T22:57:54.548 INFO:tasks.cephadm:Deploying OSDs... 2024-02-28T22:57:54.548 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T22:57:54.548 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2024-02-28T22:57:54.587 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-28T22:57:54.587 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2024-02-28T22:57:54.677 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-28T22:57:54.677 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T22:57:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 634 Links: 1 2024-02-28T22:57:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T22:57:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T22:57:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-02-28 22:56:54.322881781 +0000 2024-02-28T22:57:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-02-28 22:49:22.228630382 +0000 2024-02-28T22:57:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-02-28 22:49:22.228630382 +0000 2024-02-28T22:57:54.677 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-02-28 22:49:22.228630382 +0000 2024-02-28T22:57:54.678 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-28T22:57:54.754 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-02-28T22:57:54.754 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-02-28T22:57:54.754 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000324432 s, 1.6 MB/s 2024-02-28T22:57:54.758 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-28T22:57:54.808 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2024-02-28T22:57:54.855 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-28T22:57:54.855 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T22:57:54.855 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-02-28T22:57:54.855 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T22:57:54.856 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T22:57:54.856 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-02-28 22:56:54.322881781 +0000 2024-02-28T22:57:54.856 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-02-28 22:49:22.833617952 +0000 2024-02-28T22:57:54.856 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-02-28 22:49:22.833617952 +0000 2024-02-28T22:57:54.856 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-02-28 22:49:22.833617952 +0000 2024-02-28T22:57:54.856 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-28T22:57:54.917 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:54.917 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:54.917 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:54.917 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:54.918 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:54.918 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:54 smithi159 ceph-mon[28802]: Reconfiguring mon.smithi159 (unknown last config time)... 2024-02-28T22:57:54.918 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T22:57:54.918 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T22:57:54.918 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:54.918 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:54 smithi159 ceph-mon[28802]: Reconfiguring daemon mon.smithi159 on smithi159 2024-02-28T22:57:54.924 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-02-28T22:57:54.925 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-02-28T22:57:54.925 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000279452 s, 1.8 MB/s 2024-02-28T22:57:54.927 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-28T22:57:54.966 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2024-02-28T22:57:55.051 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-28T22:57:55.051 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T22:57:55.051 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-02-28T22:57:55.051 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T22:57:55.051 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T22:57:55.051 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-02-28 22:56:54.323881761 +0000 2024-02-28T22:57:55.051 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-02-28 22:49:23.398606344 +0000 2024-02-28T22:57:55.051 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-02-28 22:49:23.398606344 +0000 2024-02-28T22:57:55.051 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-02-28 22:49:23.398606344 +0000 2024-02-28T22:57:55.052 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-28T22:57:55.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:55.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:55.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:55.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:55.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:55.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:54 smithi184 ceph-mon[36198]: Reconfiguring mon.smithi159 (unknown last config time)... 2024-02-28T22:57:55.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T22:57:55.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T22:57:55.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:55.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:54 smithi184 ceph-mon[36198]: Reconfiguring daemon mon.smithi159 on smithi159 2024-02-28T22:57:55.174 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-02-28T22:57:55.174 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-02-28T22:57:55.175 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000288958 s, 1.8 MB/s 2024-02-28T22:57:55.178 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-28T22:57:55.226 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2024-02-28T22:57:55.308 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-28T22:57:55.308 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T22:57:55.308 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-02-28T22:57:55.308 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T22:57:55.308 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T22:57:55.308 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-02-28 22:56:54.324881741 +0000 2024-02-28T22:57:55.308 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-02-28 22:49:23.972594551 +0000 2024-02-28T22:57:55.309 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-02-28 22:49:23.972594551 +0000 2024-02-28T22:57:55.309 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-02-28 22:49:23.972594551 +0000 2024-02-28T22:57:55.309 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-28T22:57:55.425 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-02-28T22:57:55.425 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-02-28T22:57:55.425 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000263755 s, 1.9 MB/s 2024-02-28T22:57:55.428 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-28T22:57:55.469 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T22:57:55.469 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/scratch_devs of=/dev/stdout 2024-02-28T22:57:55.525 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-28T22:57:55.525 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_1 2024-02-28T22:57:55.576 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-28T22:57:55.576 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T22:57:55.576 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 633 Links: 1 2024-02-28T22:57:55.576 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T22:57:55.576 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T22:57:55.576 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-28 22:57:43.168482041 +0000 2024-02-28T22:57:55.576 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-28 22:49:22.663046160 +0000 2024-02-28T22:57:55.576 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-28 22:49:22.663046160 +0000 2024-02-28T22:57:55.576 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-28 22:49:22.663046160 +0000 2024-02-28T22:57:55.577 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-28T22:57:55.667 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-28T22:57:55.667 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-28T22:57:55.667 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.00034518 s, 1.5 MB/s 2024-02-28T22:57:55.671 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-28T22:57:55.726 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_2 2024-02-28T22:57:55.774 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-28T22:57:55.775 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T22:57:55.775 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-02-28T22:57:55.775 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T22:57:55.775 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T22:57:55.775 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-28 22:57:43.169482020 +0000 2024-02-28T22:57:55.775 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-28 22:49:23.256034107 +0000 2024-02-28T22:57:55.776 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-28 22:49:23.256034107 +0000 2024-02-28T22:57:55.776 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-28 22:49:23.256034107 +0000 2024-02-28T22:57:55.776 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-28T22:57:55.856 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-28T22:57:55.856 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-28T22:57:55.856 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000350406 s, 1.5 MB/s 2024-02-28T22:57:55.860 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-28T22:57:55.914 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_3 2024-02-28T22:57:55.963 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-28T22:57:55.963 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T22:57:55.963 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-02-28T22:57:55.963 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T22:57:55.963 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T22:57:55.963 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-28 22:57:43.169482020 +0000 2024-02-28T22:57:55.963 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-28 22:49:23.804022969 +0000 2024-02-28T22:57:55.964 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-28 22:49:23.804022969 +0000 2024-02-28T22:57:55.964 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-28 22:49:23.804022969 +0000 2024-02-28T22:57:55.964 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-28T22:57:56.039 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:55 smithi184 ceph-mon[36198]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:56.050 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-28T22:57:56.050 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-28T22:57:56.050 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000505908 s, 1.0 MB/s 2024-02-28T22:57:56.054 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-28T22:57:56.108 DEBUG:teuthology.orchestra.run.smithi184:> stat /dev/vg_nvme/lv_4 2024-02-28T22:57:56.132 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:55 smithi159 ceph-mon[28802]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:56.158 INFO:teuthology.orchestra.run.smithi184.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-28T22:57:56.158 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-28T22:57:56.158 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-02-28T22:57:56.159 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T22:57:56.159 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:device_t:s0 2024-02-28T22:57:56.159 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 2024-02-28 22:57:43.170482000 +0000 2024-02-28T22:57:56.159 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-28 22:49:24.422010408 +0000 2024-02-28T22:57:56.159 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-28 22:49:24.422010408 +0000 2024-02-28T22:57:56.159 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: 2024-02-28 22:49:24.422010408 +0000 2024-02-28T22:57:56.159 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-28T22:57:56.240 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records in 2024-02-28T22:57:56.240 INFO:teuthology.orchestra.run.smithi184.stderr:1+0 records out 2024-02-28T22:57:56.240 INFO:teuthology.orchestra.run.smithi184.stderr:512 bytes copied, 0.000335242 s, 1.5 MB/s 2024-02-28T22:57:56.243 DEBUG:teuthology.orchestra.run.smithi184:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-28T22:57:56.297 INFO:tasks.cephadm:Deploying osd.0 on smithi159 with /dev/vg_nvme/lv_4... 2024-02-28T22:57:56.297 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-28T22:57:56.711 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:57:57.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:57 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:57.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:57 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:57.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:57 smithi159 ceph-mon[28802]: Reconfiguring mgr.smithi159.pobewk (unknown last config time)... 2024-02-28T22:57:57.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:57 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.pobewk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T22:57:57.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:57 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T22:57:57.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:57 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:57.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:57 smithi159 ceph-mon[28802]: Reconfiguring daemon mgr.smithi159.pobewk on smithi159 2024-02-28T22:57:57.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:57 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:57.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:57 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:57:57.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:57 smithi184 ceph-mon[36198]: Reconfiguring mgr.smithi159.pobewk (unknown last config time)... 2024-02-28T22:57:57.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:57 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.pobewk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T22:57:57.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:57 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T22:57:57.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:57 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:57:57.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:57 smithi184 ceph-mon[36198]: Reconfiguring daemon mgr.smithi159.pobewk on smithi159 2024-02-28T22:57:58.691 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:57:58 smithi159 ceph-mon[28802]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:57:58.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:57:58 smithi184 ceph-mon[36198]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:00.541 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-28T22:58:00.542 INFO:teuthology.orchestra.run.smithi159.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-28T22:58:00.542 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10+0 records in 2024-02-28T22:58:00.542 INFO:teuthology.orchestra.run.smithi159.stderr:10+0 records out 2024-02-28T22:58:00.542 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0354187 s, 296 MB/s 2024-02-28T22:58:00.542 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping successful for: 2024-02-28T22:58:00.542 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:00 smithi159 ceph-mon[28802]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:00.542 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:00 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:00.542 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:00 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:00.542 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:00 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T22:58:00.542 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:00 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:00.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:00 smithi184 ceph-mon[36198]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:00 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:00 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:00 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T22:58:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:00 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:01.389 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi159:vg_nvme/lv_4 2024-02-28T22:58:01.582 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:01 smithi159 ceph-mon[28802]: Reconfiguring ceph-exporter.smithi159 (monmap changed)... 2024-02-28T22:58:01.582 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:01 smithi159 ceph-mon[28802]: Reconfiguring daemon ceph-exporter.smithi159 on smithi159 2024-02-28T22:58:01.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:01 smithi184 ceph-mon[36198]: Reconfiguring ceph-exporter.smithi159 (monmap changed)... 2024-02-28T22:58:01.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:01 smithi184 ceph-mon[36198]: Reconfiguring daemon ceph-exporter.smithi159 on smithi159 2024-02-28T22:58:02.210 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:58:02.639 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:02 smithi159 ceph-mon[28802]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:02.639 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:02 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:02.639 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:02 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:02.639 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:02 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T22:58:02.639 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:02 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:02.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:02 smithi184 ceph-mon[36198]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:02.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:02 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:02.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:02 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:02.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:02 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T22:58:02.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:02 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:03.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:03 smithi159 ceph-mon[28802]: Reconfiguring crash.smithi159 (monmap changed)... 2024-02-28T22:58:03.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:03 smithi159 ceph-mon[28802]: Reconfiguring daemon crash.smithi159 on smithi159 2024-02-28T22:58:03.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:03 smithi184 ceph-mon[36198]: Reconfiguring crash.smithi159 (monmap changed)... 2024-02-28T22:58:03.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:03 smithi184 ceph-mon[36198]: Reconfiguring daemon crash.smithi159 on smithi159 2024-02-28T22:58:04.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:04 smithi159 ceph-mon[28802]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:04.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:04 smithi184 ceph-mon[36198]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:04.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.911+0000 7fa116e00700 1 -- 172.21.15.159:0/1367371147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1101016a0 msgr2=0x7fa110103a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:58:04.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.911+0000 7fa116e00700 1 --2- 172.21.15.159:0/1367371147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1101016a0 0x7fa110103a90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fa100009910 tx=0x7fa100009c20 comp rx=0 tx=0).stop 2024-02-28T22:58:04.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.911+0000 7fa116e00700 1 -- 172.21.15.159:0/1367371147 shutdown_connections 2024-02-28T22:58:04.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.911+0000 7fa116e00700 1 --2- 172.21.15.159:0/1367371147 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa110103fd0 0x7fa1101063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:58:04.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.911+0000 7fa116e00700 1 --2- 172.21.15.159:0/1367371147 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1101016a0 0x7fa110103a90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:58:04.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.911+0000 7fa116e00700 1 -- 172.21.15.159:0/1367371147 >> 172.21.15.159:0/1367371147 conn(0x7fa1100fb030 msgr2=0x7fa1100fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:58:04.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.911+0000 7fa116e00700 1 -- 172.21.15.159:0/1367371147 shutdown_connections 2024-02-28T22:58:04.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.911+0000 7fa116e00700 1 -- 172.21.15.159:0/1367371147 wait complete. 2024-02-28T22:58:04.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.912+0000 7fa116e00700 1 Processor -- start 2024-02-28T22:58:04.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.913+0000 7fa116e00700 1 -- start start 2024-02-28T22:58:04.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.913+0000 7fa116e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1101016a0 0x7fa110196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:58:04.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.913+0000 7fa116e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa110103fd0 0x7fa110196850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:58:04.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.913+0000 7fa116e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa110196de0 con 0x7fa110103fd0 2024-02-28T22:58:04.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.913+0000 7fa116e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa110196f20 con 0x7fa1101016a0 2024-02-28T22:58:04.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.913+0000 7fa10f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa110103fd0 0x7fa110196850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:58:04.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.913+0000 7fa10f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa110103fd0 0x7fa110196850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45754/0 (socket says 172.21.15.159:45754) 2024-02-28T22:58:04.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.913+0000 7fa10f400700 1 -- 172.21.15.159:0/3244101827 learned_addr learned my addr 172.21.15.159:0/3244101827 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:58:04.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.914+0000 7fa10fe00700 1 --2- 172.21.15.159:0/3244101827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1101016a0 0x7fa110196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:58:04.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.914+0000 7fa10f400700 1 -- 172.21.15.159:0/3244101827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1101016a0 msgr2=0x7fa110196310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:58:04.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.914+0000 7fa10f400700 1 --2- 172.21.15.159:0/3244101827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1101016a0 0x7fa110196310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:58:04.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.914+0000 7fa10f400700 1 -- 172.21.15.159:0/3244101827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1000095f0 con 0x7fa110103fd0 2024-02-28T22:58:04.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.914+0000 7fa10f400700 1 --2- 172.21.15.159:0/3244101827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa110103fd0 0x7fa110196850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00c930 tx=0x7fa0fc00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:58:04.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.915+0000 7fa10cc00700 1 -- 172.21.15.159:0/3244101827 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0fc007ad0 con 0x7fa110103fd0 2024-02-28T22:58:04.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.915+0000 7fa10cc00700 1 -- 172.21.15.159:0/3244101827 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa0fc007c30 con 0x7fa110103fd0 2024-02-28T22:58:04.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.915+0000 7fa116e00700 1 -- 172.21.15.159:0/3244101827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11019b9e0 con 0x7fa110103fd0 2024-02-28T22:58:04.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.915+0000 7fa10cc00700 1 -- 172.21.15.159:0/3244101827 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa0fc018630 con 0x7fa110103fd0 2024-02-28T22:58:04.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.915+0000 7fa116e00700 1 -- 172.21.15.159:0/3244101827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11019bf00 con 0x7fa110103fd0 2024-02-28T22:58:04.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.917+0000 7fa116e00700 1 -- 172.21.15.159:0/3244101827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa110190520 con 0x7fa110103fd0 2024-02-28T22:58:04.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.917+0000 7fa10cc00700 1 -- 172.21.15.159:0/3244101827 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) v1 ==== 90258+0+0 (secure 0 0 0) 0x7fa0fc00f450 con 0x7fa110103fd0 2024-02-28T22:58:04.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.918+0000 7fa10cc00700 1 --2- 172.21.15.159:0/3244101827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa0f406c470 0x7fa0f406e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:58:04.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.919+0000 7fa10cc00700 1 -- 172.21.15.159:0/3244101827 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1370+0+0 (secure 0 0 0) 0x7fa0fc08a990 con 0x7fa110103fd0 2024-02-28T22:58:04.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.919+0000 7fa10fe00700 1 --2- 172.21.15.159:0/3244101827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa0f406c470 0x7fa0f406e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:58:04.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.920+0000 7fa10fe00700 1 --2- 172.21.15.159:0/3244101827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa0f406c470 0x7fa0f406e930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa100006010 tx=0x7fa10000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:58:04.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:04.924+0000 7fa10cc00700 1 -- 172.21.15.159:0/3244101827 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa0fc059c40 con 0x7fa110103fd0 2024-02-28T22:58:05.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:05.198+0000 7fa116e00700 1 -- 172.21.15.159:0/3244101827 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1100611d0 con 0x7fa0f406c470 2024-02-28T22:58:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:58:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T22:58:05.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T22:58:05.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:05.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:58:05.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T22:58:05.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T22:58:05.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:06.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:06 smithi159 ceph-mon[28802]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:06.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:06 smithi159 ceph-mon[28802]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:58:06.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:06 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:06.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:06 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:06 smithi184 ceph-mon[36198]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:06 smithi184 ceph-mon[36198]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:58:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:06 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:06 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:07.670 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:07 smithi159 ceph-mon[28802]: Reconfiguring alertmanager.smithi159 (dependencies changed)... 2024-02-28T22:58:07.670 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:07 smithi159 ceph-mon[28802]: Reconfiguring daemon alertmanager.smithi159 on smithi159 2024-02-28T22:58:07.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:07 smithi184 ceph-mon[36198]: Reconfiguring alertmanager.smithi159 (dependencies changed)... 2024-02-28T22:58:07.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:07 smithi184 ceph-mon[36198]: Reconfiguring daemon alertmanager.smithi159 on smithi159 2024-02-28T22:58:08.823 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:08 smithi159 ceph-mon[28802]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:08.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:08 smithi184 ceph-mon[36198]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:09.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:09 smithi184 ceph-mon[36198]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:09.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:09 smithi159 ceph-mon[28802]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:12.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:12 smithi159 ceph-mon[28802]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:12.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:12 smithi184 ceph-mon[36198]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:14.652 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:14 smithi184 ceph-mon[36198]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:14.653 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:14.653 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:14.653 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:14 smithi184 ceph-mon[36198]: Reconfiguring grafana.smithi159 (dependencies changed)... 2024-02-28T22:58:14.653 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:14 smithi184 ceph-mon[36198]: Reconfiguring daemon grafana.smithi159 on smithi159 2024-02-28T22:58:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:14 smithi159 ceph-mon[28802]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:14 smithi159 ceph-mon[28802]: Reconfiguring grafana.smithi159 (dependencies changed)... 2024-02-28T22:58:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:14 smithi159 ceph-mon[28802]: Reconfiguring daemon grafana.smithi159 on smithi159 2024-02-28T22:58:15.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:15 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1555030233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12a358ec-2348-437f-a587-c75299c13814"}]: dispatch 2024-02-28T22:58:15.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:15 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1555030233' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12a358ec-2348-437f-a587-c75299c13814"}]': finished 2024-02-28T22:58:15.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:15 smithi159 ceph-mon[28802]: osdmap e6: 1 total, 0 up, 1 in 2024-02-28T22:58:15.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:15 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T22:58:15.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:15 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1555030233' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "12a358ec-2348-437f-a587-c75299c13814"}]: dispatch 2024-02-28T22:58:15.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:15 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1555030233' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "12a358ec-2348-437f-a587-c75299c13814"}]': finished 2024-02-28T22:58:15.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:15 smithi184 ceph-mon[36198]: osdmap e6: 1 total, 0 up, 1 in 2024-02-28T22:58:15.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:15 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T22:58:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:16 smithi159 ceph-mon[28802]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:16 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/308655625' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T22:58:16.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:16 smithi184 ceph-mon[36198]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:16.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:16 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/308655625' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T22:58:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:18 smithi159 ceph-mon[28802]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:18.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:18 smithi184 ceph-mon[36198]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:20.665 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:20 smithi159 ceph-mon[28802]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:20.665 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:58:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:20 smithi184 ceph-mon[36198]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:58:22.642 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:22 smithi159 ceph-mon[28802]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:22.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:22 smithi184 ceph-mon[36198]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:24.660 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:24 smithi159 ceph-mon[28802]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:24.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:24 smithi184 ceph-mon[36198]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:26.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:26 smithi159 ceph-mon[28802]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:26.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:26 smithi184 ceph-mon[36198]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:28.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:28 smithi159 ceph-mon[28802]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:28.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:28.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:28.259 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:28 smithi159 ceph-mon[28802]: Reconfiguring prometheus.smithi159 (dependencies changed)... 2024-02-28T22:58:28.260 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:28 smithi159 ceph-mon[28802]: Reconfiguring daemon prometheus.smithi159 on smithi159 2024-02-28T22:58:28.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:28 smithi184 ceph-mon[36198]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:28.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:28.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:28.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:28 smithi184 ceph-mon[36198]: Reconfiguring prometheus.smithi159 (dependencies changed)... 2024-02-28T22:58:28.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:28 smithi184 ceph-mon[36198]: Reconfiguring daemon prometheus.smithi159 on smithi159 2024-02-28T22:58:29.392 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:29 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T22:58:29.392 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:29 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:29.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:29 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T22:58:29.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:29 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:30.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:30 smithi159 ceph-mon[28802]: Deploying daemon osd.0 on smithi159 2024-02-28T22:58:30.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:30 smithi159 ceph-mon[28802]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:30.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:30 smithi184 ceph-mon[36198]: Deploying daemon osd.0 on smithi159 2024-02-28T22:58:30.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:30 smithi184 ceph-mon[36198]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:32.362 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:32 smithi159 ceph-mon[28802]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:32.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:32 smithi184 ceph-mon[36198]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:34 smithi159 ceph-mon[28802]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:34.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:34 smithi184 ceph-mon[36198]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:35.829 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:35.829 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:35.829 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:35 smithi184 ceph-mon[36198]: Reconfiguring ceph-exporter.smithi184 (monmap changed)... 2024-02-28T22:58:35.830 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T22:58:35.830 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:35.830 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:35 smithi184 ceph-mon[36198]: Reconfiguring daemon ceph-exporter.smithi184 on smithi184 2024-02-28T22:58:35.830 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:35 smithi184 ceph-mon[36198]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:35.830 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:58:36.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:36.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:36.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:35 smithi159 ceph-mon[28802]: Reconfiguring ceph-exporter.smithi184 (monmap changed)... 2024-02-28T22:58:36.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T22:58:36.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:36.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:35 smithi159 ceph-mon[28802]: Reconfiguring daemon ceph-exporter.smithi184 on smithi184 2024-02-28T22:58:36.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:35 smithi159 ceph-mon[28802]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:36.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:58:37.719 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:37.719 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:37.719 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:37 smithi184 ceph-mon[36198]: Reconfiguring crash.smithi184 (monmap changed)... 2024-02-28T22:58:37.719 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T22:58:37.719 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:37.720 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:37 smithi184 ceph-mon[36198]: Reconfiguring daemon crash.smithi184 on smithi184 2024-02-28T22:58:37.720 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:37 smithi184 ceph-mon[36198]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:37.883 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:37.883 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:37.883 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:37 smithi159 ceph-mon[28802]: Reconfiguring crash.smithi184 (monmap changed)... 2024-02-28T22:58:37.883 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T22:58:37.883 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:37.883 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:37 smithi159 ceph-mon[28802]: Reconfiguring daemon crash.smithi184 on smithi184 2024-02-28T22:58:37.883 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:37 smithi159 ceph-mon[28802]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:39.742 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:39 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:39.742 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:39 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:39.742 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:39 smithi184 ceph-mon[36198]: Reconfiguring mgr.smithi184.quvmnx (monmap changed)... 2024-02-28T22:58:39.742 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:39 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.quvmnx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T22:58:39.742 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:39 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T22:58:39.742 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:39 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:39.742 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:39 smithi184 ceph-mon[36198]: Reconfiguring daemon mgr.smithi184.quvmnx on smithi184 2024-02-28T22:58:39.742 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:39 smithi184 ceph-mon[36198]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:39.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:39.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:39.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:39 smithi159 ceph-mon[28802]: Reconfiguring mgr.smithi184.quvmnx (monmap changed)... 2024-02-28T22:58:39.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.quvmnx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T22:58:39.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T22:58:39.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:39.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:39 smithi159 ceph-mon[28802]: Reconfiguring daemon mgr.smithi184.quvmnx on smithi184 2024-02-28T22:58:39.868 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:39 smithi159 ceph-mon[28802]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:41.655 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:41.655 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:41.655 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:41 smithi184 ceph-mon[36198]: Reconfiguring mon.smithi184 (monmap changed)... 2024-02-28T22:58:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:41 smithi159 ceph-mon[28802]: Reconfiguring mon.smithi184 (monmap changed)... 2024-02-28T22:58:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T22:58:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T22:58:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:41.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:41 smithi159 ceph-mon[28802]: Reconfiguring daemon mon.smithi184 on smithi184 2024-02-28T22:58:41.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:41 smithi159 ceph-mon[28802]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:42.037 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T22:58:42.038 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T22:58:42.038 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:42.038 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:41 smithi184 ceph-mon[36198]: Reconfiguring daemon mon.smithi184 on smithi184 2024-02-28T22:58:42.038 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:41 smithi184 ceph-mon[36198]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:43.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T22:58:43.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi159.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T22:58:43.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T22:58:43.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi159.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T22:58:43.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.564 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T22:58:43.564 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi159.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T22:58:43.564 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.564 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:58:43.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T22:58:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi159.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T22:58:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T22:58:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi159.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T22:58:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T22:58:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi159.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T22:58:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:58:44.596 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:44 smithi184 ceph-mon[36198]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T22:58:44.596 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:44 smithi184 ceph-mon[36198]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi159.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T22:58:44.596 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:44 smithi184 ceph-mon[36198]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T22:58:44.596 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:44 smithi184 ceph-mon[36198]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi159.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T22:58:44.596 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:44 smithi184 ceph-mon[36198]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T22:58:44.596 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:44 smithi184 ceph-mon[36198]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi159.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T22:58:44.596 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:44 smithi184 ceph-mon[36198]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:44.600 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:44 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T22:58:44.600 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:44 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi159.front.sepia.ceph.com:9093"}]: dispatch 2024-02-28T22:58:44.600 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:44 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T22:58:44.600 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:44 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi159.front.sepia.ceph.com:3000"}]: dispatch 2024-02-28T22:58:44.600 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:44 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T22:58:44.600 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:44 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi159.front.sepia.ceph.com:9095"}]: dispatch 2024-02-28T22:58:44.600 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:44 smithi159 ceph-mon[28802]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:46.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:46 smithi159 ceph-mon[28802]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:46.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:46 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:46.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:46 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:46.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:46 smithi159 ceph-mon[28802]: from='osd.0 [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T22:58:46.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:46 smithi184 ceph-mon[36198]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:46.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:46 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:46.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:46 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:46.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:46 smithi184 ceph-mon[36198]: from='osd.0 [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T22:58:46.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.643+0000 7fa10cc00700 1 -- 172.21.15.159:0/3244101827 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fa1100611d0 con 0x7fa0f406c470 2024-02-28T22:58:46.643 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 0 on host 'smithi159' 2024-02-28T22:58:46.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.646+0000 7fa116e00700 1 -- 172.21.15.159:0/3244101827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa0f406c470 msgr2=0x7fa0f406e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:58:46.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.646+0000 7fa116e00700 1 --2- 172.21.15.159:0/3244101827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa0f406c470 0x7fa0f406e930 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fa100006010 tx=0x7fa10000b540 comp rx=0 tx=0).stop 2024-02-28T22:58:46.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.646+0000 7fa116e00700 1 -- 172.21.15.159:0/3244101827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa110103fd0 msgr2=0x7fa110196850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:58:46.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.646+0000 7fa116e00700 1 --2- 172.21.15.159:0/3244101827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa110103fd0 0x7fa110196850 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc00c930 tx=0x7fa0fc00ccf0 comp rx=0 tx=0).stop 2024-02-28T22:58:46.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.647+0000 7fa116e00700 1 -- 172.21.15.159:0/3244101827 shutdown_connections 2024-02-28T22:58:46.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.647+0000 7fa116e00700 1 --2- 172.21.15.159:0/3244101827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1101016a0 0x7fa110196310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:58:46.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.647+0000 7fa116e00700 1 --2- 172.21.15.159:0/3244101827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa0f406c470 0x7fa0f406e930 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:58:46.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.647+0000 7fa116e00700 1 --2- 172.21.15.159:0/3244101827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa110103fd0 0x7fa110196850 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:58:46.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.647+0000 7fa116e00700 1 -- 172.21.15.159:0/3244101827 >> 172.21.15.159:0/3244101827 conn(0x7fa1100fb030 msgr2=0x7fa1100fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:58:46.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.647+0000 7fa116e00700 1 -- 172.21.15.159:0/3244101827 shutdown_connections 2024-02-28T22:58:46.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:46.647+0000 7fa116e00700 1 -- 172.21.15.159:0/3244101827 wait complete. 2024-02-28T22:58:47.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:47 smithi184 ceph-mon[36198]: from='osd.0 [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T22:58:47.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:47 smithi184 ceph-mon[36198]: osdmap e7: 1 total, 0 up, 1 in 2024-02-28T22:58:47.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:47 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T22:58:47.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:47 smithi184 ceph-mon[36198]: from='osd.0 [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T22:58:47.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:47 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:47.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:47 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:47 smithi159 ceph-mon[28802]: from='osd.0 [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T22:58:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:47 smithi159 ceph-mon[28802]: osdmap e7: 1 total, 0 up, 1 in 2024-02-28T22:58:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:47 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T22:58:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:47 smithi159 ceph-mon[28802]: from='osd.0 [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T22:58:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:47 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:47 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:48.271 DEBUG:teuthology.orchestra.run.smithi159:osd.0> sudo journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.0.service 2024-02-28T22:58:48.275 INFO:tasks.cephadm:Deploying osd.1 on smithi159 with /dev/vg_nvme/lv_3... 2024-02-28T22:58:48.276 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-28T22:58:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:48 smithi159 ceph-mon[28802]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:48 smithi159 ceph-mon[28802]: from='osd.0 [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-02-28T22:58:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:48 smithi159 ceph-mon[28802]: osdmap e8: 1 total, 0 up, 1 in 2024-02-28T22:58:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:48 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T22:58:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:48 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T22:58:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:48 smithi184 ceph-mon[36198]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:48 smithi184 ceph-mon[36198]: from='osd.0 [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-02-28T22:58:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:48 smithi184 ceph-mon[36198]: osdmap e8: 1 total, 0 up, 1 in 2024-02-28T22:58:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:48 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T22:58:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:48 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T22:58:49.009 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:58:49.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:49 smithi159 ceph-mon[28802]: purged_snaps scrub starts 2024-02-28T22:58:49.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:49 smithi159 ceph-mon[28802]: purged_snaps scrub ok 2024-02-28T22:58:49.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:49 smithi159 ceph-mon[28802]: osd.0 [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223] boot 2024-02-28T22:58:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:49 smithi159 ceph-mon[28802]: osdmap e9: 1 total, 1 up, 1 in 2024-02-28T22:58:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:49 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T22:58:49.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:49 smithi184 ceph-mon[36198]: purged_snaps scrub starts 2024-02-28T22:58:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:49 smithi184 ceph-mon[36198]: purged_snaps scrub ok 2024-02-28T22:58:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:49 smithi184 ceph-mon[36198]: osd.0 [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223] boot 2024-02-28T22:58:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:49 smithi184 ceph-mon[36198]: osdmap e9: 1 total, 1 up, 1 in 2024-02-28T22:58:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:49 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T22:58:50.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:50 smithi159 ceph-mon[28802]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:50.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:50 smithi159 ceph-mon[28802]: osdmap e10: 1 total, 1 up, 1 in 2024-02-28T22:58:50.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:58:50.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:50 smithi184 ceph-mon[36198]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-28T22:58:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:50 smithi184 ceph-mon[36198]: osdmap e10: 1 total, 1 up, 1 in 2024-02-28T22:58:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:58:52.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:52 smithi159 ceph-mon[28802]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:58:52.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:52 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:52.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:52 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:52.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:52 smithi184 ceph-mon[36198]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:58:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:52 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:52 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:52.830 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-28T22:58:52.830 INFO:teuthology.orchestra.run.smithi159.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-28T22:58:52.830 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10+0 records in 2024-02-28T22:58:52.830 INFO:teuthology.orchestra.run.smithi159.stderr:10+0 records out 2024-02-28T22:58:52.830 INFO:teuthology.orchestra.run.smithi159.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0568526 s, 184 MB/s 2024-02-28T22:58:52.830 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 2024-02-28T22:58:52.831 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping successful for: 2024-02-28T22:58:53.882 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi159:vg_nvme/lv_3 2024-02-28T22:58:54.393 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:54 smithi159 ceph-mon[28802]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:58:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:54 smithi184 ceph-mon[36198]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:58:55.496 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:58:56.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:56 smithi159 ceph-mon[28802]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:58:56.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:56 smithi184 ceph-mon[36198]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:58:58.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.194+0000 7f717d400700 1 -- 172.21.15.159:0/347464010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7178100bc0 msgr2=0x7f7178100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:58:58.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.194+0000 7f717d400700 1 --2- 172.21.15.159:0/347464010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7178100bc0 0x7f7178100fe0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7168009910 tx=0x7f7168009c20 comp rx=0 tx=0).stop 2024-02-28T22:58:58.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.194+0000 7f717d400700 1 -- 172.21.15.159:0/347464010 shutdown_connections 2024-02-28T22:58:58.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.194+0000 7f717d400700 1 --2- 172.21.15.159:0/347464010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7178101dc0 0x7f7178102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:58:58.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.194+0000 7f717d400700 1 --2- 172.21.15.159:0/347464010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7178100bc0 0x7f7178100fe0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:58:58.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.194+0000 7f717d400700 1 -- 172.21.15.159:0/347464010 >> 172.21.15.159:0/347464010 conn(0x7f71780fc140 msgr2=0x7f71780fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:58:58.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.194+0000 7f717d400700 1 -- 172.21.15.159:0/347464010 shutdown_connections 2024-02-28T22:58:58.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.194+0000 7f717d400700 1 -- 172.21.15.159:0/347464010 wait complete. 2024-02-28T22:58:58.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.195+0000 7f717d400700 1 Processor -- start 2024-02-28T22:58:58.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.195+0000 7f717d400700 1 -- start start 2024-02-28T22:58:58.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.196+0000 7f717d400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7178100bc0 0x7f7178196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:58:58.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.196+0000 7f717d400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7178101dc0 0x7f7178196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:58:58.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.196+0000 7f717d400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7178196f70 con 0x7f7178100bc0 2024-02-28T22:58:58.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.196+0000 7f717d400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71781970b0 con 0x7f7178101dc0 2024-02-28T22:58:58.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.196+0000 7f7176800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7178100bc0 0x7f7178196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:58:58.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.196+0000 7f7176800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7178100bc0 0x7f7178196410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55440/0 (socket says 172.21.15.159:55440) 2024-02-28T22:58:58.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.196+0000 7f7176800700 1 -- 172.21.15.159:0/3015838124 learned_addr learned my addr 172.21.15.159:0/3015838124 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:58:58.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.196+0000 7f716fe00700 1 --2- 172.21.15.159:0/3015838124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7178101dc0 0x7f7178196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:58:58.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.196+0000 7f7176800700 1 -- 172.21.15.159:0/3015838124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7178101dc0 msgr2=0x7f7178196950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:58:58.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.196+0000 7f7176800700 1 --2- 172.21.15.159:0/3015838124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7178101dc0 0x7f7178196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:58:58.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.196+0000 7f7176800700 1 -- 172.21.15.159:0/3015838124 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71680095f0 con 0x7f7178100bc0 2024-02-28T22:58:58.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.197+0000 7f7176800700 1 --2- 172.21.15.159:0/3015838124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7178100bc0 0x7f7178196410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f716800bd70 tx=0x7f716800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:58:58.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.197+0000 7f716f400700 1 -- 172.21.15.159:0/3015838124 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f716801d070 con 0x7f7178100bc0 2024-02-28T22:58:58.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.197+0000 7f716f400700 1 -- 172.21.15.159:0/3015838124 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f716800f460 con 0x7f7178100bc0 2024-02-28T22:58:58.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.197+0000 7f717d400700 1 -- 172.21.15.159:0/3015838124 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717819bb00 con 0x7f7178100bc0 2024-02-28T22:58:58.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.197+0000 7f716f400700 1 -- 172.21.15.159:0/3015838124 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7168021640 con 0x7f7178100bc0 2024-02-28T22:58:58.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.197+0000 7f717d400700 1 -- 172.21.15.159:0/3015838124 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717819c070 con 0x7f7178100bc0 2024-02-28T22:58:58.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.198+0000 7f717d400700 1 -- 172.21.15.159:0/3015838124 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71781097a0 con 0x7f7178100bc0 2024-02-28T22:58:58.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.199+0000 7f716f400700 1 -- 172.21.15.159:0/3015838124 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) v1 ==== 90258+0+0 (secure 0 0 0) 0x7f716800fab0 con 0x7f7178100bc0 2024-02-28T22:58:58.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.200+0000 7f716f400700 1 --2- 172.21.15.159:0/3015838124 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f715c06c470 0x7f715c06e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:58:58.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.200+0000 7f716f400700 1 -- 172.21.15.159:0/3015838124 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1982+0+0 (secure 0 0 0) 0x7f716808bdc0 con 0x7f7178100bc0 2024-02-28T22:58:58.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.200+0000 7f716fe00700 1 --2- 172.21.15.159:0/3015838124 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f715c06c470 0x7f715c06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:58:58.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.201+0000 7f716fe00700 1 --2- 172.21.15.159:0/3015838124 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f715c06c470 0x7f715c06e930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7160006fd0 tx=0x7f7160008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:58:58.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.205+0000 7f716f400700 1 -- 172.21.15.159:0/3015838124 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f716805ae90 con 0x7f7178100bc0 2024-02-28T22:58:58.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:58:58.434+0000 7f717d400700 1 -- 172.21.15.159:0/3015838124 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f7178106710 con 0x7f715c06c470 2024-02-28T22:58:58.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:58 smithi184 ceph-mon[36198]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:58:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:58 smithi159 ceph-mon[28802]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:58:59.609 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:59 smithi159 ceph-mon[28802]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:58:59.610 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T22:58:59.610 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T22:58:59.610 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:59.610 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:59.610 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:59.610 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T22:58:59.610 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:59.610 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:59.610 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T22:58:59.610 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:58:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:59 smithi184 ceph-mon[36198]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:58:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T22:58:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T22:58:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T22:58:59.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:58:59.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:58:59.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T22:58:59.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:58:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:00.648 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:00 smithi159 ceph-mon[28802]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:00.648 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:00 smithi159 ceph-mon[28802]: Detected new or changed devices on smithi159 2024-02-28T22:59:00.648 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:00 smithi159 ceph-mon[28802]: Adjusting osd_memory_target on smithi159 to 11843M 2024-02-28T22:59:00.648 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:00 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:59:00.754 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:00 smithi184 ceph-mon[36198]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:00.754 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:00 smithi184 ceph-mon[36198]: Detected new or changed devices on smithi159 2024-02-28T22:59:00.754 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:00 smithi184 ceph-mon[36198]: Adjusting osd_memory_target on smithi159 to 11843M 2024-02-28T22:59:00.754 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:00 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:59:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:02 smithi159 ceph-mon[28802]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:02 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2895744788' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34a65dc7-3bd8-4cb5-b61b-e04166f115c9"}]: dispatch 2024-02-28T22:59:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:02 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2895744788' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34a65dc7-3bd8-4cb5-b61b-e04166f115c9"}]': finished 2024-02-28T22:59:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:02 smithi159 ceph-mon[28802]: osdmap e11: 2 total, 1 up, 2 in 2024-02-28T22:59:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:02 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:02 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:02 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:02.738 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:02 smithi184 ceph-mon[36198]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:02.738 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:02 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2895744788' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "34a65dc7-3bd8-4cb5-b61b-e04166f115c9"}]: dispatch 2024-02-28T22:59:02.738 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:02 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2895744788' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "34a65dc7-3bd8-4cb5-b61b-e04166f115c9"}]': finished 2024-02-28T22:59:02.738 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:02 smithi184 ceph-mon[36198]: osdmap e11: 2 total, 1 up, 2 in 2024-02-28T22:59:02.738 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:02 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:02.738 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:02 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:02.739 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:02 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:03.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:03 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1325870854' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T22:59:03.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:03 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1325870854' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T22:59:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:04 smithi159 ceph-mon[28802]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:04.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:04 smithi184 ceph-mon[36198]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:05.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:59:05.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:59:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:06 smithi159 ceph-mon[28802]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:06 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:06 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:06 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:06.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:06 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T22:59:06.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:06 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:06 smithi184 ceph-mon[36198]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:06 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:06 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:06 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:06 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T22:59:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:06 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:08.549 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:08 smithi159 ceph-mon[28802]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:08.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:08 smithi184 ceph-mon[36198]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:10.712 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:10 smithi159 ceph-mon[28802]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:10.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:10 smithi184 ceph-mon[36198]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:12.707 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:12 smithi159 ceph-mon[28802]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:12.707 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:12 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T22:59:12.707 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:12 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:12.773 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:12 smithi184 ceph-mon[36198]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:12.773 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:12 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T22:59:12.773 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:12 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:13.705 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:13 smithi159 ceph-mon[28802]: Deploying daemon osd.1 on smithi159 2024-02-28T22:59:13.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:13 smithi184 ceph-mon[36198]: Deploying daemon osd.1 on smithi159 2024-02-28T22:59:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:14 smithi159 ceph-mon[28802]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:14.751 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:14 smithi184 ceph-mon[36198]: pgmap v63: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:16.553 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:16 smithi159 ceph-mon[28802]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:16.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:16 smithi184 ceph-mon[36198]: pgmap v64: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:18 smithi159 ceph-mon[28802]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:18.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:18 smithi184 ceph-mon[36198]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:20.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:20 smithi159 ceph-mon[28802]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:20.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:59:20.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:20.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:20.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:59:20.801 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:20 smithi184 ceph-mon[36198]: pgmap v66: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:20.802 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:59:20.802 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:20.802 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:20.802 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:59:22.753 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:22 smithi159 ceph-mon[28802]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:22.753 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:22 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:22.753 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:22 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:22.808 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:22 smithi184 ceph-mon[36198]: pgmap v67: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:22.809 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:22 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:22.809 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:22 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:24.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:24 smithi159 ceph-mon[28802]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:24.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:24 smithi159 ceph-mon[28802]: from='osd.1 [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T22:59:24.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:24 smithi184 ceph-mon[36198]: pgmap v68: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:24.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:24 smithi184 ceph-mon[36198]: from='osd.1 [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T22:59:24.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.922+0000 7f716f400700 1 -- 172.21.15.159:0/3015838124 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7178106710 con 0x7f715c06c470 2024-02-28T22:59:24.921 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 1 on host 'smithi159' 2024-02-28T22:59:24.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.924+0000 7f717d400700 1 -- 172.21.15.159:0/3015838124 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f715c06c470 msgr2=0x7f715c06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:59:24.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.924+0000 7f717d400700 1 --2- 172.21.15.159:0/3015838124 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f715c06c470 0x7f715c06e930 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7160006fd0 tx=0x7f7160008040 comp rx=0 tx=0).stop 2024-02-28T22:59:24.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.925+0000 7f717d400700 1 -- 172.21.15.159:0/3015838124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7178100bc0 msgr2=0x7f7178196410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:59:24.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.925+0000 7f717d400700 1 --2- 172.21.15.159:0/3015838124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7178100bc0 0x7f7178196410 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f716800bd70 tx=0x7f716800be50 comp rx=0 tx=0).stop 2024-02-28T22:59:24.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.925+0000 7f717d400700 1 -- 172.21.15.159:0/3015838124 shutdown_connections 2024-02-28T22:59:24.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.925+0000 7f717d400700 1 --2- 172.21.15.159:0/3015838124 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f715c06c470 0x7f715c06e930 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:59:24.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.925+0000 7f717d400700 1 --2- 172.21.15.159:0/3015838124 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7178100bc0 0x7f7178196410 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:59:24.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.925+0000 7f717d400700 1 --2- 172.21.15.159:0/3015838124 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7178101dc0 0x7f7178196950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:59:24.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.925+0000 7f717d400700 1 -- 172.21.15.159:0/3015838124 >> 172.21.15.159:0/3015838124 conn(0x7f71780fc140 msgr2=0x7f7178104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:59:24.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.925+0000 7f717d400700 1 -- 172.21.15.159:0/3015838124 shutdown_connections 2024-02-28T22:59:24.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:24.925+0000 7f717d400700 1 -- 172.21.15.159:0/3015838124 wait complete. 2024-02-28T22:59:25.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:25 smithi159 ceph-mon[28802]: from='osd.1 [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T22:59:25.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:25 smithi159 ceph-mon[28802]: osdmap e12: 2 total, 1 up, 2 in 2024-02-28T22:59:25.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:25 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:25.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:25 smithi159 ceph-mon[28802]: from='osd.1 [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T22:59:25.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:25 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:25.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:25 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:25.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:25 smithi159 ceph-mon[28802]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:25 smithi184 ceph-mon[36198]: from='osd.1 [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T22:59:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:25 smithi184 ceph-mon[36198]: osdmap e12: 2 total, 1 up, 2 in 2024-02-28T22:59:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:25 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:25 smithi184 ceph-mon[36198]: from='osd.1 [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T22:59:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:25 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:25 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:25 smithi184 ceph-mon[36198]: pgmap v70: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:26.000 DEBUG:teuthology.orchestra.run.smithi159:osd.1> sudo journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.1.service 2024-02-28T22:59:26.009 INFO:tasks.cephadm:Deploying osd.2 on smithi159 with /dev/vg_nvme/lv_2... 2024-02-28T22:59:26.009 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-28T22:59:26.461 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:59:26.609 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:26 smithi159 ceph-mon[28802]: from='osd.1 [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-02-28T22:59:26.609 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:26 smithi159 ceph-mon[28802]: osdmap e13: 2 total, 1 up, 2 in 2024-02-28T22:59:26.609 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:26 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:26.609 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:26 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:26.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:26 smithi184 ceph-mon[36198]: from='osd.1 [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-02-28T22:59:26.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:26 smithi184 ceph-mon[36198]: osdmap e13: 2 total, 1 up, 2 in 2024-02-28T22:59:26.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:26 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:26.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:26 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:27.826 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:27 smithi184 ceph-mon[36198]: purged_snaps scrub starts 2024-02-28T22:59:27.826 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:27 smithi184 ceph-mon[36198]: purged_snaps scrub ok 2024-02-28T22:59:27.826 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:27 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:27.827 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:27 smithi184 ceph-mon[36198]: osd.1 [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298] boot 2024-02-28T22:59:27.827 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:27 smithi184 ceph-mon[36198]: osdmap e14: 2 total, 2 up, 2 in 2024-02-28T22:59:27.827 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:27 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:27.827 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:27 smithi184 ceph-mon[36198]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:27.927 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:27 smithi159 ceph-mon[28802]: purged_snaps scrub starts 2024-02-28T22:59:27.927 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:27 smithi159 ceph-mon[28802]: purged_snaps scrub ok 2024-02-28T22:59:27.927 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:27 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:27.927 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:27 smithi159 ceph-mon[28802]: osd.1 [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298] boot 2024-02-28T22:59:27.927 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:27 smithi159 ceph-mon[28802]: osdmap e14: 2 total, 2 up, 2 in 2024-02-28T22:59:27.927 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:27 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T22:59:27.927 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:27 smithi159 ceph-mon[28802]: pgmap v73: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2024-02-28T22:59:28.601 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:28 smithi159 ceph-mon[28802]: osdmap e15: 2 total, 2 up, 2 in 2024-02-28T22:59:28.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:28 smithi184 ceph-mon[36198]: osdmap e15: 2 total, 2 up, 2 in 2024-02-28T22:59:29.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:29 smithi184 ceph-mon[36198]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:29.971 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:29 smithi159 ceph-mon[28802]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:30.291 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-28T22:59:30.291 INFO:teuthology.orchestra.run.smithi159.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-28T22:59:30.291 INFO:teuthology.orchestra.run.smithi159.stderr: stderr: 10+0 records in 2024-02-28T22:59:30.291 INFO:teuthology.orchestra.run.smithi159.stderr:10+0 records out 2024-02-28T22:59:30.291 INFO:teuthology.orchestra.run.smithi159.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.033941 s, 309 MB/s 2024-02-28T22:59:30.291 INFO:teuthology.orchestra.run.smithi159.stderr:--> Zapping successful for: 2024-02-28T22:59:31.060 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi159:vg_nvme/lv_2 2024-02-28T22:59:31.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:30 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:31.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:30 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:31.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:30 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:31.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:30 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:32.185 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:31 smithi159 ceph-mon[28802]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:32.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:31 smithi184 ceph-mon[36198]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:32.760 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T22:59:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:34 smithi159 ceph-mon[28802]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:34.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:34 smithi184 ceph-mon[36198]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:59:35.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:59:36.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.235+0000 7f00f4a00700 1 -- 172.21.15.159:0/3441002638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f0101640 msgr2=0x7f00f0103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:59:36.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.235+0000 7f00f4a00700 1 --2- 172.21.15.159:0/3441002638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f0101640 0x7f00f0103a30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009910 tx=0x7f00e0009c20 comp rx=0 tx=0).stop 2024-02-28T22:59:36.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.235+0000 7f00f4a00700 1 -- 172.21.15.159:0/3441002638 shutdown_connections 2024-02-28T22:59:36.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.235+0000 7f00f4a00700 1 --2- 172.21.15.159:0/3441002638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f0103f70 0x7f00f0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:59:36.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.236+0000 7f00f4a00700 1 --2- 172.21.15.159:0/3441002638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f0101640 0x7f00f0103a30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:59:36.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.236+0000 7f00f4a00700 1 -- 172.21.15.159:0/3441002638 >> 172.21.15.159:0/3441002638 conn(0x7f00f00fb030 msgr2=0x7f00f00fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T22:59:36.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.236+0000 7f00f4a00700 1 -- 172.21.15.159:0/3441002638 shutdown_connections 2024-02-28T22:59:36.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.236+0000 7f00f4a00700 1 -- 172.21.15.159:0/3441002638 wait complete. 2024-02-28T22:59:36.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.237+0000 7f00f4a00700 1 Processor -- start 2024-02-28T22:59:36.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.237+0000 7f00f4a00700 1 -- start start 2024-02-28T22:59:36.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.237+0000 7f00f4a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f0101640 0x7f00f0198500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:59:36.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.237+0000 7f00f4a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f0103f70 0x7f00f0198a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:59:36.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.237+0000 7f00f4a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f0199060 con 0x7f00f0103f70 2024-02-28T22:59:36.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.237+0000 7f00f4a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f01991a0 con 0x7f00f0101640 2024-02-28T22:59:36.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.237+0000 7f00e7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f0103f70 0x7f00f0198a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:59:36.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.237+0000 7f00e7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f0103f70 0x7f00f0198a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52276/0 (socket says 172.21.15.159:52276) 2024-02-28T22:59:36.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.237+0000 7f00e7e00700 1 -- 172.21.15.159:0/1917027354 learned_addr learned my addr 172.21.15.159:0/1917027354 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T22:59:36.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.238+0000 7f00ede00700 1 --2- 172.21.15.159:0/1917027354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f0101640 0x7f00f0198500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:59:36.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.238+0000 7f00e7e00700 1 -- 172.21.15.159:0/1917027354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f0101640 msgr2=0x7f00f0198500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T22:59:36.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.238+0000 7f00e7e00700 1 --2- 172.21.15.159:0/1917027354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f0101640 0x7f00f0198500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T22:59:36.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.238+0000 7f00e7e00700 1 -- 172.21.15.159:0/1917027354 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e00095f0 con 0x7f00f0103f70 2024-02-28T22:59:36.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.238+0000 7f00e7e00700 1 --2- 172.21.15.159:0/1917027354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f0103f70 0x7f00f0198a40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00d800e920 tx=0x7f00d800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:59:36.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.238+0000 7f00e6a00700 1 -- 172.21.15.159:0/1917027354 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00d800c9d0 con 0x7f00f0103f70 2024-02-28T22:59:36.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.239+0000 7f00f4a00700 1 -- 172.21.15.159:0/1917027354 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f019dc50 con 0x7f00f0103f70 2024-02-28T22:59:36.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.239+0000 7f00e6a00700 1 -- 172.21.15.159:0/1917027354 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f00d8010430 con 0x7f00f0103f70 2024-02-28T22:59:36.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.239+0000 7f00f4a00700 1 -- 172.21.15.159:0/1917027354 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f019e1a0 con 0x7f00f0103f70 2024-02-28T22:59:36.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.239+0000 7f00e6a00700 1 -- 172.21.15.159:0/1917027354 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00d8018650 con 0x7f00f0103f70 2024-02-28T22:59:36.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.241+0000 7f00dfe00700 1 -- 172.21.15.159:0/1917027354 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00cc005320 con 0x7f00f0103f70 2024-02-28T22:59:36.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.241+0000 7f00e6a00700 1 -- 172.21.15.159:0/1917027354 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) v1 ==== 90258+0+0 (secure 0 0 0) 0x7f00d8018910 con 0x7f00f0103f70 2024-02-28T22:59:36.241 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.242+0000 7f00e6a00700 1 --2- 172.21.15.159:0/1917027354 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f00d406c470 0x7f00d406e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T22:59:36.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.242+0000 7f00e6a00700 1 -- 172.21.15.159:0/1917027354 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2414+0+0 (secure 0 0 0) 0x7f00d8014070 con 0x7f00f0103f70 2024-02-28T22:59:36.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.243+0000 7f00ede00700 1 --2- 172.21.15.159:0/1917027354 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f00d406c470 0x7f00d406e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T22:59:36.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.243+0000 7f00ede00700 1 --2- 172.21.15.159:0/1917027354 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f00d406c470 0x7f00d406e930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00e000b6f0 tx=0x7f00e0005a90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T22:59:36.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.247+0000 7f00e6a00700 1 -- 172.21.15.159:0/1917027354 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f00d80520e0 con 0x7f00f0103f70 2024-02-28T22:59:36.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T22:59:36.471+0000 7f00dfe00700 1 -- 172.21.15.159:0/1917027354 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f00cc000bf0 con 0x7f00d406c470 2024-02-28T22:59:36.471 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:36 smithi159 ceph-mon[28802]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:36.471 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T22:59:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T22:59:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T22:59:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:59:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:36 smithi184 ceph-mon[36198]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T22:59:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T22:59:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T22:59:36.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:36.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:59:37.355 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:37 smithi159 ceph-mon[28802]: Detected new or changed devices on smithi159 2024-02-28T22:59:37.355 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:37 smithi159 ceph-mon[28802]: Adjusting osd_memory_target on smithi159 to 5921M 2024-02-28T22:59:37.355 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:37 smithi159 ceph-mon[28802]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:59:37.355 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T22:59:37.355 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T22:59:37.356 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:37.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:37 smithi184 ceph-mon[36198]: Detected new or changed devices on smithi159 2024-02-28T22:59:37.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:37 smithi184 ceph-mon[36198]: Adjusting osd_memory_target on smithi159 to 5921M 2024-02-28T22:59:37.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:37 smithi184 ceph-mon[36198]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi159:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T22:59:37.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T22:59:37.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T22:59:37.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:38.243 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:38 smithi159 ceph-mon[28802]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:38.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:38 smithi184 ceph-mon[36198]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:40.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:40.026 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:40.027 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:39 smithi159 ceph-mon[28802]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:40.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:39 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:40.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:39 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:40.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:39 smithi184 ceph-mon[36198]: pgmap v80: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:41.233 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:41 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3028883449' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a712ee56-f8b8-43c4-9f38-33ebe33b7977"}]: dispatch 2024-02-28T22:59:41.233 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:41 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3028883449' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a712ee56-f8b8-43c4-9f38-33ebe33b7977"}]': finished 2024-02-28T22:59:41.233 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:41 smithi159 ceph-mon[28802]: osdmap e16: 3 total, 2 up, 3 in 2024-02-28T22:59:41.233 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T22:59:41.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:41 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3028883449' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a712ee56-f8b8-43c4-9f38-33ebe33b7977"}]: dispatch 2024-02-28T22:59:41.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:41 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3028883449' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a712ee56-f8b8-43c4-9f38-33ebe33b7977"}]': finished 2024-02-28T22:59:41.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:41 smithi184 ceph-mon[36198]: osdmap e16: 3 total, 2 up, 3 in 2024-02-28T22:59:41.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T22:59:42.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:42 smithi184 ceph-mon[36198]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:43.497 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:42 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/624919159' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T22:59:43.498 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:42 smithi159 ceph-mon[28802]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:43.498 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:42 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/624919159' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T22:59:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:44 smithi159 ceph-mon[28802]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:44 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:44.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:44 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:44.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:44 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:44.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:44 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T22:59:44.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:44 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:44 smithi184 ceph-mon[36198]: pgmap v83: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:44 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:44 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:44 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:44 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T22:59:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:44 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:46 smithi159 ceph-mon[28802]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:46.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:46 smithi184 ceph-mon[36198]: pgmap v84: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:48.636 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:48 smithi159 ceph-mon[28802]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:48.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:48 smithi184 ceph-mon[36198]: pgmap v85: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:50 smithi159 ceph-mon[28802]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:59:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T22:59:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:50 smithi184 ceph-mon[36198]: pgmap v86: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T22:59:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T22:59:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T22:59:51.801 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:51 smithi159 ceph-mon[28802]: Deploying daemon osd.2 on smithi159 2024-02-28T22:59:51.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:51 smithi184 ceph-mon[36198]: Deploying daemon osd.2 on smithi159 2024-02-28T22:59:52.804 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:52 smithi159 ceph-mon[28802]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:52.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:52 smithi184 ceph-mon[36198]: pgmap v87: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:54.417 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:54 smithi159 ceph-mon[28802]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:54.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:54 smithi184 ceph-mon[36198]: pgmap v88: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:56.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:56 smithi159 ceph-mon[28802]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:56.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:56 smithi184 ceph-mon[36198]: pgmap v89: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:58.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:58 smithi159 ceph-mon[28802]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:58.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:58 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:58.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:58 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:58.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:58 smithi184 ceph-mon[36198]: pgmap v90: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T22:59:58.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:58 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:58.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:58 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T22:59:59.243 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 22:59:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T22:59:59.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 22:59:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:00:00.419 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:00 smithi159 ceph-mon[28802]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T23:00:00.419 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:00 smithi159 ceph-mon[28802]: overall HEALTH_OK 2024-02-28T23:00:00.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:00 smithi184 ceph-mon[36198]: pgmap v91: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T23:00:00.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:00 smithi184 ceph-mon[36198]: overall HEALTH_OK 2024-02-28T23:00:02.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:02 smithi159 ceph-mon[28802]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T23:00:02.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:02 smithi159 ceph-mon[28802]: from='osd.2 [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T23:00:02.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.575+0000 7f00e6a00700 1 -- 172.21.15.159:0/1917027354 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f00cc000bf0 con 0x7f00d406c470 2024-02-28T23:00:02.577 INFO:teuthology.orchestra.run.smithi159.stdout:Created osd(s) 2 on host 'smithi159' 2024-02-28T23:00:02.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.578+0000 7f00dfe00700 1 -- 172.21.15.159:0/1917027354 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f00d406c470 msgr2=0x7f00d406e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:00:02.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.578+0000 7f00dfe00700 1 --2- 172.21.15.159:0/1917027354 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f00d406c470 0x7f00d406e930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f00e000b6f0 tx=0x7f00e0005a90 comp rx=0 tx=0).stop 2024-02-28T23:00:02.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.578+0000 7f00dfe00700 1 -- 172.21.15.159:0/1917027354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f0103f70 msgr2=0x7f00f0198a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:00:02.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.578+0000 7f00dfe00700 1 --2- 172.21.15.159:0/1917027354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f0103f70 0x7f00f0198a40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f00d800e920 tx=0x7f00d800ec30 comp rx=0 tx=0).stop 2024-02-28T23:00:02.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.578+0000 7f00dfe00700 1 -- 172.21.15.159:0/1917027354 shutdown_connections 2024-02-28T23:00:02.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.578+0000 7f00dfe00700 1 --2- 172.21.15.159:0/1917027354 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f00f0101640 0x7f00f0198500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:02.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.578+0000 7f00dfe00700 1 --2- 172.21.15.159:0/1917027354 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f00d406c470 0x7f00d406e930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:02.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.578+0000 7f00dfe00700 1 --2- 172.21.15.159:0/1917027354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f00f0103f70 0x7f00f0198a40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:02.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.578+0000 7f00dfe00700 1 -- 172.21.15.159:0/1917027354 >> 172.21.15.159:0/1917027354 conn(0x7f00f00fb030 msgr2=0x7f00f00ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:00:02.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.579+0000 7f00dfe00700 1 -- 172.21.15.159:0/1917027354 shutdown_connections 2024-02-28T23:00:02.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:00:02.579+0000 7f00dfe00700 1 -- 172.21.15.159:0/1917027354 wait complete. 2024-02-28T23:00:02.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:02 smithi184 ceph-mon[36198]: pgmap v92: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T23:00:02.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:02 smithi184 ceph-mon[36198]: from='osd.2 [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T23:00:03.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:03 smithi159 ceph-mon[28802]: from='osd.2 [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T23:00:03.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:03 smithi159 ceph-mon[28802]: osdmap e17: 3 total, 2 up, 3 in 2024-02-28T23:00:03.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:03 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:00:03.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:03 smithi159 ceph-mon[28802]: from='osd.2 [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T23:00:03.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:03 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:03.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:03 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:03.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:03 smithi184 ceph-mon[36198]: from='osd.2 [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T23:00:03.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:03 smithi184 ceph-mon[36198]: osdmap e17: 3 total, 2 up, 3 in 2024-02-28T23:00:03.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:03 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:00:03.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:03 smithi184 ceph-mon[36198]: from='osd.2 [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T23:00:03.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:03 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:03.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:03 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:04.103 DEBUG:teuthology.orchestra.run.smithi159:osd.2> sudo journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.2.service 2024-02-28T23:00:04.109 INFO:tasks.cephadm:Deploying osd.3 on smithi184 with /dev/vg_nvme/lv_4... 2024-02-28T23:00:04.109 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-28T23:00:04.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:04 smithi159 ceph-mon[28802]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T23:00:04.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:04 smithi159 ceph-mon[28802]: from='osd.2 [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-02-28T23:00:04.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:04 smithi159 ceph-mon[28802]: osdmap e18: 3 total, 2 up, 3 in 2024-02-28T23:00:04.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:04 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:00:04.401 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:04 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:00:04.521 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi184/config 2024-02-28T23:00:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:04 smithi184 ceph-mon[36198]: pgmap v94: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2024-02-28T23:00:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:04 smithi184 ceph-mon[36198]: from='osd.2 [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]': finished 2024-02-28T23:00:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:04 smithi184 ceph-mon[36198]: osdmap e18: 3 total, 2 up, 3 in 2024-02-28T23:00:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:04 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:00:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:04 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:00:05.711 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:05 smithi184 ceph-mon[36198]: osd.2 [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459] boot 2024-02-28T23:00:05.711 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:05 smithi184 ceph-mon[36198]: osdmap e19: 3 total, 3 up, 3 in 2024-02-28T23:00:05.711 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:00:05.711 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:00:05.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:05 smithi159 ceph-mon[28802]: osd.2 [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459] boot 2024-02-28T23:00:05.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:05 smithi159 ceph-mon[28802]: osdmap e19: 3 total, 3 up, 3 in 2024-02-28T23:00:05.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:00:05.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:00:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:06 smithi184 ceph-mon[36198]: purged_snaps scrub starts 2024-02-28T23:00:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:06 smithi184 ceph-mon[36198]: purged_snaps scrub ok 2024-02-28T23:00:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:06 smithi184 ceph-mon[36198]: pgmap v97: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:06 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-28T23:00:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:06 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-28T23:00:06.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:06 smithi184 ceph-mon[36198]: osdmap e20: 3 total, 3 up, 3 in 2024-02-28T23:00:06.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:06 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-28T23:00:06.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:06 smithi159 ceph-mon[28802]: purged_snaps scrub starts 2024-02-28T23:00:06.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:06 smithi159 ceph-mon[28802]: purged_snaps scrub ok 2024-02-28T23:00:06.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:06 smithi159 ceph-mon[28802]: pgmap v97: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:06.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:06 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-02-28T23:00:06.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:06 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-02-28T23:00:06.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:06 smithi159 ceph-mon[28802]: osdmap e20: 3 total, 3 up, 3 in 2024-02-28T23:00:06.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:06 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-02-28T23:00:07.139 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-28T23:00:07.139 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-28T23:00:07.139 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-02-28T23:00:07.139 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-02-28T23:00:07.139 INFO:teuthology.orchestra.run.smithi184.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.032737 s, 320 MB/s 2024-02-28T23:00:07.139 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-02-28T23:00:07.844 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:07 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-28T23:00:07.844 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:07 smithi184 ceph-mon[36198]: osdmap e21: 3 total, 3 up, 3 in 2024-02-28T23:00:07.844 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:07 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:07.844 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:07 smithi184 ceph-mon[36198]: pgmap v100: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:07.844 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:07 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:07.961 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi184:vg_nvme/lv_4 2024-02-28T23:00:07.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:07 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-02-28T23:00:07.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:07 smithi159 ceph-mon[28802]: osdmap e21: 3 total, 3 up, 3 in 2024-02-28T23:00:07.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:07 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:07.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:07 smithi159 ceph-mon[28802]: pgmap v100: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:07.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:07 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:08.353 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi184/config 2024-02-28T23:00:08.472 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:00:07 smithi159 sudo[64963]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T23:00:08.473 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:00:07 smithi159 sudo[64963]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T23:00:08.473 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:00:07 smithi159 sudo[64963]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T23:00:08.473 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:00:07 smithi159 sudo[64963]: pam_unix(sudo:session): session closed for user root 2024-02-28T23:00:08.851 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:00:08 smithi159 sudo[65039]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T23:00:08.851 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:00:08 smithi159 sudo[65039]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T23:00:08.851 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:00:08 smithi159 sudo[65039]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T23:00:08.851 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:00:08 smithi159 sudo[65039]: pam_unix(sudo:session): session closed for user root 2024-02-28T23:00:09.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:09 smithi184 ceph-mon[36198]: osdmap e22: 3 total, 3 up, 3 in 2024-02-28T23:00:09.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:09 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:09.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:09 smithi159 ceph-mon[28802]: osdmap e22: 3 total, 3 up, 3 in 2024-02-28T23:00:09.152 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:09 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:09.473 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:00:09 smithi159 sudo[65094]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T23:00:09.473 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:00:09 smithi159 sudo[65094]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T23:00:09.473 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:00:09 smithi159 sudo[65094]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T23:00:09.473 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:00:09 smithi159 sudo[65094]: pam_unix(sudo:session): session closed for user root 2024-02-28T23:00:09.972 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:00:09 smithi159 sudo[65113]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T23:00:09.972 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:00:09 smithi159 sudo[65113]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T23:00:09.972 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:00:09 smithi159 sudo[65113]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T23:00:09.972 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:00:09 smithi159 sudo[65113]: pam_unix(sudo:session): session closed for user root 2024-02-28T23:00:10.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:10 smithi184 ceph-mon[36198]: pgmap v102: 1 pgs: 1 active+clean; 449 KiB data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:10.304 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:10 smithi159 ceph-mon[28802]: pgmap v102: 1 pgs: 1 active+clean; 449 KiB data, 79 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:10.325 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.327+0000 7fc09c800700 1 -- 172.21.15.184:0/1369434220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094100bc0 msgr2=0x7fc094100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:00:10.325 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.327+0000 7fc09c800700 1 --2- 172.21.15.184:0/1369434220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094100bc0 0x7fc094100fe0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fc088009870 tx=0x7fc088009b80 comp rx=0 tx=0).stop 2024-02-28T23:00:10.325 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.327+0000 7fc09c800700 1 -- 172.21.15.184:0/1369434220 shutdown_connections 2024-02-28T23:00:10.325 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.327+0000 7fc09c800700 1 --2- 172.21.15.184:0/1369434220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc094101dc0 0x7fc094102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:10.325 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.327+0000 7fc09c800700 1 --2- 172.21.15.184:0/1369434220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094100bc0 0x7fc094100fe0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:10.325 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.327+0000 7fc09c800700 1 -- 172.21.15.184:0/1369434220 >> 172.21.15.184:0/1369434220 conn(0x7fc0940fc140 msgr2=0x7fc0940fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:00:10.325 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.327+0000 7fc09c800700 1 -- 172.21.15.184:0/1369434220 shutdown_connections 2024-02-28T23:00:10.326 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.327+0000 7fc09c800700 1 -- 172.21.15.184:0/1369434220 wait complete. 2024-02-28T23:00:10.326 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.328+0000 7fc09c800700 1 Processor -- start 2024-02-28T23:00:10.326 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.328+0000 7fc09c800700 1 -- start start 2024-02-28T23:00:10.327 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.329+0000 7fc09c800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc094100bc0 0x7fc094196390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:00:10.327 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.329+0000 7fc09c800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094101dc0 0x7fc0941968d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:00:10.327 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.329+0000 7fc09c800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc094196ef0 con 0x7fc094100bc0 2024-02-28T23:00:10.327 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.329+0000 7fc09c800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc094197030 con 0x7fc094101dc0 2024-02-28T23:00:10.328 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.329+0000 7fc099400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094101dc0 0x7fc0941968d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:00:10.328 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.329+0000 7fc099e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc094100bc0 0x7fc094196390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:00:10.328 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.329+0000 7fc099400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094101dc0 0x7fc0941968d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:36622/0 (socket says 172.21.15.184:36622) 2024-02-28T23:00:10.328 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.329+0000 7fc099400700 1 -- 172.21.15.184:0/3112840911 learned_addr learned my addr 172.21.15.184:0/3112840911 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T23:00:10.328 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.329+0000 7fc099400700 1 -- 172.21.15.184:0/3112840911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc094100bc0 msgr2=0x7fc094196390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:00:10.328 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.330+0000 7fc099400700 1 --2- 172.21.15.184:0/3112840911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc094100bc0 0x7fc094196390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:10.328 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.330+0000 7fc099400700 1 -- 172.21.15.184:0/3112840911 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc088009520 con 0x7fc094101dc0 2024-02-28T23:00:10.329 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.330+0000 7fc099400700 1 --2- 172.21.15.184:0/3112840911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094101dc0 0x7fc0941968d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc08400e940 tx=0x7fc08400ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:00:10.329 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.330+0000 7fc08ea00700 1 -- 172.21.15.184:0/3112840911 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc084004a00 con 0x7fc094101dc0 2024-02-28T23:00:10.329 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.330+0000 7fc08ea00700 1 -- 172.21.15.184:0/3112840911 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc08400cc70 con 0x7fc094101dc0 2024-02-28T23:00:10.329 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.330+0000 7fc08ea00700 1 -- 172.21.15.184:0/3112840911 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc0840055b0 con 0x7fc094101dc0 2024-02-28T23:00:10.330 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.330+0000 7fc09c800700 1 -- 172.21.15.184:0/3112840911 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc09419bae0 con 0x7fc094101dc0 2024-02-28T23:00:10.330 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.330+0000 7fc09c800700 1 -- 172.21.15.184:0/3112840911 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc09419c0b0 con 0x7fc094101dc0 2024-02-28T23:00:10.330 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.331+0000 7fc09c800700 1 -- 172.21.15.184:0/3112840911 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc094109720 con 0x7fc094101dc0 2024-02-28T23:00:10.330 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.332+0000 7fc08ea00700 1 -- 172.21.15.184:0/3112840911 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fc08400c7c0 con 0x7fc094101dc0 2024-02-28T23:00:10.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.333+0000 7fc08ea00700 1 --2- 172.21.15.184:0/3112840911 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc07c06c4e0 0x7fc07c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:00:10.331 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.333+0000 7fc08ea00700 1 -- 172.21.15.184:0/3112840911 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3232+0+0 (secure 0 0 0) 0x7fc084014070 con 0x7fc094101dc0 2024-02-28T23:00:10.332 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.333+0000 7fc099e00700 1 --2- 172.21.15.184:0/3112840911 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc07c06c4e0 0x7fc07c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:00:10.332 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.334+0000 7fc099e00700 1 --2- 172.21.15.184:0/3112840911 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc07c06c4e0 0x7fc07c06e9a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc08800b6f0 tx=0x7fc088019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:00:10.336 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.339+0000 7fc08ea00700 1 -- 172.21.15.184:0/3112840911 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc084059c90 con 0x7fc094101dc0 2024-02-28T23:00:10.557 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:10.559+0000 7fc09c800700 1 -- 172.21.15.184:0/3112840911 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc094106710 con 0x7fc07c06c4e0 2024-02-28T23:00:10.610 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:00:10 smithi159 sudo[65125]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T23:00:10.610 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:00:10 smithi159 sudo[65125]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T23:00:10.610 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:00:10 smithi159 sudo[65125]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T23:00:10.610 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:00:10 smithi159 sudo[65125]: pam_unix(sudo:session): session closed for user root 2024-02-28T23:00:11.222 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:00:10 smithi159 sudo[65146]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T23:00:11.223 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:00:10 smithi159 sudo[65146]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T23:00:11.223 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:00:10 smithi159 sudo[65146]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T23:00:11.223 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:00:10 smithi159 sudo[65146]: pam_unix(sudo:session): session closed for user root 2024-02-28T23:00:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:11 smithi159 sudo[65169]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T23:00:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:11 smithi159 sudo[65169]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T23:00:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:11 smithi159 sudo[65169]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T23:00:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:11 smithi159 sudo[65169]: pam_unix(sudo:session): session closed for user root 2024-02-28T23:00:12.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:12 smithi159 sudo[67441]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T23:00:12.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:12 smithi159 sudo[67441]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T23:00:12.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:12 smithi159 sudo[67441]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T23:00:12.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:12 smithi159 sudo[67441]: pam_unix(sudo:session): session closed for user root 2024-02-28T23:00:12.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:12 smithi159 ceph-mon[28802]: mgrmap e19: smithi159.pobewk(active, since 3m), standbys: smithi184.quvmnx 2024-02-28T23:00:12.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:12 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T23:00:12.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:12 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T23:00:12.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:12 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:12.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:12 smithi159 ceph-mon[28802]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T23:00:12.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:12 smithi184 ceph-mon[36198]: mgrmap e19: smithi159.pobewk(active, since 3m), standbys: smithi184.quvmnx 2024-02-28T23:00:12.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:12 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T23:00:12.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:12 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T23:00:12.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:12 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:12.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:12 smithi184 ceph-mon[36198]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T23:00:12.634 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:12 smithi184 sudo[40081]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-02-28T23:00:12.634 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:12 smithi184 sudo[40081]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T23:00:12.634 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:12 smithi184 sudo[40081]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T23:00:12.634 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:12 smithi184 sudo[40081]: pam_unix(sudo:session): session closed for user root 2024-02-28T23:00:13.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:13 smithi184 sudo[40090]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-02-28T23:00:13.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:13 smithi184 sudo[40090]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-02-28T23:00:13.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:13 smithi184 sudo[40090]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-02-28T23:00:13.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:13 smithi184 sudo[40090]: pam_unix(sudo:session): session closed for user root 2024-02-28T23:00:13.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:13 smithi184 ceph-mon[36198]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:00:13.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:13 smithi184 ceph-mon[36198]: pgmap v103: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:13.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:13 smithi184 ceph-mon[36198]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T23:00:13.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:13 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:00:13.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:13 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:00:13.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:13 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:00:13.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:13 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:00:13.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:13 smithi159 ceph-mon[28802]: from='client.24125 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:00:13.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:13 smithi159 ceph-mon[28802]: pgmap v103: 1 pgs: 1 active+clean; 449 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:13.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:13 smithi159 ceph-mon[28802]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T23:00:13.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:13 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:00:13.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:13 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:00:13.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:13 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:00:13.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:13 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:00:14.431 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T23:00:14.431 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: Detected new or changed devices on smithi159 2024-02-28T23:00:14.431 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 105 KiB/s wr, 6 op/s 2024-02-28T23:00:14.431 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T23:00:14.431 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:14.431 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:14.431 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: Adjusting osd_memory_target on smithi159 to 3947M 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='client.? 172.21.15.184:0/1421385546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb2d95db-29e3-4e8d-bcea-ed52ae538c48"}]: dispatch 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb2d95db-29e3-4e8d-bcea-ed52ae538c48"}]: dispatch 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb2d95db-29e3-4e8d-bcea-ed52ae538c48"}]': finished 2024-02-28T23:00:14.432 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: osdmap e23: 4 total, 3 up, 4 in 2024-02-28T23:00:14.433 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:00:14.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: Detected new or changed devices on smithi159 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 105 KiB/s wr, 6 op/s 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: Adjusting osd_memory_target on smithi159 to 3947M 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:00:14.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:14.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:14.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:00:14.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/1421385546' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb2d95db-29e3-4e8d-bcea-ed52ae538c48"}]: dispatch 2024-02-28T23:00:14.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb2d95db-29e3-4e8d-bcea-ed52ae538c48"}]: dispatch 2024-02-28T23:00:14.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb2d95db-29e3-4e8d-bcea-ed52ae538c48"}]': finished 2024-02-28T23:00:14.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: osdmap e23: 4 total, 3 up, 4 in 2024-02-28T23:00:14.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:00:15.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:15 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/3438841807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T23:00:15.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:15 smithi184 ceph-mon[36198]: from='client.? 172.21.15.184:0/3438841807' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T23:00:16.471 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:16 smithi159 ceph-mon[28802]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 75 KiB/s wr, 4 op/s 2024-02-28T23:00:16.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:16 smithi184 ceph-mon[36198]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.3 KiB/s rd, 75 KiB/s wr, 4 op/s 2024-02-28T23:00:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:18 smithi159 ceph-mon[28802]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1 KiB/s rd, 58 KiB/s wr, 3 op/s 2024-02-28T23:00:18.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:18 smithi184 ceph-mon[36198]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1 KiB/s rd, 58 KiB/s wr, 3 op/s 2024-02-28T23:00:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:20 smithi184 ceph-mon[36198]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-02-28T23:00:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:00:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:00:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:20 smithi159 ceph-mon[28802]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-02-28T23:00:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:00:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:00:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:22 smithi159 ceph-mon[28802]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-02-28T23:00:22.722 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:22 smithi184 ceph-mon[36198]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-02-28T23:00:23.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T23:00:23.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T23:00:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:24.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:24 smithi159 ceph-mon[28802]: Deploying daemon osd.3 on smithi184 2024-02-28T23:00:24.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:24 smithi159 ceph-mon[28802]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T23:00:24.803 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:24 smithi184 ceph-mon[36198]: Deploying daemon osd.3 on smithi184 2024-02-28T23:00:24.803 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:24 smithi184 ceph-mon[36198]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-02-28T23:00:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:26 smithi184 ceph-mon[36198]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 70 KiB/s wr, 5 op/s 2024-02-28T23:00:26.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:26 smithi159 ceph-mon[28802]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.6 KiB/s rd, 70 KiB/s wr, 5 op/s 2024-02-28T23:00:28.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:28 smithi184 ceph-mon[36198]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-28T23:00:28.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:28 smithi159 ceph-mon[28802]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-28T23:00:30.473 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:30 smithi184 ceph-mon[36198]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-28T23:00:30.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:30 smithi159 ceph-mon[28802]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-02-28T23:00:31.783 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:31.783 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:31.783 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:00:31.783 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:31 smithi184 ceph-mon[36198]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:32.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:32.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:32.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:00:32.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:31 smithi159 ceph-mon[28802]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:34.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:34 smithi184 ceph-mon[36198]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:34 smithi159 ceph-mon[28802]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:35.253 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.253+0000 7fc08ea00700 1 -- 172.21.15.184:0/3112840911 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc094106710 con 0x7fc07c06c4e0 2024-02-28T23:00:35.253 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 3 on host 'smithi184' 2024-02-28T23:00:35.257 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.257+0000 7fc09c800700 1 -- 172.21.15.184:0/3112840911 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc07c06c4e0 msgr2=0x7fc07c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:00:35.257 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.257+0000 7fc09c800700 1 --2- 172.21.15.184:0/3112840911 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc07c06c4e0 0x7fc07c06e9a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc08800b6f0 tx=0x7fc088019040 comp rx=0 tx=0).stop 2024-02-28T23:00:35.257 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.257+0000 7fc09c800700 1 -- 172.21.15.184:0/3112840911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094101dc0 msgr2=0x7fc0941968d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:00:35.257 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.257+0000 7fc09c800700 1 --2- 172.21.15.184:0/3112840911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094101dc0 0x7fc0941968d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fc08400e940 tx=0x7fc08400ec50 comp rx=0 tx=0).stop 2024-02-28T23:00:35.257 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.257+0000 7fc09c800700 1 -- 172.21.15.184:0/3112840911 shutdown_connections 2024-02-28T23:00:35.257 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.257+0000 7fc09c800700 1 --2- 172.21.15.184:0/3112840911 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc07c06c4e0 0x7fc07c06e9a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:35.257 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.257+0000 7fc09c800700 1 --2- 172.21.15.184:0/3112840911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc094100bc0 0x7fc094196390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:35.257 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.257+0000 7fc09c800700 1 --2- 172.21.15.184:0/3112840911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc094101dc0 0x7fc0941968d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:35.257 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.257+0000 7fc09c800700 1 -- 172.21.15.184:0/3112840911 >> 172.21.15.184:0/3112840911 conn(0x7fc0940fc140 msgr2=0x7fc094104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:00:35.257 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.258+0000 7fc09c800700 1 -- 172.21.15.184:0/3112840911 shutdown_connections 2024-02-28T23:00:35.258 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:35.258+0000 7fc09c800700 1 -- 172.21.15.184:0/3112840911 wait complete. 2024-02-28T23:00:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:35 smithi159 ceph-mon[28802]: from='osd.3 [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T23:00:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:35 smithi159 ceph-mon[28802]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T23:00:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:00:35.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:35 smithi184 ceph-mon[36198]: from='osd.3 [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T23:00:35.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:35 smithi184 ceph-mon[36198]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T23:00:35.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:00:36.038 DEBUG:teuthology.orchestra.run.smithi184:osd.3> sudo journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.3.service 2024-02-28T23:00:36.045 INFO:tasks.cephadm:Deploying osd.4 on smithi184 with /dev/vg_nvme/lv_3... 2024-02-28T23:00:36.045 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-28T23:00:36.242 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-mon[36198]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:36.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-mon[36198]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T23:00:36.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-mon[36198]: osdmap e24: 4 total, 3 up, 4 in 2024-02-28T23:00:36.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:00:36.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-mon[36198]: from='osd.3 [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:00:36.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:36.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-mon[36198]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:00:36.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:36.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:36.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:36 smithi159 ceph-mon[28802]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:36.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:36 smithi159 ceph-mon[28802]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T23:00:36.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:36 smithi159 ceph-mon[28802]: osdmap e24: 4 total, 3 up, 4 in 2024-02-28T23:00:36.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:00:36.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:36 smithi159 ceph-mon[28802]: from='osd.3 [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:00:36.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:36.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:36 smithi159 ceph-mon[28802]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:00:36.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:36.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:36.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:36 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:36.584 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[42257]: 2024-02-28T23:00:36.242+0000 7f8b17400700 -1 osd.3 0 waiting for initial osdmap 2024-02-28T23:00:36.585 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:00:36 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[42257]: 2024-02-28T23:00:36.252+0000 7f8b11800700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T23:00:37.100 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi184/config 2024-02-28T23:00:37.549 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:37 smithi184 ceph-mon[36198]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-28T23:00:37.549 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:37 smithi184 ceph-mon[36198]: osdmap e25: 4 total, 3 up, 4 in 2024-02-28T23:00:37.550 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:00:37.550 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:00:37.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:37 smithi159 ceph-mon[28802]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-28T23:00:37.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:37 smithi159 ceph-mon[28802]: osdmap e25: 4 total, 3 up, 4 in 2024-02-28T23:00:37.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:00:37.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:00:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:38 smithi184 ceph-mon[36198]: purged_snaps scrub starts 2024-02-28T23:00:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:38 smithi184 ceph-mon[36198]: purged_snaps scrub ok 2024-02-28T23:00:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:38 smithi184 ceph-mon[36198]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:38 smithi184 ceph-mon[36198]: osd.3 [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213] boot 2024-02-28T23:00:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:38 smithi184 ceph-mon[36198]: osdmap e26: 4 total, 4 up, 4 in 2024-02-28T23:00:38.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:38 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:00:38.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:38 smithi184 ceph-mon[36198]: osdmap e27: 4 total, 4 up, 4 in 2024-02-28T23:00:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:38 smithi159 ceph-mon[28802]: purged_snaps scrub starts 2024-02-28T23:00:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:38 smithi159 ceph-mon[28802]: purged_snaps scrub ok 2024-02-28T23:00:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:38 smithi159 ceph-mon[28802]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2024-02-28T23:00:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:38 smithi159 ceph-mon[28802]: osd.3 [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213] boot 2024-02-28T23:00:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:38 smithi159 ceph-mon[28802]: osdmap e26: 4 total, 4 up, 4 in 2024-02-28T23:00:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:38 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:00:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:38 smithi159 ceph-mon[28802]: osdmap e27: 4 total, 4 up, 4 in 2024-02-28T23:00:40.450 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-28T23:00:40.451 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-28T23:00:40.451 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-02-28T23:00:40.451 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-02-28T23:00:40.451 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.032082 s, 327 MB/s 2024-02-28T23:00:40.451 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-02-28T23:00:40.451 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:40 smithi184 ceph-mon[36198]: pgmap v122: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:00:40.451 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:40 smithi184 ceph-mon[36198]: osdmap e28: 4 total, 4 up, 4 in 2024-02-28T23:00:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:40 smithi159 ceph-mon[28802]: pgmap v122: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:00:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:40 smithi159 ceph-mon[28802]: osdmap e28: 4 total, 4 up, 4 in 2024-02-28T23:00:41.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:41 smithi184 ceph-mon[36198]: osdmap e29: 4 total, 4 up, 4 in 2024-02-28T23:00:41.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:41.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:41.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:00:41.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:41.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:41.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:00:41.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:41.493 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:41 smithi159 ceph-mon[28802]: osdmap e29: 4 total, 4 up, 4 in 2024-02-28T23:00:41.493 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:41.493 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:41.493 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:00:41.493 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:41.493 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:41.493 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:00:41.493 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:41.708 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi184:vg_nvme/lv_3 2024-02-28T23:00:42.081 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi184/config 2024-02-28T23:00:42.492 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:42 smithi184 ceph-mon[36198]: pgmap v125: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:00:42.493 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:42 smithi184 ceph-mon[36198]: Detected new or changed devices on smithi184 2024-02-28T23:00:42.493 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:42 smithi184 ceph-mon[36198]: Adjusting osd_memory_target on smithi184 to 14915M 2024-02-28T23:00:42.493 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:42 smithi184 ceph-mon[36198]: osdmap e30: 4 total, 4 up, 4 in 2024-02-28T23:00:42.493 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:42 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:00:42.493 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:42 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:42.493 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:42 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:00:42.493 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:42 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:42 smithi159 ceph-mon[28802]: pgmap v125: 1 pgs: 1 remapped+peering; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:00:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:42 smithi159 ceph-mon[28802]: Detected new or changed devices on smithi184 2024-02-28T23:00:42.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:42 smithi159 ceph-mon[28802]: Adjusting osd_memory_target on smithi184 to 14915M 2024-02-28T23:00:42.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:42 smithi159 ceph-mon[28802]: osdmap e30: 4 total, 4 up, 4 in 2024-02-28T23:00:42.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:42 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:00:42.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:42 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:42.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:42 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:00:42.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:42 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:00:44.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.119+0000 7f3b0ec00700 1 -- 172.21.15.184:0/525839463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b08101db0 msgr2=0x7f3b08102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:00:44.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.119+0000 7f3b0ec00700 1 --2- 172.21.15.184:0/525839463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b08101db0 0x7f3b08102210 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3af4009910 tx=0x7f3af4009c20 comp rx=0 tx=0).stop 2024-02-28T23:00:44.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.119+0000 7f3b0ec00700 1 -- 172.21.15.184:0/525839463 shutdown_connections 2024-02-28T23:00:44.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.119+0000 7f3b0ec00700 1 --2- 172.21.15.184:0/525839463 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b08101db0 0x7f3b08102210 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:44.119 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.120+0000 7f3b0ec00700 1 --2- 172.21.15.184:0/525839463 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b08100bb0 0x7f3b08100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:44.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.120+0000 7f3b0ec00700 1 -- 172.21.15.184:0/525839463 >> 172.21.15.184:0/525839463 conn(0x7f3b080fc110 msgr2=0x7f3b080fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:00:44.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.120+0000 7f3b0ec00700 1 -- 172.21.15.184:0/525839463 shutdown_connections 2024-02-28T23:00:44.120 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.120+0000 7f3b0ec00700 1 -- 172.21.15.184:0/525839463 wait complete. 2024-02-28T23:00:44.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.121+0000 7f3b0ec00700 1 Processor -- start 2024-02-28T23:00:44.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.121+0000 7f3b0ec00700 1 -- start start 2024-02-28T23:00:44.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.121+0000 7f3b0ec00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b08100bb0 0x7f3b08198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:00:44.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.121+0000 7f3b0ec00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b08101db0 0x7f3b08198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:00:44.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.121+0000 7f3b0ec00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b08199080 con 0x7f3b08100bb0 2024-02-28T23:00:44.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.121+0000 7f3b0ec00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b081991c0 con 0x7f3b08101db0 2024-02-28T23:00:44.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.121+0000 7f3b07400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b08101db0 0x7f3b08198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:00:44.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.121+0000 7f3b07400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b08101db0 0x7f3b08198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:33398/0 (socket says 172.21.15.184:33398) 2024-02-28T23:00:44.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.121+0000 7f3b07400700 1 -- 172.21.15.184:0/2854749486 learned_addr learned my addr 172.21.15.184:0/2854749486 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T23:00:44.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.122+0000 7f3b07e00700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b08100bb0 0x7f3b08198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:00:44.122 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.122+0000 7f3b07400700 1 -- 172.21.15.184:0/2854749486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b08100bb0 msgr2=0x7f3b08198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:00:44.123 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.122+0000 7f3b07400700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b08100bb0 0x7f3b08198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:00:44.123 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.122+0000 7f3b07400700 1 -- 172.21.15.184:0/2854749486 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af40095f0 con 0x7f3b08101db0 2024-02-28T23:00:44.123 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.122+0000 7f3b07e00700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b08100bb0 0x7f3b08198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:00:44.123 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.122+0000 7f3b07400700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b08101db0 0x7f3b08198a60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3af400b5c0 tx=0x7f3af400be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:00:44.123 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.122+0000 7f3b04c00700 1 -- 172.21.15.184:0/2854749486 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3af401d070 con 0x7f3b08101db0 2024-02-28T23:00:44.123 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.122+0000 7f3b0ec00700 1 -- 172.21.15.184:0/2854749486 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b0819dc10 con 0x7f3b08101db0 2024-02-28T23:00:44.123 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.122+0000 7f3b04c00700 1 -- 172.21.15.184:0/2854749486 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3af400f460 con 0x7f3b08101db0 2024-02-28T23:00:44.123 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.123+0000 7f3b04c00700 1 -- 172.21.15.184:0/2854749486 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3af4021640 con 0x7f3b08101db0 2024-02-28T23:00:44.123 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.123+0000 7f3b0ec00700 1 -- 172.21.15.184:0/2854749486 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0819e100 con 0x7f3b08101db0 2024-02-28T23:00:44.123 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.124+0000 7f3b0ec00700 1 -- 172.21.15.184:0/2854749486 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b08105e90 con 0x7f3b08101db0 2024-02-28T23:00:44.124 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.125+0000 7f3b04c00700 1 -- 172.21.15.184:0/2854749486 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f3af400f5d0 con 0x7f3b08101db0 2024-02-28T23:00:44.125 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.126+0000 7f3b04c00700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3aec06c4e0 0x7f3aec06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:00:44.125 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.126+0000 7f3b04c00700 1 -- 172.21.15.184:0/2854749486 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f3af408c500 con 0x7f3b08101db0 2024-02-28T23:00:44.126 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.127+0000 7f3b07e00700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3aec06c4e0 0x7f3aec06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:00:44.126 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.128+0000 7f3b07e00700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3aec06c4e0 0x7f3aec06e9a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3af8005fd0 tx=0x7f3af8005f00 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:00:44.130 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.131+0000 7f3b04c00700 1 -- 172.21.15.184:0/2854749486 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3af405adf0 con 0x7f3b08101db0 2024-02-28T23:00:44.354 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:00:44.355+0000 7f3b0ec00700 1 -- 172.21.15.184:0/2854749486 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b080611d0 con 0x7f3aec06c4e0 2024-02-28T23:00:44.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:44 smithi184 ceph-mon[36198]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-02-28T23:00:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:44 smithi159 ceph-mon[28802]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 120 KiB/s, 0 objects/s recovering 2024-02-28T23:00:45.468 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:45 smithi184 ceph-mon[36198]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:00:45.468 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:45 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T23:00:45.468 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:45 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T23:00:45.468 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:45 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:45 smithi159 ceph-mon[28802]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:00:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:45 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T23:00:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:45 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T23:00:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:45 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:46.514 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:46 smithi184 ceph-mon[36198]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-28T23:00:46.592 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:46 smithi159 ceph-mon[28802]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-02-28T23:00:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:48 smithi184 ceph-mon[36198]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-02-28T23:00:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:48 smithi184 ceph-mon[36198]: from='client.? 172.21.15.184:0/2976444187' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55d22d45-549c-4a55-8a36-7aa785561068"}]: dispatch 2024-02-28T23:00:48.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:48 smithi184 ceph-mon[36198]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55d22d45-549c-4a55-8a36-7aa785561068"}]: dispatch 2024-02-28T23:00:48.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:48 smithi184 ceph-mon[36198]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55d22d45-549c-4a55-8a36-7aa785561068"}]': finished 2024-02-28T23:00:48.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:48 smithi184 ceph-mon[36198]: osdmap e31: 5 total, 4 up, 5 in 2024-02-28T23:00:48.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:48 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:00:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:48 smithi159 ceph-mon[28802]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-02-28T23:00:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:48 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/2976444187' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55d22d45-549c-4a55-8a36-7aa785561068"}]: dispatch 2024-02-28T23:00:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:48 smithi159 ceph-mon[28802]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "55d22d45-549c-4a55-8a36-7aa785561068"}]: dispatch 2024-02-28T23:00:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:48 smithi159 ceph-mon[28802]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "55d22d45-549c-4a55-8a36-7aa785561068"}]': finished 2024-02-28T23:00:48.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:48 smithi159 ceph-mon[28802]: osdmap e31: 5 total, 4 up, 5 in 2024-02-28T23:00:48.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:48 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:00:49.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:49 smithi184 ceph-mon[36198]: from='client.? 172.21.15.184:0/371270411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T23:00:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:49 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/371270411' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T23:00:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:50 smithi184 ceph-mon[36198]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-28T23:00:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:00:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:50 smithi159 ceph-mon[28802]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-02-28T23:00:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:00:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:52 smithi184 ceph-mon[36198]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-02-28T23:00:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:52 smithi159 ceph-mon[28802]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-02-28T23:00:54.334 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:54 smithi184 ceph-mon[36198]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:00:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:54 smithi159 ceph-mon[28802]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:00:56.511 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:56 smithi184 ceph-mon[36198]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:00:56.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:56 smithi159 ceph-mon[28802]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:00:57.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:57 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T23:00:57.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:57 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:57.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:57 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T23:00:57.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:57 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:00:58.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:58 smithi184 ceph-mon[36198]: Deploying daemon osd.4 on smithi184 2024-02-28T23:00:58.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:00:58 smithi184 ceph-mon[36198]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:00:58.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:58 smithi159 ceph-mon[28802]: Deploying daemon osd.4 on smithi184 2024-02-28T23:00:58.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:00:58 smithi159 ceph-mon[28802]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:00.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:00 smithi184 ceph-mon[36198]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:00 smithi159 ceph-mon[28802]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:02.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:02 smithi184 ceph-mon[36198]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:02 smithi159 ceph-mon[28802]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:04.595 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:04 smithi184 ceph-mon[36198]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:04 smithi159 ceph-mon[28802]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:06.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:06.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:06.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:01:06.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:05 smithi184 ceph-mon[36198]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:06.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:01:06.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:06.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:06.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:01:06.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:05 smithi159 ceph-mon[28802]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:06.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:01:08.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:08 smithi184 ceph-mon[36198]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:08.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:08 smithi159 ceph-mon[28802]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:09.525 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:09 smithi184 ceph-mon[36198]: from='osd.4 [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T23:01:09.525 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:09 smithi184 ceph-mon[36198]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T23:01:09.612 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.611+0000 7f3b04c00700 1 -- 172.21.15.184:0/2854749486 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3b080611d0 con 0x7f3aec06c4e0 2024-02-28T23:01:09.612 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 4 on host 'smithi184' 2024-02-28T23:01:09.613 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.614+0000 7f3b0ec00700 1 -- 172.21.15.184:0/2854749486 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3aec06c4e0 msgr2=0x7f3aec06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:09.613 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.614+0000 7f3b0ec00700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3aec06c4e0 0x7f3aec06e9a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3af8005fd0 tx=0x7f3af8005f00 comp rx=0 tx=0).stop 2024-02-28T23:01:09.613 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.614+0000 7f3b0ec00700 1 -- 172.21.15.184:0/2854749486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b08101db0 msgr2=0x7f3b08198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:09.613 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.614+0000 7f3b0ec00700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b08101db0 0x7f3b08198a60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3af400b5c0 tx=0x7f3af400be20 comp rx=0 tx=0).stop 2024-02-28T23:01:09.613 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.615+0000 7f3b0ec00700 1 -- 172.21.15.184:0/2854749486 shutdown_connections 2024-02-28T23:01:09.614 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.615+0000 7f3b0ec00700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3aec06c4e0 0x7f3aec06e9a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:09.614 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.615+0000 7f3b0ec00700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b08100bb0 0x7f3b08198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:09.614 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.615+0000 7f3b0ec00700 1 --2- 172.21.15.184:0/2854749486 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3b08101db0 0x7f3b08198a60 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3af400b5c0 tx=0x7f3af400be20 comp rx=0 tx=0).stop 2024-02-28T23:01:09.614 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.615+0000 7f3b0ec00700 1 -- 172.21.15.184:0/2854749486 >> 172.21.15.184:0/2854749486 conn(0x7f3b080fc110 msgr2=0x7f3b08102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:01:09.614 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.615+0000 7f3b0ec00700 1 -- 172.21.15.184:0/2854749486 shutdown_connections 2024-02-28T23:01:09.614 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:09.615+0000 7f3b0ec00700 1 -- 172.21.15.184:0/2854749486 wait complete. 2024-02-28T23:01:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:09 smithi159 ceph-mon[28802]: from='osd.4 [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T23:01:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:09 smithi159 ceph-mon[28802]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T23:01:10.259 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:10 smithi184 ceph-mon[36198]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:10.260 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:10 smithi184 ceph-mon[36198]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T23:01:10.260 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:10 smithi184 ceph-mon[36198]: osdmap e32: 5 total, 4 up, 5 in 2024-02-28T23:01:10.260 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:10 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:01:10.260 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:10 smithi184 ceph-mon[36198]: from='osd.4 [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:01:10.260 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:10 smithi184 ceph-mon[36198]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:01:10.260 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:10 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:10.260 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:10 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:10.260 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:10 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:10.260 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:10 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:10.377 DEBUG:teuthology.orchestra.run.smithi184:osd.4> sudo journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.4.service 2024-02-28T23:01:10.383 INFO:tasks.cephadm:Deploying osd.5 on smithi184 with /dev/vg_nvme/lv_2... 2024-02-28T23:01:10.383 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-28T23:01:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:10 smithi159 ceph-mon[28802]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:10 smithi159 ceph-mon[28802]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T23:01:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:10 smithi159 ceph-mon[28802]: osdmap e32: 5 total, 4 up, 5 in 2024-02-28T23:01:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:10 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:01:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:10 smithi159 ceph-mon[28802]: from='osd.4 [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:01:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:10 smithi159 ceph-mon[28802]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:01:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:10 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:10 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:10 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:10 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:10.781 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi184/config 2024-02-28T23:01:11.572 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:11 smithi184 ceph-mon[36198]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-28T23:01:11.573 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:11 smithi184 ceph-mon[36198]: osdmap e33: 5 total, 4 up, 5 in 2024-02-28T23:01:11.573 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:11 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:01:11.573 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:11 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:01:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:11 smithi159 ceph-mon[28802]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-28T23:01:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:11 smithi159 ceph-mon[28802]: osdmap e33: 5 total, 4 up, 5 in 2024-02-28T23:01:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:11 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:01:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:11 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:01:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:12 smithi159 ceph-mon[28802]: purged_snaps scrub starts 2024-02-28T23:01:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:12 smithi159 ceph-mon[28802]: purged_snaps scrub ok 2024-02-28T23:01:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:12 smithi159 ceph-mon[28802]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:12 smithi159 ceph-mon[28802]: osd.4 [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914] boot 2024-02-28T23:01:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:12 smithi159 ceph-mon[28802]: osdmap e34: 5 total, 5 up, 5 in 2024-02-28T23:01:12.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:12 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:01:12.523 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:12 smithi184 ceph-mon[36198]: purged_snaps scrub starts 2024-02-28T23:01:12.524 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:12 smithi184 ceph-mon[36198]: purged_snaps scrub ok 2024-02-28T23:01:12.524 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:12 smithi184 ceph-mon[36198]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2024-02-28T23:01:12.524 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:12 smithi184 ceph-mon[36198]: osd.4 [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914] boot 2024-02-28T23:01:12.524 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:12 smithi184 ceph-mon[36198]: osdmap e34: 5 total, 5 up, 5 in 2024-02-28T23:01:12.524 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:12 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:01:13.229 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-28T23:01:13.229 INFO:teuthology.orchestra.run.smithi184.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-28T23:01:13.229 INFO:teuthology.orchestra.run.smithi184.stderr: stderr: 10+0 records in 2024-02-28T23:01:13.229 INFO:teuthology.orchestra.run.smithi184.stderr:10+0 records out 2024-02-28T23:01:13.229 INFO:teuthology.orchestra.run.smithi184.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0381801 s, 275 MB/s 2024-02-28T23:01:13.229 INFO:teuthology.orchestra.run.smithi184.stderr:--> Zapping successful for: 2024-02-28T23:01:13.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:13 smithi184 ceph-mon[36198]: osdmap e35: 5 total, 5 up, 5 in 2024-02-28T23:01:13.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:13 smithi159 ceph-mon[28802]: osdmap e35: 5 total, 5 up, 5 in 2024-02-28T23:01:13.987 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph orch daemon add osd smithi184:vg_nvme/lv_2 2024-02-28T23:01:14.599 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi184/config 2024-02-28T23:01:14.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:14 smithi184 ceph-mon[36198]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:14.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:14 smithi159 ceph-mon[28802]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:16.562 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:16 smithi184 ceph-mon[36198]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:16 smithi159 ceph-mon[28802]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:17.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.182+0000 7f11fc200700 1 -- 172.21.15.184:0/2913125447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f4103f70 msgr2=0x7f11f41043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:17.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.182+0000 7f11fc200700 1 --2- 172.21.15.184:0/2913125447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f4103f70 0x7f11f41043f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f11e4009910 tx=0x7f11e4009c20 comp rx=0 tx=0).stop 2024-02-28T23:01:17.181 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.182+0000 7f11fc200700 1 -- 172.21.15.184:0/2913125447 shutdown_connections 2024-02-28T23:01:17.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.182+0000 7f11fc200700 1 --2- 172.21.15.184:0/2913125447 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f4103f70 0x7f11f41043f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:17.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.182+0000 7f11fc200700 1 --2- 172.21.15.184:0/2913125447 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f4102e10 0x7f11f4103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:17.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.182+0000 7f11fc200700 1 -- 172.21.15.184:0/2913125447 >> 172.21.15.184:0/2913125447 conn(0x7f11f40fe3d0 msgr2=0x7f11f41007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:01:17.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.183+0000 7f11fc200700 1 -- 172.21.15.184:0/2913125447 shutdown_connections 2024-02-28T23:01:17.182 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.183+0000 7f11fc200700 1 -- 172.21.15.184:0/2913125447 wait complete. 2024-02-28T23:01:17.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.184+0000 7f11fc200700 1 Processor -- start 2024-02-28T23:01:17.183 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.184+0000 7f11fc200700 1 -- start start 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.185+0000 7f11fc200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f4102e10 0x7f11f4198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.185+0000 7f11fc200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f4103f70 0x7f11f4198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.185+0000 7f11fc200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f41990a0 con 0x7f11f4103f70 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.185+0000 7f11fc200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11f41991e0 con 0x7f11f4102e10 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.185+0000 7f11f9800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f4102e10 0x7f11f4198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.185+0000 7f11f9800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f4102e10 0x7f11f4198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:44988/0 (socket says 172.21.15.184:44988) 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.185+0000 7f11f9800700 1 -- 172.21.15.184:0/899649567 learned_addr learned my addr 172.21.15.184:0/899649567 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.185+0000 7f11f8e00700 1 --2- 172.21.15.184:0/899649567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f4103f70 0x7f11f4198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.185+0000 7f11f9800700 1 -- 172.21.15.184:0/899649567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f4103f70 msgr2=0x7f11f4198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.185+0000 7f11f9800700 1 --2- 172.21.15.184:0/899649567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f4103f70 0x7f11f4198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.185+0000 7f11f9800700 1 -- 172.21.15.184:0/899649567 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e40095f0 con 0x7f11f4102e10 2024-02-28T23:01:17.184 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.186+0000 7f11f9800700 1 --2- 172.21.15.184:0/899649567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f4102e10 0x7f11f4198540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c8a0 tx=0x7f11e800cc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:01:17.185 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.186+0000 7f11f2000700 1 -- 172.21.15.184:0/899649567 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11e800cea0 con 0x7f11f4102e10 2024-02-28T23:01:17.185 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.186+0000 7f11f2000700 1 -- 172.21.15.184:0/899649567 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f11e8004830 con 0x7f11f4102e10 2024-02-28T23:01:17.185 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.186+0000 7f11fc200700 1 -- 172.21.15.184:0/899649567 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11f419dc90 con 0x7f11f4102e10 2024-02-28T23:01:17.185 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.186+0000 7f11f2000700 1 -- 172.21.15.184:0/899649567 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f11e80055b0 con 0x7f11f4102e10 2024-02-28T23:01:17.185 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.186+0000 7f11fc200700 1 -- 172.21.15.184:0/899649567 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11f419e190 con 0x7f11f4102e10 2024-02-28T23:01:17.185 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.187+0000 7f11fc200700 1 -- 172.21.15.184:0/899649567 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11f410b8f0 con 0x7f11f4102e10 2024-02-28T23:01:17.186 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.188+0000 7f11f2000700 1 -- 172.21.15.184:0/899649567 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f11e8007ad0 con 0x7f11f4102e10 2024-02-28T23:01:17.187 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.189+0000 7f11f2000700 1 --2- 172.21.15.184:0/899649567 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f11dc06c4e0 0x7f11dc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:17.187 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.189+0000 7f11f2000700 1 -- 172.21.15.184:0/899649567 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 4206+0+0 (secure 0 0 0) 0x7f11e808af80 con 0x7f11f4102e10 2024-02-28T23:01:17.187 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.190+0000 7f11f8e00700 1 --2- 172.21.15.184:0/899649567 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f11dc06c4e0 0x7f11dc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:17.189 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.191+0000 7f11f8e00700 1 --2- 172.21.15.184:0/899649567 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f11dc06c4e0 0x7f11dc06e9a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f11e4006010 tx=0x7f11e400b580 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:01:17.192 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.194+0000 7f11f2000700 1 -- 172.21.15.184:0/899649567 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f11e8059760 con 0x7f11f4102e10 2024-02-28T23:01:17.421 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:17.422+0000 7f11fc200700 1 -- 172.21.15.184:0/899649567 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f11f4108950 con 0x7f11dc06c4e0 2024-02-28T23:01:18.580 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:18.580 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:01:18.580 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T23:01:18.580 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T23:01:18.580 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:18.580 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:18.581 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:18.581 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:01:18.581 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:01:18.581 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:18.581 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:18.581 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:01:18.581 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:18.581 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:01:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi184:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:01:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-02-28T23:01:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-28T23:01:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:18.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:01:18.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:01:18.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:18.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:18.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:01:18.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:18.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:01:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:19 smithi184 ceph-mon[36198]: Detected new or changed devices on smithi184 2024-02-28T23:01:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:19 smithi184 ceph-mon[36198]: Adjusting osd_memory_target on smithi184 to 7457M 2024-02-28T23:01:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:19 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:19 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:01:19.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:19 smithi159 ceph-mon[28802]: Detected new or changed devices on smithi184 2024-02-28T23:01:19.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:19 smithi159 ceph-mon[28802]: Adjusting osd_memory_target on smithi184 to 7457M 2024-02-28T23:01:19.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:19 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:19.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:19 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:01:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:20 smithi184 ceph-mon[36198]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:01:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:20 smithi159 ceph-mon[28802]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:01:21.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:21 smithi184 ceph-mon[36198]: from='client.? 172.21.15.184:0/2497529048' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7"}]: dispatch 2024-02-28T23:01:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:21 smithi184 ceph-mon[36198]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7"}]: dispatch 2024-02-28T23:01:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:21 smithi184 ceph-mon[36198]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7"}]': finished 2024-02-28T23:01:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:21 smithi184 ceph-mon[36198]: osdmap e36: 6 total, 5 up, 6 in 2024-02-28T23:01:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:21 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:01:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:21 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/2497529048' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7"}]: dispatch 2024-02-28T23:01:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:21 smithi159 ceph-mon[28802]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7"}]: dispatch 2024-02-28T23:01:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:21 smithi159 ceph-mon[28802]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7"}]': finished 2024-02-28T23:01:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:21 smithi159 ceph-mon[28802]: osdmap e36: 6 total, 5 up, 6 in 2024-02-28T23:01:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:21 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:01:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:22 smithi159 ceph-mon[28802]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:22 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/2378025703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T23:01:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:22 smithi184 ceph-mon[36198]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:22 smithi184 ceph-mon[36198]: from='client.? 172.21.15.184:0/2378025703' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-28T23:01:24.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:24 smithi159 ceph-mon[28802]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:24.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:24 smithi184 ceph-mon[36198]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:26.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:26 smithi159 ceph-mon[28802]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:26.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:26 smithi184 ceph-mon[36198]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:28.434 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:28 smithi184 ceph-mon[36198]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:28.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:28 smithi159 ceph-mon[28802]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:30.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:30 smithi159 ceph-mon[28802]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:30.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:30 smithi184 ceph-mon[36198]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:31.633 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T23:01:31.633 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:31.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T23:01:31.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:32.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:32 smithi159 ceph-mon[28802]: Deploying daemon osd.5 on smithi184 2024-02-28T23:01:32.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:32 smithi159 ceph-mon[28802]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:32.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:32 smithi184 ceph-mon[36198]: Deploying daemon osd.5 on smithi184 2024-02-28T23:01:32.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:32 smithi184 ceph-mon[36198]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:34.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:34 smithi184 ceph-mon[36198]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:34 smithi159 ceph-mon[28802]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:35.712 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:01:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:01:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:36 smithi159 ceph-mon[28802]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:36.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:36 smithi184 ceph-mon[36198]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:38.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:38 smithi184 ceph-mon[36198]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:38 smithi159 ceph-mon[28802]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:39.587 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:39 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:39.587 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:39 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:39.587 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:39 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:01:39.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:39.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:39.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:39 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:01:40.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:40 smithi184 ceph-mon[36198]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:40.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:40 smithi159 ceph-mon[28802]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:41.811 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:41 smithi184 ceph-mon[36198]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:41.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:41 smithi159 ceph-mon[28802]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:42.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:42 smithi184 ceph-mon[36198]: from='osd.5 [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T23:01:42.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:42 smithi184 ceph-mon[36198]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T23:01:42.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:42 smithi159 ceph-mon[28802]: from='osd.5 [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T23:01:42.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:42 smithi159 ceph-mon[28802]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T23:01:43.477 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.479+0000 7f11f2000700 1 -- 172.21.15.184:0/899649567 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f11f4108950 con 0x7f11dc06c4e0 2024-02-28T23:01:43.478 INFO:teuthology.orchestra.run.smithi184.stdout:Created osd(s) 5 on host 'smithi184' 2024-02-28T23:01:43.483 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.483+0000 7f11fc200700 1 -- 172.21.15.184:0/899649567 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f11dc06c4e0 msgr2=0x7f11dc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:43.483 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.483+0000 7f11fc200700 1 --2- 172.21.15.184:0/899649567 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f11dc06c4e0 0x7f11dc06e9a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f11e4006010 tx=0x7f11e400b580 comp rx=0 tx=0).stop 2024-02-28T23:01:43.484 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.483+0000 7f11fc200700 1 -- 172.21.15.184:0/899649567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f4102e10 msgr2=0x7f11f4198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:43.484 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.483+0000 7f11fc200700 1 --2- 172.21.15.184:0/899649567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f4102e10 0x7f11f4198540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f11e800c8a0 tx=0x7f11e800cc60 comp rx=0 tx=0).stop 2024-02-28T23:01:43.484 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.484+0000 7f11fc200700 1 -- 172.21.15.184:0/899649567 shutdown_connections 2024-02-28T23:01:43.484 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.484+0000 7f11fc200700 1 --2- 172.21.15.184:0/899649567 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f11f4102e10 0x7f11f4198540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:43.484 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.484+0000 7f11fc200700 1 --2- 172.21.15.184:0/899649567 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f11dc06c4e0 0x7f11dc06e9a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:43.484 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.484+0000 7f11fc200700 1 --2- 172.21.15.184:0/899649567 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f11f4103f70 0x7f11f4198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:43.484 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.484+0000 7f11fc200700 1 -- 172.21.15.184:0/899649567 >> 172.21.15.184:0/899649567 conn(0x7f11f40fe3d0 msgr2=0x7f11f4107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:01:43.485 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.484+0000 7f11fc200700 1 -- 172.21.15.184:0/899649567 shutdown_connections 2024-02-28T23:01:43.485 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:01:43.485+0000 7f11fc200700 1 -- 172.21.15.184:0/899649567 wait complete. 2024-02-28T23:01:43.838 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:43 smithi184 ceph-mon[36198]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T23:01:43.838 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:43 smithi184 ceph-mon[36198]: osdmap e37: 6 total, 5 up, 6 in 2024-02-28T23:01:43.838 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:01:43.838 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:43 smithi184 ceph-mon[36198]: from='osd.5 [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:01:43.838 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:43 smithi184 ceph-mon[36198]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:01:43.838 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:43 smithi184 ceph-mon[36198]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:43.839 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:43.839 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:43 smithi159 ceph-mon[28802]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T23:01:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:43 smithi159 ceph-mon[28802]: osdmap e37: 6 total, 5 up, 6 in 2024-02-28T23:01:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:01:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:43 smithi159 ceph-mon[28802]: from='osd.5 [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:01:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:43 smithi159 ceph-mon[28802]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:01:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:43 smithi159 ceph-mon[28802]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:43.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:43.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:44.243 DEBUG:teuthology.orchestra.run.smithi184:osd.5> sudo journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.5.service 2024-02-28T23:01:44.248 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-02-28T23:01:44.249 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd stat -f json 2024-02-28T23:01:44.680 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:01:44.898 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:44 smithi184 ceph-mon[36198]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-28T23:01:44.898 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:44 smithi184 ceph-mon[36198]: osdmap e38: 6 total, 5 up, 6 in 2024-02-28T23:01:44.898 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:44 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:01:44.898 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:44 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:01:44.898 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:44 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:44.898 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:44 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:44.901 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:44 smithi159 ceph-mon[28802]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]': finished 2024-02-28T23:01:44.901 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:44 smithi159 ceph-mon[28802]: osdmap e38: 6 total, 5 up, 6 in 2024-02-28T23:01:44.901 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:44 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:01:44.901 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:44 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:01:44.901 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:44 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:44.901 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:44 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:45.835 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:45 smithi184 ceph-mon[36198]: purged_snaps scrub starts 2024-02-28T23:01:45.836 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:45 smithi184 ceph-mon[36198]: purged_snaps scrub ok 2024-02-28T23:01:45.836 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:45 smithi184 ceph-mon[36198]: osd.5 [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927] boot 2024-02-28T23:01:45.836 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:45 smithi184 ceph-mon[36198]: osdmap e39: 6 total, 6 up, 6 in 2024-02-28T23:01:45.836 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:45 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:01:45.836 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:45 smithi184 ceph-mon[36198]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:45.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:45 smithi159 ceph-mon[28802]: purged_snaps scrub starts 2024-02-28T23:01:45.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:45 smithi159 ceph-mon[28802]: purged_snaps scrub ok 2024-02-28T23:01:45.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:45 smithi159 ceph-mon[28802]: osd.5 [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927] boot 2024-02-28T23:01:45.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:45 smithi159 ceph-mon[28802]: osdmap e39: 6 total, 6 up, 6 in 2024-02-28T23:01:45.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:45 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:01:45.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:45 smithi159 ceph-mon[28802]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2024-02-28T23:01:46.828 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:46 smithi159 ceph-mon[28802]: osdmap e40: 6 total, 6 up, 6 in 2024-02-28T23:01:46.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:46 smithi184 ceph-mon[36198]: osdmap e40: 6 total, 6 up, 6 in 2024-02-28T23:01:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.992+0000 7f655fa00700 1 -- 172.21.15.159:0/1862351163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65580737f0 msgr2=0x7f6558073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.992+0000 7f655fa00700 1 --2- 172.21.15.159:0/1862351163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65580737f0 0x7f6558073c70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6544009910 tx=0x7f6544009c20 comp rx=0 tx=0).stop 2024-02-28T23:01:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.992+0000 7f655fa00700 1 -- 172.21.15.159:0/1862351163 shutdown_connections 2024-02-28T23:01:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.993+0000 7f655fa00700 1 --2- 172.21.15.159:0/1862351163 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f65580737f0 0x7f6558073c70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.993+0000 7f655fa00700 1 --2- 172.21.15.159:0/1862351163 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6558074dc0 0x7f6558073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:46.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.993+0000 7f655fa00700 1 -- 172.21.15.159:0/1862351163 >> 172.21.15.159:0/1862351163 conn(0x7f65580fc140 msgr2=0x7f65580fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:01:46.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.993+0000 7f655fa00700 1 -- 172.21.15.159:0/1862351163 shutdown_connections 2024-02-28T23:01:46.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.993+0000 7f655fa00700 1 -- 172.21.15.159:0/1862351163 wait complete. 2024-02-28T23:01:46.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.994+0000 7f655fa00700 1 Processor -- start 2024-02-28T23:01:46.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.994+0000 7f655fa00700 1 -- start start 2024-02-28T23:01:46.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.994+0000 7f655fa00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65580737f0 0x7f65581985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:46.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.994+0000 7f655fa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6558074dc0 0x7f6558198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:46.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.994+0000 7f655fa00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6558199100 con 0x7f6558074dc0 2024-02-28T23:01:46.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.994+0000 7f655fa00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6558199240 con 0x7f65580737f0 2024-02-28T23:01:46.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.994+0000 7f6557e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6558074dc0 0x7f6558198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:46.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.995+0000 7f6557e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6558074dc0 0x7f6558198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42910/0 (socket says 172.21.15.159:42910) 2024-02-28T23:01:46.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.995+0000 7f6557e00700 1 -- 172.21.15.159:0/54283900 learned_addr learned my addr 172.21.15.159:0/54283900 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:01:46.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.995+0000 7f655d000700 1 --2- 172.21.15.159:0/54283900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65580737f0 0x7f65581985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:46.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.995+0000 7f6557e00700 1 -- 172.21.15.159:0/54283900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65580737f0 msgr2=0x7f65581985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:46.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.995+0000 7f6557e00700 1 --2- 172.21.15.159:0/54283900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65580737f0 0x7f65581985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:46.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.995+0000 7f6557e00700 1 -- 172.21.15.159:0/54283900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65440095f0 con 0x7f6558074dc0 2024-02-28T23:01:46.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.995+0000 7f6557e00700 1 --2- 172.21.15.159:0/54283900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6558074dc0 0x7f6558198ae0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f654400bd70 tx=0x7f654400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:01:46.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.995+0000 7f6555600700 1 -- 172.21.15.159:0/54283900 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f654401d070 con 0x7f6558074dc0 2024-02-28T23:01:46.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.996+0000 7f6555600700 1 -- 172.21.15.159:0/54283900 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f654400f460 con 0x7f6558074dc0 2024-02-28T23:01:46.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.996+0000 7f6555600700 1 -- 172.21.15.159:0/54283900 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6544021620 con 0x7f6558074dc0 2024-02-28T23:01:46.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.996+0000 7f655fa00700 1 -- 172.21.15.159:0/54283900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655819dc90 con 0x7f6558074dc0 2024-02-28T23:01:46.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.996+0000 7f655fa00700 1 -- 172.21.15.159:0/54283900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655819e130 con 0x7f6558074dc0 2024-02-28T23:01:46.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.997+0000 7f655fa00700 1 -- 172.21.15.159:0/54283900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f655810b950 con 0x7f6558074dc0 2024-02-28T23:01:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.998+0000 7f6555600700 1 -- 172.21.15.159:0/54283900 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f654400fa40 con 0x7f6558074dc0 2024-02-28T23:01:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.999+0000 7f6555600700 1 --2- 172.21.15.159:0/54283900 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f654006c4e0 0x7f654006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.999+0000 7f6555600700 1 -- 172.21.15.159:0/54283900 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f654408c870 con 0x7f6558074dc0 2024-02-28T23:01:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:46.999+0000 7f655d000700 1 --2- 172.21.15.159:0/54283900 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f654006c4e0 0x7f654006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.000+0000 7f655d000700 1 --2- 172.21.15.159:0/54283900 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f654006c4e0 0x7f654006e9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f654c005950 tx=0x7f654c0058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:01:47.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.004+0000 7f6555600700 1 -- 172.21.15.159:0/54283900 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f654405ad80 con 0x7f6558074dc0 2024-02-28T23:01:47.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.217+0000 7f655fa00700 1 -- 172.21.15.159:0/54283900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f655810bb40 con 0x7f6558074dc0 2024-02-28T23:01:47.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.218+0000 7f6555600700 1 -- 172.21.15.159:0/54283900 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) v1 ==== 74+0+130 (secure 0 0 0) 0x7f654405a910 con 0x7f6558074dc0 2024-02-28T23:01:47.218 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:01:47.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.221+0000 7f655fa00700 1 -- 172.21.15.159:0/54283900 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f654006c4e0 msgr2=0x7f654006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:47.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.221+0000 7f655fa00700 1 --2- 172.21.15.159:0/54283900 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f654006c4e0 0x7f654006e9a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f654c005950 tx=0x7f654c0058e0 comp rx=0 tx=0).stop 2024-02-28T23:01:47.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.222+0000 7f655fa00700 1 -- 172.21.15.159:0/54283900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6558074dc0 msgr2=0x7f6558198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:47.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.222+0000 7f655fa00700 1 --2- 172.21.15.159:0/54283900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6558074dc0 0x7f6558198ae0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f654400bd70 tx=0x7f654400be50 comp rx=0 tx=0).stop 2024-02-28T23:01:47.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.222+0000 7f655fa00700 1 -- 172.21.15.159:0/54283900 shutdown_connections 2024-02-28T23:01:47.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.222+0000 7f655fa00700 1 --2- 172.21.15.159:0/54283900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f65580737f0 0x7f65581985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:47.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.222+0000 7f655fa00700 1 --2- 172.21.15.159:0/54283900 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f654006c4e0 0x7f654006e9a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:47.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.222+0000 7f655fa00700 1 --2- 172.21.15.159:0/54283900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6558074dc0 0x7f6558198ae0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:47.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.222+0000 7f655fa00700 1 -- 172.21.15.159:0/54283900 >> 172.21.15.159:0/54283900 conn(0x7f65580fc140 msgr2=0x7f65581069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:01:47.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.222+0000 7f655fa00700 1 -- 172.21.15.159:0/54283900 shutdown_connections 2024-02-28T23:01:47.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:47.222+0000 7f655fa00700 1 -- 172.21.15.159:0/54283900 wait complete. 2024-02-28T23:01:47.935 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:47 smithi159 ceph-mon[28802]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:47.935 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:47 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/54283900' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-28T23:01:48.051 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1709161304,"num_in_osds":6,"osd_in_since":1709161281,"num_remapped_pgs":0} 2024-02-28T23:01:48.052 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T23:01:48.092 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:47 smithi184 ceph-mon[36198]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:48.092 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:47 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/54283900' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-28T23:01:48.454 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:01:50.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:50.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: Detected new or changed devices on smithi184 2024-02-28T23:01:50.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:50.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:50.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:01:50.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:01:50.349 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:01:50.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: Adjusting osd_memory_target on smithi184 to 4971M 2024-02-28T23:01:50.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:50.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:50.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:01:50.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:50.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:01:50.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:50.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:01:50.350 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:50.351 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:01:50.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:50.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: Detected new or changed devices on smithi184 2024-02-28T23:01:50.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:50.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:50.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:01:50.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:01:50.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:01:50.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: Adjusting osd_memory_target on smithi184 to 4971M 2024-02-28T23:01:50.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:50.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:50.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:01:50.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:50.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:01:50.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:01:50.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:01:50.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:01:50.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:01:50.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.617+0000 7f5fd4000700 1 -- 172.21.15.159:0/1626837322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fcc10d280 msgr2=0x7f5fcc10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:50.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.617+0000 7f5fd4000700 1 --2- 172.21.15.159:0/1626837322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fcc10d280 0x7f5fcc10d660 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0009910 tx=0x7f5fc0009c20 comp rx=0 tx=0).stop 2024-02-28T23:01:50.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.617+0000 7f5fd4000700 1 -- 172.21.15.159:0/1626837322 shutdown_connections 2024-02-28T23:01:50.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.617+0000 7f5fd4000700 1 --2- 172.21.15.159:0/1626837322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fcc1071d0 0x7f5fcc107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:50.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.617+0000 7f5fd4000700 1 --2- 172.21.15.159:0/1626837322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fcc10d280 0x7f5fcc10d660 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:50.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.617+0000 7f5fd4000700 1 -- 172.21.15.159:0/1626837322 >> 172.21.15.159:0/1626837322 conn(0x7f5fcc0769e0 msgr2=0x7f5fcc078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:01:50.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.617+0000 7f5fd4000700 1 -- 172.21.15.159:0/1626837322 shutdown_connections 2024-02-28T23:01:50.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.617+0000 7f5fd4000700 1 -- 172.21.15.159:0/1626837322 wait complete. 2024-02-28T23:01:50.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.618+0000 7f5fd4000700 1 Processor -- start 2024-02-28T23:01:50.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.619+0000 7f5fd4000700 1 -- start start 2024-02-28T23:01:50.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.619+0000 7f5fd4000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fcc1071d0 0x7f5fcc19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:50.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.619+0000 7f5fd4000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fcc10d280 0x7f5fcc19d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:50.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.619+0000 7f5fd4000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc19d8a0 con 0x7f5fcc10d280 2024-02-28T23:01:50.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.619+0000 7f5fd4000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fcc1a05d0 con 0x7f5fcc1071d0 2024-02-28T23:01:50.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.619+0000 7f5fd0c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fcc10d280 0x7f5fcc19d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:50.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.620+0000 7f5fd0c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fcc10d280 0x7f5fcc19d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38540/0 (socket says 172.21.15.159:38540) 2024-02-28T23:01:50.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.620+0000 7f5fd0c00700 1 -- 172.21.15.159:0/3348952998 learned_addr learned my addr 172.21.15.159:0/3348952998 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:01:50.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.620+0000 7f5fd0c00700 1 -- 172.21.15.159:0/3348952998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fcc1071d0 msgr2=0x7f5fcc19ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:50.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.620+0000 7f5fd1600700 1 --2- 172.21.15.159:0/3348952998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fcc1071d0 0x7f5fcc19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:50.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.620+0000 7f5fd0c00700 1 --2- 172.21.15.159:0/3348952998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fcc1071d0 0x7f5fcc19ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:50.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.620+0000 7f5fd0c00700 1 -- 172.21.15.159:0/3348952998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc00095f0 con 0x7f5fcc10d280 2024-02-28T23:01:50.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.620+0000 7f5fd0c00700 1 --2- 172.21.15.159:0/3348952998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fcc10d280 0x7f5fcc19d210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800d8d0 tx=0x7f5fb800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:01:50.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.620+0000 7f5fca000700 1 -- 172.21.15.159:0/3348952998 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fb8009940 con 0x7f5fcc10d280 2024-02-28T23:01:50.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.621+0000 7f5fca000700 1 -- 172.21.15.159:0/3348952998 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5fb8010460 con 0x7f5fcc10d280 2024-02-28T23:01:50.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.621+0000 7f5fca000700 1 -- 172.21.15.159:0/3348952998 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5fb800f5f0 con 0x7f5fcc10d280 2024-02-28T23:01:50.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.621+0000 7f5fd4000700 1 -- 172.21.15.159:0/3348952998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fcc1a08b0 con 0x7f5fcc10d280 2024-02-28T23:01:50.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.621+0000 7f5fd4000700 1 -- 172.21.15.159:0/3348952998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fcc1a0e00 con 0x7f5fcc10d280 2024-02-28T23:01:50.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.622+0000 7f5fd4000700 1 -- 172.21.15.159:0/3348952998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fcc04ea90 con 0x7f5fcc10d280 2024-02-28T23:01:50.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.623+0000 7f5fca000700 1 -- 172.21.15.159:0/3348952998 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f5fb80105d0 con 0x7f5fcc10d280 2024-02-28T23:01:50.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.624+0000 7f5fca000700 1 --2- 172.21.15.159:0/3348952998 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5fb406c4e0 0x7f5fb406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:50.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.624+0000 7f5fca000700 1 -- 172.21.15.159:0/3348952998 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5fb808b590 con 0x7f5fcc10d280 2024-02-28T23:01:50.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.624+0000 7f5fd1600700 1 --2- 172.21.15.159:0/3348952998 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5fb406c4e0 0x7f5fb406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:50.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.625+0000 7f5fd1600700 1 --2- 172.21.15.159:0/3348952998 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5fb406c4e0 0x7f5fb406e9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0006010 tx=0x7f5fc000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:01:50.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.629+0000 7f5fca000700 1 -- 172.21.15.159:0/3348952998 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5fb8056010 con 0x7f5fcc10d280 2024-02-28T23:01:50.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.843+0000 7f5fd4000700 1 -- 172.21.15.159:0/3348952998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fcc1a1110 con 0x7f5fcc10d280 2024-02-28T23:01:50.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.845+0000 7f5fca000700 1 -- 172.21.15.159:0/3348952998 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11398 (secure 0 0 0) 0x7f5fb8059630 con 0x7f5fcc10d280 2024-02-28T23:01:50.844 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:01:50.845 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":40,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","created":"2024-02-28T22:54:07.259600+0000","modified":"2024-02-28T23:01:45.607869+0000","last_up_change":"2024-02-28T23:01:44.596739+0000","last_in_change":"2024-02-28T23:01:21.082396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T23:00:05.643400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"12a358ec-2348-437f-a587-c75299c13814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6803","nonce":3574200223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6805","nonce":3574200223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6809","nonce":3574200223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6807","nonce":3574200223}]},"public_addr":"172.21.15.159:6803/3574200223","cluster_addr":"172.21.15.159:6805/3574200223","heartbeat_back_addr":"172.21.15.159:6809/3574200223","heartbeat_front_addr":"172.21.15.159:6807/3574200223","state":["exists","up"]},{"osd":1,"uuid":"34a65dc7-3bd8-4cb5-b61b-e04166f115c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6811","nonce":2108285298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6813","nonce":2108285298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6817","nonce":2108285298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6815","nonce":2108285298}]},"public_addr":"172.21.15.159:6811/2108285298","cluster_addr":"172.21.15.159:6813/2108285298","heartbeat_back_addr":"172.21.15.159:6817/2108285298","heartbeat_front_addr":"172.21.15.159:6815/2108285298","state":["exists","up"]},{"osd":2,"uuid":"a712ee56-f8b8-43c4-9f38-33ebe33b7977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6819","nonce":3558816459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6821","nonce":3558816459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6825","nonce":3558816459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6823","nonce":3558816459}]},"public_addr":"172.21.15.159:6819/3558816459","cluster_addr":"172.21.15.159:6821/3558816459","heartbeat_back_addr":"172.21.15.159:6825/3558816459","heartbeat_front_addr":"172.21.15.159:6823/3558816459","state":["exists","up"]},{"osd":3,"uuid":"bb2d95db-29e3-4e8d-bcea-ed52ae538c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6801","nonce":3861297213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6803","nonce":3861297213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6807","nonce":3861297213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6805","nonce":3861297213}]},"public_addr":"172.21.15.184:6801/3861297213","cluster_addr":"172.21.15.184:6803/3861297213","heartbeat_back_addr":"172.21.15.184:6807/3861297213","heartbeat_front_addr":"172.21.15.184:6805/3861297213","state":["exists","up"]},{"osd":4,"uuid":"55d22d45-549c-4a55-8a36-7aa785561068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6809","nonce":3952225914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6811","nonce":3952225914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6815","nonce":3952225914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6813","nonce":3952225914}]},"public_addr":"172.21.15.184:6809/3952225914","cluster_addr":"172.21.15.184:6811/3952225914","heartbeat_back_addr":"172.21.15.184:6815/3952225914","heartbeat_front_addr":"172.21.15.184:6813/3952225914","state":["exists","up"]},{"osd":5,"uuid":"eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6817","nonce":1171078927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6819","nonce":1171078927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6823","nonce":1171078927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6821","nonce":1171078927}]},"public_addr":"172.21.15.184:6817/1171078927","cluster_addr":"172.21.15.184:6819/1171078927","heartbeat_back_addr":"172.21.15.184:6823/1171078927","heartbeat_front_addr":"172.21.15.184:6821/1171078927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:58:47.192772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:59:24.679857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:03.155438+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:35.629938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:09.895470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:43.528444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:6801/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:6800/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/2242263974":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/1337780901":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/3426997920":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6801/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6800/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:0/2053056032":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6801/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.159:6800/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/423942112":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/74577353":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/3456040694":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/3945263774":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/528876824":"2024-02-29T22:55:32.103959+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T23:01:50.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.848+0000 7f5fd4000700 1 -- 172.21.15.159:0/3348952998 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5fb406c4e0 msgr2=0x7f5fb406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:50.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.848+0000 7f5fd4000700 1 --2- 172.21.15.159:0/3348952998 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5fb406c4e0 0x7f5fb406e9a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0006010 tx=0x7f5fc000b540 comp rx=0 tx=0).stop 2024-02-28T23:01:50.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.848+0000 7f5fd4000700 1 -- 172.21.15.159:0/3348952998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fcc10d280 msgr2=0x7f5fcc19d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:50.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.848+0000 7f5fd4000700 1 --2- 172.21.15.159:0/3348952998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fcc10d280 0x7f5fcc19d210 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5fb800d8d0 tx=0x7f5fb800dc90 comp rx=0 tx=0).stop 2024-02-28T23:01:50.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.848+0000 7f5fd4000700 1 -- 172.21.15.159:0/3348952998 shutdown_connections 2024-02-28T23:01:50.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.848+0000 7f5fd4000700 1 --2- 172.21.15.159:0/3348952998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5fcc1071d0 0x7f5fcc19ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:50.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.848+0000 7f5fd4000700 1 --2- 172.21.15.159:0/3348952998 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5fb406c4e0 0x7f5fb406e9a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:50.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.848+0000 7f5fd4000700 1 --2- 172.21.15.159:0/3348952998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fcc10d280 0x7f5fcc19d210 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:50.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.848+0000 7f5fd4000700 1 -- 172.21.15.159:0/3348952998 >> 172.21.15.159:0/3348952998 conn(0x7f5fcc0769e0 msgr2=0x7f5fcc078320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:01:50.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.848+0000 7f5fd4000700 1 -- 172.21.15.159:0/3348952998 shutdown_connections 2024-02-28T23:01:50.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:50.848+0000 7f5fd4000700 1 -- 172.21.15.159:0/3348952998 wait complete. 2024-02-28T23:01:51.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:51 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3348952998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:01:51.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:51 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3348952998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:01:51.782 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T23:00:05.643400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T23:01:51.782 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-02-28T23:01:52.182 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:01:52.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:52 smithi159 ceph-mon[28802]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:52.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:52 smithi184 ceph-mon[36198]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:54.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:54 smithi184 ceph-mon[36198]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:54.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.472+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2082031212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d580ff180 msgr2=0x7f8d580ff600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:54.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.472+0000 7f8d5dc00700 1 --2- 172.21.15.159:0/2082031212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d580ff180 0x7f8d580ff600 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009910 tx=0x7f8d44009c20 comp rx=0 tx=0).stop 2024-02-28T23:01:54.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.472+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2082031212 shutdown_connections 2024-02-28T23:01:54.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.472+0000 7f8d5dc00700 1 --2- 172.21.15.159:0/2082031212 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d580ff180 0x7f8d580ff600 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:54.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.472+0000 7f8d5dc00700 1 --2- 172.21.15.159:0/2082031212 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d581050f0 0x7f8d581054d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:54.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.472+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2082031212 >> 172.21.15.159:0/2082031212 conn(0x7f8d58074a50 msgr2=0x7f8d58074e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:01:54.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.472+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2082031212 shutdown_connections 2024-02-28T23:01:54.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.472+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2082031212 wait complete. 2024-02-28T23:01:54.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:54 smithi159 ceph-mon[28802]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:54.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.474+0000 7f8d5dc00700 1 Processor -- start 2024-02-28T23:01:54.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.474+0000 7f8d5dc00700 1 -- start start 2024-02-28T23:01:54.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.475+0000 7f8d5dc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d580ff180 0x7f8d58100d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:54.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.475+0000 7f8d5dc00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d581050f0 0x7f8d58101260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:54.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.475+0000 7f8d5dc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d581017a0 con 0x7f8d580ff180 2024-02-28T23:01:54.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.475+0000 7f8d5dc00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d581018e0 con 0x7f8d581050f0 2024-02-28T23:01:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.475+0000 7f8d57e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d580ff180 0x7f8d58100d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.475+0000 7f8d57e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d580ff180 0x7f8d58100d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38558/0 (socket says 172.21.15.159:38558) 2024-02-28T23:01:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.475+0000 7f8d57e00700 1 -- 172.21.15.159:0/2544555574 learned_addr learned my addr 172.21.15.159:0/2544555574 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:01:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.475+0000 7f8d57400700 1 --2- 172.21.15.159:0/2544555574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d581050f0 0x7f8d58101260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.475+0000 7f8d57e00700 1 -- 172.21.15.159:0/2544555574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d581050f0 msgr2=0x7f8d58101260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.475+0000 7f8d57e00700 1 --2- 172.21.15.159:0/2544555574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d581050f0 0x7f8d58101260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.475+0000 7f8d57e00700 1 -- 172.21.15.159:0/2544555574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d440095f0 con 0x7f8d580ff180 2024-02-28T23:01:54.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.476+0000 7f8d57e00700 1 --2- 172.21.15.159:0/2544555574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d580ff180 0x7f8d58100d20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800c8a0 tx=0x7f8d4800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:01:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.476+0000 7f8d54c00700 1 -- 172.21.15.159:0/2544555574 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d4800cea0 con 0x7f8d580ff180 2024-02-28T23:01:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.476+0000 7f8d54c00700 1 -- 172.21.15.159:0/2544555574 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8d48004830 con 0x7f8d580ff180 2024-02-28T23:01:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.476+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2544555574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d581a26d0 con 0x7f8d580ff180 2024-02-28T23:01:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.476+0000 7f8d54c00700 1 -- 172.21.15.159:0/2544555574 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d480055b0 con 0x7f8d580ff180 2024-02-28T23:01:54.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.477+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2544555574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d581a2ae0 con 0x7f8d580ff180 2024-02-28T23:01:54.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.478+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2544555574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d58109600 con 0x7f8d580ff180 2024-02-28T23:01:54.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.479+0000 7f8d54c00700 1 -- 172.21.15.159:0/2544555574 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f8d48007ad0 con 0x7f8d580ff180 2024-02-28T23:01:54.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.480+0000 7f8d54c00700 1 --2- 172.21.15.159:0/2544555574 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8d3c06c4e0 0x7f8d3c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:54.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.480+0000 7f8d54c00700 1 -- 172.21.15.159:0/2544555574 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f8d4808ae60 con 0x7f8d580ff180 2024-02-28T23:01:54.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.481+0000 7f8d57400700 1 --2- 172.21.15.159:0/2544555574 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8d3c06c4e0 0x7f8d3c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:54.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.481+0000 7f8d57400700 1 --2- 172.21.15.159:0/2544555574 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8d3c06c4e0 0x7f8d3c06e9a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8d58102510 tx=0x7f8d4401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:01:54.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.486+0000 7f8d54c00700 1 -- 172.21.15.159:0/2544555574 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8d480559e0 con 0x7f8d580ff180 2024-02-28T23:01:54.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.702+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2544555574 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d5802cd30 con 0x7f8d580ff180 2024-02-28T23:01:54.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.703+0000 7f8d54c00700 1 -- 172.21.15.159:0/2544555574 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d4801d020 con 0x7f8d580ff180 2024-02-28T23:01:54.703 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 1 2024-02-28T23:01:54.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.706+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2544555574 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8d3c06c4e0 msgr2=0x7f8d3c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:54.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.706+0000 7f8d5dc00700 1 --2- 172.21.15.159:0/2544555574 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8d3c06c4e0 0x7f8d3c06e9a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8d58102510 tx=0x7f8d4401a040 comp rx=0 tx=0).stop 2024-02-28T23:01:54.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.706+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2544555574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d580ff180 msgr2=0x7f8d58100d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:54.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.706+0000 7f8d5dc00700 1 --2- 172.21.15.159:0/2544555574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d580ff180 0x7f8d58100d20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800c8a0 tx=0x7f8d4800cc60 comp rx=0 tx=0).stop 2024-02-28T23:01:54.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.706+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2544555574 shutdown_connections 2024-02-28T23:01:54.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.706+0000 7f8d5dc00700 1 --2- 172.21.15.159:0/2544555574 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8d3c06c4e0 0x7f8d3c06e9a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:54.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.706+0000 7f8d5dc00700 1 --2- 172.21.15.159:0/2544555574 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d580ff180 0x7f8d58100d20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:54.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.706+0000 7f8d5dc00700 1 --2- 172.21.15.159:0/2544555574 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d581050f0 0x7f8d58101260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:54.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.706+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2544555574 >> 172.21.15.159:0/2544555574 conn(0x7f8d58074a50 msgr2=0x7f8d580fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:01:54.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.706+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2544555574 shutdown_connections 2024-02-28T23:01:54.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:54.706+0000 7f8d5dc00700 1 -- 172.21.15.159:0/2544555574 wait complete. 2024-02-28T23:01:55.512 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:55 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2544555574' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T23:01:55.516 INFO:tasks.cephadm:Setting up client nodes... 2024-02-28T23:01:55.516 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-28T23:01:55.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:55 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2544555574' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T23:01:55.895 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:01:56.545 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:56 smithi159 ceph-mon[28802]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:56.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:56 smithi184 ceph-mon[36198]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:58.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.107+0000 7fbe80200700 1 -- 172.21.15.159:0/3457825037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe78100bb0 msgr2=0x7fbe78100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:58.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.107+0000 7fbe80200700 1 --2- 172.21.15.159:0/3457825037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe78100bb0 0x7fbe78100fd0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c009910 tx=0x7fbe6c009c20 comp rx=0 tx=0).stop 2024-02-28T23:01:58.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.108+0000 7fbe80200700 1 -- 172.21.15.159:0/3457825037 shutdown_connections 2024-02-28T23:01:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.108+0000 7fbe80200700 1 --2- 172.21.15.159:0/3457825037 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe78101db0 0x7fbe78102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.108+0000 7fbe80200700 1 --2- 172.21.15.159:0/3457825037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe78100bb0 0x7fbe78100fd0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.108+0000 7fbe80200700 1 -- 172.21.15.159:0/3457825037 >> 172.21.15.159:0/3457825037 conn(0x7fbe780fc110 msgr2=0x7fbe780fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:01:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.108+0000 7fbe80200700 1 -- 172.21.15.159:0/3457825037 shutdown_connections 2024-02-28T23:01:58.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.108+0000 7fbe80200700 1 -- 172.21.15.159:0/3457825037 wait complete. 2024-02-28T23:01:58.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.109+0000 7fbe80200700 1 Processor -- start 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.109+0000 7fbe80200700 1 -- start start 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.109+0000 7fbe80200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe78100bb0 0x7fbe781985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.109+0000 7fbe80200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe78101db0 0x7fbe78198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.109+0000 7fbe80200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78199150 con 0x7fbe78101db0 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.109+0000 7fbe80200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe78199290 con 0x7fbe78100bb0 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.110+0000 7fbe7ce00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe78101db0 0x7fbe78198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.110+0000 7fbe7ce00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe78101db0 0x7fbe78198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36066/0 (socket says 172.21.15.159:36066) 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.110+0000 7fbe7ce00700 1 -- 172.21.15.159:0/1284116164 learned_addr learned my addr 172.21.15.159:0/1284116164 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.110+0000 7fbe7d800700 1 --2- 172.21.15.159:0/1284116164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe78100bb0 0x7fbe781985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.110+0000 7fbe7ce00700 1 -- 172.21.15.159:0/1284116164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe78100bb0 msgr2=0x7fbe781985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.110+0000 7fbe7ce00700 1 --2- 172.21.15.159:0/1284116164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe78100bb0 0x7fbe781985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:58.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.110+0000 7fbe7ce00700 1 -- 172.21.15.159:0/1284116164 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6c0095f0 con 0x7fbe78101db0 2024-02-28T23:01:58.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.111+0000 7fbe7ce00700 1 --2- 172.21.15.159:0/1284116164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe78101db0 0x7fbe78198b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400b4b0 tx=0x7fbe6400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:01:58.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.111+0000 7fbe76000700 1 -- 172.21.15.159:0/1284116164 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe64011800 con 0x7fbe78101db0 2024-02-28T23:01:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.111+0000 7fbe76000700 1 -- 172.21.15.159:0/1284116164 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbe64011e10 con 0x7fbe78101db0 2024-02-28T23:01:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.111+0000 7fbe80200700 1 -- 172.21.15.159:0/1284116164 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7819dd40 con 0x7fbe78101db0 2024-02-28T23:01:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.111+0000 7fbe80200700 1 -- 172.21.15.159:0/1284116164 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7819e310 con 0x7fbe78101db0 2024-02-28T23:01:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.111+0000 7fbe76000700 1 -- 172.21.15.159:0/1284116164 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe6400f2e0 con 0x7fbe78101db0 2024-02-28T23:01:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.113+0000 7fbe80200700 1 -- 172.21.15.159:0/1284116164 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe78105e90 con 0x7fbe78101db0 2024-02-28T23:01:58.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.113+0000 7fbe76000700 1 -- 172.21.15.159:0/1284116164 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fbe64011960 con 0x7fbe78101db0 2024-02-28T23:01:58.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.114+0000 7fbe76000700 1 --2- 172.21.15.159:0/1284116164 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbe6006c4e0 0x7fbe6006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:01:58.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.114+0000 7fbe76000700 1 -- 172.21.15.159:0/1284116164 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fbe6408b1e0 con 0x7fbe78101db0 2024-02-28T23:01:58.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.114+0000 7fbe7d800700 1 --2- 172.21.15.159:0/1284116164 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbe6006c4e0 0x7fbe6006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:01:58.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.115+0000 7fbe7d800700 1 --2- 172.21.15.159:0/1284116164 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbe6006c4e0 0x7fbe6006e9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c006010 tx=0x7fbe6c00b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:01:58.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.119+0000 7fbe76000700 1 -- 172.21.15.159:0/1284116164 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbe640596f0 con 0x7fbe78101db0 2024-02-28T23:01:58.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.421+0000 7fbe80200700 1 -- 172.21.15.159:0/1284116164 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fbe78061a40 con 0x7fbe78101db0 2024-02-28T23:01:58.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.429+0000 7fbe76000700 1 -- 172.21.15.159:0/1284116164 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) v1 ==== 170+0+59 (secure 0 0 0) 0x7fbe64059280 con 0x7fbe78101db0 2024-02-28T23:01:58.429 INFO:teuthology.orchestra.run.smithi159.stdout:[client.0] 2024-02-28T23:01:58.429 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBmu99l+dVCGRAAIHdQgS7jB7+dCF/PN0d0dA== 2024-02-28T23:01:58.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.432+0000 7fbe80200700 1 -- 172.21.15.159:0/1284116164 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbe6006c4e0 msgr2=0x7fbe6006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:58.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.432+0000 7fbe80200700 1 --2- 172.21.15.159:0/1284116164 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbe6006c4e0 0x7fbe6006e9a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c006010 tx=0x7fbe6c00b540 comp rx=0 tx=0).stop 2024-02-28T23:01:58.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.432+0000 7fbe80200700 1 -- 172.21.15.159:0/1284116164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe78101db0 msgr2=0x7fbe78198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:01:58.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.432+0000 7fbe80200700 1 --2- 172.21.15.159:0/1284116164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe78101db0 0x7fbe78198b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400b4b0 tx=0x7fbe6400b870 comp rx=0 tx=0).stop 2024-02-28T23:01:58.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.432+0000 7fbe80200700 1 -- 172.21.15.159:0/1284116164 shutdown_connections 2024-02-28T23:01:58.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.432+0000 7fbe80200700 1 --2- 172.21.15.159:0/1284116164 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe78100bb0 0x7fbe781985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:58.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.432+0000 7fbe80200700 1 --2- 172.21.15.159:0/1284116164 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbe6006c4e0 0x7fbe6006e9a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:58.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.432+0000 7fbe80200700 1 --2- 172.21.15.159:0/1284116164 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe78101db0 0x7fbe78198b30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:01:58.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.432+0000 7fbe80200700 1 -- 172.21.15.159:0/1284116164 >> 172.21.15.159:0/1284116164 conn(0x7fbe780fc110 msgr2=0x7fbe78102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:01:58.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.433+0000 7fbe80200700 1 -- 172.21.15.159:0/1284116164 shutdown_connections 2024-02-28T23:01:58.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:01:58.433+0000 7fbe80200700 1 -- 172.21.15.159:0/1284116164 wait complete. 2024-02-28T23:01:58.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:58 smithi184 ceph-mon[36198]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:58 smithi159 ceph-mon[28802]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:01:59.170 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T23:01:59.170 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-28T23:01:59.170 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-28T23:01:59.311 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-28T23:01:59.398 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:59 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1284116164' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T23:01:59.398 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:01:59 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1284116164' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T23:01:59.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:59 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1284116164' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T23:01:59.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:01:59 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1284116164' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T23:01:59.722 INFO:teuthology.orchestra.run.smithi184.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi184/config 2024-02-28T23:02:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:00 smithi159 ceph-mon[28802]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:00.724 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:00 smithi184 ceph-mon[36198]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:01.942 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.944+0000 7fb13ca00700 1 -- 172.21.15.184:0/260320759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb138100a80 msgr2=0x7fb138100ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:01.942 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.944+0000 7fb13ca00700 1 --2- 172.21.15.184:0/260320759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb138100a80 0x7fb138100ea0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb128009910 tx=0x7fb128009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:01.942 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.944+0000 7fb13ca00700 1 -- 172.21.15.184:0/260320759 shutdown_connections 2024-02-28T23:02:01.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.944+0000 7fb13ca00700 1 --2- 172.21.15.184:0/260320759 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb138101c80 0x7fb1381020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:01.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.944+0000 7fb13ca00700 1 --2- 172.21.15.184:0/260320759 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb138100a80 0x7fb138100ea0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:01.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.944+0000 7fb13ca00700 1 -- 172.21.15.184:0/260320759 >> 172.21.15.184:0/260320759 conn(0x7fb1380fc000 msgr2=0x7fb1380fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:01.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.944+0000 7fb13ca00700 1 -- 172.21.15.184:0/260320759 shutdown_connections 2024-02-28T23:02:01.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.944+0000 7fb13ca00700 1 -- 172.21.15.184:0/260320759 wait complete. 2024-02-28T23:02:01.943 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.945+0000 7fb13ca00700 1 Processor -- start 2024-02-28T23:02:01.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.945+0000 7fb13ca00700 1 -- start start 2024-02-28T23:02:01.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.946+0000 7fb13ca00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb138100a80 0x7fb138196270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:01.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.946+0000 7fb13ca00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb138101c80 0x7fb1381967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:01.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.946+0000 7fb13ca00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb138196dd0 con 0x7fb138101c80 2024-02-28T23:02:01.944 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.946+0000 7fb13ca00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb138196f10 con 0x7fb138100a80 2024-02-28T23:02:01.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.946+0000 7fb136800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb138100a80 0x7fb138196270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:01.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.946+0000 7fb136800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb138100a80 0x7fb138196270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.184:47572/0 (socket says 172.21.15.184:47572) 2024-02-28T23:02:01.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.946+0000 7fb136800700 1 -- 172.21.15.184:0/2625610735 learned_addr learned my addr 172.21.15.184:0/2625610735 (peer_addr_for_me v2:172.21.15.184:0/0) 2024-02-28T23:02:01.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.946+0000 7fb135e00700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb138101c80 0x7fb1381967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:01.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.947+0000 7fb136800700 1 -- 172.21.15.184:0/2625610735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb138101c80 msgr2=0x7fb1381967b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:01.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.947+0000 7fb136800700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb138101c80 0x7fb1381967b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:01.945 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.947+0000 7fb136800700 1 -- 172.21.15.184:0/2625610735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280095f0 con 0x7fb138100a80 2024-02-28T23:02:01.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.947+0000 7fb135e00700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb138101c80 0x7fb1381967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:02:01.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.947+0000 7fb136800700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb138100a80 0x7fb138196270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb12800bda0 tx=0x7fb12800be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:01.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.947+0000 7fb12f400700 1 -- 172.21.15.184:0/2625610735 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb12801d070 con 0x7fb138100a80 2024-02-28T23:02:01.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.947+0000 7fb12f400700 1 -- 172.21.15.184:0/2625610735 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb128004c50 con 0x7fb138100a80 2024-02-28T23:02:01.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.947+0000 7fb13ca00700 1 -- 172.21.15.184:0/2625610735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb13819b960 con 0x7fb138100a80 2024-02-28T23:02:01.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.947+0000 7fb12f400700 1 -- 172.21.15.184:0/2625610735 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb12800f690 con 0x7fb138100a80 2024-02-28T23:02:01.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.947+0000 7fb13ca00700 1 -- 172.21.15.184:0/2625610735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb13819bed0 con 0x7fb138100a80 2024-02-28T23:02:01.946 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.949+0000 7fb13ca00700 1 -- 172.21.15.184:0/2625610735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1381095f0 con 0x7fb138100a80 2024-02-28T23:02:01.947 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.949+0000 7fb12f400700 1 -- 172.21.15.184:0/2625610735 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fb1280229b0 con 0x7fb138100a80 2024-02-28T23:02:01.948 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.950+0000 7fb12f400700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb11c06c4e0 0x7fb11c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:01.948 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.950+0000 7fb12f400700 1 -- 172.21.15.184:0/2625610735 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fb12808cce0 con 0x7fb138100a80 2024-02-28T23:02:01.949 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.951+0000 7fb135e00700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb11c06c4e0 0x7fb11c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:01.950 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.952+0000 7fb135e00700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb11c06c4e0 0x7fb11c06e9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb124007900 tx=0x7fb124008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:01.953 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:01.955+0000 7fb12f400700 1 -- 172.21.15.184:0/2625610735 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb12805b270 con 0x7fb138100a80 2024-02-28T23:02:02.250 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.252+0000 7fb13ca00700 1 -- 172.21.15.184:0/2625610735 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7fb1381097e0 con 0x7fb138100a80 2024-02-28T23:02:02.262 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.263+0000 7fb12f400700 1 -- 172.21.15.184:0/2625610735 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) v1 ==== 170+0+59 (secure 0 0 0) 0x7fb1280270f0 con 0x7fb138100a80 2024-02-28T23:02:02.262 INFO:teuthology.orchestra.run.smithi184.stdout:[client.1] 2024-02-28T23:02:02.262 INFO:teuthology.orchestra.run.smithi184.stdout: key = AQBqu99lkbg1DxAAeSUyAhPBDut/Z8LLAg5xwQ== 2024-02-28T23:02:02.265 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.267+0000 7fb13ca00700 1 -- 172.21.15.184:0/2625610735 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb11c06c4e0 msgr2=0x7fb11c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:02.265 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.267+0000 7fb13ca00700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb11c06c4e0 0x7fb11c06e9a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb124007900 tx=0x7fb124008040 comp rx=0 tx=0).stop 2024-02-28T23:02:02.266 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.267+0000 7fb13ca00700 1 -- 172.21.15.184:0/2625610735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb138100a80 msgr2=0x7fb138196270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:02.266 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.267+0000 7fb13ca00700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb138100a80 0x7fb138196270 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb12800bda0 tx=0x7fb12800be80 comp rx=0 tx=0).stop 2024-02-28T23:02:02.266 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.267+0000 7fb13ca00700 1 -- 172.21.15.184:0/2625610735 shutdown_connections 2024-02-28T23:02:02.266 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.267+0000 7fb13ca00700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb138100a80 0x7fb138196270 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:02.266 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.267+0000 7fb13ca00700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb11c06c4e0 0x7fb11c06e9a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:02.266 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.267+0000 7fb13ca00700 1 --2- 172.21.15.184:0/2625610735 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb138101c80 0x7fb1381967b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:02.266 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.267+0000 7fb13ca00700 1 -- 172.21.15.184:0/2625610735 >> 172.21.15.184:0/2625610735 conn(0x7fb1380fc000 msgr2=0x7fb138104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:02.266 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.267+0000 7fb13ca00700 1 -- 172.21.15.184:0/2625610735 shutdown_connections 2024-02-28T23:02:02.266 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:02:02.268+0000 7fb13ca00700 1 -- 172.21.15.184:0/2625610735 wait complete. 2024-02-28T23:02:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:02 smithi184 ceph-mon[36198]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:02 smithi184 ceph-mon[36198]: from='client.? 172.21.15.184:0/2625610735' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T23:02:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:02 smithi184 ceph-mon[36198]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T23:02:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:02 smithi184 ceph-mon[36198]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T23:02:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:02 smithi159 ceph-mon[28802]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:02 smithi159 ceph-mon[28802]: from='client.? 172.21.15.184:0/2625610735' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T23:02:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:02 smithi159 ceph-mon[28802]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-28T23:02:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:02 smithi159 ceph-mon[28802]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-28T23:02:03.135 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T23:02:03.135 DEBUG:teuthology.orchestra.run.smithi184:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-28T23:02:03.136 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-28T23:02:03.291 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-28T23:02:03.291 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-28T23:02:03.291 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph mgr dump --format=json 2024-02-28T23:02:03.701 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:04.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:04 smithi184 ceph-mon[36198]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:04.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:04 smithi159 ceph-mon[28802]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:05.600 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:02:05.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.768+0000 7f100fe00700 1 -- 172.21.15.159:0/2552751736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10080731c0 msgr2=0x7f10080735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:05.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.768+0000 7f100fe00700 1 --2- 172.21.15.159:0/2552751736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10080731c0 0x7f10080735a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009910 tx=0x7f0ffc009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:05.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.768+0000 7f100fe00700 1 -- 172.21.15.159:0/2552751736 shutdown_connections 2024-02-28T23:02:05.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.768+0000 7f100fe00700 1 --2- 172.21.15.159:0/2552751736 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1008073ae0 0x7f100810ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:05.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.768+0000 7f100fe00700 1 --2- 172.21.15.159:0/2552751736 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f10080731c0 0x7f10080735a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:05.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.768+0000 7f100fe00700 1 -- 172.21.15.159:0/2552751736 >> 172.21.15.159:0/2552751736 conn(0x7f10080fc650 msgr2=0x7f10080fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:05.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.768+0000 7f100fe00700 1 -- 172.21.15.159:0/2552751736 shutdown_connections 2024-02-28T23:02:05.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.768+0000 7f100fe00700 1 -- 172.21.15.159:0/2552751736 wait complete. 2024-02-28T23:02:05.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.769+0000 7f100fe00700 1 Processor -- start 2024-02-28T23:02:05.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.770+0000 7f100fe00700 1 -- start start 2024-02-28T23:02:05.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.770+0000 7f100fe00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10080731c0 0x7f1008198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:05.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.770+0000 7f100fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1008073ae0 0x7f1008198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:05.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.770+0000 7f100fe00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10081994d0 con 0x7f1008073ae0 2024-02-28T23:02:05.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.770+0000 7f100fe00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1008199640 con 0x7f10080731c0 2024-02-28T23:02:05.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.770+0000 7f100ca00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1008073ae0 0x7f1008198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:05.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.770+0000 7f100ca00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1008073ae0 0x7f1008198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36082/0 (socket says 172.21.15.159:36082) 2024-02-28T23:02:05.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.771+0000 7f100ca00700 1 -- 172.21.15.159:0/1401344457 learned_addr learned my addr 172.21.15.159:0/1401344457 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:05.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.771+0000 7f100d400700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10080731c0 0x7f1008198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:05.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.771+0000 7f100ca00700 1 -- 172.21.15.159:0/1401344457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10080731c0 msgr2=0x7f1008198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:05.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.771+0000 7f100ca00700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10080731c0 0x7f1008198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:05.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.771+0000 7f100ca00700 1 -- 172.21.15.159:0/1401344457 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc0095f0 con 0x7f1008073ae0 2024-02-28T23:02:05.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.771+0000 7f100d400700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10080731c0 0x7f1008198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:02:05.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.772+0000 7f100ca00700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1008073ae0 0x7f1008198ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400c930 tx=0x7f0ff400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:05.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.772+0000 7f1006000700 1 -- 172.21.15.159:0/1401344457 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff4007ad0 con 0x7f1008073ae0 2024-02-28T23:02:05.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.772+0000 7f1006000700 1 -- 172.21.15.159:0/1401344457 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0ff4007c30 con 0x7f1008073ae0 2024-02-28T23:02:05.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.772+0000 7f1006000700 1 -- 172.21.15.159:0/1401344457 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ff4018630 con 0x7f1008073ae0 2024-02-28T23:02:05.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.772+0000 7f100fe00700 1 -- 172.21.15.159:0/1401344457 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f100819d4c0 con 0x7f1008073ae0 2024-02-28T23:02:05.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.772+0000 7f100fe00700 1 -- 172.21.15.159:0/1401344457 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f100819da10 con 0x7f1008073ae0 2024-02-28T23:02:05.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.773+0000 7f100fe00700 1 -- 172.21.15.159:0/1401344457 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f100810a560 con 0x7f1008073ae0 2024-02-28T23:02:05.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.775+0000 7f1006000700 1 -- 172.21.15.159:0/1401344457 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f0ff400f450 con 0x7f1008073ae0 2024-02-28T23:02:05.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.776+0000 7f1006000700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0ff006c4e0 0x7f0ff006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:05.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.776+0000 7f1006000700 1 -- 172.21.15.159:0/1401344457 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f0ff408b5e0 con 0x7f1008073ae0 2024-02-28T23:02:05.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.776+0000 7f100d400700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0ff006c4e0 0x7f0ff006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:05.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.777+0000 7f100d400700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0ff006c4e0 0x7f0ff006e9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00b5c0 tx=0x7f0ffc01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:05.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:05.781+0000 7f1006000700 1 -- 172.21.15.159:0/1401344457 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f0ff4059c10 con 0x7f1008073ae0 2024-02-28T23:02:05.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:02:06.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.061+0000 7f100fe00700 1 -- 172.21.15.159:0/1401344457 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f100804ea90 con 0x7f1008073ae0 2024-02-28T23:02:06.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.066+0000 7f1006000700 1 -- 172.21.15.159:0/1401344457 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+173047 (secure 0 0 0) 0x7f0ff40597a0 con 0x7f1008073ae0 2024-02-28T23:02:06.066 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:02:06.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.070+0000 7f100fe00700 1 -- 172.21.15.159:0/1401344457 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0ff006c4e0 msgr2=0x7f0ff006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:06.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.070+0000 7f100fe00700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0ff006c4e0 0x7f0ff006e9a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc00b5c0 tx=0x7f0ffc01a040 comp rx=0 tx=0).stop 2024-02-28T23:02:06.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.070+0000 7f100fe00700 1 -- 172.21.15.159:0/1401344457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1008073ae0 msgr2=0x7f1008198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:06.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.070+0000 7f100fe00700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1008073ae0 0x7f1008198ed0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f0ff400c930 tx=0x7f0ff400ccf0 comp rx=0 tx=0).stop 2024-02-28T23:02:06.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.071+0000 7f100fe00700 1 -- 172.21.15.159:0/1401344457 shutdown_connections 2024-02-28T23:02:06.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.071+0000 7f100fe00700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10080731c0 0x7f1008198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:06.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.071+0000 7f100fe00700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f0ff006c4e0 0x7f0ff006e9a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:06.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.071+0000 7f100fe00700 1 --2- 172.21.15.159:0/1401344457 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1008073ae0 0x7f1008198ed0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:06.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.071+0000 7f100fe00700 1 -- 172.21.15.159:0/1401344457 >> 172.21.15.159:0/1401344457 conn(0x7f10080fc650 msgr2=0x7f10081076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:06.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.071+0000 7f100fe00700 1 -- 172.21.15.159:0/1401344457 shutdown_connections 2024-02-28T23:02:06.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:06.071+0000 7f100fe00700 1 -- 172.21.15.159:0/1401344457 wait complete. 2024-02-28T23:02:06.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:06 smithi159 ceph-mon[28802]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:06.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:06 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1401344457' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-28T23:02:06.842 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":19,"active_gid":14217,"active_name":"smithi159.pobewk","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1861094655},{"type":"v1","addr":"172.21.15.159:6801","nonce":1861094655}]},"active_addr":"172.21.15.159:6801/1861094655","active_change":"2024-02-28T22:57:04.937615+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":14242,"name":"smithi184.quvmnx","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.159:8443/","prometheus":"http://172.21.15.159:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":3397973227}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":2466956559}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":3798912796}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.159:0","nonce":656297432}]}]} 2024-02-28T23:02:06.846 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-28T23:02:06.846 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-28T23:02:06.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T23:02:06.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:06 smithi184 ceph-mon[36198]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:06.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:06 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1401344457' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-28T23:02:07.251 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:08.658 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:08 smithi159 ceph-mon[28802]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:08.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:08 smithi184 ceph-mon[36198]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.446+0000 7fddfdc00700 1 -- 172.21.15.159:0/3131414821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80752c0 msgr2=0x7fddf80756a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.446+0000 7fddfdc00700 1 --2- 172.21.15.159:0/3131414821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80752c0 0x7fddf80756a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdde8009910 tx=0x7fdde8009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.446+0000 7fddfdc00700 1 -- 172.21.15.159:0/3131414821 shutdown_connections 2024-02-28T23:02:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.446+0000 7fddfdc00700 1 --2- 172.21.15.159:0/3131414821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddf8075be0 0x7fddf81114e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.446+0000 7fddfdc00700 1 --2- 172.21.15.159:0/3131414821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80752c0 0x7fddf80756a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.446+0000 7fddfdc00700 1 -- 172.21.15.159:0/3131414821 >> 172.21.15.159:0/3131414821 conn(0x7fddf80fe890 msgr2=0x7fddf8100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.446+0000 7fddfdc00700 1 -- 172.21.15.159:0/3131414821 shutdown_connections 2024-02-28T23:02:09.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.446+0000 7fddfdc00700 1 -- 172.21.15.159:0/3131414821 wait complete. 2024-02-28T23:02:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.447+0000 7fddfdc00700 1 Processor -- start 2024-02-28T23:02:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.447+0000 7fddfdc00700 1 -- start start 2024-02-28T23:02:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddfdc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80752c0 0x7fddf81a2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddfdc00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddf8075be0 0x7fddf81a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddfdc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf81a3630 con 0x7fddf80752c0 2024-02-28T23:02:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddfdc00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddf819cae0 con 0x7fddf8075be0 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddf6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80752c0 0x7fddf81a2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddf6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80752c0 0x7fddf81a2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46224/0 (socket says 172.21.15.159:46224) 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddf6a00700 1 -- 172.21.15.159:0/2511552554 learned_addr learned my addr 172.21.15.159:0/2511552554 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddf6000700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddf8075be0 0x7fddf81a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddf6a00700 1 -- 172.21.15.159:0/2511552554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddf8075be0 msgr2=0x7fddf81a2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddf6a00700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddf8075be0 0x7fddf81a2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddf6a00700 1 -- 172.21.15.159:0/2511552554 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde80095f0 con 0x7fddf80752c0 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.448+0000 7fddf6000700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddf8075be0 0x7fddf81a2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.449+0000 7fddf6a00700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80752c0 0x7fddf81a2a60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdde8005b40 tx=0x7fdde80056a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.449+0000 7fddef400700 1 -- 172.21.15.159:0/2511552554 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde801d070 con 0x7fddf80752c0 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.449+0000 7fddef400700 1 -- 172.21.15.159:0/2511552554 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fdde800f460 con 0x7fddf80752c0 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.449+0000 7fddef400700 1 -- 172.21.15.159:0/2511552554 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdde8021640 con 0x7fddf80752c0 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.449+0000 7fddfdc00700 1 -- 172.21.15.159:0/2511552554 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddf819cdc0 con 0x7fddf80752c0 2024-02-28T23:02:09.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.449+0000 7fddfdc00700 1 -- 172.21.15.159:0/2511552554 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddf819d310 con 0x7fddf80752c0 2024-02-28T23:02:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.450+0000 7fddfdc00700 1 -- 172.21.15.159:0/2511552554 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddf810ec50 con 0x7fddf80752c0 2024-02-28T23:02:09.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.451+0000 7fddef400700 1 -- 172.21.15.159:0/2511552554 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fdde800f5d0 con 0x7fddf80752c0 2024-02-28T23:02:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.452+0000 7fddef400700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fdddc06c4e0 0x7fdddc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.452+0000 7fddef400700 1 -- 172.21.15.159:0/2511552554 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fdde808c820 con 0x7fddf80752c0 2024-02-28T23:02:09.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.452+0000 7fddf6000700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fdddc06c4e0 0x7fdddc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:09.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.453+0000 7fddf6000700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fdddc06c4e0 0x7fdddc06e9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdde4005fd0 tx=0x7fdde4005dc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:09.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.457+0000 7fddef400700 1 -- 172.21.15.159:0/2511552554 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fdde805adb0 con 0x7fddf80752c0 2024-02-28T23:02:09.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.670+0000 7fddfdc00700 1 -- 172.21.15.159:0/2511552554 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fddf804ea90 con 0x7fddf80752c0 2024-02-28T23:02:09.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.673+0000 7fddef400700 1 -- 172.21.15.159:0/2511552554 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11398 (secure 0 0 0) 0x7fdde805a940 con 0x7fddf80752c0 2024-02-28T23:02:09.672 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:02:09.673 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":40,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","created":"2024-02-28T22:54:07.259600+0000","modified":"2024-02-28T23:01:45.607869+0000","last_up_change":"2024-02-28T23:01:44.596739+0000","last_in_change":"2024-02-28T23:01:21.082396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T23:00:05.643400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"12a358ec-2348-437f-a587-c75299c13814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6803","nonce":3574200223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6805","nonce":3574200223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6809","nonce":3574200223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6807","nonce":3574200223}]},"public_addr":"172.21.15.159:6803/3574200223","cluster_addr":"172.21.15.159:6805/3574200223","heartbeat_back_addr":"172.21.15.159:6809/3574200223","heartbeat_front_addr":"172.21.15.159:6807/3574200223","state":["exists","up"]},{"osd":1,"uuid":"34a65dc7-3bd8-4cb5-b61b-e04166f115c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6811","nonce":2108285298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6813","nonce":2108285298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6817","nonce":2108285298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6815","nonce":2108285298}]},"public_addr":"172.21.15.159:6811/2108285298","cluster_addr":"172.21.15.159:6813/2108285298","heartbeat_back_addr":"172.21.15.159:6817/2108285298","heartbeat_front_addr":"172.21.15.159:6815/2108285298","state":["exists","up"]},{"osd":2,"uuid":"a712ee56-f8b8-43c4-9f38-33ebe33b7977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6819","nonce":3558816459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6821","nonce":3558816459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6825","nonce":3558816459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6823","nonce":3558816459}]},"public_addr":"172.21.15.159:6819/3558816459","cluster_addr":"172.21.15.159:6821/3558816459","heartbeat_back_addr":"172.21.15.159:6825/3558816459","heartbeat_front_addr":"172.21.15.159:6823/3558816459","state":["exists","up"]},{"osd":3,"uuid":"bb2d95db-29e3-4e8d-bcea-ed52ae538c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6801","nonce":3861297213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6803","nonce":3861297213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6807","nonce":3861297213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6805","nonce":3861297213}]},"public_addr":"172.21.15.184:6801/3861297213","cluster_addr":"172.21.15.184:6803/3861297213","heartbeat_back_addr":"172.21.15.184:6807/3861297213","heartbeat_front_addr":"172.21.15.184:6805/3861297213","state":["exists","up"]},{"osd":4,"uuid":"55d22d45-549c-4a55-8a36-7aa785561068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6809","nonce":3952225914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6811","nonce":3952225914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6815","nonce":3952225914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6813","nonce":3952225914}]},"public_addr":"172.21.15.184:6809/3952225914","cluster_addr":"172.21.15.184:6811/3952225914","heartbeat_back_addr":"172.21.15.184:6815/3952225914","heartbeat_front_addr":"172.21.15.184:6813/3952225914","state":["exists","up"]},{"osd":5,"uuid":"eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6817","nonce":1171078927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6819","nonce":1171078927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6823","nonce":1171078927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6821","nonce":1171078927}]},"public_addr":"172.21.15.184:6817/1171078927","cluster_addr":"172.21.15.184:6819/1171078927","heartbeat_back_addr":"172.21.15.184:6823/1171078927","heartbeat_front_addr":"172.21.15.184:6821/1171078927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:58:47.192772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:59:24.679857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:03.155438+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:35.629938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:09.895470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:43.528444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:6801/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:6800/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/2242263974":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/1337780901":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/3426997920":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6801/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6800/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:0/2053056032":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6801/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.159:6800/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/423942112":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/74577353":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/3456040694":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/3945263774":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/528876824":"2024-02-29T22:55:32.103959+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T23:02:09.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.675+0000 7fddfdc00700 1 -- 172.21.15.159:0/2511552554 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fdddc06c4e0 msgr2=0x7fdddc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:09.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.675+0000 7fddfdc00700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fdddc06c4e0 0x7fdddc06e9a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdde4005fd0 tx=0x7fdde4005dc0 comp rx=0 tx=0).stop 2024-02-28T23:02:09.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.675+0000 7fddfdc00700 1 -- 172.21.15.159:0/2511552554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80752c0 msgr2=0x7fddf81a2a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:09.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.675+0000 7fddfdc00700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80752c0 0x7fddf81a2a60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdde8005b40 tx=0x7fdde80056a0 comp rx=0 tx=0).stop 2024-02-28T23:02:09.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.676+0000 7fddfdc00700 1 -- 172.21.15.159:0/2511552554 shutdown_connections 2024-02-28T23:02:09.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.676+0000 7fddfdc00700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fdddc06c4e0 0x7fdddc06e9a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:09.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.676+0000 7fddfdc00700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fddf80752c0 0x7fddf81a2a60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:09.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.676+0000 7fddfdc00700 1 --2- 172.21.15.159:0/2511552554 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fddf8075be0 0x7fddf81a2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:09.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.676+0000 7fddfdc00700 1 -- 172.21.15.159:0/2511552554 >> 172.21.15.159:0/2511552554 conn(0x7fddf80fe890 msgr2=0x7fddf80ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:09.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.676+0000 7fddfdc00700 1 -- 172.21.15.159:0/2511552554 shutdown_connections 2024-02-28T23:02:09.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:09.676+0000 7fddfdc00700 1 -- 172.21.15.159:0/2511552554 wait complete. 2024-02-28T23:02:10.443 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-28T23:02:10.444 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd dump --format=json 2024-02-28T23:02:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:10 smithi159 ceph-mon[28802]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:10 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2511552554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:02:10.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:10 smithi184 ceph-mon[36198]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:10.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:10 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2511552554' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:02:10.857 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:12 smithi159 ceph-mon[28802]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:12.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:12 smithi184 ceph-mon[36198]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:13.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.040+0000 7fc1b8600700 1 -- 172.21.15.159:0/925287717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b0100dc0 msgr2=0x7fc1b01011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:13.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.040+0000 7fc1b8600700 1 --2- 172.21.15.159:0/925287717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b0100dc0 0x7fc1b01011a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009910 tx=0x7fc1a4009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:13.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.040+0000 7fc1b8600700 1 -- 172.21.15.159:0/925287717 shutdown_connections 2024-02-28T23:02:13.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.040+0000 7fc1b8600700 1 --2- 172.21.15.159:0/925287717 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b0101770 0x7fc1b01057c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:13.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.040+0000 7fc1b8600700 1 --2- 172.21.15.159:0/925287717 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b0100dc0 0x7fc1b01011a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:13.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.040+0000 7fc1b8600700 1 -- 172.21.15.159:0/925287717 >> 172.21.15.159:0/925287717 conn(0x7fc1b00fc650 msgr2=0x7fc1b00fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:13.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.041+0000 7fc1b8600700 1 -- 172.21.15.159:0/925287717 shutdown_connections 2024-02-28T23:02:13.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.041+0000 7fc1b8600700 1 -- 172.21.15.159:0/925287717 wait complete. 2024-02-28T23:02:13.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.042+0000 7fc1b8600700 1 Processor -- start 2024-02-28T23:02:13.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.042+0000 7fc1b8600700 1 -- start start 2024-02-28T23:02:13.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.042+0000 7fc1b8600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b0100dc0 0x7fc1b0073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:13.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.042+0000 7fc1b8600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b0101770 0x7fc1b00735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:13.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.042+0000 7fc1b8600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0073b10 con 0x7fc1b0101770 2024-02-28T23:02:13.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.042+0000 7fc1b8600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b0073c50 con 0x7fc1b0100dc0 2024-02-28T23:02:13.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.042+0000 7fc1b5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b0101770 0x7fc1b00735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:13.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.043+0000 7fc1b5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b0101770 0x7fc1b00735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46256/0 (socket says 172.21.15.159:46256) 2024-02-28T23:02:13.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.043+0000 7fc1b5200700 1 -- 172.21.15.159:0/33674863 learned_addr learned my addr 172.21.15.159:0/33674863 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:13.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.043+0000 7fc1b5c00700 1 --2- 172.21.15.159:0/33674863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b0100dc0 0x7fc1b0073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:13.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.043+0000 7fc1b5200700 1 -- 172.21.15.159:0/33674863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b0100dc0 msgr2=0x7fc1b0073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:13.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.043+0000 7fc1b5200700 1 --2- 172.21.15.159:0/33674863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b0100dc0 0x7fc1b0073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:13.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.043+0000 7fc1b5200700 1 -- 172.21.15.159:0/33674863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a40095f0 con 0x7fc1b0101770 2024-02-28T23:02:13.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.043+0000 7fc1b5200700 1 --2- 172.21.15.159:0/33674863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b0101770 0x7fc1b00735d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00d900 tx=0x7fc19c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:13.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.044+0000 7fc1ae000700 1 -- 172.21.15.159:0/33674863 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc19c009900 con 0x7fc1b0101770 2024-02-28T23:02:13.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.044+0000 7fc1ae000700 1 -- 172.21.15.159:0/33674863 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc19c010460 con 0x7fc1b0101770 2024-02-28T23:02:13.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.044+0000 7fc1ae000700 1 -- 172.21.15.159:0/33674863 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc19c00f5f0 con 0x7fc1b0101770 2024-02-28T23:02:13.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.044+0000 7fc1b8600700 1 -- 172.21.15.159:0/33674863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b01a2900 con 0x7fc1b0101770 2024-02-28T23:02:13.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.044+0000 7fc1b8600700 1 -- 172.21.15.159:0/33674863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b01a2c60 con 0x7fc1b0101770 2024-02-28T23:02:13.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.045+0000 7fc1b8600700 1 -- 172.21.15.159:0/33674863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b0109160 con 0x7fc1b0101770 2024-02-28T23:02:13.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.046+0000 7fc1ae000700 1 -- 172.21.15.159:0/33674863 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fc19c0105d0 con 0x7fc1b0101770 2024-02-28T23:02:13.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.047+0000 7fc1ae000700 1 --2- 172.21.15.159:0/33674863 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc19806c4e0 0x7fc19806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:13.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.047+0000 7fc1ae000700 1 -- 172.21.15.159:0/33674863 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc19c08b2f0 con 0x7fc1b0101770 2024-02-28T23:02:13.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.047+0000 7fc1b5c00700 1 --2- 172.21.15.159:0/33674863 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc19806c4e0 0x7fc19806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:13.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.048+0000 7fc1b5c00700 1 --2- 172.21.15.159:0/33674863 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc19806c4e0 0x7fc19806e9a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4006010 tx=0x7fc1a401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:13.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.051+0000 7fc1ae000700 1 -- 172.21.15.159:0/33674863 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fc19c055df0 con 0x7fc1b0101770 2024-02-28T23:02:13.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.267+0000 7fc1b8600700 1 -- 172.21.15.159:0/33674863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc1b004ea90 con 0x7fc1b0101770 2024-02-28T23:02:13.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.269+0000 7fc1ae000700 1 -- 172.21.15.159:0/33674863 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11398 (secure 0 0 0) 0x7fc19c059410 con 0x7fc1b0101770 2024-02-28T23:02:13.267 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:02:13.267 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":40,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","created":"2024-02-28T22:54:07.259600+0000","modified":"2024-02-28T23:01:45.607869+0000","last_up_change":"2024-02-28T23:01:44.596739+0000","last_in_change":"2024-02-28T23:01:21.082396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T23:00:05.643400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"12a358ec-2348-437f-a587-c75299c13814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6803","nonce":3574200223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6805","nonce":3574200223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6809","nonce":3574200223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6807","nonce":3574200223}]},"public_addr":"172.21.15.159:6803/3574200223","cluster_addr":"172.21.15.159:6805/3574200223","heartbeat_back_addr":"172.21.15.159:6809/3574200223","heartbeat_front_addr":"172.21.15.159:6807/3574200223","state":["exists","up"]},{"osd":1,"uuid":"34a65dc7-3bd8-4cb5-b61b-e04166f115c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6811","nonce":2108285298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6813","nonce":2108285298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6817","nonce":2108285298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6815","nonce":2108285298}]},"public_addr":"172.21.15.159:6811/2108285298","cluster_addr":"172.21.15.159:6813/2108285298","heartbeat_back_addr":"172.21.15.159:6817/2108285298","heartbeat_front_addr":"172.21.15.159:6815/2108285298","state":["exists","up"]},{"osd":2,"uuid":"a712ee56-f8b8-43c4-9f38-33ebe33b7977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6819","nonce":3558816459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6821","nonce":3558816459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6825","nonce":3558816459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6823","nonce":3558816459}]},"public_addr":"172.21.15.159:6819/3558816459","cluster_addr":"172.21.15.159:6821/3558816459","heartbeat_back_addr":"172.21.15.159:6825/3558816459","heartbeat_front_addr":"172.21.15.159:6823/3558816459","state":["exists","up"]},{"osd":3,"uuid":"bb2d95db-29e3-4e8d-bcea-ed52ae538c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6801","nonce":3861297213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6803","nonce":3861297213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6807","nonce":3861297213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6805","nonce":3861297213}]},"public_addr":"172.21.15.184:6801/3861297213","cluster_addr":"172.21.15.184:6803/3861297213","heartbeat_back_addr":"172.21.15.184:6807/3861297213","heartbeat_front_addr":"172.21.15.184:6805/3861297213","state":["exists","up"]},{"osd":4,"uuid":"55d22d45-549c-4a55-8a36-7aa785561068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6809","nonce":3952225914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6811","nonce":3952225914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6815","nonce":3952225914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6813","nonce":3952225914}]},"public_addr":"172.21.15.184:6809/3952225914","cluster_addr":"172.21.15.184:6811/3952225914","heartbeat_back_addr":"172.21.15.184:6815/3952225914","heartbeat_front_addr":"172.21.15.184:6813/3952225914","state":["exists","up"]},{"osd":5,"uuid":"eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6817","nonce":1171078927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6819","nonce":1171078927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6823","nonce":1171078927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6821","nonce":1171078927}]},"public_addr":"172.21.15.184:6817/1171078927","cluster_addr":"172.21.15.184:6819/1171078927","heartbeat_back_addr":"172.21.15.184:6823/1171078927","heartbeat_front_addr":"172.21.15.184:6821/1171078927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:58:47.192772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:59:24.679857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:03.155438+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:35.629938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:09.895470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:43.528444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:6801/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:6800/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/2242263974":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/1337780901":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/3426997920":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6801/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6800/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:0/2053056032":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6801/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.159:6800/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/423942112":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/74577353":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/3456040694":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/3945263774":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/528876824":"2024-02-29T22:55:32.103959+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T23:02:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.272+0000 7fc1b8600700 1 -- 172.21.15.159:0/33674863 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc19806c4e0 msgr2=0x7fc19806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.272+0000 7fc1b8600700 1 --2- 172.21.15.159:0/33674863 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc19806c4e0 0x7fc19806e9a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4006010 tx=0x7fc1a401a040 comp rx=0 tx=0).stop 2024-02-28T23:02:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.272+0000 7fc1b8600700 1 -- 172.21.15.159:0/33674863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b0101770 msgr2=0x7fc1b00735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.272+0000 7fc1b8600700 1 --2- 172.21.15.159:0/33674863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b0101770 0x7fc1b00735d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc19c00d900 tx=0x7fc19c00dcc0 comp rx=0 tx=0).stop 2024-02-28T23:02:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.272+0000 7fc1b8600700 1 -- 172.21.15.159:0/33674863 shutdown_connections 2024-02-28T23:02:13.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.272+0000 7fc1b8600700 1 --2- 172.21.15.159:0/33674863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc1b0100dc0 0x7fc1b0073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.272+0000 7fc1b8600700 1 --2- 172.21.15.159:0/33674863 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc19806c4e0 0x7fc19806e9a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.272+0000 7fc1b8600700 1 --2- 172.21.15.159:0/33674863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc1b0101770 0x7fc1b00735d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.272+0000 7fc1b8600700 1 -- 172.21.15.159:0/33674863 >> 172.21.15.159:0/33674863 conn(0x7fc1b00fc650 msgr2=0x7fc1b00fddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.272+0000 7fc1b8600700 1 -- 172.21.15.159:0/33674863 shutdown_connections 2024-02-28T23:02:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:13.272+0000 7fc1b8600700 1 -- 172.21.15.159:0/33674863 wait complete. 2024-02-28T23:02:14.132 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-28T23:02:14.133 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-28T23:02:14.133 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-28T23:02:14.133 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-28T23:02:14.134 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-28T23:02:14.134 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-28T23:02:14.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:14 smithi159 ceph-mon[28802]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:14.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:14 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/33674863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:02:14.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:14 smithi184 ceph-mon[36198]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:14.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:14 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/33674863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:02:14.657 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:14.658 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:14.675 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:14.752 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:14.753 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:15.293 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:16.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:16 smithi159 ceph-mon[28802]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:16.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:16 smithi184 ceph-mon[36198]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:18.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:18 smithi184 ceph-mon[36198]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:18 smithi159 ceph-mon[28802]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:20.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:20 smithi159 ceph-mon[28802]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:20.343 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:02:20.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:20 smithi184 ceph-mon[36198]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:02:21.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.820+0000 7f6f15400700 1 -- 172.21.15.159:0/869107877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f10102630 msgr2=0x7f6f1010ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:21.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.820+0000 7f6f15400700 1 --2- 172.21.15.159:0/869107877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f10102630 0x7f6f1010ab20 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6efc009910 tx=0x7f6efc009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:21.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.821+0000 7f6f15400700 1 -- 172.21.15.159:0/869107877 shutdown_connections 2024-02-28T23:02:21.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.821+0000 7f6f15400700 1 --2- 172.21.15.159:0/869107877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f10102630 0x7f6f1010ab20 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:21.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.821+0000 7f6f15400700 1 --2- 172.21.15.159:0/869107877 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f10101d10 0x7f6f101020f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:21.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.821+0000 7f6f15400700 1 -- 172.21.15.159:0/869107877 >> 172.21.15.159:0/869107877 conn(0x7f6f100fb540 msgr2=0x7f6f100fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:21.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.821+0000 7f6f15400700 1 -- 172.21.15.159:0/869107877 shutdown_connections 2024-02-28T23:02:21.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.821+0000 7f6f15400700 1 -- 172.21.15.159:0/869107877 wait complete. 2024-02-28T23:02:21.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.822+0000 7f6f15400700 1 Processor -- start 2024-02-28T23:02:21.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.822+0000 7f6f15400700 1 -- start start 2024-02-28T23:02:21.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.822+0000 7f6f15400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f10101d10 0x7f6f1019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:21.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.822+0000 7f6f15400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f10102630 0x7f6f1019ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:21.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.822+0000 7f6f15400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1019f3c0 con 0x7f6f10102630 2024-02-28T23:02:21.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.822+0000 7f6f15400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f10198870 con 0x7f6f10101d10 2024-02-28T23:02:21.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.823+0000 7f6f0de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f10102630 0x7f6f1019ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:21.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.823+0000 7f6f0de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f10102630 0x7f6f1019ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53736/0 (socket says 172.21.15.159:53736) 2024-02-28T23:02:21.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.823+0000 7f6f0de00700 1 -- 172.21.15.159:0/4008864691 learned_addr learned my addr 172.21.15.159:0/4008864691 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:21.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.823+0000 7f6f0e800700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f10101d10 0x7f6f1019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:21.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.823+0000 7f6f0de00700 1 -- 172.21.15.159:0/4008864691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f10101d10 msgr2=0x7f6f1019e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:21.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.823+0000 7f6f0de00700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f10101d10 0x7f6f1019e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:21.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.823+0000 7f6f0de00700 1 -- 172.21.15.159:0/4008864691 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc0095f0 con 0x7f6f10102630 2024-02-28T23:02:21.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.823+0000 7f6f0de00700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f10102630 0x7f6f1019ed30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00bda0 tx=0x7f6efc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:21.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.824+0000 7f6f07400700 1 -- 172.21.15.159:0/4008864691 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6efc01d070 con 0x7f6f10102630 2024-02-28T23:02:21.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.824+0000 7f6f07400700 1 -- 172.21.15.159:0/4008864691 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6efc004fa0 con 0x7f6f10102630 2024-02-28T23:02:21.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.824+0000 7f6f15400700 1 -- 172.21.15.159:0/4008864691 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f10198af0 con 0x7f6f10102630 2024-02-28T23:02:21.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.824+0000 7f6f07400700 1 -- 172.21.15.159:0/4008864691 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6efc00f460 con 0x7f6f10102630 2024-02-28T23:02:21.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.824+0000 7f6f15400700 1 -- 172.21.15.159:0/4008864691 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f10198fe0 con 0x7f6f10102630 2024-02-28T23:02:21.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.825+0000 7f6f15400700 1 -- 172.21.15.159:0/4008864691 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f1010dff0 con 0x7f6f10102630 2024-02-28T23:02:21.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.826+0000 7f6f07400700 1 -- 172.21.15.159:0/4008864691 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f6efc022800 con 0x7f6f10102630 2024-02-28T23:02:21.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.827+0000 7f6f07400700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f6ef406c4e0 0x7f6ef406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:21.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.827+0000 7f6f07400700 1 -- 172.21.15.159:0/4008864691 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f6efc08ca60 con 0x7f6f10102630 2024-02-28T23:02:21.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.827+0000 7f6f0e800700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f6ef406c4e0 0x7f6ef406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:21.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.827+0000 7f6f07400700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298] conn(0x7f6ef40721c0 0x7f6ef40745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:21.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.827+0000 7f6f07400700 1 -- 172.21.15.159:0/4008864691 --> [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6ef4074c90 con 0x7f6ef40721c0 2024-02-28T23:02:21.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.827+0000 7f6f07400700 1 -- 172.21.15.159:0/4008864691 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6efc0912a0 con 0x7f6f10102630 2024-02-28T23:02:21.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.827+0000 7f6f0f200700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298] conn(0x7f6ef40721c0 0x7f6ef40745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:21.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.828+0000 7f6f0e800700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f6ef406c4e0 0x7f6ef406e9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6f00005fd0 tx=0x7f6f0000a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:21.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.828+0000 7f6f0f200700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298] conn(0x7f6ef40721c0 0x7f6ef40745e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:21.829 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.829+0000 7f6f07400700 1 -- 172.21.15.159:0/4008864691 <== osd.1 v2:172.21.15.159:6810/2108285298 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f6ef4074c90 con 0x7f6ef40721c0 2024-02-28T23:02:21.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.846+0000 7f6f15400700 1 -- 172.21.15.159:0/4008864691 --> [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f10199500 con 0x7f6ef40721c0 2024-02-28T23:02:21.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.846+0000 7f6f07400700 1 -- 172.21.15.159:0/4008864691 <== osd.1 v2:172.21.15.159:6810/2108285298 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f10199500 con 0x7f6ef40721c0 2024-02-28T23:02:21.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 -- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298] conn(0x7f6ef40721c0 msgr2=0x7f6ef40745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:21.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298] conn(0x7f6ef40721c0 0x7f6ef40745e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:21.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 -- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f6ef406c4e0 msgr2=0x7f6ef406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:21.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f6ef406c4e0 0x7f6ef406e9a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6f00005fd0 tx=0x7f6f0000a560 comp rx=0 tx=0).stop 2024-02-28T23:02:21.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 -- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f10102630 msgr2=0x7f6f1019ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:21.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f10102630 0x7f6f1019ed30 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6efc00bda0 tx=0x7f6efc00be80 comp rx=0 tx=0).stop 2024-02-28T23:02:21.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 -- 172.21.15.159:0/4008864691 shutdown_connections 2024-02-28T23:02:21.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6810/2108285298,v1:172.21.15.159:6811/2108285298] conn(0x7f6ef40721c0 0x7f6ef40745e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:21.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6f10101d10 0x7f6f1019e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:21.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f6ef406c4e0 0x7f6ef406e9a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:21.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 --2- 172.21.15.159:0/4008864691 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6f10102630 0x7f6f1019ed30 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:21.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 -- 172.21.15.159:0/4008864691 >> 172.21.15.159:0/4008864691 conn(0x7f6f100fb540 msgr2=0x7f6f10100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:21.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 -- 172.21.15.159:0/4008864691 shutdown_connections 2024-02-28T23:02:21.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:21.847+0000 7f6f15400700 1 -- 172.21.15.159:0/4008864691 wait complete. 2024-02-28T23:02:22.373 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:22 smithi159 ceph-mon[28802]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:22.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:22 smithi184 ceph-mon[36198]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:22.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.614+0000 7fd6fe600700 1 -- 172.21.15.159:0/3963360851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f81039b0 msgr2=0x7fd6f8107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:22.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.614+0000 7fd6fe600700 1 --2- 172.21.15.159:0/3963360851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f81039b0 0x7fd6f8107a00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009910 tx=0x7fd6e4009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:22.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.614+0000 7fd6fe600700 1 -- 172.21.15.159:0/3963360851 shutdown_connections 2024-02-28T23:02:22.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.614+0000 7fd6fe600700 1 --2- 172.21.15.159:0/3963360851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f81039b0 0x7fd6f8107a00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:22.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.614+0000 7fd6fe600700 1 --2- 172.21.15.159:0/3963360851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6f8103000 0x7fd6f81033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:22.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.614+0000 7fd6fe600700 1 -- 172.21.15.159:0/3963360851 >> 172.21.15.159:0/3963360851 conn(0x7fd6f80fe8d0 msgr2=0x7fd6f8100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:22.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.615+0000 7fd6fe600700 1 -- 172.21.15.159:0/3963360851 shutdown_connections 2024-02-28T23:02:22.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.615+0000 7fd6fe600700 1 -- 172.21.15.159:0/3963360851 wait complete. 2024-02-28T23:02:22.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.616+0000 7fd6fe600700 1 Processor -- start 2024-02-28T23:02:22.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.616+0000 7fd6fe600700 1 -- start start 2024-02-28T23:02:22.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.616+0000 7fd6fe600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6f8103000 0x7fd6f819e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:22.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.616+0000 7fd6fe600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f81039b0 0x7fd6f819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:22.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.616+0000 7fd6fe600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f819f390 con 0x7fd6f81039b0 2024-02-28T23:02:22.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.616+0000 7fd6fe600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f8198840 con 0x7fd6f8103000 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.616+0000 7fd6f6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f81039b0 0x7fd6f819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.617+0000 7fd6f6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f81039b0 0x7fd6f819ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53754/0 (socket says 172.21.15.159:53754) 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.617+0000 7fd6f6a00700 1 -- 172.21.15.159:0/989896010 learned_addr learned my addr 172.21.15.159:0/989896010 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.617+0000 7fd6f7400700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6f8103000 0x7fd6f819e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.617+0000 7fd6f6a00700 1 -- 172.21.15.159:0/989896010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6f8103000 msgr2=0x7fd6f819e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.617+0000 7fd6f6a00700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6f8103000 0x7fd6f819e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.617+0000 7fd6f6a00700 1 -- 172.21.15.159:0/989896010 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e40095f0 con 0x7fd6f81039b0 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.617+0000 7fd6f7400700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6f8103000 0x7fd6f819e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.617+0000 7fd6f6a00700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f81039b0 0x7fd6f819ed00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400bda0 tx=0x7fd6e400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.617+0000 7fd6efe00700 1 -- 172.21.15.159:0/989896010 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e401d070 con 0x7fd6f81039b0 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.618+0000 7fd6efe00700 1 -- 172.21.15.159:0/989896010 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd6e400f460 con 0x7fd6f81039b0 2024-02-28T23:02:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.618+0000 7fd6efe00700 1 -- 172.21.15.159:0/989896010 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e4017630 con 0x7fd6f81039b0 2024-02-28T23:02:22.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.618+0000 7fd6fe600700 1 -- 172.21.15.159:0/989896010 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f8198ac0 con 0x7fd6f81039b0 2024-02-28T23:02:22.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.618+0000 7fd6fe600700 1 -- 172.21.15.159:0/989896010 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f8198fb0 con 0x7fd6f81039b0 2024-02-28T23:02:22.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.619+0000 7fd6fe600700 1 -- 172.21.15.159:0/989896010 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6f8110220 con 0x7fd6f81039b0 2024-02-28T23:02:22.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.620+0000 7fd6efe00700 1 -- 172.21.15.159:0/989896010 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fd6e400fad0 con 0x7fd6f81039b0 2024-02-28T23:02:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.621+0000 7fd6efe00700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd6dc06c4e0 0x7fd6dc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.621+0000 7fd6efe00700 1 -- 172.21.15.159:0/989896010 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd6e408c950 con 0x7fd6f81039b0 2024-02-28T23:02:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.621+0000 7fd6f7400700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd6dc06c4e0 0x7fd6dc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.621+0000 7fd6efe00700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914] conn(0x7fd6dc0721c0 0x7fd6dc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.621+0000 7fd6efe00700 1 -- 172.21.15.159:0/989896010 --> [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6dc074c90 con 0x7fd6dc0721c0 2024-02-28T23:02:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.621+0000 7fd6efe00700 1 -- 172.21.15.159:0/989896010 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6e40912a0 con 0x7fd6f81039b0 2024-02-28T23:02:22.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.622+0000 7fd6f7400700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd6dc06c4e0 0x7fd6dc06e9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8005fd0 tx=0x7fd6e8005ee0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:22.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.622+0000 7fd6f7e00700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914] conn(0x7fd6dc0721c0 0x7fd6dc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:22.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.623+0000 7fd6f7e00700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914] conn(0x7fd6dc0721c0 0x7fd6dc0745e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:22.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.625+0000 7fd6efe00700 1 -- 172.21.15.159:0/989896010 <== osd.4 v2:172.21.15.184:6808/3952225914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fd6dc074c90 con 0x7fd6dc0721c0 2024-02-28T23:02:22.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.642+0000 7fd6fe600700 1 -- 172.21.15.159:0/989896010 --> [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6f804ea90 con 0x7fd6dc0721c0 2024-02-28T23:02:22.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.643+0000 7fd6efe00700 1 -- 172.21.15.159:0/989896010 <== osd.4 v2:172.21.15.184:6808/3952225914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fd6f804ea90 con 0x7fd6dc0721c0 2024-02-28T23:02:22.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.643+0000 7fd6fe600700 1 -- 172.21.15.159:0/989896010 >> [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914] conn(0x7fd6dc0721c0 msgr2=0x7fd6dc0745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:22.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.643+0000 7fd6fe600700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914] conn(0x7fd6dc0721c0 0x7fd6dc0745e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:22.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 -- 172.21.15.159:0/989896010 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd6dc06c4e0 msgr2=0x7fd6dc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:22.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd6dc06c4e0 0x7fd6dc06e9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6e8005fd0 tx=0x7fd6e8005ee0 comp rx=0 tx=0).stop 2024-02-28T23:02:22.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 -- 172.21.15.159:0/989896010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f81039b0 msgr2=0x7fd6f819ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:22.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f81039b0 0x7fd6f819ed00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd6e400bda0 tx=0x7fd6e400be80 comp rx=0 tx=0).stop 2024-02-28T23:02:22.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 -- 172.21.15.159:0/989896010 shutdown_connections 2024-02-28T23:02:22.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.184:6808/3952225914,v1:172.21.15.184:6809/3952225914] conn(0x7fd6dc0721c0 0x7fd6dc0745e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:22.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6f8103000 0x7fd6f819e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:22.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd6dc06c4e0 0x7fd6dc06e9a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:22.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 --2- 172.21.15.159:0/989896010 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6f81039b0 0x7fd6f819ed00 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:22.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 -- 172.21.15.159:0/989896010 >> 172.21.15.159:0/989896010 conn(0x7fd6f80fe8d0 msgr2=0x7fd6f8100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:22.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 -- 172.21.15.159:0/989896010 shutdown_connections 2024-02-28T23:02:22.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.644+0000 7fd6fe600700 1 -- 172.21.15.159:0/989896010 wait complete. 2024-02-28T23:02:23.784 INFO:teuthology.orchestra.run.smithi159.stdout:146028888081 2024-02-28T23:02:23.785 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-28T23:02:24.508 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:24 smithi159 ceph-mon[28802]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:24.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:24 smithi184 ceph-mon[36198]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:25.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.031+0000 7f4cfc800700 1 -- 172.21.15.159:0/1513894054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4100da0 msgr2=0x7f4cf4101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:25.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.031+0000 7f4cfc800700 1 --2- 172.21.15.159:0/1513894054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4100da0 0x7f4cf4101180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009910 tx=0x7f4ce8009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:25.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.032+0000 7f4cfc800700 1 -- 172.21.15.159:0/1513894054 shutdown_connections 2024-02-28T23:02:25.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.032+0000 7f4cfc800700 1 --2- 172.21.15.159:0/1513894054 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cf4101750 0x7f4cf41057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.032+0000 7f4cfc800700 1 --2- 172.21.15.159:0/1513894054 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4100da0 0x7f4cf4101180 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.032+0000 7f4cfc800700 1 -- 172.21.15.159:0/1513894054 >> 172.21.15.159:0/1513894054 conn(0x7f4cf40fc630 msgr2=0x7f4cf40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:25.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.032+0000 7f4cfc800700 1 -- 172.21.15.159:0/1513894054 shutdown_connections 2024-02-28T23:02:25.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.032+0000 7f4cfc800700 1 -- 172.21.15.159:0/1513894054 wait complete. 2024-02-28T23:02:25.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.033+0000 7f4cfc800700 1 Processor -- start 2024-02-28T23:02:25.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.033+0000 7f4cfc800700 1 -- start start 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.033+0000 7f4cfc800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4100da0 0x7f4cf4073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.033+0000 7f4cfc800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cf4101750 0x7f4cf40735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.033+0000 7f4cfc800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4073b10 con 0x7f4cf4100da0 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.033+0000 7f4cfc800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4073c50 con 0x7f4cf4101750 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.033+0000 7f4cf9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4100da0 0x7f4cf4073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.033+0000 7f4cf9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4100da0 0x7f4cf4073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53792/0 (socket says 172.21.15.159:53792) 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.033+0000 7f4cf9e00700 1 -- 172.21.15.159:0/1854009659 learned_addr learned my addr 172.21.15.159:0/1854009659 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.034+0000 7f4cf9400700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cf4101750 0x7f4cf40735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.034+0000 7f4cf9e00700 1 -- 172.21.15.159:0/1854009659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cf4101750 msgr2=0x7f4cf40735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.034+0000 7f4cf9e00700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cf4101750 0x7f4cf40735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.034+0000 7f4cf9e00700 1 -- 172.21.15.159:0/1854009659 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80095f0 con 0x7f4cf4100da0 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.034+0000 7f4cf9400700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cf4101750 0x7f4cf40735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:02:25.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.034+0000 7f4cf9e00700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4100da0 0x7f4cf4073090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800b5c0 tx=0x7f4ce800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.034+0000 7f4ceea00700 1 -- 172.21.15.159:0/1854009659 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ce801d070 con 0x7f4cf4100da0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.034+0000 7f4ceea00700 1 -- 172.21.15.159:0/1854009659 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4ce8022470 con 0x7f4cf4100da0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.034+0000 7f4cfc800700 1 -- 172.21.15.159:0/1854009659 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf4073ed0 con 0x7f4cf4100da0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.034+0000 7f4ceea00700 1 -- 172.21.15.159:0/1854009659 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ce800f670 con 0x7f4cf4100da0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.035+0000 7f4cfc800700 1 -- 172.21.15.159:0/1854009659 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf41a2cd0 con 0x7f4cf4100da0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.036+0000 7f4cfc800700 1 -- 172.21.15.159:0/1854009659 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4cf410e0e0 con 0x7f4cf4100da0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.036+0000 7f4ceea00700 1 -- 172.21.15.159:0/1854009659 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f4ce8004c30 con 0x7f4cf4100da0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.037+0000 7f4ceea00700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4cdc06c4e0 0x7f4cdc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.037+0000 7f4ceea00700 1 -- 172.21.15.159:0/1854009659 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f4ce808cb70 con 0x7f4cf4100da0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.038+0000 7f4cf9400700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4cdc06c4e0 0x7f4cdc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.038+0000 7f4ceea00700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223] conn(0x7f4cdc0721c0 0x7f4cdc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.038+0000 7f4ceea00700 1 -- 172.21.15.159:0/1854009659 --> [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4cdc074c90 con 0x7f4cdc0721c0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.038+0000 7f4ceea00700 1 -- 172.21.15.159:0/1854009659 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ce80912a0 con 0x7f4cf4100da0 2024-02-28T23:02:25.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.038+0000 7f4cfa800700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223] conn(0x7f4cdc0721c0 0x7f4cdc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.038+0000 7f4cf9400700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4cdc06c4e0 0x7f4cdc06e9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4074880 tx=0x7f4ce4008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.039+0000 7f4cfa800700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223] conn(0x7f4cdc0721c0 0x7f4cdc0745e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.040+0000 7f4ceea00700 1 -- 172.21.15.159:0/1854009659 <== osd.0 v2:172.21.15.159:6802/3574200223 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f4cdc074c90 con 0x7f4cdc0721c0 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.058+0000 7f4cfc800700 1 -- 172.21.15.159:0/1854009659 --> [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4cf404ea90 con 0x7f4cdc0721c0 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.059+0000 7f4ceea00700 1 -- 172.21.15.159:0/1854009659 <== osd.0 v2:172.21.15.159:6802/3574200223 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4cf404ea90 con 0x7f4cdc0721c0 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.059+0000 7f4cfc800700 1 -- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223] conn(0x7f4cdc0721c0 msgr2=0x7f4cdc0745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.059+0000 7f4cfc800700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223] conn(0x7f4cdc0721c0 0x7f4cdc0745e0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.059+0000 7f4cfc800700 1 -- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4cdc06c4e0 msgr2=0x7f4cdc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.059+0000 7f4cfc800700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4cdc06c4e0 0x7f4cdc06e9a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4cf4074880 tx=0x7f4ce4008040 comp rx=0 tx=0).stop 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.060+0000 7f4cfc800700 1 -- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4100da0 msgr2=0x7f4cf4073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.060+0000 7f4cfc800700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4100da0 0x7f4cf4073090 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800b5c0 tx=0x7f4ce800be00 comp rx=0 tx=0).stop 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.060+0000 7f4cfc800700 1 -- 172.21.15.159:0/1854009659 shutdown_connections 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.060+0000 7f4cfc800700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6802/3574200223,v1:172.21.15.159:6803/3574200223] conn(0x7f4cdc0721c0 0x7f4cdc0745e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.060+0000 7f4cfc800700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f4cdc06c4e0 0x7f4cdc06e9a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.060+0000 7f4cfc800700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cf4100da0 0x7f4cf4073090 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.060+0000 7f4cfc800700 1 --2- 172.21.15.159:0/1854009659 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4cf4101750 0x7f4cf40735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.060+0000 7f4cfc800700 1 -- 172.21.15.159:0/1854009659 >> 172.21.15.159:0/1854009659 conn(0x7f4cf40fc630 msgr2=0x7f4cf40fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:25.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.060+0000 7f4cfc800700 1 -- 172.21.15.159:0/1854009659 shutdown_connections 2024-02-28T23:02:25.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.060+0000 7f4cfc800700 1 -- 172.21.15.159:0/1854009659 wait complete. 2024-02-28T23:02:25.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.821+0000 7fc7f0e00700 1 -- 172.21.15.159:0/2778235482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7ec102fd0 msgr2=0x7fc7ec1033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:25.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.821+0000 7fc7f0e00700 1 --2- 172.21.15.159:0/2778235482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7ec102fd0 0x7fc7ec1033b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc009910 tx=0x7fc7dc009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.821+0000 7fc7f0e00700 1 -- 172.21.15.159:0/2778235482 shutdown_connections 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.821+0000 7fc7f0e00700 1 --2- 172.21.15.159:0/2778235482 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7ec103980 0x7fc7ec1079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.821+0000 7fc7f0e00700 1 --2- 172.21.15.159:0/2778235482 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7ec102fd0 0x7fc7ec1033b0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.821+0000 7fc7f0e00700 1 -- 172.21.15.159:0/2778235482 >> 172.21.15.159:0/2778235482 conn(0x7fc7ec0fe800 msgr2=0x7fc7ec100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.821+0000 7fc7f0e00700 1 -- 172.21.15.159:0/2778235482 shutdown_connections 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.821+0000 7fc7f0e00700 1 -- 172.21.15.159:0/2778235482 wait complete. 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.822+0000 7fc7f0e00700 1 Processor -- start 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.822+0000 7fc7f0e00700 1 -- start start 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.822+0000 7fc7f0e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7ec102fd0 0x7fc7ec198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.822+0000 7fc7f0e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7ec103980 0x7fc7ec198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.823+0000 7fc7f0e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec199520 con 0x7fc7ec102fd0 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.823+0000 7fc7f0e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ec19d330 con 0x7fc7ec103980 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.823+0000 7fc7e9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7ec102fd0 0x7fc7ec198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.823+0000 7fc7e9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7ec102fd0 0x7fc7ec198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53760/0 (socket says 172.21.15.159:53760) 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.823+0000 7fc7e9e00700 1 -- 172.21.15.159:0/4196677430 learned_addr learned my addr 172.21.15.159:0/4196677430 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.823+0000 7fc7e9400700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7ec103980 0x7fc7ec198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.823+0000 7fc7e9e00700 1 -- 172.21.15.159:0/4196677430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7ec103980 msgr2=0x7fc7ec198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.823+0000 7fc7e9e00700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7ec103980 0x7fc7ec198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.823+0000 7fc7e9e00700 1 -- 172.21.15.159:0/4196677430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7dc0095f0 con 0x7fc7ec102fd0 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.823+0000 7fc7e9e00700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7ec102fd0 0x7fc7ec198950 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc006010 tx=0x7fc7dc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.824+0000 7fc7e2a00700 1 -- 172.21.15.159:0/4196677430 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7dc01d070 con 0x7fc7ec102fd0 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.824+0000 7fc7e2a00700 1 -- 172.21.15.159:0/4196677430 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc7dc00f460 con 0x7fc7ec102fd0 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.824+0000 7fc7e2a00700 1 -- 172.21.15.159:0/4196677430 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc7dc017630 con 0x7fc7ec102fd0 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.824+0000 7fc7f0e00700 1 -- 172.21.15.159:0/4196677430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7ec19d5b0 con 0x7fc7ec102fd0 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.824+0000 7fc7f0e00700 1 -- 172.21.15.159:0/4196677430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7ec19daa0 con 0x7fc7ec102fd0 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.825+0000 7fc7f0e00700 1 -- 172.21.15.159:0/4196677430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc7ec110260 con 0x7fc7ec102fd0 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.826+0000 7fc7e2a00700 1 -- 172.21.15.159:0/4196677430 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fc7dc00f5d0 con 0x7fc7ec102fd0 2024-02-28T23:02:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.827+0000 7fc7e2a00700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc7d006c4e0 0x7fc7d006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.827+0000 7fc7e2a00700 1 -- 172.21.15.159:0/4196677430 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fc7dc08cd20 con 0x7fc7ec102fd0 2024-02-28T23:02:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.827+0000 7fc7e2a00700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459] conn(0x7fc7d00721c0 0x7fc7d00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.827+0000 7fc7e2a00700 1 -- 172.21.15.159:0/4196677430 --> [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc7d0074c90 con 0x7fc7d00721c0 2024-02-28T23:02:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.827+0000 7fc7e2a00700 1 -- 172.21.15.159:0/4196677430 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7dc08d0e0 con 0x7fc7ec102fd0 2024-02-28T23:02:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.827+0000 7fc7e9400700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc7d006c4e0 0x7fc7d006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.827+0000 7fc7ea800700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459] conn(0x7fc7d00721c0 0x7fc7d00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.828+0000 7fc7e9400700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc7d006c4e0 0x7fc7d006e9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8005fd0 tx=0x7fc7d800a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.828+0000 7fc7ea800700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459] conn(0x7fc7d00721c0 0x7fc7d00745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.829+0000 7fc7e2a00700 1 -- 172.21.15.159:0/4196677430 <== osd.2 v2:172.21.15.159:6818/3558816459 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fc7d0074c90 con 0x7fc7d00721c0 2024-02-28T23:02:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.846+0000 7fc7f0e00700 1 -- 172.21.15.159:0/4196677430 --> [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc7ec04ea90 con 0x7fc7d00721c0 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.846+0000 7fc7e2a00700 1 -- 172.21.15.159:0/4196677430 <== osd.2 v2:172.21.15.159:6818/3558816459 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc7ec04ea90 con 0x7fc7d00721c0 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 -- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459] conn(0x7fc7d00721c0 msgr2=0x7fc7d00745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459] conn(0x7fc7d00721c0 0x7fc7d00745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 -- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc7d006c4e0 msgr2=0x7fc7d006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc7d006c4e0 0x7fc7d006e9a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc7d8005fd0 tx=0x7fc7d800a560 comp rx=0 tx=0).stop 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 -- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7ec102fd0 msgr2=0x7fc7ec198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7ec102fd0 0x7fc7ec198950 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc006010 tx=0x7fc7dc00be20 comp rx=0 tx=0).stop 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 -- 172.21.15.159:0/4196677430 shutdown_connections 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6818/3558816459,v1:172.21.15.159:6819/3558816459] conn(0x7fc7d00721c0 0x7fc7d00745e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fc7d006c4e0 0x7fc7d006e9a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7ec102fd0 0x7fc7ec198950 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 --2- 172.21.15.159:0/4196677430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7ec103980 0x7fc7ec198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 -- 172.21.15.159:0/4196677430 >> 172.21.15.159:0/4196677430 conn(0x7fc7ec0fe800 msgr2=0x7fc7ec0ffeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:25.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 -- 172.21.15.159:0/4196677430 shutdown_connections 2024-02-28T23:02:25.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:22.847+0000 7fc7f0e00700 1 -- 172.21.15.159:0/4196677430 wait complete. 2024-02-28T23:02:26.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.653+0000 7f851dc00700 1 -- 172.21.15.159:0/2931093099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8518073ae0 msgr2=0x7f851810ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:26.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.653+0000 7f851dc00700 1 --2- 172.21.15.159:0/2931093099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8518073ae0 0x7f851810ce40 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8504009910 tx=0x7f8504009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:26.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.653+0000 7f851dc00700 1 -- 172.21.15.159:0/2931093099 shutdown_connections 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.653+0000 7f851dc00700 1 --2- 172.21.15.159:0/2931093099 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8518073ae0 0x7f851810ce40 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.653+0000 7f851dc00700 1 --2- 172.21.15.159:0/2931093099 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85180731c0 0x7f85180735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.653+0000 7f851dc00700 1 -- 172.21.15.159:0/2931093099 >> 172.21.15.159:0/2931093099 conn(0x7f85180fc630 msgr2=0x7f85180fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.653+0000 7f851dc00700 1 -- 172.21.15.159:0/2931093099 shutdown_connections 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.654+0000 7f851dc00700 1 -- 172.21.15.159:0/2931093099 wait complete. 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.655+0000 7f851dc00700 1 Processor -- start 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.655+0000 7f851dc00700 1 -- start start 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.655+0000 7f851dc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85180731c0 0x7f8518198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.655+0000 7f851dc00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8518073ae0 0x7f8518198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.655+0000 7f851dc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8518199530 con 0x7f85180731c0 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.655+0000 7f851dc00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851819d340 con 0x7f8518073ae0 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.656+0000 7f8516a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85180731c0 0x7f8518198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.656+0000 7f8516a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85180731c0 0x7f8518198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53818/0 (socket says 172.21.15.159:53818) 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.656+0000 7f8516a00700 1 -- 172.21.15.159:0/2976991217 learned_addr learned my addr 172.21.15.159:0/2976991217 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:26.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.656+0000 7f8516000700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8518073ae0 0x7f8518198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.656+0000 7f8516a00700 1 -- 172.21.15.159:0/2976991217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8518073ae0 msgr2=0x7f8518198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.656+0000 7f8516a00700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8518073ae0 0x7f8518198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.656+0000 7f8516a00700 1 -- 172.21.15.159:0/2976991217 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85040095f0 con 0x7f85180731c0 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.656+0000 7f8516a00700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85180731c0 0x7f8518198960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f850800d8d0 tx=0x7f850800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.657+0000 7f850f400700 1 -- 172.21.15.159:0/2976991217 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8508009940 con 0x7f85180731c0 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.657+0000 7f850f400700 1 -- 172.21.15.159:0/2976991217 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8508010460 con 0x7f85180731c0 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.657+0000 7f850f400700 1 -- 172.21.15.159:0/2976991217 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f850800f5f0 con 0x7f85180731c0 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.657+0000 7f851dc00700 1 -- 172.21.15.159:0/2976991217 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851819d620 con 0x7f85180731c0 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.657+0000 7f851dc00700 1 -- 172.21.15.159:0/2976991217 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851819db70 con 0x7f85180731c0 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.658+0000 7f851dc00700 1 -- 172.21.15.159:0/2976991217 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8518110260 con 0x7f85180731c0 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.659+0000 7f850f400700 1 -- 172.21.15.159:0/2976991217 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f85080105d0 con 0x7f85180731c0 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.660+0000 7f850f400700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f84fc06c4e0 0x7f84fc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.660+0000 7f850f400700 1 -- 172.21.15.159:0/2976991217 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f850808b3f0 con 0x7f85180731c0 2024-02-28T23:02:26.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.660+0000 7f8516000700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f84fc06c4e0 0x7f84fc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:26.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.660+0000 7f850f400700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213] conn(0x7f84fc0721c0 0x7f84fc0745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:26.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.660+0000 7f850f400700 1 -- 172.21.15.159:0/2976991217 --> [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84fc074c90 con 0x7f84fc0721c0 2024-02-28T23:02:26.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.660+0000 7f850f400700 1 -- 172.21.15.159:0/2976991217 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f850808dac0 con 0x7f85180731c0 2024-02-28T23:02:26.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.661+0000 7f8516000700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f84fc06c4e0 0x7f84fc06e9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8518199f80 tx=0x7f850401a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:26.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.661+0000 7f8517400700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213] conn(0x7f84fc0721c0 0x7f84fc0745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:26.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.662+0000 7f8517400700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213] conn(0x7f84fc0721c0 0x7f84fc0745e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:26.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.664+0000 7f850f400700 1 -- 172.21.15.159:0/2976991217 <== osd.3 v2:172.21.15.184:6800/3861297213 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f84fc074c90 con 0x7f84fc0721c0 2024-02-28T23:02:26.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.681+0000 7f851dc00700 1 -- 172.21.15.159:0/2976991217 --> [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f851804ea90 con 0x7f84fc0721c0 2024-02-28T23:02:26.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.682+0000 7f850f400700 1 -- 172.21.15.159:0/2976991217 <== osd.3 v2:172.21.15.184:6800/3861297213 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f851804ea90 con 0x7f84fc0721c0 2024-02-28T23:02:26.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.682+0000 7f851dc00700 1 -- 172.21.15.159:0/2976991217 >> [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213] conn(0x7f84fc0721c0 msgr2=0x7f84fc0745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:26.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.682+0000 7f851dc00700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213] conn(0x7f84fc0721c0 0x7f84fc0745e0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.682+0000 7f851dc00700 1 -- 172.21.15.159:0/2976991217 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f84fc06c4e0 msgr2=0x7f84fc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:26.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.682+0000 7f851dc00700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f84fc06c4e0 0x7f84fc06e9a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8518199f80 tx=0x7f850401a040 comp rx=0 tx=0).stop 2024-02-28T23:02:26.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.682+0000 7f851dc00700 1 -- 172.21.15.159:0/2976991217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85180731c0 msgr2=0x7f8518198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:26.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.682+0000 7f851dc00700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85180731c0 0x7f8518198960 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f850800d8d0 tx=0x7f850800dc90 comp rx=0 tx=0).stop 2024-02-28T23:02:26.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.683+0000 7f851dc00700 1 -- 172.21.15.159:0/2976991217 shutdown_connections 2024-02-28T23:02:26.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.683+0000 7f851dc00700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.184:6800/3861297213,v1:172.21.15.184:6801/3861297213] conn(0x7f84fc0721c0 0x7f84fc0745e0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.683+0000 7f851dc00700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f84fc06c4e0 0x7f84fc06e9a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.683+0000 7f851dc00700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85180731c0 0x7f8518198960 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.683+0000 7f851dc00700 1 --2- 172.21.15.159:0/2976991217 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8518073ae0 0x7f8518198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.683+0000 7f851dc00700 1 -- 172.21.15.159:0/2976991217 >> 172.21.15.159:0/2976991217 conn(0x7f85180fc630 msgr2=0x7f8518107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:26.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.683+0000 7f851dc00700 1 -- 172.21.15.159:0/2976991217 shutdown_connections 2024-02-28T23:02:26.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:25.683+0000 7f851dc00700 1 -- 172.21.15.159:0/2976991217 wait complete. 2024-02-28T23:02:26.565 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:26 smithi159 ceph-mon[28802]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:26.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:26 smithi184 ceph-mon[36198]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:26.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.734+0000 7f3cf2600700 1 -- 172.21.15.159:0/2295619898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec105a40 msgr2=0x7f3cec105e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:26.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.734+0000 7f3cf2600700 1 --2- 172.21.15.159:0/2295619898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec105a40 0x7f3cec105e20 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc009910 tx=0x7f3cdc009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:26.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.734+0000 7f3cf2600700 1 -- 172.21.15.159:0/2295619898 shutdown_connections 2024-02-28T23:02:26.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.734+0000 7f3cf2600700 1 --2- 172.21.15.159:0/2295619898 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cec0ffa40 0x7f3cec0ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.734+0000 7f3cf2600700 1 --2- 172.21.15.159:0/2295619898 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec105a40 0x7f3cec105e20 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.734+0000 7f3cf2600700 1 -- 172.21.15.159:0/2295619898 >> 172.21.15.159:0/2295619898 conn(0x7f3cec0fb570 msgr2=0x7f3cec0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:26.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.734+0000 7f3cf2600700 1 -- 172.21.15.159:0/2295619898 shutdown_connections 2024-02-28T23:02:26.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.734+0000 7f3cf2600700 1 -- 172.21.15.159:0/2295619898 wait complete. 2024-02-28T23:02:26.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.736+0000 7f3cf2600700 1 Processor -- start 2024-02-28T23:02:26.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.736+0000 7f3cf2600700 1 -- start start 2024-02-28T23:02:26.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.736+0000 7f3cf2600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cec0ffa40 0x7f3cec19c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:26.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.736+0000 7f3cf2600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec105a40 0x7f3cec19ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:26.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.736+0000 7f3cf2600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec19d0f0 con 0x7f3cec105a40 2024-02-28T23:02:26.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.736+0000 7f3cf2600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec1965a0 con 0x7f3cec0ffa40 2024-02-28T23:02:26.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.737+0000 7f3ceaa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec105a40 0x7f3cec19ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:26.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.737+0000 7f3ceaa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec105a40 0x7f3cec19ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53832/0 (socket says 172.21.15.159:53832) 2024-02-28T23:02:26.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.737+0000 7f3ceaa00700 1 -- 172.21.15.159:0/2955757976 learned_addr learned my addr 172.21.15.159:0/2955757976 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:26.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.737+0000 7f3ceb400700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cec0ffa40 0x7f3cec19c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:26.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.737+0000 7f3ceaa00700 1 -- 172.21.15.159:0/2955757976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cec0ffa40 msgr2=0x7f3cec19c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:26.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.737+0000 7f3ceaa00700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cec0ffa40 0x7f3cec19c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.737+0000 7f3ceaa00700 1 -- 172.21.15.159:0/2955757976 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cdc0095f0 con 0x7f3cec105a40 2024-02-28T23:02:26.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.737+0000 7f3ceb400700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cec0ffa40 0x7f3cec19c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:02:26.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.738+0000 7f3ceaa00700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec105a40 0x7f3cec19ca60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800d8d0 tx=0x7f3cd800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:26.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.738+0000 7f3ce3e00700 1 -- 172.21.15.159:0/2955757976 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd8009940 con 0x7f3cec105a40 2024-02-28T23:02:26.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.738+0000 7f3ce3e00700 1 -- 172.21.15.159:0/2955757976 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3cd8010460 con 0x7f3cec105a40 2024-02-28T23:02:26.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.738+0000 7f3cf2600700 1 -- 172.21.15.159:0/2955757976 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec196880 con 0x7f3cec105a40 2024-02-28T23:02:26.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.738+0000 7f3ce3e00700 1 -- 172.21.15.159:0/2955757976 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cd800f5f0 con 0x7f3cec105a40 2024-02-28T23:02:26.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.738+0000 7f3cf2600700 1 -- 172.21.15.159:0/2955757976 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec196dd0 con 0x7f3cec105a40 2024-02-28T23:02:26.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.739+0000 7f3cf2600700 1 -- 172.21.15.159:0/2955757976 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3cec10e0e0 con 0x7f3cec105a40 2024-02-28T23:02:26.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.740+0000 7f3ce3e00700 1 -- 172.21.15.159:0/2955757976 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f3cd80105d0 con 0x7f3cec105a40 2024-02-28T23:02:26.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.741+0000 7f3ce3e00700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3cd006c4e0 0x7f3cd006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:26.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.741+0000 7f3ce3e00700 1 -- 172.21.15.159:0/2955757976 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f3cd808b4f0 con 0x7f3cec105a40 2024-02-28T23:02:26.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.741+0000 7f3ceb400700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3cd006c4e0 0x7f3cd006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:26.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.742+0000 7f3ce3e00700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927] conn(0x7f3cd00721c0 0x7f3cd00745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:26.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.742+0000 7f3ce3e00700 1 -- 172.21.15.159:0/2955757976 --> [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3cd0074c90 con 0x7f3cd00721c0 2024-02-28T23:02:26.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.742+0000 7f3ce3e00700 1 -- 172.21.15.159:0/2955757976 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cd808dbc0 con 0x7f3cec105a40 2024-02-28T23:02:26.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.742+0000 7f3ceb400700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3cd006c4e0 0x7f3cd006e9a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc006010 tx=0x7f3cdc01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:26.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.742+0000 7f3cebe00700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927] conn(0x7f3cd00721c0 0x7f3cd00745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:26.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.743+0000 7f3cebe00700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927] conn(0x7f3cd00721c0 0x7f3cd00745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:26.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.745+0000 7f3ce3e00700 1 -- 172.21.15.159:0/2955757976 <== osd.5 v2:172.21.15.184:6816/1171078927 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f3cd0074c90 con 0x7f3cd00721c0 2024-02-28T23:02:26.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.762+0000 7f3cf2600700 1 -- 172.21.15.159:0/2955757976 --> [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3cec04ea90 con 0x7f3cd00721c0 2024-02-28T23:02:26.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.763+0000 7f3ce3e00700 1 -- 172.21.15.159:0/2955757976 <== osd.5 v2:172.21.15.184:6816/1171078927 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3cec04ea90 con 0x7f3cd00721c0 2024-02-28T23:02:26.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.763+0000 7f3cf2600700 1 -- 172.21.15.159:0/2955757976 >> [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927] conn(0x7f3cd00721c0 msgr2=0x7f3cd00745e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:26.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.763+0000 7f3cf2600700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927] conn(0x7f3cd00721c0 0x7f3cd00745e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 -- 172.21.15.159:0/2955757976 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3cd006c4e0 msgr2=0x7f3cd006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:26.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3cd006c4e0 0x7f3cd006e9a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3cdc006010 tx=0x7f3cdc01a040 comp rx=0 tx=0).stop 2024-02-28T23:02:26.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 -- 172.21.15.159:0/2955757976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec105a40 msgr2=0x7f3cec19ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:26.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec105a40 0x7f3cec19ca60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f3cd800d8d0 tx=0x7f3cd800dc90 comp rx=0 tx=0).stop 2024-02-28T23:02:26.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 -- 172.21.15.159:0/2955757976 shutdown_connections 2024-02-28T23:02:26.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3cec0ffa40 0x7f3cec19c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.184:6816/1171078927,v1:172.21.15.184:6817/1171078927] conn(0x7f3cd00721c0 0x7f3cd00745e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3cd006c4e0 0x7f3cd006e9a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 --2- 172.21.15.159:0/2955757976 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3cec105a40 0x7f3cec19ca60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:26.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 -- 172.21.15.159:0/2955757976 >> 172.21.15.159:0/2955757976 conn(0x7f3cec0fb570 msgr2=0x7f3cec0fbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:26.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 -- 172.21.15.159:0/2955757976 shutdown_connections 2024-02-28T23:02:26.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:26.764+0000 7f3cf2600700 1 -- 172.21.15.159:0/2955757976 wait complete. 2024-02-28T23:02:27.101 INFO:teuthology.orchestra.run.smithi159.stdout:81604378653 2024-02-28T23:02:27.101 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-28T23:02:27.706 INFO:teuthology.orchestra.run.smithi159.stdout:60129542181 2024-02-28T23:02:27.706 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-28T23:02:28.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:28 smithi184 ceph-mon[36198]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:28.612 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:28 smithi159 ceph-mon[28802]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:28.758 INFO:teuthology.orchestra.run.smithi159.stdout:167503724556 2024-02-28T23:02:28.759 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-28T23:02:29.241 INFO:teuthology.orchestra.run.smithi159.stdout:111669149719 2024-02-28T23:02:29.241 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-28T23:02:29.591 INFO:teuthology.orchestra.run.smithi159.stdout:38654705711 2024-02-28T23:02:29.592 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-28T23:02:29.753 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:29.772 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:29.773 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:29.774 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:29.774 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:30.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:30 smithi184 ceph-mon[36198]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:30.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:30 smithi159 ceph-mon[28802]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:32.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:32 smithi184 ceph-mon[36198]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:32.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:32 smithi159 ceph-mon[28802]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:33.445 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:34.527 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:34 smithi159 ceph-mon[28802]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:34.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:34 smithi184 ceph-mon[36198]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:35.369 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:02:35.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:02:35.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.825+0000 7f5912400700 1 -- 172.21.15.159:0/2122970707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c102e10 msgr2=0x7f590c1031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:35.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.825+0000 7f5912400700 1 --2- 172.21.15.159:0/2122970707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c102e10 0x7f590c1031f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5900009910 tx=0x7f5900009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:35.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.825+0000 7f5912400700 1 -- 172.21.15.159:0/2122970707 shutdown_connections 2024-02-28T23:02:35.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.825+0000 7f5912400700 1 --2- 172.21.15.159:0/2122970707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c1037c0 0x7f590c107810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:35.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.825+0000 7f5912400700 1 --2- 172.21.15.159:0/2122970707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c102e10 0x7f590c1031f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:35.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.825+0000 7f5912400700 1 -- 172.21.15.159:0/2122970707 >> 172.21.15.159:0/2122970707 conn(0x7f590c0fe6c0 msgr2=0x7f590c100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:35.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.825+0000 7f5912400700 1 -- 172.21.15.159:0/2122970707 shutdown_connections 2024-02-28T23:02:35.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.826+0000 7f5912400700 1 -- 172.21.15.159:0/2122970707 wait complete. 2024-02-28T23:02:35.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.827+0000 7f5912400700 1 Processor -- start 2024-02-28T23:02:35.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.827+0000 7f5912400700 1 -- start start 2024-02-28T23:02:35.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.827+0000 7f5912400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c102e10 0x7f590c19e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:35.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.827+0000 7f5912400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c1037c0 0x7f590c19eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:35.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.827+0000 7f5912400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c19f0c0 con 0x7f590c1037c0 2024-02-28T23:02:35.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.827+0000 7f5912400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f590c198600 con 0x7f590c102e10 2024-02-28T23:02:35.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.828+0000 7f590be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c1037c0 0x7f590c19eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:35.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.828+0000 7f590be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c1037c0 0x7f590c19eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39368/0 (socket says 172.21.15.159:39368) 2024-02-28T23:02:35.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.828+0000 7f590be00700 1 -- 172.21.15.159:0/1207190410 learned_addr learned my addr 172.21.15.159:0/1207190410 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:35.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.828+0000 7f5911000700 1 --2- 172.21.15.159:0/1207190410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c102e10 0x7f590c19e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:35.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.828+0000 7f590be00700 1 -- 172.21.15.159:0/1207190410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c102e10 msgr2=0x7f590c19e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:35.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.828+0000 7f590be00700 1 --2- 172.21.15.159:0/1207190410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c102e10 0x7f590c19e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:35.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.828+0000 7f590be00700 1 -- 172.21.15.159:0/1207190410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59000095f0 con 0x7f590c1037c0 2024-02-28T23:02:35.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.828+0000 7f590be00700 1 --2- 172.21.15.159:0/1207190410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c1037c0 0x7f590c19eac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c960 tx=0x7f58f800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:35.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.829+0000 7f5909600700 1 -- 172.21.15.159:0/1207190410 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58f8007a70 con 0x7f590c1037c0 2024-02-28T23:02:35.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.829+0000 7f5909600700 1 -- 172.21.15.159:0/1207190410 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f58f8007bd0 con 0x7f590c1037c0 2024-02-28T23:02:35.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.829+0000 7f5912400700 1 -- 172.21.15.159:0/1207190410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f590c1988e0 con 0x7f590c1037c0 2024-02-28T23:02:35.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.829+0000 7f5909600700 1 -- 172.21.15.159:0/1207190410 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58f8018630 con 0x7f590c1037c0 2024-02-28T23:02:35.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.829+0000 7f5912400700 1 -- 172.21.15.159:0/1207190410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f590c198e30 con 0x7f590c1037c0 2024-02-28T23:02:35.829 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.830+0000 7f5912400700 1 -- 172.21.15.159:0/1207190410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590c10b1b0 con 0x7f590c1037c0 2024-02-28T23:02:35.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.831+0000 7f5909600700 1 -- 172.21.15.159:0/1207190410 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f58f800fa90 con 0x7f590c1037c0 2024-02-28T23:02:35.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.832+0000 7f5909600700 1 --2- 172.21.15.159:0/1207190410 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f58f406c4e0 0x7f58f406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:35.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.832+0000 7f5909600700 1 -- 172.21.15.159:0/1207190410 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f58f808b510 con 0x7f590c1037c0 2024-02-28T23:02:35.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.832+0000 7f5911000700 1 --2- 172.21.15.159:0/1207190410 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f58f406c4e0 0x7f58f406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:35.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.833+0000 7f5911000700 1 --2- 172.21.15.159:0/1207190410 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f58f406c4e0 0x7f58f406e9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f590000b5c0 tx=0x7f590001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:35.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:35.837+0000 7f5909600700 1 -- 172.21.15.159:0/1207190410 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f58f8059830 con 0x7f590c1037c0 2024-02-28T23:02:36.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.060+0000 7f5912400700 1 -- 172.21.15.159:0/1207190410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f590c1990b0 con 0x7f590c1037c0 2024-02-28T23:02:36.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.060+0000 7f5909600700 1 -- 172.21.15.159:0/1207190410 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f58f8059650 con 0x7f590c1037c0 2024-02-28T23:02:36.064 INFO:teuthology.orchestra.run.smithi159.stdout:81604378656 2024-02-28T23:02:36.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.063+0000 7f5912400700 1 -- 172.21.15.159:0/1207190410 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f58f406c4e0 msgr2=0x7f58f406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:36.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.063+0000 7f5912400700 1 --2- 172.21.15.159:0/1207190410 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f58f406c4e0 0x7f58f406e9a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f590000b5c0 tx=0x7f590001a040 comp rx=0 tx=0).stop 2024-02-28T23:02:36.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.063+0000 7f5912400700 1 -- 172.21.15.159:0/1207190410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c1037c0 msgr2=0x7f590c19eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:36.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.063+0000 7f5912400700 1 --2- 172.21.15.159:0/1207190410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c1037c0 0x7f590c19eac0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f58f800c960 tx=0x7f58f800cd20 comp rx=0 tx=0).stop 2024-02-28T23:02:36.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.064+0000 7f5912400700 1 -- 172.21.15.159:0/1207190410 shutdown_connections 2024-02-28T23:02:36.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.064+0000 7f5912400700 1 --2- 172.21.15.159:0/1207190410 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f590c102e10 0x7f590c19e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:36.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.064+0000 7f5912400700 1 --2- 172.21.15.159:0/1207190410 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f58f406c4e0 0x7f58f406e9a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:36.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.064+0000 7f5912400700 1 --2- 172.21.15.159:0/1207190410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f590c1037c0 0x7f590c19eac0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:36.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.064+0000 7f5912400700 1 -- 172.21.15.159:0/1207190410 >> 172.21.15.159:0/1207190410 conn(0x7f590c0fe6c0 msgr2=0x7f590c0ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:36.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.064+0000 7f5912400700 1 -- 172.21.15.159:0/1207190410 shutdown_connections 2024-02-28T23:02:36.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.064+0000 7f5912400700 1 -- 172.21.15.159:0/1207190410 wait complete. 2024-02-28T23:02:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:36 smithi184 ceph-mon[36198]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:36 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1207190410' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-28T23:02:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:36 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3828875026' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-28T23:02:36.611 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:36 smithi159 ceph-mon[28802]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:36.611 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:36 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1207190410' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-28T23:02:36.611 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:36 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3828875026' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-28T23:02:37.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.203+0000 7f9809a00700 1 -- 172.21.15.159:0/248558957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9804069020 msgr2=0x7f9804105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:37.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.203+0000 7f9809a00700 1 --2- 172.21.15.159:0/248558957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9804069020 0x7f9804105790 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009910 tx=0x7f97f0009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:37.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.203+0000 7f9809a00700 1 -- 172.21.15.159:0/248558957 shutdown_connections 2024-02-28T23:02:37.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.203+0000 7f9809a00700 1 --2- 172.21.15.159:0/248558957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9804069020 0x7f9804105790 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.203+0000 7f9809a00700 1 --2- 172.21.15.159:0/248558957 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9804068670 0x7f9804068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.203+0000 7f9809a00700 1 -- 172.21.15.159:0/248558957 >> 172.21.15.159:0/248558957 conn(0x7f98040755a0 msgr2=0x7f98040759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:37.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.203+0000 7f9809a00700 1 -- 172.21.15.159:0/248558957 shutdown_connections 2024-02-28T23:02:37.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.203+0000 7f9809a00700 1 -- 172.21.15.159:0/248558957 wait complete. 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.204+0000 7f9809a00700 1 Processor -- start 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.204+0000 7f9809a00700 1 -- start start 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.205+0000 7f9809a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9804068670 0x7f980419e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.205+0000 7f9809a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9804069020 0x7f980419ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.205+0000 7f9809a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980419f2a0 con 0x7f9804068670 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.205+0000 7f9809a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9804198750 con 0x7f9804069020 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.205+0000 7f9802a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9804068670 0x7f980419e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.205+0000 7f9802a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9804068670 0x7f980419e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39396/0 (socket says 172.21.15.159:39396) 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.205+0000 7f9802a00700 1 -- 172.21.15.159:0/4269194294 learned_addr learned my addr 172.21.15.159:0/4269194294 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.205+0000 7f9802000700 1 --2- 172.21.15.159:0/4269194294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9804069020 0x7f980419ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.206+0000 7f9802a00700 1 -- 172.21.15.159:0/4269194294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9804069020 msgr2=0x7f980419ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.206+0000 7f9802a00700 1 --2- 172.21.15.159:0/4269194294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9804069020 0x7f980419ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.206+0000 7f9802a00700 1 -- 172.21.15.159:0/4269194294 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00095f0 con 0x7f9804068670 2024-02-28T23:02:37.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.206+0000 7f9802a00700 1 --2- 172.21.15.159:0/4269194294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9804068670 0x7f980419e6d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f97f400ada0 tx=0x7f97f400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:37.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.206+0000 7f97fb400700 1 -- 172.21.15.159:0/4269194294 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f400f070 con 0x7f9804068670 2024-02-28T23:02:37.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.206+0000 7f97fb400700 1 -- 172.21.15.159:0/4269194294 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f97f4007bf0 con 0x7f9804068670 2024-02-28T23:02:37.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.206+0000 7f97fb400700 1 -- 172.21.15.159:0/4269194294 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97f4005670 con 0x7f9804068670 2024-02-28T23:02:37.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.206+0000 7f9809a00700 1 -- 172.21.15.159:0/4269194294 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9804198a30 con 0x7f9804068670 2024-02-28T23:02:37.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.207+0000 7f9809a00700 1 -- 172.21.15.159:0/4269194294 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9804198f30 con 0x7f9804068670 2024-02-28T23:02:37.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.208+0000 7f9809a00700 1 -- 172.21.15.159:0/4269194294 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980404ea90 con 0x7f9804068670 2024-02-28T23:02:37.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.209+0000 7f97fb400700 1 -- 172.21.15.159:0/4269194294 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f97f40058e0 con 0x7f9804068670 2024-02-28T23:02:37.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.210+0000 7f97fb400700 1 --2- 172.21.15.159:0/4269194294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f97e806c4e0 0x7f97e806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:37.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.210+0000 7f97fb400700 1 -- 172.21.15.159:0/4269194294 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f97f408aef0 con 0x7f9804068670 2024-02-28T23:02:37.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.210+0000 7f9802000700 1 --2- 172.21.15.159:0/4269194294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f97e806c4e0 0x7f97e806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:37.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.211+0000 7f9802000700 1 --2- 172.21.15.159:0/4269194294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f97e806c4e0 0x7f97e806e9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9804199bc0 tx=0x7f97f001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:37.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.215+0000 7f97fb400700 1 -- 172.21.15.159:0/4269194294 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f97f40594a0 con 0x7f9804068670 2024-02-28T23:02:37.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.065+0000 7f5b6b000700 1 -- 172.21.15.159:0/2783192969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b641039a0 msgr2=0x7f5b641079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:37.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.065+0000 7f5b6b000700 1 --2- 172.21.15.159:0/2783192969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b641039a0 0x7f5b641079f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5b50009910 tx=0x7f5b50009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:37.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.065+0000 7f5b6b000700 1 -- 172.21.15.159:0/2783192969 shutdown_connections 2024-02-28T23:02:37.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.065+0000 7f5b6b000700 1 --2- 172.21.15.159:0/2783192969 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b641039a0 0x7f5b641079f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.065+0000 7f5b6b000700 1 --2- 172.21.15.159:0/2783192969 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b64102ff0 0x7f5b641033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.065+0000 7f5b6b000700 1 -- 172.21.15.159:0/2783192969 >> 172.21.15.159:0/2783192969 conn(0x7f5b640fe880 msgr2=0x7f5b64100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.065+0000 7f5b6b000700 1 -- 172.21.15.159:0/2783192969 shutdown_connections 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.065+0000 7f5b6b000700 1 -- 172.21.15.159:0/2783192969 wait complete. 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.066+0000 7f5b6b000700 1 Processor -- start 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.067+0000 7f5b6b000700 1 -- start start 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.067+0000 7f5b6b000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b64102ff0 0x7f5b64198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.067+0000 7f5b6b000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b641039a0 0x7f5b64198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.067+0000 7f5b6b000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b64199530 con 0x7f5b64102ff0 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.067+0000 7f5b6b000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6419d340 con 0x7f5b641039a0 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.067+0000 7f5b63e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b64102ff0 0x7f5b64198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.067+0000 7f5b63e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b64102ff0 0x7f5b64198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39388/0 (socket says 172.21.15.159:39388) 2024-02-28T23:02:37.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.067+0000 7f5b63e00700 1 -- 172.21.15.159:0/3828875026 learned_addr learned my addr 172.21.15.159:0/3828875026 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.068+0000 7f5b63400700 1 --2- 172.21.15.159:0/3828875026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b641039a0 0x7f5b64198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.068+0000 7f5b63e00700 1 -- 172.21.15.159:0/3828875026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b641039a0 msgr2=0x7f5b64198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.068+0000 7f5b63e00700 1 --2- 172.21.15.159:0/3828875026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b641039a0 0x7f5b64198ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.068+0000 7f5b63e00700 1 -- 172.21.15.159:0/3828875026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b500095f0 con 0x7f5b64102ff0 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.068+0000 7f5b63e00700 1 --2- 172.21.15.159:0/3828875026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b64102ff0 0x7f5b64198960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400d8d0 tx=0x7f5b5400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.068+0000 7f5b60c00700 1 -- 172.21.15.159:0/3828875026 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b54009940 con 0x7f5b64102ff0 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.069+0000 7f5b60c00700 1 -- 172.21.15.159:0/3828875026 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5b54010460 con 0x7f5b64102ff0 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.069+0000 7f5b6b000700 1 -- 172.21.15.159:0/3828875026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6419d620 con 0x7f5b64102ff0 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.069+0000 7f5b60c00700 1 -- 172.21.15.159:0/3828875026 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b5400f5f0 con 0x7f5b64102ff0 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.069+0000 7f5b6b000700 1 -- 172.21.15.159:0/3828875026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6419db40 con 0x7f5b64102ff0 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.070+0000 7f5b6b000700 1 -- 172.21.15.159:0/3828875026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6410b300 con 0x7f5b64102ff0 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.072+0000 7f5b60c00700 1 -- 172.21.15.159:0/3828875026 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f5b540105d0 con 0x7f5b64102ff0 2024-02-28T23:02:37.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.074+0000 7f5b60c00700 1 --2- 172.21.15.159:0/3828875026 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5b4806c4e0 0x7f5b4806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:37.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.074+0000 7f5b60c00700 1 -- 172.21.15.159:0/3828875026 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5b5408b490 con 0x7f5b64102ff0 2024-02-28T23:02:37.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.074+0000 7f5b63400700 1 --2- 172.21.15.159:0/3828875026 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5b4806c4e0 0x7f5b4806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:37.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.075+0000 7f5b63400700 1 --2- 172.21.15.159:0/3828875026 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5b4806c4e0 0x7f5b4806e9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b641998d0 tx=0x7f5b5001a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:37.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.079+0000 7f5b60c00700 1 -- 172.21.15.159:0/3828875026 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5b54059a20 con 0x7f5b64102ff0 2024-02-28T23:02:37.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.302+0000 7f5b6b000700 1 -- 172.21.15.159:0/3828875026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f5b6404ea90 con 0x7f5b64102ff0 2024-02-28T23:02:37.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.303+0000 7f5b60c00700 1 -- 172.21.15.159:0/3828875026 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f5b5408b070 con 0x7f5b64102ff0 2024-02-28T23:02:37.232 INFO:teuthology.orchestra.run.smithi159.stdout:146028888083 2024-02-28T23:02:37.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.305+0000 7f5b6b000700 1 -- 172.21.15.159:0/3828875026 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5b4806c4e0 msgr2=0x7f5b4806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:37.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.305+0000 7f5b6b000700 1 --2- 172.21.15.159:0/3828875026 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5b4806c4e0 0x7f5b4806e9a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5b641998d0 tx=0x7f5b5001a040 comp rx=0 tx=0).stop 2024-02-28T23:02:37.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.305+0000 7f5b6b000700 1 -- 172.21.15.159:0/3828875026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b64102ff0 msgr2=0x7f5b64198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:37.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.305+0000 7f5b6b000700 1 --2- 172.21.15.159:0/3828875026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b64102ff0 0x7f5b64198960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400d8d0 tx=0x7f5b5400dc90 comp rx=0 tx=0).stop 2024-02-28T23:02:37.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.306+0000 7f5b6b000700 1 -- 172.21.15.159:0/3828875026 shutdown_connections 2024-02-28T23:02:37.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.306+0000 7f5b6b000700 1 --2- 172.21.15.159:0/3828875026 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5b4806c4e0 0x7f5b4806e9a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.306+0000 7f5b6b000700 1 --2- 172.21.15.159:0/3828875026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5b64102ff0 0x7f5b64198960 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.306+0000 7f5b6b000700 1 --2- 172.21.15.159:0/3828875026 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5b641039a0 0x7f5b64198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.306+0000 7f5b6b000700 1 -- 172.21.15.159:0/3828875026 >> 172.21.15.159:0/3828875026 conn(0x7f5b640fe880 msgr2=0x7f5b64107260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:37.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.306+0000 7f5b6b000700 1 -- 172.21.15.159:0/3828875026 shutdown_connections 2024-02-28T23:02:37.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:36.306+0000 7f5b6b000700 1 -- 172.21.15.159:0/3828875026 wait complete. 2024-02-28T23:02:37.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.437+0000 7f9809a00700 1 -- 172.21.15.159:0/4269194294 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f9804199c60 con 0x7f9804068670 2024-02-28T23:02:37.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.438+0000 7f97fb400700 1 -- 172.21.15.159:0/4269194294 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f97f4059030 con 0x7f9804068670 2024-02-28T23:02:37.437 INFO:teuthology.orchestra.run.smithi159.stdout:167503724558 2024-02-28T23:02:37.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.442+0000 7f9809a00700 1 -- 172.21.15.159:0/4269194294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f97e806c4e0 msgr2=0x7f97e806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:37.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.442+0000 7f9809a00700 1 --2- 172.21.15.159:0/4269194294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f97e806c4e0 0x7f97e806e9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9804199bc0 tx=0x7f97f001a040 comp rx=0 tx=0).stop 2024-02-28T23:02:37.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.442+0000 7f9809a00700 1 -- 172.21.15.159:0/4269194294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9804068670 msgr2=0x7f980419e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:37.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.442+0000 7f9809a00700 1 --2- 172.21.15.159:0/4269194294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9804068670 0x7f980419e6d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f97f400ada0 tx=0x7f97f400c330 comp rx=0 tx=0).stop 2024-02-28T23:02:37.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.442+0000 7f9809a00700 1 -- 172.21.15.159:0/4269194294 shutdown_connections 2024-02-28T23:02:37.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.442+0000 7f9809a00700 1 --2- 172.21.15.159:0/4269194294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f97e806c4e0 0x7f97e806e9a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.442+0000 7f9809a00700 1 --2- 172.21.15.159:0/4269194294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9804068670 0x7f980419e6d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.442+0000 7f9809a00700 1 --2- 172.21.15.159:0/4269194294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9804069020 0x7f980419ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:37.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.442+0000 7f9809a00700 1 -- 172.21.15.159:0/4269194294 >> 172.21.15.159:0/4269194294 conn(0x7f98040755a0 msgr2=0x7f9804105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:37.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.442+0000 7f9809a00700 1 -- 172.21.15.159:0/4269194294 shutdown_connections 2024-02-28T23:02:37.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:37.442+0000 7f9809a00700 1 -- 172.21.15.159:0/4269194294 wait complete. 2024-02-28T23:02:38.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:38 smithi184 ceph-mon[36198]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:38 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/4269194294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-28T23:02:38.639 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:38 smithi159 ceph-mon[28802]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:38.639 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:38 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/4269194294' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-28T23:02:39.151 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724556 got 167503724558 for osd.5 2024-02-28T23:02:39.151 DEBUG:teuthology.parallel:result is None 2024-02-28T23:02:39.736 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888081 got 146028888083 for osd.4 2024-02-28T23:02:39.736 DEBUG:teuthology.parallel:result is None 2024-02-28T23:02:39.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.932+0000 7fd885800700 1 -- 172.21.15.159:0/2435129165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd880069020 msgr2=0x7fd880105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:39.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.932+0000 7fd885800700 1 --2- 172.21.15.159:0/2435129165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd880069020 0x7fd880105790 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd86c009910 tx=0x7fd86c009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:39.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.932+0000 7fd885800700 1 -- 172.21.15.159:0/2435129165 shutdown_connections 2024-02-28T23:02:39.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.932+0000 7fd885800700 1 --2- 172.21.15.159:0/2435129165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd880069020 0x7fd880105790 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:39.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.932+0000 7fd885800700 1 --2- 172.21.15.159:0/2435129165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd880068670 0x7fd880068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:39.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.932+0000 7fd885800700 1 -- 172.21.15.159:0/2435129165 >> 172.21.15.159:0/2435129165 conn(0x7fd8800755a0 msgr2=0x7fd8800759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:39.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.932+0000 7fd885800700 1 -- 172.21.15.159:0/2435129165 shutdown_connections 2024-02-28T23:02:39.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.932+0000 7fd885800700 1 -- 172.21.15.159:0/2435129165 wait complete. 2024-02-28T23:02:39.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.933+0000 7fd885800700 1 Processor -- start 2024-02-28T23:02:39.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.934+0000 7fd885800700 1 -- start start 2024-02-28T23:02:39.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.934+0000 7fd885800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd880068670 0x7fd880196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:39.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.934+0000 7fd885800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd880069020 0x7fd880196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:39.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.934+0000 7fd885800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8801972d0 con 0x7fd880068670 2024-02-28T23:02:39.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.934+0000 7fd885800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88019a000 con 0x7fd880069020 2024-02-28T23:02:39.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.935+0000 7fd87e000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd880069020 0x7fd880196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:39.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.935+0000 7fd87ea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd880068670 0x7fd880196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:39.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.935+0000 7fd87e000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd880069020 0x7fd880196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:32842/0 (socket says 172.21.15.159:32842) 2024-02-28T23:02:39.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.935+0000 7fd87e000700 1 -- 172.21.15.159:0/2401773166 learned_addr learned my addr 172.21.15.159:0/2401773166 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:39.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.935+0000 7fd87ea00700 1 -- 172.21.15.159:0/2401773166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd880069020 msgr2=0x7fd880196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:39.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.935+0000 7fd87ea00700 1 --2- 172.21.15.159:0/2401773166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd880069020 0x7fd880196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:39.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.935+0000 7fd87ea00700 1 -- 172.21.15.159:0/2401773166 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd86c0095f0 con 0x7fd880068670 2024-02-28T23:02:39.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.936+0000 7fd87ea00700 1 --2- 172.21.15.159:0/2401773166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd880068670 0x7fd880196700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd87000d8d0 tx=0x7fd87000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:39.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.936+0000 7fd877400700 1 -- 172.21.15.159:0/2401773166 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd87000f860 con 0x7fd880068670 2024-02-28T23:02:39.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.936+0000 7fd877400700 1 -- 172.21.15.159:0/2401773166 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd87000fe70 con 0x7fd880068670 2024-02-28T23:02:39.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.936+0000 7fd885800700 1 -- 172.21.15.159:0/2401773166 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88019a2e0 con 0x7fd880068670 2024-02-28T23:02:39.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.936+0000 7fd877400700 1 -- 172.21.15.159:0/2401773166 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd87000e5e0 con 0x7fd880068670 2024-02-28T23:02:39.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.937+0000 7fd885800700 1 -- 172.21.15.159:0/2401773166 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88019a830 con 0x7fd880068670 2024-02-28T23:02:39.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.939+0000 7fd885800700 1 -- 172.21.15.159:0/2401773166 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8801090a0 con 0x7fd880068670 2024-02-28T23:02:39.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.939+0000 7fd877400700 1 -- 172.21.15.159:0/2401773166 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fd870010460 con 0x7fd880068670 2024-02-28T23:02:39.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.940+0000 7fd877400700 1 --2- 172.21.15.159:0/2401773166 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd86406c4e0 0x7fd86406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:39.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.941+0000 7fd877400700 1 -- 172.21.15.159:0/2401773166 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fd87008aa30 con 0x7fd880068670 2024-02-28T23:02:39.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.941+0000 7fd87e000700 1 --2- 172.21.15.159:0/2401773166 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd86406c4e0 0x7fd86406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:39.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.941+0000 7fd87e000700 1 --2- 172.21.15.159:0/2401773166 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd86406c4e0 0x7fd86406e9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd880197d20 tx=0x7fd86c01a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:39.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:39.945+0000 7fd877400700 1 -- 172.21.15.159:0/2401773166 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd8700555d0 con 0x7fd880068670 2024-02-28T23:02:40.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.170+0000 7fd885800700 1 -- 172.21.15.159:0/2401773166 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd88004ea90 con 0x7fd880068670 2024-02-28T23:02:40.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.171+0000 7fd877400700 1 -- 172.21.15.159:0/2401773166 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd870010710 con 0x7fd880068670 2024-02-28T23:02:40.170 INFO:teuthology.orchestra.run.smithi159.stdout:111669149722 2024-02-28T23:02:40.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.173+0000 7fd885800700 1 -- 172.21.15.159:0/2401773166 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd86406c4e0 msgr2=0x7fd86406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:40.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.173+0000 7fd885800700 1 --2- 172.21.15.159:0/2401773166 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd86406c4e0 0x7fd86406e9a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd880197d20 tx=0x7fd86c01a040 comp rx=0 tx=0).stop 2024-02-28T23:02:40.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.173+0000 7fd885800700 1 -- 172.21.15.159:0/2401773166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd880068670 msgr2=0x7fd880196700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:40.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.173+0000 7fd885800700 1 --2- 172.21.15.159:0/2401773166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd880068670 0x7fd880196700 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd87000d8d0 tx=0x7fd87000dbe0 comp rx=0 tx=0).stop 2024-02-28T23:02:40.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.174+0000 7fd885800700 1 -- 172.21.15.159:0/2401773166 shutdown_connections 2024-02-28T23:02:40.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.174+0000 7fd885800700 1 --2- 172.21.15.159:0/2401773166 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd86406c4e0 0x7fd86406e9a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:40.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.174+0000 7fd885800700 1 --2- 172.21.15.159:0/2401773166 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd880068670 0x7fd880196700 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:40.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.174+0000 7fd885800700 1 --2- 172.21.15.159:0/2401773166 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd880069020 0x7fd880196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:40.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.174+0000 7fd885800700 1 -- 172.21.15.159:0/2401773166 >> 172.21.15.159:0/2401773166 conn(0x7fd8800755a0 msgr2=0x7fd880105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:40.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.174+0000 7fd885800700 1 -- 172.21.15.159:0/2401773166 shutdown_connections 2024-02-28T23:02:40.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:40.174+0000 7fd885800700 1 -- 172.21.15.159:0/2401773166 wait complete. 2024-02-28T23:02:40.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:40 smithi159 ceph-mon[28802]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:40.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:40 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2401773166' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-28T23:02:40.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:40 smithi184 ceph-mon[36198]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:40 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2401773166' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-28T23:02:40.643 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378653 got 81604378656 for osd.2 2024-02-28T23:02:40.643 DEBUG:teuthology.parallel:result is None 2024-02-28T23:02:42.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.337+0000 7fcc14c00700 1 -- 172.21.15.159:0/1658130992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc100ff8f0 msgr2=0x7fcc100ffcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:42.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.337+0000 7fcc14c00700 1 --2- 172.21.15.159:0/1658130992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc100ff8f0 0x7fcc100ffcd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fcc00009910 tx=0x7fcc00009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:42.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.337+0000 7fcc14c00700 1 -- 172.21.15.159:0/1658130992 shutdown_connections 2024-02-28T23:02:42.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.337+0000 7fcc14c00700 1 --2- 172.21.15.159:0/1658130992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc101002a0 0x7fcc1010cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.337+0000 7fcc14c00700 1 --2- 172.21.15.159:0/1658130992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc100ff8f0 0x7fcc100ffcd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.337+0000 7fcc14c00700 1 -- 172.21.15.159:0/1658130992 >> 172.21.15.159:0/1658130992 conn(0x7fcc100fb570 msgr2=0x7fcc100fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:42.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.337+0000 7fcc14c00700 1 -- 172.21.15.159:0/1658130992 shutdown_connections 2024-02-28T23:02:42.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.337+0000 7fcc14c00700 1 -- 172.21.15.159:0/1658130992 wait complete. 2024-02-28T23:02:42.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.338+0000 7fcc14c00700 1 Processor -- start 2024-02-28T23:02:42.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.338+0000 7fcc14c00700 1 -- start start 2024-02-28T23:02:42.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.339+0000 7fcc14c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc100ff8f0 0x7fcc1019e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:42.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.339+0000 7fcc14c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc101002a0 0x7fcc1019ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:42.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.339+0000 7fcc14c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1019f380 con 0x7fcc101002a0 2024-02-28T23:02:42.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.339+0000 7fcc14c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10198830 con 0x7fcc100ff8f0 2024-02-28T23:02:42.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.339+0000 7fcc0d400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc101002a0 0x7fcc1019ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:42.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.339+0000 7fcc0d400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc101002a0 0x7fcc1019ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59450/0 (socket says 172.21.15.159:59450) 2024-02-28T23:02:42.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.339+0000 7fcc0d400700 1 -- 172.21.15.159:0/4119084377 learned_addr learned my addr 172.21.15.159:0/4119084377 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:42.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.339+0000 7fcc0de00700 1 --2- 172.21.15.159:0/4119084377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc100ff8f0 0x7fcc1019e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:42.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.340+0000 7fcc0d400700 1 -- 172.21.15.159:0/4119084377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc100ff8f0 msgr2=0x7fcc1019e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:42.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.340+0000 7fcc0d400700 1 --2- 172.21.15.159:0/4119084377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc100ff8f0 0x7fcc1019e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.340+0000 7fcc0d400700 1 -- 172.21.15.159:0/4119084377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000095f0 con 0x7fcc101002a0 2024-02-28T23:02:42.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.340+0000 7fcc0d400700 1 --2- 172.21.15.159:0/4119084377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc101002a0 0x7fcc1019ecf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00b4b0 tx=0x7fcbfc00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:42.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.342+0000 7fcc06a00700 1 -- 172.21.15.159:0/4119084377 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbfc011800 con 0x7fcc101002a0 2024-02-28T23:02:42.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.342+0000 7fcc06a00700 1 -- 172.21.15.159:0/4119084377 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcbfc011e10 con 0x7fcc101002a0 2024-02-28T23:02:42.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.342+0000 7fcc06a00700 1 -- 172.21.15.159:0/4119084377 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcbfc00f2e0 con 0x7fcc101002a0 2024-02-28T23:02:42.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.342+0000 7fcc14c00700 1 -- 172.21.15.159:0/4119084377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc10198b10 con 0x7fcc101002a0 2024-02-28T23:02:42.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.342+0000 7fcc14c00700 1 -- 172.21.15.159:0/4119084377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc10199060 con 0x7fcc101002a0 2024-02-28T23:02:42.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.343+0000 7fcc14c00700 1 -- 172.21.15.159:0/4119084377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc1010a6d0 con 0x7fcc101002a0 2024-02-28T23:02:42.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.344+0000 7fcc06a00700 1 -- 172.21.15.159:0/4119084377 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fcbfc010380 con 0x7fcc101002a0 2024-02-28T23:02:42.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.345+0000 7fcc06a00700 1 --2- 172.21.15.159:0/4119084377 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fcbf406c4e0 0x7fcbf406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:42.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.345+0000 7fcc06a00700 1 -- 172.21.15.159:0/4119084377 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7fcbfc08afe0 con 0x7fcc101002a0 2024-02-28T23:02:42.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.345+0000 7fcc0de00700 1 --2- 172.21.15.159:0/4119084377 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fcbf406c4e0 0x7fcbf406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:42.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.346+0000 7fcc0de00700 1 --2- 172.21.15.159:0/4119084377 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fcbf406c4e0 0x7fcbf406e9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc00006010 tx=0x7fcc0000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:42.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.350+0000 7fcc06a00700 1 -- 172.21.15.159:0/4119084377 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fcbfc0be0e0 con 0x7fcc101002a0 2024-02-28T23:02:42.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:42 smithi159 ceph-mon[28802]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:42.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.462+0000 7f368be00700 1 -- 172.21.15.159:0/2591425529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36840731c0 msgr2=0x7f36840735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:42.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.462+0000 7f368be00700 1 --2- 172.21.15.159:0/2591425529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36840731c0 0x7f36840735a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3678009910 tx=0x7f3678009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:42.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.462+0000 7f368be00700 1 -- 172.21.15.159:0/2591425529 shutdown_connections 2024-02-28T23:02:42.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.462+0000 7f368be00700 1 --2- 172.21.15.159:0/2591425529 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3684073ae0 0x7f368410ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.462+0000 7f368be00700 1 --2- 172.21.15.159:0/2591425529 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36840731c0 0x7f36840735a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.462+0000 7f368be00700 1 -- 172.21.15.159:0/2591425529 >> 172.21.15.159:0/2591425529 conn(0x7f36840fc640 msgr2=0x7f36840fea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.462+0000 7f368be00700 1 -- 172.21.15.159:0/2591425529 shutdown_connections 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.462+0000 7f368be00700 1 -- 172.21.15.159:0/2591425529 wait complete. 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.463+0000 7f368be00700 1 Processor -- start 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.464+0000 7f368be00700 1 -- start start 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.464+0000 7f368be00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36840731c0 0x7f368419e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.464+0000 7f368be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3684073ae0 0x7f368419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.464+0000 7f368be00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f368419f2e0 con 0x7f3684073ae0 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.464+0000 7f368be00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3684198790 con 0x7f36840731c0 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.464+0000 7f3688a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3684073ae0 0x7f368419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.464+0000 7f3688a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3684073ae0 0x7f368419ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59458/0 (socket says 172.21.15.159:59458) 2024-02-28T23:02:42.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.464+0000 7f3688a00700 1 -- 172.21.15.159:0/1111673814 learned_addr learned my addr 172.21.15.159:0/1111673814 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.465+0000 7f3689400700 1 --2- 172.21.15.159:0/1111673814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36840731c0 0x7f368419e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.465+0000 7f3688a00700 1 -- 172.21.15.159:0/1111673814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36840731c0 msgr2=0x7f368419e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.465+0000 7f3688a00700 1 --2- 172.21.15.159:0/1111673814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36840731c0 0x7f368419e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.465+0000 7f3688a00700 1 -- 172.21.15.159:0/1111673814 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36780095f0 con 0x7f3684073ae0 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.465+0000 7f3688a00700 1 --2- 172.21.15.159:0/1111673814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3684073ae0 0x7f368419ec50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f367000d900 tx=0x7f367000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.465+0000 7f3682000700 1 -- 172.21.15.159:0/1111673814 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3670004a00 con 0x7f3684073ae0 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.465+0000 7f3682000700 1 -- 172.21.15.159:0/1111673814 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f36700054d0 con 0x7f3684073ae0 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.465+0000 7f3682000700 1 -- 172.21.15.159:0/1111673814 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3670009d60 con 0x7f3684073ae0 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.466+0000 7f368be00700 1 -- 172.21.15.159:0/1111673814 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3684198a70 con 0x7f3684073ae0 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.466+0000 7f368be00700 1 -- 172.21.15.159:0/1111673814 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3684198f70 con 0x7f3684073ae0 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.467+0000 7f3677400700 1 -- 172.21.15.159:0/1111673814 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f368404ea90 con 0x7f3684073ae0 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.468+0000 7f3682000700 1 -- 172.21.15.159:0/1111673814 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f3670005020 con 0x7f3684073ae0 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.469+0000 7f3682000700 1 --2- 172.21.15.159:0/1111673814 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f366c06c4e0 0x7f366c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.469+0000 7f3682000700 1 -- 172.21.15.159:0/1111673814 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f367008b370 con 0x7f3684073ae0 2024-02-28T23:02:42.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.469+0000 7f3689400700 1 --2- 172.21.15.159:0/1111673814 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f366c06c4e0 0x7f366c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:42.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.470+0000 7f3689400700 1 --2- 172.21.15.159:0/1111673814 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f366c06c4e0 0x7f366c06e9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3678006010 tx=0x7f367801a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:42.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.473+0000 7f3682000700 1 -- 172.21.15.159:0/1111673814 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3670059900 con 0x7f3684073ae0 2024-02-28T23:02:42.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.591+0000 7fcc14c00700 1 -- 172.21.15.159:0/4119084377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcc1004ea90 con 0x7fcc101002a0 2024-02-28T23:02:42.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.592+0000 7fcc06a00700 1 -- 172.21.15.159:0/4119084377 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbfc015090 con 0x7fcc101002a0 2024-02-28T23:02:42.591 INFO:teuthology.orchestra.run.smithi159.stdout:60129542185 2024-02-28T23:02:42.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.595+0000 7fcc14c00700 1 -- 172.21.15.159:0/4119084377 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fcbf406c4e0 msgr2=0x7fcbf406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:42.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.595+0000 7fcc14c00700 1 --2- 172.21.15.159:0/4119084377 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fcbf406c4e0 0x7fcbf406e9a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcc00006010 tx=0x7fcc0000b540 comp rx=0 tx=0).stop 2024-02-28T23:02:42.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.595+0000 7fcc14c00700 1 -- 172.21.15.159:0/4119084377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc101002a0 msgr2=0x7fcc1019ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:42.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.595+0000 7fcc14c00700 1 --2- 172.21.15.159:0/4119084377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc101002a0 0x7fcc1019ecf0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc00b4b0 tx=0x7fcbfc00b7c0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.595+0000 7fcc14c00700 1 -- 172.21.15.159:0/4119084377 shutdown_connections 2024-02-28T23:02:42.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.595+0000 7fcc14c00700 1 --2- 172.21.15.159:0/4119084377 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcc100ff8f0 0x7fcc1019e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.595+0000 7fcc14c00700 1 --2- 172.21.15.159:0/4119084377 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fcbf406c4e0 0x7fcbf406e9a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.595+0000 7fcc14c00700 1 --2- 172.21.15.159:0/4119084377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcc101002a0 0x7fcc1019ecf0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.595+0000 7fcc14c00700 1 -- 172.21.15.159:0/4119084377 >> 172.21.15.159:0/4119084377 conn(0x7fcc100fb570 msgr2=0x7fcc100fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:42.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.595+0000 7fcc14c00700 1 -- 172.21.15.159:0/4119084377 shutdown_connections 2024-02-28T23:02:42.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.595+0000 7fcc14c00700 1 -- 172.21.15.159:0/4119084377 wait complete. 2024-02-28T23:02:42.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:42 smithi184 ceph-mon[36198]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:42.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.692+0000 7f3677400700 1 -- 172.21.15.159:0/1111673814 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3684199ca0 con 0x7f3684073ae0 2024-02-28T23:02:42.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.693+0000 7f3682000700 1 -- 172.21.15.159:0/1111673814 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3670017090 con 0x7f3684073ae0 2024-02-28T23:02:42.692 INFO:teuthology.orchestra.run.smithi159.stdout:38654705714 2024-02-28T23:02:42.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.696+0000 7f3677400700 1 -- 172.21.15.159:0/1111673814 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f366c06c4e0 msgr2=0x7f366c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:42.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.696+0000 7f3677400700 1 --2- 172.21.15.159:0/1111673814 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f366c06c4e0 0x7f366c06e9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3678006010 tx=0x7f367801a040 comp rx=0 tx=0).stop 2024-02-28T23:02:42.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.696+0000 7f3677400700 1 -- 172.21.15.159:0/1111673814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3684073ae0 msgr2=0x7f368419ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:42.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.696+0000 7f3677400700 1 --2- 172.21.15.159:0/1111673814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3684073ae0 0x7f368419ec50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f367000d900 tx=0x7f367000dcc0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.696+0000 7f3677400700 1 -- 172.21.15.159:0/1111673814 shutdown_connections 2024-02-28T23:02:42.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.696+0000 7f3677400700 1 --2- 172.21.15.159:0/1111673814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36840731c0 0x7f368419e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.696+0000 7f3677400700 1 --2- 172.21.15.159:0/1111673814 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f366c06c4e0 0x7f366c06e9a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.696+0000 7f3677400700 1 --2- 172.21.15.159:0/1111673814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3684073ae0 0x7f368419ec50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:42.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.696+0000 7f3677400700 1 -- 172.21.15.159:0/1111673814 >> 172.21.15.159:0/1111673814 conn(0x7f36840fc640 msgr2=0x7f3684107670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:42.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.696+0000 7f3677400700 1 -- 172.21.15.159:0/1111673814 shutdown_connections 2024-02-28T23:02:42.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:42.696+0000 7f3677400700 1 -- 172.21.15.159:0/1111673814 wait complete. 2024-02-28T23:02:43.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:43 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/4119084377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-28T23:02:43.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:43 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1111673814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-28T23:02:43.700 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:43 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/4119084377' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-28T23:02:43.700 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:43 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1111673814' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-28T23:02:43.764 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705711 got 38654705714 for osd.0 2024-02-28T23:02:43.764 DEBUG:teuthology.parallel:result is None 2024-02-28T23:02:44.333 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149719 got 111669149722 for osd.3 2024-02-28T23:02:44.333 DEBUG:teuthology.parallel:result is None 2024-02-28T23:02:44.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:44 smithi159 ceph-mon[28802]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:44.729 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542181 got 60129542185 for osd.1 2024-02-28T23:02:44.729 DEBUG:teuthology.parallel:result is None 2024-02-28T23:02:44.730 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-28T23:02:44.730 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph pg dump --format=json 2024-02-28T23:02:44.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:44 smithi184 ceph-mon[36198]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:45.152 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:46.652 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:46 smithi159 ceph-mon[28802]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:46.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:46 smithi184 ceph-mon[36198]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:47.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.136+0000 7f1dcb000700 1 -- 172.21.15.159:0/2370423451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc41039b0 msgr2=0x7f1dc4107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:47.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.136+0000 7f1dcb000700 1 --2- 172.21.15.159:0/2370423451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc41039b0 0x7f1dc4107a00 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1dac009910 tx=0x7f1dac009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:47.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.136+0000 7f1dcb000700 1 -- 172.21.15.159:0/2370423451 shutdown_connections 2024-02-28T23:02:47.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.136+0000 7f1dcb000700 1 --2- 172.21.15.159:0/2370423451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc41039b0 0x7f1dc4107a00 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:47.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.136+0000 7f1dcb000700 1 --2- 172.21.15.159:0/2370423451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc4103000 0x7f1dc41033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:47.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.136+0000 7f1dcb000700 1 -- 172.21.15.159:0/2370423451 >> 172.21.15.159:0/2370423451 conn(0x7f1dc40fe8d0 msgr2=0x7f1dc4100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:47.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.136+0000 7f1dcb000700 1 -- 172.21.15.159:0/2370423451 shutdown_connections 2024-02-28T23:02:47.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.136+0000 7f1dcb000700 1 -- 172.21.15.159:0/2370423451 wait complete. 2024-02-28T23:02:47.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.137+0000 7f1dcb000700 1 Processor -- start 2024-02-28T23:02:47.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.137+0000 7f1dcb000700 1 -- start start 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.138+0000 7f1dcb000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc4103000 0x7f1dc419e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.138+0000 7f1dcb000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc41039b0 0x7f1dc419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.138+0000 7f1dcb000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc419f390 con 0x7f1dc41039b0 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.138+0000 7f1dcb000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dc4198840 con 0x7f1dc4103000 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.138+0000 7f1dbb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc41039b0 0x7f1dc419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.138+0000 7f1dbb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc41039b0 0x7f1dc419ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59476/0 (socket says 172.21.15.159:59476) 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.138+0000 7f1dbb400700 1 -- 172.21.15.159:0/1831896000 learned_addr learned my addr 172.21.15.159:0/1831896000 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.138+0000 7f1dc3e00700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc4103000 0x7f1dc419e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.138+0000 7f1dbb400700 1 -- 172.21.15.159:0/1831896000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc4103000 msgr2=0x7f1dc419e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.139+0000 7f1dbb400700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc4103000 0x7f1dc419e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.139+0000 7f1dbb400700 1 -- 172.21.15.159:0/1831896000 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac0095f0 con 0x7f1dc41039b0 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.139+0000 7f1dc3e00700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc4103000 0x7f1dc419e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.139+0000 7f1dbb400700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc41039b0 0x7f1dc419ed00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005f50 tx=0x7f1dac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:47.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.139+0000 7f1dc1600700 1 -- 172.21.15.159:0/1831896000 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dac01d070 con 0x7f1dc41039b0 2024-02-28T23:02:47.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.139+0000 7f1dcb000700 1 -- 172.21.15.159:0/1831896000 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dc4198ac0 con 0x7f1dc41039b0 2024-02-28T23:02:47.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.139+0000 7f1dc1600700 1 -- 172.21.15.159:0/1831896000 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1dac00f460 con 0x7f1dc41039b0 2024-02-28T23:02:47.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.139+0000 7f1dc1600700 1 -- 172.21.15.159:0/1831896000 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dac004fd0 con 0x7f1dc41039b0 2024-02-28T23:02:47.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.139+0000 7f1dcb000700 1 -- 172.21.15.159:0/1831896000 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dc4198fb0 con 0x7f1dc41039b0 2024-02-28T23:02:47.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.140+0000 7f1dcb000700 1 -- 172.21.15.159:0/1831896000 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dc410b400 con 0x7f1dc41039b0 2024-02-28T23:02:47.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.141+0000 7f1dc1600700 1 -- 172.21.15.159:0/1831896000 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f1dac00f5d0 con 0x7f1dc41039b0 2024-02-28T23:02:47.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.142+0000 7f1dc1600700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f1da806c4e0 0x7f1da806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:47.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.142+0000 7f1dc1600700 1 -- 172.21.15.159:0/1831896000 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f1dac08c900 con 0x7f1dc41039b0 2024-02-28T23:02:47.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.142+0000 7f1dc3e00700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f1da806c4e0 0x7f1da806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:47.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.143+0000 7f1dc3e00700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f1da806c4e0 0x7f1da806e9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1db40060b0 tx=0x7f1db40076a0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:47.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.147+0000 7f1dc1600700 1 -- 172.21.15.159:0/1831896000 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f1dac05ae10 con 0x7f1dc41039b0 2024-02-28T23:02:47.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.356+0000 7f1dcb000700 1 -- 172.21.15.159:0/1831896000 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1dc402cd30 con 0x7f1da806c4e0 2024-02-28T23:02:47.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.358+0000 7f1dc1600700 1 -- 172.21.15.159:0/1831896000 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27018 (secure 0 0 0) 0x7f1dc402cd30 con 0x7f1da806c4e0 2024-02-28T23:02:47.358 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:02:47.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.361+0000 7f1dcb000700 1 -- 172.21.15.159:0/1831896000 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f1da806c4e0 msgr2=0x7f1da806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:47.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.361+0000 7f1dcb000700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f1da806c4e0 0x7f1da806e9a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1db40060b0 tx=0x7f1db40076a0 comp rx=0 tx=0).stop 2024-02-28T23:02:47.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.361+0000 7f1dcb000700 1 -- 172.21.15.159:0/1831896000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc41039b0 msgr2=0x7f1dc419ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:47.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.361+0000 7f1dcb000700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc41039b0 0x7f1dc419ed00 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1dac005f50 tx=0x7f1dac00be20 comp rx=0 tx=0).stop 2024-02-28T23:02:47.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.362+0000 7f1dcb000700 1 -- 172.21.15.159:0/1831896000 shutdown_connections 2024-02-28T23:02:47.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.362+0000 7f1dcb000700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1dc4103000 0x7f1dc419e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:47.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.362+0000 7f1dcb000700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f1da806c4e0 0x7f1da806e9a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:47.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.362+0000 7f1dcb000700 1 --2- 172.21.15.159:0/1831896000 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1dc41039b0 0x7f1dc419ed00 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:47.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.362+0000 7f1dcb000700 1 -- 172.21.15.159:0/1831896000 >> 172.21.15.159:0/1831896000 conn(0x7f1dc40fe8d0 msgr2=0x7f1dc4100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:47.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.362+0000 7f1dcb000700 1 -- 172.21.15.159:0/1831896000 shutdown_connections 2024-02-28T23:02:47.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:47.362+0000 7f1dcb000700 1 -- 172.21.15.159:0/1831896000 wait complete. 2024-02-28T23:02:47.363 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-02-28T23:02:48.072 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2024-02-28T23:02:47.036914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003322"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-28T23:01:44.604921+0000","last_change":"2024-02-28T23:01:11.247642+0000","last_active":"2024-02-28T23:01:44.604921+0000","last_peered":"2024-02-28T23:01:44.604921+0000","last_clean":"2024-02-28T23:01:44.604921+0000","last_became_active":"2024-02-28T23:01:11.246946+0000","last_became_peered":"2024-02-28T23:01:11.246946+0000","last_unstale":"2024-02-28T23:01:44.604921+0000","last_undegraded":"2024-02-28T23:01:44.604921+0000","last_fullsized":"2024-02-28T23:01:44.604921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-28T23:00:05.693644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-28T23:00:05.693644+0000","last_clean_scrub_stamp":"2024-02-28T23:00:05.693644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-01T02:11:42.038152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724560,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 23:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.3149999999999999}]},{"osd":1,"last update":"Wed Feb 28 23:02:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.45}]},{"osd":2,"last update":"Wed Feb 28 23:02:13 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.204}]},{"osd":3,"last update":"Wed Feb 28 23:02:13 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0960000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]}]},{"osd":3,"up_from":26,"seq":111669149723,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 23:02:40 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.0369999999999999,"15min":1.0089999999999999},"min":{"1min":0.77000000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.107,"15min":1.081},"min":{"1min":0.77900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.052,"5min":2.278,"15min":2.278},"last":1.0600000000000001}]},{"osd":1,"last update":"Wed Feb 28 23:02:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.95499999999999996,"15min":0.94699999999999995},"min":{"1min":0.67000000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6930000000000001,"5min":1.899,"15min":1.899},"last":0.877},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98999999999999999,"15min":0.99299999999999999},"min":{"1min":0.64400000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.319,"5min":1.423,"15min":1.423},"last":0.91400000000000003}]},{"osd":2,"last update":"Wed Feb 28 23:02:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.75800000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.399,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.222},{"interface":"front","average":{"1min":1.218,"5min":1.0760000000000001,"15min":1.052},"min":{"1min":0.83599999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.98399999999999999}]},{"osd":4,"last update":"Wed Feb 28 23:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.1910000000000001},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.0249999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378658,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 23:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0649999999999999,"5min":1.165,"15min":1.165},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.84299999999999997,"15min":0.83499999999999996},"min":{"1min":0.55600000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.171,"5min":1.54,"15min":1.54},"last":0.94499999999999995}]},{"osd":1,"last update":"Wed Feb 28 23:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.85399999999999998,"15min":0.83499999999999996},"min":{"1min":0.44900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.91500000000000004,"15min":0.90600000000000003},"min":{"1min":0.47599999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2729999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0289999999999999}]},{"osd":3,"last update":"Wed Feb 28 23:02:43 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.109,"15min":1.081},"min":{"1min":0.86399999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.073},{"interface":"front","average":{"1min":1.204,"5min":1.1519999999999999,"15min":1.1439999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.1499999999999999}]},{"osd":4,"last update":"Wed Feb 28 23:02:12 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.252}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]}]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 28 23:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.72199999999999998,"15min":0.69399999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.288,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.79400000000000004,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.228}]},{"osd":2,"last update":"Wed Feb 28 23:02:10 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.999,"15min":1.0009999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0429999999999999,"15min":1.0409999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8680000000000001,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.83899999999999997}]},{"osd":3,"last update":"Wed Feb 28 23:02:41 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.0649999999999999,"15min":1.0529999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.1990000000000001,"15min":1.1910000000000001},"min":{"1min":0.89700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.6830000000000001,"5min":1.752,"15min":1.752},"last":1.333}]},{"osd":4,"last update":"Wed Feb 28 23:02:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 23:02:34 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.70299999999999996,"15min":0.64800000000000002},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.749,"15min":0.69699999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.86599999999999999}]},{"osd":2,"last update":"Wed Feb 28 23:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.83899999999999997,"15min":0.83499999999999996},"min":{"1min":0.54100000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.90900000000000003,"15min":0.89900000000000002},"min":{"1min":0.63900000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.248,"5min":1.335,"15min":1.335},"last":0.92900000000000005}]},{"osd":3,"last update":"Wed Feb 28 23:01:39 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.262,"5min":1.262,"15min":1.262},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.087,"5min":1.087,"15min":1.087},"min":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":1.389}]},{"osd":4,"last update":"Wed Feb 28 23:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":1.248},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.1519999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.077}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-28T23:02:48.074 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph pg dump --format=json 2024-02-28T23:02:48.487 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:48.630 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:48 smithi159 ceph-mon[28802]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:48.631 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:48 smithi159 ceph-mon[28802]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T23:02:48.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:48 smithi184 ceph-mon[36198]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:48.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:48 smithi184 ceph-mon[36198]: from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T23:02:50.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:50 smithi184 ceph-mon[36198]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:02:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:02:50.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.614+0000 7f245cc00700 1 -- 172.21.15.159:0/330219192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2458073ae0 msgr2=0x7f245810ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:50.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.614+0000 7f245cc00700 1 --2- 172.21.15.159:0/330219192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2458073ae0 0x7f245810ce40 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2444009910 tx=0x7f2444009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:50.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.614+0000 7f245cc00700 1 -- 172.21.15.159:0/330219192 shutdown_connections 2024-02-28T23:02:50.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.614+0000 7f245cc00700 1 --2- 172.21.15.159:0/330219192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2458073ae0 0x7f245810ce40 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:50.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.614+0000 7f245cc00700 1 --2- 172.21.15.159:0/330219192 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f24580731c0 0x7f24580735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:50.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.614+0000 7f245cc00700 1 -- 172.21.15.159:0/330219192 >> 172.21.15.159:0/330219192 conn(0x7f24580fc630 msgr2=0x7f24580fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:50.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.615+0000 7f245cc00700 1 -- 172.21.15.159:0/330219192 shutdown_connections 2024-02-28T23:02:50.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.615+0000 7f245cc00700 1 -- 172.21.15.159:0/330219192 wait complete. 2024-02-28T23:02:50.617 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:50 smithi159 ceph-mon[28802]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:50.617 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:02:50.617 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:02:50.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.616+0000 7f245cc00700 1 Processor -- start 2024-02-28T23:02:50.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.616+0000 7f245cc00700 1 -- start start 2024-02-28T23:02:50.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.616+0000 7f245cc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24580731c0 0x7f2458198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:50.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.616+0000 7f245cc00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2458073ae0 0x7f2458198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:50.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.616+0000 7f245cc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2458199530 con 0x7f24580731c0 2024-02-28T23:02:50.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.616+0000 7f245cc00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245819d340 con 0x7f2458073ae0 2024-02-28T23:02:50.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.617+0000 7f2455e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24580731c0 0x7f2458198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:50.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.617+0000 7f2455e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24580731c0 0x7f2458198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56670/0 (socket says 172.21.15.159:56670) 2024-02-28T23:02:50.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.617+0000 7f2455e00700 1 -- 172.21.15.159:0/355828681 learned_addr learned my addr 172.21.15.159:0/355828681 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:50.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.617+0000 7f2455e00700 1 -- 172.21.15.159:0/355828681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2458073ae0 msgr2=0x7f2458198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:50.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.617+0000 7f2455e00700 1 --2- 172.21.15.159:0/355828681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2458073ae0 0x7f2458198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:50.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.617+0000 7f2455e00700 1 -- 172.21.15.159:0/355828681 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24440095f0 con 0x7f24580731c0 2024-02-28T23:02:50.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.617+0000 7f2455e00700 1 --2- 172.21.15.159:0/355828681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24580731c0 0x7f2458198960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f244800d8d0 tx=0x7f244800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:50.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.618+0000 7f244ea00700 1 -- 172.21.15.159:0/355828681 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2448009940 con 0x7f24580731c0 2024-02-28T23:02:50.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.618+0000 7f244ea00700 1 -- 172.21.15.159:0/355828681 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2448010460 con 0x7f24580731c0 2024-02-28T23:02:50.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.618+0000 7f244ea00700 1 -- 172.21.15.159:0/355828681 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f244800f5f0 con 0x7f24580731c0 2024-02-28T23:02:50.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.618+0000 7f245cc00700 1 -- 172.21.15.159:0/355828681 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245819d620 con 0x7f24580731c0 2024-02-28T23:02:50.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.618+0000 7f245cc00700 1 -- 172.21.15.159:0/355828681 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245819db20 con 0x7f24580731c0 2024-02-28T23:02:50.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.619+0000 7f245cc00700 1 -- 172.21.15.159:0/355828681 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245810a540 con 0x7f24580731c0 2024-02-28T23:02:50.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.621+0000 7f244ea00700 1 -- 172.21.15.159:0/355828681 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f24480105d0 con 0x7f24580731c0 2024-02-28T23:02:50.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.623+0000 7f244ea00700 1 --2- 172.21.15.159:0/355828681 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f243c06c4e0 0x7f243c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:50.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.623+0000 7f244ea00700 1 -- 172.21.15.159:0/355828681 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f244808b590 con 0x7f24580731c0 2024-02-28T23:02:50.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.623+0000 7f2455400700 1 --2- 172.21.15.159:0/355828681 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f243c06c4e0 0x7f243c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:50.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.624+0000 7f2455400700 1 --2- 172.21.15.159:0/355828681 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f243c06c4e0 0x7f243c06e9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2444006010 tx=0x7f244400b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:50.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.628+0000 7f244ea00700 1 -- 172.21.15.159:0/355828681 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2448059aa0 con 0x7f24580731c0 2024-02-28T23:02:50.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.834+0000 7f245cc00700 1 -- 172.21.15.159:0/355828681 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f245819dec0 con 0x7f243c06c4e0 2024-02-28T23:02:50.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.837+0000 7f244ea00700 1 -- 172.21.15.159:0/355828681 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27489 (secure 0 0 0) 0x7f245819dec0 con 0x7f243c06c4e0 2024-02-28T23:02:50.837 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:02:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.839+0000 7f245cc00700 1 -- 172.21.15.159:0/355828681 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f243c06c4e0 msgr2=0x7f243c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.839+0000 7f245cc00700 1 --2- 172.21.15.159:0/355828681 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f243c06c4e0 0x7f243c06e9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2444006010 tx=0x7f244400b540 comp rx=0 tx=0).stop 2024-02-28T23:02:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.839+0000 7f245cc00700 1 -- 172.21.15.159:0/355828681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24580731c0 msgr2=0x7f2458198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.839+0000 7f245cc00700 1 --2- 172.21.15.159:0/355828681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24580731c0 0x7f2458198960 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f244800d8d0 tx=0x7f244800dc90 comp rx=0 tx=0).stop 2024-02-28T23:02:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.840+0000 7f245cc00700 1 -- 172.21.15.159:0/355828681 shutdown_connections 2024-02-28T23:02:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.840+0000 7f245cc00700 1 --2- 172.21.15.159:0/355828681 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f243c06c4e0 0x7f243c06e9a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.840+0000 7f245cc00700 1 --2- 172.21.15.159:0/355828681 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24580731c0 0x7f2458198960 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.840+0000 7f245cc00700 1 --2- 172.21.15.159:0/355828681 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2458073ae0 0x7f2458198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.840+0000 7f245cc00700 1 -- 172.21.15.159:0/355828681 >> 172.21.15.159:0/355828681 conn(0x7f24580fc630 msgr2=0x7f2458107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:50.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.840+0000 7f245cc00700 1 -- 172.21.15.159:0/355828681 shutdown_connections 2024-02-28T23:02:50.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:50.840+0000 7f245cc00700 1 -- 172.21.15.159:0/355828681 wait complete. 2024-02-28T23:02:50.840 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-02-28T23:02:51.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:51 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:02:51.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:51 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:02:51.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:51 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:02:51.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:51 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:02:51.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:51 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:02:51.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:51 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:02:51.883 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":200,"stamp":"2024-02-28T23:02:49.037621+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":165588,"kb_used_data":3876,"kb_used_omap":0,"kb_used_meta":161664,"kb_avail":562305324,"statfs":{"total":575970213888,"available":575800651776,"internally_reserved":0,"allocated":3969024,"data_stored":2609166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":165543936},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003658"},"pg_stats":[{"pgid":"1.0","version":"22'117","reported_seq":186,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-02-28T23:01:44.604921+0000","last_change":"2024-02-28T23:01:11.247642+0000","last_active":"2024-02-28T23:01:44.604921+0000","last_peered":"2024-02-28T23:01:44.604921+0000","last_clean":"2024-02-28T23:01:44.604921+0000","last_became_active":"2024-02-28T23:01:11.246946+0000","last_became_peered":"2024-02-28T23:01:11.246946+0000","last_unstale":"2024-02-28T23:01:44.604921+0000","last_undegraded":"2024-02-28T23:01:44.604921+0000","last_fullsized":"2024-02-28T23:01:44.604921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-28T23:00:05.693644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-28T23:00:05.693644+0000","last_clean_scrub_stamp":"2024-02-28T23:00:05.693644+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-01T02:11:42.038152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724560,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1639999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]}]},{"osd":4,"up_from":34,"seq":146028888086,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 23:02:13 2024","interfaces":[{"interface":"back","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.482,"5min":1.482,"15min":1.482},"last":1.3149999999999999}]},{"osd":1,"last update":"Wed Feb 28 23:02:13 2024","interfaces":[{"interface":"back","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":1.8520000000000001,"5min":1.8520000000000001,"15min":1.8520000000000001},"last":1.45}]},{"osd":2,"last update":"Wed Feb 28 23:02:13 2024","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.7230000000000001,"5min":1.7230000000000001,"15min":1.7230000000000001},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":1.204}]},{"osd":3,"last update":"Wed Feb 28 23:02:13 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.0569999999999999},{"interface":"front","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":2.2280000000000002,"5min":2.2280000000000002,"15min":2.2280000000000002},"last":1.0960000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.381}]}]},{"osd":3,"up_from":26,"seq":111669149724,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 23:02:40 2024","interfaces":[{"interface":"back","average":{"1min":1.2050000000000001,"5min":1.0369999999999999,"15min":1.0089999999999999},"min":{"1min":0.77000000000000002,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.7130000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.107,"15min":1.081},"min":{"1min":0.77900000000000003,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":2.052,"5min":2.278,"15min":2.278},"last":1.79}]},{"osd":1,"last update":"Wed Feb 28 23:02:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.95499999999999996,"15min":0.94699999999999995},"min":{"1min":0.67000000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6930000000000001,"5min":1.899,"15min":1.899},"last":1.276},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.98999999999999999,"15min":0.99299999999999999},"min":{"1min":0.64400000000000002,"5min":0.625,"15min":0.625},"max":{"1min":1.319,"5min":1.423,"15min":1.423},"last":0.95599999999999996}]},{"osd":2,"last update":"Wed Feb 28 23:02:40 2024","interfaces":[{"interface":"back","average":{"1min":1.0329999999999999,"5min":1.0169999999999999,"15min":1.0149999999999999},"min":{"1min":0.75800000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.399,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.0760000000000001,"15min":1.052},"min":{"1min":0.83599999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":3.2210000000000001,"5min":3.2210000000000001,"15min":3.2210000000000001},"last":0.91100000000000003}]},{"osd":4,"last update":"Wed Feb 28 23:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":1.0629999999999999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":1.1000000000000001}]},{"osd":5,"last update":"Wed Feb 28 23:02:46 2024","interfaces":[{"interface":"back","average":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":1.5529999999999999,"5min":1.5529999999999999,"15min":1.5529999999999999},"last":1.0369999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378658,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27308,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717844,"statfs":{"total":95995035648,"available":95967072256,"internally_reserved":0,"allocated":364544,"data_stored":139677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 23:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.75,"15min":0.74299999999999999},"min":{"1min":0.41299999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0649999999999999,"5min":1.165,"15min":1.165},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.84299999999999997,"15min":0.83499999999999996},"min":{"1min":0.55600000000000005,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.171,"5min":1.54,"15min":1.54},"last":0.94499999999999995}]},{"osd":1,"last update":"Wed Feb 28 23:02:06 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":0.85399999999999998,"15min":0.83499999999999996},"min":{"1min":0.44900000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.999},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.91500000000000004,"15min":0.90600000000000003},"min":{"1min":0.47599999999999998,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.2729999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0289999999999999}]},{"osd":3,"last update":"Wed Feb 28 23:02:43 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.109,"15min":1.081},"min":{"1min":0.86399999999999999,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.073},{"interface":"front","average":{"1min":1.204,"5min":1.1519999999999999,"15min":1.1439999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6699999999999999,"5min":1.6699999999999999,"15min":1.6699999999999999},"last":1.1499999999999999}]},{"osd":4,"last update":"Wed Feb 28 23:02:12 2024","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":1.181,"15min":1.181},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"last":1.4019999999999999},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"min":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":1.252}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.446}]}]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 28 23:02:30 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.72199999999999998,"15min":0.69399999999999995},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.288,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.79400000000000004,"15min":0.72799999999999998},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":1.228}]},{"osd":2,"last update":"Wed Feb 28 23:02:10 2024","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.999,"15min":1.0009999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.5349999999999999,"5min":1.5349999999999999,"15min":1.5349999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.0429999999999999,"15min":1.0409999999999999},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.8680000000000001,"5min":2.4580000000000002,"15min":2.4580000000000002},"last":0.83899999999999997}]},{"osd":3,"last update":"Wed Feb 28 23:02:41 2024","interfaces":[{"interface":"back","average":{"1min":1.135,"5min":1.0649999999999999,"15min":1.0529999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.1990000000000001,"15min":1.1910000000000001},"min":{"1min":0.89700000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"max":{"1min":1.6830000000000001,"5min":1.752,"15min":1.752},"last":1.333}]},{"osd":4,"last update":"Wed Feb 28 23:02:15 2024","interfaces":[{"interface":"back","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.889,"5min":1.889,"15min":1.889},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":1.0760000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":730045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 28 23:02:34 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.70299999999999996,"15min":0.64800000000000002},"min":{"1min":0.47399999999999998,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.749,"15min":0.69699999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.76300000000000001}]},{"osd":2,"last update":"Wed Feb 28 23:02:09 2024","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.83899999999999997,"15min":0.83499999999999996},"min":{"1min":0.54100000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.90900000000000003,"15min":0.89900000000000002},"min":{"1min":0.63900000000000001,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.248,"5min":1.335,"15min":1.335},"last":0.88800000000000001}]},{"osd":3,"last update":"Wed Feb 28 23:02:44 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.0549999999999999,"15min":1.0349999999999999},"min":{"1min":0.81599999999999995,"5min":0.68200000000000005,"15min":0.68200000000000005},"max":{"1min":1.6020000000000001,"5min":1.6020000000000001,"15min":1.6020000000000001},"last":1.042},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.117,"15min":1.097},"min":{"1min":0.93100000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":1.1990000000000001}]},{"osd":4,"last update":"Wed Feb 28 23:02:14 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.631,"5min":1.631,"15min":1.631},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.149,"5min":1.149,"15min":1.149},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":1.9319999999999999,"5min":1.9319999999999999,"15min":1.9319999999999999},"last":1.01}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-02-28T23:02:51.884 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-28T23:02:51.884 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-28T23:02:51.884 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-28T23:02:51.885 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph health --format=json 2024-02-28T23:02:52.292 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:52.651 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:52 smithi159 ceph-mon[28802]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T23:02:52.651 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:52 smithi159 ceph-mon[28802]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:52 smithi184 ceph-mon[36198]: from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-28T23:02:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:52 smithi184 ceph-mon[36198]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:54.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.620+0000 7f44c3200700 1 -- 172.21.15.159:0/2552332579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44bc069020 msgr2=0x7f44bc105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:54.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.620+0000 7f44c3200700 1 --2- 172.21.15.159:0/2552332579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44bc069020 0x7f44bc105790 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f44a400b0a0 tx=0x7f44a400b3b0 comp rx=0 tx=0).stop 2024-02-28T23:02:54.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.620+0000 7f44c3200700 1 -- 172.21.15.159:0/2552332579 shutdown_connections 2024-02-28T23:02:54.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.620+0000 7f44c3200700 1 --2- 172.21.15.159:0/2552332579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44bc069020 0x7f44bc105790 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:54.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.620+0000 7f44c3200700 1 --2- 172.21.15.159:0/2552332579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44bc068670 0x7f44bc068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:54.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.620+0000 7f44c3200700 1 -- 172.21.15.159:0/2552332579 >> 172.21.15.159:0/2552332579 conn(0x7f44bc0755a0 msgr2=0x7f44bc0759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:54.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.621+0000 7f44c3200700 1 -- 172.21.15.159:0/2552332579 shutdown_connections 2024-02-28T23:02:54.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.621+0000 7f44c3200700 1 -- 172.21.15.159:0/2552332579 wait complete. 2024-02-28T23:02:54.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.622+0000 7f44c3200700 1 Processor -- start 2024-02-28T23:02:54.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.622+0000 7f44c3200700 1 -- start start 2024-02-28T23:02:54.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.622+0000 7f44c3200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44bc068670 0x7f44bc0ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:54.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.622+0000 7f44c3200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44bc069020 0x7f44bc1001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:54.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.622+0000 7f44c3200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc100720 con 0x7f44bc069020 2024-02-28T23:02:54.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.622+0000 7f44c3200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44bc100860 con 0x7f44bc068670 2024-02-28T23:02:54.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.622+0000 7f44b3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44bc069020 0x7f44bc1001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:54.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.623+0000 7f44b3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44bc069020 0x7f44bc1001e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56684/0 (socket says 172.21.15.159:56684) 2024-02-28T23:02:54.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.623+0000 7f44b3400700 1 -- 172.21.15.159:0/891072242 learned_addr learned my addr 172.21.15.159:0/891072242 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:54.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.623+0000 7f44bbe00700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44bc068670 0x7f44bc0ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:54.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.623+0000 7f44b3400700 1 -- 172.21.15.159:0/891072242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44bc068670 msgr2=0x7f44bc0ffca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:54.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.623+0000 7f44b3400700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44bc068670 0x7f44bc0ffca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:54.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.623+0000 7f44b3400700 1 -- 172.21.15.159:0/891072242 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a4009d00 con 0x7f44bc069020 2024-02-28T23:02:54.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.623+0000 7f44bbe00700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44bc068670 0x7f44bc0ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:02:54.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.623+0000 7f44b3400700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44bc069020 0x7f44bc1001e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009fd0 tx=0x7f44a400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:54.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.624+0000 7f44b9600700 1 -- 172.21.15.159:0/891072242 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44a400e040 con 0x7f44bc069020 2024-02-28T23:02:54.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.624+0000 7f44c3200700 1 -- 172.21.15.159:0/891072242 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44bc100ae0 con 0x7f44bc069020 2024-02-28T23:02:54.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.624+0000 7f44b9600700 1 -- 172.21.15.159:0/891072242 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f44a4003e60 con 0x7f44bc069020 2024-02-28T23:02:54.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.624+0000 7f44b9600700 1 -- 172.21.15.159:0/891072242 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44a401d9a0 con 0x7f44bc069020 2024-02-28T23:02:54.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.624+0000 7f44c3200700 1 -- 172.21.15.159:0/891072242 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44bc1a2da0 con 0x7f44bc069020 2024-02-28T23:02:54.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.625+0000 7f44c3200700 1 -- 172.21.15.159:0/891072242 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44bc1090e0 con 0x7f44bc069020 2024-02-28T23:02:54.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.626+0000 7f44b9600700 1 -- 172.21.15.159:0/891072242 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f44a4004040 con 0x7f44bc069020 2024-02-28T23:02:54.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.627+0000 7f44b9600700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f44a006c4e0 0x7f44a006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:54.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.627+0000 7f44b9600700 1 -- 172.21.15.159:0/891072242 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f44a408cf00 con 0x7f44bc069020 2024-02-28T23:02:54.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.627+0000 7f44bbe00700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f44a006c4e0 0x7f44a006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:54.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.628+0000 7f44bbe00700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f44a006c4e0 0x7f44a006e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0099d0 tx=0x7f44ac008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:54.631 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.632+0000 7f44b9600700 1 -- 172.21.15.159:0/891072242 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f44a4057a00 con 0x7f44bc069020 2024-02-28T23:02:54.631 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:54 smithi159 ceph-mon[28802]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:54.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:54 smithi184 ceph-mon[36198]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:54.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.891+0000 7f44c3200700 1 -- 172.21.15.159:0/891072242 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f44bc04ea90 con 0x7f44bc069020 2024-02-28T23:02:54.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.892+0000 7f44b9600700 1 -- 172.21.15.159:0/891072242 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f44a405b020 con 0x7f44bc069020 2024-02-28T23:02:54.892 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:02:54.892 INFO:teuthology.orchestra.run.smithi159.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-28T23:02:54.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.895+0000 7f44c3200700 1 -- 172.21.15.159:0/891072242 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f44a006c4e0 msgr2=0x7f44a006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:54.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.895+0000 7f44c3200700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f44a006c4e0 0x7f44a006e9a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f44ac0099d0 tx=0x7f44ac008040 comp rx=0 tx=0).stop 2024-02-28T23:02:54.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.895+0000 7f44c3200700 1 -- 172.21.15.159:0/891072242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44bc069020 msgr2=0x7f44bc1001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:54.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.895+0000 7f44c3200700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44bc069020 0x7f44bc1001e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f44a4009fd0 tx=0x7f44a400cdb0 comp rx=0 tx=0).stop 2024-02-28T23:02:54.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.895+0000 7f44c3200700 1 -- 172.21.15.159:0/891072242 shutdown_connections 2024-02-28T23:02:54.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.895+0000 7f44c3200700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f44bc068670 0x7f44bc0ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:54.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.895+0000 7f44c3200700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f44a006c4e0 0x7f44a006e9a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:54.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.895+0000 7f44c3200700 1 --2- 172.21.15.159:0/891072242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f44bc069020 0x7f44bc1001e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:54.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.895+0000 7f44c3200700 1 -- 172.21.15.159:0/891072242 >> 172.21.15.159:0/891072242 conn(0x7f44bc0755a0 msgr2=0x7f44bc0fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:54.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.896+0000 7f44c3200700 1 -- 172.21.15.159:0/891072242 shutdown_connections 2024-02-28T23:02:54.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:54.896+0000 7f44c3200700 1 -- 172.21.15.159:0/891072242 wait complete. 2024-02-28T23:02:55.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:55 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/891072242' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-28T23:02:55.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:55 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/891072242' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-28T23:02:55.825 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-28T23:02:55.825 INFO:tasks.cephadm:Setup complete, yielding 2024-02-28T23:02:55.826 INFO:teuthology.run_tasks:Running task print... 2024-02-28T23:02:55.836 INFO:teuthology.task.print:**** done end installing v18.2.1 cephadm ... 2024-02-28T23:02:55.837 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T23:02:55.863 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:02:55.864 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-02-28T23:02:56.264 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:02:56.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:56 smithi159 ceph-mon[28802]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:56.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:56 smithi184 ceph-mon[36198]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:58.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.566+0000 7f333a400700 1 -- 172.21.15.159:0/4254060361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33340737f0 msgr2=0x7f3334073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:58.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.566+0000 7f333a400700 1 --2- 172.21.15.159:0/4254060361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33340737f0 0x7f3334073c70 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3320009910 tx=0x7f3320009c20 comp rx=0 tx=0).stop 2024-02-28T23:02:58.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.566+0000 7f333a400700 1 -- 172.21.15.159:0/4254060361 shutdown_connections 2024-02-28T23:02:58.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.566+0000 7f333a400700 1 --2- 172.21.15.159:0/4254060361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33340737f0 0x7f3334073c70 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:58.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.566+0000 7f333a400700 1 --2- 172.21.15.159:0/4254060361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3334074dc0 0x7f3334073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:58.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.566+0000 7f333a400700 1 -- 172.21.15.159:0/4254060361 >> 172.21.15.159:0/4254060361 conn(0x7f33340fc140 msgr2=0x7f33340fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:58.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.566+0000 7f333a400700 1 -- 172.21.15.159:0/4254060361 shutdown_connections 2024-02-28T23:02:58.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.567+0000 7f333a400700 1 -- 172.21.15.159:0/4254060361 wait complete. 2024-02-28T23:02:58.567 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:58 smithi159 ceph-mon[28802]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:58.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.568+0000 7f333a400700 1 Processor -- start 2024-02-28T23:02:58.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.568+0000 7f333a400700 1 -- start start 2024-02-28T23:02:58.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.568+0000 7f333a400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33340737f0 0x7f33341985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:58.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.568+0000 7f333a400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3334074dc0 0x7f3334198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:58.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.568+0000 7f333a400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3334199120 con 0x7f33340737f0 2024-02-28T23:02:58.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.568+0000 7f333a400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3334199260 con 0x7f3334074dc0 2024-02-28T23:02:58.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.569+0000 7f3333400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33340737f0 0x7f33341985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:58.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.569+0000 7f3333400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33340737f0 0x7f33341985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48836/0 (socket says 172.21.15.159:48836) 2024-02-28T23:02:58.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.569+0000 7f3333400700 1 -- 172.21.15.159:0/3052190827 learned_addr learned my addr 172.21.15.159:0/3052190827 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:02:58.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.569+0000 7f3333400700 1 -- 172.21.15.159:0/3052190827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3334074dc0 msgr2=0x7f3334198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:58.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.569+0000 7f3333400700 1 --2- 172.21.15.159:0/3052190827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3334074dc0 0x7f3334198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:58.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.569+0000 7f3333400700 1 -- 172.21.15.159:0/3052190827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33200095f0 con 0x7f33340737f0 2024-02-28T23:02:58.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.569+0000 7f3333400700 1 --2- 172.21.15.159:0/3052190827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33340737f0 0x7f33341985c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f332400d900 tx=0x7f332400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:58.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.570+0000 7f332be00700 1 -- 172.21.15.159:0/3052190827 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3324009900 con 0x7f33340737f0 2024-02-28T23:02:58.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.570+0000 7f332be00700 1 -- 172.21.15.159:0/3052190827 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3324010460 con 0x7f33340737f0 2024-02-28T23:02:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.570+0000 7f333a400700 1 -- 172.21.15.159:0/3052190827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f333419dd10 con 0x7f33340737f0 2024-02-28T23:02:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.570+0000 7f332be00700 1 -- 172.21.15.159:0/3052190827 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f332400f5f0 con 0x7f33340737f0 2024-02-28T23:02:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.570+0000 7f333a400700 1 -- 172.21.15.159:0/3052190827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f333419e200 con 0x7f33340737f0 2024-02-28T23:02:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.571+0000 7f333a400700 1 -- 172.21.15.159:0/3052190827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f333410b9c0 con 0x7f33340737f0 2024-02-28T23:02:58.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.572+0000 7f332be00700 1 -- 172.21.15.159:0/3052190827 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f33240105d0 con 0x7f33340737f0 2024-02-28T23:02:58.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.573+0000 7f332be00700 1 --2- 172.21.15.159:0/3052190827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f331806c4e0 0x7f331806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:02:58.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.573+0000 7f332be00700 1 -- 172.21.15.159:0/3052190827 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f332408b2f0 con 0x7f33340737f0 2024-02-28T23:02:58.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.573+0000 7f3332a00700 1 --2- 172.21.15.159:0/3052190827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f331806c4e0 0x7f331806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:02:58.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.574+0000 7f3332a00700 1 --2- 172.21.15.159:0/3052190827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f331806c4e0 0x7f331806e9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f332000b5c0 tx=0x7f3320005960 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:02:58.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.578+0000 7f332be00700 1 -- 172.21.15.159:0/3052190827 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3324059880 con 0x7f33340737f0 2024-02-28T23:02:58.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.794+0000 7f333a400700 1 -- 172.21.15.159:0/3052190827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f333410bb80 con 0x7f33340737f0 2024-02-28T23:02:58.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.801+0000 7f332be00700 1 -- 172.21.15.159:0/3052190827 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7f3324059410 con 0x7f33340737f0 2024-02-28T23:02:58.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.805+0000 7f333a400700 1 -- 172.21.15.159:0/3052190827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f331806c4e0 msgr2=0x7f331806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:58.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.805+0000 7f333a400700 1 --2- 172.21.15.159:0/3052190827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f331806c4e0 0x7f331806e9a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f332000b5c0 tx=0x7f3320005960 comp rx=0 tx=0).stop 2024-02-28T23:02:58.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.805+0000 7f333a400700 1 -- 172.21.15.159:0/3052190827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33340737f0 msgr2=0x7f33341985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:02:58.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.805+0000 7f333a400700 1 --2- 172.21.15.159:0/3052190827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33340737f0 0x7f33341985c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f332400d900 tx=0x7f332400dcc0 comp rx=0 tx=0).stop 2024-02-28T23:02:58.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.805+0000 7f333a400700 1 -- 172.21.15.159:0/3052190827 shutdown_connections 2024-02-28T23:02:58.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.805+0000 7f333a400700 1 --2- 172.21.15.159:0/3052190827 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f331806c4e0 0x7f331806e9a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:58.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.805+0000 7f333a400700 1 --2- 172.21.15.159:0/3052190827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33340737f0 0x7f33341985c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:58.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.805+0000 7f333a400700 1 --2- 172.21.15.159:0/3052190827 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3334074dc0 0x7f3334198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:02:58.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.805+0000 7f333a400700 1 -- 172.21.15.159:0/3052190827 >> 172.21.15.159:0/3052190827 conn(0x7f33340fc140 msgr2=0x7f33341069a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:02:58.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.806+0000 7f333a400700 1 -- 172.21.15.159:0/3052190827 shutdown_connections 2024-02-28T23:02:58.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:02:58.806+0000 7f333a400700 1 -- 172.21.15.159:0/3052190827 wait complete. 2024-02-28T23:02:58.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:58 smithi184 ceph-mon[36198]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:02:59.736 INFO:teuthology.run_tasks:Running task print... 2024-02-28T23:02:59.745 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-02-28T23:02:59.745 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T23:02:59.826 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:02:59.826 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph orch status' 2024-02-28T23:02:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:59 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3052190827' entity='client.admin' 2024-02-28T23:02:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:02:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:02:59.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:02:59.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:02:59.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:02:59 smithi159 ceph-mon[28802]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:00.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:59 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3052190827' entity='client.admin' 2024-02-28T23:03:00.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:03:00.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:00.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:03:00.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:00.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:02:59 smithi184 ceph-mon[36198]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:00.234 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:02.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.223+0000 7f1270c00700 1 -- 172.21.15.159:0/2961916050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f126c102e10 msgr2=0x7f126c103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:02.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.223+0000 7f1270c00700 1 --2- 172.21.15.159:0/2961916050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f126c102e10 0x7f126c103230 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f125c009910 tx=0x7f125c009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:02.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.223+0000 7f1270c00700 1 -- 172.21.15.159:0/2961916050 shutdown_connections 2024-02-28T23:03:02.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.223+0000 7f1270c00700 1 --2- 172.21.15.159:0/2961916050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f126c103f70 0x7f126c1043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:02.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.223+0000 7f1270c00700 1 --2- 172.21.15.159:0/2961916050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f126c102e10 0x7f126c103230 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:02.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.223+0000 7f1270c00700 1 -- 172.21.15.159:0/2961916050 >> 172.21.15.159:0/2961916050 conn(0x7f126c0fe3d0 msgr2=0x7f126c1007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:02.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.223+0000 7f1270c00700 1 -- 172.21.15.159:0/2961916050 shutdown_connections 2024-02-28T23:03:02.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.223+0000 7f1270c00700 1 -- 172.21.15.159:0/2961916050 wait complete. 2024-02-28T23:03:02.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.224+0000 7f1270c00700 1 Processor -- start 2024-02-28T23:03:02.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.224+0000 7f1270c00700 1 -- start start 2024-02-28T23:03:02.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.225+0000 7f1270c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f126c102e10 0x7f126c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:02.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.225+0000 7f1270c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f126c103f70 0x7f126c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:02.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.225+0000 7f1270c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c199150 con 0x7f126c103f70 2024-02-28T23:03:02.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.225+0000 7f1270c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126c199290 con 0x7f126c102e10 2024-02-28T23:03:02.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.225+0000 7f1269400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f126c103f70 0x7f126c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:02.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.225+0000 7f1269400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f126c103f70 0x7f126c198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48866/0 (socket says 172.21.15.159:48866) 2024-02-28T23:03:02.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.225+0000 7f1269400700 1 -- 172.21.15.159:0/2068524119 learned_addr learned my addr 172.21.15.159:0/2068524119 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:02.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.225+0000 7f1269e00700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f126c102e10 0x7f126c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:02.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.226+0000 7f1269400700 1 -- 172.21.15.159:0/2068524119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f126c102e10 msgr2=0x7f126c1985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:02.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.226+0000 7f1269400700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f126c102e10 0x7f126c1985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:02.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.226+0000 7f1269400700 1 -- 172.21.15.159:0/2068524119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c0095f0 con 0x7f126c103f70 2024-02-28T23:03:02.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.226+0000 7f1269e00700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f126c102e10 0x7f126c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:03:02.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.226+0000 7f1269400700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f126c103f70 0x7f126c198b30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f125800b4b0 tx=0x7f125800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:02.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.226+0000 7f1262a00700 1 -- 172.21.15.159:0/2068524119 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1258011800 con 0x7f126c103f70 2024-02-28T23:03:02.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.226+0000 7f1262a00700 1 -- 172.21.15.159:0/2068524119 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1258011e10 con 0x7f126c103f70 2024-02-28T23:03:02.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.226+0000 7f1262a00700 1 -- 172.21.15.159:0/2068524119 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f125800f2e0 con 0x7f126c103f70 2024-02-28T23:03:02.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.226+0000 7f1270c00700 1 -- 172.21.15.159:0/2068524119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126c19dd40 con 0x7f126c103f70 2024-02-28T23:03:02.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.226+0000 7f1270c00700 1 -- 172.21.15.159:0/2068524119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126c19e310 con 0x7f126c103f70 2024-02-28T23:03:02.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.227+0000 7f1270c00700 1 -- 172.21.15.159:0/2068524119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f126c10b970 con 0x7f126c103f70 2024-02-28T23:03:02.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.229+0000 7f1262a00700 1 -- 172.21.15.159:0/2068524119 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f1258010380 con 0x7f126c103f70 2024-02-28T23:03:02.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.229+0000 7f1262a00700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f125006c4e0 0x7f125006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:02.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.230+0000 7f1262a00700 1 -- 172.21.15.159:0/2068524119 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f125808b1d0 con 0x7f126c103f70 2024-02-28T23:03:02.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.230+0000 7f1269e00700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f125006c4e0 0x7f125006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:02.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.230+0000 7f1269e00700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f125006c4e0 0x7f125006e9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f125c006010 tx=0x7f125c00b560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:02.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.234+0000 7f1262a00700 1 -- 172.21.15.159:0/2068524119 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f12580596e0 con 0x7f126c103f70 2024-02-28T23:03:02.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:02 smithi184 ceph-mon[36198]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:02.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.467+0000 7f1270c00700 1 -- 172.21.15.159:0/2068524119 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f126c108950 con 0x7f125006c4e0 2024-02-28T23:03:02.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:02 smithi159 ceph-mon[28802]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:02.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.469+0000 7f1262a00700 1 -- 172.21.15.159:0/2068524119 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f126c108950 con 0x7f125006c4e0 2024-02-28T23:03:02.467 INFO:teuthology.orchestra.run.smithi159.stdout:Backend: cephadm 2024-02-28T23:03:02.467 INFO:teuthology.orchestra.run.smithi159.stdout:Available: Yes 2024-02-28T23:03:02.467 INFO:teuthology.orchestra.run.smithi159.stdout:Paused: No 2024-02-28T23:03:02.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.471+0000 7f1270c00700 1 -- 172.21.15.159:0/2068524119 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f125006c4e0 msgr2=0x7f125006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:02.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.471+0000 7f1270c00700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f125006c4e0 0x7f125006e9a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f125c006010 tx=0x7f125c00b560 comp rx=0 tx=0).stop 2024-02-28T23:03:02.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.471+0000 7f1270c00700 1 -- 172.21.15.159:0/2068524119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f126c103f70 msgr2=0x7f126c198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:02.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.471+0000 7f1270c00700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f126c103f70 0x7f126c198b30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f125800b4b0 tx=0x7f125800b870 comp rx=0 tx=0).stop 2024-02-28T23:03:02.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.472+0000 7f1270c00700 1 -- 172.21.15.159:0/2068524119 shutdown_connections 2024-02-28T23:03:02.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.472+0000 7f1270c00700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f126c102e10 0x7f126c1985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:02.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.472+0000 7f1270c00700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f125006c4e0 0x7f125006e9a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:02.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.472+0000 7f1270c00700 1 --2- 172.21.15.159:0/2068524119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f126c103f70 0x7f126c198b30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:02.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.472+0000 7f1270c00700 1 -- 172.21.15.159:0/2068524119 >> 172.21.15.159:0/2068524119 conn(0x7f126c0fe3d0 msgr2=0x7f126c107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:02.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.472+0000 7f1270c00700 1 -- 172.21.15.159:0/2068524119 shutdown_connections 2024-02-28T23:03:02.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:02.472+0000 7f1270c00700 1 -- 172.21.15.159:0/2068524119 wait complete. 2024-02-28T23:03:03.307 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph orch ps' 2024-02-28T23:03:03.392 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:03 smithi159 ceph-mon[28802]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:03.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:03 smithi184 ceph-mon[36198]: from='client.14432 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:03.716 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:04.425 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:04 smithi159 ceph-mon[28802]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:04 smithi184 ceph-mon[36198]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:05.541 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:03:05.571 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:03:05.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.910+0000 7ff48d200700 1 -- 172.21.15.159:0/4105862041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff488107200 msgr2=0x7ff488107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:05.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.910+0000 7ff48d200700 1 --2- 172.21.15.159:0/4105862041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff488107200 0x7ff488107620 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff478009910 tx=0x7ff478009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:05.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.911+0000 7ff48d200700 1 -- 172.21.15.159:0/4105862041 shutdown_connections 2024-02-28T23:03:05.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.911+0000 7ff48d200700 1 --2- 172.21.15.159:0/4105862041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff488108400 0x7ff488108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:05.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.911+0000 7ff48d200700 1 --2- 172.21.15.159:0/4105862041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff488107200 0x7ff488107620 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:05.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.911+0000 7ff48d200700 1 -- 172.21.15.159:0/4105862041 >> 172.21.15.159:0/4105862041 conn(0x7ff4880761b0 msgr2=0x7ff488078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:05.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.911+0000 7ff48d200700 1 -- 172.21.15.159:0/4105862041 shutdown_connections 2024-02-28T23:03:05.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.911+0000 7ff48d200700 1 -- 172.21.15.159:0/4105862041 wait complete. 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.912+0000 7ff48d200700 1 Processor -- start 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.912+0000 7ff48d200700 1 -- start start 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.912+0000 7ff48d200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff488107200 0x7ff48819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.912+0000 7ff48d200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff488108400 0x7ff48819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.912+0000 7ff48d200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48819d510 con 0x7ff488107200 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.912+0000 7ff48d200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48819d650 con 0x7ff488108400 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.912+0000 7ff485e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff488107200 0x7ff48819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.912+0000 7ff485e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff488107200 0x7ff48819c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:48876/0 (socket says 172.21.15.159:48876) 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.912+0000 7ff485e00700 1 -- 172.21.15.159:0/2863281071 learned_addr learned my addr 172.21.15.159:0/2863281071 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.913+0000 7ff485400700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff488108400 0x7ff48819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.913+0000 7ff485e00700 1 -- 172.21.15.159:0/2863281071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff488108400 msgr2=0x7ff48819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.913+0000 7ff485e00700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff488108400 0x7ff48819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:05.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.913+0000 7ff485e00700 1 -- 172.21.15.159:0/2863281071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4780095f0 con 0x7ff488107200 2024-02-28T23:03:05.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.913+0000 7ff485400700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff488108400 0x7ff48819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:03:05.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.913+0000 7ff485e00700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff488107200 0x7ff48819c9b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff47800bda0 tx=0x7ff47800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:05.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.913+0000 7ff47ea00700 1 -- 172.21.15.159:0/2863281071 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47801d070 con 0x7ff488107200 2024-02-28T23:03:05.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.913+0000 7ff47ea00700 1 -- 172.21.15.159:0/2863281071 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff478004c50 con 0x7ff488107200 2024-02-28T23:03:05.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.913+0000 7ff48d200700 1 -- 172.21.15.159:0/2863281071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4881a20a0 con 0x7ff488107200 2024-02-28T23:03:05.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.913+0000 7ff47ea00700 1 -- 172.21.15.159:0/2863281071 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff47800f690 con 0x7ff488107200 2024-02-28T23:03:05.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.914+0000 7ff48d200700 1 -- 172.21.15.159:0/2863281071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4881a2590 con 0x7ff488107200 2024-02-28T23:03:05.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.915+0000 7ff48d200700 1 -- 172.21.15.159:0/2863281071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff48810fd60 con 0x7ff488107200 2024-02-28T23:03:05.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.916+0000 7ff47ea00700 1 -- 172.21.15.159:0/2863281071 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7ff478022a20 con 0x7ff488107200 2024-02-28T23:03:05.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.917+0000 7ff47ea00700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff46c06c4e0 0x7ff46c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:05.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.917+0000 7ff47ea00700 1 -- 172.21.15.159:0/2863281071 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7ff47808cb30 con 0x7ff488107200 2024-02-28T23:03:05.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.917+0000 7ff485400700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff46c06c4e0 0x7ff46c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:05.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.917+0000 7ff485400700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff46c06c4e0 0x7ff46c06e9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff470005fd0 tx=0x7ff470005dc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:05.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:05.922+0000 7ff47ea00700 1 -- 172.21.15.159:0/2863281071 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff47805b210 con 0x7ff488107200 2024-02-28T23:03:06.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.145+0000 7ff48d200700 1 -- 172.21.15.159:0/2863281071 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff48810cd50 con 0x7ff46c06c4e0 2024-02-28T23:03:06.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.160+0000 7ff47ea00700 1 -- 172.21.15.159:0/2863281071 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2820 (secure 0 0 0) 0x7ff48810cd50 con 0x7ff46c06c4e0 2024-02-28T23:03:06.203 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:03:06.203 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (4m) 2m ago 6m 13.7M - 0.25.0 c8568f914cd2 2b2966e86e70 2024-02-28T23:03:06.203 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (7m) 2m ago 7m 7084k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:03:06.203 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (5m) 82s ago 5m 6924k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:03:06.203 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (7m) 2m ago 7m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:03:06.203 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (5m) 82s ago 5m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (4m) 2m ago 6m 73.3M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:9283,8765,8443 running (8m) 2m ago 8m 483M - 18.2.1 5be31c24972a f518a1599079 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (5m) 82s ago 5m 440M - 18.2.1 5be31c24972a 377a08f00bbd 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (8m) 2m ago 8m 43.5M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (5m) 82s ago 5m 33.1M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (7m) 2m ago 7m 7289k - 1.5.0 0da6a335fe13 009475616a7b 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (5m) 82s ago 5m 7880k - 1.5.0 0da6a335fe13 a45ab4136b88 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (4m) 2m ago 4m 39.3M 3947M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (3m) 2m ago 3m 39.4M 3947M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (3m) 2m ago 3m 39.9M 3947M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (2m) 82s ago 2m 41.4M 4971M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (2m) 82s ago 2m 38.2M 4971M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (88s) 82s ago 87s 11.3M 4971M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:03:06.204 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (4m) 2m ago 6m 37.9M - 2.43.0 a07b618ecd1d abc97d603adc 2024-02-28T23:03:06.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.164+0000 7ff48d200700 1 -- 172.21.15.159:0/2863281071 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff46c06c4e0 msgr2=0x7ff46c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:06.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.164+0000 7ff48d200700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff46c06c4e0 0x7ff46c06e9a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff470005fd0 tx=0x7ff470005dc0 comp rx=0 tx=0).stop 2024-02-28T23:03:06.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.164+0000 7ff48d200700 1 -- 172.21.15.159:0/2863281071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff488107200 msgr2=0x7ff48819c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:06.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.164+0000 7ff48d200700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff488107200 0x7ff48819c9b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff47800bda0 tx=0x7ff47800be80 comp rx=0 tx=0).stop 2024-02-28T23:03:06.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.164+0000 7ff48d200700 1 -- 172.21.15.159:0/2863281071 shutdown_connections 2024-02-28T23:03:06.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.164+0000 7ff48d200700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff46c06c4e0 0x7ff46c06e9a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:06.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.164+0000 7ff48d200700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff488107200 0x7ff48819c9b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:06.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.164+0000 7ff48d200700 1 --2- 172.21.15.159:0/2863281071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff488108400 0x7ff48819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:06.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.164+0000 7ff48d200700 1 -- 172.21.15.159:0/2863281071 >> 172.21.15.159:0/2863281071 conn(0x7ff4880761b0 msgr2=0x7ff48810b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:06.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.164+0000 7ff48d200700 1 -- 172.21.15.159:0/2863281071 shutdown_connections 2024-02-28T23:03:06.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:06.164+0000 7ff48d200700 1 -- 172.21.15.159:0/2863281071 wait complete. 2024-02-28T23:03:06.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:06 smithi159 ceph-mon[28802]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:06.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:06 smithi184 ceph-mon[36198]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:07.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph orch ls' 2024-02-28T23:03:07.467 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:07.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:07 smithi184 ceph-mon[36198]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:07.618 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:07 smithi159 ceph-mon[28802]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:08.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:08 smithi184 ceph-mon[36198]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:08.666 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:08 smithi159 ceph-mon[28802]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:09.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.651+0000 7f5f85c00700 1 -- 172.21.15.159:0/1259436815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f80103e20 msgr2=0x7f5f80104280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:09.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.651+0000 7f5f85c00700 1 --2- 172.21.15.159:0/1259436815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f80103e20 0x7f5f80104280 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009910 tx=0x7f5f6c009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:09.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.651+0000 7f5f85c00700 1 -- 172.21.15.159:0/1259436815 shutdown_connections 2024-02-28T23:03:09.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.651+0000 7f5f85c00700 1 --2- 172.21.15.159:0/1259436815 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f80103e20 0x7f5f80104280 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:09.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.651+0000 7f5f85c00700 1 --2- 172.21.15.159:0/1259436815 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f80102c20 0x7f5f80103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:09.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.651+0000 7f5f85c00700 1 -- 172.21.15.159:0/1259436815 >> 172.21.15.159:0/1259436815 conn(0x7f5f800fe1a0 msgr2=0x7f5f80100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:09.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.651+0000 7f5f85c00700 1 -- 172.21.15.159:0/1259436815 shutdown_connections 2024-02-28T23:03:09.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.651+0000 7f5f85c00700 1 -- 172.21.15.159:0/1259436815 wait complete. 2024-02-28T23:03:09.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.652+0000 7f5f85c00700 1 Processor -- start 2024-02-28T23:03:09.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.652+0000 7f5f85c00700 1 -- start start 2024-02-28T23:03:09.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.653+0000 7f5f85c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f80102c20 0x7f5f801983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:09.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.653+0000 7f5f85c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f80103e20 0x7f5f801988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:09.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.653+0000 7f5f85c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f80198f10 con 0x7f5f80103e20 2024-02-28T23:03:09.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.653+0000 7f5f85c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f80199050 con 0x7f5f80102c20 2024-02-28T23:03:09.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.653+0000 7f5f7f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f80103e20 0x7f5f801988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:09.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.653+0000 7f5f7f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f80103e20 0x7f5f801988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34986/0 (socket says 172.21.15.159:34986) 2024-02-28T23:03:09.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.653+0000 7f5f7f400700 1 -- 172.21.15.159:0/1774483432 learned_addr learned my addr 172.21.15.159:0/1774483432 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:09.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.653+0000 7f5f7fe00700 1 --2- 172.21.15.159:0/1774483432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f80102c20 0x7f5f801983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:09.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.654+0000 7f5f7f400700 1 -- 172.21.15.159:0/1774483432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f80102c20 msgr2=0x7f5f801983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:09.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.654+0000 7f5f7f400700 1 --2- 172.21.15.159:0/1774483432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f80102c20 0x7f5f801983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:09.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.654+0000 7f5f7f400700 1 -- 172.21.15.159:0/1774483432 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0095f0 con 0x7f5f80103e20 2024-02-28T23:03:09.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.654+0000 7f5f7f400700 1 --2- 172.21.15.159:0/1774483432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f80103e20 0x7f5f801988f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005b40 tx=0x7f5f6c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:09.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.654+0000 7f5f7cc00700 1 -- 172.21.15.159:0/1774483432 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f6c01d070 con 0x7f5f80103e20 2024-02-28T23:03:09.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.654+0000 7f5f7cc00700 1 -- 172.21.15.159:0/1774483432 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5f6c022470 con 0x7f5f80103e20 2024-02-28T23:03:09.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.654+0000 7f5f85c00700 1 -- 172.21.15.159:0/1774483432 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f8019daa0 con 0x7f5f80103e20 2024-02-28T23:03:09.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.654+0000 7f5f7cc00700 1 -- 172.21.15.159:0/1774483432 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f6c00f690 con 0x7f5f80103e20 2024-02-28T23:03:09.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.655+0000 7f5f85c00700 1 -- 172.21.15.159:0/1774483432 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f8019df90 con 0x7f5f80103e20 2024-02-28T23:03:09.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.655+0000 7f5f85c00700 1 -- 172.21.15.159:0/1774483432 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f8010b780 con 0x7f5f80103e20 2024-02-28T23:03:09.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.657+0000 7f5f7cc00700 1 -- 172.21.15.159:0/1774483432 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f5f6c022a10 con 0x7f5f80103e20 2024-02-28T23:03:09.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.657+0000 7f5f7cc00700 1 --2- 172.21.15.159:0/1774483432 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5f6406c4e0 0x7f5f6406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:09.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.658+0000 7f5f7cc00700 1 -- 172.21.15.159:0/1774483432 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f5f6c08cae0 con 0x7f5f80103e20 2024-02-28T23:03:09.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.658+0000 7f5f7fe00700 1 --2- 172.21.15.159:0/1774483432 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5f6406c4e0 0x7f5f6406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:09.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.658+0000 7f5f7fe00700 1 --2- 172.21.15.159:0/1774483432 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5f6406c4e0 0x7f5f6406e9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f80103c80 tx=0x7f5f7000a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:09.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.662+0000 7f5f7cc00700 1 -- 172.21.15.159:0/1774483432 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f5f6c05b120 con 0x7f5f80103e20 2024-02-28T23:03:09.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.883+0000 7f5f85c00700 1 -- 172.21.15.159:0/1774483432 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f80108770 con 0x7f5f6406c4e0 2024-02-28T23:03:09.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.895+0000 7f5f7cc00700 1 -- 172.21.15.159:0/1774483432 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1310 (secure 0 0 0) 0x7f5f80108770 con 0x7f5f6406c4e0 2024-02-28T23:03:09.894 INFO:teuthology.orchestra.run.smithi159.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-02-28T23:03:09.894 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager ?:9093,9094 1/1 2m ago 7m count:1 2024-02-28T23:03:09.894 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter 2/2 2m ago 7m * 2024-02-28T23:03:09.894 INFO:teuthology.orchestra.run.smithi159.stdout:crash 2/2 2m ago 8m * 2024-02-28T23:03:09.894 INFO:teuthology.orchestra.run.smithi159.stdout:grafana ?:3000 1/1 2m ago 7m count:1 2024-02-28T23:03:09.894 INFO:teuthology.orchestra.run.smithi159.stdout:mgr 2/2 2m ago 8m count:2 2024-02-28T23:03:09.894 INFO:teuthology.orchestra.run.smithi159.stdout:mon 2/2 2m ago 6m smithi159:172.21.15.159=smithi159;smithi184:172.21.15.184=smithi184;count:2 2024-02-28T23:03:09.894 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter ?:9100 2/2 2m ago 7m * 2024-02-28T23:03:09.894 INFO:teuthology.orchestra.run.smithi159.stdout:osd 6 2m ago - 2024-02-28T23:03:09.894 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus ?:9095 1/1 2m ago 7m count:1 2024-02-28T23:03:09.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.899+0000 7f5f85c00700 1 -- 172.21.15.159:0/1774483432 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5f6406c4e0 msgr2=0x7f5f6406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:09.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.899+0000 7f5f85c00700 1 --2- 172.21.15.159:0/1774483432 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5f6406c4e0 0x7f5f6406e9a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5f80103c80 tx=0x7f5f7000a380 comp rx=0 tx=0).stop 2024-02-28T23:03:09.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.899+0000 7f5f85c00700 1 -- 172.21.15.159:0/1774483432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f80103e20 msgr2=0x7f5f801988f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:09.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.899+0000 7f5f85c00700 1 --2- 172.21.15.159:0/1774483432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f80103e20 0x7f5f801988f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c005b40 tx=0x7f5f6c00bd70 comp rx=0 tx=0).stop 2024-02-28T23:03:09.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.899+0000 7f5f85c00700 1 -- 172.21.15.159:0/1774483432 shutdown_connections 2024-02-28T23:03:09.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.899+0000 7f5f85c00700 1 --2- 172.21.15.159:0/1774483432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5f80102c20 0x7f5f801983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:09.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.899+0000 7f5f85c00700 1 --2- 172.21.15.159:0/1774483432 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f5f6406c4e0 0x7f5f6406e9a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:09.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.899+0000 7f5f85c00700 1 --2- 172.21.15.159:0/1774483432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f80103e20 0x7f5f801988f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:09.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.899+0000 7f5f85c00700 1 -- 172.21.15.159:0/1774483432 >> 172.21.15.159:0/1774483432 conn(0x7f5f800fe1a0 msgr2=0x7f5f80107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:09.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.899+0000 7f5f85c00700 1 -- 172.21.15.159:0/1774483432 shutdown_connections 2024-02-28T23:03:09.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:09.900+0000 7f5f85c00700 1 -- 172.21.15.159:0/1774483432 wait complete. 2024-02-28T23:03:10.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:10 smithi184 ceph-mon[36198]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:10.659 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:10 smithi159 ceph-mon[28802]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:10.713 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph orch host ls' 2024-02-28T23:03:11.128 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:11.476 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:11 smithi159 ceph-mon[28802]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:11.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:11 smithi184 ceph-mon[36198]: from='client.14440 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:12.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:12 smithi159 ceph-mon[28802]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:12.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:12 smithi184 ceph-mon[36198]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:13.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.383+0000 7f09ef000700 1 -- 172.21.15.159:0/3471546316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e8108400 msgr2=0x7f09e8108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:13.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.383+0000 7f09ef000700 1 --2- 172.21.15.159:0/3471546316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e8108400 0x7f09e8108860 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009910 tx=0x7f09d0009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:13.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.383+0000 7f09ef000700 1 -- 172.21.15.159:0/3471546316 shutdown_connections 2024-02-28T23:03:13.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.383+0000 7f09ef000700 1 --2- 172.21.15.159:0/3471546316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e8108400 0x7f09e8108860 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:13.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.383+0000 7f09ef000700 1 --2- 172.21.15.159:0/3471546316 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e8107200 0x7f09e8107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:13.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.383+0000 7f09ef000700 1 -- 172.21.15.159:0/3471546316 >> 172.21.15.159:0/3471546316 conn(0x7f09e80761b0 msgr2=0x7f09e8078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:13.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.383+0000 7f09ef000700 1 -- 172.21.15.159:0/3471546316 shutdown_connections 2024-02-28T23:03:13.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.383+0000 7f09ef000700 1 -- 172.21.15.159:0/3471546316 wait complete. 2024-02-28T23:03:13.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.384+0000 7f09ef000700 1 Processor -- start 2024-02-28T23:03:13.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.385+0000 7f09ef000700 1 -- start start 2024-02-28T23:03:13.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.385+0000 7f09ef000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e8107200 0x7f09e819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.385+0000 7f09ef000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e8108400 0x7f09e819cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.385+0000 7f09ef000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e819d430 con 0x7f09e8108400 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.385+0000 7f09ef000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e819d570 con 0x7f09e8107200 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.385+0000 7f09dfe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e8108400 0x7f09e819cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.385+0000 7f09dfe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e8108400 0x7f09e819cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35018/0 (socket says 172.21.15.159:35018) 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.385+0000 7f09dfe00700 1 -- 172.21.15.159:0/702062611 learned_addr learned my addr 172.21.15.159:0/702062611 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.385+0000 7f09e7e00700 1 --2- 172.21.15.159:0/702062611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e8107200 0x7f09e819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.386+0000 7f09dfe00700 1 -- 172.21.15.159:0/702062611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e8107200 msgr2=0x7f09e819c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.386+0000 7f09dfe00700 1 --2- 172.21.15.159:0/702062611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e8107200 0x7f09e819c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.386+0000 7f09dfe00700 1 -- 172.21.15.159:0/702062611 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d00095f0 con 0x7f09e8108400 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.386+0000 7f09dfe00700 1 --2- 172.21.15.159:0/702062611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e8108400 0x7f09e819cea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f09d000b5c0 tx=0x7f09d000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.386+0000 7f09e5600700 1 -- 172.21.15.159:0/702062611 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09d001d070 con 0x7f09e8108400 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.386+0000 7f09e5600700 1 -- 172.21.15.159:0/702062611 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f09d0022470 con 0x7f09e8108400 2024-02-28T23:03:13.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.386+0000 7f09ef000700 1 -- 172.21.15.159:0/702062611 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e81a1fd0 con 0x7f09e8108400 2024-02-28T23:03:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.386+0000 7f09e5600700 1 -- 172.21.15.159:0/702062611 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f09d000f690 con 0x7f09e8108400 2024-02-28T23:03:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.386+0000 7f09ef000700 1 -- 172.21.15.159:0/702062611 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e81a2490 con 0x7f09e8108400 2024-02-28T23:03:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.387+0000 7f09ef000700 1 -- 172.21.15.159:0/702062611 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e810fd60 con 0x7f09e8108400 2024-02-28T23:03:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.389+0000 7f09e5600700 1 -- 172.21.15.159:0/702062611 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f09d0004b70 con 0x7f09e8108400 2024-02-28T23:03:13.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.389+0000 7f09e5600700 1 --2- 172.21.15.159:0/702062611 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f09cc06c4e0 0x7f09cc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:13.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.390+0000 7f09e5600700 1 -- 172.21.15.159:0/702062611 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f09d008cc90 con 0x7f09e8108400 2024-02-28T23:03:13.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.390+0000 7f09e7e00700 1 --2- 172.21.15.159:0/702062611 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f09cc06c4e0 0x7f09cc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:13.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.390+0000 7f09e7e00700 1 --2- 172.21.15.159:0/702062611 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f09cc06c4e0 0x7f09cc06e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f09e8108260 tx=0x7f09d8005d70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:13.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.394+0000 7f09e5600700 1 -- 172.21.15.159:0/702062611 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f09d005b250 con 0x7f09e8108400 2024-02-28T23:03:13.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.617+0000 7f09ef000700 1 -- 172.21.15.159:0/702062611 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f09e810cd50 con 0x7f09cc06c4e0 2024-02-28T23:03:13.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.621+0000 7f09e5600700 1 -- 172.21.15.159:0/702062611 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f09e810cd50 con 0x7f09cc06c4e0 2024-02-28T23:03:13.619 INFO:teuthology.orchestra.run.smithi159.stdout:HOST ADDR LABELS STATUS 2024-02-28T23:03:13.619 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159 172.21.15.159 2024-02-28T23:03:13.619 INFO:teuthology.orchestra.run.smithi159.stdout:smithi184 172.21.15.184 2024-02-28T23:03:13.619 INFO:teuthology.orchestra.run.smithi159.stdout:2 hosts in cluster 2024-02-28T23:03:13.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.623+0000 7f09ef000700 1 -- 172.21.15.159:0/702062611 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f09cc06c4e0 msgr2=0x7f09cc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:13.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.623+0000 7f09ef000700 1 --2- 172.21.15.159:0/702062611 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f09cc06c4e0 0x7f09cc06e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f09e8108260 tx=0x7f09d8005d70 comp rx=0 tx=0).stop 2024-02-28T23:03:13.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.623+0000 7f09ef000700 1 -- 172.21.15.159:0/702062611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e8108400 msgr2=0x7f09e819cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:13.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.623+0000 7f09ef000700 1 --2- 172.21.15.159:0/702062611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e8108400 0x7f09e819cea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f09d000b5c0 tx=0x7f09d000be20 comp rx=0 tx=0).stop 2024-02-28T23:03:13.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.623+0000 7f09ef000700 1 -- 172.21.15.159:0/702062611 shutdown_connections 2024-02-28T23:03:13.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.623+0000 7f09ef000700 1 --2- 172.21.15.159:0/702062611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f09e8107200 0x7f09e819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:13.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.623+0000 7f09ef000700 1 --2- 172.21.15.159:0/702062611 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f09cc06c4e0 0x7f09cc06e9a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:13.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.623+0000 7f09ef000700 1 --2- 172.21.15.159:0/702062611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09e8108400 0x7f09e819cea0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:13.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.623+0000 7f09ef000700 1 -- 172.21.15.159:0/702062611 >> 172.21.15.159:0/702062611 conn(0x7f09e80761b0 msgr2=0x7f09e810b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:13.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.624+0000 7f09ef000700 1 -- 172.21.15.159:0/702062611 shutdown_connections 2024-02-28T23:03:13.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:13.624+0000 7f09ef000700 1 -- 172.21.15.159:0/702062611 wait complete. 2024-02-28T23:03:14.351 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph orch device ls' 2024-02-28T23:03:14.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:14 smithi184 ceph-mon[36198]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:14.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:14 smithi159 ceph-mon[28802]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:14.736 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:15.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:15 smithi159 ceph-mon[28802]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:15.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:15 smithi184 ceph-mon[36198]: from='client.14444 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:16.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:16 smithi159 ceph-mon[28802]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:16 smithi184 ceph-mon[36198]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:16.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.696+0000 7f7a61000700 1 -- 172.21.15.159:0/2672039612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a5c108400 msgr2=0x7f7a5c108860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:16.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.696+0000 7f7a61000700 1 --2- 172.21.15.159:0/2672039612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a5c108400 0x7f7a5c108860 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7a44009910 tx=0x7f7a44009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:16.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.696+0000 7f7a61000700 1 -- 172.21.15.159:0/2672039612 shutdown_connections 2024-02-28T23:03:16.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.696+0000 7f7a61000700 1 --2- 172.21.15.159:0/2672039612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a5c108400 0x7f7a5c108860 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:16.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.696+0000 7f7a61000700 1 --2- 172.21.15.159:0/2672039612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c107200 0x7f7a5c107620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:16.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.697+0000 7f7a61000700 1 -- 172.21.15.159:0/2672039612 >> 172.21.15.159:0/2672039612 conn(0x7f7a5c0761b0 msgr2=0x7f7a5c078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:16.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.697+0000 7f7a61000700 1 -- 172.21.15.159:0/2672039612 shutdown_connections 2024-02-28T23:03:16.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.697+0000 7f7a61000700 1 -- 172.21.15.159:0/2672039612 wait complete. 2024-02-28T23:03:16.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.698+0000 7f7a61000700 1 Processor -- start 2024-02-28T23:03:16.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.698+0000 7f7a61000700 1 -- start start 2024-02-28T23:03:16.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.698+0000 7f7a61000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a5c107200 0x7f7a5c19c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:16.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.698+0000 7f7a61000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c108400 0x7f7a5c19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:16.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.698+0000 7f7a61000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c19d4c0 con 0x7f7a5c107200 2024-02-28T23:03:16.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.698+0000 7f7a61000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c19d600 con 0x7f7a5c108400 2024-02-28T23:03:16.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.698+0000 7f7a59e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a5c107200 0x7f7a5c19c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:16.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.698+0000 7f7a59e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a5c107200 0x7f7a5c19c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35026/0 (socket says 172.21.15.159:35026) 2024-02-28T23:03:16.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.698+0000 7f7a59e00700 1 -- 172.21.15.159:0/3203850239 learned_addr learned my addr 172.21.15.159:0/3203850239 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:16.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.699+0000 7f7a51400700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c108400 0x7f7a5c19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:16.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.699+0000 7f7a59e00700 1 -- 172.21.15.159:0/3203850239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c108400 msgr2=0x7f7a5c19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:16.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.699+0000 7f7a59e00700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c108400 0x7f7a5c19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:16.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.699+0000 7f7a59e00700 1 -- 172.21.15.159:0/3203850239 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a440095f0 con 0x7f7a5c107200 2024-02-28T23:03:16.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.699+0000 7f7a51400700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c108400 0x7f7a5c19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:03:16.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.699+0000 7f7a59e00700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a5c107200 0x7f7a5c19c960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00d900 tx=0x7f7a4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:16.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.699+0000 7f7a53400700 1 -- 172.21.15.159:0/3203850239 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4c0041f0 con 0x7f7a5c107200 2024-02-28T23:03:16.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.699+0000 7f7a61000700 1 -- 172.21.15.159:0/3203850239 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c1a20b0 con 0x7f7a5c107200 2024-02-28T23:03:16.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.699+0000 7f7a53400700 1 -- 172.21.15.159:0/3203850239 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7a4c004350 con 0x7f7a5c107200 2024-02-28T23:03:16.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.699+0000 7f7a53400700 1 -- 172.21.15.159:0/3203850239 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a4c003da0 con 0x7f7a5c107200 2024-02-28T23:03:16.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.700+0000 7f7a61000700 1 -- 172.21.15.159:0/3203850239 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c1a2600 con 0x7f7a5c107200 2024-02-28T23:03:16.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.701+0000 7f7a61000700 1 -- 172.21.15.159:0/3203850239 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c10fd60 con 0x7f7a5c107200 2024-02-28T23:03:16.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.702+0000 7f7a53400700 1 -- 172.21.15.159:0/3203850239 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f7a4c009730 con 0x7f7a5c107200 2024-02-28T23:03:16.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.702+0000 7f7a53400700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7a3c06c4e0 0x7f7a3c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:16.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.703+0000 7f7a53400700 1 -- 172.21.15.159:0/3203850239 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f7a4c08b660 con 0x7f7a5c107200 2024-02-28T23:03:16.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.703+0000 7f7a51400700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7a3c06c4e0 0x7f7a3c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:16.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.703+0000 7f7a51400700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7a3c06c4e0 0x7f7a3c06e9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400b5c0 tx=0x7f7a44005e20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:16.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.707+0000 7f7a53400700 1 -- 172.21.15.159:0/3203850239 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7a4c059bf0 con 0x7f7a5c107200 2024-02-28T23:03:16.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.930+0000 7f7a61000700 1 -- 172.21.15.159:0/3203850239 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f7a5c10cd50 con 0x7f7a3c06c4e0 2024-02-28T23:03:16.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.933+0000 7f7a53400700 1 -- 172.21.15.159:0/3203850239 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f7a5c10cd50 con 0x7f7a3c06c4e0 2024-02-28T23:03:16.931 INFO:teuthology.orchestra.run.smithi159.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-02-28T23:03:16.932 INFO:teuthology.orchestra.run.smithi159.stdout:smithi159 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GH400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-02-28T23:03:16.932 INFO:teuthology.orchestra.run.smithi159.stdout:smithi184 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT626500CE400BGN 372G No 87s ago Has a FileSystem, LVM detected 2024-02-28T23:03:16.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.936+0000 7f7a61000700 1 -- 172.21.15.159:0/3203850239 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7a3c06c4e0 msgr2=0x7f7a3c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:16.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.936+0000 7f7a61000700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7a3c06c4e0 0x7f7a3c06e9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400b5c0 tx=0x7f7a44005e20 comp rx=0 tx=0).stop 2024-02-28T23:03:16.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.936+0000 7f7a61000700 1 -- 172.21.15.159:0/3203850239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a5c107200 msgr2=0x7f7a5c19c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:16.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.936+0000 7f7a61000700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a5c107200 0x7f7a5c19c960 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c00d900 tx=0x7f7a4c00dcc0 comp rx=0 tx=0).stop 2024-02-28T23:03:16.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.936+0000 7f7a61000700 1 -- 172.21.15.159:0/3203850239 shutdown_connections 2024-02-28T23:03:16.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.936+0000 7f7a61000700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7a3c06c4e0 0x7f7a3c06e9a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:16.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.936+0000 7f7a61000700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a5c107200 0x7f7a5c19c960 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:16.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.936+0000 7f7a61000700 1 --2- 172.21.15.159:0/3203850239 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7a5c108400 0x7f7a5c19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:16.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.936+0000 7f7a61000700 1 -- 172.21.15.159:0/3203850239 >> 172.21.15.159:0/3203850239 conn(0x7f7a5c0761b0 msgr2=0x7f7a5c10b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:16.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.936+0000 7f7a61000700 1 -- 172.21.15.159:0/3203850239 shutdown_connections 2024-02-28T23:03:16.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:16.936+0000 7f7a61000700 1 -- 172.21.15.159:0/3203850239 wait complete. 2024-02-28T23:03:17.638 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T23:03:17.651 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:03:17.652 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-02-28T23:03:18.058 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:18 smithi159 ceph-mon[28802]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:18 smithi159 ceph-mon[28802]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:18.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:18 smithi184 ceph-mon[36198]: from='client.14448 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:18 smithi184 ceph-mon[36198]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:20.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.342+0000 7f6385e00700 1 -- 172.21.15.159:0/1994528106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6380100c10 msgr2=0x7f6380101030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:20.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.342+0000 7f6385e00700 1 --2- 172.21.15.159:0/1994528106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6380100c10 0x7f6380101030 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6370009910 tx=0x7f6370009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:20.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.342+0000 7f6385e00700 1 -- 172.21.15.159:0/1994528106 shutdown_connections 2024-02-28T23:03:20.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.342+0000 7f6385e00700 1 --2- 172.21.15.159:0/1994528106 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6380101e10 0x7f6380102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:20.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.342+0000 7f6385e00700 1 --2- 172.21.15.159:0/1994528106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6380100c10 0x7f6380101030 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:20.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.342+0000 7f6385e00700 1 -- 172.21.15.159:0/1994528106 >> 172.21.15.159:0/1994528106 conn(0x7f63800fc1b0 msgr2=0x7f63800fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:20.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.342+0000 7f6385e00700 1 -- 172.21.15.159:0/1994528106 shutdown_connections 2024-02-28T23:03:20.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.342+0000 7f6385e00700 1 -- 172.21.15.159:0/1994528106 wait complete. 2024-02-28T23:03:20.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.344+0000 7f6385e00700 1 Processor -- start 2024-02-28T23:03:20.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.344+0000 7f6385e00700 1 -- start start 2024-02-28T23:03:20.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.344+0000 7f6385e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6380100c10 0x7f63801985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:20.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.344+0000 7f6385e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6380101e10 0x7f6380198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:20.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.344+0000 7f6385e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6380199100 con 0x7f6380101e10 2024-02-28T23:03:20.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.344+0000 7f6385e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6380199240 con 0x7f6380100c10 2024-02-28T23:03:20.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.345+0000 7f637e000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6380101e10 0x7f6380198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:20.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.345+0000 7f637e000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6380101e10 0x7f6380198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52712/0 (socket says 172.21.15.159:52712) 2024-02-28T23:03:20.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.345+0000 7f637e000700 1 -- 172.21.15.159:0/3923666421 learned_addr learned my addr 172.21.15.159:0/3923666421 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:20.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.345+0000 7f637ea00700 1 --2- 172.21.15.159:0/3923666421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6380100c10 0x7f63801985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:20.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.345+0000 7f637e000700 1 -- 172.21.15.159:0/3923666421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6380100c10 msgr2=0x7f63801985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:20.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.345+0000 7f637e000700 1 --2- 172.21.15.159:0/3923666421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6380100c10 0x7f63801985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:20.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.345+0000 7f637e000700 1 -- 172.21.15.159:0/3923666421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63700095f0 con 0x7f6380101e10 2024-02-28T23:03:20.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.345+0000 7f637e000700 1 --2- 172.21.15.159:0/3923666421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6380101e10 0x7f6380198ae0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f636c00d8d0 tx=0x7f636c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:20.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.347+0000 7f6384a00700 1 -- 172.21.15.159:0/3923666421 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f636c009940 con 0x7f6380101e10 2024-02-28T23:03:20.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.347+0000 7f6385e00700 1 -- 172.21.15.159:0/3923666421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f638019dcf0 con 0x7f6380101e10 2024-02-28T23:03:20.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.347+0000 7f6384a00700 1 -- 172.21.15.159:0/3923666421 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f636c010460 con 0x7f6380101e10 2024-02-28T23:03:20.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.347+0000 7f6384a00700 1 -- 172.21.15.159:0/3923666421 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f636c00f5f0 con 0x7f6380101e10 2024-02-28T23:03:20.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.347+0000 7f6385e00700 1 -- 172.21.15.159:0/3923666421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f638019e240 con 0x7f6380101e10 2024-02-28T23:03:20.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.348+0000 7f6385e00700 1 -- 172.21.15.159:0/3923666421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6380105ef0 con 0x7f6380101e10 2024-02-28T23:03:20.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.349+0000 7f6384a00700 1 -- 172.21.15.159:0/3923666421 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f636c0105d0 con 0x7f6380101e10 2024-02-28T23:03:20.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.350+0000 7f6384a00700 1 --2- 172.21.15.159:0/3923666421 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f636406c4e0 0x7f636406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:20.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.350+0000 7f6384a00700 1 -- 172.21.15.159:0/3923666421 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4638+0+0 (secure 0 0 0) 0x7f636c08b4e0 con 0x7f6380101e10 2024-02-28T23:03:20.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.350+0000 7f637ea00700 1 --2- 172.21.15.159:0/3923666421 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f636406c4e0 0x7f636406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:20.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.351+0000 7f637ea00700 1 --2- 172.21.15.159:0/3923666421 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f636406c4e0 0x7f636406e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6370006010 tx=0x7f637000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:20.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.355+0000 7f6384a00700 1 -- 172.21.15.159:0/3923666421 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f636c059a90 con 0x7f6380101e10 2024-02-28T23:03:20.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:20.583+0000 7f6385e00700 1 -- 172.21.15.159:0/3923666421 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f63800611d0 con 0x7f636406c4e0 2024-02-28T23:03:20.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:20 smithi184 ceph-mon[36198]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:03:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:20 smithi159 ceph-mon[28802]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:03:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:21 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-28T23:03:21.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:21 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-02-28T23:03:22.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.414+0000 7f6384a00700 1 -- 172.21.15.159:0/3923666421 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f63800611d0 con 0x7f636406c4e0 2024-02-28T23:03:22.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.416+0000 7f6385e00700 1 -- 172.21.15.159:0/3923666421 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f636406c4e0 msgr2=0x7f636406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:22.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.416+0000 7f6385e00700 1 --2- 172.21.15.159:0/3923666421 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f636406c4e0 0x7f636406e9a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6370006010 tx=0x7f637000b540 comp rx=0 tx=0).stop 2024-02-28T23:03:22.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.417+0000 7f6385e00700 1 -- 172.21.15.159:0/3923666421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6380101e10 msgr2=0x7f6380198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:22.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.417+0000 7f6385e00700 1 --2- 172.21.15.159:0/3923666421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6380101e10 0x7f6380198ae0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f636c00d8d0 tx=0x7f636c00dc90 comp rx=0 tx=0).stop 2024-02-28T23:03:22.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.417+0000 7f6385e00700 1 -- 172.21.15.159:0/3923666421 shutdown_connections 2024-02-28T23:03:22.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.417+0000 7f6385e00700 1 --2- 172.21.15.159:0/3923666421 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6380100c10 0x7f63801985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:22.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.417+0000 7f6385e00700 1 --2- 172.21.15.159:0/3923666421 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f636406c4e0 0x7f636406e9a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:22.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.417+0000 7f6385e00700 1 --2- 172.21.15.159:0/3923666421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6380101e10 0x7f6380198ae0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:22.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.417+0000 7f6385e00700 1 -- 172.21.15.159:0/3923666421 >> 172.21.15.159:0/3923666421 conn(0x7f63800fc1b0 msgr2=0x7f6380103030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:22.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.417+0000 7f6385e00700 1 -- 172.21.15.159:0/3923666421 shutdown_connections 2024-02-28T23:03:22.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:22.417+0000 7f6385e00700 1 -- 172.21.15.159:0/3923666421 wait complete. 2024-02-28T23:03:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:22 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159[28798]: 2024-02-28T23:03:22.377+0000 7f0ddb800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T23:03:22.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:22 smithi159 ceph-mon[28802]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:22.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:22 smithi159 ceph-mon[28802]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:22.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:22 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-28T23:03:22.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:22 smithi159 ceph-mon[28802]: osdmap e41: 6 total, 6 up, 6 in 2024-02-28T23:03:22.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:22 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-28T23:03:22.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:22 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-28T23:03:22.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:22 smithi159 ceph-mon[28802]: osdmap e42: 6 total, 6 up, 6 in 2024-02-28T23:03:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:22 smithi184 ceph-mon[36198]: from='client.14452 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:03:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:22 smithi184 ceph-mon[36198]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:22 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-02-28T23:03:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:22 smithi184 ceph-mon[36198]: osdmap e41: 6 total, 6 up, 6 in 2024-02-28T23:03:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:22 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-02-28T23:03:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:22 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-02-28T23:03:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:22 smithi184 ceph-mon[36198]: osdmap e42: 6 total, 6 up, 6 in 2024-02-28T23:03:23.355 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T23:03:23.674 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-28T23:03:23.674 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: osdmap e43: 6 total, 6 up, 6 in 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: fsmap cephfs:0 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: Saving service mds.cephfs spec with placement count:4 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.mbaqic", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.mbaqic", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T23:03:23.675 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:23.676 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:23 smithi159 ceph-mon[28802]: Deploying daemon mds.cephfs.smithi159.mbaqic on smithi159 2024-02-28T23:03:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-02-28T23:03:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T23:03:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-02-28T23:03:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: osdmap e43: 6 total, 6 up, 6 in 2024-02-28T23:03:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-02-28T23:03:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: fsmap cephfs:0 2024-02-28T23:03:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: Saving service mds.cephfs spec with placement count:4 2024-02-28T23:03:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:03:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:03:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.mbaqic", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:03:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.mbaqic", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T23:03:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:23 smithi184 ceph-mon[36198]: Deploying daemon mds.cephfs.smithi159.mbaqic on smithi159 2024-02-28T23:03:24.673 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:24 smithi159 ceph-mon[28802]: pgmap v220: 65 pgs: 14 creating+peering, 43 unknown, 8 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:24.673 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:24 smithi159 ceph-mon[28802]: osdmap e44: 6 total, 6 up, 6 in 2024-02-28T23:03:24.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:24 smithi184 ceph-mon[36198]: pgmap v220: 65 pgs: 14 creating+peering, 43 unknown, 8 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:24.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:24 smithi184 ceph-mon[36198]: osdmap e44: 6 total, 6 up, 6 in 2024-02-28T23:03:24.951 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:25.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:25 smithi159 ceph-mon[28802]: osdmap e45: 6 total, 6 up, 6 in 2024-02-28T23:03:25.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:25 smithi184 ceph-mon[36198]: osdmap e45: 6 total, 6 up, 6 in 2024-02-28T23:03:26.708 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:26 smithi159 ceph-mon[28802]: pgmap v223: 65 pgs: 14 creating+peering, 25 unknown, 26 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:26.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:26 smithi184 ceph-mon[36198]: pgmap v223: 65 pgs: 14 creating+peering, 25 unknown, 26 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:27.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.793+0000 7f7b29e00700 1 -- 172.21.15.159:0/3230306674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b240737f0 msgr2=0x7f7b24073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:27.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.793+0000 7f7b29e00700 1 --2- 172.21.15.159:0/3230306674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b240737f0 0x7f7b24073c70 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009910 tx=0x7f7b10009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:27.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.793+0000 7f7b29e00700 1 -- 172.21.15.159:0/3230306674 shutdown_connections 2024-02-28T23:03:27.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.793+0000 7f7b29e00700 1 --2- 172.21.15.159:0/3230306674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b240737f0 0x7f7b24073c70 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:27.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.793+0000 7f7b29e00700 1 --2- 172.21.15.159:0/3230306674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b24074dc0 0x7f7b24073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:27.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.793+0000 7f7b29e00700 1 -- 172.21.15.159:0/3230306674 >> 172.21.15.159:0/3230306674 conn(0x7f7b240fc110 msgr2=0x7f7b240fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:27.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.793+0000 7f7b29e00700 1 -- 172.21.15.159:0/3230306674 shutdown_connections 2024-02-28T23:03:27.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.793+0000 7f7b29e00700 1 -- 172.21.15.159:0/3230306674 wait complete. 2024-02-28T23:03:27.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.794+0000 7f7b29e00700 1 Processor -- start 2024-02-28T23:03:27.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.795+0000 7f7b29e00700 1 -- start start 2024-02-28T23:03:27.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.795+0000 7f7b29e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b240737f0 0x7f7b241985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.795+0000 7f7b29e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24074dc0 0x7f7b24198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.795+0000 7f7b29e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24199110 con 0x7f7b24074dc0 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.795+0000 7f7b29e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24199250 con 0x7f7b240737f0 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.795+0000 7f7b22000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24074dc0 0x7f7b24198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.795+0000 7f7b22000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24074dc0 0x7f7b24198af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52748/0 (socket says 172.21.15.159:52748) 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.795+0000 7f7b22000700 1 -- 172.21.15.159:0/3619208996 learned_addr learned my addr 172.21.15.159:0/3619208996 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.795+0000 7f7b22a00700 1 --2- 172.21.15.159:0/3619208996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b240737f0 0x7f7b241985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.796+0000 7f7b22000700 1 -- 172.21.15.159:0/3619208996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b240737f0 msgr2=0x7f7b241985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.796+0000 7f7b22000700 1 --2- 172.21.15.159:0/3619208996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b240737f0 0x7f7b241985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.796+0000 7f7b22000700 1 -- 172.21.15.159:0/3619208996 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b100095f0 con 0x7f7b24074dc0 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.796+0000 7f7b22000700 1 --2- 172.21.15.159:0/3619208996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24074dc0 0x7f7b24198af0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000bd70 tx=0x7f7b1000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.796+0000 7f7b28a00700 1 -- 172.21.15.159:0/3619208996 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b1001d070 con 0x7f7b24074dc0 2024-02-28T23:03:27.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.796+0000 7f7b28a00700 1 -- 172.21.15.159:0/3619208996 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7b10005dc0 con 0x7f7b24074dc0 2024-02-28T23:03:27.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.797+0000 7f7b29e00700 1 -- 172.21.15.159:0/3619208996 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2419dca0 con 0x7f7b24074dc0 2024-02-28T23:03:27.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.797+0000 7f7b28a00700 1 -- 172.21.15.159:0/3619208996 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b10021410 con 0x7f7b24074dc0 2024-02-28T23:03:27.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.797+0000 7f7b29e00700 1 -- 172.21.15.159:0/3619208996 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2419e190 con 0x7f7b24074dc0 2024-02-28T23:03:27.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.798+0000 7f7b29e00700 1 -- 172.21.15.159:0/3619208996 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b2410b940 con 0x7f7b24074dc0 2024-02-28T23:03:27.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.799+0000 7f7b28a00700 1 -- 172.21.15.159:0/3619208996 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f7b1000f7f0 con 0x7f7b24074dc0 2024-02-28T23:03:27.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.800+0000 7f7b28a00700 1 --2- 172.21.15.159:0/3619208996 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7b0806c4e0 0x7f7b0806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:27.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.800+0000 7f7b28a00700 1 -- 172.21.15.159:0/3619208996 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f7b1008cc00 con 0x7f7b24074dc0 2024-02-28T23:03:27.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.800+0000 7f7b22a00700 1 --2- 172.21.15.159:0/3619208996 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7b0806c4e0 0x7f7b0806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:27.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.801+0000 7f7b22a00700 1 --2- 172.21.15.159:0/3619208996 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7b0806c4e0 0x7f7b0806e9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009550 tx=0x7f7b140091b0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:27.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:27.805+0000 7f7b28a00700 1 -- 172.21.15.159:0/3619208996 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f7b1005add0 con 0x7f7b24074dc0 2024-02-28T23:03:28.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.066+0000 7f7b29e00700 1 -- 172.21.15.159:0/3619208996 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7b2410bb30 con 0x7f7b24074dc0 2024-02-28T23:03:28.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.067+0000 7f7b28a00700 1 -- 172.21.15.159:0/3619208996 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 4 v4) v1 ==== 75+0+1266 (secure 0 0 0) 0x7f7b1005a960 con 0x7f7b24074dc0 2024-02-28T23:03:28.067 INFO:teuthology.orchestra.run.smithi159.stdout:e4 2024-02-28T23:03:28.067 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:03:28.067 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:03:28.067 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:03:28.067 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 4 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:27.434231+0000 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:03:28.068 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 0 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14456} 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 0 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14456} state up:creating seq 1 addr [v2:172.21.15.159:6826/1702728557,v1:172.21.15.159:6827/1702728557] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:03:28.069 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:03:28.070 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:03:28.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.070+0000 7f7b29e00700 1 -- 172.21.15.159:0/3619208996 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7b0806c4e0 msgr2=0x7f7b0806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:28.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.070+0000 7f7b29e00700 1 --2- 172.21.15.159:0/3619208996 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7b0806c4e0 0x7f7b0806e9a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009550 tx=0x7f7b140091b0 comp rx=0 tx=0).stop 2024-02-28T23:03:28.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.070+0000 7f7b29e00700 1 -- 172.21.15.159:0/3619208996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24074dc0 msgr2=0x7f7b24198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:28.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.070+0000 7f7b29e00700 1 --2- 172.21.15.159:0/3619208996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24074dc0 0x7f7b24198af0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000bd70 tx=0x7f7b1000bda0 comp rx=0 tx=0).stop 2024-02-28T23:03:28.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.070+0000 7f7b29e00700 1 -- 172.21.15.159:0/3619208996 shutdown_connections 2024-02-28T23:03:28.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.070+0000 7f7b29e00700 1 --2- 172.21.15.159:0/3619208996 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b240737f0 0x7f7b241985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:28.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.070+0000 7f7b29e00700 1 --2- 172.21.15.159:0/3619208996 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f7b0806c4e0 0x7f7b0806e9a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:28.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.070+0000 7f7b29e00700 1 --2- 172.21.15.159:0/3619208996 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24074dc0 0x7f7b24198af0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:28.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.070+0000 7f7b29e00700 1 -- 172.21.15.159:0/3619208996 >> 172.21.15.159:0/3619208996 conn(0x7f7b240fc110 msgr2=0x7f7b24106990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:28.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.070+0000 7f7b29e00700 1 -- 172.21.15.159:0/3619208996 shutdown_connections 2024-02-28T23:03:28.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:28.070+0000 7f7b29e00700 1 -- 172.21.15.159:0/3619208996 wait complete. 2024-02-28T23:03:28.071 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 4 2024-02-28T23:03:28.457 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: pgmap v224: 65 pgs: 14 creating+peering, 6 unknown, 45 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:28.457 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:28.457 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:28.457 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:28.457 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.azwkfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:03:28.457 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.azwkfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T23:03:28.457 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:28.458 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: Deploying daemon mds.cephfs.smithi184.azwkfx on smithi184 2024-02-28T23:03:28.458 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.159:6826/1702728557,v1:172.21.15.159:6827/1702728557] up:boot 2024-02-28T23:03:28.458 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: daemon mds.cephfs.smithi159.mbaqic assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-28T23:03:28.458 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T23:03:28.458 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-28T23:03:28.458 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: Cluster is now healthy 2024-02-28T23:03:28.458 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: fsmap cephfs:0 1 up:standby 2024-02-28T23:03:28.458 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:03:28.458 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:creating} 2024-02-28T23:03:28.458 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: daemon mds.cephfs.smithi159.mbaqic is now active in filesystem cephfs as rank 0 2024-02-28T23:03:28.458 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:28 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3619208996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:03:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: pgmap v224: 65 pgs: 14 creating+peering, 6 unknown, 45 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:03:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.azwkfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:03:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.azwkfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T23:03:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: Deploying daemon mds.cephfs.smithi184.azwkfx on smithi184 2024-02-28T23:03:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.159:6826/1702728557,v1:172.21.15.159:6827/1702728557] up:boot 2024-02-28T23:03:28.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: daemon mds.cephfs.smithi159.mbaqic assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-02-28T23:03:28.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T23:03:28.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-02-28T23:03:28.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: Cluster is now healthy 2024-02-28T23:03:28.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: fsmap cephfs:0 1 up:standby 2024-02-28T23:03:28.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:03:28.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:creating} 2024-02-28T23:03:28.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: daemon mds.cephfs.smithi159.mbaqic is now active in filesystem cephfs as rank 0 2024-02-28T23:03:28.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:28 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3619208996' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:03:28.975 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T23:03:28.984 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:03:28.984 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-02-28T23:03:29.418 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:29.473 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:29 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.159:6826/1702728557,v1:172.21.15.159:6827/1702728557] up:active 2024-02-28T23:03:29.473 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:29 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 2024-02-28T23:03:29.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:29 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.159:6826/1702728557,v1:172.21.15.159:6827/1702728557] up:active 2024-02-28T23:03:29.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:29 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 2024-02-28T23:03:30.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:30 smithi159 ceph-mon[28802]: pgmap v225: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-02-28T23:03:30.766 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:30 smithi184 ceph-mon[36198]: pgmap v225: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 307 B/s wr, 0 op/s 2024-02-28T23:03:31.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.695+0000 7f83ee000700 1 -- 172.21.15.159:0/2493821153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e80ffd90 msgr2=0x7f83e8100210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:31.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.695+0000 7f83ee000700 1 --2- 172.21.15.159:0/2493821153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e80ffd90 0x7f83e8100210 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f83d4009910 tx=0x7f83d4009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:31.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.695+0000 7f83ee000700 1 -- 172.21.15.159:0/2493821153 shutdown_connections 2024-02-28T23:03:31.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.695+0000 7f83ee000700 1 --2- 172.21.15.159:0/2493821153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e80ffd90 0x7f83e8100210 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:31.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.695+0000 7f83ee000700 1 --2- 172.21.15.159:0/2493821153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e80ff430 0x7f83e80ff850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:31.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.695+0000 7f83ee000700 1 -- 172.21.15.159:0/2493821153 >> 172.21.15.159:0/2493821153 conn(0x7f83e80fb030 msgr2=0x7f83e80fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:31.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.695+0000 7f83ee000700 1 -- 172.21.15.159:0/2493821153 shutdown_connections 2024-02-28T23:03:31.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.695+0000 7f83ee000700 1 -- 172.21.15.159:0/2493821153 wait complete. 2024-02-28T23:03:31.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.696+0000 7f83ee000700 1 Processor -- start 2024-02-28T23:03:31.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.696+0000 7f83ee000700 1 -- start start 2024-02-28T23:03:31.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.696+0000 7f83ee000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e80ff430 0x7f83e8198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:31.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.696+0000 7f83ee000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e80ffd90 0x7f83e8198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:31.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.696+0000 7f83ee000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e8199080 con 0x7f83e80ffd90 2024-02-28T23:03:31.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.696+0000 7f83ee000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e81991c0 con 0x7f83e80ff430 2024-02-28T23:03:31.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.697+0000 7f83e6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e80ffd90 0x7f83e8198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:31.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.697+0000 7f83e6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e80ffd90 0x7f83e8198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50294/0 (socket says 172.21.15.159:50294) 2024-02-28T23:03:31.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.697+0000 7f83e6a00700 1 -- 172.21.15.159:0/3168127704 learned_addr learned my addr 172.21.15.159:0/3168127704 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:31.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.697+0000 7f83e7400700 1 --2- 172.21.15.159:0/3168127704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e80ff430 0x7f83e8198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:31.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.697+0000 7f83e6a00700 1 -- 172.21.15.159:0/3168127704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e80ff430 msgr2=0x7f83e8198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:31.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.697+0000 7f83e6a00700 1 --2- 172.21.15.159:0/3168127704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e80ff430 0x7f83e8198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:31.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.697+0000 7f83e6a00700 1 -- 172.21.15.159:0/3168127704 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d40095f0 con 0x7f83e80ffd90 2024-02-28T23:03:31.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.698+0000 7f83e6a00700 1 --2- 172.21.15.159:0/3168127704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e80ffd90 0x7f83e8198a60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f83d4006010 tx=0x7f83d400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:31.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.698+0000 7f83dfe00700 1 -- 172.21.15.159:0/3168127704 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d401d070 con 0x7f83e80ffd90 2024-02-28T23:03:31.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.698+0000 7f83dfe00700 1 -- 172.21.15.159:0/3168127704 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f83d400f460 con 0x7f83e80ffd90 2024-02-28T23:03:31.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.698+0000 7f83ee000700 1 -- 172.21.15.159:0/3168127704 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e819dc10 con 0x7f83e80ffd90 2024-02-28T23:03:31.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.698+0000 7f83dfe00700 1 -- 172.21.15.159:0/3168127704 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83d4021640 con 0x7f83e80ffd90 2024-02-28T23:03:31.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.698+0000 7f83ee000700 1 -- 172.21.15.159:0/3168127704 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e819e100 con 0x7f83e80ffd90 2024-02-28T23:03:31.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.700+0000 7f83ee000700 1 -- 172.21.15.159:0/3168127704 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e810b900 con 0x7f83e80ffd90 2024-02-28T23:03:31.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.701+0000 7f83dfe00700 1 -- 172.21.15.159:0/3168127704 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f83d400fab0 con 0x7f83e80ffd90 2024-02-28T23:03:31.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.702+0000 7f83dfe00700 1 --2- 172.21.15.159:0/3168127704 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f83cc06c4e0 0x7f83cc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:31.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.702+0000 7f83dfe00700 1 -- 172.21.15.159:0/3168127704 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f83d408cb40 con 0x7f83e80ffd90 2024-02-28T23:03:31.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.702+0000 7f83e7400700 1 --2- 172.21.15.159:0/3168127704 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f83cc06c4e0 0x7f83cc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:31.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.703+0000 7f83e7400700 1 --2- 172.21.15.159:0/3168127704 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f83cc06c4e0 0x7f83cc06e9a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f83d8005950 tx=0x7f83d800b410 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:31.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.707+0000 7f83dfe00700 1 -- 172.21.15.159:0/3168127704 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f83d405ad10 con 0x7f83e80ffd90 2024-02-28T23:03:31.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:31.988+0000 7f83ee000700 1 -- 172.21.15.159:0/3168127704 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f83e819e940 con 0x7f83e80ffd90 2024-02-28T23:03:32.199 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:32.199 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:32.199 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: pgmap v226: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T23:03:32.199 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:32.199 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.azxrct", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:03:32.199 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.azxrct", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T23:03:32.199 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:32.199 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: Deploying daemon mds.cephfs.smithi159.azxrct on smithi159 2024-02-28T23:03:32.200 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.184:6824/3034714861,v1:172.21.15.184:6825/3034714861] up:boot 2024-02-28T23:03:32.200 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby 2024-02-28T23:03:32.200 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:03:32.200 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:31 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby 2024-02-28T23:03:32.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:32.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:32.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: pgmap v226: 65 pgs: 65 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T23:03:32.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:32.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.azxrct", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:03:32.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.azxrct", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T23:03:32.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:32.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: Deploying daemon mds.cephfs.smithi159.azxrct on smithi159 2024-02-28T23:03:32.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.184:6824/3034714861,v1:172.21.15.184:6825/3034714861] up:boot 2024-02-28T23:03:32.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby 2024-02-28T23:03:32.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:03:32.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:31 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby 2024-02-28T23:03:32.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.477+0000 7f83dfe00700 1 -- 172.21.15.159:0/3168127704 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v8) v1 ==== 105+0+0 (secure 0 0 0) 0x7f83d405a8a0 con 0x7f83e80ffd90 2024-02-28T23:03:32.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.480+0000 7f83ee000700 1 -- 172.21.15.159:0/3168127704 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f83cc06c4e0 msgr2=0x7f83cc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:32.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.480+0000 7f83ee000700 1 --2- 172.21.15.159:0/3168127704 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f83cc06c4e0 0x7f83cc06e9a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f83d8005950 tx=0x7f83d800b410 comp rx=0 tx=0).stop 2024-02-28T23:03:32.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.480+0000 7f83ee000700 1 -- 172.21.15.159:0/3168127704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e80ffd90 msgr2=0x7f83e8198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:32.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.480+0000 7f83ee000700 1 --2- 172.21.15.159:0/3168127704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e80ffd90 0x7f83e8198a60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f83d4006010 tx=0x7f83d400bd70 comp rx=0 tx=0).stop 2024-02-28T23:03:32.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.481+0000 7f83ee000700 1 -- 172.21.15.159:0/3168127704 shutdown_connections 2024-02-28T23:03:32.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.481+0000 7f83ee000700 1 --2- 172.21.15.159:0/3168127704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83e80ff430 0x7f83e8198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:32.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.481+0000 7f83ee000700 1 --2- 172.21.15.159:0/3168127704 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f83cc06c4e0 0x7f83cc06e9a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:32.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.481+0000 7f83ee000700 1 --2- 172.21.15.159:0/3168127704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e80ffd90 0x7f83e8198a60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:32.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.481+0000 7f83ee000700 1 -- 172.21.15.159:0/3168127704 >> 172.21.15.159:0/3168127704 conn(0x7f83e80fb030 msgr2=0x7f83e8107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:32.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.481+0000 7f83ee000700 1 -- 172.21.15.159:0/3168127704 shutdown_connections 2024-02-28T23:03:32.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:32.481+0000 7f83ee000700 1 -- 172.21.15.159:0/3168127704 wait complete. 2024-02-28T23:03:33.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:32 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3168127704' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-28T23:03:33.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:32 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3168127704' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-28T23:03:33.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:32 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby 2024-02-28T23:03:33.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:32 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3168127704' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-02-28T23:03:33.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:32 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3168127704' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-02-28T23:03:33.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:32 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby 2024-02-28T23:03:33.453 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T23:03:33.462 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:03:33.463 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-02-28T23:03:34.135 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:34.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:34 smithi184 ceph-mon[36198]: pgmap v227: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-02-28T23:03:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:34 smithi159 ceph-mon[28802]: pgmap v227: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-02-28T23:03:35.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:03:35.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:03:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:36.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:36 smithi184 ceph-mon[36198]: pgmap v228: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-02-28T23:03:36.639 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:36 smithi159 ceph-mon[28802]: pgmap v228: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s wr, 4 op/s 2024-02-28T23:03:37.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.143+0000 7f9aba200700 1 -- 172.21.15.159:0/1629048674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab4103f70 msgr2=0x7f9ab41043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:37.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.143+0000 7f9aba200700 1 --2- 172.21.15.159:0/1629048674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab4103f70 0x7f9ab41043f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009910 tx=0x7f9aa0009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:37.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.143+0000 7f9aba200700 1 -- 172.21.15.159:0/1629048674 shutdown_connections 2024-02-28T23:03:37.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.143+0000 7f9aba200700 1 --2- 172.21.15.159:0/1629048674 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab4103f70 0x7f9ab41043f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:37.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.143+0000 7f9aba200700 1 --2- 172.21.15.159:0/1629048674 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ab4102e10 0x7f9ab4103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:37.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.143+0000 7f9aba200700 1 -- 172.21.15.159:0/1629048674 >> 172.21.15.159:0/1629048674 conn(0x7f9ab40fe3d0 msgr2=0x7f9ab41007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:37.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.143+0000 7f9aba200700 1 -- 172.21.15.159:0/1629048674 shutdown_connections 2024-02-28T23:03:37.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.143+0000 7f9aba200700 1 -- 172.21.15.159:0/1629048674 wait complete. 2024-02-28T23:03:37.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.144+0000 7f9aba200700 1 Processor -- start 2024-02-28T23:03:37.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.144+0000 7f9aba200700 1 -- start start 2024-02-28T23:03:37.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.145+0000 7f9aba200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ab4102e10 0x7f9ab4198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:37.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.145+0000 7f9aba200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab4103f70 0x7f9ab4198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.145+0000 7f9aba200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab41990a0 con 0x7f9ab4103f70 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.145+0000 7f9aba200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab41991e0 con 0x7f9ab4102e10 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.145+0000 7f9ab2a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab4103f70 0x7f9ab4198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.145+0000 7f9ab2a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab4103f70 0x7f9ab4198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50340/0 (socket says 172.21.15.159:50340) 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.145+0000 7f9ab2a00700 1 -- 172.21.15.159:0/3458924294 learned_addr learned my addr 172.21.15.159:0/3458924294 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.145+0000 7f9ab3400700 1 --2- 172.21.15.159:0/3458924294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ab4102e10 0x7f9ab4198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.145+0000 7f9ab2a00700 1 -- 172.21.15.159:0/3458924294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ab4102e10 msgr2=0x7f9ab4198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.145+0000 7f9ab2a00700 1 --2- 172.21.15.159:0/3458924294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ab4102e10 0x7f9ab4198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.145+0000 7f9ab2a00700 1 -- 172.21.15.159:0/3458924294 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aa00095f0 con 0x7f9ab4103f70 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.146+0000 7f9ab2a00700 1 --2- 172.21.15.159:0/3458924294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab4103f70 0x7f9ab4198a80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000bd70 tx=0x7f9aa000be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.146+0000 7f9aabe00700 1 -- 172.21.15.159:0/3458924294 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa001d070 con 0x7f9ab4103f70 2024-02-28T23:03:37.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.146+0000 7f9aabe00700 1 -- 172.21.15.159:0/3458924294 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9aa0022470 con 0x7f9ab4103f70 2024-02-28T23:03:37.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.146+0000 7f9aba200700 1 -- 172.21.15.159:0/3458924294 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab419dc30 con 0x7f9ab4103f70 2024-02-28T23:03:37.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.146+0000 7f9aabe00700 1 -- 172.21.15.159:0/3458924294 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9aa000f670 con 0x7f9ab4103f70 2024-02-28T23:03:37.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.146+0000 7f9aba200700 1 -- 172.21.15.159:0/3458924294 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab419e120 con 0x7f9ab4103f70 2024-02-28T23:03:37.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.148+0000 7f9aba200700 1 -- 172.21.15.159:0/3458924294 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ab410b8f0 con 0x7f9ab4103f70 2024-02-28T23:03:37.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.149+0000 7f9aabe00700 1 -- 172.21.15.159:0/3458924294 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f9aa0022a50 con 0x7f9ab4103f70 2024-02-28T23:03:37.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.150+0000 7f9aabe00700 1 --2- 172.21.15.159:0/3458924294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9a9806c4e0 0x7f9a9806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:37.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.150+0000 7f9aabe00700 1 -- 172.21.15.159:0/3458924294 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5468+0+0 (secure 0 0 0) 0x7f9aa008cdf0 con 0x7f9ab4103f70 2024-02-28T23:03:37.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.150+0000 7f9ab3400700 1 --2- 172.21.15.159:0/3458924294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9a9806c4e0 0x7f9a9806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:37.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.151+0000 7f9ab3400700 1 --2- 172.21.15.159:0/3458924294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9a9806c4e0 0x7f9a9806e9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4005fd0 tx=0x7f9aa400a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:37.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.155+0000 7f9aabe00700 1 -- 172.21.15.159:0/3458924294 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f9aa005b190 con 0x7f9ab4103f70 2024-02-28T23:03:37.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:37.421+0000 7f9aba200700 1 -- 172.21.15.159:0/3458924294 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f9ab419e780 con 0x7f9ab4103f70 2024-02-28T23:03:37.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:37.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:37.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:37.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.pnifob", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:03:37.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.pnifob", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T23:03:37.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:37.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: Deploying daemon mds.cephfs.smithi184.pnifob on smithi184 2024-02-28T23:03:37.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T23:03:37.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] up:boot 2024-02-28T23:03:37.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 2 up:standby 2024-02-28T23:03:37.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:03:37.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:37 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3458924294' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-28T23:03:37.778 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:37.778 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:37.778 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:37.778 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.pnifob", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:03:37.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.pnifob", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-02-28T23:03:37.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:37.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: Deploying daemon mds.cephfs.smithi184.pnifob on smithi184 2024-02-28T23:03:37.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: pgmap v229: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T23:03:37.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] up:boot 2024-02-28T23:03:37.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 2 up:standby 2024-02-28T23:03:37.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:03:37.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:37 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3458924294' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-02-28T23:03:38.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.291+0000 7f9aabe00700 1 -- 172.21.15.159:0/3458924294 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v10) v1 ==== 121+0+0 (secure 0 0 0) 0x7f9aa005ad20 con 0x7f9ab4103f70 2024-02-28T23:03:38.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.295+0000 7f9aba200700 1 -- 172.21.15.159:0/3458924294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9a9806c4e0 msgr2=0x7f9a9806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:38.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.295+0000 7f9aba200700 1 --2- 172.21.15.159:0/3458924294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9a9806c4e0 0x7f9a9806e9a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4005fd0 tx=0x7f9aa400a560 comp rx=0 tx=0).stop 2024-02-28T23:03:38.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.295+0000 7f9aba200700 1 -- 172.21.15.159:0/3458924294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab4103f70 msgr2=0x7f9ab4198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:38.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.295+0000 7f9aba200700 1 --2- 172.21.15.159:0/3458924294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab4103f70 0x7f9ab4198a80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000bd70 tx=0x7f9aa000be50 comp rx=0 tx=0).stop 2024-02-28T23:03:38.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.296+0000 7f9aba200700 1 -- 172.21.15.159:0/3458924294 shutdown_connections 2024-02-28T23:03:38.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.296+0000 7f9aba200700 1 --2- 172.21.15.159:0/3458924294 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ab4102e10 0x7f9ab4198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:38.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.296+0000 7f9aba200700 1 --2- 172.21.15.159:0/3458924294 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f9a9806c4e0 0x7f9a9806e9a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:38.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.296+0000 7f9aba200700 1 --2- 172.21.15.159:0/3458924294 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ab4103f70 0x7f9ab4198a80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:38.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.296+0000 7f9aba200700 1 -- 172.21.15.159:0/3458924294 >> 172.21.15.159:0/3458924294 conn(0x7f9ab40fe3d0 msgr2=0x7f9ab4107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:38.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.296+0000 7f9aba200700 1 -- 172.21.15.159:0/3458924294 shutdown_connections 2024-02-28T23:03:38.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:38.296+0000 7f9aba200700 1 -- 172.21.15.159:0/3458924294 wait complete. 2024-02-28T23:03:39.205 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T23:03:39.216 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:03:39.216 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-02-28T23:03:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:39 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3458924294' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-28T23:03:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:39 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 1 up:standby 2024-02-28T23:03:39.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:39 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3458924294' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-02-28T23:03:39.561 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:39 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 1 up:standby 2024-02-28T23:03:39.638 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:40 smithi159 ceph-mon[28802]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T23:03:40.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:40 smithi184 ceph-mon[36198]: pgmap v230: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-02-28T23:03:41.370 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:41 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] up:boot 2024-02-28T23:03:41.370 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:41 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:03:41.370 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:03:41.370 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:41.370 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:41.370 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:41.370 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:41.371 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:41.371 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:41 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:03:41.489 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:41 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] up:boot 2024-02-28T23:03:41.489 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:41 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:03:41.489 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:03:41.490 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:41.490 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:41.490 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:41.490 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:41.490 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:41.490 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:41 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:03:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.802+0000 7f039fe00700 1 -- 172.21.15.159:0/2137257882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0398103ff0 msgr2=0x7f0398104450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.802+0000 7f039fe00700 1 --2- 172.21.15.159:0/2137257882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0398103ff0 0x7f0398104450 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0384009910 tx=0x7f0384009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:41.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.802+0000 7f039fe00700 1 -- 172.21.15.159:0/2137257882 shutdown_connections 2024-02-28T23:03:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.802+0000 7f039fe00700 1 --2- 172.21.15.159:0/2137257882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0398103ff0 0x7f0398104450 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.802+0000 7f039fe00700 1 --2- 172.21.15.159:0/2137257882 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0398102df0 0x7f0398103210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.802+0000 7f039fe00700 1 -- 172.21.15.159:0/2137257882 >> 172.21.15.159:0/2137257882 conn(0x7f03980fe390 msgr2=0x7f03981007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.803+0000 7f039fe00700 1 -- 172.21.15.159:0/2137257882 shutdown_connections 2024-02-28T23:03:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.803+0000 7f039fe00700 1 -- 172.21.15.159:0/2137257882 wait complete. 2024-02-28T23:03:41.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.804+0000 7f039fe00700 1 Processor -- start 2024-02-28T23:03:41.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.804+0000 7f039fe00700 1 -- start start 2024-02-28T23:03:41.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.805+0000 7f039fe00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0398102df0 0x7f03981985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:41.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.805+0000 7f039fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0398103ff0 0x7f0398198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:41.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.805+0000 7f039fe00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0398199070 con 0x7f0398103ff0 2024-02-28T23:03:41.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.805+0000 7f039fe00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03981991b0 con 0x7f0398102df0 2024-02-28T23:03:41.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.805+0000 7f039ca00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0398103ff0 0x7f0398198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:41.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.805+0000 7f039ca00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0398103ff0 0x7f0398198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56934/0 (socket says 172.21.15.159:56934) 2024-02-28T23:03:41.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.805+0000 7f039ca00700 1 -- 172.21.15.159:0/495694551 learned_addr learned my addr 172.21.15.159:0/495694551 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:41.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.805+0000 7f039d400700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0398102df0 0x7f03981985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:41.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.806+0000 7f039ca00700 1 -- 172.21.15.159:0/495694551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0398102df0 msgr2=0x7f03981985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:41.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.806+0000 7f039ca00700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0398102df0 0x7f03981985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:41.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.806+0000 7f039ca00700 1 -- 172.21.15.159:0/495694551 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840095f0 con 0x7f0398103ff0 2024-02-28T23:03:41.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.806+0000 7f039d400700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0398102df0 0x7f03981985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:03:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.806+0000 7f039ca00700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0398103ff0 0x7f0398198ae0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f038400bd70 tx=0x7f038400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.806+0000 7f0396000700 1 -- 172.21.15.159:0/495694551 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f038401d070 con 0x7f0398103ff0 2024-02-28T23:03:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.807+0000 7f0396000700 1 -- 172.21.15.159:0/495694551 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f0384022470 con 0x7f0398103ff0 2024-02-28T23:03:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.807+0000 7f0396000700 1 -- 172.21.15.159:0/495694551 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f038400f670 con 0x7f0398103ff0 2024-02-28T23:03:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.807+0000 7f039fe00700 1 -- 172.21.15.159:0/495694551 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039819dc10 con 0x7f0398103ff0 2024-02-28T23:03:41.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.807+0000 7f039fe00700 1 -- 172.21.15.159:0/495694551 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039819e0d0 con 0x7f0398103ff0 2024-02-28T23:03:41.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.808+0000 7f039fe00700 1 -- 172.21.15.159:0/495694551 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039810b950 con 0x7f0398103ff0 2024-02-28T23:03:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.810+0000 7f0396000700 1 -- 172.21.15.159:0/495694551 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f0384022a50 con 0x7f0398103ff0 2024-02-28T23:03:41.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.810+0000 7f0396000700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f038006c4e0 0x7f038006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:41.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.811+0000 7f0396000700 1 -- 172.21.15.159:0/495694551 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f038408cef0 con 0x7f0398103ff0 2024-02-28T23:03:41.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.811+0000 7f039d400700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f038006c4e0 0x7f038006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:41.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.812+0000 7f039d400700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f038006c4e0 0x7f038006e9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0398103e50 tx=0x7f038c00a680 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:41.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:41.819+0000 7f0396000700 1 -- 172.21.15.159:0/495694551 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f038405b190 con 0x7f0398103ff0 2024-02-28T23:03:42.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.093+0000 7f039fe00700 1 -- 172.21.15.159:0/495694551 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f039819e7a0 con 0x7f0398103ff0 2024-02-28T23:03:42.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.490+0000 7f0396000700 1 -- 172.21.15.159:0/495694551 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v15) v1 ==== 133+0+0 (secure 0 0 0) 0x7f038405ad20 con 0x7f0398103ff0 2024-02-28T23:03:42.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.494+0000 7f039fe00700 1 -- 172.21.15.159:0/495694551 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f038006c4e0 msgr2=0x7f038006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:42.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.494+0000 7f039fe00700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f038006c4e0 0x7f038006e9a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0398103e50 tx=0x7f038c00a680 comp rx=0 tx=0).stop 2024-02-28T23:03:42.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.494+0000 7f039fe00700 1 -- 172.21.15.159:0/495694551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0398103ff0 msgr2=0x7f0398198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:42.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.494+0000 7f039fe00700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0398103ff0 0x7f0398198ae0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f038400bd70 tx=0x7f038400be50 comp rx=0 tx=0).stop 2024-02-28T23:03:42.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.494+0000 7f039fe00700 1 -- 172.21.15.159:0/495694551 shutdown_connections 2024-02-28T23:03:42.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.494+0000 7f039fe00700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0398102df0 0x7f03981985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:42.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.494+0000 7f039fe00700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f038006c4e0 0x7f038006e9a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:42.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.494+0000 7f039fe00700 1 --2- 172.21.15.159:0/495694551 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0398103ff0 0x7f0398198ae0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:42.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.494+0000 7f039fe00700 1 -- 172.21.15.159:0/495694551 >> 172.21.15.159:0/495694551 conn(0x7f03980fe390 msgr2=0x7f0398107220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:42.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.495+0000 7f039fe00700 1 -- 172.21.15.159:0/495694551 shutdown_connections 2024-02-28T23:03:42.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:42.495+0000 7f039fe00700 1 -- 172.21.15.159:0/495694551 wait complete. 2024-02-28T23:03:42.495 INFO:teuthology.orchestra.run.smithi159.stderr:inline data disabled 2024-02-28T23:03:42.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: pgmap v231: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 1023 B/s wr, 3 op/s 2024-02-28T23:03:42.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] up:standby 2024-02-28T23:03:42.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: Dropping low affinity standby-replay daemon mds.cephfs.smithi184.azwkfx in favor of higher affinity standby. 2024-02-28T23:03:42.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:03:42.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: Dropping low affinity active daemon mds.cephfs.smithi159.mbaqic in favor of higher affinity standby. 2024-02-28T23:03:42.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: Replacing daemon mds.cephfs.smithi159.mbaqic as rank 0 with standby daemon mds.cephfs.smithi159.azxrct 2024-02-28T23:03:42.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T23:03:42.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 1 up:standby 2024-02-28T23:03:42.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: osdmap e46: 6 total, 6 up, 6 in 2024-02-28T23:03:42.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:03:42.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: fsmap cephfs:1/1 {0=cephfs.smithi159.azxrct=up:replay} 1 up:standby 2024-02-28T23:03:42.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:42 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/495694551' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-28T23:03:42.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: pgmap v231: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 170 B/s rd, 1023 B/s wr, 3 op/s 2024-02-28T23:03:42.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] up:standby 2024-02-28T23:03:42.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: Dropping low affinity standby-replay daemon mds.cephfs.smithi184.azwkfx in favor of higher affinity standby. 2024-02-28T23:03:42.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:03:42.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: Dropping low affinity active daemon mds.cephfs.smithi159.mbaqic in favor of higher affinity standby. 2024-02-28T23:03:42.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: Replacing daemon mds.cephfs.smithi159.mbaqic as rank 0 with standby daemon mds.cephfs.smithi159.azxrct 2024-02-28T23:03:42.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T23:03:42.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 1 up:standby 2024-02-28T23:03:42.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: osdmap e46: 6 total, 6 up, 6 in 2024-02-28T23:03:42.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:03:42.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: fsmap cephfs:1/1 {0=cephfs.smithi159.azxrct=up:replay} 1 up:standby 2024-02-28T23:03:42.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:42 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/495694551' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-02-28T23:03:43.537 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T23:03:43.556 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:03:43.556 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T23:03:43.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:43 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] up:reconnect 2024-02-28T23:03:43.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:43 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] up:boot 2024-02-28T23:03:43.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:43 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] up:boot 2024-02-28T23:03:43.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:43 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/495694551' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-28T23:03:43.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:43 smithi184 ceph-mon[36198]: fsmap cephfs:1/1 {0=cephfs.smithi159.azxrct=up:reconnect} 3 up:standby 2024-02-28T23:03:43.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:03:43.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:43 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:03:43.962 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:43.971 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:43 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] up:reconnect 2024-02-28T23:03:43.971 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:43 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] up:boot 2024-02-28T23:03:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:43 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] up:boot 2024-02-28T23:03:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:43 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/495694551' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-02-28T23:03:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:43 smithi159 ceph-mon[28802]: fsmap cephfs:1/1 {0=cephfs.smithi159.azxrct=up:reconnect} 3 up:standby 2024-02-28T23:03:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:03:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:43 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:03:44.754 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:44 smithi184 ceph-mon[36198]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-02-28T23:03:44.754 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:44 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] up:rejoin 2024-02-28T23:03:44.754 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:44 smithi184 ceph-mon[36198]: fsmap cephfs:1/1 {0=cephfs.smithi159.azxrct=up:rejoin} 3 up:standby 2024-02-28T23:03:44.754 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:44 smithi184 ceph-mon[36198]: daemon mds.cephfs.smithi159.azxrct is now active in filesystem cephfs as rank 0 2024-02-28T23:03:44.755 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:44 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:44.755 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:44 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:44 smithi159 ceph-mon[28802]: pgmap v233: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-02-28T23:03:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:44 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] up:rejoin 2024-02-28T23:03:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:44 smithi159 ceph-mon[28802]: fsmap cephfs:1/1 {0=cephfs.smithi159.azxrct=up:rejoin} 3 up:standby 2024-02-28T23:03:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:44 smithi159 ceph-mon[28802]: daemon mds.cephfs.smithi159.azxrct is now active in filesystem cephfs as rank 0 2024-02-28T23:03:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:44 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:44.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:44 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:45.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:45 smithi184 ceph-mon[36198]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T23:03:45.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:45 smithi184 ceph-mon[36198]: Cluster is now healthy 2024-02-28T23:03:45.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:45 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] up:active 2024-02-28T23:03:45.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:45 smithi184 ceph-mon[36198]: mds.? [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] up:standby 2024-02-28T23:03:45.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:45 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 3 up:standby 2024-02-28T23:03:45.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:45 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:03:45.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:45 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:45.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:45 smithi159 ceph-mon[28802]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T23:03:45.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:45 smithi159 ceph-mon[28802]: Cluster is now healthy 2024-02-28T23:03:45.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:45 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] up:active 2024-02-28T23:03:45.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:45 smithi159 ceph-mon[28802]: mds.? [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] up:standby 2024-02-28T23:03:45.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:45 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 3 up:standby 2024-02-28T23:03:45.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:45 smithi159 ceph-mon[28802]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:03:45.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:45 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:46.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.471+0000 7fbc81c00700 1 -- 172.21.15.159:0/2106601739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc7c1071a0 msgr2=0x7fbc7c1075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:46.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.471+0000 7fbc81c00700 1 --2- 172.21.15.159:0/2106601739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc7c1071a0 0x7fbc7c1075c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c009910 tx=0x7fbc6c009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:46.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.471+0000 7fbc81c00700 1 -- 172.21.15.159:0/2106601739 shutdown_connections 2024-02-28T23:03:46.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.471+0000 7fbc81c00700 1 --2- 172.21.15.159:0/2106601739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7c1083a0 0x7fbc7c108800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:46.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.471+0000 7fbc81c00700 1 --2- 172.21.15.159:0/2106601739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc7c1071a0 0x7fbc7c1075c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:46.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.471+0000 7fbc81c00700 1 -- 172.21.15.159:0/2106601739 >> 172.21.15.159:0/2106601739 conn(0x7fbc7c0762b0 msgr2=0x7fbc7c078710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:46.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.471+0000 7fbc81c00700 1 -- 172.21.15.159:0/2106601739 shutdown_connections 2024-02-28T23:03:46.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.471+0000 7fbc81c00700 1 -- 172.21.15.159:0/2106601739 wait complete. 2024-02-28T23:03:46.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.472+0000 7fbc81c00700 1 Processor -- start 2024-02-28T23:03:46.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.472+0000 7fbc81c00700 1 -- start start 2024-02-28T23:03:46.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.473+0000 7fbc81c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc7c1071a0 0x7fbc7c19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:46.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.473+0000 7fbc81c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7c1083a0 0x7fbc7c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:46.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.473+0000 7fbc81c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c19d490 con 0x7fbc7c1071a0 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.473+0000 7fbc81c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7c19d5d0 con 0x7fbc7c1083a0 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.473+0000 7fbc7aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc7c1071a0 0x7fbc7c19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.473+0000 7fbc7aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc7c1071a0 0x7fbc7c19c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56948/0 (socket says 172.21.15.159:56948) 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.473+0000 7fbc7aa00700 1 -- 172.21.15.159:0/2625302302 learned_addr learned my addr 172.21.15.159:0/2625302302 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.473+0000 7fbc7a000700 1 --2- 172.21.15.159:0/2625302302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7c1083a0 0x7fbc7c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.473+0000 7fbc7aa00700 1 -- 172.21.15.159:0/2625302302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7c1083a0 msgr2=0x7fbc7c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.473+0000 7fbc7aa00700 1 --2- 172.21.15.159:0/2625302302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7c1083a0 0x7fbc7c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.474+0000 7fbc7aa00700 1 -- 172.21.15.159:0/2625302302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0095f0 con 0x7fbc7c1071a0 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.474+0000 7fbc7aa00700 1 --2- 172.21.15.159:0/2625302302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc7c1071a0 0x7fbc7c19c930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00bda0 tx=0x7fbc6c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.474+0000 7fbc73400700 1 -- 172.21.15.159:0/2625302302 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6c01d070 con 0x7fbc7c1071a0 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.474+0000 7fbc73400700 1 -- 172.21.15.159:0/2625302302 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbc6c004c50 con 0x7fbc7c1071a0 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.474+0000 7fbc73400700 1 -- 172.21.15.159:0/2625302302 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc6c00f690 con 0x7fbc7c1071a0 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.474+0000 7fbc81c00700 1 -- 172.21.15.159:0/2625302302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c1a2020 con 0x7fbc7c1071a0 2024-02-28T23:03:46.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.474+0000 7fbc81c00700 1 -- 172.21.15.159:0/2625302302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc7c1a2510 con 0x7fbc7c1071a0 2024-02-28T23:03:46.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.475+0000 7fbc81c00700 1 -- 172.21.15.159:0/2625302302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7c10fd00 con 0x7fbc7c1071a0 2024-02-28T23:03:46.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.476+0000 7fbc73400700 1 -- 172.21.15.159:0/2625302302 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fbc6c022a20 con 0x7fbc7c1071a0 2024-02-28T23:03:46.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.477+0000 7fbc73400700 1 --2- 172.21.15.159:0/2625302302 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbc6006c4e0 0x7fbc6006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:46.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.477+0000 7fbc73400700 1 -- 172.21.15.159:0/2625302302 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbc6c08ced0 con 0x7fbc7c1071a0 2024-02-28T23:03:46.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.477+0000 7fbc7a000700 1 --2- 172.21.15.159:0/2625302302 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbc6006c4e0 0x7fbc6006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:46.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.478+0000 7fbc7a000700 1 --2- 172.21.15.159:0/2625302302 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbc6006c4e0 0x7fbc6006e9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbc68005fd0 tx=0x7fbc6800a560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:46.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.482+0000 7fbc73400700 1 -- 172.21.15.159:0/2625302302 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbc6c05b210 con 0x7fbc7c1071a0 2024-02-28T23:03:46.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:46 smithi184 ceph-mon[36198]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-02-28T23:03:46.639 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:46 smithi159 ceph-mon[28802]: pgmap v234: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.4 KiB/s rd, 2 op/s 2024-02-28T23:03:46.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.752+0000 7fbc81c00700 1 -- 172.21.15.159:0/2625302302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbc7c1a2f80 con 0x7fbc7c1071a0 2024-02-28T23:03:46.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.753+0000 7fbc73400700 1 -- 172.21.15.159:0/2625302302 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1858 (secure 0 0 0) 0x7fbc6c027070 con 0x7fbc7c1071a0 2024-02-28T23:03:46.753 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:03:46.753 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:03:46.753 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:03:46.753 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:03:46.753 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:03:46.753 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:03:46.753 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:03:46.753 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:03:46.753 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:03:46.753 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:03:46.754 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:03:46.755 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:03:46.756 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:03:46.756 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:03:46.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.758+0000 7fbc81c00700 1 -- 172.21.15.159:0/2625302302 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbc6006c4e0 msgr2=0x7fbc6006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:46.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.758+0000 7fbc81c00700 1 --2- 172.21.15.159:0/2625302302 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbc6006c4e0 0x7fbc6006e9a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbc68005fd0 tx=0x7fbc6800a560 comp rx=0 tx=0).stop 2024-02-28T23:03:46.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.758+0000 7fbc81c00700 1 -- 172.21.15.159:0/2625302302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc7c1071a0 msgr2=0x7fbc7c19c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:46.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.758+0000 7fbc81c00700 1 --2- 172.21.15.159:0/2625302302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc7c1071a0 0x7fbc7c19c930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00bda0 tx=0x7fbc6c00be80 comp rx=0 tx=0).stop 2024-02-28T23:03:46.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.758+0000 7fbc81c00700 1 -- 172.21.15.159:0/2625302302 shutdown_connections 2024-02-28T23:03:46.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.758+0000 7fbc81c00700 1 --2- 172.21.15.159:0/2625302302 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbc6006c4e0 0x7fbc6006e9a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:46.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.758+0000 7fbc81c00700 1 --2- 172.21.15.159:0/2625302302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc7c1071a0 0x7fbc7c19c930 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:46.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.758+0000 7fbc81c00700 1 --2- 172.21.15.159:0/2625302302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc7c1083a0 0x7fbc7c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:46.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.758+0000 7fbc81c00700 1 -- 172.21.15.159:0/2625302302 >> 172.21.15.159:0/2625302302 conn(0x7fbc7c0762b0 msgr2=0x7fbc7c10b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:46.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.758+0000 7fbc81c00700 1 -- 172.21.15.159:0/2625302302 shutdown_connections 2024-02-28T23:03:46.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:46.758+0000 7fbc81c00700 1 -- 172.21.15.159:0/2625302302 wait complete. 2024-02-28T23:03:46.758 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:03:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:47 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2625302302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:03:47.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:47 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2625302302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:03:48.013 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-02-28T23:03:48.533 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:48 smithi159 ceph-mon[28802]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-02-28T23:03:48.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:48 smithi184 ceph-mon[36198]: pgmap v235: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 3.2 KiB/s rd, 3 op/s 2024-02-28T23:03:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:50 smithi159 ceph-mon[28802]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-28T23:03:50.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:03:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:50 smithi184 ceph-mon[36198]: pgmap v236: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 6.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-28T23:03:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:03:51.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.677+0000 7f694b400700 1 -- 172.21.15.159:0/1595444452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69440737f0 msgr2=0x7f6944073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:51.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.677+0000 7f694b400700 1 --2- 172.21.15.159:0/1595444452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69440737f0 0x7f6944073c70 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6930009910 tx=0x7f6930009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:51.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.677+0000 7f694b400700 1 -- 172.21.15.159:0/1595444452 shutdown_connections 2024-02-28T23:03:51.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.677+0000 7f694b400700 1 --2- 172.21.15.159:0/1595444452 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69440737f0 0x7f6944073c70 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:51.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.677+0000 7f694b400700 1 --2- 172.21.15.159:0/1595444452 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6944074dc0 0x7f6944073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.677+0000 7f694b400700 1 -- 172.21.15.159:0/1595444452 >> 172.21.15.159:0/1595444452 conn(0x7f69440fc110 msgr2=0x7f69440fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.677+0000 7f694b400700 1 -- 172.21.15.159:0/1595444452 shutdown_connections 2024-02-28T23:03:51.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.677+0000 7f694b400700 1 -- 172.21.15.159:0/1595444452 wait complete. 2024-02-28T23:03:51.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.679+0000 7f694b400700 1 Processor -- start 2024-02-28T23:03:51.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.679+0000 7f694b400700 1 -- start start 2024-02-28T23:03:51.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.679+0000 7f694b400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69440737f0 0x7f694419c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.679+0000 7f694b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6944074dc0 0x7f694419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.679+0000 7f694b400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694419d4f0 con 0x7f6944074dc0 2024-02-28T23:03:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.679+0000 7f694b400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f694419d630 con 0x7f69440737f0 2024-02-28T23:03:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.680+0000 7f6943e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6944074dc0 0x7f694419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.680+0000 7f6943e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6944074dc0 0x7f694419ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56442/0 (socket says 172.21.15.159:56442) 2024-02-28T23:03:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.680+0000 7f6943e00700 1 -- 172.21.15.159:0/1156013027 learned_addr learned my addr 172.21.15.159:0/1156013027 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.680+0000 7f6948a00700 1 --2- 172.21.15.159:0/1156013027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69440737f0 0x7f694419c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.680+0000 7f6943e00700 1 -- 172.21.15.159:0/1156013027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69440737f0 msgr2=0x7f694419c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.680+0000 7f6943e00700 1 --2- 172.21.15.159:0/1156013027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69440737f0 0x7f694419c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.680+0000 7f6943e00700 1 -- 172.21.15.159:0/1156013027 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69300095f0 con 0x7f6944074dc0 2024-02-28T23:03:51.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.680+0000 7f6943e00700 1 --2- 172.21.15.159:0/1156013027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6944074dc0 0x7f694419ced0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f693000bda0 tx=0x7f693000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:51.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.681+0000 7f6941600700 1 -- 172.21.15.159:0/1156013027 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f693001d070 con 0x7f6944074dc0 2024-02-28T23:03:51.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.681+0000 7f6941600700 1 -- 172.21.15.159:0/1156013027 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6930004c50 con 0x7f6944074dc0 2024-02-28T23:03:51.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.681+0000 7f694b400700 1 -- 172.21.15.159:0/1156013027 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69441a2080 con 0x7f6944074dc0 2024-02-28T23:03:51.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.681+0000 7f6941600700 1 -- 172.21.15.159:0/1156013027 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f693000f690 con 0x7f6944074dc0 2024-02-28T23:03:51.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.681+0000 7f694b400700 1 -- 172.21.15.159:0/1156013027 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69441a2570 con 0x7f6944074dc0 2024-02-28T23:03:51.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.683+0000 7f694b400700 1 -- 172.21.15.159:0/1156013027 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694410fd40 con 0x7f6944074dc0 2024-02-28T23:03:51.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.683+0000 7f6941600700 1 -- 172.21.15.159:0/1156013027 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f69300229b0 con 0x7f6944074dc0 2024-02-28T23:03:51.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.684+0000 7f6941600700 1 --2- 172.21.15.159:0/1156013027 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f692c06c4e0 0x7f692c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:51.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.684+0000 7f6941600700 1 -- 172.21.15.159:0/1156013027 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f693008cfb0 con 0x7f6944074dc0 2024-02-28T23:03:51.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.684+0000 7f6948a00700 1 --2- 172.21.15.159:0/1156013027 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f692c06c4e0 0x7f692c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:51.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.685+0000 7f6948a00700 1 --2- 172.21.15.159:0/1156013027 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f692c06c4e0 0x7f692c06e9a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69380060b0 tx=0x7f6938007b80 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:51.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.689+0000 7f6941600700 1 -- 172.21.15.159:0/1156013027 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f693005b390 con 0x7f6944074dc0 2024-02-28T23:03:51.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.973+0000 7f694b400700 1 -- 172.21.15.159:0/1156013027 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f694410ff00 con 0x7f6944074dc0 2024-02-28T23:03:51.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.974+0000 7f6941600700 1 -- 172.21.15.159:0/1156013027 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4756 (secure 0 0 0) 0x7f693005af20 con 0x7f6944074dc0 2024-02-28T23:03:51.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.978+0000 7f694b400700 1 -- 172.21.15.159:0/1156013027 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f692c06c4e0 msgr2=0x7f692c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:51.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.978+0000 7f694b400700 1 --2- 172.21.15.159:0/1156013027 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f692c06c4e0 0x7f692c06e9a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f69380060b0 tx=0x7f6938007b80 comp rx=0 tx=0).stop 2024-02-28T23:03:51.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.978+0000 7f694b400700 1 -- 172.21.15.159:0/1156013027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6944074dc0 msgr2=0x7f694419ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:51.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.978+0000 7f694b400700 1 --2- 172.21.15.159:0/1156013027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6944074dc0 0x7f694419ced0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f693000bda0 tx=0x7f693000be80 comp rx=0 tx=0).stop 2024-02-28T23:03:51.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.979+0000 7f694b400700 1 -- 172.21.15.159:0/1156013027 shutdown_connections 2024-02-28T23:03:51.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.979+0000 7f694b400700 1 --2- 172.21.15.159:0/1156013027 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f69440737f0 0x7f694419c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:51.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.979+0000 7f694b400700 1 --2- 172.21.15.159:0/1156013027 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f692c06c4e0 0x7f692c06e9a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:51.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.979+0000 7f694b400700 1 --2- 172.21.15.159:0/1156013027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6944074dc0 0x7f694419ced0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:51.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.979+0000 7f694b400700 1 -- 172.21.15.159:0/1156013027 >> 172.21.15.159:0/1156013027 conn(0x7f69440fc110 msgr2=0x7f6944102430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:51.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.979+0000 7f694b400700 1 -- 172.21.15.159:0/1156013027 shutdown_connections 2024-02-28T23:03:51.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:51.979+0000 7f694b400700 1 -- 172.21.15.159:0/1156013027 wait complete. 2024-02-28T23:03:51.978 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:03:51.993 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:03:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:52 smithi159 ceph-mon[28802]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-28T23:03:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:52 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1156013027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T23:03:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:52 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:52 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:52 smithi184 ceph-mon[36198]: pgmap v237: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 10 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-28T23:03:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:52 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1156013027' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T23:03:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:52 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:52 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:52.882 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-02-28T23:03:53.295 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:03:54.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:54 smithi184 ceph-mon[36198]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.3 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-28T23:03:54.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:03:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:54 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:03:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:54 smithi159 ceph-mon[28802]: pgmap v238: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 9.3 KiB/s rd, 0 B/s wr, 10 op/s 2024-02-28T23:03:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:03:54.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:03:54.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:54.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:54 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:03:55.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.625+0000 7fd26f000700 1 -- 172.21.15.159:0/3571919988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd268107200 msgr2=0x7fd268107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:55.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.625+0000 7fd26f000700 1 --2- 172.21.15.159:0/3571919988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd268107200 0x7fd268107620 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd258009910 tx=0x7fd258009c20 comp rx=0 tx=0).stop 2024-02-28T23:03:55.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.625+0000 7fd26f000700 1 -- 172.21.15.159:0/3571919988 shutdown_connections 2024-02-28T23:03:55.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.625+0000 7fd26f000700 1 --2- 172.21.15.159:0/3571919988 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd268108400 0x7fd268108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:55.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.625+0000 7fd26f000700 1 --2- 172.21.15.159:0/3571919988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd268107200 0x7fd268107620 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:55.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.625+0000 7fd26f000700 1 -- 172.21.15.159:0/3571919988 >> 172.21.15.159:0/3571919988 conn(0x7fd2680761b0 msgr2=0x7fd268078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:55.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.625+0000 7fd26f000700 1 -- 172.21.15.159:0/3571919988 shutdown_connections 2024-02-28T23:03:55.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.625+0000 7fd26f000700 1 -- 172.21.15.159:0/3571919988 wait complete. 2024-02-28T23:03:55.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.626+0000 7fd26f000700 1 Processor -- start 2024-02-28T23:03:55.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.626+0000 7fd26f000700 1 -- start start 2024-02-28T23:03:55.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.627+0000 7fd26f000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd268107200 0x7fd26819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:55.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.627+0000 7fd26f000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd268108400 0x7fd26819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:55.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.627+0000 7fd26f000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26819d480 con 0x7fd268107200 2024-02-28T23:03:55.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.627+0000 7fd26f000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd26819d5c0 con 0x7fd268108400 2024-02-28T23:03:55.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.627+0000 7fd267e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd268107200 0x7fd26819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:55.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.627+0000 7fd267e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd268107200 0x7fd26819c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56456/0 (socket says 172.21.15.159:56456) 2024-02-28T23:03:55.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.627+0000 7fd267e00700 1 -- 172.21.15.159:0/2787292180 learned_addr learned my addr 172.21.15.159:0/2787292180 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:55.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.627+0000 7fd267400700 1 --2- 172.21.15.159:0/2787292180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd268108400 0x7fd26819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:55.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.627+0000 7fd267e00700 1 -- 172.21.15.159:0/2787292180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd268108400 msgr2=0x7fd26819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:55.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.627+0000 7fd267e00700 1 --2- 172.21.15.159:0/2787292180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd268108400 0x7fd26819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:55.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.627+0000 7fd267e00700 1 -- 172.21.15.159:0/2787292180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2580095f0 con 0x7fd268107200 2024-02-28T23:03:55.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.628+0000 7fd267e00700 1 --2- 172.21.15.159:0/2787292180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd268107200 0x7fd26819c9b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd25800bda0 tx=0x7fd25800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:55.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.628+0000 7fd264c00700 1 -- 172.21.15.159:0/2787292180 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd25801d070 con 0x7fd268107200 2024-02-28T23:03:55.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.628+0000 7fd264c00700 1 -- 172.21.15.159:0/2787292180 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd258022470 con 0x7fd268107200 2024-02-28T23:03:55.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.628+0000 7fd264c00700 1 -- 172.21.15.159:0/2787292180 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd25800f650 con 0x7fd268107200 2024-02-28T23:03:55.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.628+0000 7fd26f000700 1 -- 172.21.15.159:0/2787292180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2681a2020 con 0x7fd268107200 2024-02-28T23:03:55.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.628+0000 7fd26f000700 1 -- 172.21.15.159:0/2787292180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2681a2490 con 0x7fd268107200 2024-02-28T23:03:55.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.630+0000 7fd26f000700 1 -- 172.21.15.159:0/2787292180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd26810fd60 con 0x7fd268107200 2024-02-28T23:03:55.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.630+0000 7fd264c00700 1 -- 172.21.15.159:0/2787292180 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fd258004af0 con 0x7fd268107200 2024-02-28T23:03:55.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.632+0000 7fd264c00700 1 --2- 172.21.15.159:0/2787292180 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd24c06c4e0 0x7fd24c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:55.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.632+0000 7fd264c00700 1 -- 172.21.15.159:0/2787292180 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd25808cef0 con 0x7fd268107200 2024-02-28T23:03:55.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.632+0000 7fd267400700 1 --2- 172.21.15.159:0/2787292180 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd24c06c4e0 0x7fd24c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:55.631 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.633+0000 7fd267400700 1 --2- 172.21.15.159:0/2787292180 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd24c06c4e0 0x7fd24c06e9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd25400ac50 tx=0x7fd25400a380 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:55.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.637+0000 7fd264c00700 1 -- 172.21.15.159:0/2787292180 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd25805b1b0 con 0x7fd268107200 2024-02-28T23:03:55.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.946+0000 7fd26f000700 1 -- 172.21.15.159:0/2787292180 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fd2681a2b20 con 0x7fd268107200 2024-02-28T23:03:55.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.946+0000 7fd264c00700 1 -- 172.21.15.159:0/2787292180 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v18) v1 ==== 78+0+83 (secure 0 0 0) 0x7fd258027070 con 0x7fd268107200 2024-02-28T23:03:55.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.949+0000 7fd26f000700 1 -- 172.21.15.159:0/2787292180 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd24c06c4e0 msgr2=0x7fd24c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:55.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.949+0000 7fd26f000700 1 --2- 172.21.15.159:0/2787292180 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd24c06c4e0 0x7fd24c06e9a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd25400ac50 tx=0x7fd25400a380 comp rx=0 tx=0).stop 2024-02-28T23:03:55.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.949+0000 7fd26f000700 1 -- 172.21.15.159:0/2787292180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd268107200 msgr2=0x7fd26819c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:55.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.949+0000 7fd26f000700 1 --2- 172.21.15.159:0/2787292180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd268107200 0x7fd26819c9b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd25800bda0 tx=0x7fd25800bdd0 comp rx=0 tx=0).stop 2024-02-28T23:03:55.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.949+0000 7fd26f000700 1 -- 172.21.15.159:0/2787292180 shutdown_connections 2024-02-28T23:03:55.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.949+0000 7fd26f000700 1 --2- 172.21.15.159:0/2787292180 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd24c06c4e0 0x7fd24c06e9a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:55.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.949+0000 7fd26f000700 1 --2- 172.21.15.159:0/2787292180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd268107200 0x7fd26819c9b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:55.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.949+0000 7fd26f000700 1 --2- 172.21.15.159:0/2787292180 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd268108400 0x7fd26819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:55.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.949+0000 7fd26f000700 1 -- 172.21.15.159:0/2787292180 >> 172.21.15.159:0/2787292180 conn(0x7fd2680761b0 msgr2=0x7fd26810b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:55.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.949+0000 7fd26f000700 1 -- 172.21.15.159:0/2787292180 shutdown_connections 2024-02-28T23:03:55.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:55.949+0000 7fd26f000700 1 -- 172.21.15.159:0/2787292180 wait complete. 2024-02-28T23:03:55.964 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:03:56.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:56 smithi184 ceph-mon[36198]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-28T23:03:56.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:56 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2787292180' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-28T23:03:56.655 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:56 smithi159 ceph-mon[28802]: pgmap v239: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.4 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-28T23:03:56.655 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:56 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2787292180' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-02-28T23:03:57.180 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-02-28T23:03:57.193 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T23:03:57.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.401+0000 7fd8c6a00640 1 -- 172.21.15.159:0/1014580716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c00742e0 msgr2=0x7fd8c0072730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:57.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.401+0000 7fd8c6a00640 1 --2- 172.21.15.159:0/1014580716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c00742e0 0x7fd8c0072730 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4009880 tx=0x7fd8b402bcf0 comp rx=0 tx=0).stop 2024-02-28T23:03:57.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.401+0000 7fd8c6a00640 1 -- 172.21.15.159:0/1014580716 shutdown_connections 2024-02-28T23:03:57.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.401+0000 7fd8c6a00640 1 --2- 172.21.15.159:0/1014580716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c0072d00 0x7fd8c0073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:57.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.401+0000 7fd8c6a00640 1 --2- 172.21.15.159:0/1014580716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c00742e0 0x7fd8c0072730 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:57.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.401+0000 7fd8c6a00640 1 -- 172.21.15.159:0/1014580716 >> 172.21.15.159:0/1014580716 conn(0x7fd8c00fb410 msgr2=0x7fd8c00fd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:57.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.401+0000 7fd8c6a00640 1 -- 172.21.15.159:0/1014580716 shutdown_connections 2024-02-28T23:03:57.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.401+0000 7fd8c6a00640 1 -- 172.21.15.159:0/1014580716 wait complete. 2024-02-28T23:03:57.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.402+0000 7fd8c6a00640 1 Processor -- start 2024-02-28T23:03:57.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.402+0000 7fd8c6a00640 1 -- start start 2024-02-28T23:03:57.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.402+0000 7fd8c6a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c0072d00 0x7fd8c01978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:57.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.402+0000 7fd8c6a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c00742e0 0x7fd8c0197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:57.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.402+0000 7fd8c6a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c01983d0 con 0x7fd8c0072d00 2024-02-28T23:03:57.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.402+0000 7fd8c6a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0198540 con 0x7fd8c00742e0 2024-02-28T23:03:57.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.403+0000 7fd8c5600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c0072d00 0x7fd8c01978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:57.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.403+0000 7fd8c5600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c0072d00 0x7fd8c01978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56474/0 (socket says 172.21.15.159:56474) 2024-02-28T23:03:57.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.403+0000 7fd8c5600640 1 -- 172.21.15.159:0/2780640983 learned_addr learned my addr 172.21.15.159:0/2780640983 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:57.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.403+0000 7fd8c4c00640 1 --2- 172.21.15.159:0/2780640983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c00742e0 0x7fd8c0197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:57.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.403+0000 7fd8c5600640 1 -- 172.21.15.159:0/2780640983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c00742e0 msgr2=0x7fd8c0197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:57.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.403+0000 7fd8c5600640 1 --2- 172.21.15.159:0/2780640983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c00742e0 0x7fd8c0197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:57.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.403+0000 7fd8c5600640 1 -- 172.21.15.159:0/2780640983 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b4009560 con 0x7fd8c0072d00 2024-02-28T23:03:57.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.403+0000 7fd8c5600640 1 --2- 172.21.15.159:0/2780640983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c0072d00 0x7fd8c01978c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4036040 tx=0x7fd8b4004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:57.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.404+0000 7fd8be000640 1 -- 172.21.15.159:0/2780640983 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8b4004520 con 0x7fd8c0072d00 2024-02-28T23:03:57.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.404+0000 7fd8be000640 1 -- 172.21.15.159:0/2780640983 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd8b40054b0 con 0x7fd8c0072d00 2024-02-28T23:03:57.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.404+0000 7fd8be000640 1 -- 172.21.15.159:0/2780640983 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8b4034440 con 0x7fd8c0072d00 2024-02-28T23:03:57.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.404+0000 7fd8c6a00640 1 -- 172.21.15.159:0/2780640983 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c019cf70 con 0x7fd8c0072d00 2024-02-28T23:03:57.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.404+0000 7fd8c6a00640 1 -- 172.21.15.159:0/2780640983 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c019d470 con 0x7fd8c0072d00 2024-02-28T23:03:57.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.405+0000 7fd8c6a00640 1 -- 172.21.15.159:0/2780640983 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c010ae30 con 0x7fd8c0072d00 2024-02-28T23:03:57.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.406+0000 7fd8be000640 1 -- 172.21.15.159:0/2780640983 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fd8b4003880 con 0x7fd8c0072d00 2024-02-28T23:03:57.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.407+0000 7fd8be000640 1 --2- 172.21.15.159:0/2780640983 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd8a806c560 0x7fd8a806ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:57.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.408+0000 7fd8be000640 1 -- 172.21.15.159:0/2780640983 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd8b40add80 con 0x7fd8c0072d00 2024-02-28T23:03:57.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.408+0000 7fd8c4c00640 1 --2- 172.21.15.159:0/2780640983 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd8a806c560 0x7fd8a806ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:57.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.408+0000 7fd8c4c00640 1 --2- 172.21.15.159:0/2780640983 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd8a806c560 0x7fd8a806ea20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac005fd0 tx=0x7fd8ac005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:57.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.412+0000 7fd8be000640 1 -- 172.21.15.159:0/2780640983 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd8b40784e0 con 0x7fd8c0072d00 2024-02-28T23:03:57.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.613+0000 7fd8c6a00640 1 -- 172.21.15.159:0/2780640983 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8c019dbc0 con 0x7fd8c0072d00 2024-02-28T23:03:57.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.615+0000 7fd8be000640 1 -- 172.21.15.159:0/2780640983 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+15203 (secure 0 0 0) 0x7fd8b407bb00 con 0x7fd8c0072d00 2024-02-28T23:03:57.614 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:03:57.614 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":46,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","created":"2024-02-28T22:54:07.259600+0000","modified":"2024-02-28T23:03:41.473741+0000","last_up_change":"2024-02-28T23:01:44.596739+0000","last_in_change":"2024-02-28T23:01:21.082396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T23:00:05.643400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T23:03:21.113072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T23:03:21.891379+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"12a358ec-2348-437f-a587-c75299c13814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6803","nonce":3574200223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6805","nonce":3574200223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6809","nonce":3574200223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3574200223},{"type":"v1","addr":"172.21.15.159:6807","nonce":3574200223}]},"public_addr":"172.21.15.159:6803/3574200223","cluster_addr":"172.21.15.159:6805/3574200223","heartbeat_back_addr":"172.21.15.159:6809/3574200223","heartbeat_front_addr":"172.21.15.159:6807/3574200223","state":["exists","up"]},{"osd":1,"uuid":"34a65dc7-3bd8-4cb5-b61b-e04166f115c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6811","nonce":2108285298}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6813","nonce":2108285298}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6817","nonce":2108285298}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":2108285298},{"type":"v1","addr":"172.21.15.159:6815","nonce":2108285298}]},"public_addr":"172.21.15.159:6811/2108285298","cluster_addr":"172.21.15.159:6813/2108285298","heartbeat_back_addr":"172.21.15.159:6817/2108285298","heartbeat_front_addr":"172.21.15.159:6815/2108285298","state":["exists","up"]},{"osd":2,"uuid":"a712ee56-f8b8-43c4-9f38-33ebe33b7977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6819","nonce":3558816459}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6821","nonce":3558816459}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6825","nonce":3558816459}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":3558816459},{"type":"v1","addr":"172.21.15.159:6823","nonce":3558816459}]},"public_addr":"172.21.15.159:6819/3558816459","cluster_addr":"172.21.15.159:6821/3558816459","heartbeat_back_addr":"172.21.15.159:6825/3558816459","heartbeat_front_addr":"172.21.15.159:6823/3558816459","state":["exists","up"]},{"osd":3,"uuid":"bb2d95db-29e3-4e8d-bcea-ed52ae538c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6801","nonce":3861297213}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6803","nonce":3861297213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6807","nonce":3861297213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":3861297213},{"type":"v1","addr":"172.21.15.184:6805","nonce":3861297213}]},"public_addr":"172.21.15.184:6801/3861297213","cluster_addr":"172.21.15.184:6803/3861297213","heartbeat_back_addr":"172.21.15.184:6807/3861297213","heartbeat_front_addr":"172.21.15.184:6805/3861297213","state":["exists","up"]},{"osd":4,"uuid":"55d22d45-549c-4a55-8a36-7aa785561068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6809","nonce":3952225914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6811","nonce":3952225914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6815","nonce":3952225914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":3952225914},{"type":"v1","addr":"172.21.15.184:6813","nonce":3952225914}]},"public_addr":"172.21.15.184:6809/3952225914","cluster_addr":"172.21.15.184:6811/3952225914","heartbeat_back_addr":"172.21.15.184:6815/3952225914","heartbeat_front_addr":"172.21.15.184:6813/3952225914","state":["exists","up"]},{"osd":5,"uuid":"eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6817","nonce":1171078927}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6819","nonce":1171078927}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6823","nonce":1171078927}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1171078927},{"type":"v1","addr":"172.21.15.184:6821","nonce":1171078927}]},"public_addr":"172.21.15.184:6817/1171078927","cluster_addr":"172.21.15.184:6819/1171078927","heartbeat_back_addr":"172.21.15.184:6823/1171078927","heartbeat_front_addr":"172.21.15.184:6821/1171078927","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:58:47.192772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:59:24.679857+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:03.155438+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:35.629938+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:09.895470+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:43.528444+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.159:0/528876824":"2024-02-29T22:55:32.103959+0000","172.21.15.159:0/3456040694":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/74577353":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/423942112":"2024-02-29T22:54:49.969159+0000","172.21.15.159:6800/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.159:6801/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/3945263774":"2024-02-29T22:57:04.937279+0000","172.21.15.159:6826/1702728557":"2024-02-29T23:03:41.473671+0000","172.21.15.159:0/2053056032":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6800/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6801/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6827/1702728557":"2024-02-29T23:03:41.473671+0000","172.21.15.159:0/3426997920":"2024-02-29T22:55:32.103959+0000","172.21.15.159:0/1337780901":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/2242263974":"2024-02-29T22:57:04.937279+0000","172.21.15.159:6800/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:6801/2559284946":"2024-02-29T22:57:04.937279+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T23:03:57.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.618+0000 7fd8c6a00640 1 -- 172.21.15.159:0/2780640983 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd8a806c560 msgr2=0x7fd8a806ea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:57.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.618+0000 7fd8c6a00640 1 --2- 172.21.15.159:0/2780640983 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd8a806c560 0x7fd8a806ea20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac005fd0 tx=0x7fd8ac005850 comp rx=0 tx=0).stop 2024-02-28T23:03:57.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.618+0000 7fd8c6a00640 1 -- 172.21.15.159:0/2780640983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c0072d00 msgr2=0x7fd8c01978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:57.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.618+0000 7fd8c6a00640 1 --2- 172.21.15.159:0/2780640983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c0072d00 0x7fd8c01978c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4036040 tx=0x7fd8b4004f00 comp rx=0 tx=0).stop 2024-02-28T23:03:57.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.618+0000 7fd8c6a00640 1 -- 172.21.15.159:0/2780640983 shutdown_connections 2024-02-28T23:03:57.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.618+0000 7fd8c6a00640 1 --2- 172.21.15.159:0/2780640983 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd8a806c560 0x7fd8a806ea20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:57.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.618+0000 7fd8c6a00640 1 --2- 172.21.15.159:0/2780640983 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8c00742e0 0x7fd8c0197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:57.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.618+0000 7fd8c6a00640 1 --2- 172.21.15.159:0/2780640983 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8c0072d00 0x7fd8c01978c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:57.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.618+0000 7fd8c6a00640 1 -- 172.21.15.159:0/2780640983 >> 172.21.15.159:0/2780640983 conn(0x7fd8c00fb410 msgr2=0x7fd8c0105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:57.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.619+0000 7fd8c6a00640 1 -- 172.21.15.159:0/2780640983 shutdown_connections 2024-02-28T23:03:57.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.619+0000 7fd8c6a00640 1 -- 172.21.15.159:0/2780640983 wait complete. 2024-02-28T23:03:57.636 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T23:00:05.643400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T23:03:21.113072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T23:03:21.891379+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T23:03:57.636 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T23:03:57.829 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.830+0000 7fa661c00640 1 -- 172.21.15.159:0/3375824302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1012a0 msgr2=0x7fa65c101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:57.829 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.830+0000 7fa661c00640 1 --2- 172.21.15.159:0/3375824302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1012a0 0x7fa65c101720 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa648009880 tx=0x7fa64802bce0 comp rx=0 tx=0).stop 2024-02-28T23:03:57.829 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.830+0000 7fa661c00640 1 -- 172.21.15.159:0/3375824302 shutdown_connections 2024-02-28T23:03:57.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.830+0000 7fa661c00640 1 --2- 172.21.15.159:0/3375824302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1012a0 0x7fa65c101720 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:57.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.830+0000 7fa661c00640 1 --2- 172.21.15.159:0/3375824302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa65c1000b0 0x7fa65c1004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:57.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.830+0000 7fa661c00640 1 -- 172.21.15.159:0/3375824302 >> 172.21.15.159:0/3375824302 conn(0x7fa65c0fb620 msgr2=0x7fa65c0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:57.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.830+0000 7fa661c00640 1 -- 172.21.15.159:0/3375824302 shutdown_connections 2024-02-28T23:03:57.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.830+0000 7fa661c00640 1 -- 172.21.15.159:0/3375824302 wait complete. 2024-02-28T23:03:57.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.831+0000 7fa661c00640 1 Processor -- start 2024-02-28T23:03:57.830 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.831+0000 7fa661c00640 1 -- start start 2024-02-28T23:03:57.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.832+0000 7fa661c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1000b0 0x7fa65c074050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.832+0000 7fa661c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa65c1012a0 0x7fa65c072690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.832+0000 7fa661c00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c072bd0 con 0x7fa65c1000b0 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.832+0000 7fa661c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65c072d40 con 0x7fa65c1012a0 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.832+0000 7fa65aa00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1000b0 0x7fa65c074050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.832+0000 7fa65aa00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1000b0 0x7fa65c074050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:56482/0 (socket says 172.21.15.159:56482) 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.832+0000 7fa65aa00640 1 -- 172.21.15.159:0/3231887374 learned_addr learned my addr 172.21.15.159:0/3231887374 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.832+0000 7fa65a000640 1 --2- 172.21.15.159:0/3231887374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa65c1012a0 0x7fa65c072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.832+0000 7fa65aa00640 1 -- 172.21.15.159:0/3231887374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa65c1012a0 msgr2=0x7fa65c072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.832+0000 7fa65aa00640 1 --2- 172.21.15.159:0/3231887374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa65c1012a0 0x7fa65c072690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.832+0000 7fa65aa00640 1 -- 172.21.15.159:0/3231887374 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa648009560 con 0x7fa65c1000b0 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.833+0000 7fa65aa00640 1 --2- 172.21.15.159:0/3231887374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1000b0 0x7fa65c074050 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00d8d0 tx=0x7fa64c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:57.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.833+0000 7fa653400640 1 -- 172.21.15.159:0/3231887374 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa64c009a30 con 0x7fa65c1000b0 2024-02-28T23:03:57.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.833+0000 7fa653400640 1 -- 172.21.15.159:0/3231887374 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa64c009b90 con 0x7fa65c1000b0 2024-02-28T23:03:57.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.833+0000 7fa661c00640 1 -- 172.21.15.159:0/3231887374 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa65c073020 con 0x7fa65c1000b0 2024-02-28T23:03:57.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.833+0000 7fa653400640 1 -- 172.21.15.159:0/3231887374 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa64c00f680 con 0x7fa65c1000b0 2024-02-28T23:03:57.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.833+0000 7fa661c00640 1 -- 172.21.15.159:0/3231887374 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa65c19d9c0 con 0x7fa65c1000b0 2024-02-28T23:03:57.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.834+0000 7fa661c00640 1 -- 172.21.15.159:0/3231887374 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa65c04e040 con 0x7fa65c1000b0 2024-02-28T23:03:57.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.835+0000 7fa653400640 1 -- 172.21.15.159:0/3231887374 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fa64c009d00 con 0x7fa65c1000b0 2024-02-28T23:03:57.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.836+0000 7fa653400640 1 --2- 172.21.15.159:0/3231887374 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa64006c450 0x7fa64006e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:57.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.836+0000 7fa653400640 1 -- 172.21.15.159:0/3231887374 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa64c08b550 con 0x7fa65c1000b0 2024-02-28T23:03:57.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.836+0000 7fa65a000640 1 --2- 172.21.15.159:0/3231887374 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa64006c450 0x7fa64006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:57.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.837+0000 7fa65a000640 1 --2- 172.21.15.159:0/3231887374 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa64006c450 0x7fa64006e910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa648006010 tx=0x7fa64802cf90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:57.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:57.841+0000 7fa653400640 1 -- 172.21.15.159:0/3231887374 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa64c055e00 con 0x7fa65c1000b0 2024-02-28T23:03:58.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.038+0000 7fa661c00640 1 -- 172.21.15.159:0/3231887374 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa65c19db50 con 0x7fa65c1000b0 2024-02-28T23:03:58.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.039+0000 7fa653400640 1 -- 172.21.15.159:0/3231887374 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa64c059420 con 0x7fa65c1000b0 2024-02-28T23:03:58.037 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 1 2024-02-28T23:03:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.041+0000 7fa661c00640 1 -- 172.21.15.159:0/3231887374 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa64006c450 msgr2=0x7fa64006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.041+0000 7fa661c00640 1 --2- 172.21.15.159:0/3231887374 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa64006c450 0x7fa64006e910 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa648006010 tx=0x7fa64802cf90 comp rx=0 tx=0).stop 2024-02-28T23:03:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.041+0000 7fa661c00640 1 -- 172.21.15.159:0/3231887374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1000b0 msgr2=0x7fa65c074050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.041+0000 7fa661c00640 1 --2- 172.21.15.159:0/3231887374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1000b0 0x7fa65c074050 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa64c00d8d0 tx=0x7fa64c00dd90 comp rx=0 tx=0).stop 2024-02-28T23:03:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.041+0000 7fa661c00640 1 -- 172.21.15.159:0/3231887374 shutdown_connections 2024-02-28T23:03:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.041+0000 7fa661c00640 1 --2- 172.21.15.159:0/3231887374 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa64006c450 0x7fa64006e910 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.041+0000 7fa661c00640 1 --2- 172.21.15.159:0/3231887374 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa65c1012a0 0x7fa65c072690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.041+0000 7fa661c00640 1 --2- 172.21.15.159:0/3231887374 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c1000b0 0x7fa65c074050 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.041+0000 7fa661c00640 1 -- 172.21.15.159:0/3231887374 >> 172.21.15.159:0/3231887374 conn(0x7fa65c0fb620 msgr2=0x7fa65c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.042+0000 7fa661c00640 1 -- 172.21.15.159:0/3231887374 shutdown_connections 2024-02-28T23:03:58.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.042+0000 7fa661c00640 1 -- 172.21.15.159:0/3231887374 wait complete. 2024-02-28T23:03:58.058 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T23:03:58.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.252+0000 7fa473600640 1 -- 172.21.15.159:0/447582224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c072d00 msgr2=0x7fa46c073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:58.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.252+0000 7fa473600640 1 --2- 172.21.15.159:0/447582224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c072d00 0x7fa46c073180 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa458009880 tx=0x7fa45802bce0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.253+0000 7fa473600640 1 -- 172.21.15.159:0/447582224 shutdown_connections 2024-02-28T23:03:58.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.253+0000 7fa473600640 1 --2- 172.21.15.159:0/447582224 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c072d00 0x7fa46c073180 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.253+0000 7fa473600640 1 --2- 172.21.15.159:0/447582224 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa46c0742e0 0x7fa46c072730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.253+0000 7fa473600640 1 -- 172.21.15.159:0/447582224 >> 172.21.15.159:0/447582224 conn(0x7fa46c0fb610 msgr2=0x7fa46c0fda50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:58.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.253+0000 7fa473600640 1 -- 172.21.15.159:0/447582224 shutdown_connections 2024-02-28T23:03:58.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.253+0000 7fa473600640 1 -- 172.21.15.159:0/447582224 wait complete. 2024-02-28T23:03:58.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.254+0000 7fa473600640 1 Processor -- start 2024-02-28T23:03:58.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.254+0000 7fa473600640 1 -- start start 2024-02-28T23:03:58.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.254+0000 7fa473600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c072d00 0x7fa46c19bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:58.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.254+0000 7fa473600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa46c0742e0 0x7fa46c19c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:58.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.254+0000 7fa473600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c19cab0 con 0x7fa46c072d00 2024-02-28T23:03:58.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.254+0000 7fa473600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c19cc20 con 0x7fa46c0742e0 2024-02-28T23:03:58.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.254+0000 7fa470c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c072d00 0x7fa46c19bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:58.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.254+0000 7fa470c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c072d00 0x7fa46c19bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35106/0 (socket says 172.21.15.159:35106) 2024-02-28T23:03:58.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.254+0000 7fa470c00640 1 -- 172.21.15.159:0/2234795189 learned_addr learned my addr 172.21.15.159:0/2234795189 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.255+0000 7fa46be00640 1 --2- 172.21.15.159:0/2234795189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa46c0742e0 0x7fa46c19c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.255+0000 7fa470c00640 1 -- 172.21.15.159:0/2234795189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa46c0742e0 msgr2=0x7fa46c19c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.255+0000 7fa470c00640 1 --2- 172.21.15.159:0/2234795189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa46c0742e0 0x7fa46c19c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.255+0000 7fa470c00640 1 -- 172.21.15.159:0/2234795189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa458009560 con 0x7fa46c072d00 2024-02-28T23:03:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.255+0000 7fa470c00640 1 --2- 172.21.15.159:0/2234795189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c072d00 0x7fa46c19bfa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa46000d6f0 tx=0x7fa46000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.255+0000 7fa469600640 1 -- 172.21.15.159:0/2234795189 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa460009a30 con 0x7fa46c072d00 2024-02-28T23:03:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.255+0000 7fa469600640 1 -- 172.21.15.159:0/2234795189 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa4600054d0 con 0x7fa46c072d00 2024-02-28T23:03:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.255+0000 7fa473600640 1 -- 172.21.15.159:0/2234795189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c1a16b0 con 0x7fa46c072d00 2024-02-28T23:03:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.255+0000 7fa469600640 1 -- 172.21.15.159:0/2234795189 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa460010460 con 0x7fa46c072d00 2024-02-28T23:03:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.255+0000 7fa473600640 1 -- 172.21.15.159:0/2234795189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c1a1c10 con 0x7fa46c072d00 2024-02-28T23:03:58.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.257+0000 7fa473600640 1 -- 172.21.15.159:0/2234795189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c10f410 con 0x7fa46c072d00 2024-02-28T23:03:58.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.257+0000 7fa469600640 1 -- 172.21.15.159:0/2234795189 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fa460009b90 con 0x7fa46c072d00 2024-02-28T23:03:58.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.258+0000 7fa469600640 1 --2- 172.21.15.159:0/2234795189 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa45406c450 0x7fa45406e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:58.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.258+0000 7fa469600640 1 -- 172.21.15.159:0/2234795189 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa46008b4c0 con 0x7fa46c072d00 2024-02-28T23:03:58.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.259+0000 7fa46be00640 1 --2- 172.21.15.159:0/2234795189 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa45406c450 0x7fa45406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:58.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.259+0000 7fa46be00640 1 --2- 172.21.15.159:0/2234795189 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa45406c450 0x7fa45406e910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa45802c7c0 tx=0x7fa458005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:58.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.263+0000 7fa469600640 1 -- 172.21.15.159:0/2234795189 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa460055ba0 con 0x7fa46c072d00 2024-02-28T23:03:58.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:57 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:58.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:57 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:58.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:57 smithi184 ceph-mon[36198]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-28T23:03:58.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:57 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2780640983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:03:58.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.448+0000 7fa473600640 1 -- 172.21.15.159:0/2234795189 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fa46c1a1e30 con 0x7fa46c072d00 2024-02-28T23:03:58.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.449+0000 7fa469600640 1 -- 172.21.15.159:0/2234795189 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7fa4600591c0 con 0x7fa46c072d00 2024-02-28T23:03:58.447 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-02-28T23:03:58.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.452+0000 7fa473600640 1 -- 172.21.15.159:0/2234795189 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa45406c450 msgr2=0x7fa45406e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:58.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.452+0000 7fa473600640 1 --2- 172.21.15.159:0/2234795189 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa45406c450 0x7fa45406e910 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa45802c7c0 tx=0x7fa458005fd0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.452+0000 7fa473600640 1 -- 172.21.15.159:0/2234795189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c072d00 msgr2=0x7fa46c19bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:58.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.452+0000 7fa473600640 1 --2- 172.21.15.159:0/2234795189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c072d00 0x7fa46c19bfa0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa46000d6f0 tx=0x7fa46000dbb0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.452+0000 7fa473600640 1 -- 172.21.15.159:0/2234795189 shutdown_connections 2024-02-28T23:03:58.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.452+0000 7fa473600640 1 --2- 172.21.15.159:0/2234795189 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa45406c450 0x7fa45406e910 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.452+0000 7fa473600640 1 --2- 172.21.15.159:0/2234795189 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa46c0742e0 0x7fa46c19c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.452+0000 7fa473600640 1 --2- 172.21.15.159:0/2234795189 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c072d00 0x7fa46c19bfa0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.452+0000 7fa473600640 1 -- 172.21.15.159:0/2234795189 >> 172.21.15.159:0/2234795189 conn(0x7fa46c0fb610 msgr2=0x7fa46c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:58.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.452+0000 7fa473600640 1 -- 172.21.15.159:0/2234795189 shutdown_connections 2024-02-28T23:03:58.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.452+0000 7fa473600640 1 -- 172.21.15.159:0/2234795189 wait complete. 2024-02-28T23:03:58.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:57 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:58.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:57 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:03:58.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:57 smithi159 ceph-mon[28802]: pgmap v240: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-28T23:03:58.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:57 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2780640983' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:03:58.467 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T23:03:58.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.654+0000 7ff0c2600640 1 -- 172.21.15.159:0/766286755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0bc0ffeb0 msgr2=0x7ff0bc1002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:58.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.654+0000 7ff0c2600640 1 --2- 172.21.15.159:0/766286755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0bc0ffeb0 0x7ff0bc1002d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009880 tx=0x7ff0a802bce0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.655+0000 7ff0c2600640 1 -- 172.21.15.159:0/766286755 shutdown_connections 2024-02-28T23:03:58.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.655+0000 7ff0c2600640 1 --2- 172.21.15.159:0/766286755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0bc101090 0x7ff0bc101510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.655+0000 7ff0c2600640 1 --2- 172.21.15.159:0/766286755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0bc0ffeb0 0x7ff0bc1002d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.655+0000 7ff0c2600640 1 -- 172.21.15.159:0/766286755 >> 172.21.15.159:0/766286755 conn(0x7ff0bc0fb470 msgr2=0x7ff0bc0fd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:58.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.655+0000 7ff0c2600640 1 -- 172.21.15.159:0/766286755 shutdown_connections 2024-02-28T23:03:58.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.655+0000 7ff0c2600640 1 -- 172.21.15.159:0/766286755 wait complete. 2024-02-28T23:03:58.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.656+0000 7ff0c2600640 1 Processor -- start 2024-02-28T23:03:58.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.656+0000 7ff0c2600640 1 -- start start 2024-02-28T23:03:58.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.656+0000 7ff0c2600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0bc0ffeb0 0x7ff0bc197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:58.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.656+0000 7ff0c2600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0bc101090 0x7ff0bc197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:58.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.656+0000 7ff0c2600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc198470 con 0x7ff0bc101090 2024-02-28T23:03:58.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.656+0000 7ff0c2600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0bc1985e0 con 0x7ff0bc0ffeb0 2024-02-28T23:03:58.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.656+0000 7ff0bbe00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0bc101090 0x7ff0bc197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:58.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.656+0000 7ff0bbe00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0bc101090 0x7ff0bc197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35128/0 (socket says 172.21.15.159:35128) 2024-02-28T23:03:58.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.656+0000 7ff0bbe00640 1 -- 172.21.15.159:0/146339041 learned_addr learned my addr 172.21.15.159:0/146339041 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:58.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.657+0000 7ff0c1200640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0bc0ffeb0 0x7ff0bc197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:58.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.657+0000 7ff0bbe00640 1 -- 172.21.15.159:0/146339041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0bc0ffeb0 msgr2=0x7ff0bc197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:58.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.657+0000 7ff0bbe00640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0bc0ffeb0 0x7ff0bc197960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.657+0000 7ff0bbe00640 1 -- 172.21.15.159:0/146339041 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a8009560 con 0x7ff0bc101090 2024-02-28T23:03:58.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.657+0000 7ff0c1200640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0bc0ffeb0 0x7ff0bc197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:03:58.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.657+0000 7ff0bbe00640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0bc101090 0x7ff0bc197ea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00c810 tx=0x7ff0ac00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:58.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.657+0000 7ff0b9600640 1 -- 172.21.15.159:0/146339041 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0ac0041f0 con 0x7ff0bc101090 2024-02-28T23:03:58.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.657+0000 7ff0c2600640 1 -- 172.21.15.159:0/146339041 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0bc19d070 con 0x7ff0bc101090 2024-02-28T23:03:58.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.657+0000 7ff0b9600640 1 -- 172.21.15.159:0/146339041 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff0ac007e60 con 0x7ff0bc101090 2024-02-28T23:03:58.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.657+0000 7ff0b9600640 1 -- 172.21.15.159:0/146339041 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0ac0049d0 con 0x7ff0bc101090 2024-02-28T23:03:58.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.657+0000 7ff0c2600640 1 -- 172.21.15.159:0/146339041 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0bc19d5d0 con 0x7ff0bc101090 2024-02-28T23:03:58.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.659+0000 7ff0c2600640 1 -- 172.21.15.159:0/146339041 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0bc105170 con 0x7ff0bc101090 2024-02-28T23:03:58.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.660+0000 7ff0b9600640 1 -- 172.21.15.159:0/146339041 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7ff0ac0079b0 con 0x7ff0bc101090 2024-02-28T23:03:58.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.660+0000 7ff0b9600640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff0a006c450 0x7ff0a006e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:58.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.660+0000 7ff0b9600640 1 -- 172.21.15.159:0/146339041 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff0ac08b790 con 0x7ff0bc101090 2024-02-28T23:03:58.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.661+0000 7ff0c1200640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff0a006c450 0x7ff0a006e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:58.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.661+0000 7ff0c1200640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff0a006c450 0x7ff0a006e910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8036040 tx=0x7ff0a8005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:58.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.666+0000 7ff0b9600640 1 -- 172.21.15.159:0/146339041 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff0ac055e70 con 0x7ff0bc101090 2024-02-28T23:03:58.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.860+0000 7ff0c2600640 1 -- 172.21.15.159:0/146339041 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7ff0bc02c4e0 con 0x7ff0bc101090 2024-02-28T23:03:58.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.861+0000 7ff0b9600640 1 -- 172.21.15.159:0/146339041 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v46) v1 ==== 107+0+11 (secure 0 0 0) 0x7ff0ac059490 con 0x7ff0bc101090 2024-02-28T23:03:58.859 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-02-28T23:03:58.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.863+0000 7ff0c2600640 1 -- 172.21.15.159:0/146339041 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff0a006c450 msgr2=0x7ff0a006e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:58.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.863+0000 7ff0c2600640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff0a006c450 0x7ff0a006e910 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8036040 tx=0x7ff0a8005fd0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.863+0000 7ff0c2600640 1 -- 172.21.15.159:0/146339041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0bc101090 msgr2=0x7ff0bc197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:58.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.863+0000 7ff0c2600640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0bc101090 0x7ff0bc197ea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac00c810 tx=0x7ff0ac00ccd0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.863+0000 7ff0c2600640 1 -- 172.21.15.159:0/146339041 shutdown_connections 2024-02-28T23:03:58.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.864+0000 7ff0c2600640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff0a006c450 0x7ff0a006e910 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.864+0000 7ff0c2600640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0bc101090 0x7ff0bc197ea0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.864+0000 7ff0c2600640 1 --2- 172.21.15.159:0/146339041 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0bc0ffeb0 0x7ff0bc197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:58.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.864+0000 7ff0c2600640 1 -- 172.21.15.159:0/146339041 >> 172.21.15.159:0/146339041 conn(0x7ff0bc0fb470 msgr2=0x7ff0bc102340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:58.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.864+0000 7ff0c2600640 1 -- 172.21.15.159:0/146339041 shutdown_connections 2024-02-28T23:03:58.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:58.864+0000 7ff0c2600640 1 -- 172.21.15.159:0/146339041 wait complete. 2024-02-28T23:03:58.880 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-28T23:03:59.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.108+0000 7fad50600640 1 -- 172.21.15.159:0/871590364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad48100b40 msgr2=0x7fad48102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:59.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.108+0000 7fad50600640 1 --2- 172.21.15.159:0/871590364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad48100b40 0x7fad48102f30 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fad3c0098b0 tx=0x7fad3c02bcd0 comp rx=0 tx=0).stop 2024-02-28T23:03:59.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.108+0000 7fad50600640 1 -- 172.21.15.159:0/871590364 shutdown_connections 2024-02-28T23:03:59.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.108+0000 7fad50600640 1 --2- 172.21.15.159:0/871590364 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48103470 0x7fad48105860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:59.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.108+0000 7fad50600640 1 --2- 172.21.15.159:0/871590364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad48100b40 0x7fad48102f30 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:59.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.108+0000 7fad50600640 1 -- 172.21.15.159:0/871590364 >> 172.21.15.159:0/871590364 conn(0x7fad480fa530 msgr2=0x7fad480fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:59.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.108+0000 7fad50600640 1 -- 172.21.15.159:0/871590364 shutdown_connections 2024-02-28T23:03:59.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.108+0000 7fad50600640 1 -- 172.21.15.159:0/871590364 wait complete. 2024-02-28T23:03:59.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.109+0000 7fad50600640 1 Processor -- start 2024-02-28T23:03:59.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.109+0000 7fad50600640 1 -- start start 2024-02-28T23:03:59.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad50600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad48100b40 0x7fad48195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:59.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad50600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48103470 0x7fad48195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:59.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad50600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad48196470 con 0x7fad48100b40 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad50600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad481965e0 con 0x7fad48103470 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad4dc00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad48100b40 0x7fad48195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad4dc00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad48100b40 0x7fad48195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35142/0 (socket says 172.21.15.159:35142) 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad4dc00640 1 -- 172.21.15.159:0/598448629 learned_addr learned my addr 172.21.15.159:0/598448629 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad4d200640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48103470 0x7fad48195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad4dc00640 1 -- 172.21.15.159:0/598448629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48103470 msgr2=0x7fad48195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad4dc00640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48103470 0x7fad48195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad4dc00640 1 -- 172.21.15.159:0/598448629 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad3c009560 con 0x7fad48100b40 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.110+0000 7fad4d200640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48103470 0x7fad48195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.111+0000 7fad4dc00640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad48100b40 0x7fad48195960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fad3c02c210 tx=0x7fad3c004f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.111+0000 7fad46000640 1 -- 172.21.15.159:0/598448629 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad3c0044a0 con 0x7fad48100b40 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.111+0000 7fad46000640 1 -- 172.21.15.159:0/598448629 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fad3c0054b0 con 0x7fad48100b40 2024-02-28T23:03:59.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.111+0000 7fad50600640 1 -- 172.21.15.159:0/598448629 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad4819b010 con 0x7fad48100b40 2024-02-28T23:03:59.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.111+0000 7fad46000640 1 -- 172.21.15.159:0/598448629 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad3c03e680 con 0x7fad48100b40 2024-02-28T23:03:59.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.111+0000 7fad50600640 1 -- 172.21.15.159:0/598448629 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad4819b570 con 0x7fad48100b40 2024-02-28T23:03:59.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.112+0000 7fad50600640 1 -- 172.21.15.159:0/598448629 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad48108e50 con 0x7fad48100b40 2024-02-28T23:03:59.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.113+0000 7fad46000640 1 -- 172.21.15.159:0/598448629 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fad3c005000 con 0x7fad48100b40 2024-02-28T23:03:59.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.114+0000 7fad46000640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fad3006c510 0x7fad3006e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:03:59.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.114+0000 7fad46000640 1 -- 172.21.15.159:0/598448629 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fad3c0ae720 con 0x7fad48100b40 2024-02-28T23:03:59.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.114+0000 7fad4d200640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fad3006c510 0x7fad3006e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:03:59.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.115+0000 7fad4d200640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fad3006c510 0x7fad3006e9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad48196e70 tx=0x7fad34005d30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:03:59.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.118+0000 7fad46000640 1 -- 172.21.15.159:0/598448629 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fad3c078ea0 con 0x7fad48100b40 2024-02-28T23:03:59.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:58 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3231887374' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T23:03:59.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:58 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2234795189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T23:03:59.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:03:58 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/146339041' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T23:03:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.371+0000 7fad50600640 1 -- 172.21.15.159:0/598448629 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad4819b700 con 0x7fad48100b40 2024-02-28T23:03:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.373+0000 7fad46000640 1 -- 172.21.15.159:0/598448629 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4756 (secure 0 0 0) 0x7fad3c07c4c0 con 0x7fad48100b40 2024-02-28T23:03:59.371 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:03:59.371 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24269,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2280748719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2280748719},{"type":"v1","addr":"172.21.15.184:6825","nonce":2280748719}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":18,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:03:44.517625+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi159.azxrct","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.159:6829/455979918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":455979918},{"type":"v1","addr":"172.21.15.159:6829","nonce":455979918}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14484":{"gid":14484,"name":"cephfs.smithi159.mbaqic","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6827/2161666204","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":2161666204},{"type":"v1","addr":"172.21.15.159:6827","nonce":2161666204}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:03:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:03:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.375+0000 7fad50600640 1 -- 172.21.15.159:0/598448629 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fad3006c510 msgr2=0x7fad3006e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.375+0000 7fad50600640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fad3006c510 0x7fad3006e9d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fad48196e70 tx=0x7fad34005d30 comp rx=0 tx=0).stop 2024-02-28T23:03:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.375+0000 7fad50600640 1 -- 172.21.15.159:0/598448629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad48100b40 msgr2=0x7fad48195960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:03:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.375+0000 7fad50600640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad48100b40 0x7fad48195960 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fad3c02c210 tx=0x7fad3c004f00 comp rx=0 tx=0).stop 2024-02-28T23:03:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.375+0000 7fad50600640 1 -- 172.21.15.159:0/598448629 shutdown_connections 2024-02-28T23:03:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.375+0000 7fad50600640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fad3006c510 0x7fad3006e9d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.375+0000 7fad50600640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad48103470 0x7fad48195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.375+0000 7fad50600640 1 --2- 172.21.15.159:0/598448629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad48100b40 0x7fad48195960 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:03:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.375+0000 7fad50600640 1 -- 172.21.15.159:0/598448629 >> 172.21.15.159:0/598448629 conn(0x7fad480fa530 msgr2=0x7fad480fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:03:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.376+0000 7fad50600640 1 -- 172.21.15.159:0/598448629 shutdown_connections 2024-02-28T23:03:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:03:59.376+0000 7fad50600640 1 -- 172.21.15.159:0/598448629 wait complete. 2024-02-28T23:03:59.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:58 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3231887374' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T23:03:59.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:58 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2234795189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T23:03:59.379 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:03:58 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/146339041' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T23:03:59.393 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 1, 'flags': 50} 2024-02-28T23:03:59.393 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-02-28T23:03:59.419 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-02-28T23:03:59.419 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-02-28T23:03:59.420 INFO:tasks.ceph_fuse:client.0 config is {} 2024-02-28T23:03:59.420 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-28T23:03:59.420 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-28T23:03:59.420 INFO:tasks.ceph_fuse:client.1 config is {} 2024-02-28T23:03:59.420 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-02-28T23:03:59.420 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-28T23:03:59.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:03:59.420 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2024-02-28T23:03:59.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:03:59.480 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link delete ceph-brx 2024-02-28T23:03:59.577 INFO:teuthology.orchestra.run.smithi184.stderr:Cannot find device "ceph-brx" 2024-02-28T23:03:59.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T23:03:59.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:03:59.580 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-02-28T23:03:59.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:03:59.627 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2024-02-28T23:03:59.752 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2024-02-28T23:03:59.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T23:03:59.756 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-02-28T23:03:59.756 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph fs ls 2024-02-28T23:04:00.005 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:00 smithi159 ceph-mon[28802]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-28T23:04:00.005 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:00 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/598448629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T23:04:00.156 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:04:00.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:00 smithi184 ceph-mon[36198]: pgmap v241: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 7.0 KiB/s rd, 0 B/s wr, 7 op/s 2024-02-28T23:04:00.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:00 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/598448629' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T23:04:02.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:02 smithi159 ceph-mon[28802]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s rd, 4 op/s 2024-02-28T23:04:02.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:02 smithi184 ceph-mon[36198]: pgmap v242: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s rd, 4 op/s 2024-02-28T23:04:03.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.031+0000 7fab1be00700 1 -- 172.21.15.159:0/1084758952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab14068670 msgr2=0x7fab14068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:03.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.031+0000 7fab1be00700 1 --2- 172.21.15.159:0/1084758952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab14068670 0x7fab14068a50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fab08009910 tx=0x7fab08009c20 comp rx=0 tx=0).stop 2024-02-28T23:04:03.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.032+0000 7fab1be00700 1 -- 172.21.15.159:0/1084758952 shutdown_connections 2024-02-28T23:04:03.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.032+0000 7fab1be00700 1 --2- 172.21.15.159:0/1084758952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab14069020 0x7fab14105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:03.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.032+0000 7fab1be00700 1 --2- 172.21.15.159:0/1084758952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab14068670 0x7fab14068a50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:03.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.032+0000 7fab1be00700 1 -- 172.21.15.159:0/1084758952 >> 172.21.15.159:0/1084758952 conn(0x7fab140755a0 msgr2=0x7fab140759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:04:03.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.032+0000 7fab1be00700 1 -- 172.21.15.159:0/1084758952 shutdown_connections 2024-02-28T23:04:03.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.032+0000 7fab1be00700 1 -- 172.21.15.159:0/1084758952 wait complete. 2024-02-28T23:04:03.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.033+0000 7fab1be00700 1 Processor -- start 2024-02-28T23:04:03.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.033+0000 7fab1be00700 1 -- start start 2024-02-28T23:04:03.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.033+0000 7fab1be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab14068670 0x7fab1419c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:03.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.033+0000 7fab1be00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab14069020 0x7fab1419ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:03.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.033+0000 7fab1be00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1419d0e0 con 0x7fab14068670 2024-02-28T23:04:03.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.033+0000 7fab1be00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab14196590 con 0x7fab14069020 2024-02-28T23:04:03.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.034+0000 7fab19400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab14068670 0x7fab1419c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:03.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.034+0000 7fab19400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab14068670 0x7fab1419c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35164/0 (socket says 172.21.15.159:35164) 2024-02-28T23:04:03.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.034+0000 7fab19400700 1 -- 172.21.15.159:0/4120368155 learned_addr learned my addr 172.21.15.159:0/4120368155 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:04:03.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.034+0000 7fab18a00700 1 --2- 172.21.15.159:0/4120368155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab14069020 0x7fab1419ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:03.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.034+0000 7fab19400700 1 -- 172.21.15.159:0/4120368155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab14069020 msgr2=0x7fab1419ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:03.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.034+0000 7fab19400700 1 --2- 172.21.15.159:0/4120368155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab14069020 0x7fab1419ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:03.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.034+0000 7fab19400700 1 -- 172.21.15.159:0/4120368155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab080095f0 con 0x7fab14068670 2024-02-28T23:04:03.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.034+0000 7fab19400700 1 --2- 172.21.15.159:0/4120368155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab14068670 0x7fab1419c510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab080092e0 tx=0x7fab0800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:03.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.035+0000 7fab12000700 1 -- 172.21.15.159:0/4120368155 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab0801d070 con 0x7fab14068670 2024-02-28T23:04:03.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.035+0000 7fab12000700 1 -- 172.21.15.159:0/4120368155 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab08004fa0 con 0x7fab14068670 2024-02-28T23:04:03.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.035+0000 7fab1be00700 1 -- 172.21.15.159:0/4120368155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab14196810 con 0x7fab14068670 2024-02-28T23:04:03.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.035+0000 7fab12000700 1 -- 172.21.15.159:0/4120368155 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab0800f460 con 0x7fab14068670 2024-02-28T23:04:03.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.035+0000 7fab1be00700 1 -- 172.21.15.159:0/4120368155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab14196d00 con 0x7fab14068670 2024-02-28T23:04:03.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.036+0000 7fab1be00700 1 -- 172.21.15.159:0/4120368155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab14109130 con 0x7fab14068670 2024-02-28T23:04:03.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.037+0000 7fab12000700 1 -- 172.21.15.159:0/4120368155 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fab08022810 con 0x7fab14068670 2024-02-28T23:04:03.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.038+0000 7fab12000700 1 --2- 172.21.15.159:0/4120368155 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7faafc06c4e0 0x7faafc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:03.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.038+0000 7fab12000700 1 -- 172.21.15.159:0/4120368155 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fab0808cc70 con 0x7fab14068670 2024-02-28T23:04:03.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.038+0000 7fab18a00700 1 --2- 172.21.15.159:0/4120368155 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7faafc06c4e0 0x7faafc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:03.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.039+0000 7fab18a00700 1 --2- 172.21.15.159:0/4120368155 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7faafc06c4e0 0x7faafc06e9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fab00005950 tx=0x7fab000058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:03.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.042+0000 7fab12000700 1 -- 172.21.15.159:0/4120368155 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fab0805b0d0 con 0x7fab14068670 2024-02-28T23:04:03.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.300+0000 7fab1be00700 1 -- 172.21.15.159:0/4120368155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fab1404ea90 con 0x7fab14068670 2024-02-28T23:04:03.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.302+0000 7fab12000700 1 -- 172.21.15.159:0/4120368155 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7fab0805ac60 con 0x7fab14068670 2024-02-28T23:04:03.301 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-28T23:04:03.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.306+0000 7fab1be00700 1 -- 172.21.15.159:0/4120368155 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7faafc06c4e0 msgr2=0x7faafc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:03.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.306+0000 7fab1be00700 1 --2- 172.21.15.159:0/4120368155 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7faafc06c4e0 0x7faafc06e9a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fab00005950 tx=0x7fab000058e0 comp rx=0 tx=0).stop 2024-02-28T23:04:03.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.306+0000 7fab1be00700 1 -- 172.21.15.159:0/4120368155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab14068670 msgr2=0x7fab1419c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:03.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.306+0000 7fab1be00700 1 --2- 172.21.15.159:0/4120368155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab14068670 0x7fab1419c510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fab080092e0 tx=0x7fab0800be20 comp rx=0 tx=0).stop 2024-02-28T23:04:03.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.306+0000 7fab1be00700 1 -- 172.21.15.159:0/4120368155 shutdown_connections 2024-02-28T23:04:03.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.306+0000 7fab1be00700 1 --2- 172.21.15.159:0/4120368155 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7faafc06c4e0 0x7faafc06e9a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:03.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.306+0000 7fab1be00700 1 --2- 172.21.15.159:0/4120368155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab14068670 0x7fab1419c510 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:03.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.306+0000 7fab1be00700 1 --2- 172.21.15.159:0/4120368155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab14069020 0x7fab1419ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:03.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.306+0000 7fab1be00700 1 -- 172.21.15.159:0/4120368155 >> 172.21.15.159:0/4120368155 conn(0x7fab140755a0 msgr2=0x7fab140fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:04:03.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.306+0000 7fab1be00700 1 -- 172.21.15.159:0/4120368155 shutdown_connections 2024-02-28T23:04:03.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:03.306+0000 7fab1be00700 1 -- 172.21.15.159:0/4120368155 wait complete. 2024-02-28T23:04:03.714 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:03 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:04:03.714 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:03 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:04:03.714 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:03 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:04:03.715 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:03 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:04:03.715 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:03 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:04:03.715 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:03 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/4120368155' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T23:04:03.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:03 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:04:03.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:03 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:04:03.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:03 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:04:03.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:03 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:04:03.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:03 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:04:03.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:03 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/4120368155' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T23:04:04.139 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-28T23:04:04.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-28T23:04:04.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2024-02-28T23:04:04.139 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-02-28T23:04:04.139 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-02-28T23:04:04.139 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-28T23:04:04.139 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-28T23:04:04.140 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-28T23:04:04.140 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-02-28T23:04:04.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:04.140 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2024-02-28T23:04:04.194 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-28T23:04:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-28T23:04:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2024-02-28T23:04:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-02-28T23:04:04.194 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-28T23:04:04.195 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41974sec preferred_lft 41974sec 2024-02-28T23:04:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2024-02-28T23:04:04.196 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-02-28T23:04:04.197 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-28T23:04:04.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:04.197 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2024-02-28T23:04:04.197 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-02-28T23:04:04.197 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add name ceph-brx type bridge 2024-02-28T23:04:04.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr flush dev ceph-brx 2024-02-28T23:04:04.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set ceph-brx up 2024-02-28T23:04:04.198 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-28T23:04:04.198 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-02-28T23:04:04.651 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:04.651 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-28T23:04:04.688 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:04 smithi159 ceph-mon[28802]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:04:04.732 INFO:teuthology.orchestra.run.smithi159.stdout:1 2024-02-28T23:04:04.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:04.736 DEBUG:teuthology.orchestra.run.smithi159:> route 2024-02-28T23:04:04.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:04 smithi184 ceph-mon[36198]: pgmap v243: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:04:04.856 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2024-02-28T23:04:04.856 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-28T23:04:04.856 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-28T23:04:04.856 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-28T23:04:04.856 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-28T23:04:04.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:04.857 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2024-02-28T23:04:04.857 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-02-28T23:04:04.858 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-28T23:04:04.858 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-28T23:04:04.858 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-28T23:04:04.858 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-02-28T23:04:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:04:05.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:05.602 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-02-28T23:04:05.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:05.659 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2024-02-28T23:04:05.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:05.714 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2024-02-28T23:04:05.714 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-02-28T23:04:05.714 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T23:04:05.714 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-02-28T23:04:05.715 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-02-28T23:04:05.839 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-02-28T23:04:05.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:05.840 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2024-02-28T23:04:05.840 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-02-28T23:04:05.840 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-02-28T23:04:05.840 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-28T23:04:05.840 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-02-28T23:04:05.840 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-02-28T23:04:05.840 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-02-28T23:04:05.840 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-02-28T23:04:05.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:04:06.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:06.117 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec bash -c ' 2024-02-28T23:04:06.118 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-02-28T23:04:06.118 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2024-02-28T23:04:06.118 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.0 master ceph-brx 2024-02-28T23:04:06.118 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-02-28T23:04:06.271 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-02-28T23:04:06.271 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T23:04:06.272 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-02-28T23:04:06.316 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-02-28T23:04:06.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T23:04:06.317 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-02-28T23:04:06.410 DEBUG:teuthology.orchestra.run.smithi159:> sudo modprobe fuse 2024-02-28T23:04:06.471 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:06 smithi159 ceph-mon[28802]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:04:06.503 DEBUG:teuthology.orchestra.run.smithi159:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T23:04:06.556 INFO:teuthology.orchestra.run.smithi159.stdout:/proc 2024-02-28T23:04:06.556 INFO:teuthology.orchestra.run.smithi159.stdout:/sys 2024-02-28T23:04:06.556 INFO:teuthology.orchestra.run.smithi159.stdout:/dev 2024-02-28T23:04:06.556 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/security 2024-02-28T23:04:06.556 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/shm 2024-02-28T23:04:06.556 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/pts 2024-02-28T23:04:06.556 INFO:teuthology.orchestra.run.smithi159.stdout:/run 2024-02-28T23:04:06.557 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/cgroup 2024-02-28T23:04:06.557 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/pstore 2024-02-28T23:04:06.557 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/bpf 2024-02-28T23:04:06.557 INFO:teuthology.orchestra.run.smithi159.stdout:/ 2024-02-28T23:04:06.557 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/selinux 2024-02-28T23:04:06.557 INFO:teuthology.orchestra.run.smithi159.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:06.557 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/mqueue 2024-02-28T23:04:06.557 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/hugepages 2024-02-28T23:04:06.557 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/debug 2024-02-28T23:04:06.557 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/tracing 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/fuse/connections 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/config 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/run/user/1000 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/238179a05aec9254cb8337f898de54c4e394e15fc9a472366b2074ef26a9aea6/merged 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/f3015e0307c81a7530e8ee5c854deb511a74d7adac160293915a419ede73c62a/merged 2024-02-28T23:04:06.558 INFO:teuthology.orchestra.run.smithi159.stdout:/run/user/0 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/d14198c543eaf4ec825c3ece10bb481d12697de5e6fdcea615426adf4255062b/merged 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/60128f7c0f71ba0557b1019534e285b4f99679e498131899bdda36b2015f4d49/merged 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/0038b80c98e4946fdea952c4af94489615abdaf0fa0d01a02eede8b183da4bd9/merged 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/e14c6e84ec267f866759b6c20a81490771fb22994dbf4a825bed3d22c88e0d79/merged 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/8fe58fa8e82061faf89323565a1f13e14f004cbb24422d63cc2a9683f1612084/merged 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/5ffd8cb7758bf52ee6c7dfe922696286362da6bf01fa9c1edda4f91c9df1908b/merged 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/761e00f3903f937873fa34370c2d037c37961943dbcd55a0832d69dd5ad36745/merged 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/d29ab0d1c809645fc981bcbaf159fcc250dae88a9fae8e0faecfcf7f510607b0/merged 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/27470e821a86941595ab09a68c87f59787b6f7d52ac8c631716f25a0a5359556/merged 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/b6f72cebb106093a26c9fabe5974fae6a4cba8c5796fad3c8e5176954244141c/merged 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/dd9eedd3c77cc392bc8788d6a47e13c0f0e6cb50defc250a753911f9e19933e5/merged 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns 2024-02-28T23:04:06.559 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T23:04:06.560 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T23:04:06.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:06.561 DEBUG:teuthology.orchestra.run.smithi159:> ls /sys/fs/fuse/connections 2024-02-28T23:04:06.608 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-28T23:04:06.608 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-02-28T23:04:06.613 DEBUG:teuthology.orchestra.run.smithi159:> sudo modprobe fuse 2024-02-28T23:04:06.687 DEBUG:teuthology.orchestra.run.smithi159:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T23:04:06.734 INFO:teuthology.orchestra.run.smithi159.stdout:/proc 2024-02-28T23:04:06.734 INFO:teuthology.orchestra.run.smithi159.stdout:/sys 2024-02-28T23:04:06.735 INFO:teuthology.orchestra.run.smithi159.stdout:/dev 2024-02-28T23:04:06.735 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/security 2024-02-28T23:04:06.735 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/shm 2024-02-28T23:04:06.735 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/pts 2024-02-28T23:04:06.735 INFO:teuthology.orchestra.run.smithi159.stdout:/run 2024-02-28T23:04:06.735 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/cgroup 2024-02-28T23:04:06.735 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/pstore 2024-02-28T23:04:06.735 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/bpf 2024-02-28T23:04:06.735 INFO:teuthology.orchestra.run.smithi159.stdout:/ 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/selinux 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/mqueue 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/hugepages 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/debug 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/tracing 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/fuse/connections 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/config 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T23:04:06.736 INFO:teuthology.orchestra.run.smithi159.stdout:/run/user/1000 2024-02-28T23:04:06.737 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph 2024-02-28T23:04:06.737 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay 2024-02-28T23:04:06.737 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/238179a05aec9254cb8337f898de54c4e394e15fc9a472366b2074ef26a9aea6/merged 2024-02-28T23:04:06.737 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/f3015e0307c81a7530e8ee5c854deb511a74d7adac160293915a419ede73c62a/merged 2024-02-28T23:04:06.737 INFO:teuthology.orchestra.run.smithi159.stdout:/run/user/0 2024-02-28T23:04:06.737 INFO:teuthology.orchestra.run.smithi159.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:06.737 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/d14198c543eaf4ec825c3ece10bb481d12697de5e6fdcea615426adf4255062b/merged 2024-02-28T23:04:06.737 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/60128f7c0f71ba0557b1019534e285b4f99679e498131899bdda36b2015f4d49/merged 2024-02-28T23:04:06.737 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/0038b80c98e4946fdea952c4af94489615abdaf0fa0d01a02eede8b183da4bd9/merged 2024-02-28T23:04:06.737 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/e14c6e84ec267f866759b6c20a81490771fb22994dbf4a825bed3d22c88e0d79/merged 2024-02-28T23:04:06.738 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/8fe58fa8e82061faf89323565a1f13e14f004cbb24422d63cc2a9683f1612084/merged 2024-02-28T23:04:06.738 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/5ffd8cb7758bf52ee6c7dfe922696286362da6bf01fa9c1edda4f91c9df1908b/merged 2024-02-28T23:04:06.738 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/761e00f3903f937873fa34370c2d037c37961943dbcd55a0832d69dd5ad36745/merged 2024-02-28T23:04:06.738 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/d29ab0d1c809645fc981bcbaf159fcc250dae88a9fae8e0faecfcf7f510607b0/merged 2024-02-28T23:04:06.738 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/27470e821a86941595ab09a68c87f59787b6f7d52ac8c631716f25a0a5359556/merged 2024-02-28T23:04:06.738 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/b6f72cebb106093a26c9fabe5974fae6a4cba8c5796fad3c8e5176954244141c/merged 2024-02-28T23:04:06.738 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/dd9eedd3c77cc392bc8788d6a47e13c0f0e6cb50defc250a753911f9e19933e5/merged 2024-02-28T23:04:06.738 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns 2024-02-28T23:04:06.738 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T23:04:06.738 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T23:04:06.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:06.739 DEBUG:teuthology.orchestra.run.smithi159:> ls /sys/fs/fuse/connections 2024-02-28T23:04:06.818 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi159.stderr:2024-02-28T23:04:06.820+0000 7f3dd6236480 -1 init, newargv = 0x5577856094b0 newargc=15 2024-02-28T23:04:06.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi159.stderr:ceph-fuse[77101]: starting ceph client 2024-02-28T23:04:06.831 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi159.stderr:ceph-fuse[77101]: starting fuse 2024-02-28T23:04:06.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:06 smithi184 ceph-mon[36198]: pgmap v244: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:04:07.930 DEBUG:teuthology.orchestra.run.smithi159:> sudo modprobe fuse 2024-02-28T23:04:08.028 DEBUG:teuthology.orchestra.run.smithi159:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T23:04:08.080 INFO:teuthology.orchestra.run.smithi159.stdout:/proc 2024-02-28T23:04:08.080 INFO:teuthology.orchestra.run.smithi159.stdout:/sys 2024-02-28T23:04:08.080 INFO:teuthology.orchestra.run.smithi159.stdout:/dev 2024-02-28T23:04:08.080 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/security 2024-02-28T23:04:08.080 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/shm 2024-02-28T23:04:08.080 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/pts 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/run 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/cgroup 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/pstore 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/bpf 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/ 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/selinux 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/mqueue 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/hugepages 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/debug 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/tracing 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/fuse/connections 2024-02-28T23:04:08.081 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/config 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/run/user/1000 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/238179a05aec9254cb8337f898de54c4e394e15fc9a472366b2074ef26a9aea6/merged 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/f3015e0307c81a7530e8ee5c854deb511a74d7adac160293915a419ede73c62a/merged 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/run/user/0 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/d14198c543eaf4ec825c3ece10bb481d12697de5e6fdcea615426adf4255062b/merged 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/60128f7c0f71ba0557b1019534e285b4f99679e498131899bdda36b2015f4d49/merged 2024-02-28T23:04:08.082 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/0038b80c98e4946fdea952c4af94489615abdaf0fa0d01a02eede8b183da4bd9/merged 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/e14c6e84ec267f866759b6c20a81490771fb22994dbf4a825bed3d22c88e0d79/merged 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/8fe58fa8e82061faf89323565a1f13e14f004cbb24422d63cc2a9683f1612084/merged 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/5ffd8cb7758bf52ee6c7dfe922696286362da6bf01fa9c1edda4f91c9df1908b/merged 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/761e00f3903f937873fa34370c2d037c37961943dbcd55a0832d69dd5ad36745/merged 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/d29ab0d1c809645fc981bcbaf159fcc250dae88a9fae8e0faecfcf7f510607b0/merged 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/27470e821a86941595ab09a68c87f59787b6f7d52ac8c631716f25a0a5359556/merged 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/b6f72cebb106093a26c9fabe5974fae6a4cba8c5796fad3c8e5176954244141c/merged 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/containers/storage/overlay/dd9eedd3c77cc392bc8788d6a47e13c0f0e6cb50defc250a753911f9e19933e5/merged 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-02-28T23:04:08.083 INFO:teuthology.orchestra.run.smithi159.stdout:/home/ubuntu/cephtest/mnt.0 2024-02-28T23:04:08.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:08.084 DEBUG:teuthology.orchestra.run.smithi159:> ls /sys/fs/fuse/connections 2024-02-28T23:04:08.137 INFO:teuthology.orchestra.run.smithi159.stdout:158 2024-02-28T23:04:08.137 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [158] 2024-02-28T23:04:08.137 DEBUG:teuthology.orchestra.run.smithi159:> sudo stdin-killer -- python3 -c ' 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> import glob 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> import re 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> import os 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> import subprocess 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> def _find_admin_socket(client_name): 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> files = glob.glob(asok_path) 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> # Given a non-glob path, it better be there 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> if "*" not in asok_path: 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> assert(len(files) == 1) 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> return files[0] 2024-02-28T23:04:08.138 DEBUG:teuthology.orchestra.run.smithi159:> 2024-02-28T23:04:08.139 DEBUG:teuthology.orchestra.run.smithi159:> for f in files: 2024-02-28T23:04:08.139 DEBUG:teuthology.orchestra.run.smithi159:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-28T23:04:08.139 DEBUG:teuthology.orchestra.run.smithi159:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-28T23:04:08.139 DEBUG:teuthology.orchestra.run.smithi159:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-28T23:04:08.139 DEBUG:teuthology.orchestra.run.smithi159:> contents = proc_f.read() 2024-02-28T23:04:08.139 DEBUG:teuthology.orchestra.run.smithi159:> if mountpoint in contents: 2024-02-28T23:04:08.139 DEBUG:teuthology.orchestra.run.smithi159:> return f 2024-02-28T23:04:08.139 DEBUG:teuthology.orchestra.run.smithi159:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-28T23:04:08.139 DEBUG:teuthology.orchestra.run.smithi159:> 2024-02-28T23:04:08.139 DEBUG:teuthology.orchestra.run.smithi159:> print(_find_admin_socket("client.0")) 2024-02-28T23:04:08.139 DEBUG:teuthology.orchestra.run.smithi159:> ' 2024-02-28T23:04:08.312 INFO:teuthology.orchestra.run.smithi159.stdout:/var/run/ceph/ceph-client.0.77101.asok 2024-02-28T23:04:08.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-28T23:04:08.330 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.77101.asok 2024-02-28T23:04:08.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:08.331 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.77101.asok status 2024-02-28T23:04:08.565 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: "metadata": { 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_sha1": "7fe91d5d5842e04be3b4f514d6dd990c54b29c76", 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: "entity_id": "0", 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: "hostname": "smithi159", 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: "pid": "77101", 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: "root": "/" 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: "dentry_count": 0, 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: "dentry_pinned_count": 0, 2024-02-28T23:04:08.566 INFO:teuthology.orchestra.run.smithi159.stdout: "id": 14528, 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: "inst": { 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: "name": { 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "client", 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: "num": 14528 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": { 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v1", 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "192.168.0.1:0", 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 432838846 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": { 2024-02-28T23:04:08.567 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v1", 2024-02-28T23:04:08.568 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "192.168.0.1:0", 2024-02-28T23:04:08.568 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 432838846 2024-02-28T23:04:08.568 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:04:08.568 INFO:teuthology.orchestra.run.smithi159.stdout: "inst_str": "client.14528 192.168.0.1:0/432838846", 2024-02-28T23:04:08.568 INFO:teuthology.orchestra.run.smithi159.stdout: "addr_str": "192.168.0.1:0/432838846", 2024-02-28T23:04:08.568 INFO:teuthology.orchestra.run.smithi159.stdout: "inode_count": 1, 2024-02-28T23:04:08.568 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_epoch": 18, 2024-02-28T23:04:08.568 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_epoch": 46, 2024-02-28T23:04:08.568 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_epoch_barrier": 0, 2024-02-28T23:04:08.568 INFO:teuthology.orchestra.run.smithi159.stdout: "blocklisted": false, 2024-02-28T23:04:08.569 INFO:teuthology.orchestra.run.smithi159.stdout: "fs_name": "cephfs" 2024-02-28T23:04:08.569 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:04:08.581 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- ceph fs ls 2024-02-28T23:04:08.661 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:08 smithi159 ceph-mon[28802]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:04:08.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:08 smithi184 ceph-mon[36198]: pgmap v245: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:04:08.987 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:04:10.694 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:10 smithi159 ceph-mon[28802]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-02-28T23:04:10.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:10 smithi184 ceph-mon[36198]: pgmap v246: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 170 B/s wr, 2 op/s 2024-02-28T23:04:11.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.247+0000 7fe7a1800700 1 -- 172.21.15.159:0/1352589075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe79c0731c0 msgr2=0x7fe79c0735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:11.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.247+0000 7fe7a1800700 1 --2- 172.21.15.159:0/1352589075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe79c0731c0 0x7fe79c0735a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe78c009910 tx=0x7fe78c009c20 comp rx=0 tx=0).stop 2024-02-28T23:04:11.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.247+0000 7fe7a1800700 1 -- 172.21.15.159:0/1352589075 shutdown_connections 2024-02-28T23:04:11.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.247+0000 7fe7a1800700 1 --2- 172.21.15.159:0/1352589075 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe79c073ae0 0x7fe79c10ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:11.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.247+0000 7fe7a1800700 1 --2- 172.21.15.159:0/1352589075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe79c0731c0 0x7fe79c0735a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:11.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.247+0000 7fe7a1800700 1 -- 172.21.15.159:0/1352589075 >> 172.21.15.159:0/1352589075 conn(0x7fe79c0fc650 msgr2=0x7fe79c0fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:04:11.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.247+0000 7fe7a1800700 1 -- 172.21.15.159:0/1352589075 shutdown_connections 2024-02-28T23:04:11.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.247+0000 7fe7a1800700 1 -- 172.21.15.159:0/1352589075 wait complete. 2024-02-28T23:04:11.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.248+0000 7fe7a1800700 1 Processor -- start 2024-02-28T23:04:11.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.248+0000 7fe7a1800700 1 -- start start 2024-02-28T23:04:11.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.249+0000 7fe7a1800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe79c0731c0 0x7fe79c19e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:11.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.249+0000 7fe7a1800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe79c073ae0 0x7fe79c19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:11.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.249+0000 7fe7a1800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c19f2c0 con 0x7fe79c0731c0 2024-02-28T23:04:11.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.249+0000 7fe7a1800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe79c1987e0 con 0x7fe79c073ae0 2024-02-28T23:04:11.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.249+0000 7fe79aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe79c0731c0 0x7fe79c19e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.249+0000 7fe79aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe79c0731c0 0x7fe79c19e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57416/0 (socket says 172.21.15.159:57416) 2024-02-28T23:04:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.249+0000 7fe79aa00700 1 -- 172.21.15.159:0/2698965494 learned_addr learned my addr 172.21.15.159:0/2698965494 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:04:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.249+0000 7fe79a000700 1 --2- 172.21.15.159:0/2698965494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe79c073ae0 0x7fe79c19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.249+0000 7fe79aa00700 1 -- 172.21.15.159:0/2698965494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe79c073ae0 msgr2=0x7fe79c19ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.249+0000 7fe79aa00700 1 --2- 172.21.15.159:0/2698965494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe79c073ae0 0x7fe79c19ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.249+0000 7fe79aa00700 1 -- 172.21.15.159:0/2698965494 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c0095f0 con 0x7fe79c0731c0 2024-02-28T23:04:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.250+0000 7fe79aa00700 1 --2- 172.21.15.159:0/2698965494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe79c0731c0 0x7fe79c19e6f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00bd70 tx=0x7fe78c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.250+0000 7fe793400700 1 -- 172.21.15.159:0/2698965494 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe78c01d070 con 0x7fe79c0731c0 2024-02-28T23:04:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.250+0000 7fe793400700 1 -- 172.21.15.159:0/2698965494 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe78c00f460 con 0x7fe79c0731c0 2024-02-28T23:04:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.250+0000 7fe793400700 1 -- 172.21.15.159:0/2698965494 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe78c017630 con 0x7fe79c0731c0 2024-02-28T23:04:11.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.250+0000 7fe7a1800700 1 -- 172.21.15.159:0/2698965494 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe79c198a60 con 0x7fe79c0731c0 2024-02-28T23:04:11.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.250+0000 7fe7a1800700 1 -- 172.21.15.159:0/2698965494 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe79c198f50 con 0x7fe79c0731c0 2024-02-28T23:04:11.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.252+0000 7fe7a1800700 1 -- 172.21.15.159:0/2698965494 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe79c10a560 con 0x7fe79c0731c0 2024-02-28T23:04:11.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.252+0000 7fe793400700 1 -- 172.21.15.159:0/2698965494 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fe78c00f5d0 con 0x7fe79c0731c0 2024-02-28T23:04:11.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.253+0000 7fe793400700 1 --2- 172.21.15.159:0/2698965494 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe78006c4e0 0x7fe78006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:11.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.253+0000 7fe793400700 1 -- 172.21.15.159:0/2698965494 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe78c08ce10 con 0x7fe79c0731c0 2024-02-28T23:04:11.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.254+0000 7fe79a000700 1 --2- 172.21.15.159:0/2698965494 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe78006c4e0 0x7fe78006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:11.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.254+0000 7fe79a000700 1 --2- 172.21.15.159:0/2698965494 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe78006c4e0 0x7fe78006e9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe788005950 tx=0x7fe7880058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:11.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.258+0000 7fe793400700 1 -- 172.21.15.159:0/2698965494 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe78c05b000 con 0x7fe79c0731c0 2024-02-28T23:04:11.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.520+0000 7fe7a1800700 1 -- 172.21.15.159:0/2698965494 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe79c02cc70 con 0x7fe79c0731c0 2024-02-28T23:04:11.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.520+0000 7fe793400700 1 -- 172.21.15.159:0/2698965494 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+83 (secure 0 0 0) 0x7fe78c05ab90 con 0x7fe79c0731c0 2024-02-28T23:04:11.519 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-02-28T23:04:11.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.524+0000 7fe7a1800700 1 -- 172.21.15.159:0/2698965494 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe78006c4e0 msgr2=0x7fe78006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:11.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.524+0000 7fe7a1800700 1 --2- 172.21.15.159:0/2698965494 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe78006c4e0 0x7fe78006e9a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fe788005950 tx=0x7fe7880058e0 comp rx=0 tx=0).stop 2024-02-28T23:04:11.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.524+0000 7fe7a1800700 1 -- 172.21.15.159:0/2698965494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe79c0731c0 msgr2=0x7fe79c19e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:11.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.524+0000 7fe7a1800700 1 --2- 172.21.15.159:0/2698965494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe79c0731c0 0x7fe79c19e6f0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe78c00bd70 tx=0x7fe78c00be50 comp rx=0 tx=0).stop 2024-02-28T23:04:11.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.524+0000 7fe7a1800700 1 -- 172.21.15.159:0/2698965494 shutdown_connections 2024-02-28T23:04:11.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.524+0000 7fe7a1800700 1 --2- 172.21.15.159:0/2698965494 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe78006c4e0 0x7fe78006e9a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:11.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.524+0000 7fe7a1800700 1 --2- 172.21.15.159:0/2698965494 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe79c0731c0 0x7fe79c19e6f0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:11.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.524+0000 7fe7a1800700 1 --2- 172.21.15.159:0/2698965494 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe79c073ae0 0x7fe79c19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:11.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.524+0000 7fe7a1800700 1 -- 172.21.15.159:0/2698965494 >> 172.21.15.159:0/2698965494 conn(0x7fe79c0fc650 msgr2=0x7fe79c1076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:04:11.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.524+0000 7fe7a1800700 1 -- 172.21.15.159:0/2698965494 shutdown_connections 2024-02-28T23:04:11.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:11.525+0000 7fe7a1800700 1 -- 172.21.15.159:0/2698965494 wait complete. 2024-02-28T23:04:12.434 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-02-28T23:04:12.434 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-02-28T23:04:12.434 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi184.front.sepia.ceph.com 2024-02-28T23:04:12.434 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-02-28T23:04:12.434 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-02-28T23:04:12.434 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-02-28T23:04:12.434 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-02-28T23:04:12.434 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-02-28T23:04:12.434 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-02-28T23:04:12.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:12.434 DEBUG:teuthology.orchestra.run.smithi184:> ip addr 2024-02-28T23:04:12.490 INFO:teuthology.orchestra.run.smithi184.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-02-28T23:04:12.490 INFO:teuthology.orchestra.run.smithi184.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-02-28T23:04:12.490 INFO:teuthology.orchestra.run.smithi184.stdout: inet 127.0.0.1/8 scope host lo 2024-02-28T23:04:12.490 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-02-28T23:04:12.490 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 ::1/128 scope host 2024-02-28T23:04:12.490 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-02-28T23:04:12.490 INFO:teuthology.orchestra.run.smithi184.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:16 brd ff:ff:ff:ff:ff:ff 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f0 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:d9:37:17 brd ff:ff:ff:ff:ff:ff 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout: altname enp7s0f1 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8e brd ff:ff:ff:ff:ff:ff 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout: link/ether 0c:c4:7a:88:7b:8f brd ff:ff:ff:ff:ff:ff 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout: inet 172.21.15.184/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft 41974sec preferred_lft 41974sec 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout: inet6 fe80::ec4:7aff:fe88:7b8f/64 scope link 2024-02-28T23:04:12.491 INFO:teuthology.orchestra.run.smithi184.stdout: valid_lft forever preferred_lft forever 2024-02-28T23:04:12.492 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-02-28T23:04:12.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:12.493 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2024-02-28T23:04:12.493 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-02-28T23:04:12.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add name ceph-brx type bridge 2024-02-28T23:04:12.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr flush dev ceph-brx 2024-02-28T23:04:12.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set ceph-brx up 2024-02-28T23:04:12.493 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-02-28T23:04:12.493 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-02-28T23:04:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:12 smithi159 ceph-mon[28802]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-02-28T23:04:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:12 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2698965494' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T23:04:12.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:12 smithi184 ceph-mon[36198]: pgmap v247: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 170 B/s wr, 1 op/s 2024-02-28T23:04:12.814 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:12 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2698965494' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-02-28T23:04:12.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:12.933 DEBUG:teuthology.orchestra.run.smithi184:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-02-28T23:04:13.005 INFO:teuthology.orchestra.run.smithi184.stdout:1 2024-02-28T23:04:13.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:13.008 DEBUG:teuthology.orchestra.run.smithi184:> route 2024-02-28T23:04:13.064 INFO:teuthology.orchestra.run.smithi184.stdout:Kernel IP routing table 2024-02-28T23:04:13.064 INFO:teuthology.orchestra.run.smithi184.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-02-28T23:04:13.064 INFO:teuthology.orchestra.run.smithi184.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-02-28T23:04:13.064 INFO:teuthology.orchestra.run.smithi184.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-02-28T23:04:13.064 INFO:teuthology.orchestra.run.smithi184.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-02-28T23:04:13.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:13.065 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2024-02-28T23:04:13.065 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-02-28T23:04:13.065 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-02-28T23:04:13.065 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-02-28T23:04:13.065 DEBUG:teuthology.orchestra.run.smithi184:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-02-28T23:04:13.065 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-02-28T23:04:13.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:13.718 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list 2024-02-28T23:04:13.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:13.765 DEBUG:teuthology.orchestra.run.smithi184:> ip netns list-id 2024-02-28T23:04:13.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:13.807 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2024-02-28T23:04:13.807 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-02-28T23:04:13.807 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T23:04:13.807 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-02-28T23:04:13.807 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-02-28T23:04:13.978 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-02-28T23:04:13.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:13.978 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2024-02-28T23:04:13.978 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-02-28T23:04:13.978 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-02-28T23:04:13.978 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-02-28T23:04:13.978 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-02-28T23:04:13.978 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-02-28T23:04:13.978 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-02-28T23:04:13.978 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-02-28T23:04:14.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:14.251 DEBUG:teuthology.orchestra.run.smithi184:> (cd / && exec bash -c ' 2024-02-28T23:04:14.251 DEBUG:teuthology.orchestra.run.smithi184:> set -e 2024-02-28T23:04:14.251 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set brx.0 up 2024-02-28T23:04:14.251 DEBUG:teuthology.orchestra.run.smithi184:> sudo ip link set dev brx.0 master ceph-brx 2024-02-28T23:04:14.251 DEBUG:teuthology.orchestra.run.smithi184:> ') 2024-02-28T23:04:14.405 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-02-28T23:04:14.405 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T23:04:14.405 DEBUG:teuthology.orchestra.run.smithi184:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-02-28T23:04:14.446 INFO:teuthology.orchestra.run.smithi184.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-02-28T23:04:14.446 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-02-28T23:04:14.446 DEBUG:teuthology.orchestra.run.smithi184:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-02-28T23:04:14.537 DEBUG:teuthology.orchestra.run.smithi184:> sudo modprobe fuse 2024-02-28T23:04:14.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:14 smithi184 ceph-mon[36198]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-02-28T23:04:14.630 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T23:04:14.683 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2024-02-28T23:04:14.683 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2024-02-28T23:04:14.683 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2024-02-28T23:04:14.683 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2024-02-28T23:04:14.683 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2024-02-28T23:04:14.683 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2024-02-28T23:04:14.683 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2024-02-28T23:04:14.683 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/selinux 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T23:04:14.684 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/0 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/0017b005b68a897564dc6e14f7f9f0843cc67fe207dc3f9954a0200ed31c09d9/merged 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/f62a059f932edb5bcf909cc44d284f9ad4e22c844d352e39fc2b08e4e70fd452/merged 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/89b17d3a88ea64cb83b727957f57ab473d0a295921436340de275a3c5f01679d/merged 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/c9b68984e8a23424432004f8b874898d4e7e8d1e5f84edcca29af551031948bc/merged 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/053f1fa6528946f7cf154d5dc8c44d36bfbfe8b586c7126a9bb0ae7dbd5f4ba7/merged 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/a4a82afc4c4ce0c0fcb0142484bf7790adca9812d3fbf1d8171b93d5a284a088/merged 2024-02-28T23:04:14.685 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/8c79b5f6b27eda1aae45668c6f5d6b6e896b1c06554fdd7ced9d5eb843bb1396/merged 2024-02-28T23:04:14.686 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/c5e49010c44909cd0fe658b083e0448bf369dd618bd603ddb95d5e26da6e3393/merged 2024-02-28T23:04:14.686 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/5a3e9f1d2ec858af95b794677574d0e48d342b90843523f71b9064fde9bf8dbb/merged 2024-02-28T23:04:14.686 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/3b0da6559bf670f895439fbd2ebbaac676b6098e9d12239afdd9d2431d96e467/merged 2024-02-28T23:04:14.686 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2024-02-28T23:04:14.686 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T23:04:14.686 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T23:04:14.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:14.687 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2024-02-28T23:04:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:14 smithi159 ceph-mon[28802]: pgmap v248: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-02-28T23:04:14.733 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-02-28T23:04:14.733 DEBUG:teuthology.orchestra.run.smithi184:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-02-28T23:04:14.780 DEBUG:teuthology.orchestra.run.smithi184:> sudo modprobe fuse 2024-02-28T23:04:14.863 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T23:04:14.904 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2024-02-28T23:04:14.904 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2024-02-28T23:04:14.904 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2024-02-28T23:04:14.904 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2024-02-28T23:04:14.904 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2024-02-28T23:04:14.904 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2024-02-28T23:04:14.904 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2024-02-28T23:04:14.904 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2024-02-28T23:04:14.905 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2024-02-28T23:04:14.905 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2024-02-28T23:04:14.905 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2024-02-28T23:04:14.905 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/selinux 2024-02-28T23:04:14.905 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:14.905 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2024-02-28T23:04:14.905 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2024-02-28T23:04:14.905 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2024-02-28T23:04:14.905 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2024-02-28T23:04:14.905 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2024-02-28T23:04:14.905 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2024-02-28T23:04:14.906 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T23:04:14.906 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T23:04:14.906 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T23:04:14.906 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T23:04:14.906 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2024-02-28T23:04:14.906 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2024-02-28T23:04:14.906 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/0 2024-02-28T23:04:14.906 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:14.906 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay 2024-02-28T23:04:14.906 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/0017b005b68a897564dc6e14f7f9f0843cc67fe207dc3f9954a0200ed31c09d9/merged 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/f62a059f932edb5bcf909cc44d284f9ad4e22c844d352e39fc2b08e4e70fd452/merged 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/89b17d3a88ea64cb83b727957f57ab473d0a295921436340de275a3c5f01679d/merged 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/c9b68984e8a23424432004f8b874898d4e7e8d1e5f84edcca29af551031948bc/merged 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/053f1fa6528946f7cf154d5dc8c44d36bfbfe8b586c7126a9bb0ae7dbd5f4ba7/merged 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/a4a82afc4c4ce0c0fcb0142484bf7790adca9812d3fbf1d8171b93d5a284a088/merged 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/8c79b5f6b27eda1aae45668c6f5d6b6e896b1c06554fdd7ced9d5eb843bb1396/merged 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/c5e49010c44909cd0fe658b083e0448bf369dd618bd603ddb95d5e26da6e3393/merged 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/5a3e9f1d2ec858af95b794677574d0e48d342b90843523f71b9064fde9bf8dbb/merged 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/3b0da6559bf670f895439fbd2ebbaac676b6098e9d12239afdd9d2431d96e467/merged 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T23:04:14.907 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T23:04:14.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:14.909 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2024-02-28T23:04:15.019 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:2024-02-28T23:04:15.021+0000 7fae07045480 -1 init, newargv = 0x56255c83ed70 newargc=15 2024-02-28T23:04:15.019 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[62401]: starting ceph client 2024-02-28T23:04:15.030 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi184.stderr:ceph-fuse[62401]: starting fuse 2024-02-28T23:04:16.098 DEBUG:teuthology.orchestra.run.smithi184:> sudo modprobe fuse 2024-02-28T23:04:16.202 DEBUG:teuthology.orchestra.run.smithi184:> cat /proc/self/mounts | awk '{print $2}' 2024-02-28T23:04:16.256 INFO:teuthology.orchestra.run.smithi184.stdout:/proc 2024-02-28T23:04:16.256 INFO:teuthology.orchestra.run.smithi184.stdout:/sys 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/dev 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/security 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/shm 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/pts 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/run 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/cgroup 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/pstore 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/bpf 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/ 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/selinux 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/mqueue 2024-02-28T23:04:16.257 INFO:teuthology.orchestra.run.smithi184.stdout:/dev/hugepages 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/debug 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/tracing 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/fs/fuse/connections 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/sys/kernel/config 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-sysctl.service 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/nfs/rpc_pipefs 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/1000 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/ceph 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/run/user/0 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/proc/sys/fs/binfmt_misc 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay 2024-02-28T23:04:16.258 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/0017b005b68a897564dc6e14f7f9f0843cc67fe207dc3f9954a0200ed31c09d9/merged 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/f62a059f932edb5bcf909cc44d284f9ad4e22c844d352e39fc2b08e4e70fd452/merged 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/89b17d3a88ea64cb83b727957f57ab473d0a295921436340de275a3c5f01679d/merged 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/c9b68984e8a23424432004f8b874898d4e7e8d1e5f84edcca29af551031948bc/merged 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/053f1fa6528946f7cf154d5dc8c44d36bfbfe8b586c7126a9bb0ae7dbd5f4ba7/merged 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/a4a82afc4c4ce0c0fcb0142484bf7790adca9812d3fbf1d8171b93d5a284a088/merged 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/8c79b5f6b27eda1aae45668c6f5d6b6e896b1c06554fdd7ced9d5eb843bb1396/merged 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/c5e49010c44909cd0fe658b083e0448bf369dd618bd603ddb95d5e26da6e3393/merged 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/5a3e9f1d2ec858af95b794677574d0e48d342b90843523f71b9064fde9bf8dbb/merged 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/var/lib/containers/storage/overlay/3b0da6559bf670f895439fbd2ebbaac676b6098e9d12239afdd9d2431d96e467/merged 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-02-28T23:04:16.259 INFO:teuthology.orchestra.run.smithi184.stdout:/home/ubuntu/cephtest/mnt.1 2024-02-28T23:04:16.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:16.260 DEBUG:teuthology.orchestra.run.smithi184:> ls /sys/fs/fuse/connections 2024-02-28T23:04:16.310 INFO:teuthology.orchestra.run.smithi184.stdout:125 2024-02-28T23:04:16.311 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [125] 2024-02-28T23:04:16.311 DEBUG:teuthology.orchestra.run.smithi184:> sudo stdin-killer -- python3 -c ' 2024-02-28T23:04:16.311 DEBUG:teuthology.orchestra.run.smithi184:> import glob 2024-02-28T23:04:16.311 DEBUG:teuthology.orchestra.run.smithi184:> import re 2024-02-28T23:04:16.311 DEBUG:teuthology.orchestra.run.smithi184:> import os 2024-02-28T23:04:16.311 DEBUG:teuthology.orchestra.run.smithi184:> import subprocess 2024-02-28T23:04:16.311 DEBUG:teuthology.orchestra.run.smithi184:> 2024-02-28T23:04:16.311 DEBUG:teuthology.orchestra.run.smithi184:> def _find_admin_socket(client_name): 2024-02-28T23:04:16.311 DEBUG:teuthology.orchestra.run.smithi184:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-02-28T23:04:16.311 DEBUG:teuthology.orchestra.run.smithi184:> files = glob.glob(asok_path) 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> # Given a non-glob path, it better be there 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> if "*" not in asok_path: 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> assert(len(files) == 1) 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> return files[0] 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> for f in files: 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> if os.path.exists("/proc/{0}".format(pid)): 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-02-28T23:04:16.312 DEBUG:teuthology.orchestra.run.smithi184:> contents = proc_f.read() 2024-02-28T23:04:16.313 DEBUG:teuthology.orchestra.run.smithi184:> if mountpoint in contents: 2024-02-28T23:04:16.313 DEBUG:teuthology.orchestra.run.smithi184:> return f 2024-02-28T23:04:16.313 DEBUG:teuthology.orchestra.run.smithi184:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-02-28T23:04:16.313 DEBUG:teuthology.orchestra.run.smithi184:> 2024-02-28T23:04:16.313 DEBUG:teuthology.orchestra.run.smithi184:> print(_find_admin_socket("client.1")) 2024-02-28T23:04:16.313 DEBUG:teuthology.orchestra.run.smithi184:> ' 2024-02-28T23:04:16.488 INFO:teuthology.orchestra.run.smithi184.stdout:/var/run/ceph/ceph-client.1.62401.asok 2024-02-28T23:04:16.492 INFO:teuthology.orchestra.run.smithi184.stderr:2024-02-28T23:04:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-02-28T23:04:16.506 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.62401.asok 2024-02-28T23:04:16.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:16.507 DEBUG:teuthology.orchestra.run.smithi184:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.62401.asok status 2024-02-28T23:04:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:16 smithi159 ceph-mon[28802]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-02-28T23:04:16.741 INFO:teuthology.orchestra.run.smithi184.stdout:{ 2024-02-28T23:04:16.741 INFO:teuthology.orchestra.run.smithi184.stdout: "metadata": { 2024-02-28T23:04:16.741 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_sha1": "7fe91d5d5842e04be3b4f514d6dd990c54b29c76", 2024-02-28T23:04:16.741 INFO:teuthology.orchestra.run.smithi184.stdout: "ceph_version": "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)", 2024-02-28T23:04:16.741 INFO:teuthology.orchestra.run.smithi184.stdout: "entity_id": "1", 2024-02-28T23:04:16.741 INFO:teuthology.orchestra.run.smithi184.stdout: "hostname": "smithi184", 2024-02-28T23:04:16.741 INFO:teuthology.orchestra.run.smithi184.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "pid": "62401", 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "root": "/" 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_count": 0, 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "dentry_pinned_count": 0, 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "id": 24307, 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "inst": { 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "name": { 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "client", 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "num": 24307 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2024-02-28T23:04:16.742 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 975766746 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: } 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": { 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "type": "v1", 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "addr": "192.168.0.1:0", 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "nonce": 975766746 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: }, 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "inst_str": "client.24307 192.168.0.1:0/975766746", 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "addr_str": "192.168.0.1:0/975766746", 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "inode_count": 1, 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "mds_epoch": 18, 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch": 46, 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "osd_epoch_barrier": 0, 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "blocklisted": false, 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout: "fs_name": "cephfs" 2024-02-28T23:04:16.743 INFO:teuthology.orchestra.run.smithi184.stdout:} 2024-02-28T23:04:16.753 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:16 smithi184 ceph-mon[36198]: pgmap v249: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-02-28T23:04:16.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:16.757 DEBUG:teuthology.orchestra.run.smithi159:> stat --file-system '--printf=%T 2024-02-28T23:04:16.758 DEBUG:teuthology.orchestra.run.smithi159:> ' -- /home/ubuntu/cephtest/mnt.0 2024-02-28T23:04:16.817 INFO:teuthology.orchestra.run.smithi159.stdout:fuseblk 2024-02-28T23:04:16.818 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-02-28T23:04:16.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:16.818 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-02-28T23:04:16.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:16.919 DEBUG:teuthology.orchestra.run.smithi184:> stat --file-system '--printf=%T 2024-02-28T23:04:16.919 DEBUG:teuthology.orchestra.run.smithi184:> ' -- /home/ubuntu/cephtest/mnt.1 2024-02-28T23:04:16.977 INFO:teuthology.orchestra.run.smithi184.stdout:fuseblk 2024-02-28T23:04:16.977 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-02-28T23:04:16.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:04:16.977 DEBUG:teuthology.orchestra.run.smithi184:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-02-28T23:04:17.079 INFO:teuthology.run_tasks:Running task print... 2024-02-28T23:04:17.091 INFO:teuthology.task.print:**** done client 2024-02-28T23:04:17.091 INFO:teuthology.run_tasks:Running task parallel... 2024-02-28T23:04:17.184 INFO:teuthology.task.parallel:starting parallel... 2024-02-28T23:04:17.185 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-28T23:04:17.185 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T23:04:17.186 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:04:17.186 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-28T23:04:17.186 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-02-28T23:04:17.186 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-02-28T23:04:17.190 INFO:tasks.workunit:Pulling workunits from ref 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:04:17.190 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-02-28T23:04:17.190 INFO:tasks.workunit:timeout=3h 2024-02-28T23:04:17.190 INFO:tasks.workunit:cleanup=True 2024-02-28T23:04:17.191 DEBUG:teuthology.orchestra.run.smithi159:> stat -- /home/ubuntu/cephtest/mnt.0 2024-02-28T23:04:17.248 INFO:teuthology.orchestra.run.smithi159.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-02-28T23:04:17.248 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-28T23:04:17.248 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 9eh/158d Inode: 1 Links: 2 2024-02-28T23:04:17.248 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T23:04:17.248 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-28T23:04:17.248 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-28T23:04:17.248 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-02-28 23:03:27.446218676 +0000 2024-02-28T23:04:17.248 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-02-28 23:04:16.913474871 +0000 2024-02-28T23:04:17.249 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: - 2024-02-28T23:04:17.249 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-02-28T23:04:17.249 DEBUG:teuthology.orchestra.run.smithi159:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-02-28T23:04:17.389 DEBUG:teuthology.orchestra.run.smithi184:> stat -- /home/ubuntu/cephtest/mnt.1 2024-02-28T23:04:17.448 INFO:teuthology.orchestra.run.smithi184.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-02-28T23:04:17.448 INFO:teuthology.orchestra.run.smithi184.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-02-28T23:04:17.448 INFO:teuthology.orchestra.run.smithi184.stdout:Device: 7dh/125d Inode: 1 Links: 3 2024-02-28T23:04:17.448 INFO:teuthology.orchestra.run.smithi184.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-28T23:04:17.448 INFO:teuthology.orchestra.run.smithi184.stdout:Context: system_u:object_r:fusefs_t:s0 2024-02-28T23:04:17.448 INFO:teuthology.orchestra.run.smithi184.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-02-28T23:04:17.448 INFO:teuthology.orchestra.run.smithi184.stdout:Modify: 2024-02-28 23:04:17.376601251 +0000 2024-02-28T23:04:17.448 INFO:teuthology.orchestra.run.smithi184.stdout:Change: 2024-02-28 23:04:17.376601251 +0000 2024-02-28T23:04:17.448 INFO:teuthology.orchestra.run.smithi184.stdout: Birth: - 2024-02-28T23:04:17.449 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-02-28T23:04:17.449 DEBUG:teuthology.orchestra.run.smithi184:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-02-28T23:04:17.547 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:04:17.548 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:04:17.590 INFO:tasks.workunit.client.0.smithi159.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-02-28T23:04:17.593 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:04:17.608 INFO:tasks.workunit.client.1.smithi184.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-02-28T23:04:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:18 smithi159 ceph-mon[28802]: pgmap v250: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-02-28T23:04:18.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:18 smithi184 ceph-mon[36198]: pgmap v250: 65 pgs: 65 active+clean; 579 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 938 B/s rd, 170 B/s wr, 1 op/s 2024-02-28T23:04:19.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.882+0000 7f603f200700 1 -- 172.21.15.159:0/1321476115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6038101640 msgr2=0x7f6038103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:19.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.882+0000 7f603f200700 1 --2- 172.21.15.159:0/1321476115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6038101640 0x7f6038103a30 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f6028009910 tx=0x7f6028009c20 comp rx=0 tx=0).stop 2024-02-28T23:04:19.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.883+0000 7f603f200700 1 -- 172.21.15.159:0/1321476115 shutdown_connections 2024-02-28T23:04:19.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.883+0000 7f603f200700 1 --2- 172.21.15.159:0/1321476115 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6038103f70 0x7f6038106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:19.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.883+0000 7f603f200700 1 --2- 172.21.15.159:0/1321476115 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6038101640 0x7f6038103a30 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:19.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.883+0000 7f603f200700 1 -- 172.21.15.159:0/1321476115 >> 172.21.15.159:0/1321476115 conn(0x7f60380fb050 msgr2=0x7f60380fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:04:19.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.883+0000 7f603f200700 1 -- 172.21.15.159:0/1321476115 shutdown_connections 2024-02-28T23:04:19.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.883+0000 7f603f200700 1 -- 172.21.15.159:0/1321476115 wait complete. 2024-02-28T23:04:19.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.884+0000 7f603f200700 1 Processor -- start 2024-02-28T23:04:19.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.884+0000 7f603f200700 1 -- start start 2024-02-28T23:04:19.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.884+0000 7f603f200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6038101640 0x7f6038198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:19.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.884+0000 7f603f200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6038103f70 0x7f6038198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:19.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.885+0000 7f603f200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6038198ff0 con 0x7f6038101640 2024-02-28T23:04:19.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.885+0000 7f603f200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6038199130 con 0x7f6038103f70 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.885+0000 7f6037e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6038101640 0x7f6038198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.885+0000 7f6037e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6038101640 0x7f6038198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47870/0 (socket says 172.21.15.159:47870) 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.885+0000 7f6037e00700 1 -- 172.21.15.159:0/2344112753 learned_addr learned my addr 172.21.15.159:0/2344112753 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.885+0000 7f6037400700 1 --2- 172.21.15.159:0/2344112753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6038103f70 0x7f6038198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.885+0000 7f6037e00700 1 -- 172.21.15.159:0/2344112753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6038103f70 msgr2=0x7f6038198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.885+0000 7f6037e00700 1 --2- 172.21.15.159:0/2344112753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6038103f70 0x7f6038198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.885+0000 7f6037e00700 1 -- 172.21.15.159:0/2344112753 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60280095f0 con 0x7f6038101640 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.886+0000 7f6037e00700 1 --2- 172.21.15.159:0/2344112753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6038101640 0x7f6038198520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6028005b40 tx=0x7f602800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.886+0000 7f6034c00700 1 -- 172.21.15.159:0/2344112753 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f602801d070 con 0x7f6038101640 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.886+0000 7f6034c00700 1 -- 172.21.15.159:0/2344112753 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f6028022470 con 0x7f6038101640 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.886+0000 7f603f200700 1 -- 172.21.15.159:0/2344112753 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f603819db90 con 0x7f6038101640 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.886+0000 7f6034c00700 1 -- 172.21.15.159:0/2344112753 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f602800f690 con 0x7f6038101640 2024-02-28T23:04:19.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.886+0000 7f603f200700 1 -- 172.21.15.159:0/2344112753 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f603819e050 con 0x7f6038101640 2024-02-28T23:04:19.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.887+0000 7f603f200700 1 -- 172.21.15.159:0/2344112753 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60380fcc20 con 0x7f6038101640 2024-02-28T23:04:19.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.888+0000 7f6034c00700 1 -- 172.21.15.159:0/2344112753 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f60280225e0 con 0x7f6038101640 2024-02-28T23:04:19.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.889+0000 7f6034c00700 1 --2- 172.21.15.159:0/2344112753 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f601c06c4e0 0x7f601c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:19.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.889+0000 7f6034c00700 1 -- 172.21.15.159:0/2344112753 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f602808d0f0 con 0x7f6038101640 2024-02-28T23:04:19.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.890+0000 7f6037400700 1 --2- 172.21.15.159:0/2344112753 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f601c06c4e0 0x7f601c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:19.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.890+0000 7f6037400700 1 --2- 172.21.15.159:0/2344112753 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f601c06c4e0 0x7f601c06e9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6024005ea0 tx=0x7f6024005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:19.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:19.895+0000 7f6034c00700 1 -- 172.21.15.159:0/2344112753 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f602805b4a0 con 0x7f6038101640 2024-02-28T23:04:20.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.110+0000 7f603f200700 1 -- 172.21.15.159:0/2344112753 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f603802cc70 con 0x7f6038101640 2024-02-28T23:04:20.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.111+0000 7f6034c00700 1 -- 172.21.15.159:0/2344112753 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7f602805b030 con 0x7f6038101640 2024-02-28T23:04:20.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.114+0000 7f603f200700 1 -- 172.21.15.159:0/2344112753 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f601c06c4e0 msgr2=0x7f601c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:20.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.114+0000 7f603f200700 1 --2- 172.21.15.159:0/2344112753 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f601c06c4e0 0x7f601c06e9a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6024005ea0 tx=0x7f6024005e30 comp rx=0 tx=0).stop 2024-02-28T23:04:20.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.114+0000 7f603f200700 1 -- 172.21.15.159:0/2344112753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6038101640 msgr2=0x7f6038198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:20.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.114+0000 7f603f200700 1 --2- 172.21.15.159:0/2344112753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6038101640 0x7f6038198520 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f6028005b40 tx=0x7f602800be20 comp rx=0 tx=0).stop 2024-02-28T23:04:20.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.114+0000 7f603f200700 1 -- 172.21.15.159:0/2344112753 shutdown_connections 2024-02-28T23:04:20.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.114+0000 7f603f200700 1 --2- 172.21.15.159:0/2344112753 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f601c06c4e0 0x7f601c06e9a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:20.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.114+0000 7f603f200700 1 --2- 172.21.15.159:0/2344112753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6038101640 0x7f6038198520 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:20.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.114+0000 7f603f200700 1 --2- 172.21.15.159:0/2344112753 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6038103f70 0x7f6038198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:20.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.114+0000 7f603f200700 1 -- 172.21.15.159:0/2344112753 >> 172.21.15.159:0/2344112753 conn(0x7f60380fb050 msgr2=0x7f6038104be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:04:20.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.114+0000 7f603f200700 1 -- 172.21.15.159:0/2344112753 shutdown_connections 2024-02-28T23:04:20.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:20.115+0000 7f603f200700 1 -- 172.21.15.159:0/2344112753 wait complete. 2024-02-28T23:04:20.818 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:20 smithi159 ceph-mon[28802]: pgmap v251: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 2 op/s 2024-02-28T23:04:20.818 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:04:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:20 smithi184 ceph-mon[36198]: pgmap v251: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s rd, 341 B/s wr, 2 op/s 2024-02-28T23:04:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:04:20.951 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-28T23:04:21.397 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:04:22.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:22 smithi184 ceph-mon[36198]: pgmap v252: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-02-28T23:04:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:22 smithi159 ceph-mon[28802]: pgmap v252: 65 pgs: 65 active+clean; 581 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 170 B/s wr, 1 op/s 2024-02-28T23:04:23.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.639+0000 7fda8c400700 1 -- 172.21.15.159:0/2033605443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda84075740 msgr2=0x7fda84075b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:23.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.639+0000 7fda8c400700 1 --2- 172.21.15.159:0/2033605443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda84075740 0x7fda84075b60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fda78009910 tx=0x7fda78009c20 comp rx=0 tx=0).stop 2024-02-28T23:04:23.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.639+0000 7fda8c400700 1 -- 172.21.15.159:0/2033605443 shutdown_connections 2024-02-28T23:04:23.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.639+0000 7fda8c400700 1 --2- 172.21.15.159:0/2033605443 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda84076990 0x7fda84076e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:23.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.639+0000 7fda8c400700 1 --2- 172.21.15.159:0/2033605443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda84075740 0x7fda84075b60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:23.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.639+0000 7fda8c400700 1 -- 172.21.15.159:0/2033605443 >> 172.21.15.159:0/2033605443 conn(0x7fda840fe390 msgr2=0x7fda841007b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:04:23.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.639+0000 7fda8c400700 1 -- 172.21.15.159:0/2033605443 shutdown_connections 2024-02-28T23:04:23.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.639+0000 7fda8c400700 1 -- 172.21.15.159:0/2033605443 wait complete. 2024-02-28T23:04:23.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.640+0000 7fda8c400700 1 Processor -- start 2024-02-28T23:04:23.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.641+0000 7fda8c400700 1 -- start start 2024-02-28T23:04:23.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.641+0000 7fda8c400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda84075740 0x7fda8419c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:23.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.641+0000 7fda8c400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda84076990 0x7fda8419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:23.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.641+0000 7fda8c400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8419d4b0 con 0x7fda84076990 2024-02-28T23:04:23.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.641+0000 7fda8c400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8419d5f0 con 0x7fda84075740 2024-02-28T23:04:23.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.641+0000 7fda89000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda84076990 0x7fda8419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:23.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.641+0000 7fda89000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda84076990 0x7fda8419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47884/0 (socket says 172.21.15.159:47884) 2024-02-28T23:04:23.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.641+0000 7fda89000700 1 -- 172.21.15.159:0/1522076952 learned_addr learned my addr 172.21.15.159:0/1522076952 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:04:23.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.642+0000 7fda89a00700 1 --2- 172.21.15.159:0/1522076952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda84075740 0x7fda8419c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:23.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.642+0000 7fda89000700 1 -- 172.21.15.159:0/1522076952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda84075740 msgr2=0x7fda8419c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:23.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.642+0000 7fda89000700 1 --2- 172.21.15.159:0/1522076952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda84075740 0x7fda8419c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:23.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.642+0000 7fda89000700 1 -- 172.21.15.159:0/1522076952 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda780095f0 con 0x7fda84076990 2024-02-28T23:04:23.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.642+0000 7fda89000700 1 --2- 172.21.15.159:0/1522076952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda84076990 0x7fda8419ce90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fda7000c8a0 tx=0x7fda7000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:23.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.642+0000 7fda82000700 1 -- 172.21.15.159:0/1522076952 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda7000cea0 con 0x7fda84076990 2024-02-28T23:04:23.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.642+0000 7fda8c400700 1 -- 172.21.15.159:0/1522076952 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda841a20a0 con 0x7fda84076990 2024-02-28T23:04:23.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.642+0000 7fda82000700 1 -- 172.21.15.159:0/1522076952 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fda70004830 con 0x7fda84076990 2024-02-28T23:04:23.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.642+0000 7fda82000700 1 -- 172.21.15.159:0/1522076952 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda700055b0 con 0x7fda84076990 2024-02-28T23:04:23.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.642+0000 7fda8c400700 1 -- 172.21.15.159:0/1522076952 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda841a25f0 con 0x7fda84076990 2024-02-28T23:04:23.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.643+0000 7fda8c400700 1 -- 172.21.15.159:0/1522076952 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8410fd20 con 0x7fda84076990 2024-02-28T23:04:23.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.645+0000 7fda82000700 1 -- 172.21.15.159:0/1522076952 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fda70007ad0 con 0x7fda84076990 2024-02-28T23:04:23.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.645+0000 7fda82000700 1 --2- 172.21.15.159:0/1522076952 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fda6c06c4e0 0x7fda6c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:23.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.646+0000 7fda82000700 1 -- 172.21.15.159:0/1522076952 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fda7008b5a0 con 0x7fda84076990 2024-02-28T23:04:23.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.646+0000 7fda89a00700 1 --2- 172.21.15.159:0/1522076952 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fda6c06c4e0 0x7fda6c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:23.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.647+0000 7fda89a00700 1 --2- 172.21.15.159:0/1522076952 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fda6c06c4e0 0x7fda6c06e9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fda78006010 tx=0x7fda7800b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:23.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.651+0000 7fda82000700 1 -- 172.21.15.159:0/1522076952 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fda70059790 con 0x7fda84076990 2024-02-28T23:04:23.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.866+0000 7fda8c400700 1 -- 172.21.15.159:0/1522076952 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fda841a2ce0 con 0x7fda84076990 2024-02-28T23:04:23.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.867+0000 7fda82000700 1 -- 172.21.15.159:0/1522076952 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7fda70059320 con 0x7fda84076990 2024-02-28T23:04:23.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.870+0000 7fda8c400700 1 -- 172.21.15.159:0/1522076952 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fda6c06c4e0 msgr2=0x7fda6c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:23.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.870+0000 7fda8c400700 1 --2- 172.21.15.159:0/1522076952 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fda6c06c4e0 0x7fda6c06e9a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fda78006010 tx=0x7fda7800b540 comp rx=0 tx=0).stop 2024-02-28T23:04:23.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.870+0000 7fda8c400700 1 -- 172.21.15.159:0/1522076952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda84076990 msgr2=0x7fda8419ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:23.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.870+0000 7fda8c400700 1 --2- 172.21.15.159:0/1522076952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda84076990 0x7fda8419ce90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fda7000c8a0 tx=0x7fda7000cc60 comp rx=0 tx=0).stop 2024-02-28T23:04:23.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.870+0000 7fda8c400700 1 -- 172.21.15.159:0/1522076952 shutdown_connections 2024-02-28T23:04:23.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.870+0000 7fda8c400700 1 --2- 172.21.15.159:0/1522076952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda84075740 0x7fda8419c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:23.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.870+0000 7fda8c400700 1 --2- 172.21.15.159:0/1522076952 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fda6c06c4e0 0x7fda6c06e9a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:23.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.870+0000 7fda8c400700 1 --2- 172.21.15.159:0/1522076952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda84076990 0x7fda8419ce90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:23.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.870+0000 7fda8c400700 1 -- 172.21.15.159:0/1522076952 >> 172.21.15.159:0/1522076952 conn(0x7fda840fe390 msgr2=0x7fda8410d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:04:23.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.870+0000 7fda8c400700 1 -- 172.21.15.159:0/1522076952 shutdown_connections 2024-02-28T23:04:23.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:23.870+0000 7fda8c400700 1 -- 172.21.15.159:0/1522076952 wait complete. 2024-02-28T23:04:24.753 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:24 smithi159 ceph-mon[28802]: pgmap v253: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 597 B/s wr, 3 op/s 2024-02-28T23:04:24.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-28T23:04:24.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:24 smithi184 ceph-mon[36198]: pgmap v253: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.8 KiB/s rd, 597 B/s wr, 3 op/s 2024-02-28T23:04:25.221 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:04:26.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:26 smithi184 ceph-mon[36198]: pgmap v254: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-02-28T23:04:26.932 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:26 smithi159 ceph-mon[28802]: pgmap v254: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-02-28T23:04:27.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.474+0000 7f8bc0e00700 1 -- 172.21.15.159:0/536572252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bbc107200 msgr2=0x7f8bbc107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:27.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.474+0000 7f8bc0e00700 1 --2- 172.21.15.159:0/536572252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bbc107200 0x7f8bbc107620 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8bac009910 tx=0x7f8bac009c20 comp rx=0 tx=0).stop 2024-02-28T23:04:27.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.474+0000 7f8bc0e00700 1 -- 172.21.15.159:0/536572252 shutdown_connections 2024-02-28T23:04:27.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.474+0000 7f8bc0e00700 1 --2- 172.21.15.159:0/536572252 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bbc108400 0x7f8bbc108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:27.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.474+0000 7f8bc0e00700 1 --2- 172.21.15.159:0/536572252 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bbc107200 0x7f8bbc107620 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:27.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.474+0000 7f8bc0e00700 1 -- 172.21.15.159:0/536572252 >> 172.21.15.159:0/536572252 conn(0x7f8bbc0761b0 msgr2=0x7f8bbc078610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:04:27.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.474+0000 7f8bc0e00700 1 -- 172.21.15.159:0/536572252 shutdown_connections 2024-02-28T23:04:27.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.474+0000 7f8bc0e00700 1 -- 172.21.15.159:0/536572252 wait complete. 2024-02-28T23:04:27.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.475+0000 7f8bc0e00700 1 Processor -- start 2024-02-28T23:04:27.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.475+0000 7f8bc0e00700 1 -- start start 2024-02-28T23:04:27.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.476+0000 7f8bc0e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bbc107200 0x7f8bbc19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:27.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.476+0000 7f8bc0e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bbc108400 0x7f8bbc19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:27.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.476+0000 7f8bc0e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc19d510 con 0x7f8bbc108400 2024-02-28T23:04:27.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.476+0000 7f8bc0e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bbc19d650 con 0x7f8bbc107200 2024-02-28T23:04:27.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.476+0000 7f8bb9400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bbc108400 0x7f8bbc19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:27.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.476+0000 7f8bb9400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bbc108400 0x7f8bbc19cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47904/0 (socket says 172.21.15.159:47904) 2024-02-28T23:04:27.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.476+0000 7f8bb9400700 1 -- 172.21.15.159:0/2237068127 learned_addr learned my addr 172.21.15.159:0/2237068127 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:04:27.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.476+0000 7f8bb9e00700 1 --2- 172.21.15.159:0/2237068127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bbc107200 0x7f8bbc19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:27.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.476+0000 7f8bb9400700 1 -- 172.21.15.159:0/2237068127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bbc107200 msgr2=0x7f8bbc19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:27.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.476+0000 7f8bb9400700 1 --2- 172.21.15.159:0/2237068127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bbc107200 0x7f8bbc19c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:27.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.476+0000 7f8bb9400700 1 -- 172.21.15.159:0/2237068127 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bac0095f0 con 0x7f8bbc108400 2024-02-28T23:04:27.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.477+0000 7f8bb9400700 1 --2- 172.21.15.159:0/2237068127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bbc108400 0x7f8bbc19cef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800d8d0 tx=0x7f8ba800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:27.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.477+0000 7f8bb2a00700 1 -- 172.21.15.159:0/2237068127 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba8009940 con 0x7f8bbc108400 2024-02-28T23:04:27.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.477+0000 7f8bb2a00700 1 -- 172.21.15.159:0/2237068127 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8ba8010460 con 0x7f8bbc108400 2024-02-28T23:04:27.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.477+0000 7f8bb2a00700 1 -- 172.21.15.159:0/2237068127 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ba800f5f0 con 0x7f8bbc108400 2024-02-28T23:04:27.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.477+0000 7f8bc0e00700 1 -- 172.21.15.159:0/2237068127 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bbc1a2100 con 0x7f8bbc108400 2024-02-28T23:04:27.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.477+0000 7f8bc0e00700 1 -- 172.21.15.159:0/2237068127 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bbc1a2650 con 0x7f8bbc108400 2024-02-28T23:04:27.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.478+0000 7f8bc0e00700 1 -- 172.21.15.159:0/2237068127 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bbc10fd60 con 0x7f8bbc108400 2024-02-28T23:04:27.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.479+0000 7f8bb2a00700 1 -- 172.21.15.159:0/2237068127 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f8ba80105d0 con 0x7f8bbc108400 2024-02-28T23:04:27.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.480+0000 7f8bb2a00700 1 --2- 172.21.15.159:0/2237068127 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8ba006c4e0 0x7f8ba006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:27.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.480+0000 7f8bb2a00700 1 -- 172.21.15.159:0/2237068127 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f8ba808b930 con 0x7f8bbc108400 2024-02-28T23:04:27.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.480+0000 7f8bb9e00700 1 --2- 172.21.15.159:0/2237068127 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8ba006c4e0 0x7f8ba006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:27.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.481+0000 7f8bb9e00700 1 --2- 172.21.15.159:0/2237068127 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8ba006c4e0 0x7f8ba006e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8bac006010 tx=0x7f8bac00b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:27.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.485+0000 7f8bb2a00700 1 -- 172.21.15.159:0/2237068127 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f8ba8059aa0 con 0x7f8bbc108400 2024-02-28T23:04:27.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.703+0000 7f8bc0e00700 1 -- 172.21.15.159:0/2237068127 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f8bbc10ff50 con 0x7f8bbc108400 2024-02-28T23:04:27.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.704+0000 7f8bb2a00700 1 -- 172.21.15.159:0/2237068127 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f8ba8059630 con 0x7f8bbc108400 2024-02-28T23:04:27.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.707+0000 7f8bc0e00700 1 -- 172.21.15.159:0/2237068127 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8ba006c4e0 msgr2=0x7f8ba006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:27.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.707+0000 7f8bc0e00700 1 --2- 172.21.15.159:0/2237068127 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8ba006c4e0 0x7f8ba006e9a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8bac006010 tx=0x7f8bac00b540 comp rx=0 tx=0).stop 2024-02-28T23:04:27.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.707+0000 7f8bc0e00700 1 -- 172.21.15.159:0/2237068127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bbc108400 msgr2=0x7f8bbc19cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:27.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.707+0000 7f8bc0e00700 1 --2- 172.21.15.159:0/2237068127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bbc108400 0x7f8bbc19cef0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800d8d0 tx=0x7f8ba800dc90 comp rx=0 tx=0).stop 2024-02-28T23:04:27.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.707+0000 7f8bc0e00700 1 -- 172.21.15.159:0/2237068127 shutdown_connections 2024-02-28T23:04:27.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.707+0000 7f8bc0e00700 1 --2- 172.21.15.159:0/2237068127 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8bbc107200 0x7f8bbc19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:27.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.707+0000 7f8bc0e00700 1 --2- 172.21.15.159:0/2237068127 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f8ba006c4e0 0x7f8ba006e9a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:27.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.707+0000 7f8bc0e00700 1 --2- 172.21.15.159:0/2237068127 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bbc108400 0x7f8bbc19cef0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:27.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.707+0000 7f8bc0e00700 1 -- 172.21.15.159:0/2237068127 >> 172.21.15.159:0/2237068127 conn(0x7f8bbc0761b0 msgr2=0x7f8bbc10b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:04:27.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.708+0000 7f8bc0e00700 1 -- 172.21.15.159:0/2237068127 shutdown_connections 2024-02-28T23:04:27.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:27.708+0000 7f8bc0e00700 1 -- 172.21.15.159:0/2237068127 wait complete. 2024-02-28T23:04:28.581 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-02-28T23:04:28.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:28 smithi184 ceph-mon[36198]: pgmap v255: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-02-28T23:04:28.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:28 smithi159 ceph-mon[28802]: pgmap v255: 65 pgs: 65 active+clean; 585 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.3 KiB/s rd, 597 B/s wr, 2 op/s 2024-02-28T23:04:28.992 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:04:30.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:30 smithi159 ceph-mon[28802]: pgmap v256: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-02-28T23:04:30.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:30 smithi184 ceph-mon[36198]: pgmap v256: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2024-02-28T23:04:31.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.305+0000 7f3102a00700 1 -- 172.21.15.159:0/2143532059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc100cb0 msgr2=0x7f30fc101110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:31.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.305+0000 7f3102a00700 1 --2- 172.21.15.159:0/2143532059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc100cb0 0x7f30fc101110 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f30e8009910 tx=0x7f30e8009c20 comp rx=0 tx=0).stop 2024-02-28T23:04:31.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.305+0000 7f3102a00700 1 -- 172.21.15.159:0/2143532059 shutdown_connections 2024-02-28T23:04:31.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.305+0000 7f3102a00700 1 --2- 172.21.15.159:0/2143532059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc100cb0 0x7f30fc101110 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:31.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.305+0000 7f3102a00700 1 --2- 172.21.15.159:0/2143532059 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30fc0ffab0 0x7f30fc0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:31.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.305+0000 7f3102a00700 1 -- 172.21.15.159:0/2143532059 >> 172.21.15.159:0/2143532059 conn(0x7f30fc0fb050 msgr2=0x7f30fc0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:04:31.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.305+0000 7f3102a00700 1 -- 172.21.15.159:0/2143532059 shutdown_connections 2024-02-28T23:04:31.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.305+0000 7f3102a00700 1 -- 172.21.15.159:0/2143532059 wait complete. 2024-02-28T23:04:31.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.307+0000 7f3102a00700 1 Processor -- start 2024-02-28T23:04:31.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.307+0000 7f3102a00700 1 -- start start 2024-02-28T23:04:31.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.307+0000 7f3102a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30fc0ffab0 0x7f30fc196410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:31.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.307+0000 7f3102a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc100cb0 0x7f30fc196950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:31.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.307+0000 7f3102a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc196f70 con 0x7f30fc100cb0 2024-02-28T23:04:31.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.307+0000 7f3102a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc1970b0 con 0x7f30fc0ffab0 2024-02-28T23:04:31.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.308+0000 7f30fb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc100cb0 0x7f30fc196950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:31.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.308+0000 7f30fb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc100cb0 0x7f30fc196950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53882/0 (socket says 172.21.15.159:53882) 2024-02-28T23:04:31.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.308+0000 7f30fb400700 1 -- 172.21.15.159:0/3360527002 learned_addr learned my addr 172.21.15.159:0/3360527002 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:04:31.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.308+0000 7f30fbe00700 1 --2- 172.21.15.159:0/3360527002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30fc0ffab0 0x7f30fc196410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:31.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.308+0000 7f30fb400700 1 -- 172.21.15.159:0/3360527002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30fc0ffab0 msgr2=0x7f30fc196410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:04:31.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.308+0000 7f30fb400700 1 --2- 172.21.15.159:0/3360527002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30fc0ffab0 0x7f30fc196410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:04:31.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.308+0000 7f30fb400700 1 -- 172.21.15.159:0/3360527002 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e80095f0 con 0x7f30fc100cb0 2024-02-28T23:04:31.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.308+0000 7f30fb400700 1 --2- 172.21.15.159:0/3360527002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc100cb0 0x7f30fc196950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f30e800b5c0 tx=0x7f30e800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:31.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.309+0000 7f30f8c00700 1 -- 172.21.15.159:0/3360527002 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e801d070 con 0x7f30fc100cb0 2024-02-28T23:04:31.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.309+0000 7f30f8c00700 1 -- 172.21.15.159:0/3360527002 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f30e8022470 con 0x7f30fc100cb0 2024-02-28T23:04:31.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.309+0000 7f30f8c00700 1 -- 172.21.15.159:0/3360527002 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30e800f690 con 0x7f30fc100cb0 2024-02-28T23:04:31.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.309+0000 7f3102a00700 1 -- 172.21.15.159:0/3360527002 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30fc19bb00 con 0x7f30fc100cb0 2024-02-28T23:04:31.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.309+0000 7f3102a00700 1 -- 172.21.15.159:0/3360527002 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc19c070 con 0x7f30fc100cb0 2024-02-28T23:04:31.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.310+0000 7f3102a00700 1 -- 172.21.15.159:0/3360527002 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc1086b0 con 0x7f30fc100cb0 2024-02-28T23:04:31.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.311+0000 7f30f8c00700 1 -- 172.21.15.159:0/3360527002 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f30e8004b70 con 0x7f30fc100cb0 2024-02-28T23:04:31.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.312+0000 7f30f8c00700 1 --2- 172.21.15.159:0/3360527002 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f30e006c4e0 0x7f30e006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:04:31.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.312+0000 7f30f8c00700 1 -- 172.21.15.159:0/3360527002 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f30e808d080 con 0x7f30fc100cb0 2024-02-28T23:04:31.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.312+0000 7f30fbe00700 1 --2- 172.21.15.159:0/3360527002 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f30e006c4e0 0x7f30e006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:04:31.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.313+0000 7f30fbe00700 1 --2- 172.21.15.159:0/3360527002 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f30e006c4e0 0x7f30e006e9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f30ec006fd0 tx=0x7f30ec008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:04:31.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.318+0000 7f30f8c00700 1 -- 172.21.15.159:0/3360527002 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f30e805b2a0 con 0x7f30fc100cb0 2024-02-28T23:04:31.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:04:31.560+0000 7f3102a00700 1 -- 172.21.15.159:0/3360527002 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f30fc069460 con 0x7f30e006c4e0 2024-02-28T23:04:32.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:32 smithi184 ceph-mon[36198]: pgmap v257: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 938 B/s wr, 2 op/s 2024-02-28T23:04:32.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:32 smithi159 ceph-mon[28802]: pgmap v257: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 938 B/s wr, 2 op/s 2024-02-28T23:04:33.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:33 smithi184 ceph-mon[36198]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:04:33.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:33 smithi159 ceph-mon[28802]: from='client.14550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:04:34.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:34 smithi184 ceph-mon[36198]: pgmap v258: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 938 B/s wr, 3 op/s 2024-02-28T23:04:34.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:34 smithi159 ceph-mon[28802]: pgmap v258: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 938 B/s wr, 3 op/s 2024-02-28T23:04:35.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:04:35.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:04:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:36 smithi159 ceph-mon[28802]: pgmap v259: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-28T23:04:36.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:36 smithi184 ceph-mon[36198]: pgmap v259: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-28T23:04:38.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:38 smithi184 ceph-mon[36198]: pgmap v260: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-28T23:04:38.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:38 smithi159 ceph-mon[28802]: pgmap v260: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-28T23:04:40.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:40 smithi184 ceph-mon[36198]: pgmap v261: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-28T23:04:40.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:40 smithi159 ceph-mon[28802]: pgmap v261: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 511 B/s wr, 2 op/s 2024-02-28T23:04:42.830 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:42 smithi184 ceph-mon[36198]: pgmap v262: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:04:42.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:42 smithi159 ceph-mon[28802]: pgmap v262: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:04:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:44 smithi184 ceph-mon[36198]: pgmap v263: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:04:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:44 smithi159 ceph-mon[28802]: pgmap v263: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:04:45.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:45 smithi184 ceph-mon[36198]: pgmap v264: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:04:45.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:45 smithi159 ceph-mon[28802]: pgmap v264: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:04:48.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:48 smithi184 ceph-mon[36198]: pgmap v265: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:04:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:48 smithi159 ceph-mon[28802]: pgmap v265: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:04:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:50 smithi184 ceph-mon[36198]: pgmap v266: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:04:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:04:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:50 smithi159 ceph-mon[28802]: pgmap v266: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:04:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:04:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:52 smithi184 ceph-mon[36198]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:04:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:52 smithi159 ceph-mon[28802]: pgmap v267: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:04:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:54 smithi184 ceph-mon[36198]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:04:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:54 smithi159 ceph-mon[28802]: pgmap v268: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:04:56.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:56 smithi184 ceph-mon[36198]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:04:56.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:56 smithi159 ceph-mon[28802]: pgmap v269: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:04:58.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:04:58 smithi184 ceph-mon[36198]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:04:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:04:58 smithi159 ceph-mon[28802]: pgmap v270: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:05:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:00 smithi159 ceph-mon[28802]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:00.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:00 smithi184 ceph-mon[36198]: pgmap v271: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:02 smithi159 ceph-mon[28802]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:05:02.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:02 smithi184 ceph-mon[36198]: pgmap v272: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:05:03.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:03 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:05:03.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:03 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:05:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:04 smithi159 ceph-mon[28802]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:04.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:04 smithi184 ceph-mon[36198]: pgmap v273: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:05.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:05:05.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:05:06.630 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:06 smithi159 ceph-mon[28802]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:06.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:06 smithi184 ceph-mon[36198]: pgmap v274: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:08 smithi159 ceph-mon[28802]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:08.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:08 smithi184 ceph-mon[36198]: pgmap v275: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:10 smithi159 ceph-mon[28802]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:10 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:05:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:10 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:05:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:10 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:10.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:10 smithi184 ceph-mon[36198]: pgmap v276: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:10.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:10 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:05:10.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:10 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:05:10.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:10 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:12.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.419+0000 7f30f8c00700 1 -- 172.21.15.159:0/3360527002 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f30fc069460 con 0x7f30e006c4e0 2024-02-28T23:05:12.420 INFO:teuthology.orchestra.run.smithi159.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:05:12.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.423+0000 7f3102a00700 1 -- 172.21.15.159:0/3360527002 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f30e006c4e0 msgr2=0x7f30e006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:12.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.423+0000 7f3102a00700 1 --2- 172.21.15.159:0/3360527002 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f30e006c4e0 0x7f30e006e9a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f30ec006fd0 tx=0x7f30ec008040 comp rx=0 tx=0).stop 2024-02-28T23:05:12.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.423+0000 7f3102a00700 1 -- 172.21.15.159:0/3360527002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc100cb0 msgr2=0x7f30fc196950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:12.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.423+0000 7f3102a00700 1 --2- 172.21.15.159:0/3360527002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc100cb0 0x7f30fc196950 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f30e800b5c0 tx=0x7f30e800be20 comp rx=0 tx=0).stop 2024-02-28T23:05:12.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.423+0000 7f3102a00700 1 -- 172.21.15.159:0/3360527002 shutdown_connections 2024-02-28T23:05:12.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.423+0000 7f3102a00700 1 --2- 172.21.15.159:0/3360527002 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f30fc0ffab0 0x7f30fc196410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:12.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.423+0000 7f3102a00700 1 --2- 172.21.15.159:0/3360527002 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f30e006c4e0 0x7f30e006e9a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:12.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.423+0000 7f3102a00700 1 --2- 172.21.15.159:0/3360527002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30fc100cb0 0x7f30fc196950 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:12.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.423+0000 7f3102a00700 1 -- 172.21.15.159:0/3360527002 >> 172.21.15.159:0/3360527002 conn(0x7f30fc0fb050 msgr2=0x7f30fc068ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:12.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.423+0000 7f3102a00700 1 -- 172.21.15.159:0/3360527002 shutdown_connections 2024-02-28T23:05:12.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:12.424+0000 7f3102a00700 1 -- 172.21.15.159:0/3360527002 wait complete. 2024-02-28T23:05:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:12 smithi159 ceph-mon[28802]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:12.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:12 smithi184 ceph-mon[36198]: pgmap v277: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:13.241 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-28T23:05:13.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:13 smithi159 ceph-mon[28802]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:05:13.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:13 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:13.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:13 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:05:13.722 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:05:13.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:13 smithi184 ceph-mon[36198]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:05:13.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:13 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:13.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:13 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:05:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:14 smithi159 ceph-mon[28802]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:14.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:05:14.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:05:14.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:14 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:14.751 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:14 smithi184 ceph-mon[36198]: pgmap v278: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:14.751 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:14.751 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:14.751 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:05:14.751 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:05:14.751 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:14 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:15.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:15 smithi159 ceph-mon[28802]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:05:15.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:15 smithi184 ceph-mon[36198]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:05:16.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.501+0000 7f0619000700 1 -- 172.21.15.159:0/3911955537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06140737f0 msgr2=0x7f0614073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:16.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.501+0000 7f0619000700 1 --2- 172.21.15.159:0/3911955537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06140737f0 0x7f0614073c70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0600009870 tx=0x7f0600009b80 comp rx=0 tx=0).stop 2024-02-28T23:05:16.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.501+0000 7f0619000700 1 -- 172.21.15.159:0/3911955537 shutdown_connections 2024-02-28T23:05:16.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.501+0000 7f0619000700 1 --2- 172.21.15.159:0/3911955537 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f06140737f0 0x7f0614073c70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:16.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.501+0000 7f0619000700 1 --2- 172.21.15.159:0/3911955537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0614074dc0 0x7f0614073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:16.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.501+0000 7f0619000700 1 -- 172.21.15.159:0/3911955537 >> 172.21.15.159:0/3911955537 conn(0x7f06140fc110 msgr2=0x7f06140fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:16.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.501+0000 7f0619000700 1 -- 172.21.15.159:0/3911955537 shutdown_connections 2024-02-28T23:05:16.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.501+0000 7f0619000700 1 -- 172.21.15.159:0/3911955537 wait complete. 2024-02-28T23:05:16.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.503+0000 7f0619000700 1 Processor -- start 2024-02-28T23:05:16.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.503+0000 7f0619000700 1 -- start start 2024-02-28T23:05:16.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.504+0000 7f0619000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06140737f0 0x7f061419ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:16.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.504+0000 7f0619000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0614074dc0 0x7f061419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:16.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.504+0000 7f0619000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061419d560 con 0x7f06140737f0 2024-02-28T23:05:16.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.504+0000 7f0619000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f061419d6a0 con 0x7f0614074dc0 2024-02-28T23:05:16.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.504+0000 7f0611400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0614074dc0 0x7f061419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:16.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.504+0000 7f0611e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06140737f0 0x7f061419ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:16.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.504+0000 7f0611400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0614074dc0 0x7f061419cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:47394/0 (socket says 172.21.15.159:47394) 2024-02-28T23:05:16.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.504+0000 7f0611400700 1 -- 172.21.15.159:0/3561154893 learned_addr learned my addr 172.21.15.159:0/3561154893 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:05:16.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.505+0000 7f0611400700 1 -- 172.21.15.159:0/3561154893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06140737f0 msgr2=0x7f061419ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:16.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.505+0000 7f0611400700 1 --2- 172.21.15.159:0/3561154893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06140737f0 0x7f061419ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:16.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.505+0000 7f0611400700 1 -- 172.21.15.159:0/3561154893 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0600009520 con 0x7f0614074dc0 2024-02-28T23:05:16.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.505+0000 7f0611400700 1 --2- 172.21.15.159:0/3561154893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0614074dc0 0x7f061419cf40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0600009f50 tx=0x7f060000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:16.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.506+0000 7f060aa00700 1 -- 172.21.15.159:0/3561154893 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f060001c070 con 0x7f0614074dc0 2024-02-28T23:05:16.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.506+0000 7f060aa00700 1 -- 172.21.15.159:0/3561154893 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f060000be80 con 0x7f0614074dc0 2024-02-28T23:05:16.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.506+0000 7f0619000700 1 -- 172.21.15.159:0/3561154893 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06141a20f0 con 0x7f0614074dc0 2024-02-28T23:05:16.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.506+0000 7f060aa00700 1 -- 172.21.15.159:0/3561154893 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f06000173f0 con 0x7f0614074dc0 2024-02-28T23:05:16.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.506+0000 7f0619000700 1 -- 172.21.15.159:0/3561154893 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06141a25e0 con 0x7f0614074dc0 2024-02-28T23:05:16.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.508+0000 7f0619000700 1 -- 172.21.15.159:0/3561154893 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061410fd40 con 0x7f0614074dc0 2024-02-28T23:05:16.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.509+0000 7f060aa00700 1 -- 172.21.15.159:0/3561154893 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f0600020070 con 0x7f0614074dc0 2024-02-28T23:05:16.511 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:16 smithi159 ceph-mon[28802]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:16.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.512+0000 7f060aa00700 1 --2- 172.21.15.159:0/3561154893 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f05f806c530 0x7f05f806e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:16.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.512+0000 7f060aa00700 1 -- 172.21.15.159:0/3561154893 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f060008cae0 con 0x7f0614074dc0 2024-02-28T23:05:16.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.512+0000 7f0611e00700 1 --2- 172.21.15.159:0/3561154893 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f05f806c530 0x7f05f806e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:16.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.513+0000 7f0611e00700 1 --2- 172.21.15.159:0/3561154893 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f05f806c530 0x7f05f806e9f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06140751a0 tx=0x7f0604009310 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:16.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.520+0000 7f060aa00700 1 -- 172.21.15.159:0/3561154893 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f060005af30 con 0x7f0614074dc0 2024-02-28T23:05:16.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:16 smithi184 ceph-mon[36198]: pgmap v279: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:16.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.960+0000 7f0619000700 1 -- 172.21.15.159:0/3561154893 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0614103b50 con 0x7f05f806c530 2024-02-28T23:05:16.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.962+0000 7f060aa00700 1 -- 172.21.15.159:0/3561154893 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+351 (secure 0 0 0) 0x7f0614103b50 con 0x7f05f806c530 2024-02-28T23:05:16.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.965+0000 7f0619000700 1 -- 172.21.15.159:0/3561154893 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f05f806c530 msgr2=0x7f05f806e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:16.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.965+0000 7f0619000700 1 --2- 172.21.15.159:0/3561154893 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f05f806c530 0x7f05f806e9f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06140751a0 tx=0x7f0604009310 comp rx=0 tx=0).stop 2024-02-28T23:05:16.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.966+0000 7f0619000700 1 -- 172.21.15.159:0/3561154893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0614074dc0 msgr2=0x7f061419cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:16.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.966+0000 7f0619000700 1 --2- 172.21.15.159:0/3561154893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0614074dc0 0x7f061419cf40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0600009f50 tx=0x7f060000f740 comp rx=0 tx=0).stop 2024-02-28T23:05:16.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.966+0000 7f0619000700 1 -- 172.21.15.159:0/3561154893 shutdown_connections 2024-02-28T23:05:16.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.966+0000 7f0619000700 1 --2- 172.21.15.159:0/3561154893 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f05f806c530 0x7f05f806e9f0 secure :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06140751a0 tx=0x7f0604009310 comp rx=0 tx=0).stop 2024-02-28T23:05:16.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.966+0000 7f0619000700 1 --2- 172.21.15.159:0/3561154893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06140737f0 0x7f061419ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:16.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.966+0000 7f0619000700 1 --2- 172.21.15.159:0/3561154893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0614074dc0 0x7f061419cf40 secure :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0600009f50 tx=0x7f060000f740 comp rx=0 tx=0).stop 2024-02-28T23:05:16.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.966+0000 7f0619000700 1 -- 172.21.15.159:0/3561154893 >> 172.21.15.159:0/3561154893 conn(0x7f06140fc110 msgr2=0x7f0614102430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:16.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.966+0000 7f0619000700 1 -- 172.21.15.159:0/3561154893 shutdown_connections 2024-02-28T23:05:16.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:16.967+0000 7f0619000700 1 -- 172.21.15.159:0/3561154893 wait complete. 2024-02-28T23:05:16.988 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:05:17.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.166+0000 7fac4f400700 1 -- 172.21.15.159:0/816924771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac480ffe10 msgr2=0x7fac48100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:17.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.166+0000 7fac4f400700 1 --2- 172.21.15.159:0/816924771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac480ffe10 0x7fac48100290 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fac34009910 tx=0x7fac34009c20 comp rx=0 tx=0).stop 2024-02-28T23:05:17.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.167+0000 7fac4f400700 1 -- 172.21.15.159:0/816924771 shutdown_connections 2024-02-28T23:05:17.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.167+0000 7fac4f400700 1 --2- 172.21.15.159:0/816924771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac480ffe10 0x7fac48100290 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.167+0000 7fac4f400700 1 --2- 172.21.15.159:0/816924771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac480ff4b0 0x7fac480ff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.167+0000 7fac4f400700 1 -- 172.21.15.159:0/816924771 >> 172.21.15.159:0/816924771 conn(0x7fac480fb030 msgr2=0x7fac480fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:17.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.167+0000 7fac4f400700 1 -- 172.21.15.159:0/816924771 shutdown_connections 2024-02-28T23:05:17.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.167+0000 7fac4f400700 1 -- 172.21.15.159:0/816924771 wait complete. 2024-02-28T23:05:17.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.168+0000 7fac4f400700 1 Processor -- start 2024-02-28T23:05:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.168+0000 7fac4f400700 1 -- start start 2024-02-28T23:05:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.169+0000 7fac4f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac480ff4b0 0x7fac48198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.169+0000 7fac4f400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac480ffe10 0x7fac48198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.169+0000 7fac4f400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac48199070 con 0x7fac480ff4b0 2024-02-28T23:05:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.169+0000 7fac4f400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac481991b0 con 0x7fac480ffe10 2024-02-28T23:05:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.169+0000 7fac4ca00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac480ff4b0 0x7fac48198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.169+0000 7fac4ca00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac480ff4b0 0x7fac48198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54450/0 (socket says 172.21.15.159:54450) 2024-02-28T23:05:17.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.169+0000 7fac4ca00700 1 -- 172.21.15.159:0/2344121427 learned_addr learned my addr 172.21.15.159:0/2344121427 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:05:17.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.170+0000 7fac4ca00700 1 -- 172.21.15.159:0/2344121427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac480ffe10 msgr2=0x7fac48198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:17.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.170+0000 7fac4ca00700 1 --2- 172.21.15.159:0/2344121427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac480ffe10 0x7fac48198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.170+0000 7fac4ca00700 1 -- 172.21.15.159:0/2344121427 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac340095f0 con 0x7fac480ff4b0 2024-02-28T23:05:17.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.170+0000 7fac4ca00700 1 --2- 172.21.15.159:0/2344121427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac480ff4b0 0x7fac48198510 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00e920 tx=0x7fac3c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:17.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.170+0000 7fac45600700 1 -- 172.21.15.159:0/2344121427 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3c00cba0 con 0x7fac480ff4b0 2024-02-28T23:05:17.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.171+0000 7fac45600700 1 -- 172.21.15.159:0/2344121427 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fac3c00cd00 con 0x7fac480ff4b0 2024-02-28T23:05:17.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.171+0000 7fac45600700 1 -- 172.21.15.159:0/2344121427 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac3c018770 con 0x7fac480ff4b0 2024-02-28T23:05:17.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.171+0000 7fac4f400700 1 -- 172.21.15.159:0/2344121427 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4819dc60 con 0x7fac480ff4b0 2024-02-28T23:05:17.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.171+0000 7fac4f400700 1 -- 172.21.15.159:0/2344121427 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4819e1b0 con 0x7fac480ff4b0 2024-02-28T23:05:17.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.172+0000 7fac4f400700 1 -- 172.21.15.159:0/2344121427 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac4810b910 con 0x7fac480ff4b0 2024-02-28T23:05:17.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.174+0000 7fac45600700 1 -- 172.21.15.159:0/2344121427 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fac3c010430 con 0x7fac480ff4b0 2024-02-28T23:05:17.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.174+0000 7fac45600700 1 --2- 172.21.15.159:0/2344121427 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fac3006c530 0x7fac3006e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:17.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.175+0000 7fac45600700 1 -- 172.21.15.159:0/2344121427 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fac3c014070 con 0x7fac480ff4b0 2024-02-28T23:05:17.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.175+0000 7fac47e00700 1 --2- 172.21.15.159:0/2344121427 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fac3006c530 0x7fac3006e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:17.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.176+0000 7fac47e00700 1 --2- 172.21.15.159:0/2344121427 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fac3006c530 0x7fac3006e9f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac34006010 tx=0x7fac34009f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:17.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.182+0000 7fac45600700 1 -- 172.21.15.159:0/2344121427 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fac3c05a770 con 0x7fac480ff4b0 2024-02-28T23:05:17.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.543+0000 7fac4f400700 1 -- 172.21.15.159:0/2344121427 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fac48109200 con 0x7fac3006c530 2024-02-28T23:05:17.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.545+0000 7fac45600700 1 -- 172.21.15.159:0/2344121427 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fac48109200 con 0x7fac3006c530 2024-02-28T23:05:17.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.549+0000 7fac4f400700 1 -- 172.21.15.159:0/2344121427 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fac3006c530 msgr2=0x7fac3006e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:17.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.549+0000 7fac4f400700 1 --2- 172.21.15.159:0/2344121427 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fac3006c530 0x7fac3006e9f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac34006010 tx=0x7fac34009f90 comp rx=0 tx=0).stop 2024-02-28T23:05:17.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.549+0000 7fac4f400700 1 -- 172.21.15.159:0/2344121427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac480ff4b0 msgr2=0x7fac48198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:17.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.549+0000 7fac4f400700 1 --2- 172.21.15.159:0/2344121427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac480ff4b0 0x7fac48198510 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fac3c00e920 tx=0x7fac3c00ece0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.549+0000 7fac4f400700 1 -- 172.21.15.159:0/2344121427 shutdown_connections 2024-02-28T23:05:17.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.549+0000 7fac4f400700 1 --2- 172.21.15.159:0/2344121427 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fac3006c530 0x7fac3006e9f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.549+0000 7fac4f400700 1 --2- 172.21.15.159:0/2344121427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac480ff4b0 0x7fac48198510 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.549+0000 7fac4f400700 1 --2- 172.21.15.159:0/2344121427 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac480ffe10 0x7fac48198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.549+0000 7fac4f400700 1 -- 172.21.15.159:0/2344121427 >> 172.21.15.159:0/2344121427 conn(0x7fac480fb030 msgr2=0x7fac48107ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:17.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.550+0000 7fac4f400700 1 -- 172.21.15.159:0/2344121427 shutdown_connections 2024-02-28T23:05:17.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.550+0000 7fac4f400700 1 -- 172.21.15.159:0/2344121427 wait complete. 2024-02-28T23:05:17.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.696+0000 7fbcdea00700 1 -- 172.21.15.159:0/1000388216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcd80737f0 msgr2=0x7fbcd8073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:17.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.696+0000 7fbcdea00700 1 --2- 172.21.15.159:0/1000388216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcd80737f0 0x7fbcd8073c70 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009910 tx=0x7fbcc4009c20 comp rx=0 tx=0).stop 2024-02-28T23:05:17.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.697+0000 7fbcdea00700 1 -- 172.21.15.159:0/1000388216 shutdown_connections 2024-02-28T23:05:17.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.697+0000 7fbcdea00700 1 --2- 172.21.15.159:0/1000388216 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcd80737f0 0x7fbcd8073c70 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.697+0000 7fbcdea00700 1 --2- 172.21.15.159:0/1000388216 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd8074dc0 0x7fbcd8073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.697+0000 7fbcdea00700 1 -- 172.21.15.159:0/1000388216 >> 172.21.15.159:0/1000388216 conn(0x7fbcd80fc110 msgr2=0x7fbcd80fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:17.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.697+0000 7fbcdea00700 1 -- 172.21.15.159:0/1000388216 shutdown_connections 2024-02-28T23:05:17.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.697+0000 7fbcdea00700 1 -- 172.21.15.159:0/1000388216 wait complete. 2024-02-28T23:05:17.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.699+0000 7fbcdea00700 1 Processor -- start 2024-02-28T23:05:17.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.699+0000 7fbcdea00700 1 -- start start 2024-02-28T23:05:17.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.699+0000 7fbcdea00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd80737f0 0x7fbcd81985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:17.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.699+0000 7fbcdea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcd8074dc0 0x7fbcd8198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:17.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.699+0000 7fbcdea00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd8199110 con 0x7fbcd8074dc0 2024-02-28T23:05:17.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.699+0000 7fbcdea00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcd8199250 con 0x7fbcd80737f0 2024-02-28T23:05:17.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.700+0000 7fbcd7e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd80737f0 0x7fbcd81985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:17.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.700+0000 7fbcd7e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd80737f0 0x7fbcd81985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:47430/0 (socket says 172.21.15.159:47430) 2024-02-28T23:05:17.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.700+0000 7fbcd7e00700 1 -- 172.21.15.159:0/2059728782 learned_addr learned my addr 172.21.15.159:0/2059728782 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:05:17.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.700+0000 7fbcd7400700 1 --2- 172.21.15.159:0/2059728782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcd8074dc0 0x7fbcd8198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:17.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.700+0000 7fbcd7400700 1 -- 172.21.15.159:0/2059728782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd80737f0 msgr2=0x7fbcd81985b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:17.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.700+0000 7fbcd7400700 1 --2- 172.21.15.159:0/2059728782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd80737f0 0x7fbcd81985b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.700+0000 7fbcd7400700 1 -- 172.21.15.159:0/2059728782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc40095f0 con 0x7fbcd8074dc0 2024-02-28T23:05:17.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.701+0000 7fbcd7400700 1 --2- 172.21.15.159:0/2059728782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcd8074dc0 0x7fbcd8198af0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4000c00 tx=0x7fbcc400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:17.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.701+0000 7fbcd4c00700 1 -- 172.21.15.159:0/2059728782 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcc401d070 con 0x7fbcd8074dc0 2024-02-28T23:05:17.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.701+0000 7fbcd4c00700 1 -- 172.21.15.159:0/2059728782 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbcc4005dc0 con 0x7fbcd8074dc0 2024-02-28T23:05:17.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.701+0000 7fbcd4c00700 1 -- 172.21.15.159:0/2059728782 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcc4021410 con 0x7fbcd8074dc0 2024-02-28T23:05:17.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.701+0000 7fbcdea00700 1 -- 172.21.15.159:0/2059728782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcd819dca0 con 0x7fbcd8074dc0 2024-02-28T23:05:17.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.702+0000 7fbcdea00700 1 -- 172.21.15.159:0/2059728782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcd819e190 con 0x7fbcd8074dc0 2024-02-28T23:05:17.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.703+0000 7fbcdea00700 1 -- 172.21.15.159:0/2059728782 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcd810b940 con 0x7fbcd8074dc0 2024-02-28T23:05:17.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.705+0000 7fbcd4c00700 1 -- 172.21.15.159:0/2059728782 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fbcc400f7d0 con 0x7fbcd8074dc0 2024-02-28T23:05:17.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.706+0000 7fbcd4c00700 1 --2- 172.21.15.159:0/2059728782 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbcbc06c4e0 0x7fbcbc06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:17.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.707+0000 7fbcd4c00700 1 -- 172.21.15.159:0/2059728782 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fbcc408ce70 con 0x7fbcd8074dc0 2024-02-28T23:05:17.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.708+0000 7fbcd7e00700 1 --2- 172.21.15.159:0/2059728782 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbcbc06c4e0 0x7fbcbc06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:17.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.709+0000 7fbcd7e00700 1 --2- 172.21.15.159:0/2059728782 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbcbc06c4e0 0x7fbcbc06e9a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800bd10 tx=0x7fbcc800b480 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:17.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.710+0000 7fbcd4c00700 1 -- 172.21.15.159:0/2059728782 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fbcc405b0e0 con 0x7fbcd8074dc0 2024-02-28T23:05:17.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.930+0000 7fbcdea00700 1 -- 172.21.15.159:0/2059728782 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbcd81080b0 con 0x7fbcbc06c4e0 2024-02-28T23:05:17.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.950+0000 7fbcd4c00700 1 -- 172.21.15.159:0/2059728782 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3528 (secure 0 0 0) 0x7fbcd81080b0 con 0x7fbcbc06c4e0 2024-02-28T23:05:17.949 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:05:17.949 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (7m) 75s ago 9m 13.2M - 0.25.0 c8568f914cd2 2b2966e86e70 2024-02-28T23:05:17.950 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (9m) 75s ago 9m 7604k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:05:17.950 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (7m) 80s ago 7m 7277k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:05:17.950 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (9m) 75s ago 9m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:05:17.950 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (7m) 80s ago 7m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:05:17.950 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (6m) 75s ago 8m 74.1M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:05:17.950 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (101s) 75s ago 101s 14.3M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:05:17.950 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (111s) 75s ago 110s 12.9M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:05:17.950 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (107s) 80s ago 107s 11.5M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:05:17.950 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (98s) 80s ago 97s 11.6M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:05:17.950 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:9283,8765,8443 running (10m) 75s ago 10m 490M - 18.2.1 5be31c24972a f518a1599079 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (7m) 80s ago 7m 441M - 18.2.1 5be31c24972a 377a08f00bbd 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (10m) 75s ago 11m 43.5M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (7m) 80s ago 7m 34.3M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (9m) 75s ago 9m 7906k - 1.5.0 0da6a335fe13 009475616a7b 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (7m) 80s ago 7m 7587k - 1.5.0 0da6a335fe13 a45ab4136b88 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (6m) 75s ago 6m 46.7M 3947M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (5m) 75s ago 5m 47.2M 3947M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (5m) 75s ago 5m 45.6M 3947M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (4m) 80s ago 4m 45.2M 4971M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (4m) 80s ago 4m 42.9M 4971M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (3m) 80s ago 3m 42.5M 4971M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:05:17.951 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (6m) 75s ago 8m 47.8M - 2.43.0 a07b618ecd1d abc97d603adc 2024-02-28T23:05:17.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.953+0000 7fbcdea00700 1 -- 172.21.15.159:0/2059728782 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbcbc06c4e0 msgr2=0x7fbcbc06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:17.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.953+0000 7fbcdea00700 1 --2- 172.21.15.159:0/2059728782 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbcbc06c4e0 0x7fbcbc06e9a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbcc800bd10 tx=0x7fbcc800b480 comp rx=0 tx=0).stop 2024-02-28T23:05:17.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.953+0000 7fbcdea00700 1 -- 172.21.15.159:0/2059728782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcd8074dc0 msgr2=0x7fbcd8198af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:17.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.953+0000 7fbcdea00700 1 --2- 172.21.15.159:0/2059728782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcd8074dc0 0x7fbcd8198af0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4000c00 tx=0x7fbcc400bd70 comp rx=0 tx=0).stop 2024-02-28T23:05:17.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.953+0000 7fbcdea00700 1 -- 172.21.15.159:0/2059728782 shutdown_connections 2024-02-28T23:05:17.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.953+0000 7fbcdea00700 1 --2- 172.21.15.159:0/2059728782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbcd80737f0 0x7fbcd81985b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.953+0000 7fbcdea00700 1 --2- 172.21.15.159:0/2059728782 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fbcbc06c4e0 0x7fbcbc06e9a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.953+0000 7fbcdea00700 1 --2- 172.21.15.159:0/2059728782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbcd8074dc0 0x7fbcd8198af0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:17.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.953+0000 7fbcdea00700 1 -- 172.21.15.159:0/2059728782 >> 172.21.15.159:0/2059728782 conn(0x7fbcd80fc110 msgr2=0x7fbcd8106990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:17.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.954+0000 7fbcdea00700 1 -- 172.21.15.159:0/2059728782 shutdown_connections 2024-02-28T23:05:17.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:17.954+0000 7fbcdea00700 1 -- 172.21.15.159:0/2059728782 wait complete. 2024-02-28T23:05:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.109+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3047377880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9dc101db0 msgr2=0x7fd9dc102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.109+0000 7fd9e3e00700 1 --2- 172.21.15.159:0/3047377880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9dc101db0 0x7fd9dc102210 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009910 tx=0x7fd9c8009c20 comp rx=0 tx=0).stop 2024-02-28T23:05:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.109+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3047377880 shutdown_connections 2024-02-28T23:05:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.109+0000 7fd9e3e00700 1 --2- 172.21.15.159:0/3047377880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9dc101db0 0x7fd9dc102210 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:18.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.109+0000 7fd9e3e00700 1 --2- 172.21.15.159:0/3047377880 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc100bb0 0x7fd9dc100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:18.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.109+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3047377880 >> 172.21.15.159:0/3047377880 conn(0x7fd9dc0fc110 msgr2=0x7fd9dc0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:18.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.110+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3047377880 shutdown_connections 2024-02-28T23:05:18.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.110+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3047377880 wait complete. 2024-02-28T23:05:18.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.111+0000 7fd9e3e00700 1 Processor -- start 2024-02-28T23:05:18.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.111+0000 7fd9e3e00700 1 -- start start 2024-02-28T23:05:18.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.112+0000 7fd9e3e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc100bb0 0x7fd9dc196360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:18.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.112+0000 7fd9e3e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9dc101db0 0x7fd9dc1968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:18.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.112+0000 7fd9e3e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc196ec0 con 0x7fd9dc101db0 2024-02-28T23:05:18.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.112+0000 7fd9e3e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9dc197000 con 0x7fd9dc100bb0 2024-02-28T23:05:18.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.112+0000 7fd9e0a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9dc101db0 0x7fd9dc1968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:18.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.112+0000 7fd9e1400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc100bb0 0x7fd9dc196360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:18.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.112+0000 7fd9e0a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9dc101db0 0x7fd9dc1968a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46170/0 (socket says 172.21.15.159:46170) 2024-02-28T23:05:18.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.112+0000 7fd9e1400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc100bb0 0x7fd9dc196360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:44204/0 (socket says 172.21.15.159:44204) 2024-02-28T23:05:18.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.112+0000 7fd9e0a00700 1 -- 172.21.15.159:0/3616320612 learned_addr learned my addr 172.21.15.159:0/3616320612 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:05:18.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.113+0000 7fd9e0a00700 1 -- 172.21.15.159:0/3616320612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc100bb0 msgr2=0x7fd9dc196360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:18.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.113+0000 7fd9e0a00700 1 --2- 172.21.15.159:0/3616320612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc100bb0 0x7fd9dc196360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:18.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.113+0000 7fd9e0a00700 1 -- 172.21.15.159:0/3616320612 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80095f0 con 0x7fd9dc101db0 2024-02-28T23:05:18.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.113+0000 7fd9e1400700 1 --2- 172.21.15.159:0/3616320612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc100bb0 0x7fd9dc196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T23:05:18.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.113+0000 7fd9e0a00700 1 --2- 172.21.15.159:0/3616320612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9dc101db0 0x7fd9dc1968a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8000c00 tx=0x7fd9c800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:18.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.114+0000 7fd9da000700 1 -- 172.21.15.159:0/3616320612 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9c801d070 con 0x7fd9dc101db0 2024-02-28T23:05:18.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.114+0000 7fd9da000700 1 -- 172.21.15.159:0/3616320612 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd9c8005dc0 con 0x7fd9dc101db0 2024-02-28T23:05:18.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.114+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3616320612 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9dc19ba50 con 0x7fd9dc101db0 2024-02-28T23:05:18.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.114+0000 7fd9da000700 1 -- 172.21.15.159:0/3616320612 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd9c80226a0 con 0x7fd9dc101db0 2024-02-28T23:05:18.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.114+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3616320612 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9dc19bf40 con 0x7fd9dc101db0 2024-02-28T23:05:18.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.115+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3616320612 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9dc109710 con 0x7fd9dc101db0 2024-02-28T23:05:18.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.118+0000 7fd9da000700 1 -- 172.21.15.159:0/3616320612 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fd9c80038f0 con 0x7fd9dc101db0 2024-02-28T23:05:18.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.119+0000 7fd9da000700 1 --2- 172.21.15.159:0/3616320612 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd9c406c530 0x7fd9c406e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:18.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.119+0000 7fd9da000700 1 -- 172.21.15.159:0/3616320612 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd9c808d0b0 con 0x7fd9dc101db0 2024-02-28T23:05:18.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.119+0000 7fd9e1400700 1 --2- 172.21.15.159:0/3616320612 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd9c406c530 0x7fd9c406e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:18.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.122+0000 7fd9da000700 1 -- 172.21.15.159:0/3616320612 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd9c805b320 con 0x7fd9dc101db0 2024-02-28T23:05:18.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.122+0000 7fd9e1400700 1 --2- 172.21.15.159:0/3616320612 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd9c406c530 0x7fd9c406e9f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc101c10 tx=0x7fd9d0009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:18.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:18 smithi159 ceph-mon[28802]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:18.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:18.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:18 smithi159 ceph-mon[28802]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (unknown) 2024-02-28T23:05:18.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:18 smithi159 ceph-mon[28802]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T23:05:18.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:05:18.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:18 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:18.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:18 smithi159 ceph-mon[28802]: Upgrade: Need to upgrade myself (mgr.smithi159.pobewk) 2024-02-28T23:05:18.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:18 smithi159 ceph-mon[28802]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:18.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:18 smithi159 ceph-mon[28802]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:18.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:18 smithi184 ceph-mon[36198]: from='client.24319 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:18.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:18.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:18 smithi184 ceph-mon[36198]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (unknown) 2024-02-28T23:05:18.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:18 smithi184 ceph-mon[36198]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T23:05:18.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:05:18.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:18 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:18.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:18 smithi184 ceph-mon[36198]: Upgrade: Need to upgrade myself (mgr.smithi159.pobewk) 2024-02-28T23:05:18.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:18 smithi184 ceph-mon[36198]: pgmap v280: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:18.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:18 smithi184 ceph-mon[36198]: from='client.14558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:18.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.527+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3616320612 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd9dc109900 con 0x7fd9dc101db0 2024-02-28T23:05:18.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.528+0000 7fd9da000700 1 -- 172.21.15.159:0/3616320612 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fd9c805aeb0 con 0x7fd9dc101db0 2024-02-28T23:05:18.528 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:05:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:05:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:05:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:05:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:05:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:05:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:05:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:05:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:05:18.528 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:05:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:05:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:05:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:05:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:05:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 14 2024-02-28T23:05:18.529 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:05:18.529 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:05:18.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.531+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3616320612 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd9c406c530 msgr2=0x7fd9c406e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:18.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.531+0000 7fd9e3e00700 1 --2- 172.21.15.159:0/3616320612 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd9c406c530 0x7fd9c406e9f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9dc101c10 tx=0x7fd9d0009260 comp rx=0 tx=0).stop 2024-02-28T23:05:18.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.531+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3616320612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9dc101db0 msgr2=0x7fd9dc1968a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:18.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.531+0000 7fd9e3e00700 1 --2- 172.21.15.159:0/3616320612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9dc101db0 0x7fd9dc1968a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8000c00 tx=0x7fd9c800f690 comp rx=0 tx=0).stop 2024-02-28T23:05:18.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.532+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3616320612 shutdown_connections 2024-02-28T23:05:18.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.532+0000 7fd9e3e00700 1 --2- 172.21.15.159:0/3616320612 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd9dc100bb0 0x7fd9dc196360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:18.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.532+0000 7fd9e3e00700 1 --2- 172.21.15.159:0/3616320612 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd9c406c530 0x7fd9c406e9f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:18.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.532+0000 7fd9e3e00700 1 --2- 172.21.15.159:0/3616320612 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd9dc101db0 0x7fd9dc1968a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:18.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.532+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3616320612 >> 172.21.15.159:0/3616320612 conn(0x7fd9dc0fc110 msgr2=0x7fd9dc104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:18.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.532+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3616320612 shutdown_connections 2024-02-28T23:05:18.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.532+0000 7fd9e3e00700 1 -- 172.21.15.159:0/3616320612 wait complete. 2024-02-28T23:05:18.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.738+0000 7fd28f200700 1 -- 172.21.15.159:0/3188704411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd290101470 msgr2=0x7fd290103860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:18.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.738+0000 7fd28f200700 1 --2- 172.21.15.159:0/3188704411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd290101470 0x7fd290103860 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd280009910 tx=0x7fd280009c20 comp rx=0 tx=0).stop 2024-02-28T23:05:18.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.738+0000 7fd28f200700 1 -- 172.21.15.159:0/3188704411 shutdown_connections 2024-02-28T23:05:18.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.738+0000 7fd28f200700 1 --2- 172.21.15.159:0/3188704411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd290103da0 0x7fd290106190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:18.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.738+0000 7fd28f200700 1 --2- 172.21.15.159:0/3188704411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd290101470 0x7fd290103860 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:18.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.738+0000 7fd28f200700 1 -- 172.21.15.159:0/3188704411 >> 172.21.15.159:0/3188704411 conn(0x7fd2900fae40 msgr2=0x7fd2900fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:18.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.739+0000 7fd28f200700 1 -- 172.21.15.159:0/3188704411 shutdown_connections 2024-02-28T23:05:18.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.739+0000 7fd28f200700 1 -- 172.21.15.159:0/3188704411 wait complete. 2024-02-28T23:05:18.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.740+0000 7fd28f200700 1 Processor -- start 2024-02-28T23:05:18.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.740+0000 7fd28f200700 1 -- start start 2024-02-28T23:05:18.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.740+0000 7fd28f200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd290101470 0x7fd290198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:18.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.740+0000 7fd28f200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd290103da0 0x7fd2901988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:18.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.740+0000 7fd28f200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290198ec0 con 0x7fd290103da0 2024-02-28T23:05:18.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.740+0000 7fd28f200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290199000 con 0x7fd290101470 2024-02-28T23:05:18.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.741+0000 7fd28de00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd290101470 0x7fd290198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:18.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.741+0000 7fd28d400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd290103da0 0x7fd2901988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:18.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.741+0000 7fd28d400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd290103da0 0x7fd2901988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:46188/0 (socket says 172.21.15.159:46188) 2024-02-28T23:05:18.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.741+0000 7fd28d400700 1 -- 172.21.15.159:0/2844871922 learned_addr learned my addr 172.21.15.159:0/2844871922 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:05:18.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.741+0000 7fd28d400700 1 -- 172.21.15.159:0/2844871922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd290101470 msgr2=0x7fd290198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:18.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.741+0000 7fd28d400700 1 --2- 172.21.15.159:0/2844871922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd290101470 0x7fd290198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:18.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.741+0000 7fd28d400700 1 -- 172.21.15.159:0/2844871922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2800095f0 con 0x7fd290103da0 2024-02-28T23:05:18.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.742+0000 7fd28d400700 1 --2- 172.21.15.159:0/2844871922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd290103da0 0x7fd2901988a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00e920 tx=0x7fd27c00ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:18.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.742+0000 7fd286a00700 1 -- 172.21.15.159:0/2844871922 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27c009790 con 0x7fd290103da0 2024-02-28T23:05:18.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.742+0000 7fd28f200700 1 -- 172.21.15.159:0/2844871922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd29019dab0 con 0x7fd290103da0 2024-02-28T23:05:18.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.742+0000 7fd286a00700 1 -- 172.21.15.159:0/2844871922 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd27c00cba0 con 0x7fd290103da0 2024-02-28T23:05:18.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.742+0000 7fd286a00700 1 -- 172.21.15.159:0/2844871922 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd27c018630 con 0x7fd290103da0 2024-02-28T23:05:18.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.743+0000 7fd28f200700 1 -- 172.21.15.159:0/2844871922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd29019e000 con 0x7fd290103da0 2024-02-28T23:05:18.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.744+0000 7fd28f200700 1 -- 172.21.15.159:0/2844871922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2900fca50 con 0x7fd290103da0 2024-02-28T23:05:18.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.745+0000 7fd286a00700 1 -- 172.21.15.159:0/2844871922 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fd27c00cd10 con 0x7fd290103da0 2024-02-28T23:05:18.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.746+0000 7fd286a00700 1 --2- 172.21.15.159:0/2844871922 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd27406c4e0 0x7fd27406e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:18.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.746+0000 7fd286a00700 1 -- 172.21.15.159:0/2844871922 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fd27c014070 con 0x7fd290103da0 2024-02-28T23:05:18.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.748+0000 7fd28de00700 1 --2- 172.21.15.159:0/2844871922 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd27406c4e0 0x7fd27406e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:18.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.748+0000 7fd28de00700 1 --2- 172.21.15.159:0/2844871922 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd27406c4e0 0x7fd27406e9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd28000b6f0 tx=0x7fd280009f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:18.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:18.755+0000 7fd286a00700 1 -- 172.21.15.159:0/2844871922 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fd27c0520e0 con 0x7fd290103da0 2024-02-28T23:05:19.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.198+0000 7fd28f200700 1 -- 172.21.15.159:0/2844871922 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2900611d0 con 0x7fd27406c4e0 2024-02-28T23:05:19.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.200+0000 7fd286a00700 1 -- 172.21.15.159:0/2844871922 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fd2900611d0 con 0x7fd27406c4e0 2024-02-28T23:05:19.200 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:05:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:05:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:05:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:05:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [], 2024-02-28T23:05:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "0/2 daemons upgraded", 2024-02-28T23:05:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc image on host smithi184", 2024-02-28T23:05:19.200 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:05:19.200 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:05:19.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.203+0000 7fd28f200700 1 -- 172.21.15.159:0/2844871922 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd27406c4e0 msgr2=0x7fd27406e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:19.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.203+0000 7fd28f200700 1 --2- 172.21.15.159:0/2844871922 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd27406c4e0 0x7fd27406e9a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd28000b6f0 tx=0x7fd280009f90 comp rx=0 tx=0).stop 2024-02-28T23:05:19.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.203+0000 7fd28f200700 1 -- 172.21.15.159:0/2844871922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd290103da0 msgr2=0x7fd2901988a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:19.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.203+0000 7fd28f200700 1 --2- 172.21.15.159:0/2844871922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd290103da0 0x7fd2901988a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd27c00e920 tx=0x7fd27c00ece0 comp rx=0 tx=0).stop 2024-02-28T23:05:19.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.204+0000 7fd28f200700 1 -- 172.21.15.159:0/2844871922 shutdown_connections 2024-02-28T23:05:19.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.204+0000 7fd28f200700 1 --2- 172.21.15.159:0/2844871922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd290101470 0x7fd290198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:19.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.204+0000 7fd28f200700 1 --2- 172.21.15.159:0/2844871922 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fd27406c4e0 0x7fd27406e9a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:19.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.204+0000 7fd28f200700 1 --2- 172.21.15.159:0/2844871922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd290103da0 0x7fd2901988a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:19.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.204+0000 7fd28f200700 1 -- 172.21.15.159:0/2844871922 >> 172.21.15.159:0/2844871922 conn(0x7fd2900fae40 msgr2=0x7fd2900ffaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:19.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.204+0000 7fd28f200700 1 -- 172.21.15.159:0/2844871922 shutdown_connections 2024-02-28T23:05:19.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:19.204+0000 7fd28f200700 1 -- 172.21.15.159:0/2844871922 wait complete. 2024-02-28T23:05:19.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:19 smithi159 ceph-mon[28802]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc on smithi184 2024-02-28T23:05:19.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:19 smithi159 ceph-mon[28802]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:19.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:19 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3616320612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:05:19.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:19 smithi184 ceph-mon[36198]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc on smithi184 2024-02-28T23:05:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:19 smithi184 ceph-mon[36198]: from='client.14562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:19 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3616320612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:05:20.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:20 smithi184 ceph-mon[36198]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:20 smithi184 ceph-mon[36198]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:05:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:20 smithi159 ceph-mon[28802]: pgmap v281: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:20 smithi159 ceph-mon[28802]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:05:22.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:22 smithi184 ceph-mon[36198]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:22.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:22 smithi159 ceph-mon[28802]: pgmap v282: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:24.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:24 smithi184 ceph-mon[36198]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:24.607 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:24 smithi159 ceph-mon[28802]: pgmap v283: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:26.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:26 smithi184 ceph-mon[36198]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:26.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:26 smithi159 ceph-mon[28802]: pgmap v284: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:28.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:28 smithi159 ceph-mon[28802]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:28.795 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:28 smithi184 ceph-mon[36198]: pgmap v285: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:30.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:30 smithi159 ceph-mon[28802]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:30.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:30 smithi184 ceph-mon[36198]: pgmap v286: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:32.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:32 smithi159 ceph-mon[28802]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:32.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:32 smithi184 ceph-mon[36198]: pgmap v287: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:34 smithi159 ceph-mon[28802]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:34.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:34 smithi184 ceph-mon[36198]: pgmap v288: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:35 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:05:35.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:35 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:05:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:36 smithi159 ceph-mon[28802]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:36.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:36 smithi184 ceph-mon[36198]: pgmap v289: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:38 smithi159 ceph-mon[28802]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:38.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:38 smithi184 ceph-mon[36198]: pgmap v290: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:40.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:40 smithi159 ceph-mon[28802]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:40.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:40 smithi184 ceph-mon[36198]: pgmap v291: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:42 smithi159 ceph-mon[28802]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:42.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:42 smithi184 ceph-mon[36198]: pgmap v292: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:43.604 INFO:tasks.workunit.client.1.smithi184.stderr:Updating files: 58% (7236/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 95% (11760/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-02-28T23:05:44.053 INFO:tasks.workunit.client.1.smithi184.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr: 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr:state without impacting any branches by switching back to a branch. 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr: 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr: 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr: git switch -c 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr: 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr:Or undo this operation with: 2024-02-28T23:05:44.054 INFO:tasks.workunit.client.1.smithi184.stderr: 2024-02-28T23:05:44.055 INFO:tasks.workunit.client.1.smithi184.stderr: git switch - 2024-02-28T23:05:44.055 INFO:tasks.workunit.client.1.smithi184.stderr: 2024-02-28T23:05:44.055 INFO:tasks.workunit.client.1.smithi184.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-28T23:05:44.055 INFO:tasks.workunit.client.1.smithi184.stderr: 2024-02-28T23:05:44.055 INFO:tasks.workunit.client.1.smithi184.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-02-28T23:05:44.057 DEBUG:teuthology.orchestra.run.smithi184:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-02-28T23:05:44.113 INFO:tasks.workunit.client.1.smithi184.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-28T23:05:44.121 INFO:tasks.workunit.client.1.smithi184.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-28T23:05:44.121 INFO:tasks.workunit.client.1.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-28T23:05:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:44 smithi159 ceph-mon[28802]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:44.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:44 smithi184 ceph-mon[36198]: pgmap v293: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:05:44.851 INFO:tasks.workunit.client.0.smithi159.stderr:Updating files: 57% (7085/12271) Updating files: 58% (7118/12271) Updating files: 59% (7240/12271) Updating files: 60% (7363/12271) Updating files: 61% (7486/12271) Updating files: 62% (7609/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 99% (12231/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-02-28T23:05:45.027 INFO:tasks.workunit.client.1.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-28T23:05:45.173 INFO:tasks.workunit.client.1.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-28T23:05:45.277 INFO:tasks.workunit.client.1.smithi184.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-02-28T23:05:45.283 INFO:tasks.workunit.client.1.smithi184.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-28T23:05:45.283 INFO:tasks.workunit.client.1.smithi184.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-28T23:05:45.365 INFO:tasks.workunit.client.1.smithi184.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-02-28T23:05:45.375 DEBUG:teuthology.orchestra.run.smithi184:> set -ex 2024-02-28T23:05:45.375 DEBUG:teuthology.orchestra.run.smithi184:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-02-28T23:05:45.404 INFO:tasks.workunit.client.0.smithi159.stderr:Note: switching to '1fb5d10608dccee73edd6ef8a2c7b804a097c324'. 2024-02-28T23:05:45.404 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-02-28T23:05:45.404 INFO:tasks.workunit.client.0.smithi159.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-02-28T23:05:45.404 INFO:tasks.workunit.client.0.smithi159.stderr:changes and commit them, and you can discard any commits you make in this 2024-02-28T23:05:45.404 INFO:tasks.workunit.client.0.smithi159.stderr:state without impacting any branches by switching back to a branch. 2024-02-28T23:05:45.404 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr:If you want to create a new branch to retain commits you create, you may 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr:do so (now or later) by using -c with the switch command. Example: 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr: git switch -c 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr:Or undo this operation with: 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr: git switch - 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr: 2024-02-28T23:05:45.405 INFO:tasks.workunit.client.0.smithi159.stderr:HEAD is now at 1fb5d10608d Merge pull request #55565 from BBoozmen/oozmen_avoid_path_normalization 2024-02-28T23:05:45.408 DEBUG:teuthology.orchestra.run.smithi159:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-02-28T23:05:45.421 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-02-28T23:05:45.423 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-28T23:05:45.423 DEBUG:teuthology.orchestra.run.smithi184:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-02-28T23:05:45.479 INFO:tasks.workunit.client.0.smithi159.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-02-28T23:05:45.487 INFO:tasks.workunit.client.0.smithi159.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-28T23:05:45.487 INFO:tasks.workunit.client.0.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-02-28T23:05:45.533 INFO:tasks.workunit.client.1.smithi184.stderr:+ mkdir -p fsstress 2024-02-28T23:05:45.539 INFO:tasks.workunit.client.1.smithi184.stderr:+ pushd fsstress 2024-02-28T23:05:45.543 INFO:tasks.workunit.client.1.smithi184.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T23:05:45.543 INFO:tasks.workunit.client.1.smithi184.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-28T23:05:46.513 INFO:tasks.workunit.client.1.smithi184.stderr:+ tar xzf ltp-full.tgz 2024-02-28T23:05:46.601 INFO:tasks.workunit.client.0.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-02-28T23:05:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:46 smithi159 ceph-mon[28802]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:46.730 INFO:tasks.workunit.client.0.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-02-28T23:05:46.820 INFO:tasks.workunit.client.0.smithi159.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-02-28T23:05:46.827 INFO:tasks.workunit.client.0.smithi159.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-28T23:05:46.827 INFO:tasks.workunit.client.0.smithi159.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-02-28T23:05:46.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:46 smithi184 ceph-mon[36198]: pgmap v294: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:46.911 INFO:tasks.workunit.client.0.smithi159.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-02-28T23:05:46.920 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T23:05:46.920 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-02-28T23:05:46.965 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-02-28T23:05:46.967 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-02-28T23:05:46.968 DEBUG:teuthology.orchestra.run.smithi159:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1fb5d10608dccee73edd6ef8a2c7b804a097c324 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-02-28T23:05:47.085 INFO:tasks.workunit.client.0.smithi159.stderr:+ mkdir -p fsstress 2024-02-28T23:05:47.091 INFO:tasks.workunit.client.0.smithi159.stderr:+ pushd fsstress 2024-02-28T23:05:47.093 INFO:tasks.workunit.client.0.smithi159.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T23:05:47.094 INFO:tasks.workunit.client.0.smithi159.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-02-28T23:05:48.382 INFO:tasks.workunit.client.0.smithi159.stderr:+ tar xzf ltp-full.tgz 2024-02-28T23:05:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:48 smithi159 ceph-mon[28802]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:48.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:48 smithi184 ceph-mon[36198]: pgmap v295: 65 pgs: 65 active+clean; 588 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:05:49.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.412+0000 7fa572800700 1 -- 172.21.15.159:0/2282248071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c103ff0 msgr2=0x7fa56c104450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:49.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.412+0000 7fa572800700 1 --2- 172.21.15.159:0/2282248071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c103ff0 0x7fa56c104450 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa558009870 tx=0x7fa558009b80 comp rx=0 tx=0).stop 2024-02-28T23:05:49.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.412+0000 7fa572800700 1 -- 172.21.15.159:0/2282248071 shutdown_connections 2024-02-28T23:05:49.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.412+0000 7fa572800700 1 --2- 172.21.15.159:0/2282248071 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c103ff0 0x7fa56c104450 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:49.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.412+0000 7fa572800700 1 --2- 172.21.15.159:0/2282248071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa56c102df0 0x7fa56c103210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:49.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.412+0000 7fa572800700 1 -- 172.21.15.159:0/2282248071 >> 172.21.15.159:0/2282248071 conn(0x7fa56c0fe390 msgr2=0x7fa56c1007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:49.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.413+0000 7fa572800700 1 -- 172.21.15.159:0/2282248071 shutdown_connections 2024-02-28T23:05:49.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.413+0000 7fa572800700 1 -- 172.21.15.159:0/2282248071 wait complete. 2024-02-28T23:05:49.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.414+0000 7fa572800700 1 Processor -- start 2024-02-28T23:05:49.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.414+0000 7fa572800700 1 -- start start 2024-02-28T23:05:49.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.415+0000 7fa572800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa56c102df0 0x7fa56c078b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:49.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.415+0000 7fa572800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c103ff0 0x7fa56c079080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:49.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.415+0000 7fa572800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c075630 con 0x7fa56c102df0 2024-02-28T23:05:49.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.415+0000 7fa572800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56c0757a0 con 0x7fa56c103ff0 2024-02-28T23:05:49.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.415+0000 7fa56b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa56c102df0 0x7fa56c078b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:49.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.415+0000 7fa56b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa56c102df0 0x7fa56c078b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58010/0 (socket says 172.21.15.159:58010) 2024-02-28T23:05:49.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.415+0000 7fa56b400700 1 -- 172.21.15.159:0/941614797 learned_addr learned my addr 172.21.15.159:0/941614797 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:05:49.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.416+0000 7fa56aa00700 1 --2- 172.21.15.159:0/941614797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c103ff0 0x7fa56c079080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:49.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.416+0000 7fa56b400700 1 -- 172.21.15.159:0/941614797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c103ff0 msgr2=0x7fa56c079080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:49.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.416+0000 7fa56b400700 1 --2- 172.21.15.159:0/941614797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c103ff0 0x7fa56c079080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:49.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.416+0000 7fa56b400700 1 -- 172.21.15.159:0/941614797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa558009520 con 0x7fa56c102df0 2024-02-28T23:05:49.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.417+0000 7fa56b400700 1 --2- 172.21.15.159:0/941614797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa56c102df0 0x7fa56c078b40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00e970 tx=0x7fa55c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:49.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.417+0000 7fa563e00700 1 -- 172.21.15.159:0/941614797 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa55c0041f0 con 0x7fa56c102df0 2024-02-28T23:05:49.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.417+0000 7fa563e00700 1 -- 172.21.15.159:0/941614797 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa55c00cc70 con 0x7fa56c102df0 2024-02-28T23:05:49.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.417+0000 7fa563e00700 1 -- 172.21.15.159:0/941614797 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa55c003cb0 con 0x7fa56c102df0 2024-02-28T23:05:49.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.417+0000 7fa572800700 1 -- 172.21.15.159:0/941614797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa56c075a80 con 0x7fa56c102df0 2024-02-28T23:05:49.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.417+0000 7fa572800700 1 -- 172.21.15.159:0/941614797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56c076050 con 0x7fa56c102df0 2024-02-28T23:05:49.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.419+0000 7fa572800700 1 -- 172.21.15.159:0/941614797 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56c10b950 con 0x7fa56c102df0 2024-02-28T23:05:49.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.420+0000 7fa563e00700 1 -- 172.21.15.159:0/941614797 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fa55c00c7c0 con 0x7fa56c102df0 2024-02-28T23:05:49.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.421+0000 7fa563e00700 1 --2- 172.21.15.159:0/941614797 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa55006c4e0 0x7fa55006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:49.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.422+0000 7fa563e00700 1 -- 172.21.15.159:0/941614797 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fa55c014070 con 0x7fa56c102df0 2024-02-28T23:05:49.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.422+0000 7fa56aa00700 1 --2- 172.21.15.159:0/941614797 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa55006c4e0 0x7fa55006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:49.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.424+0000 7fa56aa00700 1 --2- 172.21.15.159:0/941614797 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa55006c4e0 0x7fa55006e9a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa558009840 tx=0x7fa558019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:49.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.428+0000 7fa563e00700 1 -- 172.21.15.159:0/941614797 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fa55c059c60 con 0x7fa56c102df0 2024-02-28T23:05:49.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.766+0000 7fa572800700 1 -- 172.21.15.159:0/941614797 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa56c108940 con 0x7fa55006c4e0 2024-02-28T23:05:49.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.768+0000 7fa563e00700 1 -- 172.21.15.159:0/941614797 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fa56c108940 con 0x7fa55006c4e0 2024-02-28T23:05:49.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.771+0000 7fa572800700 1 -- 172.21.15.159:0/941614797 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa55006c4e0 msgr2=0x7fa55006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:49.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.771+0000 7fa572800700 1 --2- 172.21.15.159:0/941614797 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa55006c4e0 0x7fa55006e9a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa558009840 tx=0x7fa558019040 comp rx=0 tx=0).stop 2024-02-28T23:05:49.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.771+0000 7fa572800700 1 -- 172.21.15.159:0/941614797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa56c102df0 msgr2=0x7fa56c078b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:49.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.771+0000 7fa572800700 1 --2- 172.21.15.159:0/941614797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa56c102df0 0x7fa56c078b40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00e970 tx=0x7fa55c00ec80 comp rx=0 tx=0).stop 2024-02-28T23:05:49.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.772+0000 7fa572800700 1 -- 172.21.15.159:0/941614797 shutdown_connections 2024-02-28T23:05:49.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.772+0000 7fa572800700 1 --2- 172.21.15.159:0/941614797 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fa55006c4e0 0x7fa55006e9a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:49.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.772+0000 7fa572800700 1 --2- 172.21.15.159:0/941614797 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa56c102df0 0x7fa56c078b40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:49.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.772+0000 7fa572800700 1 --2- 172.21.15.159:0/941614797 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa56c103ff0 0x7fa56c079080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:49.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.772+0000 7fa572800700 1 -- 172.21.15.159:0/941614797 >> 172.21.15.159:0/941614797 conn(0x7fa56c0fe390 msgr2=0x7fa56c107220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:49.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.772+0000 7fa572800700 1 -- 172.21.15.159:0/941614797 shutdown_connections 2024-02-28T23:05:49.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.772+0000 7fa572800700 1 -- 172.21.15.159:0/941614797 wait complete. 2024-02-28T23:05:49.791 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:05:49.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.971+0000 7f6491c00700 1 -- 172.21.15.159:0/1737159932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f648c0737f0 msgr2=0x7f648c073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:49.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.971+0000 7f6491c00700 1 --2- 172.21.15.159:0/1737159932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f648c0737f0 0x7f648c073c70 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6478009910 tx=0x7f6478009c20 comp rx=0 tx=0).stop 2024-02-28T23:05:49.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.971+0000 7f6491c00700 1 -- 172.21.15.159:0/1737159932 shutdown_connections 2024-02-28T23:05:49.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.971+0000 7f6491c00700 1 --2- 172.21.15.159:0/1737159932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f648c0737f0 0x7f648c073c70 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:49.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.971+0000 7f6491c00700 1 --2- 172.21.15.159:0/1737159932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c074dc0 0x7f648c073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:49.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.971+0000 7f6491c00700 1 -- 172.21.15.159:0/1737159932 >> 172.21.15.159:0/1737159932 conn(0x7f648c0fc110 msgr2=0x7f648c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:49.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.972+0000 7f6491c00700 1 -- 172.21.15.159:0/1737159932 shutdown_connections 2024-02-28T23:05:49.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.972+0000 7f6491c00700 1 -- 172.21.15.159:0/1737159932 wait complete. 2024-02-28T23:05:49.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.973+0000 7f6491c00700 1 Processor -- start 2024-02-28T23:05:49.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.973+0000 7f6491c00700 1 -- start start 2024-02-28T23:05:49.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.974+0000 7f6491c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f648c0737f0 0x7f648c19c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:49.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.974+0000 7f6491c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c074dc0 0x7f648c19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:49.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.974+0000 7f6491c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c19d4f0 con 0x7f648c0737f0 2024-02-28T23:05:49.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.974+0000 7f6491c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648c19d630 con 0x7f648c074dc0 2024-02-28T23:05:49.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.974+0000 7f648aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f648c0737f0 0x7f648c19c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:49.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.974+0000 7f648aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f648c0737f0 0x7f648c19c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58036/0 (socket says 172.21.15.159:58036) 2024-02-28T23:05:49.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.974+0000 7f648aa00700 1 -- 172.21.15.159:0/3842024737 learned_addr learned my addr 172.21.15.159:0/3842024737 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:05:49.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.974+0000 7f648a000700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c074dc0 0x7f648c19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:49.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.975+0000 7f648aa00700 1 -- 172.21.15.159:0/3842024737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c074dc0 msgr2=0x7f648c19ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:49.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.975+0000 7f648aa00700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c074dc0 0x7f648c19ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:49.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.975+0000 7f648aa00700 1 -- 172.21.15.159:0/3842024737 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64780095f0 con 0x7f648c0737f0 2024-02-28T23:05:49.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.975+0000 7f648a000700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c074dc0 0x7f648c19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T23:05:49.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.975+0000 7f648aa00700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f648c0737f0 0x7f648c19c990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f647c00e8f0 tx=0x7f647c00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:49.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.975+0000 7f6483400700 1 -- 172.21.15.159:0/3842024737 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f647c009790 con 0x7f648c0737f0 2024-02-28T23:05:49.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.976+0000 7f6483400700 1 -- 172.21.15.159:0/3842024737 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f647c00c810 con 0x7f648c0737f0 2024-02-28T23:05:49.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.976+0000 7f6491c00700 1 -- 172.21.15.159:0/3842024737 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f648c1a20e0 con 0x7f648c0737f0 2024-02-28T23:05:49.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.976+0000 7f6483400700 1 -- 172.21.15.159:0/3842024737 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f647c0055b0 con 0x7f648c0737f0 2024-02-28T23:05:49.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.976+0000 7f6491c00700 1 -- 172.21.15.159:0/3842024737 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f648c1a2630 con 0x7f648c0737f0 2024-02-28T23:05:49.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.979+0000 7f6483400700 1 -- 172.21.15.159:0/3842024737 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7f647c021440 con 0x7f648c0737f0 2024-02-28T23:05:49.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.980+0000 7f6483400700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f647006c4e0 0x7f647006e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:49.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.980+0000 7f6491c00700 1 -- 172.21.15.159:0/3842024737 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648c10fd40 con 0x7f648c0737f0 2024-02-28T23:05:49.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.980+0000 7f6483400700 1 -- 172.21.15.159:0/3842024737 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f647c014070 con 0x7f648c0737f0 2024-02-28T23:05:49.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.981+0000 7f648a000700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f647006c4e0 0x7f647006e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:49.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.982+0000 7f648a000700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f647006c4e0 0x7f647006e9a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6478009fd0 tx=0x7f6478005fd0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:49.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:49.987+0000 7f6483400700 1 -- 172.21.15.159:0/3842024737 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f647c05ad90 con 0x7f648c0737f0 2024-02-28T23:05:50.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.322+0000 7f6491c00700 1 -- 172.21.15.159:0/3842024737 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f648c103b50 con 0x7f647006c4e0 2024-02-28T23:05:50.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.323+0000 7f6483400700 1 -- 172.21.15.159:0/3842024737 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f648c103b50 con 0x7f647006c4e0 2024-02-28T23:05:50.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.326+0000 7f6491c00700 1 -- 172.21.15.159:0/3842024737 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f647006c4e0 msgr2=0x7f647006e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:50.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.326+0000 7f6491c00700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f647006c4e0 0x7f647006e9a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6478009fd0 tx=0x7f6478005fd0 comp rx=0 tx=0).stop 2024-02-28T23:05:50.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.326+0000 7f6491c00700 1 -- 172.21.15.159:0/3842024737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f648c0737f0 msgr2=0x7f648c19c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:50.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.326+0000 7f6491c00700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f648c0737f0 0x7f648c19c990 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f647c00e8f0 tx=0x7f647c00ec00 comp rx=0 tx=0).stop 2024-02-28T23:05:50.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.326+0000 7f6491c00700 1 -- 172.21.15.159:0/3842024737 shutdown_connections 2024-02-28T23:05:50.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.326+0000 7f6491c00700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f647006c4e0 0x7f647006e9a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:50.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.326+0000 7f6491c00700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f648c0737f0 0x7f648c19c990 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:50.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.326+0000 7f6491c00700 1 --2- 172.21.15.159:0/3842024737 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f648c074dc0 0x7f648c19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:50.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.326+0000 7f6491c00700 1 -- 172.21.15.159:0/3842024737 >> 172.21.15.159:0/3842024737 conn(0x7f648c0fc110 msgr2=0x7f648c102430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:50.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.327+0000 7f6491c00700 1 -- 172.21.15.159:0/3842024737 shutdown_connections 2024-02-28T23:05:50.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.327+0000 7f6491c00700 1 -- 172.21.15.159:0/3842024737 wait complete. 2024-02-28T23:05:50.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.506+0000 7fe94a400700 1 -- 172.21.15.159:0/1650647780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9440ff260 msgr2=0x7fe944101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:50.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.506+0000 7fe94a400700 1 --2- 172.21.15.159:0/1650647780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9440ff260 0x7fe944101690 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe938009910 tx=0x7fe938009c20 comp rx=0 tx=0).stop 2024-02-28T23:05:50.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.506+0000 7fe94a400700 1 -- 172.21.15.159:0/1650647780 shutdown_connections 2024-02-28T23:05:50.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.506+0000 7fe94a400700 1 --2- 172.21.15.159:0/1650647780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe944101bd0 0x7fe944104060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:50.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.506+0000 7fe94a400700 1 --2- 172.21.15.159:0/1650647780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9440ff260 0x7fe944101690 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:50.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.506+0000 7fe94a400700 1 -- 172.21.15.159:0/1650647780 >> 172.21.15.159:0/1650647780 conn(0x7fe9440fae40 msgr2=0x7fe9440fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:50.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.506+0000 7fe94a400700 1 -- 172.21.15.159:0/1650647780 shutdown_connections 2024-02-28T23:05:50.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.506+0000 7fe94a400700 1 -- 172.21.15.159:0/1650647780 wait complete. 2024-02-28T23:05:50.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.507+0000 7fe94a400700 1 Processor -- start 2024-02-28T23:05:50.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.507+0000 7fe94a400700 1 -- start start 2024-02-28T23:05:50.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.508+0000 7fe94a400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9440ff260 0x7fe94419c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:50.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.508+0000 7fe94a400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe944101bd0 0x7fe94419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:50.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.508+0000 7fe94a400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94419d310 con 0x7fe944101bd0 2024-02-28T23:05:50.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.508+0000 7fe94a400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe94419d450 con 0x7fe9440ff260 2024-02-28T23:05:50.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.508+0000 7fe949000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9440ff260 0x7fe94419c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:50.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.508+0000 7fe949000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9440ff260 0x7fe94419c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:33498/0 (socket says 172.21.15.159:33498) 2024-02-28T23:05:50.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.508+0000 7fe949000700 1 -- 172.21.15.159:0/475247357 learned_addr learned my addr 172.21.15.159:0/475247357 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:05:50.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.509+0000 7fe943e00700 1 --2- 172.21.15.159:0/475247357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe944101bd0 0x7fe94419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:50.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.509+0000 7fe949000700 1 -- 172.21.15.159:0/475247357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe944101bd0 msgr2=0x7fe94419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:50.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.509+0000 7fe949000700 1 --2- 172.21.15.159:0/475247357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe944101bd0 0x7fe94419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:50.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.509+0000 7fe949000700 1 -- 172.21.15.159:0/475247357 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9380095f0 con 0x7fe9440ff260 2024-02-28T23:05:50.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.509+0000 7fe949000700 1 --2- 172.21.15.159:0/475247357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9440ff260 0x7fe94419c7b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe938000c00 tx=0x7fe93800f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:50.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.510+0000 7fe941600700 1 -- 172.21.15.159:0/475247357 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe93801d070 con 0x7fe9440ff260 2024-02-28T23:05:50.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.510+0000 7fe941600700 1 -- 172.21.15.159:0/475247357 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe938005dc0 con 0x7fe9440ff260 2024-02-28T23:05:50.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.510+0000 7fe94a400700 1 -- 172.21.15.159:0/475247357 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9441a1ea0 con 0x7fe9440ff260 2024-02-28T23:05:50.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.510+0000 7fe941600700 1 -- 172.21.15.159:0/475247357 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9380226a0 con 0x7fe9440ff260 2024-02-28T23:05:50.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.510+0000 7fe94a400700 1 -- 172.21.15.159:0/475247357 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9441a2310 con 0x7fe9440ff260 2024-02-28T23:05:50.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.511+0000 7fe94a400700 1 -- 172.21.15.159:0/475247357 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe944196940 con 0x7fe9440ff260 2024-02-28T23:05:50.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.513+0000 7fe941600700 1 -- 172.21.15.159:0/475247357 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fe938003680 con 0x7fe9440ff260 2024-02-28T23:05:50.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.515+0000 7fe941600700 1 --2- 172.21.15.159:0/475247357 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe92c06c4e0 0x7fe92c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:50.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.515+0000 7fe941600700 1 -- 172.21.15.159:0/475247357 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fe93808ce40 con 0x7fe9440ff260 2024-02-28T23:05:50.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.516+0000 7fe943e00700 1 --2- 172.21.15.159:0/475247357 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe92c06c4e0 0x7fe92c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:50.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.516+0000 7fe943e00700 1 --2- 172.21.15.159:0/475247357 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe92c06c4e0 0x7fe92c06e9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe930009bf0 tx=0x7fe930009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:50.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.520+0000 7fe941600700 1 -- 172.21.15.159:0/475247357 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fe93805b030 con 0x7fe9440ff260 2024-02-28T23:05:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:50 smithi159 ceph-mon[28802]: pgmap v296: 65 pgs: 65 active+clean; 7.0 MiB data, 176 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 553 KiB/s wr, 8 op/s 2024-02-28T23:05:50.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:50 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:05:50.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.819+0000 7fe94a400700 1 -- 172.21.15.159:0/475247357 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9440611d0 con 0x7fe92c06c4e0 2024-02-28T23:05:50.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.838+0000 7fe941600700 1 -- 172.21.15.159:0/475247357 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3480 (secure 0 0 0) 0x7fe9440611d0 con 0x7fe92c06c4e0 2024-02-28T23:05:50.837 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:05:50.837 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (7m) 108s ago 9m 13.2M - 0.25.0 c8568f914cd2 2b2966e86e70 2024-02-28T23:05:50.837 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (9m) 108s ago 9m 7604k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:05:50.837 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (8m) 113s ago 8m 7277k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:05:50.837 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (9m) 108s ago 9m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:05:50.837 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (8m) 113s ago 8m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:05:50.837 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (7m) 108s ago 9m 74.1M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:05:50.837 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (2m) 108s ago 2m 14.3M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:05:50.837 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (2m) 108s ago 2m 12.9M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:05:50.837 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (2m) 113s ago 2m 11.5M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (2m) 113s ago 2m 11.6M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:9283,8765,8443 running (11m) 108s ago 11m 490M - 18.2.1 5be31c24972a f518a1599079 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (8m) 113s ago 8m 441M - 18.2.1 5be31c24972a 377a08f00bbd 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (11m) 108s ago 11m 43.5M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (8m) 113s ago 8m 34.3M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (9m) 108s ago 9m 7906k - 1.5.0 0da6a335fe13 009475616a7b 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (8m) 113s ago 8m 7587k - 1.5.0 0da6a335fe13 a45ab4136b88 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (7m) 108s ago 7m 46.7M 3947M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (6m) 108s ago 6m 47.2M 3947M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (5m) 108s ago 5m 45.6M 3947M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (5m) 113s ago 5m 45.2M 4971M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (4m) 113s ago 4m 42.9M 4971M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (4m) 113s ago 4m 42.5M 4971M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:05:50.838 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (7m) 108s ago 8m 47.8M - 2.43.0 a07b618ecd1d abc97d603adc 2024-02-28T23:05:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.841+0000 7fe94a400700 1 -- 172.21.15.159:0/475247357 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe92c06c4e0 msgr2=0x7fe92c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.841+0000 7fe94a400700 1 --2- 172.21.15.159:0/475247357 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe92c06c4e0 0x7fe92c06e9a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe930009bf0 tx=0x7fe930009260 comp rx=0 tx=0).stop 2024-02-28T23:05:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.841+0000 7fe94a400700 1 -- 172.21.15.159:0/475247357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9440ff260 msgr2=0x7fe94419c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:50.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.841+0000 7fe94a400700 1 --2- 172.21.15.159:0/475247357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9440ff260 0x7fe94419c7b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe938000c00 tx=0x7fe93800f740 comp rx=0 tx=0).stop 2024-02-28T23:05:50.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.841+0000 7fe94a400700 1 -- 172.21.15.159:0/475247357 shutdown_connections 2024-02-28T23:05:50.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.841+0000 7fe94a400700 1 --2- 172.21.15.159:0/475247357 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe9440ff260 0x7fe94419c7b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:50.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.841+0000 7fe94a400700 1 --2- 172.21.15.159:0/475247357 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fe92c06c4e0 0x7fe92c06e9a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:50.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.841+0000 7fe94a400700 1 --2- 172.21.15.159:0/475247357 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe944101bd0 0x7fe94419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:50.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.841+0000 7fe94a400700 1 -- 172.21.15.159:0/475247357 >> 172.21.15.159:0/475247357 conn(0x7fe9440fae40 msgr2=0x7fe9440fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:50.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.841+0000 7fe94a400700 1 -- 172.21.15.159:0/475247357 shutdown_connections 2024-02-28T23:05:50.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:50.842+0000 7fe94a400700 1 -- 172.21.15.159:0/475247357 wait complete. 2024-02-28T23:05:50.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:50 smithi184 ceph-mon[36198]: pgmap v296: 65 pgs: 65 active+clean; 7.0 MiB data, 176 MiB used, 536 GiB / 536 GiB avail; 2.5 KiB/s rd, 553 KiB/s wr, 8 op/s 2024-02-28T23:05:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:50 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:05:51.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.047+0000 7fb05d000700 1 -- 172.21.15.159:0/1551122375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0580737f0 msgr2=0x7fb058073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:51.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.047+0000 7fb05d000700 1 --2- 172.21.15.159:0/1551122375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0580737f0 0x7fb058073c70 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fb044009910 tx=0x7fb044009c20 comp rx=0 tx=0).stop 2024-02-28T23:05:51.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.048+0000 7fb05d000700 1 -- 172.21.15.159:0/1551122375 shutdown_connections 2024-02-28T23:05:51.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.048+0000 7fb05d000700 1 --2- 172.21.15.159:0/1551122375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0580737f0 0x7fb058073c70 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:51.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.048+0000 7fb05d000700 1 --2- 172.21.15.159:0/1551122375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb058074dc0 0x7fb058073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:51.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.048+0000 7fb05d000700 1 -- 172.21.15.159:0/1551122375 >> 172.21.15.159:0/1551122375 conn(0x7fb0580fbf70 msgr2=0x7fb0580fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:51.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.048+0000 7fb05d000700 1 -- 172.21.15.159:0/1551122375 shutdown_connections 2024-02-28T23:05:51.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.048+0000 7fb05d000700 1 -- 172.21.15.159:0/1551122375 wait complete. 2024-02-28T23:05:51.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.049+0000 7fb05d000700 1 Processor -- start 2024-02-28T23:05:51.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.049+0000 7fb05d000700 1 -- start start 2024-02-28T23:05:51.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb05d000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0580737f0 0x7fb05810be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:51.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb05d000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb058074dc0 0x7fb05810c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:51.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb05d000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05810c9b0 con 0x7fb058074dc0 2024-02-28T23:05:51.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb05d000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05810caf0 con 0x7fb0580737f0 2024-02-28T23:05:51.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb056a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb058074dc0 0x7fb05810c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:51.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb057400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0580737f0 0x7fb05810be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:51.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb056a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb058074dc0 0x7fb05810c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58060/0 (socket says 172.21.15.159:58060) 2024-02-28T23:05:51.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb057400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0580737f0 0x7fb05810be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:33514/0 (socket says 172.21.15.159:33514) 2024-02-28T23:05:51.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb056a00700 1 -- 172.21.15.159:0/3490614872 learned_addr learned my addr 172.21.15.159:0/3490614872 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:05:51.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb056a00700 1 -- 172.21.15.159:0/3490614872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0580737f0 msgr2=0x7fb05810be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:51.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb056a00700 1 --2- 172.21.15.159:0/3490614872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0580737f0 0x7fb05810be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:51.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.050+0000 7fb056a00700 1 -- 172.21.15.159:0/3490614872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0440095f0 con 0x7fb058074dc0 2024-02-28T23:05:51.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.051+0000 7fb056a00700 1 --2- 172.21.15.159:0/3490614872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb058074dc0 0x7fb05810c390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb04400f690 tx=0x7fb04400f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:51.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.052+0000 7fb04fe00700 1 -- 172.21.15.159:0/3490614872 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb04401d070 con 0x7fb058074dc0 2024-02-28T23:05:51.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.052+0000 7fb04fe00700 1 -- 172.21.15.159:0/3490614872 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb044005dc0 con 0x7fb058074dc0 2024-02-28T23:05:51.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.052+0000 7fb04fe00700 1 -- 172.21.15.159:0/3490614872 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb044017630 con 0x7fb058074dc0 2024-02-28T23:05:51.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.052+0000 7fb05d000700 1 -- 172.21.15.159:0/3490614872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0581aa770 con 0x7fb058074dc0 2024-02-28T23:05:51.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.052+0000 7fb05d000700 1 -- 172.21.15.159:0/3490614872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0581aac60 con 0x7fb058074dc0 2024-02-28T23:05:51.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.053+0000 7fb05d000700 1 -- 172.21.15.159:0/3490614872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05810fcf0 con 0x7fb058074dc0 2024-02-28T23:05:51.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.055+0000 7fb04fe00700 1 -- 172.21.15.159:0/3490614872 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7fb044003910 con 0x7fb058074dc0 2024-02-28T23:05:51.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.056+0000 7fb04fe00700 1 --2- 172.21.15.159:0/3490614872 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb03c06c4e0 0x7fb03c06e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:51.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.056+0000 7fb04fe00700 1 -- 172.21.15.159:0/3490614872 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7fb04408cc20 con 0x7fb058074dc0 2024-02-28T23:05:51.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.056+0000 7fb057400700 1 --2- 172.21.15.159:0/3490614872 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb03c06c4e0 0x7fb03c06e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:51.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.057+0000 7fb057400700 1 --2- 172.21.15.159:0/3490614872 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb03c06c4e0 0x7fb03c06e9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb0580751a0 tx=0x7fb048009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:51.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.061+0000 7fb04fe00700 1 -- 172.21.15.159:0/3490614872 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7fb04405ae10 con 0x7fb058074dc0 2024-02-28T23:05:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:51 smithi159 ceph-mon[28802]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:51 smithi159 ceph-mon[28802]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:51.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.474+0000 7fb05d000700 1 -- 172.21.15.159:0/3490614872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb0581ab360 con 0x7fb058074dc0 2024-02-28T23:05:51.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.475+0000 7fb04fe00700 1 -- 172.21.15.159:0/3490614872 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+558 (secure 0 0 0) 0x7fb04405a9a0 con 0x7fb058074dc0 2024-02-28T23:05:51.473 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:05:51.473 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:05:51.473 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:05:51.473 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:05:51.473 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:05:51.473 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:05:51.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:05:51.474 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:05:51.474 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:05:51.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:05:51.474 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:05:51.474 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:05:51.474 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:05:51.474 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:05:51.474 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 14 2024-02-28T23:05:51.474 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:05:51.474 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:05:51.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.478+0000 7fb05d000700 1 -- 172.21.15.159:0/3490614872 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb03c06c4e0 msgr2=0x7fb03c06e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:51.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.478+0000 7fb05d000700 1 --2- 172.21.15.159:0/3490614872 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb03c06c4e0 0x7fb03c06e9a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb0580751a0 tx=0x7fb048009260 comp rx=0 tx=0).stop 2024-02-28T23:05:51.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.478+0000 7fb05d000700 1 -- 172.21.15.159:0/3490614872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb058074dc0 msgr2=0x7fb05810c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:51.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.478+0000 7fb05d000700 1 --2- 172.21.15.159:0/3490614872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb058074dc0 0x7fb05810c390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb04400f690 tx=0x7fb04400f6c0 comp rx=0 tx=0).stop 2024-02-28T23:05:51.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.479+0000 7fb05d000700 1 -- 172.21.15.159:0/3490614872 shutdown_connections 2024-02-28T23:05:51.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.479+0000 7fb05d000700 1 --2- 172.21.15.159:0/3490614872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0580737f0 0x7fb05810be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:51.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.479+0000 7fb05d000700 1 --2- 172.21.15.159:0/3490614872 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7fb03c06c4e0 0x7fb03c06e9a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:51.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.479+0000 7fb05d000700 1 --2- 172.21.15.159:0/3490614872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb058074dc0 0x7fb05810c390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:51.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.479+0000 7fb05d000700 1 -- 172.21.15.159:0/3490614872 >> 172.21.15.159:0/3490614872 conn(0x7fb0580fbf70 msgr2=0x7fb058102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:51.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.480+0000 7fb05d000700 1 -- 172.21.15.159:0/3490614872 shutdown_connections 2024-02-28T23:05:51.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.480+0000 7fb05d000700 1 -- 172.21.15.159:0/3490614872 wait complete. 2024-02-28T23:05:51.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.685+0000 7ff1b8600700 1 -- 172.21.15.159:0/1785353584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1b0074dc0 msgr2=0x7ff1b0073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:51.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.685+0000 7ff1b8600700 1 --2- 172.21.15.159:0/1785353584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1b0074dc0 0x7ff1b0073220 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4009910 tx=0x7ff1a4009c20 comp rx=0 tx=0).stop 2024-02-28T23:05:51.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.686+0000 7ff1b8600700 1 -- 172.21.15.159:0/1785353584 shutdown_connections 2024-02-28T23:05:51.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.686+0000 7ff1b8600700 1 --2- 172.21.15.159:0/1785353584 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b00737f0 0x7ff1b0073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:51.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.686+0000 7ff1b8600700 1 --2- 172.21.15.159:0/1785353584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1b0074dc0 0x7ff1b0073220 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:51.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.686+0000 7ff1b8600700 1 -- 172.21.15.159:0/1785353584 >> 172.21.15.159:0/1785353584 conn(0x7ff1b00fc110 msgr2=0x7ff1b00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:51.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.686+0000 7ff1b8600700 1 -- 172.21.15.159:0/1785353584 shutdown_connections 2024-02-28T23:05:51.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.686+0000 7ff1b8600700 1 -- 172.21.15.159:0/1785353584 wait complete. 2024-02-28T23:05:51.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.688+0000 7ff1b8600700 1 Processor -- start 2024-02-28T23:05:51.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.689+0000 7ff1b8600700 1 -- start start 2024-02-28T23:05:51.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.689+0000 7ff1b8600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b00737f0 0x7ff1b0198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:51.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.689+0000 7ff1b8600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1b0074dc0 0x7ff1b0198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:51.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.689+0000 7ff1b8600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b01990d0 con 0x7ff1b0074dc0 2024-02-28T23:05:51.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.689+0000 7ff1b8600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b0199210 con 0x7ff1b00737f0 2024-02-28T23:05:51.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.689+0000 7ff1b5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1b0074dc0 0x7ff1b0198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:51.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.689+0000 7ff1b5c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b00737f0 0x7ff1b0198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:51.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.690+0000 7ff1b5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1b0074dc0 0x7ff1b0198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58070/0 (socket says 172.21.15.159:58070) 2024-02-28T23:05:51.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.690+0000 7ff1b5200700 1 -- 172.21.15.159:0/3300135590 learned_addr learned my addr 172.21.15.159:0/3300135590 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:05:51.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.690+0000 7ff1b5c00700 1 -- 172.21.15.159:0/3300135590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1b0074dc0 msgr2=0x7ff1b0198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:51.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.690+0000 7ff1b5c00700 1 --2- 172.21.15.159:0/3300135590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1b0074dc0 0x7ff1b0198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:51.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.691+0000 7ff1b5c00700 1 -- 172.21.15.159:0/3300135590 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40095f0 con 0x7ff1b00737f0 2024-02-28T23:05:51.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.691+0000 7ff1b5c00700 1 --2- 172.21.15.159:0/3300135590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b00737f0 0x7ff1b0198570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00751a0 tx=0x7ff1a400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:51.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.692+0000 7ff1ae000700 1 -- 172.21.15.159:0/3300135590 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a401d070 con 0x7ff1b00737f0 2024-02-28T23:05:51.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.692+0000 7ff1ae000700 1 -- 172.21.15.159:0/3300135590 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff1a4005dc0 con 0x7ff1b00737f0 2024-02-28T23:05:51.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.692+0000 7ff1b8600700 1 -- 172.21.15.159:0/3300135590 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b019dc60 con 0x7ff1b00737f0 2024-02-28T23:05:51.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.692+0000 7ff1ae000700 1 -- 172.21.15.159:0/3300135590 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1a4017630 con 0x7ff1b00737f0 2024-02-28T23:05:51.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.692+0000 7ff1b8600700 1 -- 172.21.15.159:0/3300135590 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b019e150 con 0x7ff1b00737f0 2024-02-28T23:05:51.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.694+0000 7ff1b8600700 1 -- 172.21.15.159:0/3300135590 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b010b920 con 0x7ff1b00737f0 2024-02-28T23:05:51.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.696+0000 7ff1ae000700 1 -- 172.21.15.159:0/3300135590 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 19) v1 ==== 90314+0+0 (secure 0 0 0) 0x7ff1a40038a0 con 0x7ff1b00737f0 2024-02-28T23:05:51.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.696+0000 7ff1ae000700 1 --2- 172.21.15.159:0/3300135590 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff19806c4e0 0x7ff19806e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:05:51.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.697+0000 7ff1ae000700 1 -- 172.21.15.159:0/3300135590 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7ff1a408cc20 con 0x7ff1b00737f0 2024-02-28T23:05:51.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.697+0000 7ff1b5200700 1 --2- 172.21.15.159:0/3300135590 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff19806c4e0 0x7ff19806e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:05:51.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.699+0000 7ff1b5200700 1 --2- 172.21.15.159:0/3300135590 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff19806c4e0 0x7ff19806e9a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff19c005950 tx=0x7ff19c009260 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:05:51.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:51.704+0000 7ff1ae000700 1 -- 172.21.15.159:0/3300135590 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7ff1a405aec0 con 0x7ff1b00737f0 2024-02-28T23:05:51.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:51 smithi184 ceph-mon[36198]: from='client.14574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:51.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:51 smithi184 ceph-mon[36198]: from='client.14578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:52.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.029+0000 7ff1b8600700 1 -- 172.21.15.159:0/3300135590 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1b01080b0 con 0x7ff19806c4e0 2024-02-28T23:05:52.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.031+0000 7ff1ae000700 1 -- 172.21.15.159:0/3300135590 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7ff1b01080b0 con 0x7ff19806c4e0 2024-02-28T23:05:52.029 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:05:52.029 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:05:52.029 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:05:52.029 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:05:52.029 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [], 2024-02-28T23:05:52.029 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "0/2 daemons upgraded", 2024-02-28T23:05:52.029 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc image on host smithi184", 2024-02-28T23:05:52.029 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:05:52.030 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:05:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.033+0000 7ff1b8600700 1 -- 172.21.15.159:0/3300135590 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff19806c4e0 msgr2=0x7ff19806e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.033+0000 7ff1b8600700 1 --2- 172.21.15.159:0/3300135590 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff19806c4e0 0x7ff19806e9a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff19c005950 tx=0x7ff19c009260 comp rx=0 tx=0).stop 2024-02-28T23:05:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.034+0000 7ff1b8600700 1 -- 172.21.15.159:0/3300135590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b00737f0 msgr2=0x7ff1b0198570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:05:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.034+0000 7ff1b8600700 1 --2- 172.21.15.159:0/3300135590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b00737f0 0x7ff1b0198570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff1b00751a0 tx=0x7ff1a400f690 comp rx=0 tx=0).stop 2024-02-28T23:05:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.034+0000 7ff1b8600700 1 -- 172.21.15.159:0/3300135590 shutdown_connections 2024-02-28T23:05:52.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.034+0000 7ff1b8600700 1 --2- 172.21.15.159:0/3300135590 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff1b00737f0 0x7ff1b0198570 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.034+0000 7ff1b8600700 1 --2- 172.21.15.159:0/3300135590 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7ff19806c4e0 0x7ff19806e9a0 secure :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff19c005950 tx=0x7ff19c009260 comp rx=0 tx=0).stop 2024-02-28T23:05:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.034+0000 7ff1b8600700 1 --2- 172.21.15.159:0/3300135590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1b0074dc0 0x7ff1b0198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:05:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.034+0000 7ff1b8600700 1 -- 172.21.15.159:0/3300135590 >> 172.21.15.159:0/3300135590 conn(0x7ff1b00fc110 msgr2=0x7ff1b0106990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:05:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.034+0000 7ff1b8600700 1 -- 172.21.15.159:0/3300135590 shutdown_connections 2024-02-28T23:05:52.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:05:52.034+0000 7ff1b8600700 1 -- 172.21.15.159:0/3300135590 wait complete. 2024-02-28T23:05:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:52 smithi159 ceph-mon[28802]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:52 smithi159 ceph-mon[28802]: pgmap v297: 65 pgs: 65 active+clean; 21 MiB data, 215 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.7 MiB/s wr, 50 op/s 2024-02-28T23:05:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:52 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3490614872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:05:52.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:52 smithi184 ceph-mon[36198]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:52.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:52 smithi184 ceph-mon[36198]: pgmap v297: 65 pgs: 65 active+clean; 21 MiB data, 215 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 1.7 MiB/s wr, 50 op/s 2024-02-28T23:05:52.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:52 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3490614872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:05:53.471 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:53 smithi159 ceph-mon[28802]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:53 smithi184 ceph-mon[36198]: from='client.24353 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:05:54.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:54 smithi184 ceph-mon[36198]: pgmap v298: 65 pgs: 65 active+clean; 30 MiB data, 267 MiB used, 536 GiB / 536 GiB avail; 301 KiB/s rd, 2.5 MiB/s wr, 108 op/s 2024-02-28T23:05:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:54 smithi159 ceph-mon[28802]: pgmap v298: 65 pgs: 65 active+clean; 30 MiB data, 267 MiB used, 536 GiB / 536 GiB avail; 301 KiB/s rd, 2.5 MiB/s wr, 108 op/s 2024-02-28T23:05:56.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:56 smithi159 ceph-mon[28802]: pgmap v299: 65 pgs: 65 active+clean; 31 MiB data, 283 MiB used, 536 GiB / 536 GiB avail; 301 KiB/s rd, 2.7 MiB/s wr, 147 op/s 2024-02-28T23:05:56.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:56 smithi184 ceph-mon[36198]: pgmap v299: 65 pgs: 65 active+clean; 31 MiB data, 283 MiB used, 536 GiB / 536 GiB avail; 301 KiB/s rd, 2.7 MiB/s wr, 147 op/s 2024-02-28T23:05:58.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:58 smithi159 ceph-mon[28802]: pgmap v300: 65 pgs: 65 active+clean; 33 MiB data, 301 MiB used, 536 GiB / 536 GiB avail; 301 KiB/s rd, 2.8 MiB/s wr, 190 op/s 2024-02-28T23:05:58.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:58 smithi184 ceph-mon[36198]: pgmap v300: 65 pgs: 65 active+clean; 33 MiB data, 301 MiB used, 536 GiB / 536 GiB avail; 301 KiB/s rd, 2.8 MiB/s wr, 190 op/s 2024-02-28T23:05:59.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:59 smithi184 ceph-mon[36198]: Upgrade: Updating mgr.smithi184.quvmnx 2024-02-28T23:05:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.quvmnx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T23:05:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T23:05:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:59 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:05:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:05:59 smithi184 ceph-mon[36198]: Deploying daemon mgr.smithi184.quvmnx on smithi184 2024-02-28T23:05:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:59 smithi159 ceph-mon[28802]: Upgrade: Updating mgr.smithi184.quvmnx 2024-02-28T23:05:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:05:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.quvmnx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T23:05:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T23:05:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:59 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:05:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:05:59 smithi159 ceph-mon[28802]: Deploying daemon mgr.smithi184.quvmnx on smithi184 2024-02-28T23:06:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:00 smithi184 ceph-mon[36198]: pgmap v301: 65 pgs: 65 active+clean; 41 MiB data, 323 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.5 MiB/s wr, 236 op/s 2024-02-28T23:06:00.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:00 smithi159 ceph-mon[28802]: pgmap v301: 65 pgs: 65 active+clean; 41 MiB data, 323 MiB used, 536 GiB / 536 GiB avail; 684 KiB/s rd, 3.5 MiB/s wr, 236 op/s 2024-02-28T23:06:02.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:02 smithi184 ceph-mon[36198]: pgmap v302: 65 pgs: 65 active+clean; 44 MiB data, 348 MiB used, 536 GiB / 536 GiB avail; 682 KiB/s rd, 3.2 MiB/s wr, 300 op/s 2024-02-28T23:06:02.971 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:02 smithi159 ceph-mon[28802]: pgmap v302: 65 pgs: 65 active+clean; 44 MiB data, 348 MiB used, 536 GiB / 536 GiB avail; 682 KiB/s rd, 3.2 MiB/s wr, 300 op/s 2024-02-28T23:06:04.596 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:04 smithi184 ceph-mon[36198]: pgmap v303: 65 pgs: 65 active+clean; 48 MiB data, 376 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 315 op/s 2024-02-28T23:06:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:04 smithi159 ceph-mon[28802]: pgmap v303: 65 pgs: 65 active+clean; 48 MiB data, 376 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 315 op/s 2024-02-28T23:06:05.619 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:05 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:06:05.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:05 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:06:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:06 smithi159 ceph-mon[28802]: pgmap v304: 65 pgs: 65 active+clean; 54 MiB data, 393 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 295 op/s 2024-02-28T23:06:06.779 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:06 smithi184 ceph-mon[36198]: pgmap v304: 65 pgs: 65 active+clean; 54 MiB data, 393 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.2 MiB/s wr, 295 op/s 2024-02-28T23:06:08.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:08 smithi184 ceph-mon[36198]: pgmap v305: 65 pgs: 65 active+clean; 57 MiB data, 420 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 297 op/s 2024-02-28T23:06:08.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:08 smithi159 ceph-mon[28802]: pgmap v305: 65 pgs: 65 active+clean; 57 MiB data, 420 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 297 op/s 2024-02-28T23:06:09.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:09 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:09.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:09 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:09.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:09 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:06:09.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:09 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:09.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:09 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:09.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:09 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:06:10.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:10 smithi184 ceph-mon[36198]: pgmap v306: 65 pgs: 65 active+clean; 63 MiB data, 442 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 301 op/s 2024-02-28T23:06:10.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:10 smithi159 ceph-mon[28802]: pgmap v306: 65 pgs: 65 active+clean; 63 MiB data, 442 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 2.7 MiB/s wr, 301 op/s 2024-02-28T23:06:12.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:12 smithi184 ceph-mon[36198]: pgmap v307: 65 pgs: 65 active+clean; 76 MiB data, 485 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 340 op/s 2024-02-28T23:06:12.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:12 smithi159 ceph-mon[28802]: pgmap v307: 65 pgs: 65 active+clean; 76 MiB data, 485 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 3.1 MiB/s wr, 340 op/s 2024-02-28T23:06:14.780 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:14 smithi184 ceph-mon[36198]: pgmap v308: 65 pgs: 65 active+clean; 87 MiB data, 489 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 326 op/s 2024-02-28T23:06:14.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:14 smithi159 ceph-mon[28802]: pgmap v308: 65 pgs: 65 active+clean; 87 MiB data, 489 MiB used, 536 GiB / 536 GiB avail; 1.7 MiB/s rd, 3.8 MiB/s wr, 326 op/s 2024-02-28T23:06:16.777 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:16 smithi184 ceph-mon[36198]: pgmap v309: 65 pgs: 65 active+clean; 92 MiB data, 509 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 297 op/s 2024-02-28T23:06:16.971 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:16 smithi159 ceph-mon[28802]: pgmap v309: 65 pgs: 65 active+clean; 92 MiB data, 509 MiB used, 536 GiB / 536 GiB avail; 1.4 MiB/s rd, 3.7 MiB/s wr, 297 op/s 2024-02-28T23:06:17.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:17 smithi184 ceph-mon[36198]: pgmap v310: 65 pgs: 65 active+clean; 94 MiB data, 527 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-02-28T23:06:17.971 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:17 smithi159 ceph-mon[28802]: pgmap v310: 65 pgs: 65 active+clean; 94 MiB data, 527 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 3.5 MiB/s wr, 295 op/s 2024-02-28T23:06:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:20 smithi159 ceph-mon[28802]: pgmap v311: 65 pgs: 65 active+clean; 101 MiB data, 555 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 304 op/s 2024-02-28T23:06:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:20 smithi159 ceph-mon[28802]: Standby manager daemon smithi184.quvmnx restarted 2024-02-28T23:06:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:20 smithi159 ceph-mon[28802]: Standby manager daemon smithi184.quvmnx started 2024-02-28T23:06:20.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:20 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/crt"}]: dispatch 2024-02-28T23:06:20.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:20 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:06:20.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:20 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/key"}]: dispatch 2024-02-28T23:06:20.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:20 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:06:20.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:20 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:06:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:20 smithi184 ceph-mon[36198]: pgmap v311: 65 pgs: 65 active+clean; 101 MiB data, 555 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.8 MiB/s wr, 304 op/s 2024-02-28T23:06:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:20 smithi184 ceph-mon[36198]: Standby manager daemon smithi184.quvmnx restarted 2024-02-28T23:06:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:20 smithi184 ceph-mon[36198]: Standby manager daemon smithi184.quvmnx started 2024-02-28T23:06:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:20 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/crt"}]: dispatch 2024-02-28T23:06:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:20 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:06:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:20 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/key"}]: dispatch 2024-02-28T23:06:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:20 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:06:20.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:20 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:06:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:21 smithi159 ceph-mon[28802]: mgrmap e20: smithi159.pobewk(active, since 9m), standbys: smithi184.quvmnx 2024-02-28T23:06:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:21 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:21 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:21.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:21 smithi184 ceph-mon[36198]: mgrmap e20: smithi159.pobewk(active, since 9m), standbys: smithi184.quvmnx 2024-02-28T23:06:21.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:21 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:21.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:21 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:22.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.237+0000 7f2e2b000700 1 -- 172.21.15.159:0/1048728916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e240737f0 msgr2=0x7f2e24073c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:22.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.237+0000 7f2e2b000700 1 --2- 172.21.15.159:0/1048728916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e240737f0 0x7f2e24073c70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2e10009910 tx=0x7f2e10009c20 comp rx=0 tx=0).stop 2024-02-28T23:06:22.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.237+0000 7f2e2b000700 1 -- 172.21.15.159:0/1048728916 shutdown_connections 2024-02-28T23:06:22.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.237+0000 7f2e2b000700 1 --2- 172.21.15.159:0/1048728916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e240737f0 0x7f2e24073c70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:22.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.237+0000 7f2e2b000700 1 --2- 172.21.15.159:0/1048728916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e24074dc0 0x7f2e24073220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:22.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.237+0000 7f2e2b000700 1 -- 172.21.15.159:0/1048728916 >> 172.21.15.159:0/1048728916 conn(0x7f2e240fc110 msgr2=0x7f2e240fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:22.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.237+0000 7f2e2b000700 1 -- 172.21.15.159:0/1048728916 shutdown_connections 2024-02-28T23:06:22.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.237+0000 7f2e2b000700 1 -- 172.21.15.159:0/1048728916 wait complete. 2024-02-28T23:06:22.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.238+0000 7f2e2b000700 1 Processor -- start 2024-02-28T23:06:22.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.238+0000 7f2e2b000700 1 -- start start 2024-02-28T23:06:22.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.239+0000 7f2e2b000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e240737f0 0x7f2e241985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:22.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.239+0000 7f2e2b000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e24074dc0 0x7f2e24198af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:22.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.239+0000 7f2e2b000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24199110 con 0x7f2e240737f0 2024-02-28T23:06:22.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.239+0000 7f2e2b000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e24199250 con 0x7f2e24074dc0 2024-02-28T23:06:22.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.239+0000 7f2e23e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e240737f0 0x7f2e241985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:22.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.239+0000 7f2e23e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e240737f0 0x7f2e241985b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33416/0 (socket says 172.21.15.159:33416) 2024-02-28T23:06:22.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.239+0000 7f2e23e00700 1 -- 172.21.15.159:0/3535957989 learned_addr learned my addr 172.21.15.159:0/3535957989 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:06:22.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.240+0000 7f2e23400700 1 --2- 172.21.15.159:0/3535957989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e24074dc0 0x7f2e24198af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:22.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.240+0000 7f2e23e00700 1 -- 172.21.15.159:0/3535957989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e24074dc0 msgr2=0x7f2e24198af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:22.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.240+0000 7f2e23e00700 1 --2- 172.21.15.159:0/3535957989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e24074dc0 0x7f2e24198af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:22.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.240+0000 7f2e23e00700 1 -- 172.21.15.159:0/3535957989 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e100095f0 con 0x7f2e240737f0 2024-02-28T23:06:22.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.240+0000 7f2e23e00700 1 --2- 172.21.15.159:0/3535957989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e240737f0 0x7f2e241985b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400d900 tx=0x7f2e1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:22.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.241+0000 7f2e20c00700 1 -- 172.21.15.159:0/3535957989 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e14009900 con 0x7f2e240737f0 2024-02-28T23:06:22.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.241+0000 7f2e20c00700 1 -- 172.21.15.159:0/3535957989 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2e14010460 con 0x7f2e240737f0 2024-02-28T23:06:22.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.241+0000 7f2e2b000700 1 -- 172.21.15.159:0/3535957989 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2419dd00 con 0x7f2e240737f0 2024-02-28T23:06:22.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.241+0000 7f2e20c00700 1 -- 172.21.15.159:0/3535957989 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e1400f5f0 con 0x7f2e240737f0 2024-02-28T23:06:22.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.241+0000 7f2e2b000700 1 -- 172.21.15.159:0/3535957989 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2419e1f0 con 0x7f2e240737f0 2024-02-28T23:06:22.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.242+0000 7f2e2b000700 1 -- 172.21.15.159:0/3535957989 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e2410b940 con 0x7f2e240737f0 2024-02-28T23:06:22.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.244+0000 7f2e20c00700 1 -- 172.21.15.159:0/3535957989 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 20) v1 ==== 90827+0+0 (secure 0 0 0) 0x7f2e140105d0 con 0x7f2e240737f0 2024-02-28T23:06:22.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.245+0000 7f2e20c00700 1 --2- 172.21.15.159:0/3535957989 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f2e0806cd00 0x7f2e0806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:22.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.246+0000 7f2e20c00700 1 -- 172.21.15.159:0/3535957989 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f2e1408c090 con 0x7f2e240737f0 2024-02-28T23:06:22.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.246+0000 7f2e23400700 1 --2- 172.21.15.159:0/3535957989 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f2e0806cd00 0x7f2e0806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:22.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.247+0000 7f2e23400700 1 --2- 172.21.15.159:0/3535957989 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f2e0806cd00 0x7f2e0806f1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2e10006010 tx=0x7f2e1000b540 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:22.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.252+0000 7f2e20c00700 1 -- 172.21.15.159:0/3535957989 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f2e1405a2c0 con 0x7f2e240737f0 2024-02-28T23:06:22.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.550+0000 7f2e2b000700 1 -- 172.21.15.159:0/3535957989 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e241080b0 con 0x7f2e0806cd00 2024-02-28T23:06:22.549 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:22 smithi159 ceph-mon[28802]: pgmap v312: 65 pgs: 65 active+clean; 103 MiB data, 539 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 342 op/s 2024-02-28T23:06:22.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.552+0000 7f2e20c00700 1 -- 172.21.15.159:0/3535957989 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f2e241080b0 con 0x7f2e0806cd00 2024-02-28T23:06:22.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.555+0000 7f2e2b000700 1 -- 172.21.15.159:0/3535957989 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f2e0806cd00 msgr2=0x7f2e0806f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:22.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.555+0000 7f2e2b000700 1 --2- 172.21.15.159:0/3535957989 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f2e0806cd00 0x7f2e0806f1c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2e10006010 tx=0x7f2e1000b540 comp rx=0 tx=0).stop 2024-02-28T23:06:22.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.555+0000 7f2e2b000700 1 -- 172.21.15.159:0/3535957989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e240737f0 msgr2=0x7f2e241985b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:22.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.555+0000 7f2e2b000700 1 --2- 172.21.15.159:0/3535957989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e240737f0 0x7f2e241985b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400d900 tx=0x7f2e1400dcc0 comp rx=0 tx=0).stop 2024-02-28T23:06:22.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.555+0000 7f2e2b000700 1 -- 172.21.15.159:0/3535957989 shutdown_connections 2024-02-28T23:06:22.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.555+0000 7f2e2b000700 1 --2- 172.21.15.159:0/3535957989 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f2e0806cd00 0x7f2e0806f1c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:22.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.555+0000 7f2e2b000700 1 --2- 172.21.15.159:0/3535957989 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e240737f0 0x7f2e241985b0 secure :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400d900 tx=0x7f2e1400dcc0 comp rx=0 tx=0).stop 2024-02-28T23:06:22.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.555+0000 7f2e2b000700 1 --2- 172.21.15.159:0/3535957989 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e24074dc0 0x7f2e24198af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:22.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.555+0000 7f2e2b000700 1 -- 172.21.15.159:0/3535957989 >> 172.21.15.159:0/3535957989 conn(0x7f2e240fc110 msgr2=0x7f2e24106990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:22.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.556+0000 7f2e2b000700 1 -- 172.21.15.159:0/3535957989 shutdown_connections 2024-02-28T23:06:22.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.556+0000 7f2e2b000700 1 -- 172.21.15.159:0/3535957989 wait complete. 2024-02-28T23:06:22.577 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:22 smithi184 ceph-mon[36198]: pgmap v312: 65 pgs: 65 active+clean; 103 MiB data, 539 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.5 MiB/s wr, 342 op/s 2024-02-28T23:06:22.580 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:06:22.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.773+0000 7f1502200700 1 -- 172.21.15.159:0/281596819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14fc100bb0 msgr2=0x7f14fc100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:22.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.773+0000 7f1502200700 1 --2- 172.21.15.159:0/281596819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14fc100bb0 0x7f14fc100fd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009910 tx=0x7f14ec009c20 comp rx=0 tx=0).stop 2024-02-28T23:06:22.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.773+0000 7f1502200700 1 -- 172.21.15.159:0/281596819 shutdown_connections 2024-02-28T23:06:22.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.773+0000 7f1502200700 1 --2- 172.21.15.159:0/281596819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14fc101db0 0x7f14fc102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:22.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.773+0000 7f1502200700 1 --2- 172.21.15.159:0/281596819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14fc100bb0 0x7f14fc100fd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:22.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.773+0000 7f1502200700 1 -- 172.21.15.159:0/281596819 >> 172.21.15.159:0/281596819 conn(0x7f14fc0fc110 msgr2=0x7f14fc0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:22.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.774+0000 7f1502200700 1 -- 172.21.15.159:0/281596819 shutdown_connections 2024-02-28T23:06:22.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.774+0000 7f1502200700 1 -- 172.21.15.159:0/281596819 wait complete. 2024-02-28T23:06:22.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.775+0000 7f1502200700 1 Processor -- start 2024-02-28T23:06:22.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.775+0000 7f1502200700 1 -- start start 2024-02-28T23:06:22.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.775+0000 7f1502200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14fc100bb0 0x7f14fc074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:22.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.775+0000 7f1502200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14fc101db0 0x7f14fc073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:22.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.775+0000 7f1502200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc0736c0 con 0x7f14fc100bb0 2024-02-28T23:06:22.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.775+0000 7f1502200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc073800 con 0x7f14fc101db0 2024-02-28T23:06:22.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.776+0000 7f14fb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14fc100bb0 0x7f14fc074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:22.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.776+0000 7f14fb400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14fc100bb0 0x7f14fc074b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33436/0 (socket says 172.21.15.159:33436) 2024-02-28T23:06:22.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.776+0000 7f14fb400700 1 -- 172.21.15.159:0/2993562434 learned_addr learned my addr 172.21.15.159:0/2993562434 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:06:22.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.776+0000 7f14faa00700 1 --2- 172.21.15.159:0/2993562434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14fc101db0 0x7f14fc073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:22.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.776+0000 7f14fb400700 1 -- 172.21.15.159:0/2993562434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14fc101db0 msgr2=0x7f14fc073180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:22.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.776+0000 7f14fb400700 1 --2- 172.21.15.159:0/2993562434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14fc101db0 0x7f14fc073180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:22.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.776+0000 7f14fb400700 1 -- 172.21.15.159:0/2993562434 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0095f0 con 0x7f14fc100bb0 2024-02-28T23:06:22.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.776+0000 7f14fb400700 1 --2- 172.21.15.159:0/2993562434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14fc100bb0 0x7f14fc074b30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00bda0 tx=0x7f14ec00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:22.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.777+0000 7f14f3e00700 1 -- 172.21.15.159:0/2993562434 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14ec01d070 con 0x7f14fc100bb0 2024-02-28T23:06:22.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.777+0000 7f14f3e00700 1 -- 172.21.15.159:0/2993562434 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f14ec00f460 con 0x7f14fc100bb0 2024-02-28T23:06:22.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.777+0000 7f1502200700 1 -- 172.21.15.159:0/2993562434 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14fc073a80 con 0x7f14fc100bb0 2024-02-28T23:06:22.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.777+0000 7f14f3e00700 1 -- 172.21.15.159:0/2993562434 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14ec021620 con 0x7f14fc100bb0 2024-02-28T23:06:22.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.777+0000 7f1502200700 1 -- 172.21.15.159:0/2993562434 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc073f70 con 0x7f14fc100bb0 2024-02-28T23:06:22.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.778+0000 7f1502200700 1 -- 172.21.15.159:0/2993562434 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14fc109710 con 0x7f14fc100bb0 2024-02-28T23:06:22.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.780+0000 7f14f3e00700 1 -- 172.21.15.159:0/2993562434 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 20) v1 ==== 90827+0+0 (secure 0 0 0) 0x7f14ec00f5d0 con 0x7f14fc100bb0 2024-02-28T23:06:22.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.781+0000 7f14f3e00700 1 --2- 172.21.15.159:0/2993562434 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f14e006cd00 0x7f14e006f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:22.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.781+0000 7f14f3e00700 1 -- 172.21.15.159:0/2993562434 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f14ec08d660 con 0x7f14fc100bb0 2024-02-28T23:06:22.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.783+0000 7f14faa00700 1 --2- 172.21.15.159:0/2993562434 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f14e006cd00 0x7f14e006f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:22.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.783+0000 7f14faa00700 1 --2- 172.21.15.159:0/2993562434 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f14e006cd00 0x7f14e006f1c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f14e8005950 tx=0x7f14e80058e0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:22.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:22.788+0000 7f14f3e00700 1 -- 172.21.15.159:0/2993562434 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f14ec05b810 con 0x7f14fc100bb0 2024-02-28T23:06:23.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.144+0000 7f1502200700 1 -- 172.21.15.159:0/2993562434 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14fc106700 con 0x7f14e006cd00 2024-02-28T23:06:23.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.146+0000 7f14f3e00700 1 -- 172.21.15.159:0/2993562434 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f14fc106700 con 0x7f14e006cd00 2024-02-28T23:06:23.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.149+0000 7f1502200700 1 -- 172.21.15.159:0/2993562434 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f14e006cd00 msgr2=0x7f14e006f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:23.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.149+0000 7f1502200700 1 --2- 172.21.15.159:0/2993562434 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f14e006cd00 0x7f14e006f1c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f14e8005950 tx=0x7f14e80058e0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.149+0000 7f1502200700 1 -- 172.21.15.159:0/2993562434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14fc100bb0 msgr2=0x7f14fc074b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:23.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.149+0000 7f1502200700 1 --2- 172.21.15.159:0/2993562434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14fc100bb0 0x7f14fc074b30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f14ec00bda0 tx=0x7f14ec00be80 comp rx=0 tx=0).stop 2024-02-28T23:06:23.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.149+0000 7f1502200700 1 -- 172.21.15.159:0/2993562434 shutdown_connections 2024-02-28T23:06:23.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.149+0000 7f1502200700 1 --2- 172.21.15.159:0/2993562434 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f14e006cd00 0x7f14e006f1c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.149+0000 7f1502200700 1 --2- 172.21.15.159:0/2993562434 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14fc100bb0 0x7f14fc074b30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.149+0000 7f1502200700 1 --2- 172.21.15.159:0/2993562434 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14fc101db0 0x7f14fc073180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.149+0000 7f1502200700 1 -- 172.21.15.159:0/2993562434 >> 172.21.15.159:0/2993562434 conn(0x7f14fc0fc110 msgr2=0x7f14fc104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:23.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.149+0000 7f1502200700 1 -- 172.21.15.159:0/2993562434 shutdown_connections 2024-02-28T23:06:23.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.149+0000 7f1502200700 1 -- 172.21.15.159:0/2993562434 wait complete. 2024-02-28T23:06:23.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.332+0000 7f3e88000700 1 -- 172.21.15.159:0/3025933234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e80103fd0 msgr2=0x7f3e801063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:23.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.332+0000 7f3e88000700 1 --2- 172.21.15.159:0/3025933234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e80103fd0 0x7f3e801063c0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c009910 tx=0x7f3e6c009c20 comp rx=0 tx=0).stop 2024-02-28T23:06:23.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.332+0000 7f3e88000700 1 -- 172.21.15.159:0/3025933234 shutdown_connections 2024-02-28T23:06:23.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.332+0000 7f3e88000700 1 --2- 172.21.15.159:0/3025933234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e80103fd0 0x7f3e801063c0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.332+0000 7f3e88000700 1 --2- 172.21.15.159:0/3025933234 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e801016a0 0x7f3e80103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.332+0000 7f3e88000700 1 -- 172.21.15.159:0/3025933234 >> 172.21.15.159:0/3025933234 conn(0x7f3e800fb030 msgr2=0x7f3e800fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:23.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.332+0000 7f3e88000700 1 -- 172.21.15.159:0/3025933234 shutdown_connections 2024-02-28T23:06:23.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.332+0000 7f3e88000700 1 -- 172.21.15.159:0/3025933234 wait complete. 2024-02-28T23:06:23.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.333+0000 7f3e88000700 1 Processor -- start 2024-02-28T23:06:23.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.333+0000 7f3e88000700 1 -- start start 2024-02-28T23:06:23.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.334+0000 7f3e88000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e801016a0 0x7f3e80101000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:23.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.334+0000 7f3e88000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e80103fd0 0x7f3e800ff650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:23.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.334+0000 7f3e88000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800ffb90 con 0x7f3e80103fd0 2024-02-28T23:06:23.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.334+0000 7f3e88000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e800ffcd0 con 0x7f3e801016a0 2024-02-28T23:06:23.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.334+0000 7f3e84c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e80103fd0 0x7f3e800ff650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:23.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.334+0000 7f3e84c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e80103fd0 0x7f3e800ff650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33448/0 (socket says 172.21.15.159:33448) 2024-02-28T23:06:23.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.334+0000 7f3e84c00700 1 -- 172.21.15.159:0/2040996182 learned_addr learned my addr 172.21.15.159:0/2040996182 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:06:23.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.334+0000 7f3e85600700 1 --2- 172.21.15.159:0/2040996182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e801016a0 0x7f3e80101000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:23.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.335+0000 7f3e84c00700 1 -- 172.21.15.159:0/2040996182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e801016a0 msgr2=0x7f3e80101000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:23.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.335+0000 7f3e84c00700 1 --2- 172.21.15.159:0/2040996182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e801016a0 0x7f3e80101000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.335+0000 7f3e84c00700 1 -- 172.21.15.159:0/2040996182 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c0095f0 con 0x7f3e80103fd0 2024-02-28T23:06:23.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.335+0000 7f3e84c00700 1 --2- 172.21.15.159:0/2040996182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e80103fd0 0x7f3e800ff650 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00bd70 tx=0x7f3e6c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:23.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.335+0000 7f3e7e000700 1 -- 172.21.15.159:0/2040996182 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e6c01d070 con 0x7f3e80103fd0 2024-02-28T23:06:23.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.335+0000 7f3e7e000700 1 -- 172.21.15.159:0/2040996182 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3e6c022470 con 0x7f3e80103fd0 2024-02-28T23:06:23.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.335+0000 7f3e7e000700 1 -- 172.21.15.159:0/2040996182 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e6c00f670 con 0x7f3e80103fd0 2024-02-28T23:06:23.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.335+0000 7f3e88000700 1 -- 172.21.15.159:0/2040996182 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e800fff50 con 0x7f3e80103fd0 2024-02-28T23:06:23.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.335+0000 7f3e88000700 1 -- 172.21.15.159:0/2040996182 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e80100440 con 0x7f3e80103fd0 2024-02-28T23:06:23.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.336+0000 7f3e88000700 1 -- 172.21.15.159:0/2040996182 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e80190520 con 0x7f3e80103fd0 2024-02-28T23:06:23.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.339+0000 7f3e7e000700 1 -- 172.21.15.159:0/2040996182 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 20) v1 ==== 90827+0+0 (secure 0 0 0) 0x7f3e6c022a50 con 0x7f3e80103fd0 2024-02-28T23:06:23.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.339+0000 7f3e7e000700 1 --2- 172.21.15.159:0/2040996182 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3e6806cd00 0x7f3e6806f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:23.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.340+0000 7f3e7e000700 1 -- 172.21.15.159:0/2040996182 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3e6c08dec0 con 0x7f3e80103fd0 2024-02-28T23:06:23.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.340+0000 7f3e85600700 1 --2- 172.21.15.159:0/2040996182 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3e6806cd00 0x7f3e6806f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:23.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.340+0000 7f3e85600700 1 --2- 172.21.15.159:0/2040996182 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3e6806cd00 0x7f3e6806f1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e74005ea0 tx=0x7f3e74005e30 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:23.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.346+0000 7f3e7e000700 1 -- 172.21.15.159:0/2040996182 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f3e6c05c2c0 con 0x7f3e80103fd0 2024-02-28T23:06:23.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.641+0000 7f3e88000700 1 -- 172.21.15.159:0/2040996182 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e800611d0 con 0x7f3e6806cd00 2024-02-28T23:06:23.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.658+0000 7f3e7e000700 1 -- 172.21.15.159:0/2040996182 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f3e800611d0 con 0x7f3e6806cd00 2024-02-28T23:06:23.657 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:06:23.657 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (8m) 2m ago 10m 13.2M - 0.25.0 c8568f914cd2 2b2966e86e70 2024-02-28T23:06:23.657 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (10m) 2m ago 10m 7604k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:06:23.657 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (9m) 4s ago 9m 7453k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:06:23.657 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (10m) 2m ago 10m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (8m) 4s ago 8m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (7m) 2m ago 9m 74.1M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (2m) 2m ago 2m 14.3M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (2m) 2m ago 2m 12.9M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (2m) 4s ago 2m 12.7M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (2m) 4s ago 2m 12.7M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:9283,8765,8443 running (11m) 2m ago 11m 490M - 18.2.1 5be31c24972a f518a1599079 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (15s) 4s ago 8m 55.5M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1399495d8706 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (12m) 2m ago 12m 43.5M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (8m) 4s ago 8m 35.5M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (10m) 2m ago 10m 7906k - 1.5.0 0da6a335fe13 009475616a7b 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (8m) 4s ago 8m 8108k - 1.5.0 0da6a335fe13 a45ab4136b88 2024-02-28T23:06:23.658 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (7m) 2m ago 7m 46.7M 3947M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:06:23.659 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (7m) 2m ago 7m 47.2M 3947M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:06:23.659 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (6m) 2m ago 6m 45.6M 3947M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:06:23.659 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (5m) 4s ago 5m 83.0M 4971M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:06:23.659 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (5m) 4s ago 5m 80.1M 4971M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:06:23.659 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (4m) 4s ago 4m 78.2M 4971M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:06:23.659 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (7m) 2m ago 9m 47.8M - 2.43.0 a07b618ecd1d abc97d603adc 2024-02-28T23:06:23.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.662+0000 7f3e88000700 1 -- 172.21.15.159:0/2040996182 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3e6806cd00 msgr2=0x7f3e6806f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:23.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.662+0000 7f3e88000700 1 --2- 172.21.15.159:0/2040996182 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3e6806cd00 0x7f3e6806f1c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3e74005ea0 tx=0x7f3e74005e30 comp rx=0 tx=0).stop 2024-02-28T23:06:23.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.662+0000 7f3e88000700 1 -- 172.21.15.159:0/2040996182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e80103fd0 msgr2=0x7f3e800ff650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:23.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.662+0000 7f3e88000700 1 --2- 172.21.15.159:0/2040996182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e80103fd0 0x7f3e800ff650 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00bd70 tx=0x7f3e6c00be50 comp rx=0 tx=0).stop 2024-02-28T23:06:23.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.662+0000 7f3e88000700 1 -- 172.21.15.159:0/2040996182 shutdown_connections 2024-02-28T23:06:23.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.662+0000 7f3e88000700 1 --2- 172.21.15.159:0/2040996182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3e801016a0 0x7f3e80101000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.662+0000 7f3e88000700 1 --2- 172.21.15.159:0/2040996182 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f3e6806cd00 0x7f3e6806f1c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.662+0000 7f3e88000700 1 --2- 172.21.15.159:0/2040996182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e80103fd0 0x7f3e800ff650 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.662+0000 7f3e88000700 1 -- 172.21.15.159:0/2040996182 >> 172.21.15.159:0/2040996182 conn(0x7f3e800fb030 msgr2=0x7f3e800fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:23.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.662+0000 7f3e88000700 1 -- 172.21.15.159:0/2040996182 shutdown_connections 2024-02-28T23:06:23.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.662+0000 7f3e88000700 1 -- 172.21.15.159:0/2040996182 wait complete. 2024-02-28T23:06:23.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:23 smithi159 ceph-mon[28802]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:23.773 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:23 smithi184 ceph-mon[36198]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:23.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.866+0000 7feb74400700 1 -- 172.21.15.159:0/248228102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb6c107200 msgr2=0x7feb6c107620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:23.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.866+0000 7feb74400700 1 --2- 172.21.15.159:0/248228102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb6c107200 0x7feb6c107620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7feb60009910 tx=0x7feb60009c20 comp rx=0 tx=0).stop 2024-02-28T23:06:23.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.867+0000 7feb74400700 1 -- 172.21.15.159:0/248228102 shutdown_connections 2024-02-28T23:06:23.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.867+0000 7feb74400700 1 --2- 172.21.15.159:0/248228102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb6c108400 0x7feb6c108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.867+0000 7feb74400700 1 --2- 172.21.15.159:0/248228102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb6c107200 0x7feb6c107620 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.867+0000 7feb74400700 1 -- 172.21.15.159:0/248228102 >> 172.21.15.159:0/248228102 conn(0x7feb6c06a1d0 msgr2=0x7feb6c078790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:23.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.867+0000 7feb74400700 1 -- 172.21.15.159:0/248228102 shutdown_connections 2024-02-28T23:06:23.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.867+0000 7feb74400700 1 -- 172.21.15.159:0/248228102 wait complete. 2024-02-28T23:06:23.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.868+0000 7feb74400700 1 Processor -- start 2024-02-28T23:06:23.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.868+0000 7feb74400700 1 -- start start 2024-02-28T23:06:23.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.868+0000 7feb74400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb6c107200 0x7feb6c19c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:23.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.868+0000 7feb74400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb6c108400 0x7feb6c19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:23.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.868+0000 7feb74400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c19d4f0 con 0x7feb6c108400 2024-02-28T23:06:23.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.868+0000 7feb74400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c19d630 con 0x7feb6c107200 2024-02-28T23:06:23.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.869+0000 7feb71000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb6c108400 0x7feb6c19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:23.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.869+0000 7feb71a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb6c107200 0x7feb6c19c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:23.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.869+0000 7feb71a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb6c107200 0x7feb6c19c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:59742/0 (socket says 172.21.15.159:59742) 2024-02-28T23:06:23.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.869+0000 7feb71000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb6c108400 0x7feb6c19ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33464/0 (socket says 172.21.15.159:33464) 2024-02-28T23:06:23.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.869+0000 7feb71a00700 1 -- 172.21.15.159:0/2505474303 learned_addr learned my addr 172.21.15.159:0/2505474303 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:06:23.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.870+0000 7feb71000700 1 -- 172.21.15.159:0/2505474303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb6c107200 msgr2=0x7feb6c19c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:23.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.870+0000 7feb71000700 1 --2- 172.21.15.159:0/2505474303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb6c107200 0x7feb6c19c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:23.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.870+0000 7feb71000700 1 -- 172.21.15.159:0/2505474303 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb600095f0 con 0x7feb6c108400 2024-02-28T23:06:23.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.871+0000 7feb71000700 1 --2- 172.21.15.159:0/2505474303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb6c108400 0x7feb6c19ced0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb5800d8d0 tx=0x7feb5800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:23.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.871+0000 7feb6a000700 1 -- 172.21.15.159:0/2505474303 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb5800f860 con 0x7feb6c108400 2024-02-28T23:06:23.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.871+0000 7feb6a000700 1 -- 172.21.15.159:0/2505474303 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7feb5800fe70 con 0x7feb6c108400 2024-02-28T23:06:23.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.871+0000 7feb74400700 1 -- 172.21.15.159:0/2505474303 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6c1a20e0 con 0x7feb6c108400 2024-02-28T23:06:23.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.872+0000 7feb74400700 1 -- 172.21.15.159:0/2505474303 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6c1a2630 con 0x7feb6c108400 2024-02-28T23:06:23.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.872+0000 7feb6a000700 1 -- 172.21.15.159:0/2505474303 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb5800e5e0 con 0x7feb6c108400 2024-02-28T23:06:23.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.873+0000 7feb74400700 1 -- 172.21.15.159:0/2505474303 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4c005320 con 0x7feb6c108400 2024-02-28T23:06:23.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.874+0000 7feb6a000700 1 -- 172.21.15.159:0/2505474303 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 20) v1 ==== 90827+0+0 (secure 0 0 0) 0x7feb5800f9c0 con 0x7feb6c108400 2024-02-28T23:06:23.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.877+0000 7feb6a000700 1 --2- 172.21.15.159:0/2505474303 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7feb5406cd50 0x7feb5406f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:23.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.877+0000 7feb6a000700 1 -- 172.21.15.159:0/2505474303 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7feb5808bd70 con 0x7feb6c108400 2024-02-28T23:06:23.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.878+0000 7feb71a00700 1 --2- 172.21.15.159:0/2505474303 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7feb5406cd50 0x7feb5406f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:23.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.879+0000 7feb71a00700 1 --2- 172.21.15.159:0/2505474303 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7feb5406cd50 0x7feb5406f210 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feb6000b5c0 tx=0x7feb60005fb0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:23.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:23.883+0000 7feb6a000700 1 -- 172.21.15.159:0/2505474303 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7feb5805a000 con 0x7feb6c108400 2024-02-28T23:06:24.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.329+0000 7feb74400700 1 -- 172.21.15.159:0/2505474303 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feb4c006200 con 0x7feb6c108400 2024-02-28T23:06:24.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.329+0000 7feb6a000700 1 -- 172.21.15.159:0/2505474303 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7feb58059b90 con 0x7feb6c108400 2024-02-28T23:06:24.328 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:06:24.328 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:06:24.328 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:06:24.328 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:06:24.328 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:06:24.328 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-02-28T23:06:24.328 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:06:24.328 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:06:24.328 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:06:24.329 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:06:24.329 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:06:24.329 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:06:24.329 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:06:24.329 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:06:24.329 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:06:24.329 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 13, 2024-02-28T23:06:24.329 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:06:24.329 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:06:24.329 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:06:24.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.332+0000 7feb74400700 1 -- 172.21.15.159:0/2505474303 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7feb5406cd50 msgr2=0x7feb5406f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:24.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.332+0000 7feb74400700 1 --2- 172.21.15.159:0/2505474303 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7feb5406cd50 0x7feb5406f210 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feb6000b5c0 tx=0x7feb60005fb0 comp rx=0 tx=0).stop 2024-02-28T23:06:24.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.332+0000 7feb74400700 1 -- 172.21.15.159:0/2505474303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb6c108400 msgr2=0x7feb6c19ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:24.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.333+0000 7feb74400700 1 --2- 172.21.15.159:0/2505474303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb6c108400 0x7feb6c19ced0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7feb5800d8d0 tx=0x7feb5800dbe0 comp rx=0 tx=0).stop 2024-02-28T23:06:24.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.333+0000 7feb74400700 1 -- 172.21.15.159:0/2505474303 shutdown_connections 2024-02-28T23:06:24.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.333+0000 7feb74400700 1 --2- 172.21.15.159:0/2505474303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb6c107200 0x7feb6c19c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:24.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.333+0000 7feb74400700 1 --2- 172.21.15.159:0/2505474303 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7feb5406cd50 0x7feb5406f210 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:24.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.333+0000 7feb74400700 1 --2- 172.21.15.159:0/2505474303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb6c108400 0x7feb6c19ced0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:24.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.333+0000 7feb74400700 1 -- 172.21.15.159:0/2505474303 >> 172.21.15.159:0/2505474303 conn(0x7feb6c06a1d0 msgr2=0x7feb6c10b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:24.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.333+0000 7feb74400700 1 -- 172.21.15.159:0/2505474303 shutdown_connections 2024-02-28T23:06:24.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.333+0000 7feb74400700 1 -- 172.21.15.159:0/2505474303 wait complete. 2024-02-28T23:06:24.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.504+0000 7f337be00700 1 -- 172.21.15.159:0/4020633008 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f336800bb10 con 0x7f337c103fd0 2024-02-28T23:06:24.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.504+0000 7f3384400700 1 -- 172.21.15.159:0/4020633008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f337c103fd0 msgr2=0x7f337c1063c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:24.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.504+0000 7f3384400700 1 --2- 172.21.15.159:0/4020633008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f337c103fd0 0x7f337c1063c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f3368009870 tx=0x7f3368009b80 comp rx=0 tx=0).stop 2024-02-28T23:06:24.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.505+0000 7f3384400700 1 -- 172.21.15.159:0/4020633008 shutdown_connections 2024-02-28T23:06:24.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.505+0000 7f3384400700 1 --2- 172.21.15.159:0/4020633008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f337c103fd0 0x7f337c1063c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:24.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.505+0000 7f3384400700 1 --2- 172.21.15.159:0/4020633008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f337c1016a0 0x7f337c103a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:24.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.505+0000 7f3384400700 1 -- 172.21.15.159:0/4020633008 >> 172.21.15.159:0/4020633008 conn(0x7f337c0fb030 msgr2=0x7f337c0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:24.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.505+0000 7f3384400700 1 -- 172.21.15.159:0/4020633008 shutdown_connections 2024-02-28T23:06:24.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.506+0000 7f3384400700 1 -- 172.21.15.159:0/4020633008 wait complete. 2024-02-28T23:06:24.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.507+0000 7f3384400700 1 Processor -- start 2024-02-28T23:06:24.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.507+0000 7f3384400700 1 -- start start 2024-02-28T23:06:24.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.508+0000 7f3384400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f337c1016a0 0x7f337c108e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:24.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.508+0000 7f3384400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f337c103fd0 0x7f337c109350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:24.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.508+0000 7f3384400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c109970 con 0x7f337c1016a0 2024-02-28T23:06:24.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.508+0000 7f3384400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c109ab0 con 0x7f337c103fd0 2024-02-28T23:06:24.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.508+0000 7f3381000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f337c103fd0 0x7f337c109350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:24.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.508+0000 7f3381000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f337c103fd0 0x7f337c109350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:59758/0 (socket says 172.21.15.159:59758) 2024-02-28T23:06:24.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.508+0000 7f3381000700 1 -- 172.21.15.159:0/1850269226 learned_addr learned my addr 172.21.15.159:0/1850269226 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:06:24.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.508+0000 7f3381a00700 1 --2- 172.21.15.159:0/1850269226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f337c1016a0 0x7f337c108e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:24.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.509+0000 7f3381a00700 1 -- 172.21.15.159:0/1850269226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f337c103fd0 msgr2=0x7f337c109350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:24.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.509+0000 7f3381a00700 1 --2- 172.21.15.159:0/1850269226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f337c103fd0 0x7f337c109350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:24.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.509+0000 7f3381a00700 1 -- 172.21.15.159:0/1850269226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368009520 con 0x7f337c1016a0 2024-02-28T23:06:24.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.510+0000 7f3381a00700 1 --2- 172.21.15.159:0/1850269226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f337c1016a0 0x7f337c108e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f337000e940 tx=0x7f337000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:24.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.510+0000 7f337a000700 1 -- 172.21.15.159:0/1850269226 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f337000c990 con 0x7f337c1016a0 2024-02-28T23:06:24.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.510+0000 7f337a000700 1 -- 172.21.15.159:0/1850269226 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3370010430 con 0x7f337c1016a0 2024-02-28T23:06:24.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.510+0000 7f3384400700 1 -- 172.21.15.159:0/1850269226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337c0ff4f0 con 0x7f337c1016a0 2024-02-28T23:06:24.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.510+0000 7f337a000700 1 -- 172.21.15.159:0/1850269226 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f337000c990 con 0x7f337c1016a0 2024-02-28T23:06:24.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.510+0000 7f3384400700 1 -- 172.21.15.159:0/1850269226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c0ffac0 con 0x7f337c1016a0 2024-02-28T23:06:24.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.512+0000 7f3384400700 1 -- 172.21.15.159:0/1850269226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c06c2b0 con 0x7f337c1016a0 2024-02-28T23:06:24.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.515+0000 7f337a000700 1 -- 172.21.15.159:0/1850269226 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 20) v1 ==== 90827+0+0 (secure 0 0 0) 0x7f33700105a0 con 0x7f337c1016a0 2024-02-28T23:06:24.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.516+0000 7f337a000700 1 --2- 172.21.15.159:0/1850269226 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f336406cd50 0x7f336406f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:24.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.516+0000 7f337a000700 1 -- 172.21.15.159:0/1850269226 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5554+0+0 (secure 0 0 0) 0x7f3370014070 con 0x7f337c1016a0 2024-02-28T23:06:24.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.517+0000 7f3381000700 1 --2- 172.21.15.159:0/1850269226 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f336406cd50 0x7f336406f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:24.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.518+0000 7f3381000700 1 --2- 172.21.15.159:0/1850269226 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f336406cd50 0x7f336406f210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3368009f50 tx=0x7f3368019040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:24.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.523+0000 7f337a000700 1 -- 172.21.15.159:0/1850269226 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180422 (secure 0 0 0) 0x7f33700520e0 con 0x7f337c1016a0 2024-02-28T23:06:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:24 smithi184 ceph-mon[36198]: pgmap v313: 65 pgs: 65 active+clean; 105 MiB data, 567 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 314 op/s 2024-02-28T23:06:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:24 smithi184 ceph-mon[36198]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:24 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2505474303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:06:24.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:24 smithi159 ceph-mon[28802]: pgmap v313: 65 pgs: 65 active+clean; 105 MiB data, 567 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 314 op/s 2024-02-28T23:06:24.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:24 smithi159 ceph-mon[28802]: from='client.14602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:24.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:24 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2505474303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:06:24.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.899+0000 7f3384400700 1 -- 172.21.15.159:0/1850269226 --> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f337c06ded0 con 0x7f336406cd50 2024-02-28T23:06:24.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.902+0000 7f337a000700 1 -- 172.21.15.159:0/1850269226 <== mgr.14217 v2:172.21.15.159:6800/1861094655 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f337c06ded0 con 0x7f336406cd50 2024-02-28T23:06:24.900 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:06:24.901 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:06:24.901 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:06:24.901 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:06:24.901 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [], 2024-02-28T23:06:24.901 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "1/2 daemons upgraded", 2024-02-28T23:06:24.901 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading mgr daemons", 2024-02-28T23:06:24.901 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:06:24.901 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:06:24.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.905+0000 7f3384400700 1 -- 172.21.15.159:0/1850269226 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f336406cd50 msgr2=0x7f336406f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:24.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.905+0000 7f3384400700 1 --2- 172.21.15.159:0/1850269226 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f336406cd50 0x7f336406f210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3368009f50 tx=0x7f3368019040 comp rx=0 tx=0).stop 2024-02-28T23:06:24.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.905+0000 7f3384400700 1 -- 172.21.15.159:0/1850269226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f337c1016a0 msgr2=0x7f337c108e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:24.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.905+0000 7f3384400700 1 --2- 172.21.15.159:0/1850269226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f337c1016a0 0x7f337c108e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f337000e940 tx=0x7f337000ec50 comp rx=0 tx=0).stop 2024-02-28T23:06:24.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.905+0000 7f3384400700 1 -- 172.21.15.159:0/1850269226 shutdown_connections 2024-02-28T23:06:24.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.905+0000 7f3384400700 1 --2- 172.21.15.159:0/1850269226 >> [v2:172.21.15.159:6800/1861094655,v1:172.21.15.159:6801/1861094655] conn(0x7f336406cd50 0x7f336406f210 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:24.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.905+0000 7f3384400700 1 --2- 172.21.15.159:0/1850269226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f337c1016a0 0x7f337c108e10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:24.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.905+0000 7f3384400700 1 --2- 172.21.15.159:0/1850269226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f337c103fd0 0x7f337c109350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:24.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.905+0000 7f3384400700 1 -- 172.21.15.159:0/1850269226 >> 172.21.15.159:0/1850269226 conn(0x7f337c0fb030 msgr2=0x7f337c0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:24.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.905+0000 7f3384400700 1 -- 172.21.15.159:0/1850269226 shutdown_connections 2024-02-28T23:06:24.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:24.906+0000 7f3384400700 1 -- 172.21.15.159:0/1850269226 wait complete. 2024-02-28T23:06:25.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:25 smithi159 ceph-mon[28802]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:25.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:25 smithi184 ceph-mon[36198]: from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:26.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:26 smithi159 ceph-mon[28802]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:26.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:26 smithi159 ceph-mon[28802]: pgmap v314: 65 pgs: 65 active+clean; 110 MiB data, 590 MiB used, 536 GiB / 536 GiB avail; 974 KiB/s rd, 2.0 MiB/s wr, 295 op/s 2024-02-28T23:06:26.792 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:26 smithi184 ceph-mon[36198]: from='client.14614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:26.792 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:26 smithi184 ceph-mon[36198]: pgmap v314: 65 pgs: 65 active+clean; 110 MiB data, 590 MiB used, 536 GiB / 536 GiB avail; 974 KiB/s rd, 2.0 MiB/s wr, 295 op/s 2024-02-28T23:06:28.323 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: pgmap v315: 65 pgs: 65 active+clean; 115 MiB data, 607 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 299 op/s 2024-02-28T23:06:28.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:28.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:28.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:06:28.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:06:28.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:28.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:06:28.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr fail", "who": "smithi159.pobewk"}]: dispatch 2024-02-28T23:06:28.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: osdmap e47: 6 total, 6 up, 6 in 2024-02-28T23:06:28.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "mgr fail", "who": "smithi159.pobewk"}]': finished 2024-02-28T23:06:28.324 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: mgrmap e21: smithi184.quvmnx(active, starting, since 0.0126379s) 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mgr metadata", "who": "smithi184.quvmnx", "id": "smithi184.quvmnx"}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:06:28.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T23:06:28.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T23:06:28.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T23:06:28.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: Manager daemon smithi184.quvmnx is now available 2024-02-28T23:06:28.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:06:28.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:06:28.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:06:28.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi184.quvmnx/mirror_snapshot_schedule"}]: dispatch 2024-02-28T23:06:28.326 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi184.quvmnx/trash_purge_schedule"}]: dispatch 2024-02-28T23:06:28.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: pgmap v315: 65 pgs: 65 active+clean; 115 MiB data, 607 MiB used, 536 GiB / 536 GiB avail; 1.3 MiB/s rd, 2.1 MiB/s wr, 299 op/s 2024-02-28T23:06:28.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:28.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:28.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:06:28.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:06:28.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' 2024-02-28T23:06:28.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr fail", "who": "smithi159.pobewk"}]: dispatch 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: osdmap e47: 6 total, 6 up, 6 in 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.14217 172.21.15.159:0/3504411401' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "mgr fail", "who": "smithi159.pobewk"}]': finished 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: mgrmap e21: smithi184.quvmnx(active, starting, since 0.0126379s) 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mgr metadata", "who": "smithi184.quvmnx", "id": "smithi184.quvmnx"}]: dispatch 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T23:06:28.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: Manager daemon smithi184.quvmnx is now available 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi184.quvmnx/mirror_snapshot_schedule"}]: dispatch 2024-02-28T23:06:28.687 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi184.quvmnx/trash_purge_schedule"}]: dispatch 2024-02-28T23:06:29.951 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:29 smithi159 ceph-mon[28802]: Deploying cephadm binary to smithi184 2024-02-28T23:06:29.951 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:29 smithi159 ceph-mon[28802]: Deploying cephadm binary to smithi159 2024-02-28T23:06:29.951 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:29 smithi159 ceph-mon[28802]: mgrmap e22: smithi184.quvmnx(active, since 1.0171s) 2024-02-28T23:06:29.951 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:29 smithi159 ceph-mon[28802]: pgmap v3: 65 pgs: 65 active+clean; 122 MiB data, 649 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:06:29.951 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:29 smithi159 ceph-mon[28802]: [28/Feb/2024:23:06:28] ENGINE Bus STARTING 2024-02-28T23:06:29.951 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:29 smithi159 ceph-mon[28802]: [28/Feb/2024:23:06:28] ENGINE Serving on http://172.21.15.184:8765 2024-02-28T23:06:29.951 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:29 smithi159 ceph-mon[28802]: [28/Feb/2024:23:06:29] ENGINE Serving on https://172.21.15.184:7150 2024-02-28T23:06:29.951 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:29 smithi159 ceph-mon[28802]: [28/Feb/2024:23:06:29] ENGINE Bus STARTED 2024-02-28T23:06:30.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:29 smithi184 ceph-mon[36198]: Deploying cephadm binary to smithi184 2024-02-28T23:06:30.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:29 smithi184 ceph-mon[36198]: Deploying cephadm binary to smithi159 2024-02-28T23:06:30.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:29 smithi184 ceph-mon[36198]: mgrmap e22: smithi184.quvmnx(active, since 1.0171s) 2024-02-28T23:06:30.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:29 smithi184 ceph-mon[36198]: pgmap v3: 65 pgs: 65 active+clean; 122 MiB data, 649 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:06:30.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:29 smithi184 ceph-mon[36198]: [28/Feb/2024:23:06:28] ENGINE Bus STARTING 2024-02-28T23:06:30.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:29 smithi184 ceph-mon[36198]: [28/Feb/2024:23:06:28] ENGINE Serving on http://172.21.15.184:8765 2024-02-28T23:06:30.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:29 smithi184 ceph-mon[36198]: [28/Feb/2024:23:06:29] ENGINE Serving on https://172.21.15.184:7150 2024-02-28T23:06:30.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:29 smithi184 ceph-mon[36198]: [28/Feb/2024:23:06:29] ENGINE Bus STARTED 2024-02-28T23:06:30.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:30 smithi159 ceph-mon[28802]: pgmap v4: 65 pgs: 65 active+clean; 122 MiB data, 649 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:06:31.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:30 smithi184 ceph-mon[36198]: pgmap v4: 65 pgs: 65 active+clean; 122 MiB data, 649 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:06:31.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:31 smithi159 ceph-mon[28802]: mgrmap e23: smithi184.quvmnx(active, since 3s) 2024-02-28T23:06:32.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:31 smithi184 ceph-mon[36198]: mgrmap e23: smithi184.quvmnx(active, since 3s) 2024-02-28T23:06:32.971 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:32 smithi159 ceph-mon[28802]: pgmap v5: 65 pgs: 65 active+clean; 122 MiB data, 649 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:06:33.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:32 smithi184 ceph-mon[36198]: pgmap v5: 65 pgs: 65 active+clean; 122 MiB data, 649 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:06:33.928 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:33 smithi159 ceph-mon[28802]: mgrmap e24: smithi184.quvmnx(active, since 5s) 2024-02-28T23:06:34.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:33 smithi184 ceph-mon[36198]: mgrmap e24: smithi184.quvmnx(active, since 5s) 2024-02-28T23:06:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:35 smithi159 ceph-mon[28802]: pgmap v6: 65 pgs: 65 active+clean; 128 MiB data, 666 MiB used, 536 GiB / 536 GiB avail; 865 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-02-28T23:06:35.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:35 smithi184 ceph-mon[36198]: pgmap v6: 65 pgs: 65 active+clean; 128 MiB data, 666 MiB used, 536 GiB / 536 GiB avail; 865 KiB/s rd, 1.3 MiB/s wr, 130 op/s 2024-02-28T23:06:37.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:37 smithi159 ceph-mon[28802]: pgmap v7: 65 pgs: 65 active+clean; 132 MiB data, 709 MiB used, 536 GiB / 536 GiB avail; 701 KiB/s rd, 1.7 MiB/s wr, 225 op/s 2024-02-28T23:06:37.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:37 smithi184 ceph-mon[36198]: pgmap v7: 65 pgs: 65 active+clean; 132 MiB data, 709 MiB used, 536 GiB / 536 GiB avail; 701 KiB/s rd, 1.7 MiB/s wr, 225 op/s 2024-02-28T23:06:39.667 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:39 smithi159 ceph-mon[28802]: pgmap v8: 65 pgs: 65 active+clean; 132 MiB data, 709 MiB used, 536 GiB / 536 GiB avail; 545 KiB/s rd, 1.3 MiB/s wr, 174 op/s 2024-02-28T23:06:39.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:39 smithi184 ceph-mon[36198]: pgmap v8: 65 pgs: 65 active+clean; 132 MiB data, 709 MiB used, 536 GiB / 536 GiB avail; 545 KiB/s rd, 1.3 MiB/s wr, 174 op/s 2024-02-28T23:06:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:40 smithi159 ceph-mon[28802]: Standby manager daemon smithi159.pobewk started 2024-02-28T23:06:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:40 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.159:0/971383983' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.pobewk/crt"}]: dispatch 2024-02-28T23:06:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:40 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.159:0/971383983' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:06:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:40 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.159:0/971383983' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.pobewk/key"}]: dispatch 2024-02-28T23:06:40.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:40 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.159:0/971383983' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:06:40.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:40 smithi184 ceph-mon[36198]: Standby manager daemon smithi159.pobewk started 2024-02-28T23:06:40.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:40 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.159:0/971383983' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.pobewk/crt"}]: dispatch 2024-02-28T23:06:40.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:40 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.159:0/971383983' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:06:40.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:40 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.159:0/971383983' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.pobewk/key"}]: dispatch 2024-02-28T23:06:40.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:40 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.159:0/971383983' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:06:41.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:41 smithi159 ceph-mon[28802]: pgmap v9: 65 pgs: 65 active+clean; 149 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 268 op/s 2024-02-28T23:06:41.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:41 smithi159 ceph-mon[28802]: mgrmap e25: smithi184.quvmnx(active, since 12s), standbys: smithi159.pobewk 2024-02-28T23:06:41.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:41 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mgr metadata", "who": "smithi159.pobewk", "id": "smithi159.pobewk"}]: dispatch 2024-02-28T23:06:41.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:41 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:41.476 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:41 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:41.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:41 smithi184 ceph-mon[36198]: pgmap v9: 65 pgs: 65 active+clean; 149 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 268 op/s 2024-02-28T23:06:41.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:41 smithi184 ceph-mon[36198]: mgrmap e25: smithi184.quvmnx(active, since 12s), standbys: smithi159.pobewk 2024-02-28T23:06:41.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:41 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mgr metadata", "who": "smithi159.pobewk", "id": "smithi159.pobewk"}]: dispatch 2024-02-28T23:06:41.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:41 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:41.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:41 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:43.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:43 smithi159 ceph-mon[28802]: pgmap v10: 65 pgs: 65 active+clean; 149 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 987 KiB/s rd, 2.4 MiB/s wr, 246 op/s 2024-02-28T23:06:43.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:43 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:43.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:43 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:43.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:43 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:06:43.761 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:43 smithi184 ceph-mon[36198]: pgmap v10: 65 pgs: 65 active+clean; 149 MiB data, 731 MiB used, 536 GiB / 536 GiB avail; 987 KiB/s rd, 2.4 MiB/s wr, 246 op/s 2024-02-28T23:06:43.761 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:43 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:43.761 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:43 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:43.761 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:43 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:06:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:44 smithi159 ceph-mon[28802]: pgmap v11: 65 pgs: 65 active+clean; 153 MiB data, 753 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 288 op/s 2024-02-28T23:06:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:44 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:44 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:45.001 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:44 smithi184 ceph-mon[36198]: pgmap v11: 65 pgs: 65 active+clean; 153 MiB data, 753 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.8 MiB/s wr, 288 op/s 2024-02-28T23:06:45.001 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:44 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:45.001 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:44 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:47.163 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:46 smithi184 ceph-mon[36198]: pgmap v12: 65 pgs: 65 active+clean; 162 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 304 op/s 2024-02-28T23:06:47.163 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:46 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:47.163 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:46 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:47.163 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:46 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:47.163 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:46 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:47.163 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:46 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:47.163 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:46 smithi184 ceph-mon[36198]: Adjusting osd_memory_target on smithi159 to 1217M 2024-02-28T23:06:47.164 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:46 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:47.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:46 smithi159 ceph-mon[28802]: pgmap v12: 65 pgs: 65 active+clean; 162 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 1.2 MiB/s rd, 3.0 MiB/s wr, 304 op/s 2024-02-28T23:06:47.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:46 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:47.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:46 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:47.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:46 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:47.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:46 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:47.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:46 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:47.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:46 smithi159 ceph-mon[28802]: Adjusting osd_memory_target on smithi159 to 1217M 2024-02-28T23:06:47.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:46 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:49.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: pgmap v13: 65 pgs: 65 active+clean; 162 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 228 op/s 2024-02-28T23:06:49.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:49.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:49.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:49.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: Adjusting osd_memory_target on smithi184 to 2241M 2024-02-28T23:06:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:06:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:06:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: Updating smithi159:/etc/ceph/ceph.conf 2024-02-28T23:06:49.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:49 smithi159 ceph-mon[28802]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-28T23:06:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: pgmap v13: 65 pgs: 65 active+clean; 162 MiB data, 801 MiB used, 536 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 228 op/s 2024-02-28T23:06:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-02-28T23:06:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: Adjusting osd_memory_target on smithi184 to 2241M 2024-02-28T23:06:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:06:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:06:49.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: Updating smithi159:/etc/ceph/ceph.conf 2024-02-28T23:06:49.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:49 smithi184 ceph-mon[36198]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-28T23:06:50.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:50 smithi184 ceph-mon[36198]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:06:50.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:50 smithi184 ceph-mon[36198]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:06:50.471 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:50 smithi159 ceph-mon[28802]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:06:50.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:50 smithi159 ceph-mon[28802]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:06:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:51 smithi159 ceph-mon[28802]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:06:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:51 smithi159 ceph-mon[28802]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:06:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:51 smithi159 ceph-mon[28802]: pgmap v14: 65 pgs: 65 active+clean; 174 MiB data, 857 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 354 op/s 2024-02-28T23:06:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:51 smithi159 ceph-mon[28802]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:06:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:51 smithi159 ceph-mon[28802]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:06:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:51 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:51 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:51 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:51 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:51.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:51 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:51.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:51 smithi184 ceph-mon[36198]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:06:51.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:51 smithi184 ceph-mon[36198]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:06:51.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:51 smithi184 ceph-mon[36198]: pgmap v14: 65 pgs: 65 active+clean; 174 MiB data, 857 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 3.7 MiB/s wr, 354 op/s 2024-02-28T23:06:51.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:51 smithi184 ceph-mon[36198]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:06:51.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:51 smithi184 ceph-mon[36198]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:06:51.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:51 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:51.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:51 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:51.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:51 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:51.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:51 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:51.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:51 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:06:52.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:52 smithi159 ceph-mon[28802]: Reconfiguring prometheus.smithi159 (dependencies changed)... 2024-02-28T23:06:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:52 smithi184 ceph-mon[36198]: Reconfiguring prometheus.smithi159 (dependencies changed)... 2024-02-28T23:06:53.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:53 smithi159 ceph-mon[28802]: Reconfiguring daemon prometheus.smithi159 on smithi159 2024-02-28T23:06:53.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:53 smithi159 ceph-mon[28802]: pgmap v15: 65 pgs: 65 active+clean; 174 MiB data, 857 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 238 op/s 2024-02-28T23:06:53.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:53 smithi184 ceph-mon[36198]: Reconfiguring daemon prometheus.smithi159 on smithi159 2024-02-28T23:06:53.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:53 smithi184 ceph-mon[36198]: pgmap v15: 65 pgs: 65 active+clean; 174 MiB data, 857 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 238 op/s 2024-02-28T23:06:55.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.121+0000 7fc073200700 1 -- 172.21.15.159:0/362174451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0ff470 msgr2=0x7fc06c0ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:55.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.121+0000 7fc073200700 1 --2- 172.21.15.159:0/362174451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0ff470 0x7fc06c0ff890 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc05c009910 tx=0x7fc05c009c20 comp rx=0 tx=0).stop 2024-02-28T23:06:55.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.122+0000 7fc073200700 1 -- 172.21.15.159:0/362174451 shutdown_connections 2024-02-28T23:06:55.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.122+0000 7fc073200700 1 --2- 172.21.15.159:0/362174451 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc06c0ffdd0 0x7fc06c100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:55.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.122+0000 7fc073200700 1 --2- 172.21.15.159:0/362174451 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0ff470 0x7fc06c0ff890 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:55.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.122+0000 7fc073200700 1 -- 172.21.15.159:0/362174451 >> 172.21.15.159:0/362174451 conn(0x7fc06c0fb030 msgr2=0x7fc06c0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:55.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.122+0000 7fc073200700 1 -- 172.21.15.159:0/362174451 shutdown_connections 2024-02-28T23:06:55.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.122+0000 7fc073200700 1 -- 172.21.15.159:0/362174451 wait complete. 2024-02-28T23:06:55.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.123+0000 7fc073200700 1 Processor -- start 2024-02-28T23:06:55.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.124+0000 7fc073200700 1 -- start start 2024-02-28T23:06:55.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.124+0000 7fc073200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0ff470 0x7fc06c071d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:55.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.125+0000 7fc073200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc06c0ffdd0 0x7fc06c0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:55.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.125+0000 7fc073200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c0728e0 con 0x7fc06c0ff470 2024-02-28T23:06:55.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.125+0000 7fc073200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06c1a62b0 con 0x7fc06c0ffdd0 2024-02-28T23:06:55.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.125+0000 7fc06b400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc06c0ffdd0 0x7fc06c0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:55.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.125+0000 7fc06be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0ff470 0x7fc06c071d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:55.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.125+0000 7fc06be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0ff470 0x7fc06c071d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34940/0 (socket says 172.21.15.159:34940) 2024-02-28T23:06:55.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.125+0000 7fc06be00700 1 -- 172.21.15.159:0/392154261 learned_addr learned my addr 172.21.15.159:0/392154261 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:06:55.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.125+0000 7fc06b400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc06c0ffdd0 0x7fc06c0722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:40184/0 (socket says 172.21.15.159:40184) 2024-02-28T23:06:55.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.126+0000 7fc06b400700 1 -- 172.21.15.159:0/392154261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0ff470 msgr2=0x7fc06c071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:55.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.126+0000 7fc06b400700 1 --2- 172.21.15.159:0/392154261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0ff470 0x7fc06c071d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:55.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.126+0000 7fc06b400700 1 -- 172.21.15.159:0/392154261 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c0095f0 con 0x7fc06c0ffdd0 2024-02-28T23:06:55.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.127+0000 7fc06b400700 1 --2- 172.21.15.159:0/392154261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc06c0ffdd0 0x7fc06c0722c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc05400d8d0 tx=0x7fc05400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.127+0000 7fc068c00700 1 -- 172.21.15.159:0/392154261 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc05400f860 con 0x7fc06c0ffdd0 2024-02-28T23:06:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.127+0000 7fc073200700 1 -- 172.21.15.159:0/392154261 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06c1a64b0 con 0x7fc06c0ffdd0 2024-02-28T23:06:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.127+0000 7fc068c00700 1 -- 172.21.15.159:0/392154261 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc05400fe70 con 0x7fc06c0ffdd0 2024-02-28T23:06:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.127+0000 7fc068c00700 1 -- 172.21.15.159:0/392154261 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc05400e5e0 con 0x7fc06c0ffdd0 2024-02-28T23:06:55.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.128+0000 7fc073200700 1 -- 172.21.15.159:0/392154261 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06c1a69d0 con 0x7fc06c0ffdd0 2024-02-28T23:06:55.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.129+0000 7fc073200700 1 -- 172.21.15.159:0/392154261 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06c10b900 con 0x7fc06c0ffdd0 2024-02-28T23:06:55.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.131+0000 7fc068c00700 1 -- 172.21.15.159:0/392154261 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 25) v1 ==== 90929+0+0 (secure 0 0 0) 0x7fc054010460 con 0x7fc06c0ffdd0 2024-02-28T23:06:55.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.132+0000 7fc068c00700 1 --2- 172.21.15.159:0/392154261 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc05006ce30 0x7fc05006f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:55.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.132+0000 7fc068c00700 1 -- 172.21.15.159:0/392154261 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc05408c300 con 0x7fc06c0ffdd0 2024-02-28T23:06:55.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.133+0000 7fc06be00700 1 --2- 172.21.15.159:0/392154261 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc05006ce30 0x7fc05006f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:55.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.134+0000 7fc06be00700 1 --2- 172.21.15.159:0/392154261 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc05006ce30 0x7fc05006f2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc05c006010 tx=0x7fc05c005ab0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:55.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.146+0000 7fc068c00700 1 -- 172.21.15.159:0/392154261 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fc054055e70 con 0x7fc06c0ffdd0 2024-02-28T23:06:55.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.538+0000 7fc073200700 1 -- 172.21.15.159:0/392154261 --> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc06c1091c0 con 0x7fc05006ce30 2024-02-28T23:06:55.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.541+0000 7fc068c00700 1 -- 172.21.15.159:0/392154261 <== mgr.24357 v2:172.21.15.184:6828/2879526003 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fc06c1091c0 con 0x7fc05006ce30 2024-02-28T23:06:55.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.546+0000 7fc073200700 1 -- 172.21.15.159:0/392154261 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc05006ce30 msgr2=0x7fc05006f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:55.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.546+0000 7fc073200700 1 --2- 172.21.15.159:0/392154261 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc05006ce30 0x7fc05006f2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc05c006010 tx=0x7fc05c005ab0 comp rx=0 tx=0).stop 2024-02-28T23:06:55.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.546+0000 7fc073200700 1 -- 172.21.15.159:0/392154261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc06c0ffdd0 msgr2=0x7fc06c0722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:55.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.546+0000 7fc073200700 1 --2- 172.21.15.159:0/392154261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc06c0ffdd0 0x7fc06c0722c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc05400d8d0 tx=0x7fc05400dbe0 comp rx=0 tx=0).stop 2024-02-28T23:06:55.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.546+0000 7fc073200700 1 -- 172.21.15.159:0/392154261 shutdown_connections 2024-02-28T23:06:55.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.546+0000 7fc073200700 1 --2- 172.21.15.159:0/392154261 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc05006ce30 0x7fc05006f2f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:55.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.546+0000 7fc073200700 1 --2- 172.21.15.159:0/392154261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc06c0ff470 0x7fc06c071d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:55.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.546+0000 7fc073200700 1 --2- 172.21.15.159:0/392154261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc06c0ffdd0 0x7fc06c0722c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:55.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.546+0000 7fc073200700 1 -- 172.21.15.159:0/392154261 >> 172.21.15.159:0/392154261 conn(0x7fc06c0fb030 msgr2=0x7fc06c107aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:55.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.547+0000 7fc073200700 1 -- 172.21.15.159:0/392154261 shutdown_connections 2024-02-28T23:06:55.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.547+0000 7fc073200700 1 -- 172.21.15.159:0/392154261 wait complete. 2024-02-28T23:06:55.568 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:06:55.568 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:55 smithi159 ceph-mon[28802]: pgmap v16: 65 pgs: 65 active+clean; 178 MiB data, 884 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 281 op/s 2024-02-28T23:06:55.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:55 smithi184 ceph-mon[36198]: pgmap v16: 65 pgs: 65 active+clean; 178 MiB data, 884 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 281 op/s 2024-02-28T23:06:55.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.746+0000 7f66f8c00700 1 -- 172.21.15.159:0/1533580889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66f410a7e0 msgr2=0x7f66f410cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:55.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.746+0000 7f66f8c00700 1 --2- 172.21.15.159:0/1533580889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66f410a7e0 0x7f66f410cbf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f66e400aa20 tx=0x7f66e400ad30 comp rx=0 tx=0).stop 2024-02-28T23:06:55.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.747+0000 7f66f8c00700 1 -- 172.21.15.159:0/1533580889 shutdown_connections 2024-02-28T23:06:55.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.747+0000 7f66f8c00700 1 --2- 172.21.15.159:0/1533580889 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66f410a7e0 0x7f66f410cbf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:55.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.747+0000 7f66f8c00700 1 --2- 172.21.15.159:0/1533580889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f4107e20 0x7f66f410a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:55.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.747+0000 7f66f8c00700 1 -- 172.21.15.159:0/1533580889 >> 172.21.15.159:0/1533580889 conn(0x7f66f406d9f0 msgr2=0x7f66f406fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:55.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.747+0000 7f66f8c00700 1 -- 172.21.15.159:0/1533580889 shutdown_connections 2024-02-28T23:06:55.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.747+0000 7f66f8c00700 1 -- 172.21.15.159:0/1533580889 wait complete. 2024-02-28T23:06:55.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.748+0000 7f66f8c00700 1 Processor -- start 2024-02-28T23:06:55.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.749+0000 7f66f8c00700 1 -- start start 2024-02-28T23:06:55.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.749+0000 7f66f8c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f4107e20 0x7f66f419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:55.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.749+0000 7f66f8c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66f410a7e0 0x7f66f419f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:55.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.749+0000 7f66f8c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f419f6e0 con 0x7f66f4107e20 2024-02-28T23:06:55.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.749+0000 7f66f8c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66f419f820 con 0x7f66f410a7e0 2024-02-28T23:06:55.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.750+0000 7f66ebe00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66f410a7e0 0x7f66f419f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:55.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.750+0000 7f66ebe00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66f410a7e0 0x7f66f419f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:40190/0 (socket says 172.21.15.159:40190) 2024-02-28T23:06:55.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.750+0000 7f66ebe00700 1 -- 172.21.15.159:0/3078056914 learned_addr learned my addr 172.21.15.159:0/3078056914 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:06:55.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.750+0000 7f66ebe00700 1 -- 172.21.15.159:0/3078056914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f4107e20 msgr2=0x7f66f419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:55.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.750+0000 7f66ebe00700 1 --2- 172.21.15.159:0/3078056914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f4107e20 0x7f66f419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:55.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.750+0000 7f66ebe00700 1 -- 172.21.15.159:0/3078056914 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e400a700 con 0x7f66f410a7e0 2024-02-28T23:06:55.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.751+0000 7f66ebe00700 1 --2- 172.21.15.159:0/3078056914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66f410a7e0 0x7f66f419f0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f66e400fdd0 tx=0x7f66e400feb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:55.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.751+0000 7f66eaa00700 1 -- 172.21.15.159:0/3078056914 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66e4005070 con 0x7f66f410a7e0 2024-02-28T23:06:55.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.751+0000 7f66f8c00700 1 -- 172.21.15.159:0/3078056914 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66f41a4270 con 0x7f66f410a7e0 2024-02-28T23:06:55.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.752+0000 7f66eaa00700 1 -- 172.21.15.159:0/3078056914 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f66e40051d0 con 0x7f66f410a7e0 2024-02-28T23:06:55.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.752+0000 7f66f8c00700 1 -- 172.21.15.159:0/3078056914 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66f41a4760 con 0x7f66f410a7e0 2024-02-28T23:06:55.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.752+0000 7f66eaa00700 1 -- 172.21.15.159:0/3078056914 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f66e4029900 con 0x7f66f410a7e0 2024-02-28T23:06:55.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.753+0000 7f66f8c00700 1 -- 172.21.15.159:0/3078056914 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66d0005320 con 0x7f66f410a7e0 2024-02-28T23:06:55.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.756+0000 7f66eaa00700 1 -- 172.21.15.159:0/3078056914 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 25) v1 ==== 90929+0+0 (secure 0 0 0) 0x7f66e4029a60 con 0x7f66f410a7e0 2024-02-28T23:06:55.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.757+0000 7f66eaa00700 1 --2- 172.21.15.159:0/3078056914 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f66d806ce90 0x7f66d806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:55.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.757+0000 7f66eaa00700 1 -- 172.21.15.159:0/3078056914 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f66e4012070 con 0x7f66f410a7e0 2024-02-28T23:06:55.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.758+0000 7f66f1e00700 1 --2- 172.21.15.159:0/3078056914 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f66d806ce90 0x7f66d806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:55.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.759+0000 7f66f1e00700 1 --2- 172.21.15.159:0/3078056914 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f66d806ce90 0x7f66d806f350 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f66dc005d90 tx=0x7f66dc005d00 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:55.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:55.774+0000 7f66eaa00700 1 -- 172.21.15.159:0/3078056914 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f66e405c670 con 0x7f66f410a7e0 2024-02-28T23:06:56.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.148+0000 7f66f8c00700 1 -- 172.21.15.159:0/3078056914 --> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f66d0000bf0 con 0x7f66d806ce90 2024-02-28T23:06:56.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.150+0000 7f66eaa00700 1 -- 172.21.15.159:0/3078056914 <== mgr.24357 v2:172.21.15.184:6828/2879526003 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f66d0000bf0 con 0x7f66d806ce90 2024-02-28T23:06:56.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.153+0000 7f66f8c00700 1 -- 172.21.15.159:0/3078056914 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f66d806ce90 msgr2=0x7f66d806f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:56.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.153+0000 7f66f8c00700 1 --2- 172.21.15.159:0/3078056914 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f66d806ce90 0x7f66d806f350 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f66dc005d90 tx=0x7f66dc005d00 comp rx=0 tx=0).stop 2024-02-28T23:06:56.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.153+0000 7f66f8c00700 1 -- 172.21.15.159:0/3078056914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66f410a7e0 msgr2=0x7f66f419f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:56.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.153+0000 7f66f8c00700 1 --2- 172.21.15.159:0/3078056914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66f410a7e0 0x7f66f419f0c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f66e400fdd0 tx=0x7f66e400feb0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.154+0000 7f66f8c00700 1 -- 172.21.15.159:0/3078056914 shutdown_connections 2024-02-28T23:06:56.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.154+0000 7f66f8c00700 1 --2- 172.21.15.159:0/3078056914 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f66d806ce90 0x7f66d806f350 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.154+0000 7f66f8c00700 1 --2- 172.21.15.159:0/3078056914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66f4107e20 0x7f66f419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.154+0000 7f66f8c00700 1 --2- 172.21.15.159:0/3078056914 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f66f410a7e0 0x7f66f419f0c0 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f66e400fdd0 tx=0x7f66e400feb0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.154+0000 7f66f8c00700 1 -- 172.21.15.159:0/3078056914 >> 172.21.15.159:0/3078056914 conn(0x7f66f406d9f0 msgr2=0x7f66f406e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:56.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.154+0000 7f66f8c00700 1 -- 172.21.15.159:0/3078056914 shutdown_connections 2024-02-28T23:06:56.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.154+0000 7f66f8c00700 1 -- 172.21.15.159:0/3078056914 wait complete. 2024-02-28T23:06:56.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.346+0000 7fbf68800700 1 -- 172.21.15.159:0/3949479001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf60101640 msgr2=0x7fbf60103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:56.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.346+0000 7fbf68800700 1 --2- 172.21.15.159:0/3949479001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf60101640 0x7fbf60103a30 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbf54009910 tx=0x7fbf54009c20 comp rx=0 tx=0).stop 2024-02-28T23:06:56.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.347+0000 7fbf68800700 1 -- 172.21.15.159:0/3949479001 shutdown_connections 2024-02-28T23:06:56.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.347+0000 7fbf68800700 1 --2- 172.21.15.159:0/3949479001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf60103f70 0x7fbf60106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.347+0000 7fbf68800700 1 --2- 172.21.15.159:0/3949479001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf60101640 0x7fbf60103a30 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.347+0000 7fbf68800700 1 -- 172.21.15.159:0/3949479001 >> 172.21.15.159:0/3949479001 conn(0x7fbf600fb030 msgr2=0x7fbf600fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:56.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.347+0000 7fbf68800700 1 -- 172.21.15.159:0/3949479001 shutdown_connections 2024-02-28T23:06:56.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.347+0000 7fbf68800700 1 -- 172.21.15.159:0/3949479001 wait complete. 2024-02-28T23:06:56.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.348+0000 7fbf68800700 1 Processor -- start 2024-02-28T23:06:56.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.348+0000 7fbf68800700 1 -- start start 2024-02-28T23:06:56.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.349+0000 7fbf68800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf60101640 0x7fbf60196300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:56.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.349+0000 7fbf68800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf60103f70 0x7fbf60196840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:56.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.349+0000 7fbf68800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf60196e60 con 0x7fbf60103f70 2024-02-28T23:06:56.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.349+0000 7fbf68800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf60196fa0 con 0x7fbf60101640 2024-02-28T23:06:56.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.349+0000 7fbf65400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf60103f70 0x7fbf60196840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:56.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.349+0000 7fbf65400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf60103f70 0x7fbf60196840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34968/0 (socket says 172.21.15.159:34968) 2024-02-28T23:06:56.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.349+0000 7fbf65400700 1 -- 172.21.15.159:0/1592282713 learned_addr learned my addr 172.21.15.159:0/1592282713 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:06:56.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.349+0000 7fbf65e00700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf60101640 0x7fbf60196300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:56.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.350+0000 7fbf65400700 1 -- 172.21.15.159:0/1592282713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf60101640 msgr2=0x7fbf60196300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:56.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.350+0000 7fbf65400700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf60101640 0x7fbf60196300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.350+0000 7fbf65400700 1 -- 172.21.15.159:0/1592282713 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf540095f0 con 0x7fbf60103f70 2024-02-28T23:06:56.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.350+0000 7fbf65e00700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf60101640 0x7fbf60196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:06:56.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.350+0000 7fbf65400700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf60103f70 0x7fbf60196840 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000d8d0 tx=0x7fbf5000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:56.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.350+0000 7fbf5aa00700 1 -- 172.21.15.159:0/1592282713 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf50009940 con 0x7fbf60103f70 2024-02-28T23:06:56.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.350+0000 7fbf5aa00700 1 -- 172.21.15.159:0/1592282713 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbf50010460 con 0x7fbf60103f70 2024-02-28T23:06:56.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.350+0000 7fbf68800700 1 -- 172.21.15.159:0/1592282713 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6019ba50 con 0x7fbf60103f70 2024-02-28T23:06:56.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.351+0000 7fbf68800700 1 -- 172.21.15.159:0/1592282713 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf6019bfa0 con 0x7fbf60103f70 2024-02-28T23:06:56.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.351+0000 7fbf5aa00700 1 -- 172.21.15.159:0/1592282713 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf5000f5f0 con 0x7fbf60103f70 2024-02-28T23:06:56.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.353+0000 7fbf68800700 1 -- 172.21.15.159:0/1592282713 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf44005320 con 0x7fbf60103f70 2024-02-28T23:06:56.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.353+0000 7fbf5aa00700 1 -- 172.21.15.159:0/1592282713 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) v1 ==== 90929+0+0 (secure 0 0 0) 0x7fbf5000f830 con 0x7fbf60103f70 2024-02-28T23:06:56.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.354+0000 7fbf5aa00700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fbf4806ce30 0x7fbf4806f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:56.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.354+0000 7fbf5aa00700 1 -- 172.21.15.159:0/1592282713 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fbf5008c800 con 0x7fbf60103f70 2024-02-28T23:06:56.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.355+0000 7fbf65e00700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fbf4806ce30 0x7fbf4806f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:56.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.356+0000 7fbf65e00700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fbf4806ce30 0x7fbf4806f2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf54006010 tx=0x7fbf5400b560 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:56.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.363+0000 7fbf5aa00700 1 -- 172.21.15.159:0/1592282713 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fbf5005ab10 con 0x7fbf60103f70 2024-02-28T23:06:56.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.696+0000 7fbf68800700 1 -- 172.21.15.159:0/1592282713 --> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf44000bf0 con 0x7fbf4806ce30 2024-02-28T23:06:56.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.737+0000 7fbf5aa00700 1 -- 172.21.15.159:0/1592282713 <== mgr.24357 v2:172.21.15.184:6828/2879526003 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fbf44000bf0 con 0x7fbf4806ce30 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (8m) 13s ago 10m 14.0M - 0.25.0 c8568f914cd2 2b2966e86e70 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (11m) 13s ago 11m 7822k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (9m) 16s ago 9m 7490k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (10m) 13s ago 10m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (9m) 16s ago 9m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (8m) 13s ago 10m 74.8M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (3m) 13s ago 3m 137M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (3m) 13s ago 3m 75.4M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (3m) 16s ago 3m 13.4M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (3m) 16s ago 3m 13.3M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:06:56.737 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:9283,8765,8443 running (12m) 13s ago 12m 325M - 18.2.1 5be31c24972a f518a1599079 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (48s) 16s ago 9m 486M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1399495d8706 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (12m) 13s ago 12m 49.0M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (9m) 16s ago 9m 38.4M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (10m) 13s ago 10m 8094k - 1.5.0 0da6a335fe13 009475616a7b 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (9m) 16s ago 9m 8216k - 1.5.0 0da6a335fe13 a45ab4136b88 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (8m) 13s ago 8m 97.8M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (7m) 13s ago 7m 110M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (6m) 13s ago 6m 90.6M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (6m) 16s ago 6m 112M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (5m) 16s ago 5m 107M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (5m) 16s ago 5m 104M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:06:56.738 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (8m) 13s ago 10m 53.4M - 2.43.0 a07b618ecd1d abc97d603adc 2024-02-28T23:06:56.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.741+0000 7fbf68800700 1 -- 172.21.15.159:0/1592282713 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fbf4806ce30 msgr2=0x7fbf4806f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:56.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.741+0000 7fbf68800700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fbf4806ce30 0x7fbf4806f2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf54006010 tx=0x7fbf5400b560 comp rx=0 tx=0).stop 2024-02-28T23:06:56.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.741+0000 7fbf68800700 1 -- 172.21.15.159:0/1592282713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf60103f70 msgr2=0x7fbf60196840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:56.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.741+0000 7fbf68800700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf60103f70 0x7fbf60196840 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000d8d0 tx=0x7fbf5000dc90 comp rx=0 tx=0).stop 2024-02-28T23:06:56.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.741+0000 7fbf68800700 1 -- 172.21.15.159:0/1592282713 shutdown_connections 2024-02-28T23:06:56.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.741+0000 7fbf68800700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fbf4806ce30 0x7fbf4806f2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.741+0000 7fbf68800700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf60101640 0x7fbf60196300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.741+0000 7fbf68800700 1 --2- 172.21.15.159:0/1592282713 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf60103f70 0x7fbf60196840 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.741+0000 7fbf68800700 1 -- 172.21.15.159:0/1592282713 >> 172.21.15.159:0/1592282713 conn(0x7fbf600fb030 msgr2=0x7fbf600fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:56.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.741+0000 7fbf68800700 1 -- 172.21.15.159:0/1592282713 shutdown_connections 2024-02-28T23:06:56.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.741+0000 7fbf68800700 1 -- 172.21.15.159:0/1592282713 wait complete. 2024-02-28T23:06:56.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.918+0000 7efee4600700 1 -- 172.21.15.159:0/1761984855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efedc0ff490 msgr2=0x7efedc0ff8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:56.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.918+0000 7efee4600700 1 --2- 172.21.15.159:0/1761984855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efedc0ff490 0x7efedc0ff8b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efecc009910 tx=0x7efecc009c20 comp rx=0 tx=0).stop 2024-02-28T23:06:56.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.918+0000 7efee4600700 1 -- 172.21.15.159:0/1761984855 shutdown_connections 2024-02-28T23:06:56.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.918+0000 7efee4600700 1 --2- 172.21.15.159:0/1761984855 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efedc0ffdf0 0x7efedc100270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.918+0000 7efee4600700 1 --2- 172.21.15.159:0/1761984855 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efedc0ff490 0x7efedc0ff8b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.918+0000 7efee4600700 1 -- 172.21.15.159:0/1761984855 >> 172.21.15.159:0/1761984855 conn(0x7efedc0fb030 msgr2=0x7efedc0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:56.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.919+0000 7efee4600700 1 -- 172.21.15.159:0/1761984855 shutdown_connections 2024-02-28T23:06:56.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.919+0000 7efee4600700 1 -- 172.21.15.159:0/1761984855 wait complete. 2024-02-28T23:06:56.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.920+0000 7efee4600700 1 Processor -- start 2024-02-28T23:06:56.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.922+0000 7efee4600700 1 -- start start 2024-02-28T23:06:56.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.922+0000 7efee4600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efedc0ff490 0x7efedc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:56.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.922+0000 7efee4600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efedc0ffdf0 0x7efedc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:56.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.922+0000 7efee4600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc199090 con 0x7efedc0ffdf0 2024-02-28T23:06:56.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.922+0000 7efee4600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efedc1991d0 con 0x7efedc0ff490 2024-02-28T23:06:56.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.923+0000 7efee1c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efedc0ff490 0x7efedc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:56.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.923+0000 7efee1200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efedc0ffdf0 0x7efedc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:56.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.923+0000 7efee1200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efedc0ffdf0 0x7efedc198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34984/0 (socket says 172.21.15.159:34984) 2024-02-28T23:06:56.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.923+0000 7efee1200700 1 -- 172.21.15.159:0/3192383471 learned_addr learned my addr 172.21.15.159:0/3192383471 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:06:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.924+0000 7efee1200700 1 -- 172.21.15.159:0/3192383471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efedc0ff490 msgr2=0x7efedc198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.924+0000 7efee1200700 1 --2- 172.21.15.159:0/3192383471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efedc0ff490 0x7efedc198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:56.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.924+0000 7efee1200700 1 -- 172.21.15.159:0/3192383471 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0095f0 con 0x7efedc0ffdf0 2024-02-28T23:06:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.924+0000 7efee1200700 1 --2- 172.21.15.159:0/3192383471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efedc0ffdf0 0x7efedc198a70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efed000d8d0 tx=0x7efed000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.924+0000 7efeda000700 1 -- 172.21.15.159:0/3192383471 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efed0009940 con 0x7efedc0ffdf0 2024-02-28T23:06:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.925+0000 7efeda000700 1 -- 172.21.15.159:0/3192383471 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7efed0010460 con 0x7efedc0ffdf0 2024-02-28T23:06:56.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.925+0000 7efeda000700 1 -- 172.21.15.159:0/3192383471 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efed0009940 con 0x7efedc0ffdf0 2024-02-28T23:06:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.925+0000 7efee4600700 1 -- 172.21.15.159:0/3192383471 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efedc19dc80 con 0x7efedc0ffdf0 2024-02-28T23:06:56.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.925+0000 7efee4600700 1 -- 172.21.15.159:0/3192383471 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efedc19e1d0 con 0x7efedc0ffdf0 2024-02-28T23:06:56.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.928+0000 7efee4600700 1 -- 172.21.15.159:0/3192383471 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efedc10b910 con 0x7efedc0ffdf0 2024-02-28T23:06:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.930+0000 7efeda000700 1 -- 172.21.15.159:0/3192383471 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) v1 ==== 90929+0+0 (secure 0 0 0) 0x7efed00105d0 con 0x7efedc0ffdf0 2024-02-28T23:06:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.931+0000 7efeda000700 1 --2- 172.21.15.159:0/3192383471 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7efec406cee0 0x7efec406f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.932+0000 7efeda000700 1 -- 172.21.15.159:0/3192383471 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7efed008c110 con 0x7efedc0ffdf0 2024-02-28T23:06:56.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.932+0000 7efee1c00700 1 --2- 172.21.15.159:0/3192383471 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7efec406cee0 0x7efec406f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:56.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.934+0000 7efee1c00700 1 --2- 172.21.15.159:0/3192383471 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7efec406cee0 0x7efec406f3a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efecc000c00 tx=0x7efecc005fb0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:56.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:56.938+0000 7efeda000700 1 -- 172.21.15.159:0/3192383471 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7efed0059830 con 0x7efedc0ffdf0 2024-02-28T23:06:57.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.391+0000 7efee4600700 1 -- 172.21.15.159:0/3192383471 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efedc19de10 con 0x7efedc0ffdf0 2024-02-28T23:06:57.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.392+0000 7efeda000700 1 -- 172.21.15.159:0/3192383471 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7efedc19de10 con 0x7efedc0ffdf0 2024-02-28T23:06:57.392 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:06:57.392 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:06:57.392 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:06:57.392 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 13, 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:06:57.393 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:06:57.394 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:06:57.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.397+0000 7efee4600700 1 -- 172.21.15.159:0/3192383471 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7efec406cee0 msgr2=0x7efec406f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:57.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.397+0000 7efee4600700 1 --2- 172.21.15.159:0/3192383471 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7efec406cee0 0x7efec406f3a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7efecc000c00 tx=0x7efecc005fb0 comp rx=0 tx=0).stop 2024-02-28T23:06:57.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.397+0000 7efee4600700 1 -- 172.21.15.159:0/3192383471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efedc0ffdf0 msgr2=0x7efedc198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:57.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.397+0000 7efee4600700 1 --2- 172.21.15.159:0/3192383471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efedc0ffdf0 0x7efedc198a70 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efed000d8d0 tx=0x7efed000dc90 comp rx=0 tx=0).stop 2024-02-28T23:06:57.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.398+0000 7efee4600700 1 -- 172.21.15.159:0/3192383471 shutdown_connections 2024-02-28T23:06:57.398 INFO:tasks.workunit.client.0.smithi159.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-28T23:06:57.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.398+0000 7efee4600700 1 --2- 172.21.15.159:0/3192383471 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7efec406cee0 0x7efec406f3a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:57.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.398+0000 7efee4600700 1 --2- 172.21.15.159:0/3192383471 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efedc0ff490 0x7efedc198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:57.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.398+0000 7efee4600700 1 --2- 172.21.15.159:0/3192383471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efedc0ffdf0 0x7efedc198a70 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:57.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.398+0000 7efee4600700 1 -- 172.21.15.159:0/3192383471 >> 172.21.15.159:0/3192383471 conn(0x7efedc0fb030 msgr2=0x7efedc107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:57.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.398+0000 7efee4600700 1 -- 172.21.15.159:0/3192383471 shutdown_connections 2024-02-28T23:06:57.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.398+0000 7efee4600700 1 -- 172.21.15.159:0/3192383471 wait complete. 2024-02-28T23:06:57.412 INFO:tasks.workunit.client.0.smithi159.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T23:06:57.413 INFO:tasks.workunit.client.0.smithi159.stderr:+ make 2024-02-28T23:06:57.527 INFO:tasks.workunit.client.0.smithi159.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-28T23:06:57.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:57 smithi184 ceph-mon[36198]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:57.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:57 smithi184 ceph-mon[36198]: pgmap v17: 65 pgs: 65 active+clean; 192 MiB data, 898 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 317 op/s 2024-02-28T23:06:57.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:57 smithi184 ceph-mon[36198]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:57.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.606+0000 7f2e46400700 1 -- 172.21.15.159:0/2588393816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e40074d80 msgr2=0x7f2e400731e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:57.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.606+0000 7f2e46400700 1 --2- 172.21.15.159:0/2588393816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e40074d80 0x7f2e400731e0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f2e30009910 tx=0x7f2e30009c20 comp rx=0 tx=0).stop 2024-02-28T23:06:57.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:57 smithi159 ceph-mon[28802]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:57.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:57 smithi159 ceph-mon[28802]: pgmap v17: 65 pgs: 65 active+clean; 192 MiB data, 898 MiB used, 536 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.4 MiB/s wr, 317 op/s 2024-02-28T23:06:57.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:57 smithi159 ceph-mon[28802]: from='client.24401 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:57.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.607+0000 7f2e46400700 1 -- 172.21.15.159:0/2588393816 shutdown_connections 2024-02-28T23:06:57.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.607+0000 7f2e46400700 1 --2- 172.21.15.159:0/2588393816 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e400737b0 0x7f2e40073c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:57.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.607+0000 7f2e46400700 1 --2- 172.21.15.159:0/2588393816 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e40074d80 0x7f2e400731e0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:57.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.607+0000 7f2e46400700 1 -- 172.21.15.159:0/2588393816 >> 172.21.15.159:0/2588393816 conn(0x7f2e400fc110 msgr2=0x7f2e400fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:57.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.607+0000 7f2e46400700 1 -- 172.21.15.159:0/2588393816 shutdown_connections 2024-02-28T23:06:57.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.608+0000 7f2e46400700 1 -- 172.21.15.159:0/2588393816 wait complete. 2024-02-28T23:06:57.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.609+0000 7f2e46400700 1 Processor -- start 2024-02-28T23:06:57.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.609+0000 7f2e46400700 1 -- start start 2024-02-28T23:06:57.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.609+0000 7f2e46400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e400737b0 0x7f2e40071dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:57.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.609+0000 7f2e46400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e40074d80 0x7f2e40072300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:57.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.609+0000 7f2e46400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e400728d0 con 0x7f2e40074d80 2024-02-28T23:06:57.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.609+0000 7f2e46400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e40072a10 con 0x7f2e400737b0 2024-02-28T23:06:57.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.610+0000 7f2e3ea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e40074d80 0x7f2e40072300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:57.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.610+0000 7f2e3ea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e40074d80 0x7f2e40072300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35002/0 (socket says 172.21.15.159:35002) 2024-02-28T23:06:57.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.610+0000 7f2e3ea00700 1 -- 172.21.15.159:0/3806800505 learned_addr learned my addr 172.21.15.159:0/3806800505 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:06:57.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.610+0000 7f2e3ea00700 1 -- 172.21.15.159:0/3806800505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e400737b0 msgr2=0x7f2e40071dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:57.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.610+0000 7f2e3ea00700 1 --2- 172.21.15.159:0/3806800505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e400737b0 0x7f2e40071dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:57.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.610+0000 7f2e3ea00700 1 -- 172.21.15.159:0/3806800505 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e300095f0 con 0x7f2e40074d80 2024-02-28T23:06:57.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.610+0000 7f2e3ea00700 1 --2- 172.21.15.159:0/3806800505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e40074d80 0x7f2e40072300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00b4b0 tx=0x7f2e2c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:57.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.610+0000 7f2e37e00700 1 -- 172.21.15.159:0/3806800505 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e2c011800 con 0x7f2e40074d80 2024-02-28T23:06:57.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.611+0000 7f2e37e00700 1 -- 172.21.15.159:0/3806800505 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f2e2c011e10 con 0x7f2e40074d80 2024-02-28T23:06:57.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.611+0000 7f2e37e00700 1 -- 172.21.15.159:0/3806800505 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2e2c00f2e0 con 0x7f2e40074d80 2024-02-28T23:06:57.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.611+0000 7f2e46400700 1 -- 172.21.15.159:0/3806800505 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e401aa970 con 0x7f2e40074d80 2024-02-28T23:06:57.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.611+0000 7f2e46400700 1 -- 172.21.15.159:0/3806800505 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e401aaef0 con 0x7f2e40074d80 2024-02-28T23:06:57.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.613+0000 7f2e46400700 1 -- 172.21.15.159:0/3806800505 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4010b990 con 0x7f2e40074d80 2024-02-28T23:06:57.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.614+0000 7f2e37e00700 1 -- 172.21.15.159:0/3806800505 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) v1 ==== 90929+0+0 (secure 0 0 0) 0x7f2e2c011960 con 0x7f2e40074d80 2024-02-28T23:06:57.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.615+0000 7f2e37e00700 1 --2- 172.21.15.159:0/3806800505 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f2e2406ce30 0x7f2e2406f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:06:57.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.615+0000 7f2e37e00700 1 -- 172.21.15.159:0/3806800505 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f2e2c08c1b0 con 0x7f2e40074d80 2024-02-28T23:06:57.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.615+0000 7f2e3f400700 1 --2- 172.21.15.159:0/3806800505 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f2e2406ce30 0x7f2e2406f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:06:57.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.617+0000 7f2e3f400700 1 --2- 172.21.15.159:0/3806800505 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f2e2406ce30 0x7f2e2406f2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2e30005090 tx=0x7f2e30005fb0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:06:57.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.622+0000 7f2e37e00700 1 -- 172.21.15.159:0/3806800505 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f2e2c059a00 con 0x7f2e40074d80 2024-02-28T23:06:57.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.874+0000 7f2e46400700 1 -- 172.21.15.159:0/3806800505 --> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2e401080f0 con 0x7f2e2406ce30 2024-02-28T23:06:57.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.877+0000 7f2e37e00700 1 -- 172.21.15.159:0/3806800505 <== mgr.24357 v2:172.21.15.184:6828/2879526003 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f2e401080f0 con 0x7f2e2406ce30 2024-02-28T23:06:57.877 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:06:57.877 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:06:57.877 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:06:57.877 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:06:57.878 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [], 2024-02-28T23:06:57.878 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "1/2 daemons upgraded", 2024-02-28T23:06:57.878 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "", 2024-02-28T23:06:57.878 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:06:57.878 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:06:57.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.880+0000 7f2e46400700 1 -- 172.21.15.159:0/3806800505 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f2e2406ce30 msgr2=0x7f2e2406f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:57.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.880+0000 7f2e46400700 1 --2- 172.21.15.159:0/3806800505 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f2e2406ce30 0x7f2e2406f2f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f2e30005090 tx=0x7f2e30005fb0 comp rx=0 tx=0).stop 2024-02-28T23:06:57.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.880+0000 7f2e46400700 1 -- 172.21.15.159:0/3806800505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e40074d80 msgr2=0x7f2e40072300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:06:57.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.880+0000 7f2e46400700 1 --2- 172.21.15.159:0/3806800505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e40074d80 0x7f2e40072300 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f2e2c00b4b0 tx=0x7f2e2c00b870 comp rx=0 tx=0).stop 2024-02-28T23:06:57.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.880+0000 7f2e46400700 1 -- 172.21.15.159:0/3806800505 shutdown_connections 2024-02-28T23:06:57.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.880+0000 7f2e46400700 1 --2- 172.21.15.159:0/3806800505 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f2e2406ce30 0x7f2e2406f2f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:57.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.880+0000 7f2e46400700 1 --2- 172.21.15.159:0/3806800505 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2e400737b0 0x7f2e40071dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:57.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.880+0000 7f2e46400700 1 --2- 172.21.15.159:0/3806800505 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2e40074d80 0x7f2e40072300 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:06:57.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.880+0000 7f2e46400700 1 -- 172.21.15.159:0/3806800505 >> 172.21.15.159:0/3806800505 conn(0x7f2e400fc110 msgr2=0x7f2e401069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:06:57.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.880+0000 7f2e46400700 1 -- 172.21.15.159:0/3806800505 shutdown_connections 2024-02-28T23:06:57.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:06:57.880+0000 7f2e46400700 1 -- 172.21.15.159:0/3806800505 wait complete. 2024-02-28T23:06:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:58 smithi159 ceph-mon[28802]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:58 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3192383471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:06:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:58 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:06:58.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:58 smithi184 ceph-mon[36198]: from='client.14650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:58.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:58 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3192383471' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:06:58.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:58 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:06:59.611 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:59 smithi159 ceph-mon[28802]: pgmap v18: 65 pgs: 65 active+clean; 192 MiB data, 898 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 247 op/s 2024-02-28T23:06:59.611 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:06:59 smithi159 ceph-mon[28802]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:06:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:59 smithi184 ceph-mon[36198]: pgmap v18: 65 pgs: 65 active+clean; 192 MiB data, 898 MiB used, 536 GiB / 536 GiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 247 op/s 2024-02-28T23:06:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:06:59 smithi184 ceph-mon[36198]: from='client.14658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:07:00.404 INFO:tasks.workunit.client.0.smithi159.stderr:++ readlink -f fsstress 2024-02-28T23:07:00.409 INFO:tasks.workunit.client.0.smithi159.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-28T23:07:00.409 INFO:tasks.workunit.client.0.smithi159.stderr:+ popd 2024-02-28T23:07:00.413 INFO:tasks.workunit.client.0.smithi159.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-02-28T23:07:00.413 INFO:tasks.workunit.client.0.smithi159.stderr:+ popd 2024-02-28T23:07:00.415 INFO:tasks.workunit.client.0.smithi159.stdout:~/cephtest/mnt.0/client.0/tmp 2024-02-28T23:07:00.415 INFO:tasks.workunit.client.0.smithi159.stderr:++ mktemp -d -p . 2024-02-28T23:07:00.420 INFO:tasks.workunit.client.0.smithi159.stderr:+ T=./tmp.YW5rI8OtDN 2024-02-28T23:07:00.420 INFO:tasks.workunit.client.0.smithi159.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.YW5rI8OtDN -l 1 -n 1000 -p 10 -v 2024-02-28T23:07:00.427 INFO:tasks.workunit.client.0.smithi159.stdout:seed = 1708733362 2024-02-28T23:07:00.436 INFO:tasks.workunit.client.0.smithi159.stdout:1/0: readlink - no filename 2024-02-28T23:07:00.436 INFO:tasks.workunit.client.0.smithi159.stdout:1/1: stat - no entries 2024-02-28T23:07:00.436 INFO:tasks.workunit.client.0.smithi159.stdout:1/2: dread - no filename 2024-02-28T23:07:00.436 INFO:tasks.workunit.client.0.smithi159.stdout:1/3: rename - no filename 2024-02-28T23:07:00.436 INFO:tasks.workunit.client.0.smithi159.stdout:1/4: fdatasync - no filename 2024-02-28T23:07:00.437 INFO:tasks.workunit.client.0.smithi159.stdout:1/5: unlink - no file 2024-02-28T23:07:00.437 INFO:tasks.workunit.client.0.smithi159.stdout:0/0: mkdir d0 0 2024-02-28T23:07:00.442 INFO:tasks.workunit.client.0.smithi159.stdout:1/6: creat f0 x:0 0 0 2024-02-28T23:07:00.444 INFO:tasks.workunit.client.0.smithi159.stdout:0/1: mknod d0/c1 0 2024-02-28T23:07:00.444 INFO:tasks.workunit.client.0.smithi159.stdout:0/2: fdatasync - no filename 2024-02-28T23:07:00.444 INFO:tasks.workunit.client.0.smithi159.stdout:1/7: chown f0 231449 1 2024-02-28T23:07:00.444 INFO:tasks.workunit.client.0.smithi159.stdout:3/0: rmdir - no directory 2024-02-28T23:07:00.448 INFO:tasks.workunit.client.0.smithi159.stdout:2/0: creat f0 x:0 0 0 2024-02-28T23:07:00.448 INFO:tasks.workunit.client.0.smithi159.stdout:1/8: symlink l1 0 2024-02-28T23:07:00.449 INFO:tasks.workunit.client.0.smithi159.stdout:2/1: chown f0 0 1 2024-02-28T23:07:00.451 INFO:tasks.workunit.client.0.smithi159.stdout:5/0: dwrite - no filename 2024-02-28T23:07:00.451 INFO:tasks.workunit.client.0.smithi159.stdout:5/1: fsync - no filename 2024-02-28T23:07:00.451 INFO:tasks.workunit.client.0.smithi159.stdout:5/2: stat - no entries 2024-02-28T23:07:00.451 INFO:tasks.workunit.client.0.smithi159.stdout:5/3: fsync - no filename 2024-02-28T23:07:00.451 INFO:tasks.workunit.client.0.smithi159.stdout:1/9: truncate f0 674743 0 2024-02-28T23:07:00.452 INFO:tasks.workunit.client.0.smithi159.stdout:3/1: mkdir d0 0 2024-02-28T23:07:00.453 INFO:tasks.workunit.client.0.smithi159.stdout:3/2: dread - no filename 2024-02-28T23:07:00.453 INFO:tasks.workunit.client.0.smithi159.stdout:3/3: readlink - no filename 2024-02-28T23:07:00.453 INFO:tasks.workunit.client.0.smithi159.stdout:3/4: truncate - no filename 2024-02-28T23:07:00.458 INFO:tasks.workunit.client.0.smithi159.stdout:1/10: dread f0 [0,4194304] 0 2024-02-28T23:07:00.465 INFO:tasks.workunit.client.0.smithi159.stdout:6/0: link - no file 2024-02-28T23:07:00.465 INFO:tasks.workunit.client.0.smithi159.stdout:6/1: truncate - no filename 2024-02-28T23:07:00.465 INFO:tasks.workunit.client.0.smithi159.stdout:6/2: dread - no filename 2024-02-28T23:07:00.465 INFO:tasks.workunit.client.0.smithi159.stdout:6/3: truncate - no filename 2024-02-28T23:07:00.465 INFO:tasks.workunit.client.0.smithi159.stdout:6/4: dwrite - no filename 2024-02-28T23:07:00.465 INFO:tasks.workunit.client.0.smithi159.stdout:4/0: creat f0 x:0 0 0 2024-02-28T23:07:00.466 INFO:tasks.workunit.client.0.smithi159.stdout:2/2: creat f1 x:0 0 0 2024-02-28T23:07:00.466 INFO:tasks.workunit.client.0.smithi159.stdout:6/5: chown . 2602 1 2024-02-28T23:07:00.466 INFO:tasks.workunit.client.0.smithi159.stdout:6/6: dread - no filename 2024-02-28T23:07:00.466 INFO:tasks.workunit.client.0.smithi159.stdout:1/11: unlink l1 0 2024-02-28T23:07:00.467 INFO:tasks.workunit.client.0.smithi159.stdout:3/5: symlink d0/l1 0 2024-02-28T23:07:00.467 INFO:tasks.workunit.client.0.smithi159.stdout:7/0: readlink - no filename 2024-02-28T23:07:00.468 INFO:tasks.workunit.client.0.smithi159.stdout:7/1: link - no file 2024-02-28T23:07:00.472 INFO:tasks.workunit.client.0.smithi159.stdout:2/3: unlink f0 0 2024-02-28T23:07:00.473 INFO:tasks.workunit.client.0.smithi159.stdout:6/7: mkdir d0 0 2024-02-28T23:07:00.474 INFO:tasks.workunit.client.0.smithi159.stdout:8/0: truncate - no filename 2024-02-28T23:07:00.474 INFO:tasks.workunit.client.0.smithi159.stdout:8/1: write - no filename 2024-02-28T23:07:00.474 INFO:tasks.workunit.client.0.smithi159.stdout:8/2: fsync - no filename 2024-02-28T23:07:00.475 INFO:tasks.workunit.client.0.smithi159.stdout:8/3: link - no file 2024-02-28T23:07:00.475 INFO:tasks.workunit.client.0.smithi159.stdout:8/4: fsync - no filename 2024-02-28T23:07:00.475 INFO:tasks.workunit.client.0.smithi159.stdout:8/5: fdatasync - no filename 2024-02-28T23:07:00.475 INFO:tasks.workunit.client.0.smithi159.stdout:8/6: write - no filename 2024-02-28T23:07:00.475 INFO:tasks.workunit.client.0.smithi159.stdout:8/7: dread - no filename 2024-02-28T23:07:00.475 INFO:tasks.workunit.client.0.smithi159.stdout:8/8: readlink - no filename 2024-02-28T23:07:00.475 INFO:tasks.workunit.client.0.smithi159.stdout:8/9: rename - no filename 2024-02-28T23:07:00.475 INFO:tasks.workunit.client.0.smithi159.stdout:8/10: write - no filename 2024-02-28T23:07:00.475 INFO:tasks.workunit.client.0.smithi159.stdout:8/11: read - no filename 2024-02-28T23:07:00.476 INFO:tasks.workunit.client.0.smithi159.stdout:8/12: chown . 3 1 2024-02-28T23:07:00.476 INFO:tasks.workunit.client.0.smithi159.stdout:8/13: write - no filename 2024-02-28T23:07:00.476 INFO:tasks.workunit.client.0.smithi159.stdout:8/14: truncate - no filename 2024-02-28T23:07:00.476 INFO:tasks.workunit.client.0.smithi159.stdout:7/2: creat f0 x:0 0 0 2024-02-28T23:07:00.476 INFO:tasks.workunit.client.0.smithi159.stdout:8/15: chown . 351731399 1 2024-02-28T23:07:00.476 INFO:tasks.workunit.client.0.smithi159.stdout:8/16: dwrite - no filename 2024-02-28T23:07:00.476 INFO:tasks.workunit.client.0.smithi159.stdout:8/17: dwrite - no filename 2024-02-28T23:07:00.476 INFO:tasks.workunit.client.0.smithi159.stdout:8/18: readlink - no filename 2024-02-28T23:07:00.477 INFO:tasks.workunit.client.0.smithi159.stdout:8/19: chown . 4 1 2024-02-28T23:07:00.477 INFO:tasks.workunit.client.0.smithi159.stdout:7/3: stat f0 0 2024-02-28T23:07:00.479 INFO:tasks.workunit.client.0.smithi159.stdout:3/6: link d0/l1 d0/l2 0 2024-02-28T23:07:00.479 INFO:tasks.workunit.client.0.smithi159.stdout:3/7: write - no filename 2024-02-28T23:07:00.481 INFO:tasks.workunit.client.0.smithi159.stdout:9/0: dread - no filename 2024-02-28T23:07:00.481 INFO:tasks.workunit.client.0.smithi159.stdout:9/1: write - no filename 2024-02-28T23:07:00.482 INFO:tasks.workunit.client.0.smithi159.stdout:9/2: chown . 1 1 2024-02-28T23:07:00.482 INFO:tasks.workunit.client.0.smithi159.stdout:9/3: fdatasync - no filename 2024-02-28T23:07:00.482 INFO:tasks.workunit.client.0.smithi159.stdout:9/4: dwrite - no filename 2024-02-28T23:07:00.482 INFO:tasks.workunit.client.0.smithi159.stdout:6/8: creat d0/f1 x:0 0 0 2024-02-28T23:07:00.482 INFO:tasks.workunit.client.0.smithi159.stdout:7/4: creat f1 x:0 0 0 2024-02-28T23:07:00.484 INFO:tasks.workunit.client.0.smithi159.stdout:7/5: dread - f1 zero size 2024-02-28T23:07:00.484 INFO:tasks.workunit.client.0.smithi159.stdout:8/20: mknod c0 0 2024-02-28T23:07:00.485 INFO:tasks.workunit.client.0.smithi159.stdout:6/9: dread - d0/f1 zero size 2024-02-28T23:07:00.488 INFO:tasks.workunit.client.0.smithi159.stdout:9/5: mknod c0 0 2024-02-28T23:07:00.488 INFO:tasks.workunit.client.0.smithi159.stdout:9/6: dwrite - no filename 2024-02-28T23:07:00.488 INFO:tasks.workunit.client.0.smithi159.stdout:9/7: dwrite - no filename 2024-02-28T23:07:00.488 INFO:tasks.workunit.client.0.smithi159.stdout:9/8: write - no filename 2024-02-28T23:07:00.489 INFO:tasks.workunit.client.0.smithi159.stdout:9/9: dwrite - no filename 2024-02-28T23:07:00.493 INFO:tasks.workunit.client.0.smithi159.stdout:8/21: unlink c0 0 2024-02-28T23:07:00.493 INFO:tasks.workunit.client.0.smithi159.stdout:8/22: write - no filename 2024-02-28T23:07:00.493 INFO:tasks.workunit.client.0.smithi159.stdout:8/23: chown . 261 1 2024-02-28T23:07:00.493 INFO:tasks.workunit.client.0.smithi159.stdout:8/24: fsync - no filename 2024-02-28T23:07:00.493 INFO:tasks.workunit.client.0.smithi159.stdout:8/25: dread - no filename 2024-02-28T23:07:00.493 INFO:tasks.workunit.client.0.smithi159.stdout:8/26: read - no filename 2024-02-28T23:07:00.493 INFO:tasks.workunit.client.0.smithi159.stdout:8/27: write - no filename 2024-02-28T23:07:00.497 INFO:tasks.workunit.client.0.smithi159.stdout:9/10: mknod c1 0 2024-02-28T23:07:00.499 INFO:tasks.workunit.client.0.smithi159.stdout:3/8: rename d0/l2 to d0/l3 0 2024-02-28T23:07:00.500 INFO:tasks.workunit.client.0.smithi159.stdout:4/1: dwrite f0 [0,4194304] 0 2024-02-28T23:07:00.500 INFO:tasks.workunit.client.0.smithi159.stdout:4/2: readlink - no filename 2024-02-28T23:07:00.502 INFO:tasks.workunit.client.0.smithi159.stdout:8/28: mknod c1 0 2024-02-28T23:07:00.502 INFO:tasks.workunit.client.0.smithi159.stdout:8/29: dread - no filename 2024-02-28T23:07:00.502 INFO:tasks.workunit.client.0.smithi159.stdout:6/10: link d0/f1 d0/f2 0 2024-02-28T23:07:00.503 INFO:tasks.workunit.client.0.smithi159.stdout:3/9: rename d0 to d0/d4 22 2024-02-28T23:07:00.505 INFO:tasks.workunit.client.0.smithi159.stdout:9/11: mknod c2 0 2024-02-28T23:07:00.506 INFO:tasks.workunit.client.0.smithi159.stdout:3/10: chown d0 470551985 1 2024-02-28T23:07:00.507 INFO:tasks.workunit.client.0.smithi159.stdout:4/3: mknod c1 0 2024-02-28T23:07:00.509 INFO:tasks.workunit.client.0.smithi159.stdout:8/30: chown c1 49309 1 2024-02-28T23:07:00.509 INFO:tasks.workunit.client.0.smithi159.stdout:8/31: dwrite - no filename 2024-02-28T23:07:00.509 INFO:tasks.workunit.client.0.smithi159.stdout:8/32: write - no filename 2024-02-28T23:07:00.512 INFO:tasks.workunit.client.0.smithi159.stdout:8/33: chown c1 47934 1 2024-02-28T23:07:00.514 INFO:tasks.workunit.client.0.smithi159.stdout:9/12: symlink l3 0 2024-02-28T23:07:00.518 INFO:tasks.workunit.client.0.smithi159.stdout:7/6: dwrite f0 [0,4194304] 0 2024-02-28T23:07:00.520 INFO:tasks.workunit.client.0.smithi159.stdout:4/4: creat f2 x:0 0 0 2024-02-28T23:07:00.521 INFO:tasks.workunit.client.0.smithi159.stdout:8/34: unlink c1 0 2024-02-28T23:07:00.522 INFO:tasks.workunit.client.0.smithi159.stdout:4/5: write f2 [523884,62359] 0 2024-02-28T23:07:00.524 INFO:tasks.workunit.client.0.smithi159.stdout:9/13: mkdir d4 0 2024-02-28T23:07:00.524 INFO:tasks.workunit.client.0.smithi159.stdout:9/14: dwrite - no filename 2024-02-28T23:07:00.530 INFO:tasks.workunit.client.0.smithi159.stdout:4/6: unlink f0 0 2024-02-28T23:07:00.536 INFO:tasks.workunit.client.0.smithi159.stdout:4/7: symlink l3 0 2024-02-28T23:07:00.539 INFO:tasks.workunit.client.0.smithi159.stdout:6/11: dwrite d0/f1 [0,4194304] 0 2024-02-28T23:07:00.539 INFO:tasks.workunit.client.0.smithi159.stdout:6/12: readlink - no filename 2024-02-28T23:07:00.540 INFO:tasks.workunit.client.0.smithi159.stdout:4/8: read f2 [53694,118533] 0 2024-02-28T23:07:00.546 INFO:tasks.workunit.client.0.smithi159.stdout:6/13: creat d0/f3 x:0 0 0 2024-02-28T23:07:00.549 INFO:tasks.workunit.client.0.smithi159.stdout:4/9: creat f4 x:0 0 0 2024-02-28T23:07:00.549 INFO:tasks.workunit.client.0.smithi159.stdout:4/10: rmdir - no directory 2024-02-28T23:07:00.551 INFO:tasks.workunit.client.0.smithi159.stdout:6/14: creat d0/f4 x:0 0 0 2024-02-28T23:07:00.576 INFO:tasks.workunit.client.0.smithi159.stdout:4/11: dwrite f2 [0,4194304] 0 2024-02-28T23:07:00.581 INFO:tasks.workunit.client.0.smithi159.stdout:4/12: unlink l3 0 2024-02-28T23:07:00.583 INFO:tasks.workunit.client.0.smithi159.stdout:4/13: write f2 [739296,63400] 0 2024-02-28T23:07:00.589 INFO:tasks.workunit.client.0.smithi159.stdout:4/14: rename f4 to f5 0 2024-02-28T23:07:00.590 INFO:tasks.workunit.client.0.smithi159.stdout:4/15: write f2 [1142526,61296] 0 2024-02-28T23:07:00.592 INFO:tasks.workunit.client.0.smithi159.stdout:4/16: read f2 [343079,113044] 0 2024-02-28T23:07:00.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:00 smithi184 ceph-mon[36198]: pgmap v19: 65 pgs: 65 active+clean; 204 MiB data, 955 MiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 321 op/s 2024-02-28T23:07:00.616 INFO:tasks.workunit.client.0.smithi159.stdout:4/17: dwrite f5 [0,4194304] 0 2024-02-28T23:07:00.618 INFO:tasks.workunit.client.0.smithi159.stdout:4/18: chown c1 105 1 2024-02-28T23:07:00.621 INFO:tasks.workunit.client.0.smithi159.stdout:4/19: symlink l6 0 2024-02-28T23:07:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:00 smithi159 ceph-mon[28802]: pgmap v19: 65 pgs: 65 active+clean; 204 MiB data, 955 MiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 3.7 MiB/s wr, 321 op/s 2024-02-28T23:07:00.988 INFO:tasks.workunit.client.0.smithi159.stdout:1/12: fsync f0 0 2024-02-28T23:07:00.992 INFO:tasks.workunit.client.0.smithi159.stdout:0/3: getdents d0 0 2024-02-28T23:07:01.045 INFO:tasks.workunit.client.0.smithi159.stdout:0/4: symlink d0/l2 0 2024-02-28T23:07:01.046 INFO:tasks.workunit.client.0.smithi159.stdout:3/11: readlink d0/l3 0 2024-02-28T23:07:01.047 INFO:tasks.workunit.client.0.smithi159.stdout:3/12: dread - no filename 2024-02-28T23:07:01.047 INFO:tasks.workunit.client.0.smithi159.stdout:3/13: dread - no filename 2024-02-28T23:07:01.047 INFO:tasks.workunit.client.0.smithi159.stdout:3/14: fdatasync - no filename 2024-02-28T23:07:01.049 INFO:tasks.workunit.client.0.smithi159.stdout:0/5: creat d0/f3 x:0 0 0 2024-02-28T23:07:01.050 INFO:tasks.workunit.client.0.smithi159.stdout:3/15: mknod d0/c5 0 2024-02-28T23:07:01.050 INFO:tasks.workunit.client.0.smithi159.stdout:0/6: dread - d0/f3 zero size 2024-02-28T23:07:01.052 INFO:tasks.workunit.client.0.smithi159.stdout:0/7: dread - d0/f3 zero size 2024-02-28T23:07:01.052 INFO:tasks.workunit.client.0.smithi159.stdout:3/16: mkdir d0/d6 0 2024-02-28T23:07:01.054 INFO:tasks.workunit.client.0.smithi159.stdout:3/17: readlink d0/l1 0 2024-02-28T23:07:01.054 INFO:tasks.workunit.client.0.smithi159.stdout:3/18: dread - no filename 2024-02-28T23:07:01.057 INFO:tasks.workunit.client.0.smithi159.stdout:0/8: rename d0/c1 to d0/c4 0 2024-02-28T23:07:01.062 INFO:tasks.workunit.client.0.smithi159.stdout:3/19: link d0/c5 d0/c7 0 2024-02-28T23:07:01.069 INFO:tasks.workunit.client.0.smithi159.stdout:3/20: getdents d0/d6 0 2024-02-28T23:07:01.069 INFO:tasks.workunit.client.0.smithi159.stdout:8/35: getdents . 0 2024-02-28T23:07:01.069 INFO:tasks.workunit.client.0.smithi159.stdout:8/36: rename - no filename 2024-02-28T23:07:01.073 INFO:tasks.workunit.client.0.smithi159.stdout:8/37: mkdir d2 0 2024-02-28T23:07:01.073 INFO:tasks.workunit.client.0.smithi159.stdout:8/38: unlink - no file 2024-02-28T23:07:01.073 INFO:tasks.workunit.client.0.smithi159.stdout:8/39: write - no filename 2024-02-28T23:07:01.076 INFO:tasks.workunit.client.0.smithi159.stdout:3/21: unlink d0/c7 0 2024-02-28T23:07:01.076 INFO:tasks.workunit.client.0.smithi159.stdout:3/22: dread - no filename 2024-02-28T23:07:01.076 INFO:tasks.workunit.client.0.smithi159.stdout:3/23: write - no filename 2024-02-28T23:07:01.077 INFO:tasks.workunit.client.0.smithi159.stdout:3/24: dwrite - no filename 2024-02-28T23:07:01.080 INFO:tasks.workunit.client.0.smithi159.stdout:8/40: mkdir d2/d3 0 2024-02-28T23:07:01.083 INFO:tasks.workunit.client.0.smithi159.stdout:3/25: mkdir d0/d8 0 2024-02-28T23:07:01.083 INFO:tasks.workunit.client.0.smithi159.stdout:3/26: dread - no filename 2024-02-28T23:07:01.085 INFO:tasks.workunit.client.0.smithi159.stdout:8/41: mknod d2/c4 0 2024-02-28T23:07:01.085 INFO:tasks.workunit.client.0.smithi159.stdout:8/42: dwrite - no filename 2024-02-28T23:07:01.088 INFO:tasks.workunit.client.0.smithi159.stdout:3/27: symlink d0/d6/l9 0 2024-02-28T23:07:01.088 INFO:tasks.workunit.client.0.smithi159.stdout:3/28: dread - no filename 2024-02-28T23:07:01.088 INFO:tasks.workunit.client.0.smithi159.stdout:3/29: dwrite - no filename 2024-02-28T23:07:01.088 INFO:tasks.workunit.client.0.smithi159.stdout:0/9: dwrite d0/f3 [0,4194304] 0 2024-02-28T23:07:01.089 INFO:tasks.workunit.client.0.smithi159.stdout:8/43: rename d2/d3 to d2/d3/d5 22 2024-02-28T23:07:01.089 INFO:tasks.workunit.client.0.smithi159.stdout:8/44: fsync - no filename 2024-02-28T23:07:01.090 INFO:tasks.workunit.client.0.smithi159.stdout:0/10: chown d0/f3 19479 1 2024-02-28T23:07:01.092 INFO:tasks.workunit.client.0.smithi159.stdout:8/45: mknod d2/d3/c6 0 2024-02-28T23:07:01.093 INFO:tasks.workunit.client.0.smithi159.stdout:0/11: mkdir d0/d5 0 2024-02-28T23:07:01.095 INFO:tasks.workunit.client.0.smithi159.stdout:8/46: symlink d2/d3/l7 0 2024-02-28T23:07:01.096 INFO:tasks.workunit.client.0.smithi159.stdout:0/12: creat d0/f6 x:0 0 0 2024-02-28T23:07:01.098 INFO:tasks.workunit.client.0.smithi159.stdout:8/47: rmdir d2/d3 39 2024-02-28T23:07:01.098 INFO:tasks.workunit.client.0.smithi159.stdout:0/13: truncate d0/f3 4401775 0 2024-02-28T23:07:01.103 INFO:tasks.workunit.client.0.smithi159.stdout:0/14: creat d0/d5/f7 x:0 0 0 2024-02-28T23:07:01.104 INFO:tasks.workunit.client.0.smithi159.stdout:0/15: symlink d0/d5/l8 0 2024-02-28T23:07:01.106 INFO:tasks.workunit.client.0.smithi159.stdout:0/16: mknod d0/d5/c9 0 2024-02-28T23:07:01.107 INFO:tasks.workunit.client.0.smithi159.stdout:0/17: mknod d0/ca 0 2024-02-28T23:07:01.109 INFO:tasks.workunit.client.0.smithi159.stdout:0/18: creat d0/fb x:0 0 0 2024-02-28T23:07:01.187 INFO:tasks.workunit.client.0.smithi159.stdout:0/19: mknod d0/cc 0 2024-02-28T23:07:01.194 INFO:tasks.workunit.client.0.smithi159.stdout:0/20: write d0/f6 [1029181,84025] 0 2024-02-28T23:07:01.225 INFO:tasks.workunit.client.0.smithi159.stdout:4/20: getdents . 0 2024-02-28T23:07:01.227 INFO:tasks.workunit.client.0.smithi159.stdout:4/21: fdatasync f5 0 2024-02-28T23:07:01.230 INFO:tasks.workunit.client.0.smithi159.stdout:0/21: dwrite d0/d5/f7 [0,4194304] 0 2024-02-28T23:07:01.233 INFO:tasks.workunit.client.0.smithi159.stdout:4/22: symlink l7 0 2024-02-28T23:07:01.236 INFO:tasks.workunit.client.0.smithi159.stdout:0/22: mknod d0/cd 0 2024-02-28T23:07:01.239 INFO:tasks.workunit.client.0.smithi159.stdout:0/23: write d0/f6 [252944,66776] 0 2024-02-28T23:07:01.244 INFO:tasks.workunit.client.0.smithi159.stdout:4/23: rename f2 to f8 0 2024-02-28T23:07:01.244 INFO:tasks.workunit.client.0.smithi159.stdout:0/24: truncate d0/f6 1979280 0 2024-02-28T23:07:01.249 INFO:tasks.workunit.client.0.smithi159.stdout:4/24: mkdir d9 0 2024-02-28T23:07:01.250 INFO:tasks.workunit.client.0.smithi159.stdout:0/25: mkdir d0/de 0 2024-02-28T23:07:01.251 INFO:tasks.workunit.client.0.smithi159.stdout:4/25: chown l7 1067394434 1 2024-02-28T23:07:01.252 INFO:tasks.workunit.client.0.smithi159.stdout:4/26: chown c1 49 1 2024-02-28T23:07:01.254 INFO:tasks.workunit.client.0.smithi159.stdout:0/26: write d0/d5/f7 [410543,76484] 0 2024-02-28T23:07:01.257 INFO:tasks.workunit.client.0.smithi159.stdout:4/27: mkdir d9/da 0 2024-02-28T23:07:01.259 INFO:tasks.workunit.client.0.smithi159.stdout:0/27: creat d0/d5/ff x:0 0 0 2024-02-28T23:07:01.263 INFO:tasks.workunit.client.0.smithi159.stdout:0/28: symlink d0/de/l10 0 2024-02-28T23:07:01.348 INFO:tasks.workunit.client.0.smithi159.stdout:8/48: creat d2/d3/f8 x:0 0 0 2024-02-28T23:07:01.350 INFO:tasks.workunit.client.0.smithi159.stdout:8/49: truncate d2/d3/f8 619171 0 2024-02-28T23:07:01.352 INFO:tasks.workunit.client.0.smithi159.stdout:0/29: fsync d0/d5/f7 0 2024-02-28T23:07:01.353 INFO:tasks.workunit.client.0.smithi159.stdout:0/30: dread - d0/fb zero size 2024-02-28T23:07:01.353 INFO:tasks.workunit.client.0.smithi159.stdout:8/50: creat d2/d3/f9 x:0 0 0 2024-02-28T23:07:01.354 INFO:tasks.workunit.client.0.smithi159.stdout:0/31: stat d0/cd 0 2024-02-28T23:07:01.356 INFO:tasks.workunit.client.0.smithi159.stdout:8/51: write d2/d3/f8 [778515,45113] 0 2024-02-28T23:07:01.357 INFO:tasks.workunit.client.0.smithi159.stdout:0/32: mkdir d0/de/d11 0 2024-02-28T23:07:01.361 INFO:tasks.workunit.client.0.smithi159.stdout:4/28: fsync f8 0 2024-02-28T23:07:01.363 INFO:tasks.workunit.client.0.smithi159.stdout:0/33: symlink d0/de/d11/l12 0 2024-02-28T23:07:01.381 INFO:tasks.workunit.client.0.smithi159.stdout:8/52: dwrite d2/d3/f8 [0,4194304] 0 2024-02-28T23:07:01.386 INFO:tasks.workunit.client.0.smithi159.stdout:4/29: dwrite f8 [0,4194304] 0 2024-02-28T23:07:01.403 INFO:tasks.workunit.client.0.smithi159.stdout:4/30: dread f5 [0,4194304] 0 2024-02-28T23:07:01.952 INFO:tasks.workunit.client.0.smithi159.stdout:4/31: rename f8 to d9/da/fb 0 2024-02-28T23:07:01.981 INFO:tasks.workunit.client.0.smithi159.stdout:4/32: dread d9/da/fb [0,4194304] 0 2024-02-28T23:07:01.988 INFO:tasks.workunit.client.0.smithi159.stdout:0/34: rmdir d0 39 2024-02-28T23:07:02.196 INFO:tasks.workunit.client.0.smithi159.stdout:9/15: sync 2024-02-28T23:07:02.197 INFO:tasks.workunit.client.0.smithi159.stdout:7/7: sync 2024-02-28T23:07:02.197 INFO:tasks.workunit.client.0.smithi159.stdout:5/4: sync 2024-02-28T23:07:02.197 INFO:tasks.workunit.client.0.smithi159.stdout:5/5: fdatasync - no filename 2024-02-28T23:07:02.197 INFO:tasks.workunit.client.0.smithi159.stdout:5/6: truncate - no filename 2024-02-28T23:07:02.197 INFO:tasks.workunit.client.0.smithi159.stdout:2/4: sync 2024-02-28T23:07:02.197 INFO:tasks.workunit.client.0.smithi159.stdout:5/7: dwrite - no filename 2024-02-28T23:07:02.197 INFO:tasks.workunit.client.0.smithi159.stdout:5/8: dwrite - no filename 2024-02-28T23:07:02.198 INFO:tasks.workunit.client.0.smithi159.stdout:5/9: chown . 1 1 2024-02-28T23:07:02.198 INFO:tasks.workunit.client.0.smithi159.stdout:5/10: fdatasync - no filename 2024-02-28T23:07:02.198 INFO:tasks.workunit.client.0.smithi159.stdout:5/11: truncate - no filename 2024-02-28T23:07:02.198 INFO:tasks.workunit.client.0.smithi159.stdout:5/12: chown . 0 1 2024-02-28T23:07:02.198 INFO:tasks.workunit.client.0.smithi159.stdout:9/16: readlink l3 0 2024-02-28T23:07:02.199 INFO:tasks.workunit.client.0.smithi159.stdout:2/5: dread - f1 zero size 2024-02-28T23:07:02.200 INFO:tasks.workunit.client.0.smithi159.stdout:7/8: write f0 [521545,6636] 0 2024-02-28T23:07:02.202 INFO:tasks.workunit.client.0.smithi159.stdout:2/6: chown f1 3271220 1 2024-02-28T23:07:02.239 INFO:tasks.workunit.client.0.smithi159.stdout:2/7: dwrite f1 [0,4194304] 0 2024-02-28T23:07:02.312 INFO:tasks.workunit.client.0.smithi159.stdout:1/13: sync 2024-02-28T23:07:02.313 INFO:tasks.workunit.client.0.smithi159.stdout:4/33: sync 2024-02-28T23:07:02.313 INFO:tasks.workunit.client.0.smithi159.stdout:1/14: rmdir - no directory 2024-02-28T23:07:02.313 INFO:tasks.workunit.client.0.smithi159.stdout:3/30: sync 2024-02-28T23:07:02.313 INFO:tasks.workunit.client.0.smithi159.stdout:6/15: sync 2024-02-28T23:07:02.314 INFO:tasks.workunit.client.0.smithi159.stdout:4/34: readlink l6 0 2024-02-28T23:07:02.420 INFO:tasks.workunit.client.0.smithi159.stdout:2/8: mkdir d2 0 2024-02-28T23:07:02.421 INFO:tasks.workunit.client.0.smithi159.stdout:6/16: rmdir d0 39 2024-02-28T23:07:02.423 INFO:tasks.workunit.client.0.smithi159.stdout:4/35: rmdir d9 39 2024-02-28T23:07:02.426 INFO:tasks.workunit.client.0.smithi159.stdout:3/31: rename d0/d6/l9 to d0/d8/la 0 2024-02-28T23:07:02.426 INFO:tasks.workunit.client.0.smithi159.stdout:3/32: truncate - no filename 2024-02-28T23:07:02.426 INFO:tasks.workunit.client.0.smithi159.stdout:3/33: write - no filename 2024-02-28T23:07:02.426 INFO:tasks.workunit.client.0.smithi159.stdout:3/34: write - no filename 2024-02-28T23:07:02.426 INFO:tasks.workunit.client.0.smithi159.stdout:3/35: write - no filename 2024-02-28T23:07:02.427 INFO:tasks.workunit.client.0.smithi159.stdout:8/53: creat d2/fa x:0 0 0 2024-02-28T23:07:02.427 INFO:tasks.workunit.client.0.smithi159.stdout:5/13: creat f0 x:0 0 0 2024-02-28T23:07:02.429 INFO:tasks.workunit.client.0.smithi159.stdout:8/54: dread - d2/fa zero size 2024-02-28T23:07:02.431 INFO:tasks.workunit.client.0.smithi159.stdout:9/17: creat d4/f5 x:0 0 0 2024-02-28T23:07:02.435 INFO:tasks.workunit.client.0.smithi159.stdout:8/55: write d2/d3/f9 [980985,42474] 0 2024-02-28T23:07:02.441 INFO:tasks.workunit.client.0.smithi159.stdout:5/14: creat f1 x:0 0 0 2024-02-28T23:07:02.442 INFO:tasks.workunit.client.0.smithi159.stdout:3/36: symlink d0/d8/lb 0 2024-02-28T23:07:02.447 INFO:tasks.workunit.client.0.smithi159.stdout:6/17: symlink d0/l5 0 2024-02-28T23:07:02.449 INFO:tasks.workunit.client.0.smithi159.stdout:7/9: getdents . 0 2024-02-28T23:07:02.453 INFO:tasks.workunit.client.0.smithi159.stdout:0/35: dwrite d0/fb [0,4194304] 0 2024-02-28T23:07:02.456 INFO:tasks.workunit.client.0.smithi159.stdout:6/18: rmdir d0 39 2024-02-28T23:07:02.458 INFO:tasks.workunit.client.0.smithi159.stdout:0/36: chown d0/de/d11 193060474 1 2024-02-28T23:07:02.464 INFO:tasks.workunit.client.0.smithi159.stdout:2/9: dwrite f1 [0,4194304] 0 2024-02-28T23:07:02.467 INFO:tasks.workunit.client.0.smithi159.stdout:4/36: getdents d9/da 0 2024-02-28T23:07:02.469 INFO:tasks.workunit.client.0.smithi159.stdout:4/37: write f5 [1748686,69774] 0 2024-02-28T23:07:02.470 INFO:tasks.workunit.client.0.smithi159.stdout:6/19: creat d0/f6 x:0 0 0 2024-02-28T23:07:02.472 INFO:tasks.workunit.client.0.smithi159.stdout:2/10: unlink f1 0 2024-02-28T23:07:02.473 INFO:tasks.workunit.client.0.smithi159.stdout:2/11: dread - no filename 2024-02-28T23:07:02.473 INFO:tasks.workunit.client.0.smithi159.stdout:2/12: write - no filename 2024-02-28T23:07:02.473 INFO:tasks.workunit.client.0.smithi159.stdout:4/38: chown d9/da/fb 765774216 1 2024-02-28T23:07:02.474 INFO:tasks.workunit.client.0.smithi159.stdout:7/10: dread f0 [0,4194304] 0 2024-02-28T23:07:02.474 INFO:tasks.workunit.client.0.smithi159.stdout:7/11: readlink - no filename 2024-02-28T23:07:02.475 INFO:tasks.workunit.client.0.smithi159.stdout:4/39: stat d9/da 0 2024-02-28T23:07:02.475 INFO:tasks.workunit.client.0.smithi159.stdout:8/56: dwrite d2/d3/f8 [0,4194304] 0 2024-02-28T23:07:02.476 INFO:tasks.workunit.client.0.smithi159.stdout:7/12: chown f1 19425750 1 2024-02-28T23:07:02.477 INFO:tasks.workunit.client.0.smithi159.stdout:4/40: chown d9/da/fb 193740136 1 2024-02-28T23:07:02.479 INFO:tasks.workunit.client.0.smithi159.stdout:4/41: read d9/da/fb [3226398,98439] 0 2024-02-28T23:07:02.481 INFO:tasks.workunit.client.0.smithi159.stdout:7/13: symlink l2 0 2024-02-28T23:07:02.483 INFO:tasks.workunit.client.0.smithi159.stdout:0/37: link d0/d5/c9 d0/de/d11/c13 0 2024-02-28T23:07:02.487 INFO:tasks.workunit.client.0.smithi159.stdout:4/42: write d9/da/fb [4676626,4946] 0 2024-02-28T23:07:02.488 INFO:tasks.workunit.client.0.smithi159.stdout:4/43: chown l7 49593153 1 2024-02-28T23:07:02.490 INFO:tasks.workunit.client.0.smithi159.stdout:0/38: mkdir d0/d5/d14 0 2024-02-28T23:07:02.491 INFO:tasks.workunit.client.0.smithi159.stdout:0/39: read d0/f3 [643503,88250] 0 2024-02-28T23:07:02.511 INFO:tasks.workunit.client.0.smithi159.stdout:7/14: dwrite f1 [0,4194304] 0 2024-02-28T23:07:02.516 INFO:tasks.workunit.client.0.smithi159.stdout:7/15: unlink f0 0 2024-02-28T23:07:02.521 INFO:tasks.workunit.client.0.smithi159.stdout:0/40: dwrite d0/d5/ff [0,4194304] 0 2024-02-28T23:07:02.521 INFO:tasks.workunit.client.0.smithi159.stdout:7/16: truncate f1 4342539 0 2024-02-28T23:07:02.524 INFO:tasks.workunit.client.0.smithi159.stdout:7/17: creat f3 x:0 0 0 2024-02-28T23:07:02.525 INFO:tasks.workunit.client.0.smithi159.stdout:7/18: chown l2 9 1 2024-02-28T23:07:02.528 INFO:tasks.workunit.client.0.smithi159.stdout:7/19: creat f4 x:0 0 0 2024-02-28T23:07:02.530 INFO:tasks.workunit.client.0.smithi159.stdout:0/41: mknod d0/d5/d14/c15 0 2024-02-28T23:07:02.536 INFO:tasks.workunit.client.0.smithi159.stdout:0/42: read d0/f3 [1629663,73525] 0 2024-02-28T23:07:02.545 INFO:tasks.workunit.client.0.smithi159.stdout:0/43: dread d0/f3 [4194304,4194304] 0 2024-02-28T23:07:02.545 INFO:tasks.workunit.client.0.smithi159.stdout:0/44: fdatasync d0/d5/f7 0 2024-02-28T23:07:02.552 INFO:tasks.workunit.client.0.smithi159.stdout:7/20: dwrite f4 [0,4194304] 0 2024-02-28T23:07:02.554 INFO:tasks.workunit.client.0.smithi159.stdout:1/15: sync 2024-02-28T23:07:02.558 INFO:tasks.workunit.client.0.smithi159.stdout:7/21: mkdir d5 0 2024-02-28T23:07:02.568 INFO:tasks.workunit.client.0.smithi159.stdout:1/16: link f0 f2 0 2024-02-28T23:07:02.569 INFO:tasks.workunit.client.0.smithi159.stdout:7/22: mknod d5/c6 0 2024-02-28T23:07:02.569 INFO:tasks.workunit.client.0.smithi159.stdout:0/45: dwrite d0/d5/ff [0,4194304] 0 2024-02-28T23:07:02.573 INFO:tasks.workunit.client.0.smithi159.stdout:1/17: mknod c3 0 2024-02-28T23:07:02.574 INFO:tasks.workunit.client.0.smithi159.stdout:7/23: symlink d5/l7 0 2024-02-28T23:07:02.576 INFO:tasks.workunit.client.0.smithi159.stdout:0/46: rename d0/de/d11/l12 to d0/de/l16 0 2024-02-28T23:07:02.579 INFO:tasks.workunit.client.0.smithi159.stdout:7/24: symlink d5/l8 0 2024-02-28T23:07:02.583 INFO:tasks.workunit.client.0.smithi159.stdout:0/47: write d0/f3 [3443493,97000] 0 2024-02-28T23:07:02.583 INFO:tasks.workunit.client.0.smithi159.stdout:1/18: link f0 f4 0 2024-02-28T23:07:02.586 INFO:tasks.workunit.client.0.smithi159.stdout:7/25: creat d5/f9 x:0 0 0 2024-02-28T23:07:02.586 INFO:tasks.workunit.client.0.smithi159.stdout:0/48: chown d0/cc 9803 1 2024-02-28T23:07:02.587 INFO:tasks.workunit.client.0.smithi159.stdout:1/19: symlink l5 0 2024-02-28T23:07:02.593 INFO:tasks.workunit.client.0.smithi159.stdout:7/26: rename f1 to d5/fa 0 2024-02-28T23:07:02.594 INFO:tasks.workunit.client.0.smithi159.stdout:1/20: unlink f2 0 2024-02-28T23:07:02.598 INFO:tasks.workunit.client.0.smithi159.stdout:0/49: rename d0/ca to d0/de/c17 0 2024-02-28T23:07:02.605 INFO:tasks.workunit.client.0.smithi159.stdout:1/21: dread f4 [0,4194304] 0 2024-02-28T23:07:02.607 INFO:tasks.workunit.client.0.smithi159.stdout:0/50: link d0/cd d0/d5/d14/c18 0 2024-02-28T23:07:02.611 INFO:tasks.workunit.client.0.smithi159.stdout:1/22: dread f4 [0,4194304] 0 2024-02-28T23:07:02.613 INFO:tasks.workunit.client.0.smithi159.stdout:0/51: creat d0/de/d11/f19 x:0 0 0 2024-02-28T23:07:02.614 INFO:tasks.workunit.client.0.smithi159.stdout:7/27: dwrite f3 [0,4194304] 0 2024-02-28T23:07:02.617 INFO:tasks.workunit.client.0.smithi159.stdout:7/28: write f4 [2273902,86524] 0 2024-02-28T23:07:02.622 INFO:tasks.workunit.client.0.smithi159.stdout:9/18: getdents d4 0 2024-02-28T23:07:02.626 INFO:tasks.workunit.client.0.smithi159.stdout:3/37: getdents d0/d8 0 2024-02-28T23:07:02.630 INFO:tasks.workunit.client.0.smithi159.stdout:9/19: getdents d4 0 2024-02-28T23:07:02.632 INFO:tasks.workunit.client.0.smithi159.stdout:3/38: creat d0/fc x:0 0 0 2024-02-28T23:07:02.634 INFO:tasks.workunit.client.0.smithi159.stdout:6/20: rmdir d0 39 2024-02-28T23:07:02.636 INFO:tasks.workunit.client.0.smithi159.stdout:9/20: truncate d4/f5 629389 0 2024-02-28T23:07:02.639 INFO:tasks.workunit.client.0.smithi159.stdout:8/57: truncate d2/d3/f9 940994 0 2024-02-28T23:07:02.642 INFO:tasks.workunit.client.0.smithi159.stdout:4/44: truncate f5 663476 0 2024-02-28T23:07:02.645 INFO:tasks.workunit.client.0.smithi159.stdout:9/21: truncate d4/f5 1390230 0 2024-02-28T23:07:02.645 INFO:tasks.workunit.client.0.smithi159.stdout:0/52: dwrite d0/d5/ff [0,4194304] 0 2024-02-28T23:07:02.647 INFO:tasks.workunit.client.0.smithi159.stdout:1/23: dwrite f0 [0,4194304] 0 2024-02-28T23:07:02.648 INFO:tasks.workunit.client.0.smithi159.stdout:8/58: symlink d2/lb 0 2024-02-28T23:07:02.652 INFO:tasks.workunit.client.0.smithi159.stdout:4/45: rename d9/da/fb to d9/da/fc 0 2024-02-28T23:07:02.661 INFO:tasks.workunit.client.0.smithi159.stdout:2/13: sync 2024-02-28T23:07:02.661 INFO:tasks.workunit.client.0.smithi159.stdout:5/15: sync 2024-02-28T23:07:02.661 INFO:tasks.workunit.client.0.smithi159.stdout:2/14: readlink - no filename 2024-02-28T23:07:02.661 INFO:tasks.workunit.client.0.smithi159.stdout:2/15: dwrite - no filename 2024-02-28T23:07:02.661 INFO:tasks.workunit.client.0.smithi159.stdout:2/16: dread - no filename 2024-02-28T23:07:02.661 INFO:tasks.workunit.client.0.smithi159.stdout:9/22: mknod d4/c6 0 2024-02-28T23:07:02.664 INFO:tasks.workunit.client.0.smithi159.stdout:1/24: mkdir d6 0 2024-02-28T23:07:02.672 INFO:tasks.workunit.client.0.smithi159.stdout:3/39: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:02.672 INFO:tasks.workunit.client.0.smithi159.stdout:4/46: rename l6 to d9/da/ld 0 2024-02-28T23:07:02.675 INFO:tasks.workunit.client.0.smithi159.stdout:1/25: fdatasync f0 0 2024-02-28T23:07:02.681 INFO:tasks.workunit.client.0.smithi159.stdout:9/23: creat d4/f7 x:0 0 0 2024-02-28T23:07:02.682 INFO:tasks.workunit.client.0.smithi159.stdout:6/21: dwrite d0/f1 [4194304,4194304] 0 2024-02-28T23:07:02.683 INFO:tasks.workunit.client.0.smithi159.stdout:9/24: truncate d4/f5 1869207 0 2024-02-28T23:07:02.687 INFO:tasks.workunit.client.0.smithi159.stdout:9/25: stat d4/c6 0 2024-02-28T23:07:02.689 INFO:tasks.workunit.client.0.smithi159.stdout:4/47: creat d9/fe x:0 0 0 2024-02-28T23:07:02.691 INFO:tasks.workunit.client.0.smithi159.stdout:8/59: link d2/lb d2/d3/lc 0 2024-02-28T23:07:02.703 INFO:tasks.workunit.client.0.smithi159.stdout:3/40: creat d0/d8/fd x:0 0 0 2024-02-28T23:07:02.705 INFO:tasks.workunit.client.0.smithi159.stdout:6/22: rmdir d0 39 2024-02-28T23:07:02.706 INFO:tasks.workunit.client.0.smithi159.stdout:0/53: link d0/c4 d0/c1a 0 2024-02-28T23:07:02.708 INFO:tasks.workunit.client.0.smithi159.stdout:5/16: dwrite f0 [0,4194304] 0 2024-02-28T23:07:02.710 INFO:tasks.workunit.client.0.smithi159.stdout:5/17: stat f0 0 2024-02-28T23:07:02.712 INFO:tasks.workunit.client.0.smithi159.stdout:2/17: rmdir d2 0 2024-02-28T23:07:02.715 INFO:tasks.workunit.client.0.smithi159.stdout:1/26: creat d6/f7 x:0 0 0 2024-02-28T23:07:02.715 INFO:tasks.workunit.client.0.smithi159.stdout:3/41: creat d0/fe x:0 0 0 2024-02-28T23:07:02.726 INFO:tasks.workunit.client.0.smithi159.stdout:2/18: mknod c3 0 2024-02-28T23:07:02.726 INFO:tasks.workunit.client.0.smithi159.stdout:9/26: dwrite d4/f5 [0,4194304] 0 2024-02-28T23:07:02.728 INFO:tasks.workunit.client.0.smithi159.stdout:8/60: creat d2/fd x:0 0 0 2024-02-28T23:07:02.730 INFO:tasks.workunit.client.0.smithi159.stdout:9/27: write d4/f7 [719401,112434] 0 2024-02-28T23:07:02.731 INFO:tasks.workunit.client.0.smithi159.stdout:3/42: symlink d0/d6/lf 0 2024-02-28T23:07:02.732 INFO:tasks.workunit.client.0.smithi159.stdout:7/29: getdents d5 0 2024-02-28T23:07:02.733 INFO:tasks.workunit.client.0.smithi159.stdout:3/43: dread - d0/d8/fd zero size 2024-02-28T23:07:02.734 INFO:tasks.workunit.client.0.smithi159.stdout:9/28: write d4/f7 [342563,33575] 0 2024-02-28T23:07:02.735 INFO:tasks.workunit.client.0.smithi159.stdout:3/44: dread - d0/d8/fd zero size 2024-02-28T23:07:02.735 INFO:tasks.workunit.client.0.smithi159.stdout:9/29: chown c2 5519936 1 2024-02-28T23:07:02.737 INFO:tasks.workunit.client.0.smithi159.stdout:6/23: rename d0/f1 to d0/f7 0 2024-02-28T23:07:02.737 INFO:tasks.workunit.client.0.smithi159.stdout:9/30: write d4/f5 [3216312,38633] 0 2024-02-28T23:07:02.742 INFO:tasks.workunit.client.0.smithi159.stdout:0/54: rename d0/c4 to d0/d5/d14/c1b 0 2024-02-28T23:07:02.743 INFO:tasks.workunit.client.0.smithi159.stdout:6/24: write d0/f3 [620902,99957] 0 2024-02-28T23:07:02.743 INFO:tasks.workunit.client.0.smithi159.stdout:9/31: chown l3 6286050 1 2024-02-28T23:07:02.748 INFO:tasks.workunit.client.0.smithi159.stdout:5/18: link f0 f2 0 2024-02-28T23:07:02.750 INFO:tasks.workunit.client.0.smithi159.stdout:1/27: write f4 [673148,107615] 0 2024-02-28T23:07:02.750 INFO:tasks.workunit.client.0.smithi159.stdout:5/19: dread - f1 zero size 2024-02-28T23:07:02.750 INFO:tasks.workunit.client.0.smithi159.stdout:2/19: rename c3 to c4 0 2024-02-28T23:07:02.750 INFO:tasks.workunit.client.0.smithi159.stdout:2/20: dread - no filename 2024-02-28T23:07:02.751 INFO:tasks.workunit.client.0.smithi159.stdout:5/20: chown f1 221 1 2024-02-28T23:07:02.753 INFO:tasks.workunit.client.0.smithi159.stdout:7/30: creat d5/fb x:0 0 0 2024-02-28T23:07:02.762 INFO:tasks.workunit.client.0.smithi159.stdout:3/45: unlink d0/d8/la 0 2024-02-28T23:07:02.763 INFO:tasks.workunit.client.0.smithi159.stdout:6/25: rename d0/f6 to d0/f8 0 2024-02-28T23:07:02.765 INFO:tasks.workunit.client.0.smithi159.stdout:9/32: mknod d4/c8 0 2024-02-28T23:07:02.776 INFO:tasks.workunit.client.0.smithi159.stdout:0/55: dwrite d0/d5/f7 [0,4194304] 0 2024-02-28T23:07:02.777 INFO:tasks.workunit.client.0.smithi159.stdout:2/21: creat f5 x:0 0 0 2024-02-28T23:07:02.777 INFO:tasks.workunit.client.0.smithi159.stdout:2/22: rmdir - no directory 2024-02-28T23:07:02.780 INFO:tasks.workunit.client.0.smithi159.stdout:5/21: mknod c3 0 2024-02-28T23:07:02.783 INFO:tasks.workunit.client.0.smithi159.stdout:1/28: dwrite f0 [0,4194304] 0 2024-02-28T23:07:02.786 INFO:tasks.workunit.client.0.smithi159.stdout:1/29: write f0 [1368953,126507] 0 2024-02-28T23:07:02.787 INFO:tasks.workunit.client.0.smithi159.stdout:7/31: creat d5/fc x:0 0 0 2024-02-28T23:07:02.788 INFO:tasks.workunit.client.0.smithi159.stdout:7/32: fsync f3 0 2024-02-28T23:07:02.793 INFO:tasks.workunit.client.0.smithi159.stdout:1/30: write d6/f7 [881840,90477] 0 2024-02-28T23:07:02.797 INFO:tasks.workunit.client.0.smithi159.stdout:9/33: symlink d4/l9 0 2024-02-28T23:07:02.798 INFO:tasks.workunit.client.0.smithi159.stdout:0/56: mknod d0/c1c 0 2024-02-28T23:07:02.798 INFO:tasks.workunit.client.0.smithi159.stdout:7/33: write d5/fc [822822,28551] 0 2024-02-28T23:07:02.802 INFO:tasks.workunit.client.0.smithi159.stdout:8/61: link d2/fd d2/fe 0 2024-02-28T23:07:02.802 INFO:tasks.workunit.client.0.smithi159.stdout:5/22: creat f4 x:0 0 0 2024-02-28T23:07:02.812 INFO:tasks.workunit.client.0.smithi159.stdout:6/26: link d0/f3 d0/f9 0 2024-02-28T23:07:02.817 INFO:tasks.workunit.client.0.smithi159.stdout:9/34: symlink d4/la 0 2024-02-28T23:07:02.817 INFO:tasks.workunit.client.0.smithi159.stdout:9/35: stat c2 0 2024-02-28T23:07:02.821 INFO:tasks.workunit.client.0.smithi159.stdout:7/34: dwrite f4 [0,4194304] 0 2024-02-28T23:07:02.823 INFO:tasks.workunit.client.0.smithi159.stdout:0/57: rename d0/d5/l8 to d0/d5/d14/l1d 0 2024-02-28T23:07:02.826 INFO:tasks.workunit.client.0.smithi159.stdout:7/35: write d5/fc [697505,98995] 0 2024-02-28T23:07:02.828 INFO:tasks.workunit.client.0.smithi159.stdout:0/58: read - d0/de/d11/f19 zero size 2024-02-28T23:07:02.831 INFO:tasks.workunit.client.0.smithi159.stdout:1/31: rename d6/f7 to d6/f8 0 2024-02-28T23:07:02.845 INFO:tasks.workunit.client.0.smithi159.stdout:2/23: chown c4 5978 1 2024-02-28T23:07:02.845 INFO:tasks.workunit.client.0.smithi159.stdout:2/24: rmdir - no directory 2024-02-28T23:07:02.849 INFO:tasks.workunit.client.0.smithi159.stdout:5/23: dread f2 [0,4194304] 0 2024-02-28T23:07:02.850 INFO:tasks.workunit.client.0.smithi159.stdout:3/46: link d0/c5 d0/d8/c10 0 2024-02-28T23:07:02.850 INFO:tasks.workunit.client.0.smithi159.stdout:2/25: dread - f5 zero size 2024-02-28T23:07:02.860 INFO:tasks.workunit.client.0.smithi159.stdout:3/47: readlink d0/l1 0 2024-02-28T23:07:02.863 INFO:tasks.workunit.client.0.smithi159.stdout:4/48: write f5 [1539613,49506] 0 2024-02-28T23:07:02.863 INFO:tasks.workunit.client.0.smithi159.stdout:8/62: rename d2/fe to d2/ff 0 2024-02-28T23:07:02.864 INFO:tasks.workunit.client.0.smithi159.stdout:2/26: dread - f5 zero size 2024-02-28T23:07:02.864 INFO:tasks.workunit.client.0.smithi159.stdout:9/36: dwrite d4/f7 [0,4194304] 0 2024-02-28T23:07:02.864 INFO:tasks.workunit.client.0.smithi159.stdout:7/36: dwrite f4 [0,4194304] 0 2024-02-28T23:07:02.890 INFO:tasks.workunit.client.0.smithi159.stdout:5/24: write f1 [501342,37308] 0 2024-02-28T23:07:02.890 INFO:tasks.workunit.client.0.smithi159.stdout:5/25: readlink - no filename 2024-02-28T23:07:02.891 INFO:tasks.workunit.client.0.smithi159.stdout:5/26: readlink - no filename 2024-02-28T23:07:02.893 INFO:tasks.workunit.client.0.smithi159.stdout:8/63: dread - d2/fa zero size 2024-02-28T23:07:02.906 INFO:tasks.workunit.client.0.smithi159.stdout:0/59: dwrite d0/fb [0,4194304] 0 2024-02-28T23:07:02.915 INFO:tasks.workunit.client.0.smithi159.stdout:1/32: dwrite d6/f8 [0,4194304] 0 2024-02-28T23:07:02.917 INFO:tasks.workunit.client.0.smithi159.stdout:3/48: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:02.918 INFO:tasks.workunit.client.0.smithi159.stdout:6/27: dwrite d0/f8 [0,4194304] 0 2024-02-28T23:07:02.925 INFO:tasks.workunit.client.0.smithi159.stdout:3/49: dread - d0/d8/fd zero size 2024-02-28T23:07:02.925 INFO:tasks.workunit.client.0.smithi159.stdout:6/28: chown d0/f7 257963 1 2024-02-28T23:07:02.943 INFO:tasks.workunit.client.0.smithi159.stdout:5/27: dwrite f4 [0,4194304] 0 2024-02-28T23:07:02.953 INFO:tasks.workunit.client.0.smithi159.stdout:2/27: creat f6 x:0 0 0 2024-02-28T23:07:02.954 INFO:tasks.workunit.client.0.smithi159.stdout:2/28: readlink - no filename 2024-02-28T23:07:02.954 INFO:tasks.workunit.client.0.smithi159.stdout:9/37: symlink d4/lb 0 2024-02-28T23:07:02.956 INFO:tasks.workunit.client.0.smithi159.stdout:7/37: creat d5/fd x:0 0 0 2024-02-28T23:07:02.957 INFO:tasks.workunit.client.0.smithi159.stdout:8/64: creat d2/d3/f10 x:0 0 0 2024-02-28T23:07:02.961 INFO:tasks.workunit.client.0.smithi159.stdout:0/60: creat d0/f1e x:0 0 0 2024-02-28T23:07:02.965 INFO:tasks.workunit.client.0.smithi159.stdout:6/29: dwrite d0/f8 [0,4194304] 0 2024-02-28T23:07:02.966 INFO:tasks.workunit.client.0.smithi159.stdout:1/33: rmdir d6 39 2024-02-28T23:07:02.968 INFO:tasks.workunit.client.0.smithi159.stdout:3/50: mknod d0/d6/c11 0 2024-02-28T23:07:02.969 INFO:tasks.workunit.client.0.smithi159.stdout:7/38: truncate f4 4563173 0 2024-02-28T23:07:02.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:02 smithi159 ceph-mon[28802]: pgmap v20: 65 pgs: 65 active+clean; 204 MiB data, 955 MiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 195 op/s 2024-02-28T23:07:02.984 INFO:tasks.workunit.client.0.smithi159.stdout:2/29: dwrite f5 [0,4194304] 0 2024-02-28T23:07:02.984 INFO:tasks.workunit.client.0.smithi159.stdout:6/30: dread d0/f3 [0,4194304] 0 2024-02-28T23:07:02.986 INFO:tasks.workunit.client.0.smithi159.stdout:9/38: symlink d4/lc 0 2024-02-28T23:07:03.042 INFO:tasks.workunit.client.0.smithi159.stdout:7/39: creat d5/fe x:0 0 0 2024-02-28T23:07:03.044 INFO:tasks.workunit.client.0.smithi159.stdout:2/30: creat f7 x:0 0 0 2024-02-28T23:07:03.046 INFO:tasks.workunit.client.0.smithi159.stdout:2/31: fsync f6 0 2024-02-28T23:07:03.047 INFO:tasks.workunit.client.0.smithi159.stdout:9/39: symlink d4/ld 0 2024-02-28T23:07:03.049 INFO:tasks.workunit.client.0.smithi159.stdout:6/31: rename d0/f4 to d0/fa 0 2024-02-28T23:07:03.050 INFO:tasks.workunit.client.0.smithi159.stdout:7/40: write d5/fa [3285534,116053] 0 2024-02-28T23:07:03.055 INFO:tasks.workunit.client.0.smithi159.stdout:0/61: getdents d0/de 0 2024-02-28T23:07:03.057 INFO:tasks.workunit.client.0.smithi159.stdout:9/40: creat d4/fe x:0 0 0 2024-02-28T23:07:03.063 INFO:tasks.workunit.client.0.smithi159.stdout:9/41: fdatasync d4/f5 0 2024-02-28T23:07:03.065 INFO:tasks.workunit.client.0.smithi159.stdout:3/51: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:03.066 INFO:tasks.workunit.client.0.smithi159.stdout:0/62: creat d0/de/f1f x:0 0 0 2024-02-28T23:07:03.069 INFO:tasks.workunit.client.0.smithi159.stdout:5/28: dwrite f2 [0,4194304] 0 2024-02-28T23:07:03.072 INFO:tasks.workunit.client.0.smithi159.stdout:9/42: chown d4/f5 1 1 2024-02-28T23:07:03.073 INFO:tasks.workunit.client.0.smithi159.stdout:3/52: write d0/fc [4704257,98920] 0 2024-02-28T23:07:03.075 INFO:tasks.workunit.client.0.smithi159.stdout:5/29: read f2 [426709,57586] 0 2024-02-28T23:07:03.075 INFO:tasks.workunit.client.0.smithi159.stdout:6/32: truncate d0/f7 2653580 0 2024-02-28T23:07:03.081 INFO:tasks.workunit.client.0.smithi159.stdout:0/63: write d0/f6 [1014003,129699] 0 2024-02-28T23:07:03.081 INFO:tasks.workunit.client.0.smithi159.stdout:7/41: dread f4 [0,4194304] 0 2024-02-28T23:07:03.081 INFO:tasks.workunit.client.0.smithi159.stdout:8/65: dwrite d2/d3/f9 [0,4194304] 0 2024-02-28T23:07:03.083 INFO:tasks.workunit.client.0.smithi159.stdout:5/30: symlink l5 0 2024-02-28T23:07:03.087 INFO:tasks.workunit.client.0.smithi159.stdout:6/33: creat d0/fb x:0 0 0 2024-02-28T23:07:03.088 INFO:tasks.workunit.client.0.smithi159.stdout:7/42: write d5/f9 [898724,46814] 0 2024-02-28T23:07:03.088 INFO:tasks.workunit.client.0.smithi159.stdout:5/31: readlink l5 0 2024-02-28T23:07:03.088 INFO:tasks.workunit.client.0.smithi159.stdout:9/43: rename d4/la to d4/lf 0 2024-02-28T23:07:03.088 INFO:tasks.workunit.client.0.smithi159.stdout:3/53: rename d0/d8/fd to d0/f12 0 2024-02-28T23:07:03.094 INFO:tasks.workunit.client.0.smithi159.stdout:3/54: truncate d0/fc 5799474 0 2024-02-28T23:07:03.096 INFO:tasks.workunit.client.0.smithi159.stdout:7/43: mknod d5/cf 0 2024-02-28T23:07:03.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:02 smithi184 ceph-mon[36198]: pgmap v20: 65 pgs: 65 active+clean; 204 MiB data, 955 MiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 195 op/s 2024-02-28T23:07:03.100 INFO:tasks.workunit.client.0.smithi159.stdout:7/44: read d5/fc [291049,36036] 0 2024-02-28T23:07:03.101 INFO:tasks.workunit.client.0.smithi159.stdout:7/45: fsync f3 0 2024-02-28T23:07:03.102 INFO:tasks.workunit.client.0.smithi159.stdout:6/34: rename d0/f3 to d0/fc 0 2024-02-28T23:07:03.103 INFO:tasks.workunit.client.0.smithi159.stdout:5/32: creat f6 x:0 0 0 2024-02-28T23:07:03.107 INFO:tasks.workunit.client.0.smithi159.stdout:6/35: chown d0/fb 35067295 1 2024-02-28T23:07:03.108 INFO:tasks.workunit.client.0.smithi159.stdout:3/55: creat d0/d6/f13 x:0 0 0 2024-02-28T23:07:03.109 INFO:tasks.workunit.client.0.smithi159.stdout:0/64: dread d0/fb [0,4194304] 0 2024-02-28T23:07:03.111 INFO:tasks.workunit.client.0.smithi159.stdout:5/33: rename f2 to f7 0 2024-02-28T23:07:03.114 INFO:tasks.workunit.client.0.smithi159.stdout:3/56: mknod d0/c14 0 2024-02-28T23:07:03.115 INFO:tasks.workunit.client.0.smithi159.stdout:0/65: symlink d0/de/l20 0 2024-02-28T23:07:03.118 INFO:tasks.workunit.client.0.smithi159.stdout:6/36: creat d0/fd x:0 0 0 2024-02-28T23:07:03.119 INFO:tasks.workunit.client.0.smithi159.stdout:5/34: mkdir d8 0 2024-02-28T23:07:03.120 INFO:tasks.workunit.client.0.smithi159.stdout:8/66: getdents d2/d3 0 2024-02-28T23:07:03.127 INFO:tasks.workunit.client.0.smithi159.stdout:3/57: creat d0/d8/f15 x:0 0 0 2024-02-28T23:07:03.129 INFO:tasks.workunit.client.0.smithi159.stdout:6/37: dread d0/f9 [0,4194304] 0 2024-02-28T23:07:03.130 INFO:tasks.workunit.client.0.smithi159.stdout:5/35: rename c3 to d8/c9 0 2024-02-28T23:07:03.140 INFO:tasks.workunit.client.0.smithi159.stdout:8/67: mkdir d2/d11 0 2024-02-28T23:07:03.141 INFO:tasks.workunit.client.0.smithi159.stdout:5/36: chown f7 12391970 1 2024-02-28T23:07:03.141 INFO:tasks.workunit.client.0.smithi159.stdout:9/44: dwrite d4/f5 [4194304,4194304] 0 2024-02-28T23:07:03.141 INFO:tasks.workunit.client.0.smithi159.stdout:3/58: mknod d0/c16 0 2024-02-28T23:07:03.143 INFO:tasks.workunit.client.0.smithi159.stdout:5/37: mknod d8/ca 0 2024-02-28T23:07:03.148 INFO:tasks.workunit.client.0.smithi159.stdout:9/45: chown d4/c6 55405099 1 2024-02-28T23:07:03.152 INFO:tasks.workunit.client.0.smithi159.stdout:3/59: symlink d0/d8/l17 0 2024-02-28T23:07:03.155 INFO:tasks.workunit.client.0.smithi159.stdout:7/46: dwrite d5/fa [0,4194304] 0 2024-02-28T23:07:03.155 INFO:tasks.workunit.client.0.smithi159.stdout:3/60: stat d0/d6/lf 0 2024-02-28T23:07:03.157 INFO:tasks.workunit.client.0.smithi159.stdout:0/66: dwrite d0/d5/ff [0,4194304] 0 2024-02-28T23:07:03.158 INFO:tasks.workunit.client.0.smithi159.stdout:3/61: write d0/d8/f15 [614641,99712] 0 2024-02-28T23:07:03.160 INFO:tasks.workunit.client.0.smithi159.stdout:0/67: write d0/d5/f7 [1486030,4067] 0 2024-02-28T23:07:03.168 INFO:tasks.workunit.client.0.smithi159.stdout:3/62: symlink d0/l18 0 2024-02-28T23:07:03.169 INFO:tasks.workunit.client.0.smithi159.stdout:7/47: write f4 [5113595,44493] 0 2024-02-28T23:07:03.170 INFO:tasks.workunit.client.0.smithi159.stdout:8/68: link d2/fd d2/d11/f12 0 2024-02-28T23:07:03.176 INFO:tasks.workunit.client.0.smithi159.stdout:6/38: dwrite d0/f9 [0,4194304] 0 2024-02-28T23:07:03.178 INFO:tasks.workunit.client.0.smithi159.stdout:7/48: mkdir d5/d10 0 2024-02-28T23:07:03.184 INFO:tasks.workunit.client.0.smithi159.stdout:0/68: dread d0/f3 [0,4194304] 0 2024-02-28T23:07:03.190 INFO:tasks.workunit.client.0.smithi159.stdout:5/38: getdents d8 0 2024-02-28T23:07:03.194 INFO:tasks.workunit.client.0.smithi159.stdout:6/39: creat d0/fe x:0 0 0 2024-02-28T23:07:03.195 INFO:tasks.workunit.client.0.smithi159.stdout:5/39: write f1 [1062439,10990] 0 2024-02-28T23:07:03.195 INFO:tasks.workunit.client.0.smithi159.stdout:7/49: creat d5/d10/f11 x:0 0 0 2024-02-28T23:07:03.201 INFO:tasks.workunit.client.0.smithi159.stdout:0/69: rmdir d0/de 39 2024-02-28T23:07:03.205 INFO:tasks.workunit.client.0.smithi159.stdout:3/63: dwrite d0/fe [0,4194304] 0 2024-02-28T23:07:03.207 INFO:tasks.workunit.client.0.smithi159.stdout:6/40: symlink d0/lf 0 2024-02-28T23:07:03.211 INFO:tasks.workunit.client.0.smithi159.stdout:3/64: fdatasync d0/d8/f15 0 2024-02-28T23:07:03.212 INFO:tasks.workunit.client.0.smithi159.stdout:9/46: dwrite d4/f7 [0,4194304] 0 2024-02-28T23:07:03.213 INFO:tasks.workunit.client.0.smithi159.stdout:7/50: rmdir d5/d10 39 2024-02-28T23:07:03.213 INFO:tasks.workunit.client.0.smithi159.stdout:8/69: write d2/ff [948230,87924] 0 2024-02-28T23:07:03.216 INFO:tasks.workunit.client.0.smithi159.stdout:4/49: sync 2024-02-28T23:07:03.218 INFO:tasks.workunit.client.0.smithi159.stdout:0/70: write d0/fb [3457950,113336] 0 2024-02-28T23:07:03.222 INFO:tasks.workunit.client.0.smithi159.stdout:6/41: mkdir d0/d10 0 2024-02-28T23:07:03.229 INFO:tasks.workunit.client.0.smithi159.stdout:8/70: creat d2/d3/f13 x:0 0 0 2024-02-28T23:07:03.232 INFO:tasks.workunit.client.0.smithi159.stdout:4/50: symlink d9/da/lf 0 2024-02-28T23:07:03.235 INFO:tasks.workunit.client.0.smithi159.stdout:6/42: unlink d0/f2 0 2024-02-28T23:07:03.235 INFO:tasks.workunit.client.0.smithi159.stdout:8/71: creat d2/d3/f14 x:0 0 0 2024-02-28T23:07:03.238 INFO:tasks.workunit.client.0.smithi159.stdout:3/65: fsync d0/fe 0 2024-02-28T23:07:03.239 INFO:tasks.workunit.client.0.smithi159.stdout:7/51: creat d5/f12 x:0 0 0 2024-02-28T23:07:03.240 INFO:tasks.workunit.client.0.smithi159.stdout:4/51: fdatasync d9/fe 0 2024-02-28T23:07:03.241 INFO:tasks.workunit.client.0.smithi159.stdout:5/40: dwrite f1 [0,4194304] 0 2024-02-28T23:07:03.247 INFO:tasks.workunit.client.0.smithi159.stdout:6/43: truncate d0/fd 801424 0 2024-02-28T23:07:03.254 INFO:tasks.workunit.client.0.smithi159.stdout:4/52: creat d9/da/f10 x:0 0 0 2024-02-28T23:07:03.255 INFO:tasks.workunit.client.0.smithi159.stdout:7/52: mknod d5/d10/c13 0 2024-02-28T23:07:03.257 INFO:tasks.workunit.client.0.smithi159.stdout:6/44: truncate d0/fe 382131 0 2024-02-28T23:07:03.262 INFO:tasks.workunit.client.0.smithi159.stdout:9/47: dread d4/f7 [0,4194304] 0 2024-02-28T23:07:03.266 INFO:tasks.workunit.client.0.smithi159.stdout:6/45: fdatasync d0/f9 0 2024-02-28T23:07:03.266 INFO:tasks.workunit.client.0.smithi159.stdout:9/48: chown d4 2412474 1 2024-02-28T23:07:03.266 INFO:tasks.workunit.client.0.smithi159.stdout:4/53: mknod d9/da/c11 0 2024-02-28T23:07:03.266 INFO:tasks.workunit.client.0.smithi159.stdout:7/53: mknod d5/c14 0 2024-02-28T23:07:03.266 INFO:tasks.workunit.client.0.smithi159.stdout:3/66: dread d0/d8/f15 [0,4194304] 0 2024-02-28T23:07:03.267 INFO:tasks.workunit.client.0.smithi159.stdout:9/49: stat d4/f7 0 2024-02-28T23:07:03.272 INFO:tasks.workunit.client.0.smithi159.stdout:0/71: dwrite d0/de/f1f [0,4194304] 0 2024-02-28T23:07:03.273 INFO:tasks.workunit.client.0.smithi159.stdout:6/46: mkdir d0/d10/d11 0 2024-02-28T23:07:03.275 INFO:tasks.workunit.client.0.smithi159.stdout:6/47: readlink d0/l5 0 2024-02-28T23:07:03.276 INFO:tasks.workunit.client.0.smithi159.stdout:3/67: write d0/fe [1989047,54821] 0 2024-02-28T23:07:03.282 INFO:tasks.workunit.client.0.smithi159.stdout:9/50: rename d4/c8 to d4/c10 0 2024-02-28T23:07:03.283 INFO:tasks.workunit.client.0.smithi159.stdout:7/54: mknod d5/c15 0 2024-02-28T23:07:03.284 INFO:tasks.workunit.client.0.smithi159.stdout:8/72: dread d2/d3/f9 [0,4194304] 0 2024-02-28T23:07:03.284 INFO:tasks.workunit.client.0.smithi159.stdout:6/48: creat d0/d10/f12 x:0 0 0 2024-02-28T23:07:03.285 INFO:tasks.workunit.client.0.smithi159.stdout:4/54: dread f5 [0,4194304] 0 2024-02-28T23:07:03.285 INFO:tasks.workunit.client.0.smithi159.stdout:9/51: chown d4/l9 23052 1 2024-02-28T23:07:03.285 INFO:tasks.workunit.client.0.smithi159.stdout:3/68: chown d0/l18 257475 1 2024-02-28T23:07:03.285 INFO:tasks.workunit.client.0.smithi159.stdout:7/55: chown d5/c15 487761 1 2024-02-28T23:07:03.286 INFO:tasks.workunit.client.0.smithi159.stdout:3/69: fdatasync d0/fc 0 2024-02-28T23:07:03.286 INFO:tasks.workunit.client.0.smithi159.stdout:5/41: dread f0 [0,4194304] 0 2024-02-28T23:07:03.288 INFO:tasks.workunit.client.0.smithi159.stdout:7/56: chown d5/fa 84773380 1 2024-02-28T23:07:03.294 INFO:tasks.workunit.client.0.smithi159.stdout:7/57: write d5/f9 [432878,43858] 0 2024-02-28T23:07:03.296 INFO:tasks.workunit.client.0.smithi159.stdout:2/32: sync 2024-02-28T23:07:03.296 INFO:tasks.workunit.client.0.smithi159.stdout:1/34: sync 2024-02-28T23:07:03.297 INFO:tasks.workunit.client.0.smithi159.stdout:3/70: mkdir d0/d6/d19 0 2024-02-28T23:07:03.300 INFO:tasks.workunit.client.0.smithi159.stdout:2/33: write f6 [767861,23786] 0 2024-02-28T23:07:03.302 INFO:tasks.workunit.client.0.smithi159.stdout:3/71: readlink d0/l3 0 2024-02-28T23:07:03.304 INFO:tasks.workunit.client.0.smithi159.stdout:3/72: stat d0/l3 0 2024-02-28T23:07:03.306 INFO:tasks.workunit.client.0.smithi159.stdout:8/73: creat d2/f15 x:0 0 0 2024-02-28T23:07:03.308 INFO:tasks.workunit.client.0.smithi159.stdout:7/58: mkdir d5/d16 0 2024-02-28T23:07:03.310 INFO:tasks.workunit.client.0.smithi159.stdout:2/34: rename f5 to f8 0 2024-02-28T23:07:03.314 INFO:tasks.workunit.client.0.smithi159.stdout:1/35: rename d6/f8 to d6/f9 0 2024-02-28T23:07:03.315 INFO:tasks.workunit.client.0.smithi159.stdout:7/59: chown d5/cf 91196707 1 2024-02-28T23:07:03.316 INFO:tasks.workunit.client.0.smithi159.stdout:2/35: truncate f7 826801 0 2024-02-28T23:07:03.317 INFO:tasks.workunit.client.0.smithi159.stdout:9/52: dread d4/f5 [4194304,4194304] 0 2024-02-28T23:07:03.320 INFO:tasks.workunit.client.0.smithi159.stdout:0/72: dwrite d0/d5/ff [0,4194304] 0 2024-02-28T23:07:03.327 INFO:tasks.workunit.client.0.smithi159.stdout:1/36: mknod d6/ca 0 2024-02-28T23:07:03.327 INFO:tasks.workunit.client.0.smithi159.stdout:6/49: dwrite d0/f9 [0,4194304] 0 2024-02-28T23:07:03.328 INFO:tasks.workunit.client.0.smithi159.stdout:2/36: mkdir d9 0 2024-02-28T23:07:03.333 INFO:tasks.workunit.client.0.smithi159.stdout:5/42: dread f0 [0,4194304] 0 2024-02-28T23:07:03.336 INFO:tasks.workunit.client.0.smithi159.stdout:1/37: creat d6/fb x:0 0 0 2024-02-28T23:07:03.336 INFO:tasks.workunit.client.0.smithi159.stdout:4/55: dwrite d9/da/fc [0,4194304] 0 2024-02-28T23:07:03.340 INFO:tasks.workunit.client.0.smithi159.stdout:4/56: read d9/da/fc [3612739,70808] 0 2024-02-28T23:07:03.340 INFO:tasks.workunit.client.0.smithi159.stdout:0/73: creat d0/de/d11/f21 x:0 0 0 2024-02-28T23:07:03.343 INFO:tasks.workunit.client.0.smithi159.stdout:8/74: getdents d2 0 2024-02-28T23:07:03.343 INFO:tasks.workunit.client.0.smithi159.stdout:1/38: chown f4 1 1 2024-02-28T23:07:03.344 INFO:tasks.workunit.client.0.smithi159.stdout:0/74: truncate d0/f1e 475254 0 2024-02-28T23:07:03.354 INFO:tasks.workunit.client.0.smithi159.stdout:5/43: creat d8/fb x:0 0 0 2024-02-28T23:07:03.356 INFO:tasks.workunit.client.0.smithi159.stdout:3/73: dwrite d0/fe [0,4194304] 0 2024-02-28T23:07:03.358 INFO:tasks.workunit.client.0.smithi159.stdout:1/39: write f0 [1975260,62852] 0 2024-02-28T23:07:03.366 INFO:tasks.workunit.client.0.smithi159.stdout:2/37: getdents d9 0 2024-02-28T23:07:03.369 INFO:tasks.workunit.client.0.smithi159.stdout:1/40: chown l5 5871 1 2024-02-28T23:07:03.373 INFO:tasks.workunit.client.0.smithi159.stdout:3/74: read - d0/d6/f13 zero size 2024-02-28T23:07:03.373 INFO:tasks.workunit.client.0.smithi159.stdout:7/60: dwrite d5/fb [0,4194304] 0 2024-02-28T23:07:03.373 INFO:tasks.workunit.client.0.smithi159.stdout:2/38: stat c4 0 2024-02-28T23:07:03.375 INFO:tasks.workunit.client.0.smithi159.stdout:5/44: symlink d8/lc 0 2024-02-28T23:07:03.387 INFO:tasks.workunit.client.0.smithi159.stdout:8/75: write d2/d3/f9 [570465,120400] 0 2024-02-28T23:07:03.388 INFO:tasks.workunit.client.0.smithi159.stdout:1/41: truncate f0 4780023 0 2024-02-28T23:07:03.388 INFO:tasks.workunit.client.0.smithi159.stdout:2/39: fsync f8 0 2024-02-28T23:07:03.399 INFO:tasks.workunit.client.0.smithi159.stdout:9/53: dwrite d4/f7 [0,4194304] 0 2024-02-28T23:07:03.399 INFO:tasks.workunit.client.0.smithi159.stdout:3/75: write d0/fe [4812866,104099] 0 2024-02-28T23:07:03.402 INFO:tasks.workunit.client.0.smithi159.stdout:6/50: dread d0/fc [0,4194304] 0 2024-02-28T23:07:03.404 INFO:tasks.workunit.client.0.smithi159.stdout:8/76: write d2/ff [600355,84594] 0 2024-02-28T23:07:03.411 INFO:tasks.workunit.client.0.smithi159.stdout:9/54: truncate d4/f7 4593324 0 2024-02-28T23:07:03.413 INFO:tasks.workunit.client.0.smithi159.stdout:4/57: dwrite d9/fe [0,4194304] 0 2024-02-28T23:07:03.416 INFO:tasks.workunit.client.0.smithi159.stdout:5/45: rename d8/lc to d8/ld 0 2024-02-28T23:07:03.420 INFO:tasks.workunit.client.0.smithi159.stdout:3/76: symlink d0/l1a 0 2024-02-28T23:07:03.421 INFO:tasks.workunit.client.0.smithi159.stdout:4/58: truncate f5 1597410 0 2024-02-28T23:07:03.422 INFO:tasks.workunit.client.0.smithi159.stdout:3/77: write d0/d6/f13 [99615,18102] 0 2024-02-28T23:07:03.423 INFO:tasks.workunit.client.0.smithi159.stdout:9/55: creat d4/f11 x:0 0 0 2024-02-28T23:07:03.424 INFO:tasks.workunit.client.0.smithi159.stdout:7/61: getdents d5/d16 0 2024-02-28T23:07:03.424 INFO:tasks.workunit.client.0.smithi159.stdout:8/77: dread - d2/f15 zero size 2024-02-28T23:07:03.427 INFO:tasks.workunit.client.0.smithi159.stdout:2/40: symlink d9/la 0 2024-02-28T23:07:03.428 INFO:tasks.workunit.client.0.smithi159.stdout:2/41: fsync f6 0 2024-02-28T23:07:03.428 INFO:tasks.workunit.client.0.smithi159.stdout:0/75: dwrite d0/f3 [0,4194304] 0 2024-02-28T23:07:03.431 INFO:tasks.workunit.client.0.smithi159.stdout:8/78: stat d2/f15 0 2024-02-28T23:07:03.439 INFO:tasks.workunit.client.0.smithi159.stdout:0/76: fsync d0/de/d11/f19 0 2024-02-28T23:07:03.442 INFO:tasks.workunit.client.0.smithi159.stdout:3/78: mknod d0/d8/c1b 0 2024-02-28T23:07:03.444 INFO:tasks.workunit.client.0.smithi159.stdout:7/62: truncate d5/fc 1481380 0 2024-02-28T23:07:03.450 INFO:tasks.workunit.client.0.smithi159.stdout:4/59: creat d9/da/f12 x:0 0 0 2024-02-28T23:07:03.453 INFO:tasks.workunit.client.0.smithi159.stdout:0/77: creat d0/d5/d14/f22 x:0 0 0 2024-02-28T23:07:03.455 INFO:tasks.workunit.client.0.smithi159.stdout:8/79: mknod d2/d11/c16 0 2024-02-28T23:07:03.457 INFO:tasks.workunit.client.0.smithi159.stdout:4/60: creat d9/da/f13 x:0 0 0 2024-02-28T23:07:03.464 INFO:tasks.workunit.client.0.smithi159.stdout:6/51: dwrite d0/f8 [0,4194304] 0 2024-02-28T23:07:03.464 INFO:tasks.workunit.client.0.smithi159.stdout:3/79: rename d0/d6/c11 to d0/d8/c1c 0 2024-02-28T23:07:03.464 INFO:tasks.workunit.client.0.smithi159.stdout:9/56: dread d4/f7 [0,4194304] 0 2024-02-28T23:07:03.466 INFO:tasks.workunit.client.0.smithi159.stdout:6/52: chown d0/fb 4 1 2024-02-28T23:07:03.466 INFO:tasks.workunit.client.0.smithi159.stdout:9/57: readlink d4/l9 0 2024-02-28T23:07:03.466 INFO:tasks.workunit.client.0.smithi159.stdout:0/78: readlink d0/d5/d14/l1d 0 2024-02-28T23:07:03.466 INFO:tasks.workunit.client.0.smithi159.stdout:8/80: creat d2/d3/f17 x:0 0 0 2024-02-28T23:07:03.469 INFO:tasks.workunit.client.0.smithi159.stdout:4/61: chown d9/da/fc 483288 1 2024-02-28T23:07:03.470 INFO:tasks.workunit.client.0.smithi159.stdout:5/46: dwrite f0 [0,4194304] 0 2024-02-28T23:07:03.471 INFO:tasks.workunit.client.0.smithi159.stdout:3/80: unlink d0/fc 0 2024-02-28T23:07:03.471 INFO:tasks.workunit.client.0.smithi159.stdout:2/42: dwrite f8 [0,4194304] 0 2024-02-28T23:07:03.479 INFO:tasks.workunit.client.0.smithi159.stdout:6/53: mknod d0/d10/c13 0 2024-02-28T23:07:03.480 INFO:tasks.workunit.client.0.smithi159.stdout:8/81: mkdir d2/d3/d18 0 2024-02-28T23:07:03.481 INFO:tasks.workunit.client.0.smithi159.stdout:3/81: read d0/d6/f13 [21114,62969] 0 2024-02-28T23:07:03.481 INFO:tasks.workunit.client.0.smithi159.stdout:9/58: symlink d4/l12 0 2024-02-28T23:07:03.481 INFO:tasks.workunit.client.0.smithi159.stdout:4/62: symlink d9/da/l14 0 2024-02-28T23:07:03.482 INFO:tasks.workunit.client.0.smithi159.stdout:2/43: mknod d9/cb 0 2024-02-28T23:07:03.490 INFO:tasks.workunit.client.0.smithi159.stdout:5/47: creat d8/fe x:0 0 0 2024-02-28T23:07:03.491 INFO:tasks.workunit.client.0.smithi159.stdout:9/59: truncate d4/f11 940066 0 2024-02-28T23:07:03.492 INFO:tasks.workunit.client.0.smithi159.stdout:4/63: chown d9/da 225703275 1 2024-02-28T23:07:03.498 INFO:tasks.workunit.client.0.smithi159.stdout:5/48: truncate f6 416777 0 2024-02-28T23:07:03.509 INFO:tasks.workunit.client.0.smithi159.stdout:7/63: dwrite d5/d10/f11 [0,4194304] 0 2024-02-28T23:07:03.509 INFO:tasks.workunit.client.0.smithi159.stdout:4/64: symlink d9/l15 0 2024-02-28T23:07:03.520 INFO:tasks.workunit.client.0.smithi159.stdout:2/44: link d9/cb d9/cc 0 2024-02-28T23:07:03.520 INFO:tasks.workunit.client.0.smithi159.stdout:4/65: read d9/fe [3624306,82209] 0 2024-02-28T23:07:03.520 INFO:tasks.workunit.client.0.smithi159.stdout:7/64: chown d5/fb 22914 1 2024-02-28T23:07:03.524 INFO:tasks.workunit.client.0.smithi159.stdout:7/65: readlink d5/l8 0 2024-02-28T23:07:03.526 INFO:tasks.workunit.client.0.smithi159.stdout:0/79: link d0/de/l16 d0/l23 0 2024-02-28T23:07:03.527 INFO:tasks.workunit.client.0.smithi159.stdout:3/82: link d0/fe d0/d8/f1d 0 2024-02-28T23:07:03.533 INFO:tasks.workunit.client.0.smithi159.stdout:8/82: dwrite d2/ff [0,4194304] 0 2024-02-28T23:07:03.538 INFO:tasks.workunit.client.0.smithi159.stdout:6/54: dwrite d0/fe [0,4194304] 0 2024-02-28T23:07:03.542 INFO:tasks.workunit.client.0.smithi159.stdout:7/66: rename l2 to d5/d16/l17 0 2024-02-28T23:07:03.546 INFO:tasks.workunit.client.0.smithi159.stdout:9/60: truncate d4/f7 3147276 0 2024-02-28T23:07:03.550 INFO:tasks.workunit.client.0.smithi159.stdout:3/83: chown d0/d8/c1c 7189206 1 2024-02-28T23:07:03.550 INFO:tasks.workunit.client.0.smithi159.stdout:0/80: mknod d0/d5/c24 0 2024-02-28T23:07:03.559 INFO:tasks.workunit.client.0.smithi159.stdout:8/83: readlink d2/lb 0 2024-02-28T23:07:03.561 INFO:tasks.workunit.client.0.smithi159.stdout:5/49: dwrite f6 [0,4194304] 0 2024-02-28T23:07:03.561 INFO:tasks.workunit.client.0.smithi159.stdout:2/45: link d9/cb d9/cd 0 2024-02-28T23:07:03.568 INFO:tasks.workunit.client.0.smithi159.stdout:9/61: creat d4/f13 x:0 0 0 2024-02-28T23:07:03.572 INFO:tasks.workunit.client.0.smithi159.stdout:3/84: creat d0/d8/f1e x:0 0 0 2024-02-28T23:07:03.572 INFO:tasks.workunit.client.0.smithi159.stdout:4/66: dwrite d9/da/f12 [0,4194304] 0 2024-02-28T23:07:03.574 INFO:tasks.workunit.client.0.smithi159.stdout:4/67: chown d9/l15 44 1 2024-02-28T23:07:03.580 INFO:tasks.workunit.client.0.smithi159.stdout:8/84: creat d2/f19 x:0 0 0 2024-02-28T23:07:03.587 INFO:tasks.workunit.client.0.smithi159.stdout:5/50: dread f1 [0,4194304] 0 2024-02-28T23:07:03.587 INFO:tasks.workunit.client.0.smithi159.stdout:5/51: dread - d8/fb zero size 2024-02-28T23:07:03.589 INFO:tasks.workunit.client.0.smithi159.stdout:9/62: symlink d4/l14 0 2024-02-28T23:07:03.591 INFO:tasks.workunit.client.0.smithi159.stdout:0/81: unlink d0/d5/d14/c18 0 2024-02-28T23:07:03.594 INFO:tasks.workunit.client.0.smithi159.stdout:7/67: creat d5/f18 x:0 0 0 2024-02-28T23:07:03.595 INFO:tasks.workunit.client.0.smithi159.stdout:0/82: write d0/d5/f7 [3587162,27321] 0 2024-02-28T23:07:03.603 INFO:tasks.workunit.client.0.smithi159.stdout:2/46: chown d9/cb 24 1 2024-02-28T23:07:03.605 INFO:tasks.workunit.client.0.smithi159.stdout:7/68: write d5/f12 [239861,50157] 0 2024-02-28T23:07:03.608 INFO:tasks.workunit.client.0.smithi159.stdout:4/68: dwrite d9/da/f13 [0,4194304] 0 2024-02-28T23:07:03.611 INFO:tasks.workunit.client.0.smithi159.stdout:4/69: write d9/da/f12 [1421064,58024] 0 2024-02-28T23:07:03.619 INFO:tasks.workunit.client.0.smithi159.stdout:5/52: dwrite f6 [0,4194304] 0 2024-02-28T23:07:03.622 INFO:tasks.workunit.client.0.smithi159.stdout:9/63: creat d4/f15 x:0 0 0 2024-02-28T23:07:03.624 INFO:tasks.workunit.client.0.smithi159.stdout:3/85: write d0/fe [3681679,19400] 0 2024-02-28T23:07:03.624 INFO:tasks.workunit.client.0.smithi159.stdout:9/64: write d4/fe [750488,108655] 0 2024-02-28T23:07:03.626 INFO:tasks.workunit.client.0.smithi159.stdout:7/69: dread d5/fb [0,4194304] 0 2024-02-28T23:07:03.627 INFO:tasks.workunit.client.0.smithi159.stdout:7/70: truncate f4 5584488 0 2024-02-28T23:07:03.629 INFO:tasks.workunit.client.0.smithi159.stdout:7/71: write d5/fd [201996,33256] 0 2024-02-28T23:07:03.633 INFO:tasks.workunit.client.0.smithi159.stdout:0/83: mkdir d0/d5/d14/d25 0 2024-02-28T23:07:03.633 INFO:tasks.workunit.client.0.smithi159.stdout:8/85: rmdir d2/d11 39 2024-02-28T23:07:03.635 INFO:tasks.workunit.client.0.smithi159.stdout:7/72: truncate d5/fe 795419 0 2024-02-28T23:07:03.635 INFO:tasks.workunit.client.0.smithi159.stdout:0/84: chown d0/de/f1f 6470 1 2024-02-28T23:07:03.638 INFO:tasks.workunit.client.0.smithi159.stdout:0/85: truncate d0/d5/ff 4963834 0 2024-02-28T23:07:03.639 INFO:tasks.workunit.client.0.smithi159.stdout:2/47: mkdir d9/de 0 2024-02-28T23:07:03.640 INFO:tasks.workunit.client.0.smithi159.stdout:2/48: truncate f6 1272553 0 2024-02-28T23:07:03.641 INFO:tasks.workunit.client.0.smithi159.stdout:2/49: fdatasync f8 0 2024-02-28T23:07:03.643 INFO:tasks.workunit.client.0.smithi159.stdout:5/53: creat d8/ff x:0 0 0 2024-02-28T23:07:03.644 INFO:tasks.workunit.client.0.smithi159.stdout:4/70: write d9/da/fc [3406817,34240] 0 2024-02-28T23:07:03.648 INFO:tasks.workunit.client.0.smithi159.stdout:3/86: unlink d0/d8/f15 0 2024-02-28T23:07:03.648 INFO:tasks.workunit.client.0.smithi159.stdout:1/42: sync 2024-02-28T23:07:03.652 INFO:tasks.workunit.client.0.smithi159.stdout:8/86: chown d2/d3/f8 17091 1 2024-02-28T23:07:03.654 INFO:tasks.workunit.client.0.smithi159.stdout:7/73: creat d5/d16/f19 x:0 0 0 2024-02-28T23:07:03.664 INFO:tasks.workunit.client.0.smithi159.stdout:5/54: creat d8/f10 x:0 0 0 2024-02-28T23:07:03.664 INFO:tasks.workunit.client.0.smithi159.stdout:4/71: creat d9/da/f16 x:0 0 0 2024-02-28T23:07:03.666 INFO:tasks.workunit.client.0.smithi159.stdout:1/43: mkdir d6/dc 0 2024-02-28T23:07:03.668 INFO:tasks.workunit.client.0.smithi159.stdout:2/50: dwrite f7 [0,4194304] 0 2024-02-28T23:07:03.674 INFO:tasks.workunit.client.0.smithi159.stdout:9/65: dwrite d4/f5 [8388608,4194304] 0 2024-02-28T23:07:03.678 INFO:tasks.workunit.client.0.smithi159.stdout:5/55: rename f1 to d8/f11 0 2024-02-28T23:07:03.680 INFO:tasks.workunit.client.0.smithi159.stdout:8/87: mknod d2/d11/c1a 0 2024-02-28T23:07:03.694 INFO:tasks.workunit.client.0.smithi159.stdout:5/56: dread f6 [0,4194304] 0 2024-02-28T23:07:03.694 INFO:tasks.workunit.client.0.smithi159.stdout:7/74: dread d5/fc [0,4194304] 0 2024-02-28T23:07:03.701 INFO:tasks.workunit.client.0.smithi159.stdout:4/72: rmdir d9/da 39 2024-02-28T23:07:03.705 INFO:tasks.workunit.client.0.smithi159.stdout:2/51: creat d9/de/ff x:0 0 0 2024-02-28T23:07:03.710 INFO:tasks.workunit.client.0.smithi159.stdout:8/88: truncate d2/f15 930590 0 2024-02-28T23:07:03.710 INFO:tasks.workunit.client.0.smithi159.stdout:9/66: dwrite d4/f11 [0,4194304] 0 2024-02-28T23:07:03.712 INFO:tasks.workunit.client.0.smithi159.stdout:7/75: mkdir d5/d16/d1a 0 2024-02-28T23:07:03.714 INFO:tasks.workunit.client.0.smithi159.stdout:4/73: read d9/fe [2017779,5953] 0 2024-02-28T23:07:03.715 INFO:tasks.workunit.client.0.smithi159.stdout:2/52: rename c4 to d9/de/c10 0 2024-02-28T23:07:03.716 INFO:tasks.workunit.client.0.smithi159.stdout:7/76: rename d5 to d5/d16/d1a/d1b 22 2024-02-28T23:07:03.718 INFO:tasks.workunit.client.0.smithi159.stdout:1/44: dwrite d6/f9 [0,4194304] 0 2024-02-28T23:07:03.718 INFO:tasks.workunit.client.0.smithi159.stdout:3/87: truncate d0/fe 4417859 0 2024-02-28T23:07:03.722 INFO:tasks.workunit.client.0.smithi159.stdout:3/88: chown d0/d8/lb 47161 1 2024-02-28T23:07:03.722 INFO:tasks.workunit.client.0.smithi159.stdout:1/45: write d6/f9 [1330479,79596] 0 2024-02-28T23:07:03.723 INFO:tasks.workunit.client.0.smithi159.stdout:5/57: rmdir d8 39 2024-02-28T23:07:03.724 INFO:tasks.workunit.client.0.smithi159.stdout:1/46: chown d6 62 1 2024-02-28T23:07:03.727 INFO:tasks.workunit.client.0.smithi159.stdout:1/47: write d6/fb [819472,19983] 0 2024-02-28T23:07:03.733 INFO:tasks.workunit.client.0.smithi159.stdout:1/48: write f4 [1662661,58644] 0 2024-02-28T23:07:03.744 INFO:tasks.workunit.client.0.smithi159.stdout:4/74: creat d9/f17 x:0 0 0 2024-02-28T23:07:03.747 INFO:tasks.workunit.client.0.smithi159.stdout:8/89: getdents d2/d11 0 2024-02-28T23:07:03.749 INFO:tasks.workunit.client.0.smithi159.stdout:1/49: rename f4 to d6/fd 0 2024-02-28T23:07:03.749 INFO:tasks.workunit.client.0.smithi159.stdout:9/67: dwrite d4/f11 [0,4194304] 0 2024-02-28T23:07:03.750 INFO:tasks.workunit.client.0.smithi159.stdout:5/58: dread f7 [0,4194304] 0 2024-02-28T23:07:03.755 INFO:tasks.workunit.client.0.smithi159.stdout:7/77: dwrite d5/fe [0,4194304] 0 2024-02-28T23:07:03.756 INFO:tasks.workunit.client.0.smithi159.stdout:3/89: link d0/l3 d0/d8/l1f 0 2024-02-28T23:07:03.756 INFO:tasks.workunit.client.0.smithi159.stdout:7/78: fsync d5/fd 0 2024-02-28T23:07:03.757 INFO:tasks.workunit.client.0.smithi159.stdout:8/90: creat d2/d11/f1b x:0 0 0 2024-02-28T23:07:03.764 INFO:tasks.workunit.client.0.smithi159.stdout:2/53: truncate f6 429088 0 2024-02-28T23:07:03.769 INFO:tasks.workunit.client.0.smithi159.stdout:8/91: symlink d2/d3/l1c 0 2024-02-28T23:07:03.772 INFO:tasks.workunit.client.0.smithi159.stdout:1/50: link d6/fb d6/dc/fe 0 2024-02-28T23:07:03.776 INFO:tasks.workunit.client.0.smithi159.stdout:5/59: mknod d8/c12 0 2024-02-28T23:07:03.778 INFO:tasks.workunit.client.0.smithi159.stdout:3/90: chown d0/l1 112899 1 2024-02-28T23:07:03.780 INFO:tasks.workunit.client.0.smithi159.stdout:8/92: chown d2/lb 474 1 2024-02-28T23:07:03.781 INFO:tasks.workunit.client.0.smithi159.stdout:7/79: dwrite d5/fd [0,4194304] 0 2024-02-28T23:07:03.781 INFO:tasks.workunit.client.0.smithi159.stdout:3/91: dread - d0/f12 zero size 2024-02-28T23:07:03.781 INFO:tasks.workunit.client.0.smithi159.stdout:1/51: rename d6/fd to d6/dc/ff 0 2024-02-28T23:07:03.782 INFO:tasks.workunit.client.0.smithi159.stdout:5/60: readlink d8/ld 0 2024-02-28T23:07:03.783 INFO:tasks.workunit.client.0.smithi159.stdout:7/80: stat d5/f18 0 2024-02-28T23:07:03.786 INFO:tasks.workunit.client.0.smithi159.stdout:8/93: creat d2/d3/f1d x:0 0 0 2024-02-28T23:07:03.787 INFO:tasks.workunit.client.0.smithi159.stdout:1/52: mknod d6/c10 0 2024-02-28T23:07:03.789 INFO:tasks.workunit.client.0.smithi159.stdout:5/61: creat d8/f13 x:0 0 0 2024-02-28T23:07:03.793 INFO:tasks.workunit.client.0.smithi159.stdout:7/81: rename d5/c15 to d5/d16/d1a/c1c 0 2024-02-28T23:07:03.794 INFO:tasks.workunit.client.0.smithi159.stdout:7/82: stat d5/d16 0 2024-02-28T23:07:03.801 INFO:tasks.workunit.client.0.smithi159.stdout:5/62: link d8/f10 d8/f14 0 2024-02-28T23:07:03.804 INFO:tasks.workunit.client.0.smithi159.stdout:4/75: truncate d9/da/f13 2126207 0 2024-02-28T23:07:03.806 INFO:tasks.workunit.client.0.smithi159.stdout:7/83: creat d5/f1d x:0 0 0 2024-02-28T23:07:03.808 INFO:tasks.workunit.client.0.smithi159.stdout:5/63: write f0 [628318,117610] 0 2024-02-28T23:07:03.809 INFO:tasks.workunit.client.0.smithi159.stdout:4/76: write f5 [2425813,91999] 0 2024-02-28T23:07:03.810 INFO:tasks.workunit.client.0.smithi159.stdout:7/84: truncate d5/d16/f19 720098 0 2024-02-28T23:07:03.812 INFO:tasks.workunit.client.0.smithi159.stdout:5/64: read - d8/fb zero size 2024-02-28T23:07:03.814 INFO:tasks.workunit.client.0.smithi159.stdout:8/94: dwrite d2/fd [0,4194304] 0 2024-02-28T23:07:03.814 INFO:tasks.workunit.client.0.smithi159.stdout:7/85: write d5/f12 [464860,109597] 0 2024-02-28T23:07:03.815 INFO:tasks.workunit.client.0.smithi159.stdout:2/54: write f6 [797133,44905] 0 2024-02-28T23:07:03.817 INFO:tasks.workunit.client.0.smithi159.stdout:7/86: dread - d5/f1d zero size 2024-02-28T23:07:03.817 INFO:tasks.workunit.client.0.smithi159.stdout:2/55: dread - d9/de/ff zero size 2024-02-28T23:07:03.819 INFO:tasks.workunit.client.0.smithi159.stdout:7/87: chown d5/d16/d1a 3 1 2024-02-28T23:07:03.824 INFO:tasks.workunit.client.0.smithi159.stdout:5/65: creat d8/f15 x:0 0 0 2024-02-28T23:07:03.827 INFO:tasks.workunit.client.0.smithi159.stdout:7/88: truncate f3 2612473 0 2024-02-28T23:07:03.829 INFO:tasks.workunit.client.0.smithi159.stdout:5/66: unlink d8/ld 0 2024-02-28T23:07:03.832 INFO:tasks.workunit.client.0.smithi159.stdout:2/56: fsync f6 0 2024-02-28T23:07:03.834 INFO:tasks.workunit.client.0.smithi159.stdout:5/67: fdatasync d8/f14 0 2024-02-28T23:07:03.834 INFO:tasks.workunit.client.0.smithi159.stdout:4/77: stat d9/da/f13 0 2024-02-28T23:07:03.844 INFO:tasks.workunit.client.0.smithi159.stdout:7/89: getdents d5/d10 0 2024-02-28T23:07:03.844 INFO:tasks.workunit.client.0.smithi159.stdout:5/68: mkdir d8/d16 0 2024-02-28T23:07:03.848 INFO:tasks.workunit.client.0.smithi159.stdout:8/95: dwrite d2/d3/f14 [0,4194304] 0 2024-02-28T23:07:03.850 INFO:tasks.workunit.client.0.smithi159.stdout:2/57: dread f6 [0,4194304] 0 2024-02-28T23:07:03.850 INFO:tasks.workunit.client.0.smithi159.stdout:7/90: write d5/d10/f11 [3696687,37763] 0 2024-02-28T23:07:03.852 INFO:tasks.workunit.client.0.smithi159.stdout:5/69: creat d8/f17 x:0 0 0 2024-02-28T23:07:03.855 INFO:tasks.workunit.client.0.smithi159.stdout:2/58: readlink d9/la 0 2024-02-28T23:07:03.855 INFO:tasks.workunit.client.0.smithi159.stdout:5/70: readlink l5 0 2024-02-28T23:07:03.856 INFO:tasks.workunit.client.0.smithi159.stdout:3/92: dwrite d0/d8/f1d [0,4194304] 0 2024-02-28T23:07:03.860 INFO:tasks.workunit.client.0.smithi159.stdout:2/59: chown d9/cb 4 1 2024-02-28T23:07:03.863 INFO:tasks.workunit.client.0.smithi159.stdout:5/71: rename f7 to d8/f18 0 2024-02-28T23:07:03.865 INFO:tasks.workunit.client.0.smithi159.stdout:3/93: write d0/f12 [824718,120206] 0 2024-02-28T23:07:03.867 INFO:tasks.workunit.client.0.smithi159.stdout:2/60: creat d9/f11 x:0 0 0 2024-02-28T23:07:03.869 INFO:tasks.workunit.client.0.smithi159.stdout:7/91: dread f3 [0,4194304] 0 2024-02-28T23:07:03.869 INFO:tasks.workunit.client.0.smithi159.stdout:5/72: write d8/f11 [2269132,15544] 0 2024-02-28T23:07:03.877 INFO:tasks.workunit.client.0.smithi159.stdout:7/92: creat d5/f1e x:0 0 0 2024-02-28T23:07:03.884 INFO:tasks.workunit.client.0.smithi159.stdout:8/96: dread d2/d11/f12 [0,4194304] 0 2024-02-28T23:07:03.887 INFO:tasks.workunit.client.0.smithi159.stdout:6/55: sync 2024-02-28T23:07:03.888 INFO:tasks.workunit.client.0.smithi159.stdout:5/73: truncate d8/f11 3966703 0 2024-02-28T23:07:03.892 INFO:tasks.workunit.client.0.smithi159.stdout:6/56: fdatasync d0/fd 0 2024-02-28T23:07:03.892 INFO:tasks.workunit.client.0.smithi159.stdout:8/97: write d2/d11/f1b [835987,114987] 0 2024-02-28T23:07:03.894 INFO:tasks.workunit.client.0.smithi159.stdout:4/78: dwrite d9/da/f13 [0,4194304] 0 2024-02-28T23:07:03.894 INFO:tasks.workunit.client.0.smithi159.stdout:5/74: mkdir d8/d19 0 2024-02-28T23:07:03.897 INFO:tasks.workunit.client.0.smithi159.stdout:3/94: dwrite d0/d8/f1d [0,4194304] 0 2024-02-28T23:07:03.898 INFO:tasks.workunit.client.0.smithi159.stdout:5/75: stat f0 0 2024-02-28T23:07:03.901 INFO:tasks.workunit.client.0.smithi159.stdout:8/98: symlink d2/d3/l1e 0 2024-02-28T23:07:03.903 INFO:tasks.workunit.client.0.smithi159.stdout:5/76: unlink f4 0 2024-02-28T23:07:03.905 INFO:tasks.workunit.client.0.smithi159.stdout:2/61: dwrite d9/f11 [0,4194304] 0 2024-02-28T23:07:03.908 INFO:tasks.workunit.client.0.smithi159.stdout:2/62: write d9/f11 [4605856,57039] 0 2024-02-28T23:07:03.909 INFO:tasks.workunit.client.0.smithi159.stdout:3/95: mknod d0/c20 0 2024-02-28T23:07:03.910 INFO:tasks.workunit.client.0.smithi159.stdout:2/63: stat d9/cc 0 2024-02-28T23:07:03.910 INFO:tasks.workunit.client.0.smithi159.stdout:8/99: write d2/fd [940035,61920] 0 2024-02-28T23:07:03.911 INFO:tasks.workunit.client.0.smithi159.stdout:4/79: creat d9/f18 x:0 0 0 2024-02-28T23:07:03.914 INFO:tasks.workunit.client.0.smithi159.stdout:5/77: creat d8/d16/f1a x:0 0 0 2024-02-28T23:07:03.914 INFO:tasks.workunit.client.0.smithi159.stdout:3/96: rmdir d0/d8 39 2024-02-28T23:07:03.917 INFO:tasks.workunit.client.0.smithi159.stdout:8/100: readlink d2/d3/l7 0 2024-02-28T23:07:03.917 INFO:tasks.workunit.client.0.smithi159.stdout:2/64: read f8 [3187158,9511] 0 2024-02-28T23:07:03.918 INFO:tasks.workunit.client.0.smithi159.stdout:5/78: write d8/f15 [266498,51301] 0 2024-02-28T23:07:03.919 INFO:tasks.workunit.client.0.smithi159.stdout:6/57: dread d0/f7 [0,4194304] 0 2024-02-28T23:07:03.920 INFO:tasks.workunit.client.0.smithi159.stdout:3/97: chown d0/d6/lf 0 1 2024-02-28T23:07:03.925 INFO:tasks.workunit.client.0.smithi159.stdout:8/101: stat d2/d3/l1c 0 2024-02-28T23:07:03.928 INFO:tasks.workunit.client.0.smithi159.stdout:3/98: read - d0/d8/f1e zero size 2024-02-28T23:07:03.929 INFO:tasks.workunit.client.0.smithi159.stdout:2/65: link d9/cd d9/de/c12 0 2024-02-28T23:07:03.931 INFO:tasks.workunit.client.0.smithi159.stdout:6/58: mkdir d0/d10/d11/d14 0 2024-02-28T23:07:03.933 INFO:tasks.workunit.client.0.smithi159.stdout:2/66: mkdir d9/de/d13 0 2024-02-28T23:07:03.934 INFO:tasks.workunit.client.0.smithi159.stdout:6/59: write d0/fd [1800952,118680] 0 2024-02-28T23:07:03.938 INFO:tasks.workunit.client.0.smithi159.stdout:8/102: rename d2/f19 to d2/d3/f1f 0 2024-02-28T23:07:03.938 INFO:tasks.workunit.client.0.smithi159.stdout:3/99: mkdir d0/d6/d19/d21 0 2024-02-28T23:07:03.940 INFO:tasks.workunit.client.0.smithi159.stdout:8/103: stat d2/d11 0 2024-02-28T23:07:03.941 INFO:tasks.workunit.client.0.smithi159.stdout:6/60: mknod d0/c15 0 2024-02-28T23:07:03.947 INFO:tasks.workunit.client.0.smithi159.stdout:2/67: getdents d9/de/d13 0 2024-02-28T23:07:03.948 INFO:tasks.workunit.client.0.smithi159.stdout:6/61: mkdir d0/d10/d11/d16 0 2024-02-28T23:07:03.948 INFO:tasks.workunit.client.0.smithi159.stdout:8/104: creat d2/d3/f20 x:0 0 0 2024-02-28T23:07:03.951 INFO:tasks.workunit.client.0.smithi159.stdout:4/80: dwrite f5 [0,4194304] 0 2024-02-28T23:07:03.957 INFO:tasks.workunit.client.0.smithi159.stdout:6/62: write d0/fd [669145,36044] 0 2024-02-28T23:07:03.962 INFO:tasks.workunit.client.0.smithi159.stdout:8/105: mkdir d2/d21 0 2024-02-28T23:07:03.964 INFO:tasks.workunit.client.0.smithi159.stdout:2/68: creat d9/de/d13/f14 x:0 0 0 2024-02-28T23:07:03.968 INFO:tasks.workunit.client.0.smithi159.stdout:8/106: readlink d2/d3/l1c 0 2024-02-28T23:07:03.976 INFO:tasks.workunit.client.0.smithi159.stdout:8/107: stat d2/d3/l1e 0 2024-02-28T23:07:03.980 INFO:tasks.workunit.client.0.smithi159.stdout:2/69: symlink d9/de/d13/l15 0 2024-02-28T23:07:03.980 INFO:tasks.workunit.client.0.smithi159.stdout:3/100: dwrite d0/d8/f1d [0,4194304] 0 2024-02-28T23:07:03.986 INFO:tasks.workunit.client.0.smithi159.stdout:2/70: read f6 [657069,85432] 0 2024-02-28T23:07:03.986 INFO:tasks.workunit.client.0.smithi159.stdout:5/79: dwrite d8/f10 [0,4194304] 0 2024-02-28T23:07:03.993 INFO:tasks.workunit.client.0.smithi159.stdout:3/101: chown d0/l1a 7 1 2024-02-28T23:07:03.995 INFO:tasks.workunit.client.0.smithi159.stdout:2/71: truncate d9/de/ff 1029816 0 2024-02-28T23:07:03.997 INFO:tasks.workunit.client.0.smithi159.stdout:4/81: dwrite f5 [0,4194304] 0 2024-02-28T23:07:03.999 INFO:tasks.workunit.client.0.smithi159.stdout:8/108: rmdir d2/d11 39 2024-02-28T23:07:04.002 INFO:tasks.workunit.client.0.smithi159.stdout:2/72: dread - d9/de/d13/f14 zero size 2024-02-28T23:07:04.003 INFO:tasks.workunit.client.0.smithi159.stdout:2/73: read f6 [667806,22084] 0 2024-02-28T23:07:04.012 INFO:tasks.workunit.client.0.smithi159.stdout:3/102: creat d0/d8/f22 x:0 0 0 2024-02-28T23:07:04.018 INFO:tasks.workunit.client.0.smithi159.stdout:2/74: creat d9/f16 x:0 0 0 2024-02-28T23:07:04.019 INFO:tasks.workunit.client.0.smithi159.stdout:5/80: symlink d8/d19/l1b 0 2024-02-28T23:07:04.025 INFO:tasks.workunit.client.0.smithi159.stdout:6/63: truncate d0/f8 370620 0 2024-02-28T23:07:04.027 INFO:tasks.workunit.client.0.smithi159.stdout:2/75: readlink d9/de/d13/l15 0 2024-02-28T23:07:04.027 INFO:tasks.workunit.client.0.smithi159.stdout:4/82: creat d9/f19 x:0 0 0 2024-02-28T23:07:04.028 INFO:tasks.workunit.client.0.smithi159.stdout:5/81: creat d8/d19/f1c x:0 0 0 2024-02-28T23:07:04.030 INFO:tasks.workunit.client.0.smithi159.stdout:6/64: truncate d0/fa 1047096 0 2024-02-28T23:07:04.030 INFO:tasks.workunit.client.0.smithi159.stdout:2/76: creat d9/de/f17 x:0 0 0 2024-02-28T23:07:04.032 INFO:tasks.workunit.client.0.smithi159.stdout:8/109: dwrite d2/fd [0,4194304] 0 2024-02-28T23:07:04.032 INFO:tasks.workunit.client.0.smithi159.stdout:4/83: symlink d9/l1a 0 2024-02-28T23:07:04.035 INFO:tasks.workunit.client.0.smithi159.stdout:2/77: symlink d9/de/d13/l18 0 2024-02-28T23:07:04.041 INFO:tasks.workunit.client.0.smithi159.stdout:4/84: write d9/da/fc [5586564,4993] 0 2024-02-28T23:07:04.041 INFO:tasks.workunit.client.0.smithi159.stdout:6/65: chown d0/f8 82686421 1 2024-02-28T23:07:04.041 INFO:tasks.workunit.client.0.smithi159.stdout:2/78: write f8 [1230903,45288] 0 2024-02-28T23:07:04.043 INFO:tasks.workunit.client.0.smithi159.stdout:6/66: chown d0/d10 5 1 2024-02-28T23:07:04.043 INFO:tasks.workunit.client.0.smithi159.stdout:2/79: fsync f6 0 2024-02-28T23:07:04.047 INFO:tasks.workunit.client.0.smithi159.stdout:3/103: truncate d0/d8/f1d 4347313 0 2024-02-28T23:07:04.048 INFO:tasks.workunit.client.0.smithi159.stdout:2/80: write f6 [590178,40978] 0 2024-02-28T23:07:04.051 INFO:tasks.workunit.client.0.smithi159.stdout:2/81: write d9/de/f17 [321353,121809] 0 2024-02-28T23:07:04.055 INFO:tasks.workunit.client.0.smithi159.stdout:5/82: dread f6 [0,4194304] 0 2024-02-28T23:07:04.057 INFO:tasks.workunit.client.0.smithi159.stdout:2/82: creat d9/de/f19 x:0 0 0 2024-02-28T23:07:04.058 INFO:tasks.workunit.client.0.smithi159.stdout:6/67: link d0/l5 d0/d10/d11/d16/l17 0 2024-02-28T23:07:04.061 INFO:tasks.workunit.client.0.smithi159.stdout:5/83: mknod d8/d19/c1d 0 2024-02-28T23:07:04.063 INFO:tasks.workunit.client.0.smithi159.stdout:6/68: creat d0/d10/f18 x:0 0 0 2024-02-28T23:07:04.064 INFO:tasks.workunit.client.0.smithi159.stdout:4/85: dwrite f5 [0,4194304] 0 2024-02-28T23:07:04.064 INFO:tasks.workunit.client.0.smithi159.stdout:6/69: chown d0 0 1 2024-02-28T23:07:04.065 INFO:tasks.workunit.client.0.smithi159.stdout:0/86: sync 2024-02-28T23:07:04.066 INFO:tasks.workunit.client.0.smithi159.stdout:3/104: rmdir d0 39 2024-02-28T23:07:04.066 INFO:tasks.workunit.client.0.smithi159.stdout:2/83: dread d9/de/ff [0,4194304] 0 2024-02-28T23:07:04.068 INFO:tasks.workunit.client.0.smithi159.stdout:0/87: write d0/d5/ff [5267867,70113] 0 2024-02-28T23:07:04.068 INFO:tasks.workunit.client.0.smithi159.stdout:5/84: creat d8/d16/f1e x:0 0 0 2024-02-28T23:07:04.069 INFO:tasks.workunit.client.0.smithi159.stdout:8/110: truncate d2/d11/f12 1287979 0 2024-02-28T23:07:04.082 INFO:tasks.workunit.client.0.smithi159.stdout:8/111: symlink d2/d3/l22 0 2024-02-28T23:07:04.089 INFO:tasks.workunit.client.0.smithi159.stdout:2/84: rename d9/cc to d9/de/c1a 0 2024-02-28T23:07:04.092 INFO:tasks.workunit.client.0.smithi159.stdout:4/86: link d9/da/f13 d9/f1b 0 2024-02-28T23:07:04.094 INFO:tasks.workunit.client.0.smithi159.stdout:3/105: creat d0/f23 x:0 0 0 2024-02-28T23:07:04.094 INFO:tasks.workunit.client.0.smithi159.stdout:6/70: dwrite d0/fe [4194304,4194304] 0 2024-02-28T23:07:04.095 INFO:tasks.workunit.client.0.smithi159.stdout:8/112: creat d2/d3/d18/f23 x:0 0 0 2024-02-28T23:07:04.096 INFO:tasks.workunit.client.0.smithi159.stdout:2/85: rename d9 to d9/de/d1b 22 2024-02-28T23:07:04.103 INFO:tasks.workunit.client.0.smithi159.stdout:0/88: dwrite d0/de/d11/f21 [0,4194304] 0 2024-02-28T23:07:04.106 INFO:tasks.workunit.client.0.smithi159.stdout:8/113: unlink d2/fa 0 2024-02-28T23:07:04.110 INFO:tasks.workunit.client.0.smithi159.stdout:6/71: creat d0/d10/d11/f19 x:0 0 0 2024-02-28T23:07:04.114 INFO:tasks.workunit.client.0.smithi159.stdout:2/86: symlink d9/de/d13/l1c 0 2024-02-28T23:07:04.114 INFO:tasks.workunit.client.0.smithi159.stdout:5/85: dwrite d8/f18 [0,4194304] 0 2024-02-28T23:07:04.117 INFO:tasks.workunit.client.0.smithi159.stdout:5/86: write f0 [1284091,53922] 0 2024-02-28T23:07:04.117 INFO:tasks.workunit.client.0.smithi159.stdout:0/89: mknod d0/d5/d14/c26 0 2024-02-28T23:07:04.119 INFO:tasks.workunit.client.0.smithi159.stdout:5/87: write d8/fb [955592,9978] 0 2024-02-28T23:07:04.123 INFO:tasks.workunit.client.0.smithi159.stdout:5/88: write d8/d19/f1c [379515,72034] 0 2024-02-28T23:07:04.123 INFO:tasks.workunit.client.0.smithi159.stdout:2/87: creat d9/f1d x:0 0 0 2024-02-28T23:07:04.129 INFO:tasks.workunit.client.0.smithi159.stdout:5/89: creat d8/d19/f1f x:0 0 0 2024-02-28T23:07:04.135 INFO:tasks.workunit.client.0.smithi159.stdout:0/90: creat d0/f27 x:0 0 0 2024-02-28T23:07:04.136 INFO:tasks.workunit.client.0.smithi159.stdout:5/90: fdatasync d8/d19/f1f 0 2024-02-28T23:07:04.138 INFO:tasks.workunit.client.0.smithi159.stdout:4/87: truncate d9/da/f12 687722 0 2024-02-28T23:07:04.140 INFO:tasks.workunit.client.0.smithi159.stdout:5/91: stat d8/f11 0 2024-02-28T23:07:04.150 INFO:tasks.workunit.client.0.smithi159.stdout:0/91: symlink d0/de/d11/l28 0 2024-02-28T23:07:04.152 INFO:tasks.workunit.client.0.smithi159.stdout:8/114: dwrite d2/d3/d18/f23 [0,4194304] 0 2024-02-28T23:07:04.156 INFO:tasks.workunit.client.0.smithi159.stdout:4/88: getdents d9 0 2024-02-28T23:07:04.160 INFO:tasks.workunit.client.0.smithi159.stdout:6/72: dwrite d0/fb [0,4194304] 0 2024-02-28T23:07:04.167 INFO:tasks.workunit.client.0.smithi159.stdout:0/92: write d0/fb [4840059,128981] 0 2024-02-28T23:07:04.169 INFO:tasks.workunit.client.0.smithi159.stdout:3/106: dwrite d0/d6/f13 [0,4194304] 0 2024-02-28T23:07:04.169 INFO:tasks.workunit.client.0.smithi159.stdout:8/115: symlink d2/d21/l24 0 2024-02-28T23:07:04.171 INFO:tasks.workunit.client.0.smithi159.stdout:2/88: dwrite f7 [0,4194304] 0 2024-02-28T23:07:04.173 INFO:tasks.workunit.client.0.smithi159.stdout:5/92: link d8/c9 d8/d19/c20 0 2024-02-28T23:07:04.176 INFO:tasks.workunit.client.0.smithi159.stdout:5/93: readlink l5 0 2024-02-28T23:07:04.184 INFO:tasks.workunit.client.0.smithi159.stdout:6/73: read d0/fd [141903,78473] 0 2024-02-28T23:07:04.184 INFO:tasks.workunit.client.0.smithi159.stdout:5/94: fdatasync d8/fb 0 2024-02-28T23:07:04.185 INFO:tasks.workunit.client.0.smithi159.stdout:8/116: symlink d2/d3/d18/l25 0 2024-02-28T23:07:04.186 INFO:tasks.workunit.client.0.smithi159.stdout:5/95: fdatasync d8/d19/f1f 0 2024-02-28T23:07:04.191 INFO:tasks.workunit.client.0.smithi159.stdout:8/117: mkdir d2/d21/d26 0 2024-02-28T23:07:04.193 INFO:tasks.workunit.client.0.smithi159.stdout:8/118: fsync d2/d3/d18/f23 0 2024-02-28T23:07:04.194 INFO:tasks.workunit.client.0.smithi159.stdout:5/96: creat d8/f21 x:0 0 0 2024-02-28T23:07:04.196 INFO:tasks.workunit.client.0.smithi159.stdout:3/107: link d0/d8/l17 d0/l24 0 2024-02-28T23:07:04.197 INFO:tasks.workunit.client.0.smithi159.stdout:9/68: sync 2024-02-28T23:07:04.197 INFO:tasks.workunit.client.0.smithi159.stdout:1/53: sync 2024-02-28T23:07:04.198 INFO:tasks.workunit.client.0.smithi159.stdout:7/93: sync 2024-02-28T23:07:04.200 INFO:tasks.workunit.client.0.smithi159.stdout:7/94: creat d5/d16/f1f x:0 0 0 2024-02-28T23:07:04.203 INFO:tasks.workunit.client.0.smithi159.stdout:1/54: fdatasync d6/fb 0 2024-02-28T23:07:04.203 INFO:tasks.workunit.client.0.smithi159.stdout:3/108: symlink d0/l25 0 2024-02-28T23:07:04.206 INFO:tasks.workunit.client.0.smithi159.stdout:2/89: dread d9/f11 [0,4194304] 0 2024-02-28T23:07:04.207 INFO:tasks.workunit.client.0.smithi159.stdout:0/93: dwrite d0/f3 [0,4194304] 0 2024-02-28T23:07:04.207 INFO:tasks.workunit.client.0.smithi159.stdout:9/69: truncate d4/f13 809867 0 2024-02-28T23:07:04.208 INFO:tasks.workunit.client.0.smithi159.stdout:7/95: write d5/fe [912566,100770] 0 2024-02-28T23:07:04.210 INFO:tasks.workunit.client.0.smithi159.stdout:3/109: unlink d0/l3 0 2024-02-28T23:07:04.219 INFO:tasks.workunit.client.0.smithi159.stdout:2/90: unlink d9/de/f19 0 2024-02-28T23:07:04.220 INFO:tasks.workunit.client.0.smithi159.stdout:7/96: dread - d5/f1e zero size 2024-02-28T23:07:04.230 INFO:tasks.workunit.client.0.smithi159.stdout:4/89: truncate d9/da/fc 992190 0 2024-02-28T23:07:04.232 INFO:tasks.workunit.client.0.smithi159.stdout:2/91: write f8 [1363164,73849] 0 2024-02-28T23:07:04.234 INFO:tasks.workunit.client.0.smithi159.stdout:4/90: fdatasync d9/f19 0 2024-02-28T23:07:04.240 INFO:tasks.workunit.client.0.smithi159.stdout:3/110: creat d0/d6/d19/d21/f26 x:0 0 0 2024-02-28T23:07:04.248 INFO:tasks.workunit.client.0.smithi159.stdout:2/92: chown f6 3 1 2024-02-28T23:07:04.253 INFO:tasks.workunit.client.0.smithi159.stdout:0/94: getdents d0/de 0 2024-02-28T23:07:04.259 INFO:tasks.workunit.client.0.smithi159.stdout:4/91: mkdir d9/da/d1c 0 2024-02-28T23:07:04.260 INFO:tasks.workunit.client.0.smithi159.stdout:8/119: dwrite d2/d3/f13 [0,4194304] 0 2024-02-28T23:07:04.260 INFO:tasks.workunit.client.0.smithi159.stdout:6/74: dwrite d0/fa [0,4194304] 0 2024-02-28T23:07:04.270 INFO:tasks.workunit.client.0.smithi159.stdout:5/97: dwrite d8/f10 [0,4194304] 0 2024-02-28T23:07:04.273 INFO:tasks.workunit.client.0.smithi159.stdout:9/70: dwrite d4/f13 [0,4194304] 0 2024-02-28T23:07:04.274 INFO:tasks.workunit.client.0.smithi159.stdout:2/93: write d9/f11 [314252,6333] 0 2024-02-28T23:07:04.279 INFO:tasks.workunit.client.0.smithi159.stdout:3/111: mknod d0/c27 0 2024-02-28T23:07:04.280 INFO:tasks.workunit.client.0.smithi159.stdout:5/98: write d8/f10 [779629,56122] 0 2024-02-28T23:07:04.281 INFO:tasks.workunit.client.0.smithi159.stdout:9/71: read - d4/f15 zero size 2024-02-28T23:07:04.282 INFO:tasks.workunit.client.0.smithi159.stdout:2/94: truncate f6 1812164 0 2024-02-28T23:07:04.282 INFO:tasks.workunit.client.0.smithi159.stdout:1/55: dwrite d6/dc/ff [0,4194304] 0 2024-02-28T23:07:04.288 INFO:tasks.workunit.client.0.smithi159.stdout:7/97: dwrite d5/d10/f11 [0,4194304] 0 2024-02-28T23:07:04.289 INFO:tasks.workunit.client.0.smithi159.stdout:8/120: mknod d2/c27 0 2024-02-28T23:07:04.289 INFO:tasks.workunit.client.0.smithi159.stdout:6/75: creat d0/d10/d11/d16/f1a x:0 0 0 2024-02-28T23:07:04.292 INFO:tasks.workunit.client.0.smithi159.stdout:3/112: fdatasync d0/d6/d19/d21/f26 0 2024-02-28T23:07:04.293 INFO:tasks.workunit.client.0.smithi159.stdout:6/76: chown d0/fe 82478987 1 2024-02-28T23:07:04.296 INFO:tasks.workunit.client.0.smithi159.stdout:7/98: truncate d5/d16/f1f 639187 0 2024-02-28T23:07:04.297 INFO:tasks.workunit.client.0.smithi159.stdout:4/92: link d9/f19 d9/da/d1c/f1d 0 2024-02-28T23:07:04.299 INFO:tasks.workunit.client.0.smithi159.stdout:2/95: symlink d9/l1e 0 2024-02-28T23:07:04.302 INFO:tasks.workunit.client.0.smithi159.stdout:0/95: dwrite d0/de/d11/f21 [0,4194304] 0 2024-02-28T23:07:04.312 INFO:tasks.workunit.client.0.smithi159.stdout:1/56: creat d6/f11 x:0 0 0 2024-02-28T23:07:04.312 INFO:tasks.workunit.client.0.smithi159.stdout:0/96: read d0/f1e [163853,118566] 0 2024-02-28T23:07:04.314 INFO:tasks.workunit.client.0.smithi159.stdout:3/113: symlink d0/d8/l28 0 2024-02-28T23:07:04.316 INFO:tasks.workunit.client.0.smithi159.stdout:3/114: stat d0/d6/d19/d21/f26 0 2024-02-28T23:07:04.320 INFO:tasks.workunit.client.0.smithi159.stdout:7/99: fsync f3 0 2024-02-28T23:07:04.323 INFO:tasks.workunit.client.0.smithi159.stdout:8/121: mknod d2/c28 0 2024-02-28T23:07:04.324 INFO:tasks.workunit.client.0.smithi159.stdout:4/93: creat d9/f1e x:0 0 0 2024-02-28T23:07:04.328 INFO:tasks.workunit.client.0.smithi159.stdout:0/97: creat d0/de/f29 x:0 0 0 2024-02-28T23:07:04.330 INFO:tasks.workunit.client.0.smithi159.stdout:1/57: rename d6/dc to d6/d12 0 2024-02-28T23:07:04.337 INFO:tasks.workunit.client.0.smithi159.stdout:7/100: truncate d5/f1e 630015 0 2024-02-28T23:07:04.340 INFO:tasks.workunit.client.0.smithi159.stdout:9/72: link d4/lf d4/l16 0 2024-02-28T23:07:04.340 INFO:tasks.workunit.client.0.smithi159.stdout:3/115: creat d0/d6/d19/d21/f29 x:0 0 0 2024-02-28T23:07:04.341 INFO:tasks.workunit.client.0.smithi159.stdout:8/122: creat d2/d3/f29 x:0 0 0 2024-02-28T23:07:04.344 INFO:tasks.workunit.client.0.smithi159.stdout:0/98: read d0/d5/ff [4710529,93535] 0 2024-02-28T23:07:04.346 INFO:tasks.workunit.client.0.smithi159.stdout:2/96: dwrite d9/f16 [0,4194304] 0 2024-02-28T23:07:04.347 INFO:tasks.workunit.client.0.smithi159.stdout:5/99: dwrite f6 [0,4194304] 0 2024-02-28T23:07:04.352 INFO:tasks.workunit.client.0.smithi159.stdout:9/73: mkdir d4/d17 0 2024-02-28T23:07:04.353 INFO:tasks.workunit.client.0.smithi159.stdout:3/116: chown d0/c16 18709915 1 2024-02-28T23:07:04.356 INFO:tasks.workunit.client.0.smithi159.stdout:0/99: fsync d0/d5/d14/f22 0 2024-02-28T23:07:04.360 INFO:tasks.workunit.client.0.smithi159.stdout:9/74: readlink d4/lc 0 2024-02-28T23:07:04.364 INFO:tasks.workunit.client.0.smithi159.stdout:9/75: readlink l3 0 2024-02-28T23:07:04.366 INFO:tasks.workunit.client.0.smithi159.stdout:1/58: dread d6/fb [0,4194304] 0 2024-02-28T23:07:04.370 INFO:tasks.workunit.client.0.smithi159.stdout:1/59: rename d6 to d6/d12/d13 22 2024-02-28T23:07:04.371 INFO:tasks.workunit.client.0.smithi159.stdout:0/100: write d0/de/f1f [4189026,81068] 0 2024-02-28T23:07:04.372 INFO:tasks.workunit.client.0.smithi159.stdout:6/77: dwrite d0/f7 [0,4194304] 0 2024-02-28T23:07:04.372 INFO:tasks.workunit.client.0.smithi159.stdout:3/117: symlink d0/d6/d19/d21/l2a 0 2024-02-28T23:07:04.373 INFO:tasks.workunit.client.0.smithi159.stdout:8/123: link d2/d3/f20 d2/d3/f2a 0 2024-02-28T23:07:04.377 INFO:tasks.workunit.client.0.smithi159.stdout:0/101: chown d0/de/d11 7790 1 2024-02-28T23:07:04.378 INFO:tasks.workunit.client.0.smithi159.stdout:6/78: chown d0/fb 597716 1 2024-02-28T23:07:04.379 INFO:tasks.workunit.client.0.smithi159.stdout:8/124: chown d2/d3/f10 326535001 1 2024-02-28T23:07:04.381 INFO:tasks.workunit.client.0.smithi159.stdout:1/60: creat d6/d12/f14 x:0 0 0 2024-02-28T23:07:04.383 INFO:tasks.workunit.client.0.smithi159.stdout:4/94: rename d9/fe to d9/f1f 0 2024-02-28T23:07:04.384 INFO:tasks.workunit.client.0.smithi159.stdout:2/97: dwrite f7 [0,4194304] 0 2024-02-28T23:07:04.384 INFO:tasks.workunit.client.0.smithi159.stdout:8/125: write d2/d3/f1d [190828,84759] 0 2024-02-28T23:07:04.388 INFO:tasks.workunit.client.0.smithi159.stdout:7/101: truncate d5/f12 342627 0 2024-02-28T23:07:04.390 INFO:tasks.workunit.client.0.smithi159.stdout:9/76: dread d4/fe [0,4194304] 0 2024-02-28T23:07:04.392 INFO:tasks.workunit.client.0.smithi159.stdout:4/95: write f5 [5021593,64013] 0 2024-02-28T23:07:04.399 INFO:tasks.workunit.client.0.smithi159.stdout:9/77: chown d4/l16 997432922 1 2024-02-28T23:07:04.400 INFO:tasks.workunit.client.0.smithi159.stdout:5/100: truncate d8/f18 1584467 0 2024-02-28T23:07:04.401 INFO:tasks.workunit.client.0.smithi159.stdout:9/78: dread - d4/f15 zero size 2024-02-28T23:07:04.403 INFO:tasks.workunit.client.0.smithi159.stdout:1/61: rmdir d6/d12 39 2024-02-28T23:07:04.404 INFO:tasks.workunit.client.0.smithi159.stdout:9/79: chown c1 1584 1 2024-02-28T23:07:04.405 INFO:tasks.workunit.client.0.smithi159.stdout:5/101: write d8/d16/f1a [989960,29861] 0 2024-02-28T23:07:04.410 INFO:tasks.workunit.client.0.smithi159.stdout:3/118: rename d0/d6/d19/d21 to d0/d2b 0 2024-02-28T23:07:04.410 INFO:tasks.workunit.client.0.smithi159.stdout:0/102: write d0/f1e [1386947,17366] 0 2024-02-28T23:07:04.414 INFO:tasks.workunit.client.0.smithi159.stdout:5/102: truncate d8/fe 36458 0 2024-02-28T23:07:04.416 INFO:tasks.workunit.client.0.smithi159.stdout:9/80: unlink d4/ld 0 2024-02-28T23:07:04.419 INFO:tasks.workunit.client.0.smithi159.stdout:4/96: dread - d9/f17 zero size 2024-02-28T23:07:04.419 INFO:tasks.workunit.client.0.smithi159.stdout:8/126: truncate d2/d3/d18/f23 1395383 0 2024-02-28T23:07:04.420 INFO:tasks.workunit.client.0.smithi159.stdout:5/103: rmdir d8/d19 39 2024-02-28T23:07:04.422 INFO:tasks.workunit.client.0.smithi159.stdout:2/98: dwrite d9/f11 [0,4194304] 0 2024-02-28T23:07:04.422 INFO:tasks.workunit.client.0.smithi159.stdout:3/119: truncate d0/d6/f13 5183885 0 2024-02-28T23:07:04.423 INFO:tasks.workunit.client.0.smithi159.stdout:0/103: write d0/de/f29 [16364,89069] 0 2024-02-28T23:07:04.425 INFO:tasks.workunit.client.0.smithi159.stdout:6/79: rename d0/d10/d11/d16 to d0/d1b 0 2024-02-28T23:07:04.426 INFO:tasks.workunit.client.0.smithi159.stdout:3/120: readlink d0/d8/l28 0 2024-02-28T23:07:04.426 INFO:tasks.workunit.client.0.smithi159.stdout:2/99: stat d9/la 0 2024-02-28T23:07:04.428 INFO:tasks.workunit.client.0.smithi159.stdout:3/121: dread - d0/f23 zero size 2024-02-28T23:07:04.431 INFO:tasks.workunit.client.0.smithi159.stdout:8/127: creat d2/d11/f2b x:0 0 0 2024-02-28T23:07:04.436 INFO:tasks.workunit.client.0.smithi159.stdout:1/62: dwrite d6/f9 [0,4194304] 0 2024-02-28T23:07:04.440 INFO:tasks.workunit.client.0.smithi159.stdout:2/100: stat d9/cd 0 2024-02-28T23:07:04.442 INFO:tasks.workunit.client.0.smithi159.stdout:0/104: dread d0/f3 [0,4194304] 0 2024-02-28T23:07:04.444 INFO:tasks.workunit.client.0.smithi159.stdout:4/97: dread d9/f1f [0,4194304] 0 2024-02-28T23:07:04.444 INFO:tasks.workunit.client.0.smithi159.stdout:3/122: symlink d0/d8/l2c 0 2024-02-28T23:07:04.454 INFO:tasks.workunit.client.0.smithi159.stdout:8/128: write d2/d11/f12 [651680,122304] 0 2024-02-28T23:07:04.455 INFO:tasks.workunit.client.0.smithi159.stdout:5/104: mknod d8/c22 0 2024-02-28T23:07:04.458 INFO:tasks.workunit.client.0.smithi159.stdout:5/105: stat d8/d16/f1e 0 2024-02-28T23:07:04.458 INFO:tasks.workunit.client.0.smithi159.stdout:9/81: write d4/f7 [3279853,88926] 0 2024-02-28T23:07:04.461 INFO:tasks.workunit.client.0.smithi159.stdout:2/101: rmdir d9 39 2024-02-28T23:07:04.463 INFO:tasks.workunit.client.0.smithi159.stdout:0/105: mknod d0/d5/d14/c2a 0 2024-02-28T23:07:04.470 INFO:tasks.workunit.client.0.smithi159.stdout:9/82: creat d4/f18 x:0 0 0 2024-02-28T23:07:04.470 INFO:tasks.workunit.client.0.smithi159.stdout:5/106: chown d8/d19/l1b 28941 1 2024-02-28T23:07:04.473 INFO:tasks.workunit.client.0.smithi159.stdout:5/107: stat d8/f11 0 2024-02-28T23:07:04.473 INFO:tasks.workunit.client.0.smithi159.stdout:8/129: dwrite d2/d3/f1d [0,4194304] 0 2024-02-28T23:07:04.474 INFO:tasks.workunit.client.0.smithi159.stdout:5/108: stat f6 0 2024-02-28T23:07:04.474 INFO:tasks.workunit.client.0.smithi159.stdout:0/106: creat d0/de/f2b x:0 0 0 2024-02-28T23:07:04.476 INFO:tasks.workunit.client.0.smithi159.stdout:9/83: mkdir d4/d19 0 2024-02-28T23:07:04.477 INFO:tasks.workunit.client.0.smithi159.stdout:2/102: dread - d9/de/d13/f14 zero size 2024-02-28T23:07:04.477 INFO:tasks.workunit.client.0.smithi159.stdout:6/80: link d0/l5 d0/d10/d11/d14/l1c 0 2024-02-28T23:07:04.480 INFO:tasks.workunit.client.0.smithi159.stdout:3/123: getdents d0 0 2024-02-28T23:07:04.481 INFO:tasks.workunit.client.0.smithi159.stdout:5/109: mkdir d8/d19/d23 0 2024-02-28T23:07:04.486 INFO:tasks.workunit.client.0.smithi159.stdout:4/98: dread d9/da/f12 [0,4194304] 0 2024-02-28T23:07:04.487 INFO:tasks.workunit.client.0.smithi159.stdout:1/63: dwrite d6/d12/ff [0,4194304] 0 2024-02-28T23:07:04.490 INFO:tasks.workunit.client.0.smithi159.stdout:9/84: rename c2 to d4/c1a 0 2024-02-28T23:07:04.490 INFO:tasks.workunit.client.0.smithi159.stdout:2/103: truncate d9/de/d13/f14 321926 0 2024-02-28T23:07:04.493 INFO:tasks.workunit.client.0.smithi159.stdout:4/99: dread - d9/da/d1c/f1d zero size 2024-02-28T23:07:04.495 INFO:tasks.workunit.client.0.smithi159.stdout:9/85: chown d4/l16 1 1 2024-02-28T23:07:04.499 INFO:tasks.workunit.client.0.smithi159.stdout:6/81: creat d0/d10/d11/f1d x:0 0 0 2024-02-28T23:07:04.499 INFO:tasks.workunit.client.0.smithi159.stdout:3/124: chown d0/d8/l17 24493714 1 2024-02-28T23:07:04.500 INFO:tasks.workunit.client.0.smithi159.stdout:9/86: write d4/f18 [101084,93623] 0 2024-02-28T23:07:04.503 INFO:tasks.workunit.client.0.smithi159.stdout:2/104: rmdir d9/de/d13 39 2024-02-28T23:07:04.504 INFO:tasks.workunit.client.0.smithi159.stdout:1/64: fsync d6/fb 0 2024-02-28T23:07:04.504 INFO:tasks.workunit.client.0.smithi159.stdout:8/130: dwrite d2/d3/f8 [0,4194304] 0 2024-02-28T23:07:04.507 INFO:tasks.workunit.client.0.smithi159.stdout:2/105: fsync d9/f1d 0 2024-02-28T23:07:04.512 INFO:tasks.workunit.client.0.smithi159.stdout:9/87: fsync d4/f18 0 2024-02-28T23:07:04.513 INFO:tasks.workunit.client.0.smithi159.stdout:1/65: read - d6/d12/f14 zero size 2024-02-28T23:07:04.516 INFO:tasks.workunit.client.0.smithi159.stdout:0/107: dread d0/de/f1f [0,4194304] 0 2024-02-28T23:07:04.524 INFO:tasks.workunit.client.0.smithi159.stdout:0/108: write d0/de/d11/f19 [944357,121783] 0 2024-02-28T23:07:04.528 INFO:tasks.workunit.client.0.smithi159.stdout:1/66: rmdir d6 39 2024-02-28T23:07:04.528 INFO:tasks.workunit.client.0.smithi159.stdout:1/67: readlink l5 0 2024-02-28T23:07:04.544 INFO:tasks.workunit.client.0.smithi159.stdout:0/109: write d0/de/d11/f21 [868282,58359] 0 2024-02-28T23:07:04.546 INFO:tasks.workunit.client.0.smithi159.stdout:2/106: creat d9/de/d13/f1f x:0 0 0 2024-02-28T23:07:04.547 INFO:tasks.workunit.client.0.smithi159.stdout:6/82: dwrite d0/d1b/f1a [0,4194304] 0 2024-02-28T23:07:04.551 INFO:tasks.workunit.client.0.smithi159.stdout:2/107: fdatasync f7 0 2024-02-28T23:07:04.555 INFO:tasks.workunit.client.0.smithi159.stdout:9/88: dread d4/f11 [0,4194304] 0 2024-02-28T23:07:04.560 INFO:tasks.workunit.client.0.smithi159.stdout:1/68: write d6/d12/ff [3079267,31672] 0 2024-02-28T23:07:04.562 INFO:tasks.workunit.client.0.smithi159.stdout:3/125: dwrite d0/d6/f13 [4194304,4194304] 0 2024-02-28T23:07:04.562 INFO:tasks.workunit.client.0.smithi159.stdout:0/110: write d0/d5/d14/f22 [58279,15692] 0 2024-02-28T23:07:04.567 INFO:tasks.workunit.client.0.smithi159.stdout:2/108: creat d9/f20 x:0 0 0 2024-02-28T23:07:04.571 INFO:tasks.workunit.client.0.smithi159.stdout:4/100: dwrite d9/f18 [0,4194304] 0 2024-02-28T23:07:04.571 INFO:tasks.workunit.client.0.smithi159.stdout:6/83: mknod d0/d1b/c1e 0 2024-02-28T23:07:04.573 INFO:tasks.workunit.client.0.smithi159.stdout:8/131: dread d2/d3/f1d [0,4194304] 0 2024-02-28T23:07:04.576 INFO:tasks.workunit.client.0.smithi159.stdout:0/111: chown d0/cc 726366 1 2024-02-28T23:07:04.582 INFO:tasks.workunit.client.0.smithi159.stdout:6/84: creat d0/d1b/f1f x:0 0 0 2024-02-28T23:07:04.589 INFO:tasks.workunit.client.0.smithi159.stdout:1/69: write d6/d12/ff [5351856,22905] 0 2024-02-28T23:07:04.589 INFO:tasks.workunit.client.0.smithi159.stdout:3/126: creat d0/d6/d19/f2d x:0 0 0 2024-02-28T23:07:04.589 INFO:tasks.workunit.client.0.smithi159.stdout:9/89: dread d4/fe [0,4194304] 0 2024-02-28T23:07:04.590 INFO:tasks.workunit.client.0.smithi159.stdout:2/109: mknod d9/de/d13/c21 0 2024-02-28T23:07:04.596 INFO:tasks.workunit.client.0.smithi159.stdout:6/85: creat d0/d1b/f20 x:0 0 0 2024-02-28T23:07:04.598 INFO:tasks.workunit.client.0.smithi159.stdout:5/110: dwrite d8/f18 [0,4194304] 0 2024-02-28T23:07:04.599 INFO:tasks.workunit.client.0.smithi159.stdout:3/127: mknod d0/d6/d19/c2e 0 2024-02-28T23:07:04.606 INFO:tasks.workunit.client.0.smithi159.stdout:5/111: chown l5 22 1 2024-02-28T23:07:04.609 INFO:tasks.workunit.client.0.smithi159.stdout:1/70: link d6/f9 d6/d12/f15 0 2024-02-28T23:07:04.615 INFO:tasks.workunit.client.0.smithi159.stdout:4/101: truncate d9/da/f13 14136 0 2024-02-28T23:07:04.616 INFO:tasks.workunit.client.0.smithi159.stdout:5/112: truncate d8/f13 282566 0 2024-02-28T23:07:04.618 INFO:tasks.workunit.client.0.smithi159.stdout:6/86: creat d0/d10/d11/d14/f21 x:0 0 0 2024-02-28T23:07:04.623 INFO:tasks.workunit.client.0.smithi159.stdout:8/132: dwrite d2/d3/f13 [4194304,4194304] 0 2024-02-28T23:07:04.626 INFO:tasks.workunit.client.0.smithi159.stdout:5/113: rmdir d8 39 2024-02-28T23:07:04.632 INFO:tasks.workunit.client.0.smithi159.stdout:4/102: mkdir d9/d20 0 2024-02-28T23:07:04.634 INFO:tasks.workunit.client.0.smithi159.stdout:0/112: dwrite d0/de/f29 [0,4194304] 0 2024-02-28T23:07:04.635 INFO:tasks.workunit.client.0.smithi159.stdout:6/87: readlink d0/l5 0 2024-02-28T23:07:04.647 INFO:tasks.workunit.client.0.smithi159.stdout:8/133: creat d2/d3/f2c x:0 0 0 2024-02-28T23:07:04.648 INFO:tasks.workunit.client.0.smithi159.stdout:2/110: dwrite f7 [0,4194304] 0 2024-02-28T23:07:04.651 INFO:tasks.workunit.client.0.smithi159.stdout:3/128: dwrite d0/d6/d19/f2d [0,4194304] 0 2024-02-28T23:07:04.651 INFO:tasks.workunit.client.0.smithi159.stdout:5/114: mknod d8/d19/c24 0 2024-02-28T23:07:04.652 INFO:tasks.workunit.client.0.smithi159.stdout:0/113: write d0/d5/d14/f22 [1070895,116456] 0 2024-02-28T23:07:04.652 INFO:tasks.workunit.client.0.smithi159.stdout:9/90: dwrite d4/f15 [0,4194304] 0 2024-02-28T23:07:04.656 INFO:tasks.workunit.client.0.smithi159.stdout:3/129: truncate d0/d2b/f26 842693 0 2024-02-28T23:07:04.669 INFO:tasks.workunit.client.0.smithi159.stdout:9/91: unlink d4/f18 0 2024-02-28T23:07:04.672 INFO:tasks.workunit.client.0.smithi159.stdout:0/114: rmdir d0/d5 39 2024-02-28T23:07:04.680 INFO:tasks.workunit.client.0.smithi159.stdout:8/134: mkdir d2/d2d 0 2024-02-28T23:07:04.682 INFO:tasks.workunit.client.0.smithi159.stdout:6/88: rmdir d0 39 2024-02-28T23:07:04.684 INFO:tasks.workunit.client.0.smithi159.stdout:3/130: dwrite d0/f12 [0,4194304] 0 2024-02-28T23:07:04.686 INFO:tasks.workunit.client.0.smithi159.stdout:3/131: chown d0/d8/f22 1973778 1 2024-02-28T23:07:04.686 INFO:tasks.workunit.client.0.smithi159.stdout:2/111: dwrite d9/de/d13/f14 [0,4194304] 0 2024-02-28T23:07:04.692 INFO:tasks.workunit.client.0.smithi159.stdout:0/115: chown d0/d5/d14/d25 116290391 1 2024-02-28T23:07:04.704 INFO:tasks.workunit.client.0.smithi159.stdout:5/115: rename d8/d19/c24 to d8/c25 0 2024-02-28T23:07:04.706 INFO:tasks.workunit.client.0.smithi159.stdout:3/132: mkdir d0/d8/d2f 0 2024-02-28T23:07:04.712 INFO:tasks.workunit.client.0.smithi159.stdout:6/89: unlink d0/fd 0 2024-02-28T23:07:04.715 INFO:tasks.workunit.client.0.smithi159.stdout:9/92: rename c1 to d4/c1b 0 2024-02-28T23:07:04.716 INFO:tasks.workunit.client.0.smithi159.stdout:6/90: rename d0 to d0/d10/d11/d14/d22 22 2024-02-28T23:07:04.716 INFO:tasks.workunit.client.0.smithi159.stdout:9/93: fsync d4/f15 0 2024-02-28T23:07:04.717 INFO:tasks.workunit.client.0.smithi159.stdout:3/133: mknod d0/d6/d19/c30 0 2024-02-28T23:07:04.718 INFO:tasks.workunit.client.0.smithi159.stdout:0/116: mkdir d0/d5/d14/d25/d2c 0 2024-02-28T23:07:04.719 INFO:tasks.workunit.client.0.smithi159.stdout:5/116: mknod d8/c26 0 2024-02-28T23:07:04.720 INFO:tasks.workunit.client.0.smithi159.stdout:8/135: getdents d2/d21 0 2024-02-28T23:07:04.723 INFO:tasks.workunit.client.0.smithi159.stdout:5/117: dread d8/fe [0,4194304] 0 2024-02-28T23:07:04.724 INFO:tasks.workunit.client.0.smithi159.stdout:4/103: write d9/da/f13 [543565,113928] 0 2024-02-28T23:07:04.725 INFO:tasks.workunit.client.0.smithi159.stdout:6/91: mkdir d0/d10/d11/d14/d23 0 2024-02-28T23:07:04.728 INFO:tasks.workunit.client.0.smithi159.stdout:0/117: mknod d0/d5/c2d 0 2024-02-28T23:07:04.732 INFO:tasks.workunit.client.0.smithi159.stdout:5/118: creat d8/d19/f27 x:0 0 0 2024-02-28T23:07:04.735 INFO:tasks.workunit.client.0.smithi159.stdout:6/92: creat d0/f24 x:0 0 0 2024-02-28T23:07:04.737 INFO:tasks.workunit.client.0.smithi159.stdout:3/134: dread d0/fe [0,4194304] 0 2024-02-28T23:07:04.738 INFO:tasks.workunit.client.0.smithi159.stdout:0/118: creat d0/d5/f2e x:0 0 0 2024-02-28T23:07:04.747 INFO:tasks.workunit.client.0.smithi159.stdout:9/94: rmdir d4/d19 0 2024-02-28T23:07:04.748 INFO:tasks.workunit.client.0.smithi159.stdout:3/135: symlink d0/d8/l31 0 2024-02-28T23:07:04.750 INFO:tasks.workunit.client.0.smithi159.stdout:8/136: rmdir d2/d2d 0 2024-02-28T23:07:04.751 INFO:tasks.workunit.client.0.smithi159.stdout:5/119: dwrite d8/f10 [0,4194304] 0 2024-02-28T23:07:04.759 INFO:tasks.workunit.client.0.smithi159.stdout:8/137: mknod d2/d21/d26/c2e 0 2024-02-28T23:07:04.760 INFO:tasks.workunit.client.0.smithi159.stdout:5/120: symlink d8/l28 0 2024-02-28T23:07:04.761 INFO:tasks.workunit.client.0.smithi159.stdout:5/121: readlink l5 0 2024-02-28T23:07:04.761 INFO:tasks.workunit.client.0.smithi159.stdout:6/93: rmdir d0 39 2024-02-28T23:07:04.763 INFO:tasks.workunit.client.0.smithi159.stdout:5/122: write d8/d19/f1c [312559,57472] 0 2024-02-28T23:07:04.767 INFO:tasks.workunit.client.0.smithi159.stdout:0/119: dwrite d0/de/f1f [0,4194304] 0 2024-02-28T23:07:04.768 INFO:tasks.workunit.client.0.smithi159.stdout:6/94: chown d0 6245045 1 2024-02-28T23:07:04.771 INFO:tasks.workunit.client.0.smithi159.stdout:5/123: symlink d8/d19/l29 0 2024-02-28T23:07:04.776 INFO:tasks.workunit.client.0.smithi159.stdout:4/104: dwrite d9/f19 [0,4194304] 0 2024-02-28T23:07:04.777 INFO:tasks.workunit.client.0.smithi159.stdout:0/120: chown d0/de/l16 126419 1 2024-02-28T23:07:04.778 INFO:tasks.workunit.client.0.smithi159.stdout:6/95: symlink d0/d10/d11/d14/l25 0 2024-02-28T23:07:04.783 INFO:tasks.workunit.client.0.smithi159.stdout:6/96: chown d0/f24 5 1 2024-02-28T23:07:04.783 INFO:tasks.workunit.client.0.smithi159.stdout:5/124: mkdir d8/d19/d23/d2a 0 2024-02-28T23:07:04.784 INFO:tasks.workunit.client.0.smithi159.stdout:8/138: write d2/d3/f2a [899857,13733] 0 2024-02-28T23:07:04.786 INFO:tasks.workunit.client.0.smithi159.stdout:5/125: chown d8/fe 13935788 1 2024-02-28T23:07:04.786 INFO:tasks.workunit.client.0.smithi159.stdout:0/121: mknod d0/d5/d14/d25/d2c/c2f 0 2024-02-28T23:07:04.788 INFO:tasks.workunit.client.0.smithi159.stdout:8/139: readlink d2/d3/l22 0 2024-02-28T23:07:04.789 INFO:tasks.workunit.client.0.smithi159.stdout:6/97: chown d0/d1b/f1f 33404702 1 2024-02-28T23:07:04.790 INFO:tasks.workunit.client.0.smithi159.stdout:4/105: truncate d9/da/d1c/f1d 5065042 0 2024-02-28T23:07:04.793 INFO:tasks.workunit.client.0.smithi159.stdout:8/140: symlink d2/d3/d18/l2f 0 2024-02-28T23:07:04.794 INFO:tasks.workunit.client.0.smithi159.stdout:3/136: dwrite d0/fe [0,4194304] 0 2024-02-28T23:07:04.795 INFO:tasks.workunit.client.0.smithi159.stdout:4/106: creat d9/da/f21 x:0 0 0 2024-02-28T23:07:04.800 INFO:tasks.workunit.client.0.smithi159.stdout:0/122: link d0/de/l20 d0/de/l30 0 2024-02-28T23:07:04.800 INFO:tasks.workunit.client.0.smithi159.stdout:3/137: readlink d0/l18 0 2024-02-28T23:07:04.800 INFO:tasks.workunit.client.0.smithi159.stdout:5/126: dread d8/fb [0,4194304] 0 2024-02-28T23:07:04.800 INFO:tasks.workunit.client.0.smithi159.stdout:4/107: truncate d9/da/f16 721947 0 2024-02-28T23:07:04.800 INFO:tasks.workunit.client.0.smithi159.stdout:6/98: mknod d0/d10/d11/d14/d23/c26 0 2024-02-28T23:07:04.802 INFO:tasks.workunit.client.0.smithi159.stdout:0/123: creat d0/d5/d14/d25/f31 x:0 0 0 2024-02-28T23:07:04.803 INFO:tasks.workunit.client.0.smithi159.stdout:6/99: fdatasync d0/d10/d11/f19 0 2024-02-28T23:07:04.804 INFO:tasks.workunit.client.0.smithi159.stdout:3/138: creat d0/d6/f32 x:0 0 0 2024-02-28T23:07:04.808 INFO:tasks.workunit.client.0.smithi159.stdout:6/100: write d0/f9 [2301681,125609] 0 2024-02-28T23:07:04.809 INFO:tasks.workunit.client.0.smithi159.stdout:8/141: truncate d2/d3/d18/f23 525306 0 2024-02-28T23:07:04.811 INFO:tasks.workunit.client.0.smithi159.stdout:4/108: creat d9/d20/f22 x:0 0 0 2024-02-28T23:07:04.814 INFO:tasks.workunit.client.0.smithi159.stdout:6/101: creat d0/d10/d11/d14/d23/f27 x:0 0 0 2024-02-28T23:07:04.816 INFO:tasks.workunit.client.0.smithi159.stdout:8/142: creat d2/d3/f30 x:0 0 0 2024-02-28T23:07:04.818 INFO:tasks.workunit.client.0.smithi159.stdout:4/109: chown d9/f1b 27249 1 2024-02-28T23:07:04.820 INFO:tasks.workunit.client.0.smithi159.stdout:8/143: chown d2/d11/c16 1339160 1 2024-02-28T23:07:04.825 INFO:tasks.workunit.client.0.smithi159.stdout:5/127: dwrite d8/f11 [0,4194304] 0 2024-02-28T23:07:04.827 INFO:tasks.workunit.client.0.smithi159.stdout:8/144: creat d2/d21/d26/f31 x:0 0 0 2024-02-28T23:07:04.832 INFO:tasks.workunit.client.0.smithi159.stdout:3/139: dwrite d0/d6/d19/f2d [0,4194304] 0 2024-02-28T23:07:04.832 INFO:tasks.workunit.client.0.smithi159.stdout:0/124: rmdir d0/d5/d14/d25 39 2024-02-28T23:07:04.841 INFO:tasks.workunit.client.0.smithi159.stdout:3/140: write d0/d8/f1e [364343,39374] 0 2024-02-28T23:07:04.842 INFO:tasks.workunit.client.0.smithi159.stdout:6/102: dwrite d0/f9 [0,4194304] 0 2024-02-28T23:07:04.847 INFO:tasks.workunit.client.0.smithi159.stdout:3/141: symlink d0/d2b/l33 0 2024-02-28T23:07:04.853 INFO:tasks.workunit.client.0.smithi159.stdout:3/142: chown d0/d8/l17 343 1 2024-02-28T23:07:04.856 INFO:tasks.workunit.client.0.smithi159.stdout:6/103: creat d0/d10/d11/d14/f28 x:0 0 0 2024-02-28T23:07:04.859 INFO:tasks.workunit.client.0.smithi159.stdout:4/110: dwrite d9/f18 [0,4194304] 0 2024-02-28T23:07:04.860 INFO:tasks.workunit.client.0.smithi159.stdout:5/128: dwrite d8/ff [0,4194304] 0 2024-02-28T23:07:04.867 INFO:tasks.workunit.client.0.smithi159.stdout:3/143: rmdir d0/d6 39 2024-02-28T23:07:04.871 INFO:tasks.workunit.client.0.smithi159.stdout:8/145: truncate d2/d3/f14 167123 0 2024-02-28T23:07:04.871 INFO:tasks.workunit.client.0.smithi159.stdout:4/111: dread - d9/da/f10 zero size 2024-02-28T23:07:04.877 INFO:tasks.workunit.client.0.smithi159.stdout:8/146: truncate d2/d3/f29 395795 0 2024-02-28T23:07:04.879 INFO:tasks.workunit.client.0.smithi159.stdout:3/144: dread d0/d2b/f26 [0,4194304] 0 2024-02-28T23:07:04.881 INFO:tasks.workunit.client.0.smithi159.stdout:0/125: dread d0/de/f1f [0,4194304] 0 2024-02-28T23:07:04.885 INFO:tasks.workunit.client.0.smithi159.stdout:8/147: creat d2/d21/f32 x:0 0 0 2024-02-28T23:07:04.888 INFO:tasks.workunit.client.0.smithi159.stdout:3/145: stat d0/d6/f32 0 2024-02-28T23:07:04.890 INFO:tasks.workunit.client.0.smithi159.stdout:6/104: dread d0/fa [0,4194304] 0 2024-02-28T23:07:04.890 INFO:tasks.workunit.client.0.smithi159.stdout:0/126: rename d0/d5/d14/l1d to d0/de/l32 0 2024-02-28T23:07:04.893 INFO:tasks.workunit.client.0.smithi159.stdout:6/105: chown d0/d10/d11 3 1 2024-02-28T23:07:04.899 INFO:tasks.workunit.client.0.smithi159.stdout:0/127: rename d0/d5/f2e to d0/d5/f33 0 2024-02-28T23:07:04.899 INFO:tasks.workunit.client.0.smithi159.stdout:5/129: dread d8/f14 [0,4194304] 0 2024-02-28T23:07:04.902 INFO:tasks.workunit.client.0.smithi159.stdout:4/112: dwrite d9/f18 [4194304,4194304] 0 2024-02-28T23:07:04.903 INFO:tasks.workunit.client.0.smithi159.stdout:5/130: dread - d8/d16/f1e zero size 2024-02-28T23:07:04.904 INFO:tasks.workunit.client.0.smithi159.stdout:8/148: chown d2/d3/d18/f23 654066 1 2024-02-28T23:07:04.905 INFO:tasks.workunit.client.0.smithi159.stdout:5/131: chown f6 1781339 1 2024-02-28T23:07:04.914 INFO:tasks.workunit.client.0.smithi159.stdout:8/149: mknod d2/d3/d18/c33 0 2024-02-28T23:07:04.915 INFO:tasks.workunit.client.0.smithi159.stdout:3/146: dread d0/d6/d19/f2d [0,4194304] 0 2024-02-28T23:07:04.916 INFO:tasks.workunit.client.0.smithi159.stdout:5/132: write d8/f10 [108635,46377] 0 2024-02-28T23:07:04.917 INFO:tasks.workunit.client.0.smithi159.stdout:3/147: stat d0/d6/lf 0 2024-02-28T23:07:04.920 INFO:tasks.workunit.client.0.smithi159.stdout:6/106: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:04.922 INFO:tasks.workunit.client.0.smithi159.stdout:8/150: mknod d2/d11/c34 0 2024-02-28T23:07:04.928 INFO:tasks.workunit.client.0.smithi159.stdout:4/113: dread d9/da/d1c/f1d [0,4194304] 0 2024-02-28T23:07:04.930 INFO:tasks.workunit.client.0.smithi159.stdout:0/128: truncate d0/f6 568239 0 2024-02-28T23:07:04.932 INFO:tasks.workunit.client.0.smithi159.stdout:3/148: mkdir d0/d6/d34 0 2024-02-28T23:07:04.933 INFO:tasks.workunit.client.0.smithi159.stdout:5/133: dread d8/d19/f1c [0,4194304] 0 2024-02-28T23:07:04.934 INFO:tasks.workunit.client.0.smithi159.stdout:8/151: mkdir d2/d11/d35 0 2024-02-28T23:07:04.937 INFO:tasks.workunit.client.0.smithi159.stdout:5/134: write f0 [2635807,118784] 0 2024-02-28T23:07:04.937 INFO:tasks.workunit.client.0.smithi159.stdout:0/129: write d0/d5/f33 [857584,52139] 0 2024-02-28T23:07:04.937 INFO:tasks.workunit.client.0.smithi159.stdout:4/114: mkdir d9/da/d1c/d23 0 2024-02-28T23:07:04.940 INFO:tasks.workunit.client.0.smithi159.stdout:5/135: stat d8/d19/f27 0 2024-02-28T23:07:04.942 INFO:tasks.workunit.client.0.smithi159.stdout:0/130: write d0/d5/f7 [4068340,115782] 0 2024-02-28T23:07:04.947 INFO:tasks.workunit.client.0.smithi159.stdout:5/136: chown d8/d19/c20 32511618 1 2024-02-28T23:07:04.947 INFO:tasks.workunit.client.0.smithi159.stdout:6/107: dwrite d0/d10/d11/d14/d23/f27 [0,4194304] 0 2024-02-28T23:07:04.948 INFO:tasks.workunit.client.0.smithi159.stdout:8/152: rename d2/d3/d18 to d2/d21/d26/d36 0 2024-02-28T23:07:04.950 INFO:tasks.workunit.client.0.smithi159.stdout:5/137: chown f6 74816 1 2024-02-28T23:07:04.952 INFO:tasks.workunit.client.0.smithi159.stdout:6/108: chown d0/d10/d11/d14/d23/f27 55034 1 2024-02-28T23:07:04.952 INFO:tasks.workunit.client.0.smithi159.stdout:5/138: dread - d8/d16/f1e zero size 2024-02-28T23:07:04.954 INFO:tasks.workunit.client.0.smithi159.stdout:5/139: fdatasync d8/f18 0 2024-02-28T23:07:04.958 INFO:tasks.workunit.client.0.smithi159.stdout:4/115: rename f5 to d9/da/d1c/d23/f24 0 2024-02-28T23:07:04.959 INFO:tasks.workunit.client.0.smithi159.stdout:5/140: write d8/d16/f1e [322897,44398] 0 2024-02-28T23:07:04.960 INFO:tasks.workunit.client.0.smithi159.stdout:0/131: mkdir d0/d5/d14/d34 0 2024-02-28T23:07:04.960 INFO:tasks.workunit.client.0.smithi159.stdout:4/116: stat d9/d20/f22 0 2024-02-28T23:07:04.963 INFO:tasks.workunit.client.0.smithi159.stdout:0/132: chown d0/d5/d14/c2a 42 1 2024-02-28T23:07:04.964 INFO:tasks.workunit.client.0.smithi159.stdout:0/133: read d0/f1e [205866,104396] 0 2024-02-28T23:07:04.966 INFO:tasks.workunit.client.0.smithi159.stdout:0/134: chown d0/de/c17 114 1 2024-02-28T23:07:04.967 INFO:tasks.workunit.client.0.smithi159.stdout:6/109: creat d0/d1b/f29 x:0 0 0 2024-02-28T23:07:04.970 INFO:tasks.workunit.client.0.smithi159.stdout:0/135: truncate d0/d5/d14/f22 1636618 0 2024-02-28T23:07:04.985 INFO:tasks.workunit.client.0.smithi159.stdout:4/117: symlink d9/l25 0 2024-02-28T23:07:04.987 INFO:tasks.workunit.client.0.smithi159.stdout:4/118: symlink d9/d20/l26 0 2024-02-28T23:07:04.988 INFO:tasks.workunit.client.0.smithi159.stdout:4/119: readlink d9/da/l14 0 2024-02-28T23:07:04.989 INFO:tasks.workunit.client.0.smithi159.stdout:4/120: dread - d9/da/f10 zero size 2024-02-28T23:07:04.992 INFO:tasks.workunit.client.0.smithi159.stdout:4/121: symlink d9/d20/l27 0 2024-02-28T23:07:04.993 INFO:tasks.workunit.client.0.smithi159.stdout:4/122: stat d9/da/lf 0 2024-02-28T23:07:04.994 INFO:tasks.workunit.client.0.smithi159.stdout:8/153: truncate d2/ff 313980 0 2024-02-28T23:07:04.995 INFO:tasks.workunit.client.0.smithi159.stdout:5/141: truncate d8/d19/f1c 81251 0 2024-02-28T23:07:04.998 INFO:tasks.workunit.client.0.smithi159.stdout:4/123: rename d9/d20/l26 to d9/da/l28 0 2024-02-28T23:07:05.003 INFO:tasks.workunit.client.0.smithi159.stdout:8/154: rename d2/d21/d26/d36/l25 to d2/d21/d26/d36/l37 0 2024-02-28T23:07:05.004 INFO:tasks.workunit.client.0.smithi159.stdout:5/142: chown d8/d19/f1c 1761 1 2024-02-28T23:07:05.005 INFO:tasks.workunit.client.0.smithi159.stdout:5/143: chown d8/fe 1686923 1 2024-02-28T23:07:05.008 INFO:tasks.workunit.client.0.smithi159.stdout:5/144: truncate d8/f15 394135 0 2024-02-28T23:07:05.013 INFO:tasks.workunit.client.0.smithi159.stdout:0/136: write d0/f6 [889707,14835] 0 2024-02-28T23:07:05.015 INFO:tasks.workunit.client.0.smithi159.stdout:4/124: link d9/da/fc d9/d20/f29 0 2024-02-28T23:07:05.017 INFO:tasks.workunit.client.0.smithi159.stdout:8/155: getdents d2/d21/d26/d36 0 2024-02-28T23:07:05.018 INFO:tasks.workunit.client.0.smithi159.stdout:8/156: readlink d2/d3/l1c 0 2024-02-28T23:07:05.020 INFO:tasks.workunit.client.0.smithi159.stdout:5/145: truncate d8/f18 2822629 0 2024-02-28T23:07:05.021 INFO:tasks.workunit.client.0.smithi159.stdout:4/125: mknod d9/d20/c2a 0 2024-02-28T23:07:05.026 INFO:tasks.workunit.client.0.smithi159.stdout:0/137: getdents d0/d5/d14/d34 0 2024-02-28T23:07:05.028 INFO:tasks.workunit.client.0.smithi159.stdout:4/126: mkdir d9/da/d2b 0 2024-02-28T23:07:05.031 INFO:tasks.workunit.client.0.smithi159.stdout:8/157: dread d2/d3/f13 [4194304,4194304] 0 2024-02-28T23:07:05.032 INFO:tasks.workunit.client.0.smithi159.stdout:0/138: fdatasync d0/d5/ff 0 2024-02-28T23:07:05.033 INFO:tasks.workunit.client.0.smithi159.stdout:8/158: write d2/f15 [741525,106228] 0 2024-02-28T23:07:05.034 INFO:tasks.workunit.client.0.smithi159.stdout:0/139: chown d0/f1e 246438 1 2024-02-28T23:07:05.040 INFO:tasks.workunit.client.0.smithi159.stdout:8/159: mkdir d2/d21/d26/d36/d38 0 2024-02-28T23:07:05.043 INFO:tasks.workunit.client.0.smithi159.stdout:8/160: chown d2/d21/d26/f31 19544261 1 2024-02-28T23:07:05.046 INFO:tasks.workunit.client.0.smithi159.stdout:8/161: write d2/d3/f30 [523871,118942] 0 2024-02-28T23:07:05.048 INFO:tasks.workunit.client.0.smithi159.stdout:4/127: truncate d9/f19 1053064 0 2024-02-28T23:07:05.049 INFO:tasks.workunit.client.0.smithi159.stdout:5/146: dwrite f0 [0,4194304] 0 2024-02-28T23:07:05.049 INFO:tasks.workunit.client.0.smithi159.stdout:4/128: read - d9/da/f10 zero size 2024-02-28T23:07:05.052 INFO:tasks.workunit.client.0.smithi159.stdout:5/147: truncate d8/f11 5200069 0 2024-02-28T23:07:05.053 INFO:tasks.workunit.client.0.smithi159.stdout:8/162: creat d2/d21/d26/d36/d38/f39 x:0 0 0 2024-02-28T23:07:05.055 INFO:tasks.workunit.client.0.smithi159.stdout:4/129: write d9/da/d1c/d23/f24 [5426402,91261] 0 2024-02-28T23:07:05.056 INFO:tasks.workunit.client.0.smithi159.stdout:5/148: unlink d8/fb 0 2024-02-28T23:07:05.058 INFO:tasks.workunit.client.0.smithi159.stdout:4/130: rmdir d9 39 2024-02-28T23:07:05.060 INFO:tasks.workunit.client.0.smithi159.stdout:5/149: mknod d8/d19/c2b 0 2024-02-28T23:07:05.060 INFO:tasks.workunit.client.0.smithi159.stdout:8/163: creat d2/f3a x:0 0 0 2024-02-28T23:07:05.085 INFO:tasks.workunit.client.0.smithi159.stdout:5/150: dwrite d8/f18 [0,4194304] 0 2024-02-28T23:07:05.088 INFO:tasks.workunit.client.0.smithi159.stdout:8/164: dwrite d2/d3/f29 [0,4194304] 0 2024-02-28T23:07:05.089 INFO:tasks.workunit.client.0.smithi159.stdout:8/165: readlink d2/d3/l1c 0 2024-02-28T23:07:05.090 INFO:tasks.workunit.client.0.smithi159.stdout:4/131: write d9/da/d1c/f1d [1673146,106394] 0 2024-02-28T23:07:05.090 INFO:tasks.workunit.client.0.smithi159.stdout:5/151: write d8/d19/f27 [669585,92830] 0 2024-02-28T23:07:05.099 INFO:tasks.workunit.client.0.smithi159.stdout:5/152: dread d8/fe [0,4194304] 0 2024-02-28T23:07:05.104 INFO:tasks.workunit.client.0.smithi159.stdout:5/153: symlink d8/d19/l2c 0 2024-02-28T23:07:05.110 INFO:tasks.workunit.client.0.smithi159.stdout:5/154: creat d8/d19/f2d x:0 0 0 2024-02-28T23:07:05.110 INFO:tasks.workunit.client.0.smithi159.stdout:8/166: dread d2/d3/f2a [0,4194304] 0 2024-02-28T23:07:05.113 INFO:tasks.workunit.client.0.smithi159.stdout:5/155: creat d8/d19/f2e x:0 0 0 2024-02-28T23:07:05.117 INFO:tasks.workunit.client.0.smithi159.stdout:8/167: mknod d2/d3/c3b 0 2024-02-28T23:07:05.118 INFO:tasks.workunit.client.0.smithi159.stdout:4/132: truncate d9/f19 458165 0 2024-02-28T23:07:05.119 INFO:tasks.workunit.client.0.smithi159.stdout:4/133: chown d9/d20 3953187 1 2024-02-28T23:07:05.120 INFO:tasks.workunit.client.0.smithi159.stdout:8/168: creat d2/d3/f3c x:0 0 0 2024-02-28T23:07:05.122 INFO:tasks.workunit.client.0.smithi159.stdout:4/134: symlink d9/d20/l2c 0 2024-02-28T23:07:05.124 INFO:tasks.workunit.client.0.smithi159.stdout:5/156: link d8/f13 d8/d19/d23/d2a/f2f 0 2024-02-28T23:07:05.125 INFO:tasks.workunit.client.0.smithi159.stdout:4/135: write d9/da/d1c/d23/f24 [6071029,78974] 0 2024-02-28T23:07:05.129 INFO:tasks.workunit.client.0.smithi159.stdout:8/169: dread d2/f15 [0,4194304] 0 2024-02-28T23:07:05.129 INFO:tasks.workunit.client.0.smithi159.stdout:5/157: getdents d8/d16 0 2024-02-28T23:07:05.131 INFO:tasks.workunit.client.0.smithi159.stdout:4/136: rename d9/da/d2b to d9/da/d1c/d23/d2d 0 2024-02-28T23:07:05.133 INFO:tasks.workunit.client.0.smithi159.stdout:8/170: rename d2/d11/f2b to d2/d3/f3d 0 2024-02-28T23:07:05.135 INFO:tasks.workunit.client.0.smithi159.stdout:5/158: link d8/f15 d8/d19/d23/f30 0 2024-02-28T23:07:05.136 INFO:tasks.workunit.client.0.smithi159.stdout:4/137: mknod d9/da/d1c/c2e 0 2024-02-28T23:07:05.137 INFO:tasks.workunit.client.0.smithi159.stdout:8/171: chown d2/d3/f14 3662 1 2024-02-28T23:07:05.138 INFO:tasks.workunit.client.0.smithi159.stdout:4/138: rmdir d9/da/d1c/d23 39 2024-02-28T23:07:05.143 INFO:tasks.workunit.client.0.smithi159.stdout:5/159: getdents d8 0 2024-02-28T23:07:05.143 INFO:tasks.workunit.client.0.smithi159.stdout:5/160: stat d8/f13 0 2024-02-28T23:07:05.154 INFO:tasks.workunit.client.0.smithi159.stdout:8/172: dwrite d2/d3/f17 [0,4194304] 0 2024-02-28T23:07:05.159 INFO:tasks.workunit.client.0.smithi159.stdout:5/161: rmdir d8/d19 39 2024-02-28T23:07:05.159 INFO:tasks.workunit.client.0.smithi159.stdout:8/173: creat d2/d21/d26/d36/d38/f3e x:0 0 0 2024-02-28T23:07:05.162 INFO:tasks.workunit.client.0.smithi159.stdout:4/139: write d9/da/f12 [1014011,3888] 0 2024-02-28T23:07:05.165 INFO:tasks.workunit.client.0.smithi159.stdout:8/174: creat d2/d11/d35/f3f x:0 0 0 2024-02-28T23:07:05.167 INFO:tasks.workunit.client.0.smithi159.stdout:4/140: dread d9/da/d1c/f1d [0,4194304] 0 2024-02-28T23:07:05.167 INFO:tasks.workunit.client.0.smithi159.stdout:8/175: chown d2/d11/c1a 68563 1 2024-02-28T23:07:05.174 INFO:tasks.workunit.client.0.smithi159.stdout:8/176: rename d2/d21/d26/d36/d38/f3e to d2/f40 0 2024-02-28T23:07:05.180 INFO:tasks.workunit.client.0.smithi159.stdout:4/141: dread d9/da/fc [0,4194304] 0 2024-02-28T23:07:05.189 INFO:tasks.workunit.client.0.smithi159.stdout:4/142: creat d9/da/d1c/d23/f2f x:0 0 0 2024-02-28T23:07:05.189 INFO:tasks.workunit.client.0.smithi159.stdout:5/162: dwrite d8/f15 [0,4194304] 0 2024-02-28T23:07:05.190 INFO:tasks.workunit.client.0.smithi159.stdout:1/71: sync 2024-02-28T23:07:05.190 INFO:tasks.workunit.client.0.smithi159.stdout:7/102: sync 2024-02-28T23:07:05.193 INFO:tasks.workunit.client.0.smithi159.stdout:4/143: unlink d9/da/f21 0 2024-02-28T23:07:05.196 INFO:tasks.workunit.client.0.smithi159.stdout:5/163: write d8/f17 [2377,120412] 0 2024-02-28T23:07:05.197 INFO:tasks.workunit.client.0.smithi159.stdout:1/72: mkdir d6/d12/d16 0 2024-02-28T23:07:05.198 INFO:tasks.workunit.client.0.smithi159.stdout:8/177: dwrite d2/d11/d35/f3f [0,4194304] 0 2024-02-28T23:07:05.199 INFO:tasks.workunit.client.0.smithi159.stdout:1/73: dread - d6/f11 zero size 2024-02-28T23:07:05.202 INFO:tasks.workunit.client.0.smithi159.stdout:8/178: fdatasync d2/d3/f20 0 2024-02-28T23:07:05.206 INFO:tasks.workunit.client.0.smithi159.stdout:7/103: link d5/l7 d5/d16/l20 0 2024-02-28T23:07:05.206 INFO:tasks.workunit.client.0.smithi159.stdout:4/144: mknod d9/da/d1c/c30 0 2024-02-28T23:07:05.207 INFO:tasks.workunit.client.0.smithi159.stdout:8/179: symlink d2/d21/d26/l41 0 2024-02-28T23:07:05.208 INFO:tasks.workunit.client.0.smithi159.stdout:7/104: fsync d5/fc 0 2024-02-28T23:07:05.211 INFO:tasks.workunit.client.0.smithi159.stdout:8/180: mknod d2/c42 0 2024-02-28T23:07:05.214 INFO:tasks.workunit.client.0.smithi159.stdout:4/145: mknod d9/da/d1c/c31 0 2024-02-28T23:07:05.214 INFO:tasks.workunit.client.0.smithi159.stdout:1/74: dread d6/f9 [0,4194304] 0 2024-02-28T23:07:05.214 INFO:tasks.workunit.client.0.smithi159.stdout:8/181: symlink d2/d21/d26/d36/l43 0 2024-02-28T23:07:05.216 INFO:tasks.workunit.client.0.smithi159.stdout:8/182: truncate d2/d3/f2c 166697 0 2024-02-28T23:07:05.218 INFO:tasks.workunit.client.0.smithi159.stdout:1/75: mknod d6/d12/d16/c17 0 2024-02-28T23:07:05.218 INFO:tasks.workunit.client.0.smithi159.stdout:8/183: dread - d2/d21/d26/f31 zero size 2024-02-28T23:07:05.222 INFO:tasks.workunit.client.0.smithi159.stdout:4/146: getdents d9/da/d1c/d23 0 2024-02-28T23:07:05.224 INFO:tasks.workunit.client.0.smithi159.stdout:4/147: chown d9/d20/f29 80 1 2024-02-28T23:07:05.229 INFO:tasks.workunit.client.0.smithi159.stdout:4/148: unlink d9/f17 0 2024-02-28T23:07:05.233 INFO:tasks.workunit.client.0.smithi159.stdout:4/149: symlink d9/l32 0 2024-02-28T23:07:05.236 INFO:tasks.workunit.client.0.smithi159.stdout:4/150: chown d9/l32 0 1 2024-02-28T23:07:05.240 INFO:tasks.workunit.client.0.smithi159.stdout:1/76: dwrite d6/d12/ff [0,4194304] 0 2024-02-28T23:07:05.241 INFO:tasks.workunit.client.0.smithi159.stdout:1/77: chown d6/f9 115352572 1 2024-02-28T23:07:05.246 INFO:tasks.workunit.client.0.smithi159.stdout:4/151: symlink d9/da/d1c/l33 0 2024-02-28T23:07:05.254 INFO:tasks.workunit.client.0.smithi159.stdout:1/78: write d6/f9 [2402324,115067] 0 2024-02-28T23:07:05.257 INFO:tasks.workunit.client.0.smithi159.stdout:1/79: creat d6/d12/f18 x:0 0 0 2024-02-28T23:07:05.258 INFO:tasks.workunit.client.0.smithi159.stdout:1/80: chown f0 2629 1 2024-02-28T23:07:05.263 INFO:tasks.workunit.client.0.smithi159.stdout:1/81: creat d6/f19 x:0 0 0 2024-02-28T23:07:05.264 INFO:tasks.workunit.client.0.smithi159.stdout:4/152: write d9/f1f [2780744,97807] 0 2024-02-28T23:07:05.266 INFO:tasks.workunit.client.0.smithi159.stdout:1/82: mkdir d6/d12/d1a 0 2024-02-28T23:07:05.266 INFO:tasks.workunit.client.0.smithi159.stdout:4/153: write d9/f1f [728574,116518] 0 2024-02-28T23:07:05.269 INFO:tasks.workunit.client.0.smithi159.stdout:1/83: creat d6/d12/f1b x:0 0 0 2024-02-28T23:07:05.269 INFO:tasks.workunit.client.0.smithi159.stdout:1/84: readlink l5 0 2024-02-28T23:07:05.271 INFO:tasks.workunit.client.0.smithi159.stdout:4/154: getdents d9/da/d1c/d23/d2d 0 2024-02-28T23:07:05.271 INFO:tasks.workunit.client.0.smithi159.stdout:1/85: read - d6/d12/f1b zero size 2024-02-28T23:07:05.272 INFO:tasks.workunit.client.0.smithi159.stdout:1/86: write d6/f9 [3793942,82418] 0 2024-02-28T23:07:05.273 INFO:tasks.workunit.client.0.smithi159.stdout:1/87: readlink l5 0 2024-02-28T23:07:05.274 INFO:tasks.workunit.client.0.smithi159.stdout:4/155: symlink d9/da/d1c/l34 0 2024-02-28T23:07:05.277 INFO:tasks.workunit.client.0.smithi159.stdout:4/156: symlink d9/l35 0 2024-02-28T23:07:05.278 INFO:tasks.workunit.client.0.smithi159.stdout:1/88: dread d6/d12/fe [0,4194304] 0 2024-02-28T23:07:05.279 INFO:tasks.workunit.client.0.smithi159.stdout:4/157: mknod d9/da/d1c/d23/d2d/c36 0 2024-02-28T23:07:05.279 INFO:tasks.workunit.client.0.smithi159.stdout:1/89: write d6/f19 [170343,65402] 0 2024-02-28T23:07:05.281 INFO:tasks.workunit.client.0.smithi159.stdout:1/90: read d6/f9 [3861035,109866] 0 2024-02-28T23:07:05.282 INFO:tasks.workunit.client.0.smithi159.stdout:4/158: write d9/f19 [778939,49490] 0 2024-02-28T23:07:05.285 INFO:tasks.workunit.client.0.smithi159.stdout:1/91: unlink d6/f19 0 2024-02-28T23:07:05.286 INFO:tasks.workunit.client.0.smithi159.stdout:4/159: creat d9/da/d1c/d23/f37 x:0 0 0 2024-02-28T23:07:05.288 INFO:tasks.workunit.client.0.smithi159.stdout:1/92: creat d6/d12/d16/f1c x:0 0 0 2024-02-28T23:07:05.303 INFO:tasks.workunit.client.0.smithi159.stdout:1/93: dwrite d6/d12/f14 [0,4194304] 0 2024-02-28T23:07:05.306 INFO:tasks.workunit.client.0.smithi159.stdout:4/160: truncate d9/da/f13 546741 0 2024-02-28T23:07:05.306 INFO:tasks.workunit.client.0.smithi159.stdout:1/94: unlink f0 0 2024-02-28T23:07:05.307 INFO:tasks.workunit.client.0.smithi159.stdout:4/161: read - d9/da/d1c/d23/f2f zero size 2024-02-28T23:07:05.327 INFO:tasks.workunit.client.0.smithi159.stdout:4/162: dwrite d9/da/f12 [0,4194304] 0 2024-02-28T23:07:05.343 INFO:tasks.workunit.client.0.smithi159.stdout:1/95: dwrite d6/d12/ff [4194304,4194304] 0 2024-02-28T23:07:05.346 INFO:tasks.workunit.client.0.smithi159.stdout:4/163: dread d9/f1b [0,4194304] 0 2024-02-28T23:07:05.349 INFO:tasks.workunit.client.0.smithi159.stdout:1/96: write d6/fb [1254424,10786] 0 2024-02-28T23:07:05.349 INFO:tasks.workunit.client.0.smithi159.stdout:4/164: chown d9/da/d1c/c30 563142 1 2024-02-28T23:07:05.350 INFO:tasks.workunit.client.0.smithi159.stdout:1/97: stat d6/f9 0 2024-02-28T23:07:05.354 INFO:tasks.workunit.client.0.smithi159.stdout:4/165: truncate d9/da/f13 631346 0 2024-02-28T23:07:05.355 INFO:tasks.workunit.client.0.smithi159.stdout:1/98: mkdir d6/d1d 0 2024-02-28T23:07:05.357 INFO:tasks.workunit.client.0.smithi159.stdout:4/166: symlink d9/da/d1c/d23/l38 0 2024-02-28T23:07:05.358 INFO:tasks.workunit.client.0.smithi159.stdout:1/99: chown d6/d12/d16 100 1 2024-02-28T23:07:05.360 INFO:tasks.workunit.client.0.smithi159.stdout:1/100: stat d6/d12/d16/f1c 0 2024-02-28T23:07:05.362 INFO:tasks.workunit.client.0.smithi159.stdout:1/101: write d6/d12/f18 [384244,79794] 0 2024-02-28T23:07:05.366 INFO:tasks.workunit.client.0.smithi159.stdout:4/167: write d9/da/fc [1564122,16372] 0 2024-02-28T23:07:05.367 INFO:tasks.workunit.client.0.smithi159.stdout:1/102: creat d6/d1d/f1e x:0 0 0 2024-02-28T23:07:05.370 INFO:tasks.workunit.client.0.smithi159.stdout:4/168: creat d9/da/d1c/f39 x:0 0 0 2024-02-28T23:07:05.370 INFO:tasks.workunit.client.0.smithi159.stdout:1/103: mkdir d6/d1d/d1f 0 2024-02-28T23:07:05.372 INFO:tasks.workunit.client.0.smithi159.stdout:4/169: creat d9/da/f3a x:0 0 0 2024-02-28T23:07:05.375 INFO:tasks.workunit.client.0.smithi159.stdout:4/170: creat d9/da/f3b x:0 0 0 2024-02-28T23:07:05.375 INFO:tasks.workunit.client.0.smithi159.stdout:1/104: creat d6/f20 x:0 0 0 2024-02-28T23:07:05.377 INFO:tasks.workunit.client.0.smithi159.stdout:1/105: mknod d6/d1d/d1f/c21 0 2024-02-28T23:07:05.380 INFO:tasks.workunit.client.0.smithi159.stdout:1/106: mknod d6/d12/d1a/c22 0 2024-02-28T23:07:05.716 INFO:tasks.workunit.client.0.smithi159.stdout:9/95: sync 2024-02-28T23:07:05.716 INFO:tasks.workunit.client.0.smithi159.stdout:2/112: sync 2024-02-28T23:07:05.718 INFO:tasks.workunit.client.0.smithi159.stdout:2/113: stat d9/f11 0 2024-02-28T23:07:05.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:05 smithi159 ceph-mon[28802]: pgmap v21: 65 pgs: 65 active+clean; 288 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 14 MiB/s wr, 216 op/s 2024-02-28T23:07:05.722 INFO:tasks.workunit.client.0.smithi159.stdout:2/114: write d9/f16 [3465075,95400] 0 2024-02-28T23:07:05.760 INFO:tasks.workunit.client.0.smithi159.stdout:2/115: dread d9/de/d13/f14 [0,4194304] 0 2024-02-28T23:07:05.767 INFO:tasks.workunit.client.0.smithi159.stdout:2/116: symlink d9/de/l22 0 2024-02-28T23:07:05.769 INFO:tasks.workunit.client.0.smithi159.stdout:9/96: dread d4/f7 [0,4194304] 0 2024-02-28T23:07:05.769 INFO:tasks.workunit.client.0.smithi159.stdout:2/117: readlink d9/de/d13/l15 0 2024-02-28T23:07:05.778 INFO:tasks.workunit.client.0.smithi159.stdout:9/97: symlink d4/d17/l1c 0 2024-02-28T23:07:05.783 INFO:tasks.workunit.client.0.smithi159.stdout:9/98: mknod d4/c1d 0 2024-02-28T23:07:05.814 INFO:tasks.workunit.client.0.smithi159.stdout:9/99: dwrite d4/f5 [8388608,4194304] 0 2024-02-28T23:07:05.817 INFO:tasks.workunit.client.0.smithi159.stdout:9/100: write d4/f15 [3741016,46711] 0 2024-02-28T23:07:05.822 INFO:tasks.workunit.client.0.smithi159.stdout:2/118: dread f8 [0,4194304] 0 2024-02-28T23:07:05.834 INFO:tasks.workunit.client.0.smithi159.stdout:6/110: sync 2024-02-28T23:07:05.834 INFO:tasks.workunit.client.0.smithi159.stdout:8/184: sync 2024-02-28T23:07:05.834 INFO:tasks.workunit.client.0.smithi159.stdout:4/171: sync 2024-02-28T23:07:05.834 INFO:tasks.workunit.client.0.smithi159.stdout:5/164: sync 2024-02-28T23:07:05.835 INFO:tasks.workunit.client.0.smithi159.stdout:0/140: sync 2024-02-28T23:07:05.835 INFO:tasks.workunit.client.0.smithi159.stdout:3/149: sync 2024-02-28T23:07:05.835 INFO:tasks.workunit.client.0.smithi159.stdout:1/107: sync 2024-02-28T23:07:05.835 INFO:tasks.workunit.client.0.smithi159.stdout:7/105: sync 2024-02-28T23:07:05.837 INFO:tasks.workunit.client.0.smithi159.stdout:9/101: dread d4/f5 [8388608,4194304] 0 2024-02-28T23:07:05.839 INFO:tasks.workunit.client.0.smithi159.stdout:9/102: stat d4/f7 0 2024-02-28T23:07:05.840 INFO:tasks.workunit.client.0.smithi159.stdout:3/150: write d0/f23 [493718,8079] 0 2024-02-28T23:07:05.842 INFO:tasks.workunit.client.0.smithi159.stdout:1/108: creat d6/d12/d1a/f23 x:0 0 0 2024-02-28T23:07:05.844 INFO:tasks.workunit.client.0.smithi159.stdout:7/106: rmdir d5/d16 39 2024-02-28T23:07:05.846 INFO:tasks.workunit.client.0.smithi159.stdout:3/151: fdatasync d0/f23 0 2024-02-28T23:07:05.848 INFO:tasks.workunit.client.0.smithi159.stdout:3/152: read d0/d6/d19/f2d [957596,5871] 0 2024-02-28T23:07:05.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:05 smithi184 ceph-mon[36198]: pgmap v21: 65 pgs: 65 active+clean; 288 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 14 MiB/s wr, 216 op/s 2024-02-28T23:07:05.852 INFO:tasks.workunit.client.0.smithi159.stdout:9/103: rename d4/f15 to d4/d17/f1e 0 2024-02-28T23:07:05.859 INFO:tasks.workunit.client.0.smithi159.stdout:4/172: creat d9/f3c x:0 0 0 2024-02-28T23:07:05.861 INFO:tasks.workunit.client.0.smithi159.stdout:5/165: creat d8/f31 x:0 0 0 2024-02-28T23:07:05.864 INFO:tasks.workunit.client.0.smithi159.stdout:6/111: link d0/d10/d11/f1d d0/f2a 0 2024-02-28T23:07:05.866 INFO:tasks.workunit.client.0.smithi159.stdout:4/173: dread d9/da/fc [0,4194304] 0 2024-02-28T23:07:05.872 INFO:tasks.workunit.client.0.smithi159.stdout:9/104: unlink d4/lc 0 2024-02-28T23:07:05.873 INFO:tasks.workunit.client.0.smithi159.stdout:1/109: dwrite d6/d12/ff [4194304,4194304] 0 2024-02-28T23:07:05.873 INFO:tasks.workunit.client.0.smithi159.stdout:7/107: rmdir d5/d16 39 2024-02-28T23:07:05.878 INFO:tasks.workunit.client.0.smithi159.stdout:5/166: read - d8/f21 zero size 2024-02-28T23:07:05.878 INFO:tasks.workunit.client.0.smithi159.stdout:2/119: truncate d9/f11 1093800 0 2024-02-28T23:07:05.880 INFO:tasks.workunit.client.0.smithi159.stdout:6/112: rmdir d0/d10 39 2024-02-28T23:07:05.884 INFO:tasks.workunit.client.0.smithi159.stdout:8/185: write d2/d11/f12 [72884,99014] 0 2024-02-28T23:07:05.886 INFO:tasks.workunit.client.0.smithi159.stdout:9/105: symlink d4/l1f 0 2024-02-28T23:07:05.886 INFO:tasks.workunit.client.0.smithi159.stdout:4/174: creat d9/da/d1c/d23/d2d/f3d x:0 0 0 2024-02-28T23:07:05.889 INFO:tasks.workunit.client.0.smithi159.stdout:7/108: unlink d5/c14 0 2024-02-28T23:07:05.893 INFO:tasks.workunit.client.0.smithi159.stdout:3/153: dwrite d0/d6/d19/f2d [0,4194304] 0 2024-02-28T23:07:05.896 INFO:tasks.workunit.client.0.smithi159.stdout:0/141: truncate d0/fb 1222076 0 2024-02-28T23:07:05.902 INFO:tasks.workunit.client.0.smithi159.stdout:7/109: fdatasync d5/d16/f1f 0 2024-02-28T23:07:05.904 INFO:tasks.workunit.client.0.smithi159.stdout:7/110: fsync d5/fd 0 2024-02-28T23:07:05.906 INFO:tasks.workunit.client.0.smithi159.stdout:2/120: dwrite f6 [0,4194304] 0 2024-02-28T23:07:05.908 INFO:tasks.workunit.client.0.smithi159.stdout:5/167: creat d8/d19/d23/d2a/f32 x:0 0 0 2024-02-28T23:07:05.915 INFO:tasks.workunit.client.0.smithi159.stdout:6/113: link d0/fc d0/f2b 0 2024-02-28T23:07:05.919 INFO:tasks.workunit.client.0.smithi159.stdout:8/186: getdents d2/d11/d35 0 2024-02-28T23:07:05.919 INFO:tasks.workunit.client.0.smithi159.stdout:5/168: chown d8/c22 6 1 2024-02-28T23:07:05.920 INFO:tasks.workunit.client.0.smithi159.stdout:0/142: link d0/d5/c2d d0/de/c35 0 2024-02-28T23:07:05.928 INFO:tasks.workunit.client.0.smithi159.stdout:7/111: rename d5/fc to d5/f21 0 2024-02-28T23:07:05.929 INFO:tasks.workunit.client.0.smithi159.stdout:9/106: dwrite d4/d17/f1e [0,4194304] 0 2024-02-28T23:07:05.930 INFO:tasks.workunit.client.0.smithi159.stdout:7/112: chown f4 1 1 2024-02-28T23:07:05.931 INFO:tasks.workunit.client.0.smithi159.stdout:7/113: chown f4 3228433 1 2024-02-28T23:07:05.934 INFO:tasks.workunit.client.0.smithi159.stdout:5/169: creat d8/d16/f33 x:0 0 0 2024-02-28T23:07:05.936 INFO:tasks.workunit.client.0.smithi159.stdout:0/143: dread d0/d5/ff [4194304,4194304] 0 2024-02-28T23:07:05.938 INFO:tasks.workunit.client.0.smithi159.stdout:9/107: symlink d4/l20 0 2024-02-28T23:07:05.940 INFO:tasks.workunit.client.0.smithi159.stdout:9/108: chown d4/l1f 21801 1 2024-02-28T23:07:05.940 INFO:tasks.workunit.client.0.smithi159.stdout:3/154: write d0/d2b/f26 [158170,12078] 0 2024-02-28T23:07:05.943 INFO:tasks.workunit.client.0.smithi159.stdout:7/114: creat d5/d16/d1a/f22 x:0 0 0 2024-02-28T23:07:05.944 INFO:tasks.workunit.client.0.smithi159.stdout:7/115: fdatasync d5/fa 0 2024-02-28T23:07:05.945 INFO:tasks.workunit.client.0.smithi159.stdout:6/114: dwrite d0/d1b/f1a [4194304,4194304] 0 2024-02-28T23:07:05.945 INFO:tasks.workunit.client.0.smithi159.stdout:4/175: truncate d9/da/f12 978428 0 2024-02-28T23:07:05.945 INFO:tasks.workunit.client.0.smithi159.stdout:5/170: stat d8/c25 0 2024-02-28T23:07:05.952 INFO:tasks.workunit.client.0.smithi159.stdout:9/109: rename c0 to d4/c21 0 2024-02-28T23:07:05.959 INFO:tasks.workunit.client.0.smithi159.stdout:2/121: dread d9/f11 [0,4194304] 0 2024-02-28T23:07:05.960 INFO:tasks.workunit.client.0.smithi159.stdout:8/187: getdents d2/d21/d26/d36 0 2024-02-28T23:07:05.965 INFO:tasks.workunit.client.0.smithi159.stdout:6/115: dwrite d0/fe [0,4194304] 0 2024-02-28T23:07:05.965 INFO:tasks.workunit.client.0.smithi159.stdout:7/116: unlink d5/d16/d1a/f22 0 2024-02-28T23:07:05.966 INFO:tasks.workunit.client.0.smithi159.stdout:6/116: readlink d0/lf 0 2024-02-28T23:07:05.966 INFO:tasks.workunit.client.0.smithi159.stdout:0/144: creat d0/d5/d14/d34/f36 x:0 0 0 2024-02-28T23:07:05.967 INFO:tasks.workunit.client.0.smithi159.stdout:7/117: chown d5/f1d 336 1 2024-02-28T23:07:05.974 INFO:tasks.workunit.client.0.smithi159.stdout:9/110: mknod d4/d17/c22 0 2024-02-28T23:07:05.975 INFO:tasks.workunit.client.0.smithi159.stdout:5/171: dwrite d8/f18 [0,4194304] 0 2024-02-28T23:07:05.979 INFO:tasks.workunit.client.0.smithi159.stdout:2/122: mkdir d9/d23 0 2024-02-28T23:07:05.982 INFO:tasks.workunit.client.0.smithi159.stdout:8/188: fdatasync d2/d3/f1d 0 2024-02-28T23:07:05.986 INFO:tasks.workunit.client.0.smithi159.stdout:6/117: rmdir d0/d1b 39 2024-02-28T23:07:05.990 INFO:tasks.workunit.client.0.smithi159.stdout:3/155: creat d0/f35 x:0 0 0 2024-02-28T23:07:05.992 INFO:tasks.workunit.client.0.smithi159.stdout:3/156: dread - d0/d8/f22 zero size 2024-02-28T23:07:05.993 INFO:tasks.workunit.client.0.smithi159.stdout:0/145: dread d0/f1e [0,4194304] 0 2024-02-28T23:07:05.995 INFO:tasks.workunit.client.0.smithi159.stdout:9/111: symlink d4/l23 0 2024-02-28T23:07:05.999 INFO:tasks.workunit.client.0.smithi159.stdout:0/146: truncate d0/d5/d14/d34/f36 705195 0 2024-02-28T23:07:06.002 INFO:tasks.workunit.client.0.smithi159.stdout:8/189: symlink d2/d11/l44 0 2024-02-28T23:07:06.011 INFO:tasks.workunit.client.0.smithi159.stdout:8/190: symlink d2/d3/l45 0 2024-02-28T23:07:06.012 INFO:tasks.workunit.client.0.smithi159.stdout:4/176: truncate d9/da/d1c/d23/f24 5088667 0 2024-02-28T23:07:06.015 INFO:tasks.workunit.client.0.smithi159.stdout:4/177: dread - d9/da/d1c/d23/f2f zero size 2024-02-28T23:07:06.016 INFO:tasks.workunit.client.0.smithi159.stdout:0/147: rename d0/de/l16 to d0/d5/d14/d34/l37 0 2024-02-28T23:07:06.021 INFO:tasks.workunit.client.0.smithi159.stdout:4/178: chown d9/d20/f22 2034588 1 2024-02-28T23:07:06.022 INFO:tasks.workunit.client.0.smithi159.stdout:7/118: getdents d5/d16 0 2024-02-28T23:07:06.023 INFO:tasks.workunit.client.0.smithi159.stdout:8/191: creat d2/d3/f46 x:0 0 0 2024-02-28T23:07:06.027 INFO:tasks.workunit.client.0.smithi159.stdout:5/172: dwrite d8/ff [0,4194304] 0 2024-02-28T23:07:06.032 INFO:tasks.workunit.client.0.smithi159.stdout:9/112: getdents d4 0 2024-02-28T23:07:06.034 INFO:tasks.workunit.client.0.smithi159.stdout:8/192: readlink d2/d11/l44 0 2024-02-28T23:07:06.036 INFO:tasks.workunit.client.0.smithi159.stdout:0/148: chown d0/l23 86020723 1 2024-02-28T23:07:06.040 INFO:tasks.workunit.client.0.smithi159.stdout:6/118: dwrite d0/d1b/f20 [0,4194304] 0 2024-02-28T23:07:06.043 INFO:tasks.workunit.client.0.smithi159.stdout:4/179: mknod d9/da/d1c/c3e 0 2024-02-28T23:07:06.045 INFO:tasks.workunit.client.0.smithi159.stdout:2/123: dwrite d9/f11 [0,4194304] 0 2024-02-28T23:07:06.046 INFO:tasks.workunit.client.0.smithi159.stdout:9/113: creat d4/d17/f24 x:0 0 0 2024-02-28T23:07:06.058 INFO:tasks.workunit.client.0.smithi159.stdout:2/124: rmdir d9/de 39 2024-02-28T23:07:06.061 INFO:tasks.workunit.client.0.smithi159.stdout:4/180: unlink d9/da/c11 0 2024-02-28T23:07:06.063 INFO:tasks.workunit.client.0.smithi159.stdout:9/114: write d4/f7 [1935977,7922] 0 2024-02-28T23:07:06.064 INFO:tasks.workunit.client.0.smithi159.stdout:8/193: dread d2/d3/f1d [0,4194304] 0 2024-02-28T23:07:06.066 INFO:tasks.workunit.client.0.smithi159.stdout:6/119: rename d0/f24 to d0/d10/d11/f2c 0 2024-02-28T23:07:06.066 INFO:tasks.workunit.client.0.smithi159.stdout:4/181: chown d9/da/d1c/f1d 11491 1 2024-02-28T23:07:06.071 INFO:tasks.workunit.client.0.smithi159.stdout:5/173: truncate d8/f10 2010537 0 2024-02-28T23:07:06.073 INFO:tasks.workunit.client.0.smithi159.stdout:8/194: fdatasync d2/f15 0 2024-02-28T23:07:06.073 INFO:tasks.workunit.client.0.smithi159.stdout:5/174: write d8/d19/f2d [545907,66721] 0 2024-02-28T23:07:06.074 INFO:tasks.workunit.client.0.smithi159.stdout:2/125: symlink d9/d23/l24 0 2024-02-28T23:07:06.075 INFO:tasks.workunit.client.0.smithi159.stdout:6/120: mknod d0/d1b/c2d 0 2024-02-28T23:07:06.077 INFO:tasks.workunit.client.0.smithi159.stdout:5/175: write d8/d16/f1e [458838,75280] 0 2024-02-28T23:07:06.078 INFO:tasks.workunit.client.0.smithi159.stdout:0/149: truncate d0/d5/f7 1334156 0 2024-02-28T23:07:06.081 INFO:tasks.workunit.client.0.smithi159.stdout:4/182: creat d9/d20/f3f x:0 0 0 2024-02-28T23:07:06.088 INFO:tasks.workunit.client.0.smithi159.stdout:2/126: write d9/de/d13/f1f [184255,63991] 0 2024-02-28T23:07:06.090 INFO:tasks.workunit.client.0.smithi159.stdout:0/150: mkdir d0/d5/d38 0 2024-02-28T23:07:06.091 INFO:tasks.workunit.client.0.smithi159.stdout:0/151: stat d0/d5/d14/d34/l37 0 2024-02-28T23:07:06.093 INFO:tasks.workunit.client.0.smithi159.stdout:0/152: chown d0/de/d11/f19 24829 1 2024-02-28T23:07:06.096 INFO:tasks.workunit.client.0.smithi159.stdout:4/183: mknod d9/da/c40 0 2024-02-28T23:07:06.097 INFO:tasks.workunit.client.0.smithi159.stdout:6/121: link d0/d1b/f1f d0/d10/d11/f2e 0 2024-02-28T23:07:06.099 INFO:tasks.workunit.client.0.smithi159.stdout:5/176: creat d8/f34 x:0 0 0 2024-02-28T23:07:06.102 INFO:tasks.workunit.client.0.smithi159.stdout:0/153: creat d0/d5/d14/d25/f39 x:0 0 0 2024-02-28T23:07:06.104 INFO:tasks.workunit.client.0.smithi159.stdout:2/127: creat d9/f25 x:0 0 0 2024-02-28T23:07:06.105 INFO:tasks.workunit.client.0.smithi159.stdout:4/184: creat d9/da/d1c/d23/d2d/f41 x:0 0 0 2024-02-28T23:07:06.106 INFO:tasks.workunit.client.0.smithi159.stdout:6/122: symlink d0/d10/d11/d14/l2f 0 2024-02-28T23:07:06.107 INFO:tasks.workunit.client.0.smithi159.stdout:5/177: mkdir d8/d19/d23/d35 0 2024-02-28T23:07:06.108 INFO:tasks.workunit.client.0.smithi159.stdout:0/154: write d0/f3 [539513,63898] 0 2024-02-28T23:07:06.110 INFO:tasks.workunit.client.0.smithi159.stdout:2/128: creat d9/de/d13/f26 x:0 0 0 2024-02-28T23:07:06.111 INFO:tasks.workunit.client.0.smithi159.stdout:5/178: truncate d8/d16/f1a 1378378 0 2024-02-28T23:07:06.111 INFO:tasks.workunit.client.0.smithi159.stdout:6/123: read d0/fe [1512489,68967] 0 2024-02-28T23:07:06.113 INFO:tasks.workunit.client.0.smithi159.stdout:0/155: unlink d0/d5/d14/f22 0 2024-02-28T23:07:06.120 INFO:tasks.workunit.client.0.smithi159.stdout:5/179: creat d8/d19/f36 x:0 0 0 2024-02-28T23:07:06.122 INFO:tasks.workunit.client.0.smithi159.stdout:0/156: dread d0/f1e [0,4194304] 0 2024-02-28T23:07:06.128 INFO:tasks.workunit.client.0.smithi159.stdout:5/180: write d8/f34 [886547,119303] 0 2024-02-28T23:07:06.132 INFO:tasks.workunit.client.0.smithi159.stdout:4/185: dwrite d9/da/f3b [0,4194304] 0 2024-02-28T23:07:06.134 INFO:tasks.workunit.client.0.smithi159.stdout:5/181: chown d8/d19/f2d 5 1 2024-02-28T23:07:06.137 INFO:tasks.workunit.client.0.smithi159.stdout:0/157: rename d0/d5/d14/d34/f36 to d0/d5/f3a 0 2024-02-28T23:07:06.139 INFO:tasks.workunit.client.0.smithi159.stdout:6/124: rename d0/l5 to d0/l30 0 2024-02-28T23:07:06.141 INFO:tasks.workunit.client.0.smithi159.stdout:6/125: chown d0/d10/d11/d14/d23/c26 17959513 1 2024-02-28T23:07:06.143 INFO:tasks.workunit.client.0.smithi159.stdout:8/195: dread d2/d3/f9 [0,4194304] 0 2024-02-28T23:07:06.146 INFO:tasks.workunit.client.0.smithi159.stdout:8/196: write d2/f3a [327745,70791] 0 2024-02-28T23:07:06.146 INFO:tasks.workunit.client.0.smithi159.stdout:1/110: sync 2024-02-28T23:07:06.154 INFO:tasks.workunit.client.0.smithi159.stdout:0/158: read d0/fb [1003538,64238] 0 2024-02-28T23:07:06.154 INFO:tasks.workunit.client.0.smithi159.stdout:5/182: rename d8/d19/d23/f30 to d8/d19/f37 0 2024-02-28T23:07:06.155 INFO:tasks.workunit.client.0.smithi159.stdout:6/126: symlink d0/d10/d11/l31 0 2024-02-28T23:07:06.156 INFO:tasks.workunit.client.0.smithi159.stdout:8/197: fsync d2/f3a 0 2024-02-28T23:07:06.157 INFO:tasks.workunit.client.0.smithi159.stdout:8/198: chown d2/d21/d26/c2e 8 1 2024-02-28T23:07:06.159 INFO:tasks.workunit.client.0.smithi159.stdout:6/127: truncate d0/d10/d11/f19 12052 0 2024-02-28T23:07:06.159 INFO:tasks.workunit.client.0.smithi159.stdout:8/199: chown d2/d21/d26/l41 1744783 1 2024-02-28T23:07:06.161 INFO:tasks.workunit.client.0.smithi159.stdout:4/186: mkdir d9/d42 0 2024-02-28T23:07:06.166 INFO:tasks.workunit.client.0.smithi159.stdout:1/111: fsync d6/d12/fe 0 2024-02-28T23:07:06.177 INFO:tasks.workunit.client.0.smithi159.stdout:0/159: readlink d0/de/l32 0 2024-02-28T23:07:06.179 INFO:tasks.workunit.client.0.smithi159.stdout:6/128: write d0/d10/d11/f2c [140138,20006] 0 2024-02-28T23:07:06.179 INFO:tasks.workunit.client.0.smithi159.stdout:0/160: stat d0/d5/d14 0 2024-02-28T23:07:06.180 INFO:tasks.workunit.client.0.smithi159.stdout:8/200: write d2/d3/f9 [346701,506] 0 2024-02-28T23:07:06.186 INFO:tasks.workunit.client.0.smithi159.stdout:8/201: dread - d2/d3/f10 zero size 2024-02-28T23:07:06.188 INFO:tasks.workunit.client.0.smithi159.stdout:4/187: dwrite d9/da/d1c/f1d [0,4194304] 0 2024-02-28T23:07:06.190 INFO:tasks.workunit.client.0.smithi159.stdout:6/129: fsync d0/d10/d11/f19 0 2024-02-28T23:07:06.193 INFO:tasks.workunit.client.0.smithi159.stdout:4/188: fsync d9/da/f16 0 2024-02-28T23:07:06.194 INFO:tasks.workunit.client.0.smithi159.stdout:0/161: creat d0/de/f3b x:0 0 0 2024-02-28T23:07:06.196 INFO:tasks.workunit.client.0.smithi159.stdout:1/112: fdatasync d6/d12/f15 0 2024-02-28T23:07:06.200 INFO:tasks.workunit.client.0.smithi159.stdout:8/202: mkdir d2/d21/d47 0 2024-02-28T23:07:06.202 INFO:tasks.workunit.client.0.smithi159.stdout:6/130: mknod d0/d10/d11/d14/c32 0 2024-02-28T23:07:06.204 INFO:tasks.workunit.client.0.smithi159.stdout:4/189: symlink d9/da/d1c/d23/d2d/l43 0 2024-02-28T23:07:06.206 INFO:tasks.workunit.client.0.smithi159.stdout:6/131: dread - d0/f2a zero size 2024-02-28T23:07:06.208 INFO:tasks.workunit.client.0.smithi159.stdout:8/203: unlink d2/d3/f8 0 2024-02-28T23:07:06.222 INFO:tasks.workunit.client.0.smithi159.stdout:5/183: dwrite d8/f13 [0,4194304] 0 2024-02-28T23:07:06.224 INFO:tasks.workunit.client.0.smithi159.stdout:8/204: symlink d2/d11/d35/l48 0 2024-02-28T23:07:06.227 INFO:tasks.workunit.client.0.smithi159.stdout:1/113: dread d6/f9 [0,4194304] 0 2024-02-28T23:07:06.229 INFO:tasks.workunit.client.0.smithi159.stdout:6/132: rename d0/d10 to d0/d1b/d33 0 2024-02-28T23:07:06.231 INFO:tasks.workunit.client.0.smithi159.stdout:8/205: read d2/fd [284255,107228] 0 2024-02-28T23:07:06.236 INFO:tasks.workunit.client.0.smithi159.stdout:0/162: getdents d0/d5/d14 0 2024-02-28T23:07:06.236 INFO:tasks.workunit.client.0.smithi159.stdout:5/184: dread d8/d19/f2d [0,4194304] 0 2024-02-28T23:07:06.238 INFO:tasks.workunit.client.0.smithi159.stdout:4/190: dwrite d9/da/d1c/d23/d2d/f41 [0,4194304] 0 2024-02-28T23:07:06.238 INFO:tasks.workunit.client.0.smithi159.stdout:5/185: dread - d8/d19/f36 zero size 2024-02-28T23:07:06.247 INFO:tasks.workunit.client.0.smithi159.stdout:8/206: rename d2/d3/f9 to d2/d21/d26/d36/d38/f49 0 2024-02-28T23:07:06.251 INFO:tasks.workunit.client.0.smithi159.stdout:4/191: symlink d9/da/d1c/d23/l44 0 2024-02-28T23:07:06.255 INFO:tasks.workunit.client.0.smithi159.stdout:0/163: rename d0/de/f1f to d0/d5/d14/d34/f3c 0 2024-02-28T23:07:06.256 INFO:tasks.workunit.client.0.smithi159.stdout:5/186: mkdir d8/d19/d23/d35/d38 0 2024-02-28T23:07:06.259 INFO:tasks.workunit.client.0.smithi159.stdout:1/114: dwrite d6/d1d/f1e [0,4194304] 0 2024-02-28T23:07:06.261 INFO:tasks.workunit.client.0.smithi159.stdout:6/133: dread d0/f7 [0,4194304] 0 2024-02-28T23:07:06.262 INFO:tasks.workunit.client.0.smithi159.stdout:4/192: rename l7 to d9/d20/l45 0 2024-02-28T23:07:06.263 INFO:tasks.workunit.client.0.smithi159.stdout:1/115: fsync d6/d12/d1a/f23 0 2024-02-28T23:07:06.268 INFO:tasks.workunit.client.0.smithi159.stdout:4/193: truncate d9/da/f3a 917928 0 2024-02-28T23:07:06.270 INFO:tasks.workunit.client.0.smithi159.stdout:5/187: creat d8/d19/d23/d35/d38/f39 x:0 0 0 2024-02-28T23:07:06.272 INFO:tasks.workunit.client.0.smithi159.stdout:6/134: mkdir d0/d1b/d33/d11/d34 0 2024-02-28T23:07:06.275 INFO:tasks.workunit.client.0.smithi159.stdout:8/207: dwrite d2/d11/f1b [0,4194304] 0 2024-02-28T23:07:06.275 INFO:tasks.workunit.client.0.smithi159.stdout:6/135: readlink d0/d1b/d33/d11/d14/l2f 0 2024-02-28T23:07:06.275 INFO:tasks.workunit.client.0.smithi159.stdout:5/188: write d8/d19/f1f [263813,59774] 0 2024-02-28T23:07:06.277 INFO:tasks.workunit.client.0.smithi159.stdout:6/136: chown d0/d1b/f20 1043138705 1 2024-02-28T23:07:06.277 INFO:tasks.workunit.client.0.smithi159.stdout:4/194: chown d9/da/f12 12 1 2024-02-28T23:07:06.280 INFO:tasks.workunit.client.0.smithi159.stdout:1/116: rename d6/f11 to d6/d12/d16/f24 0 2024-02-28T23:07:06.280 INFO:tasks.workunit.client.0.smithi159.stdout:4/195: write d9/f1f [3197335,97365] 0 2024-02-28T23:07:06.282 INFO:tasks.workunit.client.0.smithi159.stdout:5/189: write d8/f11 [4489065,31039] 0 2024-02-28T23:07:06.287 INFO:tasks.workunit.client.0.smithi159.stdout:6/137: write d0/fe [2084096,61912] 0 2024-02-28T23:07:06.290 INFO:tasks.workunit.client.0.smithi159.stdout:4/196: mknod d9/da/d1c/d23/d2d/c46 0 2024-02-28T23:07:06.292 INFO:tasks.workunit.client.0.smithi159.stdout:1/117: write d6/d12/f14 [223547,102] 0 2024-02-28T23:07:06.294 INFO:tasks.workunit.client.0.smithi159.stdout:5/190: mknod d8/d19/d23/d35/c3a 0 2024-02-28T23:07:06.295 INFO:tasks.workunit.client.0.smithi159.stdout:6/138: unlink d0/d1b/d33/d11/f1d 0 2024-02-28T23:07:06.297 INFO:tasks.workunit.client.0.smithi159.stdout:4/197: creat d9/da/f47 x:0 0 0 2024-02-28T23:07:06.300 INFO:tasks.workunit.client.0.smithi159.stdout:0/164: dwrite d0/d5/f7 [0,4194304] 0 2024-02-28T23:07:06.303 INFO:tasks.workunit.client.0.smithi159.stdout:8/208: dread d2/d3/f17 [0,4194304] 0 2024-02-28T23:07:06.304 INFO:tasks.workunit.client.0.smithi159.stdout:4/198: creat d9/d20/f48 x:0 0 0 2024-02-28T23:07:06.305 INFO:tasks.workunit.client.0.smithi159.stdout:4/199: dread - d9/f1e zero size 2024-02-28T23:07:06.306 INFO:tasks.workunit.client.0.smithi159.stdout:0/165: mkdir d0/d5/d14/d34/d3d 0 2024-02-28T23:07:06.314 INFO:tasks.workunit.client.0.smithi159.stdout:8/209: rmdir d2/d11/d35 39 2024-02-28T23:07:06.317 INFO:tasks.workunit.client.0.smithi159.stdout:8/210: unlink d2/d11/c34 0 2024-02-28T23:07:06.318 INFO:tasks.workunit.client.0.smithi159.stdout:4/200: mknod d9/c49 0 2024-02-28T23:07:06.319 INFO:tasks.workunit.client.0.smithi159.stdout:8/211: write d2/f3a [458812,122218] 0 2024-02-28T23:07:06.322 INFO:tasks.workunit.client.0.smithi159.stdout:6/139: write d0/d1b/f1f [335202,63797] 0 2024-02-28T23:07:06.322 INFO:tasks.workunit.client.0.smithi159.stdout:4/201: write d9/f19 [1530546,98235] 0 2024-02-28T23:07:06.326 INFO:tasks.workunit.client.0.smithi159.stdout:1/118: truncate d6/d12/f18 243482 0 2024-02-28T23:07:06.328 INFO:tasks.workunit.client.0.smithi159.stdout:0/166: write d0/fb [300886,9030] 0 2024-02-28T23:07:06.339 INFO:tasks.workunit.client.0.smithi159.stdout:6/140: write d0/d1b/d33/d11/d14/f28 [745899,104566] 0 2024-02-28T23:07:06.340 INFO:tasks.workunit.client.0.smithi159.stdout:1/119: dread d6/d12/f15 [0,4194304] 0 2024-02-28T23:07:06.342 INFO:tasks.workunit.client.0.smithi159.stdout:4/202: truncate d9/f1b 1259467 0 2024-02-28T23:07:06.343 INFO:tasks.workunit.client.0.smithi159.stdout:4/203: dread - d9/d20/f48 zero size 2024-02-28T23:07:06.345 INFO:tasks.workunit.client.0.smithi159.stdout:6/141: stat d0/d1b/d33/d11/l31 0 2024-02-28T23:07:06.345 INFO:tasks.workunit.client.0.smithi159.stdout:0/167: creat d0/f3e x:0 0 0 2024-02-28T23:07:06.349 INFO:tasks.workunit.client.0.smithi159.stdout:0/168: chown d0/d5/f33 30 1 2024-02-28T23:07:06.353 INFO:tasks.workunit.client.0.smithi159.stdout:6/142: dread d0/d1b/d33/d11/f2e [0,4194304] 0 2024-02-28T23:07:06.354 INFO:tasks.workunit.client.0.smithi159.stdout:0/169: creat d0/d5/f3f x:0 0 0 2024-02-28T23:07:06.359 INFO:tasks.workunit.client.0.smithi159.stdout:0/170: unlink d0/de/c35 0 2024-02-28T23:07:06.360 INFO:tasks.workunit.client.0.smithi159.stdout:1/120: dwrite d6/d1d/f1e [0,4194304] 0 2024-02-28T23:07:06.362 INFO:tasks.workunit.client.0.smithi159.stdout:6/143: creat d0/d1b/d33/d11/d34/f35 x:0 0 0 2024-02-28T23:07:06.363 INFO:tasks.workunit.client.0.smithi159.stdout:1/121: rmdir d6 39 2024-02-28T23:07:06.364 INFO:tasks.workunit.client.0.smithi159.stdout:6/144: stat d0/d1b/d33/d11/d14/f21 0 2024-02-28T23:07:06.364 INFO:tasks.workunit.client.0.smithi159.stdout:1/122: readlink l5 0 2024-02-28T23:07:06.365 INFO:tasks.workunit.client.0.smithi159.stdout:4/204: dwrite d9/da/d1c/d23/d2d/f3d [0,4194304] 0 2024-02-28T23:07:06.367 INFO:tasks.workunit.client.0.smithi159.stdout:0/171: creat d0/d5/d14/d25/d2c/f40 x:0 0 0 2024-02-28T23:07:06.367 INFO:tasks.workunit.client.0.smithi159.stdout:4/205: stat d9/da/d1c 0 2024-02-28T23:07:06.370 INFO:tasks.workunit.client.0.smithi159.stdout:4/206: write d9/da/f10 [612078,9437] 0 2024-02-28T23:07:06.372 INFO:tasks.workunit.client.0.smithi159.stdout:6/145: rename d0/d1b/f20 to d0/d1b/d33/d11/d14/d23/f36 0 2024-02-28T23:07:06.375 INFO:tasks.workunit.client.0.smithi159.stdout:0/172: symlink d0/de/d11/l41 0 2024-02-28T23:07:06.378 INFO:tasks.workunit.client.0.smithi159.stdout:6/146: readlink d0/l30 0 2024-02-28T23:07:06.379 INFO:tasks.workunit.client.0.smithi159.stdout:4/207: write d9/f18 [7810582,84659] 0 2024-02-28T23:07:06.382 INFO:tasks.workunit.client.0.smithi159.stdout:1/123: truncate d6/d12/fe 752681 0 2024-02-28T23:07:06.385 INFO:tasks.workunit.client.0.smithi159.stdout:6/147: rename d0/l30 to d0/d1b/d33/d11/d14/d23/l37 0 2024-02-28T23:07:06.385 INFO:tasks.workunit.client.0.smithi159.stdout:4/208: symlink d9/d20/l4a 0 2024-02-28T23:07:06.387 INFO:tasks.workunit.client.0.smithi159.stdout:1/124: symlink d6/d1d/l25 0 2024-02-28T23:07:06.388 INFO:tasks.workunit.client.0.smithi159.stdout:6/148: mkdir d0/d1b/d38 0 2024-02-28T23:07:06.389 INFO:tasks.workunit.client.0.smithi159.stdout:4/209: rename d9/da/d1c/d23 to d9/da/d1c/d23/d2d/d4b 22 2024-02-28T23:07:06.390 INFO:tasks.workunit.client.0.smithi159.stdout:1/125: rmdir d6/d1d 39 2024-02-28T23:07:06.391 INFO:tasks.workunit.client.0.smithi159.stdout:0/173: getdents d0/d5/d14/d25/d2c 0 2024-02-28T23:07:06.396 INFO:tasks.workunit.client.0.smithi159.stdout:0/174: write d0/d5/d14/d34/f3c [4381829,81646] 0 2024-02-28T23:07:06.397 INFO:tasks.workunit.client.0.smithi159.stdout:4/210: dread d9/d20/f29 [0,4194304] 0 2024-02-28T23:07:06.398 INFO:tasks.workunit.client.0.smithi159.stdout:1/126: creat d6/d1d/f26 x:0 0 0 2024-02-28T23:07:06.400 INFO:tasks.workunit.client.0.smithi159.stdout:1/127: write d6/d12/ff [1291385,6488] 0 2024-02-28T23:07:06.402 INFO:tasks.workunit.client.0.smithi159.stdout:4/211: readlink d9/l15 0 2024-02-28T23:07:06.404 INFO:tasks.workunit.client.0.smithi159.stdout:4/212: fsync d9/da/f3b 0 2024-02-28T23:07:06.405 INFO:tasks.workunit.client.0.smithi159.stdout:1/128: truncate d6/d12/d1a/f23 411906 0 2024-02-28T23:07:06.406 INFO:tasks.workunit.client.0.smithi159.stdout:4/213: chown d9/l35 2 1 2024-02-28T23:07:06.410 INFO:tasks.workunit.client.0.smithi159.stdout:1/129: symlink d6/d1d/l27 0 2024-02-28T23:07:06.411 INFO:tasks.workunit.client.0.smithi159.stdout:0/175: creat d0/f42 x:0 0 0 2024-02-28T23:07:06.413 INFO:tasks.workunit.client.0.smithi159.stdout:0/176: dread - d0/de/f2b zero size 2024-02-28T23:07:06.415 INFO:tasks.workunit.client.0.smithi159.stdout:1/130: rmdir d6 39 2024-02-28T23:07:06.415 INFO:tasks.workunit.client.0.smithi159.stdout:0/177: stat d0/de/f2b 0 2024-02-28T23:07:06.418 INFO:tasks.workunit.client.0.smithi159.stdout:0/178: creat d0/d5/d14/d25/d2c/f43 x:0 0 0 2024-02-28T23:07:06.420 INFO:tasks.workunit.client.0.smithi159.stdout:1/131: creat d6/d12/d16/f28 x:0 0 0 2024-02-28T23:07:06.421 INFO:tasks.workunit.client.0.smithi159.stdout:1/132: stat d6/d12/d16 0 2024-02-28T23:07:06.421 INFO:tasks.workunit.client.0.smithi159.stdout:0/179: creat d0/d5/d14/d25/d2c/f44 x:0 0 0 2024-02-28T23:07:06.425 INFO:tasks.workunit.client.0.smithi159.stdout:0/180: mkdir d0/d5/d14/d45 0 2024-02-28T23:07:06.425 INFO:tasks.workunit.client.0.smithi159.stdout:4/214: write d9/d20/f29 [672304,49048] 0 2024-02-28T23:07:06.431 INFO:tasks.workunit.client.0.smithi159.stdout:4/215: mkdir d9/d4c 0 2024-02-28T23:07:06.435 INFO:tasks.workunit.client.0.smithi159.stdout:4/216: unlink d9/d20/f3f 0 2024-02-28T23:07:06.441 INFO:tasks.workunit.client.0.smithi159.stdout:4/217: chown d9/da/d1c/d23/f37 536445233 1 2024-02-28T23:07:06.441 INFO:tasks.workunit.client.0.smithi159.stdout:0/181: dwrite d0/f6 [0,4194304] 0 2024-02-28T23:07:06.444 INFO:tasks.workunit.client.0.smithi159.stdout:1/133: dwrite d6/fb [0,4194304] 0 2024-02-28T23:07:06.444 INFO:tasks.workunit.client.0.smithi159.stdout:0/182: chown d0/de/l10 2 1 2024-02-28T23:07:06.448 INFO:tasks.workunit.client.0.smithi159.stdout:1/134: dread - d6/d1d/f26 zero size 2024-02-28T23:07:06.448 INFO:tasks.workunit.client.0.smithi159.stdout:0/183: read - d0/f42 zero size 2024-02-28T23:07:06.453 INFO:tasks.workunit.client.0.smithi159.stdout:1/135: chown d6/d12/f18 69 1 2024-02-28T23:07:06.456 INFO:tasks.workunit.client.0.smithi159.stdout:0/184: rename d0/d5/d14/d45 to d0/de/d46 0 2024-02-28T23:07:06.458 INFO:tasks.workunit.client.0.smithi159.stdout:4/218: dread d9/da/d1c/d23/d2d/f41 [0,4194304] 0 2024-02-28T23:07:06.462 INFO:tasks.workunit.client.0.smithi159.stdout:1/136: rename d6/d12/d16/c17 to d6/d1d/c29 0 2024-02-28T23:07:06.462 INFO:tasks.workunit.client.0.smithi159.stdout:4/219: creat d9/da/d1c/d23/f4d x:0 0 0 2024-02-28T23:07:06.464 INFO:tasks.workunit.client.0.smithi159.stdout:4/220: fdatasync d9/da/d1c/d23/f2f 0 2024-02-28T23:07:06.469 INFO:tasks.workunit.client.0.smithi159.stdout:4/221: write d9/da/d1c/d23/f2f [401058,28255] 0 2024-02-28T23:07:06.471 INFO:tasks.workunit.client.0.smithi159.stdout:4/222: readlink d9/da/l14 0 2024-02-28T23:07:06.473 INFO:tasks.workunit.client.0.smithi159.stdout:4/223: truncate d9/da/f47 436082 0 2024-02-28T23:07:06.476 INFO:tasks.workunit.client.0.smithi159.stdout:4/224: unlink d9/da/c40 0 2024-02-28T23:07:06.478 INFO:tasks.workunit.client.0.smithi159.stdout:1/137: dread d6/d12/fe [0,4194304] 0 2024-02-28T23:07:06.485 INFO:tasks.workunit.client.0.smithi159.stdout:0/185: dwrite d0/d5/d14/d34/f3c [0,4194304] 0 2024-02-28T23:07:06.485 INFO:tasks.workunit.client.0.smithi159.stdout:1/138: write d6/f9 [2833789,130890] 0 2024-02-28T23:07:06.489 INFO:tasks.workunit.client.0.smithi159.stdout:0/186: truncate d0/f27 289650 0 2024-02-28T23:07:06.490 INFO:tasks.workunit.client.0.smithi159.stdout:1/139: fdatasync d6/d12/f18 0 2024-02-28T23:07:06.495 INFO:tasks.workunit.client.0.smithi159.stdout:0/187: rename d0/de/f29 to d0/d5/d14/d34/f47 0 2024-02-28T23:07:06.496 INFO:tasks.workunit.client.0.smithi159.stdout:4/225: dwrite d9/da/fc [0,4194304] 0 2024-02-28T23:07:06.501 INFO:tasks.workunit.client.0.smithi159.stdout:1/140: creat d6/d12/f2a x:0 0 0 2024-02-28T23:07:06.504 INFO:tasks.workunit.client.0.smithi159.stdout:1/141: read d6/d12/fe [1706182,97727] 0 2024-02-28T23:07:06.505 INFO:tasks.workunit.client.0.smithi159.stdout:4/226: write d9/da/f3a [1548780,60468] 0 2024-02-28T23:07:06.508 INFO:tasks.workunit.client.0.smithi159.stdout:4/227: chown d9/l35 82533 1 2024-02-28T23:07:06.519 INFO:tasks.workunit.client.0.smithi159.stdout:4/228: getdents d9/da/d1c 0 2024-02-28T23:07:06.519 INFO:tasks.workunit.client.0.smithi159.stdout:0/188: dwrite d0/f3 [0,4194304] 0 2024-02-28T23:07:06.523 INFO:tasks.workunit.client.0.smithi159.stdout:4/229: creat d9/f4e x:0 0 0 2024-02-28T23:07:06.526 INFO:tasks.workunit.client.0.smithi159.stdout:0/189: mknod d0/d5/d14/d25/c48 0 2024-02-28T23:07:06.526 INFO:tasks.workunit.client.0.smithi159.stdout:3/157: sync 2024-02-28T23:07:06.529 INFO:tasks.workunit.client.0.smithi159.stdout:3/158: chown d0/c14 0 1 2024-02-28T23:07:06.531 INFO:tasks.workunit.client.0.smithi159.stdout:4/230: symlink d9/da/d1c/d23/l4f 0 2024-02-28T23:07:06.531 INFO:tasks.workunit.client.0.smithi159.stdout:3/159: fdatasync d0/d6/f13 0 2024-02-28T23:07:06.531 INFO:tasks.workunit.client.0.smithi159.stdout:1/142: dwrite d6/d12/f1b [0,4194304] 0 2024-02-28T23:07:06.533 INFO:tasks.workunit.client.0.smithi159.stdout:3/160: dread - d0/f35 zero size 2024-02-28T23:07:06.536 INFO:tasks.workunit.client.0.smithi159.stdout:0/190: rename d0/cd to d0/de/d11/c49 0 2024-02-28T23:07:06.542 INFO:tasks.workunit.client.0.smithi159.stdout:4/231: mknod d9/da/d1c/c50 0 2024-02-28T23:07:06.542 INFO:tasks.workunit.client.0.smithi159.stdout:1/143: creat d6/d12/d1a/f2b x:0 0 0 2024-02-28T23:07:06.543 INFO:tasks.workunit.client.0.smithi159.stdout:3/161: mknod d0/d2b/c36 0 2024-02-28T23:07:06.544 INFO:tasks.workunit.client.0.smithi159.stdout:0/191: getdents d0/de/d46 0 2024-02-28T23:07:06.545 INFO:tasks.workunit.client.0.smithi159.stdout:4/232: mknod d9/d20/c51 0 2024-02-28T23:07:06.547 INFO:tasks.workunit.client.0.smithi159.stdout:1/144: creat d6/f2c x:0 0 0 2024-02-28T23:07:06.550 INFO:tasks.workunit.client.0.smithi159.stdout:1/145: symlink d6/d12/d16/l2d 0 2024-02-28T23:07:06.551 INFO:tasks.workunit.client.0.smithi159.stdout:1/146: stat d6/f20 0 2024-02-28T23:07:06.552 INFO:tasks.workunit.client.0.smithi159.stdout:4/233: link d9/l15 d9/da/l52 0 2024-02-28T23:07:06.554 INFO:tasks.workunit.client.0.smithi159.stdout:4/234: truncate d9/f1e 564262 0 2024-02-28T23:07:06.555 INFO:tasks.workunit.client.0.smithi159.stdout:1/147: mknod d6/d12/c2e 0 2024-02-28T23:07:06.557 INFO:tasks.workunit.client.0.smithi159.stdout:0/192: dread d0/d5/d14/d34/f47 [0,4194304] 0 2024-02-28T23:07:06.557 INFO:tasks.workunit.client.0.smithi159.stdout:1/148: write d6/d12/ff [3010577,88191] 0 2024-02-28T23:07:06.559 INFO:tasks.workunit.client.0.smithi159.stdout:1/149: chown d6/d12/ff 51 1 2024-02-28T23:07:06.560 INFO:tasks.workunit.client.0.smithi159.stdout:0/193: creat d0/de/f4a x:0 0 0 2024-02-28T23:07:06.561 INFO:tasks.workunit.client.0.smithi159.stdout:1/150: dread - d6/f2c zero size 2024-02-28T23:07:06.568 INFO:tasks.workunit.client.0.smithi159.stdout:1/151: rmdir d6/d12/d16 39 2024-02-28T23:07:06.714 INFO:tasks.workunit.client.0.smithi159.stdout:0/194: truncate d0/d5/d14/d34/f47 558896 0 2024-02-28T23:07:06.715 INFO:tasks.workunit.client.0.smithi159.stdout:4/235: creat d9/da/d1c/f53 x:0 0 0 2024-02-28T23:07:06.717 INFO:tasks.workunit.client.0.smithi159.stdout:4/236: chown d9/da/f47 4480 1 2024-02-28T23:07:06.724 INFO:tasks.workunit.client.0.smithi159.stdout:0/195: mkdir d0/d5/d14/d25/d2c/d4b 0 2024-02-28T23:07:06.724 INFO:tasks.workunit.client.0.smithi159.stdout:1/152: creat d6/d12/f2f x:0 0 0 2024-02-28T23:07:06.727 INFO:tasks.workunit.client.0.smithi159.stdout:1/153: write d6/d12/f1b [5222748,87627] 0 2024-02-28T23:07:06.730 INFO:tasks.workunit.client.0.smithi159.stdout:4/237: chown d9/da/d1c/d23/d2d/c36 21401187 1 2024-02-28T23:07:06.738 INFO:tasks.workunit.client.0.smithi159.stdout:1/154: truncate d6/d12/d16/f28 713855 0 2024-02-28T23:07:06.744 INFO:tasks.workunit.client.0.smithi159.stdout:1/155: symlink d6/d1d/l30 0 2024-02-28T23:07:06.747 INFO:tasks.workunit.client.0.smithi159.stdout:7/119: sync 2024-02-28T23:07:06.748 INFO:tasks.workunit.client.0.smithi159.stdout:0/196: mknod d0/de/c4c 0 2024-02-28T23:07:06.749 INFO:tasks.workunit.client.0.smithi159.stdout:0/197: stat d0/fb 0 2024-02-28T23:07:06.749 INFO:tasks.workunit.client.0.smithi159.stdout:9/115: sync 2024-02-28T23:07:06.752 INFO:tasks.workunit.client.0.smithi159.stdout:9/116: write d4/f13 [2960494,93423] 0 2024-02-28T23:07:06.756 INFO:tasks.workunit.client.0.smithi159.stdout:4/238: getdents d9 0 2024-02-28T23:07:06.757 INFO:tasks.workunit.client.0.smithi159.stdout:7/120: readlink d5/l7 0 2024-02-28T23:07:06.758 INFO:tasks.workunit.client.0.smithi159.stdout:1/156: mkdir d6/d12/d31 0 2024-02-28T23:07:06.767 INFO:tasks.workunit.client.0.smithi159.stdout:7/121: mknod d5/d10/c23 0 2024-02-28T23:07:06.771 INFO:tasks.workunit.client.0.smithi159.stdout:0/198: symlink d0/d5/d14/d25/d2c/d4b/l4d 0 2024-02-28T23:07:06.773 INFO:tasks.workunit.client.0.smithi159.stdout:0/199: fsync d0/f27 0 2024-02-28T23:07:06.773 INFO:tasks.workunit.client.0.smithi159.stdout:7/122: mkdir d5/d16/d1a/d24 0 2024-02-28T23:07:06.779 INFO:tasks.workunit.client.0.smithi159.stdout:0/200: stat d0/d5/d14/d25/d2c/d4b 0 2024-02-28T23:07:06.780 INFO:tasks.workunit.client.0.smithi159.stdout:1/157: dwrite d6/d12/f15 [0,4194304] 0 2024-02-28T23:07:06.780 INFO:tasks.workunit.client.0.smithi159.stdout:7/123: unlink d5/d16/l17 0 2024-02-28T23:07:06.785 INFO:tasks.workunit.client.0.smithi159.stdout:7/124: mknod d5/d16/d1a/c25 0 2024-02-28T23:07:06.799 INFO:tasks.workunit.client.0.smithi159.stdout:0/201: getdents d0 0 2024-02-28T23:07:06.802 INFO:tasks.workunit.client.0.smithi159.stdout:1/158: getdents d6/d12 0 2024-02-28T23:07:06.807 INFO:tasks.workunit.client.0.smithi159.stdout:7/125: rename d5/f1d to d5/f26 0 2024-02-28T23:07:06.817 INFO:tasks.workunit.client.0.smithi159.stdout:0/202: dwrite d0/de/f4a [0,4194304] 0 2024-02-28T23:07:06.825 INFO:tasks.workunit.client.0.smithi159.stdout:0/203: mknod d0/d5/d14/d25/c4e 0 2024-02-28T23:07:06.828 INFO:tasks.workunit.client.0.smithi159.stdout:7/126: rmdir d5/d16 39 2024-02-28T23:07:06.835 INFO:tasks.workunit.client.0.smithi159.stdout:7/127: readlink d5/d16/l20 0 2024-02-28T23:07:06.840 INFO:tasks.workunit.client.0.smithi159.stdout:7/128: mkdir d5/d16/d1a/d27 0 2024-02-28T23:07:06.841 INFO:tasks.workunit.client.0.smithi159.stdout:7/129: readlink d5/d16/l20 0 2024-02-28T23:07:06.842 INFO:tasks.workunit.client.0.smithi159.stdout:0/204: creat d0/d5/d14/f4f x:0 0 0 2024-02-28T23:07:06.843 INFO:tasks.workunit.client.0.smithi159.stdout:0/205: fsync d0/de/f2b 0 2024-02-28T23:07:06.848 INFO:tasks.workunit.client.0.smithi159.stdout:0/206: chown d0/d5/d14/d25/d2c/f44 3604 1 2024-02-28T23:07:06.852 INFO:tasks.workunit.client.0.smithi159.stdout:7/130: link d5/d16/d1a/c25 d5/d16/d1a/d24/c28 0 2024-02-28T23:07:06.852 INFO:tasks.workunit.client.0.smithi159.stdout:0/207: write d0/de/f2b [41075,116752] 0 2024-02-28T23:07:06.852 INFO:tasks.workunit.client.0.smithi159.stdout:7/131: write d5/fd [2896069,57578] 0 2024-02-28T23:07:06.855 INFO:tasks.workunit.client.0.smithi159.stdout:0/208: creat d0/d5/f50 x:0 0 0 2024-02-28T23:07:06.858 INFO:tasks.workunit.client.0.smithi159.stdout:7/132: mkdir d5/d16/d1a/d27/d29 0 2024-02-28T23:07:06.858 INFO:tasks.workunit.client.0.smithi159.stdout:0/209: read d0/d5/ff [3585007,7671] 0 2024-02-28T23:07:06.861 INFO:tasks.workunit.client.0.smithi159.stdout:0/210: symlink d0/de/d11/l51 0 2024-02-28T23:07:06.865 INFO:tasks.workunit.client.0.smithi159.stdout:7/133: mkdir d5/d16/d1a/d27/d29/d2a 0 2024-02-28T23:07:06.879 INFO:tasks.workunit.client.0.smithi159.stdout:0/211: dread d0/d5/f7 [0,4194304] 0 2024-02-28T23:07:06.882 INFO:tasks.workunit.client.0.smithi159.stdout:0/212: chown d0/c1a 0 1 2024-02-28T23:07:06.888 INFO:tasks.workunit.client.0.smithi159.stdout:2/129: sync 2024-02-28T23:07:06.889 INFO:tasks.workunit.client.0.smithi159.stdout:0/213: rename d0/d5/c9 to d0/de/d11/c52 0 2024-02-28T23:07:06.891 INFO:tasks.workunit.client.0.smithi159.stdout:0/214: fdatasync d0/d5/d14/d25/f39 0 2024-02-28T23:07:06.893 INFO:tasks.workunit.client.0.smithi159.stdout:0/215: stat d0/d5/d14/d25/c4e 0 2024-02-28T23:07:06.894 INFO:tasks.workunit.client.0.smithi159.stdout:5/191: sync 2024-02-28T23:07:06.897 INFO:tasks.workunit.client.0.smithi159.stdout:0/216: truncate d0/d5/d14/d25/f39 852436 0 2024-02-28T23:07:06.898 INFO:tasks.workunit.client.0.smithi159.stdout:0/217: fsync d0/f3 0 2024-02-28T23:07:06.900 INFO:tasks.workunit.client.0.smithi159.stdout:5/192: link d8/f21 d8/d19/d23/d2a/f3b 0 2024-02-28T23:07:06.903 INFO:tasks.workunit.client.0.smithi159.stdout:5/193: read d8/d19/f1f [288653,92802] 0 2024-02-28T23:07:06.906 INFO:tasks.workunit.client.0.smithi159.stdout:0/218: creat d0/d5/f53 x:0 0 0 2024-02-28T23:07:06.912 INFO:tasks.workunit.client.0.smithi159.stdout:2/130: dwrite d9/f25 [0,4194304] 0 2024-02-28T23:07:06.917 INFO:tasks.workunit.client.0.smithi159.stdout:0/219: creat d0/d5/d14/d25/d2c/d4b/f54 x:0 0 0 2024-02-28T23:07:06.923 INFO:tasks.workunit.client.0.smithi159.stdout:5/194: dread d8/f10 [0,4194304] 0 2024-02-28T23:07:06.926 INFO:tasks.workunit.client.0.smithi159.stdout:2/131: symlink d9/de/l27 0 2024-02-28T23:07:06.929 INFO:tasks.workunit.client.0.smithi159.stdout:5/195: truncate d8/f21 813812 0 2024-02-28T23:07:06.929 INFO:tasks.workunit.client.0.smithi159.stdout:2/132: write d9/de/d13/f26 [520625,69008] 0 2024-02-28T23:07:06.930 INFO:tasks.workunit.client.0.smithi159.stdout:0/220: link d0/de/d11/l28 d0/d5/d14/d25/d2c/d4b/l55 0 2024-02-28T23:07:06.931 INFO:tasks.workunit.client.0.smithi159.stdout:5/196: write d8/d16/f33 [792555,127961] 0 2024-02-28T23:07:06.932 INFO:tasks.workunit.client.0.smithi159.stdout:2/133: write d9/f20 [630122,79651] 0 2024-02-28T23:07:06.937 INFO:tasks.workunit.client.0.smithi159.stdout:5/197: write d8/d19/f36 [938154,7875] 0 2024-02-28T23:07:06.938 INFO:tasks.workunit.client.0.smithi159.stdout:5/198: fdatasync f6 0 2024-02-28T23:07:06.940 INFO:tasks.workunit.client.0.smithi159.stdout:5/199: write d8/f17 [354522,114466] 0 2024-02-28T23:07:06.945 INFO:tasks.workunit.client.0.smithi159.stdout:5/200: creat d8/d19/f3c x:0 0 0 2024-02-28T23:07:06.948 INFO:tasks.workunit.client.0.smithi159.stdout:2/134: dread f6 [0,4194304] 0 2024-02-28T23:07:06.949 INFO:tasks.workunit.client.0.smithi159.stdout:5/201: creat d8/d19/d23/d35/d38/f3d x:0 0 0 2024-02-28T23:07:06.949 INFO:tasks.workunit.client.0.smithi159.stdout:5/202: readlink d8/d19/l29 0 2024-02-28T23:07:06.955 INFO:tasks.workunit.client.0.smithi159.stdout:0/221: truncate d0/de/d11/f21 4073662 0 2024-02-28T23:07:06.957 INFO:tasks.workunit.client.0.smithi159.stdout:0/222: chown d0/l23 2868347 1 2024-02-28T23:07:06.962 INFO:tasks.workunit.client.0.smithi159.stdout:2/135: truncate d9/f16 556269 0 2024-02-28T23:07:06.962 INFO:tasks.workunit.client.0.smithi159.stdout:0/223: unlink d0/de/d11/f19 0 2024-02-28T23:07:06.983 INFO:tasks.workunit.client.0.smithi159.stdout:0/224: dread d0/f6 [0,4194304] 0 2024-02-28T23:07:06.984 INFO:tasks.workunit.client.0.smithi159.stdout:2/136: dwrite f7 [4194304,4194304] 0 2024-02-28T23:07:06.988 INFO:tasks.workunit.client.0.smithi159.stdout:2/137: symlink d9/l28 0 2024-02-28T23:07:06.990 INFO:tasks.workunit.client.0.smithi159.stdout:0/225: rename d0/d5/d14/d25/d2c/f40 to d0/d5/d14/d25/d2c/f56 0 2024-02-28T23:07:06.990 INFO:tasks.workunit.client.0.smithi159.stdout:2/138: rmdir d9/d23 39 2024-02-28T23:07:06.992 INFO:tasks.workunit.client.0.smithi159.stdout:0/226: mknod d0/d5/c57 0 2024-02-28T23:07:06.995 INFO:tasks.workunit.client.0.smithi159.stdout:0/227: creat d0/d5/d14/d25/f58 x:0 0 0 2024-02-28T23:07:06.996 INFO:tasks.workunit.client.0.smithi159.stdout:2/139: creat d9/de/f29 x:0 0 0 2024-02-28T23:07:06.998 INFO:tasks.workunit.client.0.smithi159.stdout:0/228: truncate d0/f3e 342903 0 2024-02-28T23:07:06.998 INFO:tasks.workunit.client.0.smithi159.stdout:2/140: write f7 [2203703,129478] 0 2024-02-28T23:07:07.003 INFO:tasks.workunit.client.0.smithi159.stdout:2/141: unlink d9/d23/l24 0 2024-02-28T23:07:07.015 INFO:tasks.workunit.client.0.smithi159.stdout:2/142: dread d9/f11 [0,4194304] 0 2024-02-28T23:07:07.019 INFO:tasks.workunit.client.0.smithi159.stdout:0/229: dwrite d0/f1e [0,4194304] 0 2024-02-28T23:07:07.022 INFO:tasks.workunit.client.0.smithi159.stdout:2/143: dread d9/de/ff [0,4194304] 0 2024-02-28T23:07:07.031 INFO:tasks.workunit.client.0.smithi159.stdout:2/144: truncate f6 1860795 0 2024-02-28T23:07:07.039 INFO:tasks.workunit.client.0.smithi159.stdout:0/230: dwrite d0/fb [0,4194304] 0 2024-02-28T23:07:07.041 INFO:tasks.workunit.client.0.smithi159.stdout:0/231: fdatasync d0/f3e 0 2024-02-28T23:07:07.047 INFO:tasks.workunit.client.0.smithi159.stdout:2/145: dread d9/de/d13/f14 [0,4194304] 0 2024-02-28T23:07:07.056 INFO:tasks.workunit.client.0.smithi159.stdout:2/146: rmdir d9 39 2024-02-28T23:07:07.059 INFO:tasks.workunit.client.0.smithi159.stdout:2/147: chown d9/la 3921 1 2024-02-28T23:07:07.064 INFO:tasks.workunit.client.0.smithi159.stdout:0/232: dwrite d0/f1e [0,4194304] 0 2024-02-28T23:07:07.070 INFO:tasks.workunit.client.0.smithi159.stdout:2/148: dread d9/f11 [0,4194304] 0 2024-02-28T23:07:07.078 INFO:tasks.workunit.client.0.smithi159.stdout:0/233: getdents d0/d5/d14/d34 0 2024-02-28T23:07:07.083 INFO:tasks.workunit.client.0.smithi159.stdout:2/149: rename d9/de/d13/f1f to d9/de/f2a 0 2024-02-28T23:07:07.087 INFO:tasks.workunit.client.0.smithi159.stdout:2/150: fsync f6 0 2024-02-28T23:07:07.090 INFO:tasks.workunit.client.0.smithi159.stdout:2/151: stat d9/de/d13/l15 0 2024-02-28T23:07:07.094 INFO:tasks.workunit.client.0.smithi159.stdout:0/234: dwrite d0/fb [4194304,4194304] 0 2024-02-28T23:07:07.100 INFO:tasks.workunit.client.0.smithi159.stdout:2/152: link d9/l1e d9/l2b 0 2024-02-28T23:07:07.116 INFO:tasks.workunit.client.0.smithi159.stdout:0/235: dwrite d0/d5/d14/d25/d2c/f56 [0,4194304] 0 2024-02-28T23:07:07.119 INFO:tasks.workunit.client.0.smithi159.stdout:8/212: sync 2024-02-28T23:07:07.119 INFO:tasks.workunit.client.0.smithi159.stdout:3/162: sync 2024-02-28T23:07:07.119 INFO:tasks.workunit.client.0.smithi159.stdout:6/149: sync 2024-02-28T23:07:07.120 INFO:tasks.workunit.client.0.smithi159.stdout:2/153: dwrite d9/f25 [4194304,4194304] 0 2024-02-28T23:07:07.122 INFO:tasks.workunit.client.0.smithi159.stdout:3/163: write d0/f12 [4104867,9157] 0 2024-02-28T23:07:07.127 INFO:tasks.workunit.client.0.smithi159.stdout:8/213: symlink d2/d21/d26/l4a 0 2024-02-28T23:07:07.128 INFO:tasks.workunit.client.0.smithi159.stdout:3/164: write d0/d8/f22 [20122,104192] 0 2024-02-28T23:07:07.128 INFO:tasks.workunit.client.0.smithi159.stdout:0/236: getdents d0/d5/d14/d34/d3d 0 2024-02-28T23:07:07.129 INFO:tasks.workunit.client.0.smithi159.stdout:8/214: chown d2/d3/l1c 950362 1 2024-02-28T23:07:07.132 INFO:tasks.workunit.client.0.smithi159.stdout:3/165: read - d0/d6/f32 zero size 2024-02-28T23:07:07.133 INFO:tasks.workunit.client.0.smithi159.stdout:3/166: stat d0/f23 0 2024-02-28T23:07:07.135 INFO:tasks.workunit.client.0.smithi159.stdout:3/167: write d0/f35 [397409,45705] 0 2024-02-28T23:07:07.139 INFO:tasks.workunit.client.0.smithi159.stdout:2/154: dread d9/f11 [0,4194304] 0 2024-02-28T23:07:07.141 INFO:tasks.workunit.client.0.smithi159.stdout:3/168: write d0/d2b/f29 [537275,80370] 0 2024-02-28T23:07:07.144 INFO:tasks.workunit.client.0.smithi159.stdout:0/237: rename d0/d5/d14/d25/d2c/d4b/l55 to d0/d5/d14/d25/l59 0 2024-02-28T23:07:07.147 INFO:tasks.workunit.client.0.smithi159.stdout:0/238: write d0/de/f4a [477464,48817] 0 2024-02-28T23:07:07.149 INFO:tasks.workunit.client.0.smithi159.stdout:6/150: write d0/f2a [999019,7797] 0 2024-02-28T23:07:07.157 INFO:tasks.workunit.client.0.smithi159.stdout:8/215: dwrite d2/f40 [0,4194304] 0 2024-02-28T23:07:07.161 INFO:tasks.workunit.client.0.smithi159.stdout:6/151: creat d0/d1b/d38/f39 x:0 0 0 2024-02-28T23:07:07.163 INFO:tasks.workunit.client.0.smithi159.stdout:2/155: dread d9/f16 [0,4194304] 0 2024-02-28T23:07:07.167 INFO:tasks.workunit.client.0.smithi159.stdout:3/169: dwrite d0/d8/f1d [4194304,4194304] 0 2024-02-28T23:07:07.172 INFO:tasks.workunit.client.0.smithi159.stdout:3/170: read d0/d8/f22 [11631,73962] 0 2024-02-28T23:07:07.173 INFO:tasks.workunit.client.0.smithi159.stdout:2/156: write d9/de/d13/f14 [4670814,84817] 0 2024-02-28T23:07:07.173 INFO:tasks.workunit.client.0.smithi159.stdout:3/171: write d0/f12 [834144,57554] 0 2024-02-28T23:07:07.173 INFO:tasks.workunit.client.0.smithi159.stdout:6/152: link d0/d1b/f29 d0/d1b/f3a 0 2024-02-28T23:07:07.174 INFO:tasks.workunit.client.0.smithi159.stdout:3/172: fsync d0/d2b/f29 0 2024-02-28T23:07:07.176 INFO:tasks.workunit.client.0.smithi159.stdout:6/153: stat d0/d1b/d38 0 2024-02-28T23:07:07.176 INFO:tasks.workunit.client.0.smithi159.stdout:8/216: dread d2/fd [0,4194304] 0 2024-02-28T23:07:07.178 INFO:tasks.workunit.client.0.smithi159.stdout:8/217: write d2/f3a [162454,8458] 0 2024-02-28T23:07:07.182 INFO:tasks.workunit.client.0.smithi159.stdout:6/154: unlink d0/d1b/d33/d11/f2c 0 2024-02-28T23:07:07.183 INFO:tasks.workunit.client.0.smithi159.stdout:0/239: truncate d0/f6 1892218 0 2024-02-28T23:07:07.184 INFO:tasks.workunit.client.0.smithi159.stdout:0/240: fsync d0/f42 0 2024-02-28T23:07:07.184 INFO:tasks.workunit.client.0.smithi159.stdout:8/218: rmdir d2/d21/d26/d36 39 2024-02-28T23:07:07.187 INFO:tasks.workunit.client.0.smithi159.stdout:6/155: write d0/d1b/f1f [683595,122191] 0 2024-02-28T23:07:07.188 INFO:tasks.workunit.client.0.smithi159.stdout:8/219: dread d2/fd [0,4194304] 0 2024-02-28T23:07:07.194 INFO:tasks.workunit.client.0.smithi159.stdout:6/156: mknod d0/d1b/d33/d11/d14/d23/c3b 0 2024-02-28T23:07:07.198 INFO:tasks.workunit.client.0.smithi159.stdout:3/173: fsync d0/d8/f1d 0 2024-02-28T23:07:07.198 INFO:tasks.workunit.client.0.smithi159.stdout:6/157: creat d0/d1b/f3c x:0 0 0 2024-02-28T23:07:07.199 INFO:tasks.workunit.client.0.smithi159.stdout:3/174: chown d0/f35 47702 1 2024-02-28T23:07:07.204 INFO:tasks.workunit.client.0.smithi159.stdout:8/220: dread d2/f40 [0,4194304] 0 2024-02-28T23:07:07.204 INFO:tasks.workunit.client.0.smithi159.stdout:0/241: truncate d0/d5/d14/d34/f3c 1548488 0 2024-02-28T23:07:07.205 INFO:tasks.workunit.client.0.smithi159.stdout:6/158: creat d0/d1b/d33/f3d x:0 0 0 2024-02-28T23:07:07.206 INFO:tasks.workunit.client.0.smithi159.stdout:3/175: symlink d0/d6/l37 0 2024-02-28T23:07:07.208 INFO:tasks.workunit.client.0.smithi159.stdout:0/242: symlink d0/l5a 0 2024-02-28T23:07:07.208 INFO:tasks.workunit.client.0.smithi159.stdout:8/221: dread d2/ff [0,4194304] 0 2024-02-28T23:07:07.210 INFO:tasks.workunit.client.0.smithi159.stdout:3/176: symlink d0/d2b/l38 0 2024-02-28T23:07:07.211 INFO:tasks.workunit.client.0.smithi159.stdout:6/159: creat d0/d1b/d33/d11/d34/f3e x:0 0 0 2024-02-28T23:07:07.212 INFO:tasks.workunit.client.0.smithi159.stdout:6/160: stat d0/d1b/d33/f18 0 2024-02-28T23:07:07.212 INFO:tasks.workunit.client.0.smithi159.stdout:8/222: fsync d2/d3/f14 0 2024-02-28T23:07:07.214 INFO:tasks.workunit.client.0.smithi159.stdout:0/243: creat d0/d5/d14/d25/f5b x:0 0 0 2024-02-28T23:07:07.216 INFO:tasks.workunit.client.0.smithi159.stdout:6/161: mkdir d0/d1b/d33/d3f 0 2024-02-28T23:07:07.218 INFO:tasks.workunit.client.0.smithi159.stdout:6/162: dread - d0/d1b/d33/f18 zero size 2024-02-28T23:07:07.220 INFO:tasks.workunit.client.0.smithi159.stdout:6/163: dread - d0/d1b/d33/f18 zero size 2024-02-28T23:07:07.220 INFO:tasks.workunit.client.0.smithi159.stdout:0/244: mkdir d0/d5/d14/d25/d5c 0 2024-02-28T23:07:07.222 INFO:tasks.workunit.client.0.smithi159.stdout:3/177: getdents d0/d6/d19 0 2024-02-28T23:07:07.226 INFO:tasks.workunit.client.0.smithi159.stdout:6/164: fdatasync d0/fb 0 2024-02-28T23:07:07.227 INFO:tasks.workunit.client.0.smithi159.stdout:0/245: symlink d0/d5/d14/d34/l5d 0 2024-02-28T23:07:07.232 INFO:tasks.workunit.client.0.smithi159.stdout:8/223: truncate d2/f40 1676275 0 2024-02-28T23:07:07.236 INFO:tasks.workunit.client.0.smithi159.stdout:0/246: creat d0/d5/f5e x:0 0 0 2024-02-28T23:07:07.236 INFO:tasks.workunit.client.0.smithi159.stdout:6/165: fsync d0/d1b/f3a 0 2024-02-28T23:07:07.243 INFO:tasks.workunit.client.0.smithi159.stdout:0/247: mkdir d0/de/d11/d5f 0 2024-02-28T23:07:07.247 INFO:tasks.workunit.client.0.smithi159.stdout:0/248: dread - d0/d5/f53 zero size 2024-02-28T23:07:07.250 INFO:tasks.workunit.client.0.smithi159.stdout:8/224: dwrite d2/f3a [0,4194304] 0 2024-02-28T23:07:07.255 INFO:tasks.workunit.client.0.smithi159.stdout:6/166: rename d0/d1b/d33/d11/d14/d23/l37 to d0/d1b/d33/d11/l40 0 2024-02-28T23:07:07.255 INFO:tasks.workunit.client.0.smithi159.stdout:3/178: truncate d0/d2b/f26 381047 0 2024-02-28T23:07:07.258 INFO:tasks.workunit.client.0.smithi159.stdout:6/167: stat d0/d1b/d33/d11/d14/d23/f36 0 2024-02-28T23:07:07.260 INFO:tasks.workunit.client.0.smithi159.stdout:8/225: write d2/d3/f13 [8922893,55252] 0 2024-02-28T23:07:07.266 INFO:tasks.workunit.client.0.smithi159.stdout:8/226: rename d2/d3/f2c to d2/d11/f4b 0 2024-02-28T23:07:07.271 INFO:tasks.workunit.client.0.smithi159.stdout:9/117: sync 2024-02-28T23:07:07.278 INFO:tasks.workunit.client.0.smithi159.stdout:6/168: rename d0/lf to d0/d1b/d33/d11/d34/l41 0 2024-02-28T23:07:07.280 INFO:tasks.workunit.client.0.smithi159.stdout:8/227: creat d2/d21/d26/f4c x:0 0 0 2024-02-28T23:07:07.282 INFO:tasks.workunit.client.0.smithi159.stdout:0/249: dwrite d0/d5/d14/d25/d2c/d4b/f54 [0,4194304] 0 2024-02-28T23:07:07.285 INFO:tasks.workunit.client.0.smithi159.stdout:3/179: dwrite d0/fe [4194304,4194304] 0 2024-02-28T23:07:07.292 INFO:tasks.workunit.client.0.smithi159.stdout:6/169: mknod d0/d1b/d33/d11/d34/c42 0 2024-02-28T23:07:07.294 INFO:tasks.workunit.client.0.smithi159.stdout:3/180: read d0/d8/f1d [3741787,43554] 0 2024-02-28T23:07:07.300 INFO:tasks.workunit.client.0.smithi159.stdout:6/170: rename d0/d1b/d33/d11/d14/d23/f36 to d0/d1b/d33/f43 0 2024-02-28T23:07:07.301 INFO:tasks.workunit.client.0.smithi159.stdout:0/250: dread d0/f3 [0,4194304] 0 2024-02-28T23:07:07.304 INFO:tasks.workunit.client.0.smithi159.stdout:0/251: readlink d0/de/l32 0 2024-02-28T23:07:07.308 INFO:tasks.workunit.client.0.smithi159.stdout:6/171: mkdir d0/d1b/d33/d3f/d44 0 2024-02-28T23:07:07.314 INFO:tasks.workunit.client.0.smithi159.stdout:0/252: rename d0/d5/d14/d25/d2c/f56 to d0/d5/d14/d25/d5c/f60 0 2024-02-28T23:07:07.316 INFO:tasks.workunit.client.0.smithi159.stdout:3/181: truncate d0/fe 3485623 0 2024-02-28T23:07:07.317 INFO:tasks.workunit.client.0.smithi159.stdout:3/182: truncate d0/d6/f32 1015631 0 2024-02-28T23:07:07.320 INFO:tasks.workunit.client.0.smithi159.stdout:0/253: creat d0/de/d46/f61 x:0 0 0 2024-02-28T23:07:07.322 INFO:tasks.workunit.client.0.smithi159.stdout:0/254: chown d0/d5/d14/d25/f39 60998138 1 2024-02-28T23:07:07.324 INFO:tasks.workunit.client.0.smithi159.stdout:0/255: fdatasync d0/d5/d14/f4f 0 2024-02-28T23:07:07.329 INFO:tasks.workunit.client.0.smithi159.stdout:3/183: creat d0/d8/d2f/f39 x:0 0 0 2024-02-28T23:07:07.329 INFO:tasks.workunit.client.0.smithi159.stdout:0/256: fsync d0/fb 0 2024-02-28T23:07:07.337 INFO:tasks.workunit.client.0.smithi159.stdout:6/172: truncate d0/d1b/d33/d11/d14/d23/f27 3915090 0 2024-02-28T23:07:07.340 INFO:tasks.workunit.client.0.smithi159.stdout:0/257: symlink d0/d5/d14/l62 0 2024-02-28T23:07:07.340 INFO:tasks.workunit.client.0.smithi159.stdout:9/118: dread d4/f13 [0,4194304] 0 2024-02-28T23:07:07.347 INFO:tasks.workunit.client.0.smithi159.stdout:9/119: creat d4/f25 x:0 0 0 2024-02-28T23:07:07.348 INFO:tasks.workunit.client.0.smithi159.stdout:0/258: mkdir d0/d5/d38/d63 0 2024-02-28T23:07:07.349 INFO:tasks.workunit.client.0.smithi159.stdout:6/173: link d0/d1b/d33/d11/d14/l25 d0/d1b/l45 0 2024-02-28T23:07:07.350 INFO:tasks.workunit.client.0.smithi159.stdout:9/120: fdatasync d4/f13 0 2024-02-28T23:07:07.350 INFO:tasks.workunit.client.0.smithi159.stdout:6/174: stat d0/d1b/d33 0 2024-02-28T23:07:07.351 INFO:tasks.workunit.client.0.smithi159.stdout:0/259: symlink d0/d5/d14/d25/d2c/l64 0 2024-02-28T23:07:07.353 INFO:tasks.workunit.client.0.smithi159.stdout:6/175: chown d0/d1b/d33/f43 119010 1 2024-02-28T23:07:07.353 INFO:tasks.workunit.client.0.smithi159.stdout:9/121: creat d4/f26 x:0 0 0 2024-02-28T23:07:07.357 INFO:tasks.workunit.client.0.smithi159.stdout:0/260: creat d0/d5/d14/d34/d3d/f65 x:0 0 0 2024-02-28T23:07:07.360 INFO:tasks.workunit.client.0.smithi159.stdout:0/261: mknod d0/de/c66 0 2024-02-28T23:07:07.364 INFO:tasks.workunit.client.0.smithi159.stdout:3/184: dread d0/d6/f13 [0,4194304] 0 2024-02-28T23:07:07.369 INFO:tasks.workunit.client.0.smithi159.stdout:9/122: dread d4/f13 [0,4194304] 0 2024-02-28T23:07:07.371 INFO:tasks.workunit.client.0.smithi159.stdout:3/185: creat d0/d6/d19/f3a x:0 0 0 2024-02-28T23:07:07.371 INFO:tasks.workunit.client.0.smithi159.stdout:0/262: dread d0/d5/d14/d34/f3c [0,4194304] 0 2024-02-28T23:07:07.372 INFO:tasks.workunit.client.0.smithi159.stdout:9/123: creat d4/d17/f27 x:0 0 0 2024-02-28T23:07:07.373 INFO:tasks.workunit.client.0.smithi159.stdout:9/124: stat d4/c1d 0 2024-02-28T23:07:07.380 INFO:tasks.workunit.client.0.smithi159.stdout:3/186: symlink d0/l3b 0 2024-02-28T23:07:07.381 INFO:tasks.workunit.client.0.smithi159.stdout:6/176: write d0/f8 [1055410,68255] 0 2024-02-28T23:07:07.395 INFO:tasks.workunit.client.0.smithi159.stdout:9/125: dwrite d4/fe [0,4194304] 0 2024-02-28T23:07:07.398 INFO:tasks.workunit.client.0.smithi159.stdout:3/187: dread d0/d6/d19/f2d [0,4194304] 0 2024-02-28T23:07:07.406 INFO:tasks.workunit.client.0.smithi159.stdout:0/263: truncate d0/d5/d14/d25/d2c/d4b/f54 738832 0 2024-02-28T23:07:07.410 INFO:tasks.workunit.client.0.smithi159.stdout:9/126: dread d4/f13 [0,4194304] 0 2024-02-28T23:07:07.411 INFO:tasks.workunit.client.0.smithi159.stdout:4/239: sync 2024-02-28T23:07:07.416 INFO:tasks.workunit.client.0.smithi159.stdout:9/127: symlink d4/l28 0 2024-02-28T23:07:07.419 INFO:tasks.workunit.client.0.smithi159.stdout:3/188: dwrite d0/f23 [0,4194304] 0 2024-02-28T23:07:07.423 INFO:tasks.workunit.client.0.smithi159.stdout:4/240: unlink d9/da/f3b 0 2024-02-28T23:07:07.425 INFO:tasks.workunit.client.0.smithi159.stdout:4/241: write d9/f1e [857479,91673] 0 2024-02-28T23:07:07.428 INFO:tasks.workunit.client.0.smithi159.stdout:6/177: write d0/d1b/d33/d11/d14/d23/f27 [46556,41911] 0 2024-02-28T23:07:07.434 INFO:tasks.workunit.client.0.smithi159.stdout:9/128: dread d4/f13 [0,4194304] 0 2024-02-28T23:07:07.435 INFO:tasks.workunit.client.0.smithi159.stdout:0/264: getdents d0/d5 0 2024-02-28T23:07:07.435 INFO:tasks.workunit.client.0.smithi159.stdout:0/265: fsync d0/d5/f33 0 2024-02-28T23:07:07.439 INFO:tasks.workunit.client.0.smithi159.stdout:3/189: rename d0/c20 to d0/d8/d2f/c3c 0 2024-02-28T23:07:07.440 INFO:tasks.workunit.client.0.smithi159.stdout:8/228: sync 2024-02-28T23:07:07.440 INFO:tasks.workunit.client.0.smithi159.stdout:5/203: sync 2024-02-28T23:07:07.440 INFO:tasks.workunit.client.0.smithi159.stdout:2/157: sync 2024-02-28T23:07:07.441 INFO:tasks.workunit.client.0.smithi159.stdout:7/134: sync 2024-02-28T23:07:07.441 INFO:tasks.workunit.client.0.smithi159.stdout:1/159: sync 2024-02-28T23:07:07.441 INFO:tasks.workunit.client.0.smithi159.stdout:0/266: dread d0/d5/d14/d25/f39 [0,4194304] 0 2024-02-28T23:07:07.448 INFO:tasks.workunit.client.0.smithi159.stdout:9/129: creat d4/d17/f29 x:0 0 0 2024-02-28T23:07:07.449 INFO:tasks.workunit.client.0.smithi159.stdout:8/229: chown d2/d21/d26/c2e 800 1 2024-02-28T23:07:07.452 INFO:tasks.workunit.client.0.smithi159.stdout:9/130: dread - d4/f25 zero size 2024-02-28T23:07:07.455 INFO:tasks.workunit.client.0.smithi159.stdout:6/178: dwrite d0/d1b/d33/d11/d34/f3e [0,4194304] 0 2024-02-28T23:07:07.456 INFO:tasks.workunit.client.0.smithi159.stdout:5/204: dread d8/f17 [0,4194304] 0 2024-02-28T23:07:07.456 INFO:tasks.workunit.client.0.smithi159.stdout:3/190: creat d0/d6/d19/f3d x:0 0 0 2024-02-28T23:07:07.456 INFO:tasks.workunit.client.0.smithi159.stdout:2/158: mkdir d9/d23/d2c 0 2024-02-28T23:07:07.457 INFO:tasks.workunit.client.0.smithi159.stdout:1/160: symlink d6/d12/l32 0 2024-02-28T23:07:07.462 INFO:tasks.workunit.client.0.smithi159.stdout:0/267: rename d0/d5/d14/d25/f5b to d0/d5/d14/d25/d5c/f67 0 2024-02-28T23:07:07.468 INFO:tasks.workunit.client.0.smithi159.stdout:8/230: creat d2/d21/f4d x:0 0 0 2024-02-28T23:07:07.475 INFO:tasks.workunit.client.0.smithi159.stdout:0/268: write d0/f3 [5292221,126563] 0 2024-02-28T23:07:07.475 INFO:tasks.workunit.client.0.smithi159.stdout:3/191: dread d0/f35 [0,4194304] 0 2024-02-28T23:07:07.475 INFO:tasks.workunit.client.0.smithi159.stdout:5/205: creat d8/d19/d23/d35/d38/f3e x:0 0 0 2024-02-28T23:07:07.475 INFO:tasks.workunit.client.0.smithi159.stdout:6/179: symlink d0/d1b/d33/d11/l46 0 2024-02-28T23:07:07.475 INFO:tasks.workunit.client.0.smithi159.stdout:3/192: dread - d0/d8/d2f/f39 zero size 2024-02-28T23:07:07.481 INFO:tasks.workunit.client.0.smithi159.stdout:9/131: dwrite d4/fe [0,4194304] 0 2024-02-28T23:07:07.484 INFO:tasks.workunit.client.0.smithi159.stdout:1/161: unlink d6/d1d/l27 0 2024-02-28T23:07:07.484 INFO:tasks.workunit.client.0.smithi159.stdout:7/135: creat d5/d16/d1a/d27/d29/d2a/f2b x:0 0 0 2024-02-28T23:07:07.486 INFO:tasks.workunit.client.0.smithi159.stdout:8/231: dread d2/d3/f2a [0,4194304] 0 2024-02-28T23:07:07.487 INFO:tasks.workunit.client.0.smithi159.stdout:0/269: creat d0/de/f68 x:0 0 0 2024-02-28T23:07:07.489 INFO:tasks.workunit.client.0.smithi159.stdout:7/136: read d5/fa [2695685,100091] 0 2024-02-28T23:07:07.490 INFO:tasks.workunit.client.0.smithi159.stdout:2/159: creat d9/d23/d2c/f2d x:0 0 0 2024-02-28T23:07:07.492 INFO:tasks.workunit.client.0.smithi159.stdout:9/132: creat d4/d17/f2a x:0 0 0 2024-02-28T23:07:07.503 INFO:tasks.workunit.client.0.smithi159.stdout:4/242: dwrite d9/da/f13 [0,4194304] 0 2024-02-28T23:07:07.503 INFO:tasks.workunit.client.0.smithi159.stdout:6/180: dwrite d0/d1b/d33/d11/d34/f35 [0,4194304] 0 2024-02-28T23:07:07.506 INFO:tasks.workunit.client.0.smithi159.stdout:9/133: rename d4/lf to d4/l2b 0 2024-02-28T23:07:07.508 INFO:tasks.workunit.client.0.smithi159.stdout:9/134: chown d4/l9 139 1 2024-02-28T23:07:07.508 INFO:tasks.workunit.client.0.smithi159.stdout:5/206: creat d8/f3f x:0 0 0 2024-02-28T23:07:07.508 INFO:tasks.workunit.client.0.smithi159.stdout:7/137: symlink d5/d16/d1a/d27/d29/d2a/l2c 0 2024-02-28T23:07:07.510 INFO:tasks.workunit.client.0.smithi159.stdout:0/270: creat d0/d5/d38/d63/f69 x:0 0 0 2024-02-28T23:07:07.514 INFO:tasks.workunit.client.0.smithi159.stdout:5/207: chown d8/d19/d23/d35/c3a 55805 1 2024-02-28T23:07:07.516 INFO:tasks.workunit.client.0.smithi159.stdout:5/208: chown d8/d19/f36 2019380 1 2024-02-28T23:07:07.517 INFO:tasks.workunit.client.0.smithi159.stdout:5/209: dread - d8/d19/f3c zero size 2024-02-28T23:07:07.518 INFO:tasks.workunit.client.0.smithi159.stdout:8/232: mknod d2/d21/d26/d36/c4e 0 2024-02-28T23:07:07.520 INFO:tasks.workunit.client.0.smithi159.stdout:2/160: unlink d9/l2b 0 2024-02-28T23:07:07.522 INFO:tasks.workunit.client.0.smithi159.stdout:1/162: write d6/d12/fe [455300,66038] 0 2024-02-28T23:07:07.526 INFO:tasks.workunit.client.0.smithi159.stdout:0/271: stat d0/d5/c2d 0 2024-02-28T23:07:07.528 INFO:tasks.workunit.client.0.smithi159.stdout:7/138: creat d5/d16/d1a/d27/f2d x:0 0 0 2024-02-28T23:07:07.531 INFO:tasks.workunit.client.0.smithi159.stdout:5/210: creat d8/d19/f40 x:0 0 0 2024-02-28T23:07:07.533 INFO:tasks.workunit.client.0.smithi159.stdout:9/135: read d4/f11 [2664914,61846] 0 2024-02-28T23:07:07.533 INFO:tasks.workunit.client.0.smithi159.stdout:8/233: mknod d2/d21/d26/d36/d38/c4f 0 2024-02-28T23:07:07.534 INFO:tasks.workunit.client.0.smithi159.stdout:8/234: dread - d2/d3/f46 zero size 2024-02-28T23:07:07.536 INFO:tasks.workunit.client.0.smithi159.stdout:9/136: truncate d4/d17/f27 986319 0 2024-02-28T23:07:07.537 INFO:tasks.workunit.client.0.smithi159.stdout:9/137: fsync d4/d17/f29 0 2024-02-28T23:07:07.538 INFO:tasks.workunit.client.0.smithi159.stdout:8/235: truncate d2/d21/f32 239570 0 2024-02-28T23:07:07.539 INFO:tasks.workunit.client.0.smithi159.stdout:4/243: mkdir d9/d42/d54 0 2024-02-28T23:07:07.540 INFO:tasks.workunit.client.0.smithi159.stdout:0/272: mknod d0/d5/d14/d34/d3d/c6a 0 2024-02-28T23:07:07.541 INFO:tasks.workunit.client.0.smithi159.stdout:7/139: mknod d5/d16/d1a/c2e 0 2024-02-28T23:07:07.544 INFO:tasks.workunit.client.0.smithi159.stdout:4/244: fsync d9/d20/f48 0 2024-02-28T23:07:07.544 INFO:tasks.workunit.client.0.smithi159.stdout:0/273: chown d0/f3 72055 1 2024-02-28T23:07:07.546 INFO:tasks.workunit.client.0.smithi159.stdout:7/140: chown d5/d16/l20 4022244 1 2024-02-28T23:07:07.547 INFO:tasks.workunit.client.0.smithi159.stdout:9/138: symlink d4/l2c 0 2024-02-28T23:07:07.548 INFO:tasks.workunit.client.0.smithi159.stdout:1/163: mkdir d6/d12/d33 0 2024-02-28T23:07:07.548 INFO:tasks.workunit.client.0.smithi159.stdout:7/141: chown d5/f26 3594877 1 2024-02-28T23:07:07.552 INFO:tasks.workunit.client.0.smithi159.stdout:9/139: truncate d4/d17/f2a 258124 0 2024-02-28T23:07:07.552 INFO:tasks.workunit.client.0.smithi159.stdout:7/142: fdatasync d5/d16/d1a/d27/d29/d2a/f2b 0 2024-02-28T23:07:07.558 INFO:tasks.workunit.client.0.smithi159.stdout:4/245: mkdir d9/d42/d54/d55 0 2024-02-28T23:07:07.559 INFO:tasks.workunit.client.0.smithi159.stdout:9/140: fsync d4/d17/f29 0 2024-02-28T23:07:07.560 INFO:tasks.workunit.client.0.smithi159.stdout:7/143: creat d5/d16/d1a/d27/d29/f2f x:0 0 0 2024-02-28T23:07:07.564 INFO:tasks.workunit.client.0.smithi159.stdout:4/246: mkdir d9/d42/d54/d56 0 2024-02-28T23:07:07.564 INFO:tasks.workunit.client.0.smithi159.stdout:0/274: dread d0/f1e [0,4194304] 0 2024-02-28T23:07:07.571 INFO:tasks.workunit.client.0.smithi159.stdout:9/141: truncate d4/f26 88419 0 2024-02-28T23:07:07.572 INFO:tasks.workunit.client.0.smithi159.stdout:2/161: write f6 [1193812,108058] 0 2024-02-28T23:07:07.578 INFO:tasks.workunit.client.0.smithi159.stdout:6/181: truncate d0/d1b/f1f 791624 0 2024-02-28T23:07:07.578 INFO:tasks.workunit.client.0.smithi159.stdout:5/211: dwrite d8/f17 [0,4194304] 0 2024-02-28T23:07:07.582 INFO:tasks.workunit.client.0.smithi159.stdout:4/247: creat d9/d42/d54/f57 x:0 0 0 2024-02-28T23:07:07.585 INFO:tasks.workunit.client.0.smithi159.stdout:8/236: dwrite d2/d21/d26/d36/d38/f39 [0,4194304] 0 2024-02-28T23:07:07.586 INFO:tasks.workunit.client.0.smithi159.stdout:6/182: fsync d0/d1b/d33/d11/d34/f3e 0 2024-02-28T23:07:07.586 INFO:tasks.workunit.client.0.smithi159.stdout:5/212: unlink d8/d19/c1d 0 2024-02-28T23:07:07.588 INFO:tasks.workunit.client.0.smithi159.stdout:4/248: chown d9/da/d1c/d23/l4f 1627560 1 2024-02-28T23:07:07.589 INFO:tasks.workunit.client.0.smithi159.stdout:6/183: chown d0/d1b/d38 42621 1 2024-02-28T23:07:07.596 INFO:tasks.workunit.client.0.smithi159.stdout:8/237: fsync d2/d21/f4d 0 2024-02-28T23:07:07.603 INFO:tasks.workunit.client.0.smithi159.stdout:4/249: write d9/da/f16 [452779,124096] 0 2024-02-28T23:07:07.605 INFO:tasks.workunit.client.0.smithi159.stdout:8/238: chown d2/d21/d47 18 1 2024-02-28T23:07:07.606 INFO:tasks.workunit.client.0.smithi159.stdout:7/144: link d5/f21 d5/d16/f30 0 2024-02-28T23:07:07.610 INFO:tasks.workunit.client.0.smithi159.stdout:1/164: dwrite d6/d12/d16/f1c [0,4194304] 0 2024-02-28T23:07:07.615 INFO:tasks.workunit.client.0.smithi159.stdout:0/275: dwrite d0/d5/d38/d63/f69 [0,4194304] 0 2024-02-28T23:07:07.615 INFO:tasks.workunit.client.0.smithi159.stdout:5/213: mkdir d8/d19/d23/d35/d41 0 2024-02-28T23:07:07.616 INFO:tasks.workunit.client.0.smithi159.stdout:6/184: mkdir d0/d1b/d38/d47 0 2024-02-28T23:07:07.621 INFO:tasks.workunit.client.0.smithi159.stdout:0/276: chown d0/de/f4a 5 1 2024-02-28T23:07:07.621 INFO:tasks.workunit.client.0.smithi159.stdout:9/142: dwrite d4/d17/f2a [0,4194304] 0 2024-02-28T23:07:07.627 INFO:tasks.workunit.client.0.smithi159.stdout:2/162: dread f8 [0,4194304] 0 2024-02-28T23:07:07.632 INFO:tasks.workunit.client.0.smithi159.stdout:5/214: mkdir d8/d19/d23/d42 0 2024-02-28T23:07:07.633 INFO:tasks.workunit.client.0.smithi159.stdout:5/215: read - d8/f3f zero size 2024-02-28T23:07:07.635 INFO:tasks.workunit.client.0.smithi159.stdout:2/163: truncate d9/f1d 214869 0 2024-02-28T23:07:07.643 INFO:tasks.workunit.client.0.smithi159.stdout:7/145: dwrite d5/fd [0,4194304] 0 2024-02-28T23:07:07.648 INFO:tasks.workunit.client.0.smithi159.stdout:2/164: read d9/de/f2a [119270,81491] 0 2024-02-28T23:07:07.652 INFO:tasks.workunit.client.0.smithi159.stdout:9/143: creat d4/d17/f2d x:0 0 0 2024-02-28T23:07:07.656 INFO:tasks.workunit.client.0.smithi159.stdout:4/250: creat d9/d4c/f58 x:0 0 0 2024-02-28T23:07:07.659 INFO:tasks.workunit.client.0.smithi159.stdout:4/251: write d9/d20/f22 [624387,75013] 0 2024-02-28T23:07:07.663 INFO:tasks.workunit.client.0.smithi159.stdout:0/277: creat d0/de/d11/d5f/f6b x:0 0 0 2024-02-28T23:07:07.665 INFO:tasks.workunit.client.0.smithi159.stdout:7/146: creat d5/d16/d1a/d27/f31 x:0 0 0 2024-02-28T23:07:07.665 INFO:tasks.workunit.client.0.smithi159.stdout:2/165: truncate d9/de/ff 1883004 0 2024-02-28T23:07:07.666 INFO:tasks.workunit.client.0.smithi159.stdout:8/239: creat d2/d21/d26/f50 x:0 0 0 2024-02-28T23:07:07.667 INFO:tasks.workunit.client.0.smithi159.stdout:0/278: dread d0/f3e [0,4194304] 0 2024-02-28T23:07:07.668 INFO:tasks.workunit.client.0.smithi159.stdout:0/279: stat d0/d5/f3a 0 2024-02-28T23:07:07.670 INFO:tasks.workunit.client.0.smithi159.stdout:4/252: mkdir d9/da/d1c/d23/d2d/d59 0 2024-02-28T23:07:07.670 INFO:tasks.workunit.client.0.smithi159.stdout:0/280: write d0/d5/d14/d25/d2c/f43 [446628,71306] 0 2024-02-28T23:07:07.671 INFO:tasks.workunit.client.0.smithi159.stdout:7/147: mknod d5/d16/c32 0 2024-02-28T23:07:07.673 INFO:tasks.workunit.client.0.smithi159.stdout:7/148: fdatasync d5/d16/d1a/d27/d29/f2f 0 2024-02-28T23:07:07.674 INFO:tasks.workunit.client.0.smithi159.stdout:9/144: link d4/f26 d4/d17/f2e 0 2024-02-28T23:07:07.678 INFO:tasks.workunit.client.0.smithi159.stdout:2/166: write d9/f11 [1719722,109409] 0 2024-02-28T23:07:07.679 INFO:tasks.workunit.client.0.smithi159.stdout:5/216: rmdir d8/d19/d23/d42 0 2024-02-28T23:07:07.681 INFO:tasks.workunit.client.0.smithi159.stdout:6/185: getdents d0/d1b/d33/d3f 0 2024-02-28T23:07:07.685 INFO:tasks.workunit.client.0.smithi159.stdout:4/253: rename d9/da/f10 to d9/d4c/f5a 0 2024-02-28T23:07:07.687 INFO:tasks.workunit.client.0.smithi159.stdout:0/281: unlink d0/d5/d14/l62 0 2024-02-28T23:07:07.689 INFO:tasks.workunit.client.0.smithi159.stdout:3/193: sync 2024-02-28T23:07:07.693 INFO:tasks.workunit.client.0.smithi159.stdout:4/254: dread d9/da/f47 [0,4194304] 0 2024-02-28T23:07:07.693 INFO:tasks.workunit.client.0.smithi159.stdout:0/282: dread - d0/d5/f5e zero size 2024-02-28T23:07:07.693 INFO:tasks.workunit.client.0.smithi159.stdout:7/149: creat d5/d16/d1a/d27/d29/f33 x:0 0 0 2024-02-28T23:07:07.696 INFO:tasks.workunit.client.0.smithi159.stdout:8/240: creat d2/d21/d47/f51 x:0 0 0 2024-02-28T23:07:07.696 INFO:tasks.workunit.client.0.smithi159.stdout:2/167: symlink d9/de/d13/l2e 0 2024-02-28T23:07:07.698 INFO:tasks.workunit.client.0.smithi159.stdout:0/283: dread - d0/d5/f53 zero size 2024-02-28T23:07:07.698 INFO:tasks.workunit.client.0.smithi159.stdout:1/165: truncate d6/d12/f14 2742801 0 2024-02-28T23:07:07.699 INFO:tasks.workunit.client.0.smithi159.stdout:9/145: dwrite d4/fe [0,4194304] 0 2024-02-28T23:07:07.700 INFO:tasks.workunit.client.0.smithi159.stdout:8/241: fdatasync d2/f15 0 2024-02-28T23:07:07.701 INFO:tasks.workunit.client.0.smithi159.stdout:4/255: creat d9/f5b x:0 0 0 2024-02-28T23:07:07.702 INFO:tasks.workunit.client.0.smithi159.stdout:6/186: chown d0/f2b 11632 1 2024-02-28T23:07:07.703 INFO:tasks.workunit.client.0.smithi159.stdout:8/242: readlink d2/lb 0 2024-02-28T23:07:07.704 INFO:tasks.workunit.client.0.smithi159.stdout:5/217: dread d8/f17 [0,4194304] 0 2024-02-28T23:07:07.704 INFO:tasks.workunit.client.0.smithi159.stdout:1/166: write d6/d12/d16/f28 [1036777,35831] 0 2024-02-28T23:07:07.705 INFO:tasks.workunit.client.0.smithi159.stdout:0/284: chown d0/cc 10975 1 2024-02-28T23:07:07.705 INFO:tasks.workunit.client.0.smithi159.stdout:7/150: creat d5/d10/f34 x:0 0 0 2024-02-28T23:07:07.708 INFO:tasks.workunit.client.0.smithi159.stdout:8/243: chown d2/d21/d26/d36/c4e 49918 1 2024-02-28T23:07:07.710 INFO:tasks.workunit.client.0.smithi159.stdout:9/146: rename d4/l23 to d4/l2f 0 2024-02-28T23:07:07.713 INFO:tasks.workunit.client.0.smithi159.stdout:1/167: read - d6/d12/d16/f24 zero size 2024-02-28T23:07:07.713 INFO:tasks.workunit.client.0.smithi159.stdout:8/244: truncate d2/d3/f1f 192874 0 2024-02-28T23:07:07.714 INFO:tasks.workunit.client.0.smithi159.stdout:0/285: truncate d0/d5/d14/d25/d5c/f60 4425678 0 2024-02-28T23:07:07.722 INFO:tasks.workunit.client.0.smithi159.stdout:9/147: creat d4/f30 x:0 0 0 2024-02-28T23:07:07.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:07 smithi159 ceph-mon[28802]: pgmap v22: 65 pgs: 65 active+clean; 353 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 24 MiB/s wr, 204 op/s 2024-02-28T23:07:07.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:07 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:07.724 INFO:tasks.workunit.client.0.smithi159.stdout:0/286: mkdir d0/d5/d14/d34/d6c 0 2024-02-28T23:07:07.725 INFO:tasks.workunit.client.0.smithi159.stdout:2/168: rename d9/f1d to d9/de/f2f 0 2024-02-28T23:07:07.725 INFO:tasks.workunit.client.0.smithi159.stdout:1/168: truncate d6/d12/f1b 5443477 0 2024-02-28T23:07:07.729 INFO:tasks.workunit.client.0.smithi159.stdout:2/169: write d9/de/d13/f26 [613254,12887] 0 2024-02-28T23:07:07.731 INFO:tasks.workunit.client.0.smithi159.stdout:5/218: dwrite d8/d19/d23/d35/d38/f39 [0,4194304] 0 2024-02-28T23:07:07.740 INFO:tasks.workunit.client.0.smithi159.stdout:0/287: creat d0/d5/d14/d25/f6d x:0 0 0 2024-02-28T23:07:07.741 INFO:tasks.workunit.client.0.smithi159.stdout:2/170: mknod d9/d23/d2c/c30 0 2024-02-28T23:07:07.743 INFO:tasks.workunit.client.0.smithi159.stdout:8/245: getdents d2/d21/d26 0 2024-02-28T23:07:07.743 INFO:tasks.workunit.client.0.smithi159.stdout:7/151: write d5/fb [364157,65661] 0 2024-02-28T23:07:07.745 INFO:tasks.workunit.client.0.smithi159.stdout:5/219: unlink d8/d19/d23/d35/d38/f3d 0 2024-02-28T23:07:07.750 INFO:tasks.workunit.client.0.smithi159.stdout:0/288: symlink d0/l6e 0 2024-02-28T23:07:07.755 INFO:tasks.workunit.client.0.smithi159.stdout:9/148: write d4/f26 [183388,11320] 0 2024-02-28T23:07:07.758 INFO:tasks.workunit.client.0.smithi159.stdout:4/256: mknod d9/d4c/c5c 0 2024-02-28T23:07:07.759 INFO:tasks.workunit.client.0.smithi159.stdout:6/187: dwrite d0/f9 [0,4194304] 0 2024-02-28T23:07:07.764 INFO:tasks.workunit.client.0.smithi159.stdout:9/149: mknod d4/d17/c31 0 2024-02-28T23:07:07.767 INFO:tasks.workunit.client.0.smithi159.stdout:9/150: stat d4/c10 0 2024-02-28T23:07:07.770 INFO:tasks.workunit.client.0.smithi159.stdout:8/246: rename d2/d21 to d2/d11/d52 0 2024-02-28T23:07:07.773 INFO:tasks.workunit.client.0.smithi159.stdout:8/247: stat d2/d11/d52 0 2024-02-28T23:07:07.774 INFO:tasks.workunit.client.0.smithi159.stdout:2/171: getdents d9 0 2024-02-28T23:07:07.775 INFO:tasks.workunit.client.0.smithi159.stdout:4/257: fdatasync d9/da/d1c/f53 0 2024-02-28T23:07:07.778 INFO:tasks.workunit.client.0.smithi159.stdout:5/220: dwrite d8/d19/f2e [0,4194304] 0 2024-02-28T23:07:07.778 INFO:tasks.workunit.client.0.smithi159.stdout:6/188: mknod d0/d1b/d33/d11/d34/c48 0 2024-02-28T23:07:07.780 INFO:tasks.workunit.client.0.smithi159.stdout:4/258: chown d9/da/d1c/c50 741 1 2024-02-28T23:07:07.781 INFO:tasks.workunit.client.0.smithi159.stdout:9/151: creat d4/f32 x:0 0 0 2024-02-28T23:07:07.785 INFO:tasks.workunit.client.0.smithi159.stdout:7/152: rename d5/cf to d5/d10/c35 0 2024-02-28T23:07:07.791 INFO:tasks.workunit.client.0.smithi159.stdout:8/248: mknod d2/d3/c53 0 2024-02-28T23:07:07.793 INFO:tasks.workunit.client.0.smithi159.stdout:7/153: read - d5/d16/d1a/d27/f31 zero size 2024-02-28T23:07:07.795 INFO:tasks.workunit.client.0.smithi159.stdout:2/172: mkdir d9/de/d13/d31 0 2024-02-28T23:07:07.799 INFO:tasks.workunit.client.0.smithi159.stdout:0/289: dwrite d0/d5/f3a [0,4194304] 0 2024-02-28T23:07:07.805 INFO:tasks.workunit.client.0.smithi159.stdout:4/259: creat d9/da/d1c/d23/d2d/d59/f5d x:0 0 0 2024-02-28T23:07:07.808 INFO:tasks.workunit.client.0.smithi159.stdout:2/173: rmdir d9/de 39 2024-02-28T23:07:07.810 INFO:tasks.workunit.client.0.smithi159.stdout:7/154: dread - d5/d16/d1a/d27/d29/d2a/f2b zero size 2024-02-28T23:07:07.818 INFO:tasks.workunit.client.0.smithi159.stdout:0/290: creat d0/d5/d14/d25/d5c/f6f x:0 0 0 2024-02-28T23:07:07.827 INFO:tasks.workunit.client.0.smithi159.stdout:4/260: dread - d9/f3c zero size 2024-02-28T23:07:07.827 INFO:tasks.workunit.client.0.smithi159.stdout:6/189: dwrite d0/d1b/d33/d11/d14/f21 [0,4194304] 0 2024-02-28T23:07:07.827 INFO:tasks.workunit.client.0.smithi159.stdout:9/152: dwrite d4/d17/f24 [0,4194304] 0 2024-02-28T23:07:07.837 INFO:tasks.workunit.client.0.smithi159.stdout:5/221: dread f0 [0,4194304] 0 2024-02-28T23:07:07.838 INFO:tasks.workunit.client.0.smithi159.stdout:9/153: mknod d4/d17/c33 0 2024-02-28T23:07:07.840 INFO:tasks.workunit.client.0.smithi159.stdout:4/261: fdatasync d9/d20/f48 0 2024-02-28T23:07:07.840 INFO:tasks.workunit.client.0.smithi159.stdout:8/249: dwrite d2/d11/d52/d26/d36/d38/f39 [0,4194304] 0 2024-02-28T23:07:07.841 INFO:tasks.workunit.client.0.smithi159.stdout:6/190: read d0/d1b/d33/f43 [3235547,118538] 0 2024-02-28T23:07:07.845 INFO:tasks.workunit.client.0.smithi159.stdout:2/174: creat d9/d23/d2c/f32 x:0 0 0 2024-02-28T23:07:07.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:07 smithi184 ceph-mon[36198]: pgmap v22: 65 pgs: 65 active+clean; 353 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.5 MiB/s rd, 24 MiB/s wr, 204 op/s 2024-02-28T23:07:07.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:07 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:07.851 INFO:tasks.workunit.client.0.smithi159.stdout:5/222: creat d8/d19/d23/d2a/f43 x:0 0 0 2024-02-28T23:07:07.852 INFO:tasks.workunit.client.0.smithi159.stdout:0/291: creat d0/d5/d14/f70 x:0 0 0 2024-02-28T23:07:07.857 INFO:tasks.workunit.client.0.smithi159.stdout:8/250: creat d2/d11/d52/f54 x:0 0 0 2024-02-28T23:07:07.860 INFO:tasks.workunit.client.0.smithi159.stdout:6/191: write d0/d1b/f3a [18269,92372] 0 2024-02-28T23:07:07.862 INFO:tasks.workunit.client.0.smithi159.stdout:5/223: symlink d8/d19/d23/d35/d41/l44 0 2024-02-28T23:07:07.867 INFO:tasks.workunit.client.0.smithi159.stdout:6/192: read d0/f2b [3146333,101426] 0 2024-02-28T23:07:07.867 INFO:tasks.workunit.client.0.smithi159.stdout:0/292: link d0/d5/d14/d25/f31 d0/f71 0 2024-02-28T23:07:07.869 INFO:tasks.workunit.client.0.smithi159.stdout:9/154: dwrite d4/d17/f24 [0,4194304] 0 2024-02-28T23:07:07.869 INFO:tasks.workunit.client.0.smithi159.stdout:7/155: dwrite d5/f12 [0,4194304] 0 2024-02-28T23:07:07.876 INFO:tasks.workunit.client.0.smithi159.stdout:2/175: creat d9/f33 x:0 0 0 2024-02-28T23:07:07.877 INFO:tasks.workunit.client.0.smithi159.stdout:8/251: creat d2/d11/d52/d26/d36/f55 x:0 0 0 2024-02-28T23:07:07.890 INFO:tasks.workunit.client.0.smithi159.stdout:5/224: dwrite d8/f34 [0,4194304] 0 2024-02-28T23:07:07.894 INFO:tasks.workunit.client.0.smithi159.stdout:5/225: chown d8/f18 163 1 2024-02-28T23:07:07.895 INFO:tasks.workunit.client.0.smithi159.stdout:0/293: rmdir d0/d5/d14 39 2024-02-28T23:07:07.898 INFO:tasks.workunit.client.0.smithi159.stdout:6/193: mkdir d0/d1b/d33/d11/d14/d49 0 2024-02-28T23:07:07.901 INFO:tasks.workunit.client.0.smithi159.stdout:9/155: creat d4/d17/f34 x:0 0 0 2024-02-28T23:07:07.901 INFO:tasks.workunit.client.0.smithi159.stdout:5/226: dread - d8/d19/f40 zero size 2024-02-28T23:07:07.908 INFO:tasks.workunit.client.0.smithi159.stdout:7/156: creat d5/d10/f36 x:0 0 0 2024-02-28T23:07:07.908 INFO:tasks.workunit.client.0.smithi159.stdout:2/176: dwrite d9/d23/d2c/f2d [0,4194304] 0 2024-02-28T23:07:07.909 INFO:tasks.workunit.client.0.smithi159.stdout:8/252: dwrite d2/d11/d52/d26/d36/f55 [0,4194304] 0 2024-02-28T23:07:07.912 INFO:tasks.workunit.client.0.smithi159.stdout:7/157: stat d5/d16/d1a/d27/f2d 0 2024-02-28T23:07:07.915 INFO:tasks.workunit.client.0.smithi159.stdout:5/227: write d8/f17 [1046560,92225] 0 2024-02-28T23:07:07.920 INFO:tasks.workunit.client.0.smithi159.stdout:7/158: mkdir d5/d16/d1a/d27/d37 0 2024-02-28T23:07:07.922 INFO:tasks.workunit.client.0.smithi159.stdout:0/294: dwrite d0/d5/d38/d63/f69 [0,4194304] 0 2024-02-28T23:07:07.924 INFO:tasks.workunit.client.0.smithi159.stdout:0/295: write d0/de/d46/f61 [340324,24773] 0 2024-02-28T23:07:07.924 INFO:tasks.workunit.client.0.smithi159.stdout:6/194: link d0/d1b/f3c d0/d1b/d33/d11/d14/d49/f4a 0 2024-02-28T23:07:07.931 INFO:tasks.workunit.client.0.smithi159.stdout:2/177: mkdir d9/d34 0 2024-02-28T23:07:07.937 INFO:tasks.workunit.client.0.smithi159.stdout:8/253: mkdir d2/d11/d35/d56 0 2024-02-28T23:07:07.942 INFO:tasks.workunit.client.0.smithi159.stdout:8/254: dread d2/d11/f12 [0,4194304] 0 2024-02-28T23:07:07.945 INFO:tasks.workunit.client.0.smithi159.stdout:5/228: dwrite d8/d19/d23/d35/d38/f3e [0,4194304] 0 2024-02-28T23:07:07.947 INFO:tasks.workunit.client.0.smithi159.stdout:0/296: creat d0/de/d11/d5f/f72 x:0 0 0 2024-02-28T23:07:07.947 INFO:tasks.workunit.client.0.smithi159.stdout:6/195: readlink d0/d1b/d33/d11/d14/l1c 0 2024-02-28T23:07:07.952 INFO:tasks.workunit.client.0.smithi159.stdout:5/229: chown d8/c9 1398505391 1 2024-02-28T23:07:07.957 INFO:tasks.workunit.client.0.smithi159.stdout:0/297: fsync d0/d5/d14/d34/d3d/f65 0 2024-02-28T23:07:07.965 INFO:tasks.workunit.client.0.smithi159.stdout:0/298: symlink d0/d5/d14/d34/l73 0 2024-02-28T23:07:07.967 INFO:tasks.workunit.client.0.smithi159.stdout:2/178: rename d9/f20 to d9/f35 0 2024-02-28T23:07:07.973 INFO:tasks.workunit.client.0.smithi159.stdout:0/299: creat d0/d5/d14/d34/f74 x:0 0 0 2024-02-28T23:07:07.976 INFO:tasks.workunit.client.0.smithi159.stdout:2/179: mkdir d9/d36 0 2024-02-28T23:07:07.977 INFO:tasks.workunit.client.0.smithi159.stdout:5/230: write d8/d19/f2d [660533,12977] 0 2024-02-28T23:07:07.979 INFO:tasks.workunit.client.0.smithi159.stdout:0/300: rename d0/de/d11 to d0/de/d75 0 2024-02-28T23:07:07.982 INFO:tasks.workunit.client.0.smithi159.stdout:2/180: readlink d9/de/d13/l2e 0 2024-02-28T23:07:07.985 INFO:tasks.workunit.client.0.smithi159.stdout:5/231: unlink d8/d19/f37 0 2024-02-28T23:07:07.987 INFO:tasks.workunit.client.0.smithi159.stdout:5/232: read d8/f10 [293307,44796] 0 2024-02-28T23:07:07.988 INFO:tasks.workunit.client.0.smithi159.stdout:7/159: dwrite d5/f21 [0,4194304] 0 2024-02-28T23:07:08.003 INFO:tasks.workunit.client.0.smithi159.stdout:5/233: creat d8/d19/d23/d2a/f45 x:0 0 0 2024-02-28T23:07:08.011 INFO:tasks.workunit.client.0.smithi159.stdout:6/196: dread d0/fa [0,4194304] 0 2024-02-28T23:07:08.013 INFO:tasks.workunit.client.0.smithi159.stdout:2/181: dwrite d9/de/d13/f26 [0,4194304] 0 2024-02-28T23:07:08.014 INFO:tasks.workunit.client.0.smithi159.stdout:7/160: dwrite d5/d10/f36 [0,4194304] 0 2024-02-28T23:07:08.017 INFO:tasks.workunit.client.0.smithi159.stdout:2/182: chown d9/f35 134018585 1 2024-02-28T23:07:08.017 INFO:tasks.workunit.client.0.smithi159.stdout:5/234: rename f0 to d8/f46 0 2024-02-28T23:07:08.022 INFO:tasks.workunit.client.0.smithi159.stdout:7/161: creat d5/d16/d1a/f38 x:0 0 0 2024-02-28T23:07:08.028 INFO:tasks.workunit.client.0.smithi159.stdout:6/197: rename d0/d1b/d33/d11/d14/l2f to d0/d1b/l4b 0 2024-02-28T23:07:08.046 INFO:tasks.workunit.client.0.smithi159.stdout:7/162: dwrite d5/d16/f1f [0,4194304] 0 2024-02-28T23:07:08.046 INFO:tasks.workunit.client.0.smithi159.stdout:5/235: dwrite d8/d19/f3c [0,4194304] 0 2024-02-28T23:07:08.052 INFO:tasks.workunit.client.0.smithi159.stdout:6/198: truncate d0/d1b/d33/d11/d14/d23/f27 3071134 0 2024-02-28T23:07:08.053 INFO:tasks.workunit.client.0.smithi159.stdout:5/236: stat d8/f14 0 2024-02-28T23:07:08.053 INFO:tasks.workunit.client.0.smithi159.stdout:7/163: readlink d5/d16/d1a/d27/d29/d2a/l2c 0 2024-02-28T23:07:08.055 INFO:tasks.workunit.client.0.smithi159.stdout:6/199: write d0/d1b/f3a [329094,100870] 0 2024-02-28T23:07:08.067 INFO:tasks.workunit.client.0.smithi159.stdout:6/200: truncate d0/d1b/d33/d11/f2e 309533 0 2024-02-28T23:07:08.072 INFO:tasks.workunit.client.0.smithi159.stdout:6/201: getdents d0/d1b/d33/d3f/d44 0 2024-02-28T23:07:08.079 INFO:tasks.workunit.client.0.smithi159.stdout:5/237: dwrite d8/f46 [0,4194304] 0 2024-02-28T23:07:08.089 INFO:tasks.workunit.client.0.smithi159.stdout:3/194: sync 2024-02-28T23:07:08.093 INFO:tasks.workunit.client.0.smithi159.stdout:5/238: dwrite d8/f18 [0,4194304] 0 2024-02-28T23:07:08.103 INFO:tasks.workunit.client.0.smithi159.stdout:5/239: rename d8/d19/d23/d35/d38/f39 to d8/d19/d23/d35/d41/f47 0 2024-02-28T23:07:08.106 INFO:tasks.workunit.client.0.smithi159.stdout:5/240: symlink d8/d19/d23/l48 0 2024-02-28T23:07:08.107 INFO:tasks.workunit.client.0.smithi159.stdout:3/195: truncate d0/fe 879678 0 2024-02-28T23:07:08.107 INFO:tasks.workunit.client.0.smithi159.stdout:5/241: readlink d8/d19/l29 0 2024-02-28T23:07:08.108 INFO:tasks.workunit.client.0.smithi159.stdout:5/242: readlink l5 0 2024-02-28T23:07:08.112 INFO:tasks.workunit.client.0.smithi159.stdout:5/243: write d8/f31 [961144,20601] 0 2024-02-28T23:07:08.117 INFO:tasks.workunit.client.0.smithi159.stdout:5/244: creat d8/d19/d23/f49 x:0 0 0 2024-02-28T23:07:08.123 INFO:tasks.workunit.client.0.smithi159.stdout:5/245: creat d8/d19/d23/f4a x:0 0 0 2024-02-28T23:07:08.123 INFO:tasks.workunit.client.0.smithi159.stdout:5/246: chown d8/f21 26845232 1 2024-02-28T23:07:08.127 INFO:tasks.workunit.client.0.smithi159.stdout:5/247: write d8/d19/d23/d2a/f45 [585503,127940] 0 2024-02-28T23:07:08.127 INFO:tasks.workunit.client.0.smithi159.stdout:3/196: dwrite d0/d8/f1e [0,4194304] 0 2024-02-28T23:07:08.127 INFO:tasks.workunit.client.0.smithi159.stdout:6/202: dread d0/d1b/d33/d11/d14/d23/f27 [0,4194304] 0 2024-02-28T23:07:08.130 INFO:tasks.workunit.client.0.smithi159.stdout:3/197: read d0/d6/f13 [2456972,84255] 0 2024-02-28T23:07:08.133 INFO:tasks.workunit.client.0.smithi159.stdout:3/198: fdatasync d0/d6/d19/f2d 0 2024-02-28T23:07:08.135 INFO:tasks.workunit.client.0.smithi159.stdout:5/248: getdents d8/d16 0 2024-02-28T23:07:08.137 INFO:tasks.workunit.client.0.smithi159.stdout:6/203: rename d0/d1b/d38/f39 to d0/d1b/d33/d11/d34/f4c 0 2024-02-28T23:07:08.143 INFO:tasks.workunit.client.0.smithi159.stdout:3/199: rename d0/d8 to d0/d6/d3e 0 2024-02-28T23:07:08.146 INFO:tasks.workunit.client.0.smithi159.stdout:6/204: unlink d0/d1b/d33/d11/d14/d23/c3b 0 2024-02-28T23:07:08.149 INFO:tasks.workunit.client.0.smithi159.stdout:5/249: link d8/d19/d23/d2a/f45 d8/d19/d23/d2a/f4b 0 2024-02-28T23:07:08.151 INFO:tasks.workunit.client.0.smithi159.stdout:6/205: mkdir d0/d1b/d38/d4d 0 2024-02-28T23:07:08.153 INFO:tasks.workunit.client.0.smithi159.stdout:5/250: mknod d8/d19/d23/d35/d41/c4c 0 2024-02-28T23:07:08.155 INFO:tasks.workunit.client.0.smithi159.stdout:6/206: mkdir d0/d1b/d38/d4e 0 2024-02-28T23:07:08.159 INFO:tasks.workunit.client.0.smithi159.stdout:6/207: mknod d0/d1b/d33/d3f/c4f 0 2024-02-28T23:07:08.165 INFO:tasks.workunit.client.0.smithi159.stdout:6/208: fdatasync d0/f9 0 2024-02-28T23:07:08.167 INFO:tasks.workunit.client.0.smithi159.stdout:6/209: readlink d0/d1b/d33/d11/l31 0 2024-02-28T23:07:08.172 INFO:tasks.workunit.client.0.smithi159.stdout:3/200: dread d0/fe [0,4194304] 0 2024-02-28T23:07:08.173 INFO:tasks.workunit.client.0.smithi159.stdout:5/251: dwrite d8/d19/f2d [0,4194304] 0 2024-02-28T23:07:08.176 INFO:tasks.workunit.client.0.smithi159.stdout:6/210: write d0/d1b/d33/d11/d14/d23/f27 [320973,125868] 0 2024-02-28T23:07:08.180 INFO:tasks.workunit.client.0.smithi159.stdout:6/211: write d0/d1b/d33/d11/d34/f35 [1742121,67854] 0 2024-02-28T23:07:08.183 INFO:tasks.workunit.client.0.smithi159.stdout:3/201: mkdir d0/d3f 0 2024-02-28T23:07:08.192 INFO:tasks.workunit.client.0.smithi159.stdout:6/212: truncate d0/d1b/f1f 759508 0 2024-02-28T23:07:08.195 INFO:tasks.workunit.client.0.smithi159.stdout:6/213: creat d0/d1b/d33/d11/d34/f50 x:0 0 0 2024-02-28T23:07:08.196 INFO:tasks.workunit.client.0.smithi159.stdout:5/252: dwrite d8/f18 [0,4194304] 0 2024-02-28T23:07:08.201 INFO:tasks.workunit.client.0.smithi159.stdout:5/253: unlink d8/f46 0 2024-02-28T23:07:08.202 INFO:tasks.workunit.client.0.smithi159.stdout:6/214: rmdir d0/d1b/d33/d11/d14/d49 39 2024-02-28T23:07:08.210 INFO:tasks.workunit.client.0.smithi159.stdout:3/202: dwrite d0/d6/d19/f3d [0,4194304] 0 2024-02-28T23:07:08.211 INFO:tasks.workunit.client.0.smithi159.stdout:6/215: link d0/d1b/c2d d0/d1b/d38/d4d/c51 0 2024-02-28T23:07:08.214 INFO:tasks.workunit.client.0.smithi159.stdout:3/203: chown d0/l1a 5039 1 2024-02-28T23:07:08.224 INFO:tasks.workunit.client.0.smithi159.stdout:5/254: truncate d8/f11 4981362 0 2024-02-28T23:07:08.226 INFO:tasks.workunit.client.0.smithi159.stdout:3/204: dread d0/d2b/f29 [0,4194304] 0 2024-02-28T23:07:08.228 INFO:tasks.workunit.client.0.smithi159.stdout:6/216: rename d0/d1b/d33/d11/d14/d23 to d0/d1b/d38/d52 0 2024-02-28T23:07:08.230 INFO:tasks.workunit.client.0.smithi159.stdout:8/255: sync 2024-02-28T23:07:08.231 INFO:tasks.workunit.client.0.smithi159.stdout:4/262: sync 2024-02-28T23:07:08.231 INFO:tasks.workunit.client.0.smithi159.stdout:9/156: sync 2024-02-28T23:07:08.231 INFO:tasks.workunit.client.0.smithi159.stdout:1/169: sync 2024-02-28T23:07:08.233 INFO:tasks.workunit.client.0.smithi159.stdout:9/157: write d4/f7 [3633368,30212] 0 2024-02-28T23:07:08.235 INFO:tasks.workunit.client.0.smithi159.stdout:4/263: stat d9/f1b 0 2024-02-28T23:07:08.238 INFO:tasks.workunit.client.0.smithi159.stdout:4/264: chown d9/f5b 2 1 2024-02-28T23:07:08.239 INFO:tasks.workunit.client.0.smithi159.stdout:6/217: mknod d0/d1b/d33/d11/d14/c53 0 2024-02-28T23:07:08.241 INFO:tasks.workunit.client.0.smithi159.stdout:8/256: dread d2/d3/f14 [0,4194304] 0 2024-02-28T23:07:08.243 INFO:tasks.workunit.client.0.smithi159.stdout:5/255: stat d8/d19/d23/d35/d38/f3e 0 2024-02-28T23:07:08.243 INFO:tasks.workunit.client.0.smithi159.stdout:9/158: mknod d4/c35 0 2024-02-28T23:07:08.244 INFO:tasks.workunit.client.0.smithi159.stdout:6/218: write d0/d1b/d33/d11/d14/f21 [2854733,112575] 0 2024-02-28T23:07:08.247 INFO:tasks.workunit.client.0.smithi159.stdout:1/170: dread d6/d12/d16/f28 [0,4194304] 0 2024-02-28T23:07:08.248 INFO:tasks.workunit.client.0.smithi159.stdout:9/159: write d4/f5 [11750868,34280] 0 2024-02-28T23:07:08.252 INFO:tasks.workunit.client.0.smithi159.stdout:9/160: stat d4 0 2024-02-28T23:07:08.255 INFO:tasks.workunit.client.0.smithi159.stdout:1/171: mknod d6/d12/c34 0 2024-02-28T23:07:08.256 INFO:tasks.workunit.client.0.smithi159.stdout:6/219: symlink d0/d1b/d33/d3f/d44/l54 0 2024-02-28T23:07:08.256 INFO:tasks.workunit.client.0.smithi159.stdout:1/172: read - d6/f2c zero size 2024-02-28T23:07:08.264 INFO:tasks.workunit.client.0.smithi159.stdout:1/173: read d6/d12/d16/f1c [409739,103464] 0 2024-02-28T23:07:08.270 INFO:tasks.workunit.client.0.smithi159.stdout:4/265: dwrite d9/f3c [0,4194304] 0 2024-02-28T23:07:08.275 INFO:tasks.workunit.client.0.smithi159.stdout:1/174: chown d6/d12/f14 15118 1 2024-02-28T23:07:08.285 INFO:tasks.workunit.client.0.smithi159.stdout:5/256: dread d8/d19/d23/d35/d38/f3e [0,4194304] 0 2024-02-28T23:07:08.285 INFO:tasks.workunit.client.0.smithi159.stdout:8/257: dwrite d2/d11/d52/d26/d36/d38/f39 [4194304,4194304] 0 2024-02-28T23:07:08.286 INFO:tasks.workunit.client.0.smithi159.stdout:1/175: fdatasync d6/d12/d16/f1c 0 2024-02-28T23:07:08.287 INFO:tasks.workunit.client.0.smithi159.stdout:9/161: dwrite d4/d17/f34 [0,4194304] 0 2024-02-28T23:07:08.292 INFO:tasks.workunit.client.0.smithi159.stdout:8/258: dread - d2/d3/f3d zero size 2024-02-28T23:07:08.292 INFO:tasks.workunit.client.0.smithi159.stdout:6/220: dwrite d0/fb [0,4194304] 0 2024-02-28T23:07:08.301 INFO:tasks.workunit.client.0.smithi159.stdout:9/162: creat d4/f36 x:0 0 0 2024-02-28T23:07:08.308 INFO:tasks.workunit.client.0.smithi159.stdout:8/259: dread d2/d3/f14 [0,4194304] 0 2024-02-28T23:07:08.311 INFO:tasks.workunit.client.0.smithi159.stdout:1/176: rename d6/d12/c2e to d6/d12/d16/c35 0 2024-02-28T23:07:08.311 INFO:tasks.workunit.client.0.smithi159.stdout:9/163: write d4/d17/f24 [1346033,28143] 0 2024-02-28T23:07:08.313 INFO:tasks.workunit.client.0.smithi159.stdout:6/221: write d0/fe [4534741,70319] 0 2024-02-28T23:07:08.317 INFO:tasks.workunit.client.0.smithi159.stdout:4/266: dwrite d9/f18 [0,4194304] 0 2024-02-28T23:07:08.319 INFO:tasks.workunit.client.0.smithi159.stdout:8/260: creat d2/d11/d52/d26/d36/d38/f57 x:0 0 0 2024-02-28T23:07:08.320 INFO:tasks.workunit.client.0.smithi159.stdout:9/164: readlink d4/l2b 0 2024-02-28T23:07:08.328 INFO:tasks.workunit.client.0.smithi159.stdout:4/267: creat d9/d20/f5e x:0 0 0 2024-02-28T23:07:08.330 INFO:tasks.workunit.client.0.smithi159.stdout:9/165: mkdir d4/d17/d37 0 2024-02-28T23:07:08.331 INFO:tasks.workunit.client.0.smithi159.stdout:0/301: sync 2024-02-28T23:07:08.331 INFO:tasks.workunit.client.0.smithi159.stdout:7/164: sync 2024-02-28T23:07:08.331 INFO:tasks.workunit.client.0.smithi159.stdout:2/183: sync 2024-02-28T23:07:08.333 INFO:tasks.workunit.client.0.smithi159.stdout:9/166: fsync d4/f26 0 2024-02-28T23:07:08.337 INFO:tasks.workunit.client.0.smithi159.stdout:6/222: link d0/fb d0/d1b/d38/d47/f55 0 2024-02-28T23:07:08.340 INFO:tasks.workunit.client.0.smithi159.stdout:7/165: readlink d5/l7 0 2024-02-28T23:07:08.341 INFO:tasks.workunit.client.0.smithi159.stdout:5/257: dwrite d8/f17 [0,4194304] 0 2024-02-28T23:07:08.345 INFO:tasks.workunit.client.0.smithi159.stdout:0/302: write d0/d5/d14/d25/d5c/f6f [702910,31911] 0 2024-02-28T23:07:08.349 INFO:tasks.workunit.client.0.smithi159.stdout:8/261: mkdir d2/d11/d58 0 2024-02-28T23:07:08.353 INFO:tasks.workunit.client.0.smithi159.stdout:0/303: chown d0/d5/f5e 56505579 1 2024-02-28T23:07:08.355 INFO:tasks.workunit.client.0.smithi159.stdout:2/184: unlink d9/de/d13/f26 0 2024-02-28T23:07:08.357 INFO:tasks.workunit.client.0.smithi159.stdout:4/268: truncate d9/d42/d54/f57 688936 0 2024-02-28T23:07:08.357 INFO:tasks.workunit.client.0.smithi159.stdout:0/304: fsync d0/d5/d14/f4f 0 2024-02-28T23:07:08.363 INFO:tasks.workunit.client.0.smithi159.stdout:6/223: creat d0/d1b/f56 x:0 0 0 2024-02-28T23:07:08.365 INFO:tasks.workunit.client.0.smithi159.stdout:3/205: sync 2024-02-28T23:07:08.368 INFO:tasks.workunit.client.0.smithi159.stdout:3/206: stat d0/d6/d3e/l17 0 2024-02-28T23:07:08.369 INFO:tasks.workunit.client.0.smithi159.stdout:0/305: write d0/d5/f3a [4833193,50203] 0 2024-02-28T23:07:08.369 INFO:tasks.workunit.client.0.smithi159.stdout:4/269: mknod d9/d42/c5f 0 2024-02-28T23:07:08.371 INFO:tasks.workunit.client.0.smithi159.stdout:1/177: dwrite d6/d12/d1a/f2b [0,4194304] 0 2024-02-28T23:07:08.377 INFO:tasks.workunit.client.0.smithi159.stdout:8/262: creat d2/d11/d58/f59 x:0 0 0 2024-02-28T23:07:08.379 INFO:tasks.workunit.client.0.smithi159.stdout:7/166: dread d5/f9 [0,4194304] 0 2024-02-28T23:07:08.387 INFO:tasks.workunit.client.0.smithi159.stdout:7/167: fdatasync d5/d16/d1a/d27/f31 0 2024-02-28T23:07:08.389 INFO:tasks.workunit.client.0.smithi159.stdout:6/224: creat d0/d1b/d33/d11/d14/d49/f57 x:0 0 0 2024-02-28T23:07:08.395 INFO:tasks.workunit.client.0.smithi159.stdout:9/167: dwrite d4/f11 [0,4194304] 0 2024-02-28T23:07:08.398 INFO:tasks.workunit.client.0.smithi159.stdout:3/207: rmdir d0/d6/d19 39 2024-02-28T23:07:08.401 INFO:tasks.workunit.client.0.smithi159.stdout:9/168: write d4/f11 [2964502,49347] 0 2024-02-28T23:07:08.403 INFO:tasks.workunit.client.0.smithi159.stdout:5/258: dwrite d8/f34 [0,4194304] 0 2024-02-28T23:07:08.404 INFO:tasks.workunit.client.0.smithi159.stdout:3/208: write d0/d6/d3e/f1e [406863,78859] 0 2024-02-28T23:07:08.404 INFO:tasks.workunit.client.0.smithi159.stdout:9/169: write d4/f36 [750644,113635] 0 2024-02-28T23:07:08.411 INFO:tasks.workunit.client.0.smithi159.stdout:5/259: fdatasync d8/d19/d23/d2a/f43 0 2024-02-28T23:07:08.417 INFO:tasks.workunit.client.0.smithi159.stdout:4/270: readlink d9/d20/l45 0 2024-02-28T23:07:08.420 INFO:tasks.workunit.client.0.smithi159.stdout:0/306: mkdir d0/d5/d38/d76 0 2024-02-28T23:07:08.423 INFO:tasks.workunit.client.0.smithi159.stdout:7/168: dwrite d5/d10/f11 [0,4194304] 0 2024-02-28T23:07:08.425 INFO:tasks.workunit.client.0.smithi159.stdout:1/178: symlink d6/d12/d16/l36 0 2024-02-28T23:07:08.428 INFO:tasks.workunit.client.0.smithi159.stdout:2/185: mkdir d9/de/d13/d31/d37 0 2024-02-28T23:07:08.433 INFO:tasks.workunit.client.0.smithi159.stdout:9/170: dwrite d4/d17/f34 [0,4194304] 0 2024-02-28T23:07:08.437 INFO:tasks.workunit.client.0.smithi159.stdout:9/171: chown d4/l14 902 1 2024-02-28T23:07:08.437 INFO:tasks.workunit.client.0.smithi159.stdout:9/172: stat d4/lb 0 2024-02-28T23:07:08.438 INFO:tasks.workunit.client.0.smithi159.stdout:9/173: truncate d4/d17/f2d 934473 0 2024-02-28T23:07:08.440 INFO:tasks.workunit.client.0.smithi159.stdout:6/225: dread d0/f8 [0,4194304] 0 2024-02-28T23:07:08.440 INFO:tasks.workunit.client.0.smithi159.stdout:8/263: rename d2/d3/f10 to d2/d11/d52/d26/f5a 0 2024-02-28T23:07:08.455 INFO:tasks.workunit.client.0.smithi159.stdout:5/260: creat d8/d19/d23/f4d x:0 0 0 2024-02-28T23:07:08.459 INFO:tasks.workunit.client.0.smithi159.stdout:4/271: write d9/da/d1c/f1d [368684,44030] 0 2024-02-28T23:07:08.459 INFO:tasks.workunit.client.0.smithi159.stdout:0/307: creat d0/d5/d14/d25/f77 x:0 0 0 2024-02-28T23:07:08.466 INFO:tasks.workunit.client.0.smithi159.stdout:2/186: rmdir d9/d23 39 2024-02-28T23:07:08.467 INFO:tasks.workunit.client.0.smithi159.stdout:2/187: read - d9/f33 zero size 2024-02-28T23:07:08.471 INFO:tasks.workunit.client.0.smithi159.stdout:1/179: write d6/d12/d16/f24 [564381,84702] 0 2024-02-28T23:07:08.473 INFO:tasks.workunit.client.0.smithi159.stdout:1/180: readlink d6/d12/l32 0 2024-02-28T23:07:08.476 INFO:tasks.workunit.client.0.smithi159.stdout:9/174: rename d4/d17/f34 to d4/d17/d37/f38 0 2024-02-28T23:07:08.476 INFO:tasks.workunit.client.0.smithi159.stdout:1/181: write d6/f9 [1618517,75085] 0 2024-02-28T23:07:08.483 INFO:tasks.workunit.client.0.smithi159.stdout:7/169: write f3 [3387527,108152] 0 2024-02-28T23:07:08.483 INFO:tasks.workunit.client.0.smithi159.stdout:5/261: creat d8/d19/d23/d2a/f4e x:0 0 0 2024-02-28T23:07:08.483 INFO:tasks.workunit.client.0.smithi159.stdout:4/272: creat d9/d42/f60 x:0 0 0 2024-02-28T23:07:08.488 INFO:tasks.workunit.client.0.smithi159.stdout:9/175: creat d4/f39 x:0 0 0 2024-02-28T23:07:08.490 INFO:tasks.workunit.client.0.smithi159.stdout:1/182: mknod d6/d1d/d1f/c37 0 2024-02-28T23:07:08.491 INFO:tasks.workunit.client.0.smithi159.stdout:9/176: readlink d4/l12 0 2024-02-28T23:07:08.492 INFO:tasks.workunit.client.0.smithi159.stdout:0/308: mkdir d0/d5/d14/d78 0 2024-02-28T23:07:08.492 INFO:tasks.workunit.client.0.smithi159.stdout:5/262: write d8/d19/f2e [4790337,44979] 0 2024-02-28T23:07:08.493 INFO:tasks.workunit.client.0.smithi159.stdout:2/188: dwrite f6 [0,4194304] 0 2024-02-28T23:07:08.498 INFO:tasks.workunit.client.0.smithi159.stdout:5/263: stat d8/d19/d23/d2a/f3b 0 2024-02-28T23:07:08.498 INFO:tasks.workunit.client.0.smithi159.stdout:2/189: chown d9/de/c12 40 1 2024-02-28T23:07:08.499 INFO:tasks.workunit.client.0.smithi159.stdout:9/177: truncate d4/d17/f27 1403601 0 2024-02-28T23:07:08.501 INFO:tasks.workunit.client.0.smithi159.stdout:8/264: dread d2/d3/f1d [0,4194304] 0 2024-02-28T23:07:08.502 INFO:tasks.workunit.client.0.smithi159.stdout:7/170: rename d5/d16/d1a/d24/c28 to d5/d16/c39 0 2024-02-28T23:07:08.504 INFO:tasks.workunit.client.0.smithi159.stdout:0/309: truncate d0/d5/d14/d34/f74 821593 0 2024-02-28T23:07:08.506 INFO:tasks.workunit.client.0.smithi159.stdout:2/190: unlink f7 0 2024-02-28T23:07:08.507 INFO:tasks.workunit.client.0.smithi159.stdout:7/171: write f3 [1316413,38765] 0 2024-02-28T23:07:08.508 INFO:tasks.workunit.client.0.smithi159.stdout:0/310: readlink d0/l23 0 2024-02-28T23:07:08.510 INFO:tasks.workunit.client.0.smithi159.stdout:8/265: dread d2/d3/f14 [0,4194304] 0 2024-02-28T23:07:08.514 INFO:tasks.workunit.client.0.smithi159.stdout:9/178: rmdir d4 39 2024-02-28T23:07:08.516 INFO:tasks.workunit.client.0.smithi159.stdout:4/273: dwrite d9/da/d1c/f53 [0,4194304] 0 2024-02-28T23:07:08.516 INFO:tasks.workunit.client.0.smithi159.stdout:5/264: dread d8/f10 [0,4194304] 0 2024-02-28T23:07:08.519 INFO:tasks.workunit.client.0.smithi159.stdout:5/265: read - d8/d19/d23/d2a/f32 zero size 2024-02-28T23:07:08.520 INFO:tasks.workunit.client.0.smithi159.stdout:1/183: rename d6/d1d/f26 to d6/d12/d1a/f38 0 2024-02-28T23:07:08.522 INFO:tasks.workunit.client.0.smithi159.stdout:2/191: mknod d9/de/d13/d31/c38 0 2024-02-28T23:07:08.525 INFO:tasks.workunit.client.0.smithi159.stdout:9/179: fsync d4/f39 0 2024-02-28T23:07:08.525 INFO:tasks.workunit.client.0.smithi159.stdout:9/180: readlink d4/l12 0 2024-02-28T23:07:08.526 INFO:tasks.workunit.client.0.smithi159.stdout:9/181: readlink d4/l16 0 2024-02-28T23:07:08.527 INFO:tasks.workunit.client.0.smithi159.stdout:4/274: mknod d9/da/d1c/d23/d2d/c61 0 2024-02-28T23:07:08.531 INFO:tasks.workunit.client.0.smithi159.stdout:1/184: symlink d6/d1d/d1f/l39 0 2024-02-28T23:07:08.535 INFO:tasks.workunit.client.0.smithi159.stdout:5/266: rename d8/f11 to d8/d19/d23/f4f 0 2024-02-28T23:07:08.537 INFO:tasks.workunit.client.0.smithi159.stdout:0/311: link d0/l5a d0/d5/d14/d34/d3d/l79 0 2024-02-28T23:07:08.538 INFO:tasks.workunit.client.0.smithi159.stdout:0/312: fsync d0/de/f4a 0 2024-02-28T23:07:08.540 INFO:tasks.workunit.client.0.smithi159.stdout:4/275: link d9/f1e d9/da/f62 0 2024-02-28T23:07:08.544 INFO:tasks.workunit.client.0.smithi159.stdout:8/266: mknod d2/d11/d52/d26/d36/c5b 0 2024-02-28T23:07:08.546 INFO:tasks.workunit.client.0.smithi159.stdout:7/172: getdents d5/d16/d1a 0 2024-02-28T23:07:08.549 INFO:tasks.workunit.client.0.smithi159.stdout:2/192: rename f8 to d9/de/d13/d31/d37/f39 0 2024-02-28T23:07:08.550 INFO:tasks.workunit.client.0.smithi159.stdout:2/193: fsync f6 0 2024-02-28T23:07:08.552 INFO:tasks.workunit.client.0.smithi159.stdout:7/173: truncate d5/d16/d1a/d27/f2d 298146 0 2024-02-28T23:07:08.561 INFO:tasks.workunit.client.0.smithi159.stdout:8/267: dread - d2/d11/d52/d26/f50 zero size 2024-02-28T23:07:08.562 INFO:tasks.workunit.client.0.smithi159.stdout:0/313: dread d0/d5/d14/d34/f3c [0,4194304] 0 2024-02-28T23:07:08.562 INFO:tasks.workunit.client.0.smithi159.stdout:4/276: creat d9/da/d1c/d23/f63 x:0 0 0 2024-02-28T23:07:08.563 INFO:tasks.workunit.client.0.smithi159.stdout:5/267: rmdir d8/d19/d23 39 2024-02-28T23:07:08.568 INFO:tasks.workunit.client.0.smithi159.stdout:9/182: rename d4/c6 to d4/d17/c3a 0 2024-02-28T23:07:08.571 INFO:tasks.workunit.client.0.smithi159.stdout:1/185: dread d6/fb [0,4194304] 0 2024-02-28T23:07:08.573 INFO:tasks.workunit.client.0.smithi159.stdout:7/174: dwrite d5/d16/f19 [0,4194304] 0 2024-02-28T23:07:08.585 INFO:tasks.workunit.client.0.smithi159.stdout:1/186: fsync d6/d12/f15 0 2024-02-28T23:07:08.588 INFO:tasks.workunit.client.0.smithi159.stdout:0/314: unlink d0/de/d75/l28 0 2024-02-28T23:07:08.589 INFO:tasks.workunit.client.0.smithi159.stdout:2/194: dwrite d9/de/d13/d31/d37/f39 [4194304,4194304] 0 2024-02-28T23:07:08.590 INFO:tasks.workunit.client.0.smithi159.stdout:0/315: chown d0/d5/d14/d34 1054 1 2024-02-28T23:07:08.593 INFO:tasks.workunit.client.0.smithi159.stdout:0/316: dread - d0/d5/d14/d25/f77 zero size 2024-02-28T23:07:08.593 INFO:tasks.workunit.client.0.smithi159.stdout:5/268: creat d8/d19/d23/d35/d41/f50 x:0 0 0 2024-02-28T23:07:08.596 INFO:tasks.workunit.client.0.smithi159.stdout:4/277: rename d9/da/d1c/l34 to d9/d42/d54/d55/l64 0 2024-02-28T23:07:08.600 INFO:tasks.workunit.client.0.smithi159.stdout:8/268: creat d2/f5c x:0 0 0 2024-02-28T23:07:08.602 INFO:tasks.workunit.client.0.smithi159.stdout:8/269: fdatasync d2/d3/f3c 0 2024-02-28T23:07:08.607 INFO:tasks.workunit.client.0.smithi159.stdout:0/317: dread d0/de/f2b [0,4194304] 0 2024-02-28T23:07:08.613 INFO:tasks.workunit.client.0.smithi159.stdout:5/269: creat d8/d19/d23/f51 x:0 0 0 2024-02-28T23:07:08.616 INFO:tasks.workunit.client.0.smithi159.stdout:5/270: fdatasync d8/d19/f2d 0 2024-02-28T23:07:08.616 INFO:tasks.workunit.client.0.smithi159.stdout:9/183: rename d4/f7 to d4/d17/d37/f3b 0 2024-02-28T23:07:08.617 INFO:tasks.workunit.client.0.smithi159.stdout:3/209: sync 2024-02-28T23:07:08.617 INFO:tasks.workunit.client.0.smithi159.stdout:6/226: sync 2024-02-28T23:07:08.620 INFO:tasks.workunit.client.0.smithi159.stdout:9/184: fsync d4/f26 0 2024-02-28T23:07:08.622 INFO:tasks.workunit.client.0.smithi159.stdout:3/210: dread d0/d2b/f29 [0,4194304] 0 2024-02-28T23:07:08.622 INFO:tasks.workunit.client.0.smithi159.stdout:4/278: symlink d9/da/l65 0 2024-02-28T23:07:08.626 INFO:tasks.workunit.client.0.smithi159.stdout:8/270: creat d2/d11/d52/d26/d36/d38/f5d x:0 0 0 2024-02-28T23:07:08.627 INFO:tasks.workunit.client.0.smithi159.stdout:4/279: truncate d9/d20/f48 104977 0 2024-02-28T23:07:08.629 INFO:tasks.workunit.client.0.smithi159.stdout:1/187: dread d6/f9 [0,4194304] 0 2024-02-28T23:07:08.635 INFO:tasks.workunit.client.0.smithi159.stdout:7/175: truncate d5/d16/f1f 755269 0 2024-02-28T23:07:08.642 INFO:tasks.workunit.client.0.smithi159.stdout:5/271: rmdir d8/d19/d23 39 2024-02-28T23:07:08.647 INFO:tasks.workunit.client.0.smithi159.stdout:6/227: rename d0/d1b/f3a to d0/d1b/d38/d4d/f58 0 2024-02-28T23:07:08.649 INFO:tasks.workunit.client.0.smithi159.stdout:3/211: dwrite d0/d6/d3e/d2f/f39 [0,4194304] 0 2024-02-28T23:07:08.652 INFO:tasks.workunit.client.0.smithi159.stdout:2/195: truncate d9/de/f2f 157901 0 2024-02-28T23:07:08.655 INFO:tasks.workunit.client.0.smithi159.stdout:5/272: dread d8/f17 [0,4194304] 0 2024-02-28T23:07:08.661 INFO:tasks.workunit.client.0.smithi159.stdout:7/176: creat d5/d16/d1a/d24/f3a x:0 0 0 2024-02-28T23:07:08.666 INFO:tasks.workunit.client.0.smithi159.stdout:7/177: dread d5/f1e [0,4194304] 0 2024-02-28T23:07:08.669 INFO:tasks.workunit.client.0.smithi159.stdout:0/318: dwrite d0/d5/d14/d34/f47 [0,4194304] 0 2024-02-28T23:07:08.679 INFO:tasks.workunit.client.0.smithi159.stdout:6/228: creat d0/d1b/d33/f59 x:0 0 0 2024-02-28T23:07:08.681 INFO:tasks.workunit.client.0.smithi159.stdout:3/212: chown d0/d6/d3e/c10 25587 1 2024-02-28T23:07:08.682 INFO:tasks.workunit.client.0.smithi159.stdout:4/280: mkdir d9/d66 0 2024-02-28T23:07:08.682 INFO:tasks.workunit.client.0.smithi159.stdout:6/229: stat d0/d1b/d38/d52/c26 0 2024-02-28T23:07:08.692 INFO:tasks.workunit.client.0.smithi159.stdout:6/230: chown d0/d1b/d33/d11/d14/c53 294719 1 2024-02-28T23:07:08.692 INFO:tasks.workunit.client.0.smithi159.stdout:5/273: stat d8/d19/d23/d2a/f43 0 2024-02-28T23:07:08.693 INFO:tasks.workunit.client.0.smithi159.stdout:8/271: fdatasync d2/d11/d52/d26/f5a 0 2024-02-28T23:07:08.693 INFO:tasks.workunit.client.0.smithi159.stdout:7/178: dwrite d5/d16/d1a/d27/f2d [0,4194304] 0 2024-02-28T23:07:08.699 INFO:tasks.workunit.client.0.smithi159.stdout:7/179: write d5/d10/f11 [1986196,2837] 0 2024-02-28T23:07:08.699 INFO:tasks.workunit.client.0.smithi159.stdout:0/319: dwrite d0/f3 [0,4194304] 0 2024-02-28T23:07:08.708 INFO:tasks.workunit.client.0.smithi159.stdout:9/185: truncate d4/d17/f24 2944213 0 2024-02-28T23:07:08.713 INFO:tasks.workunit.client.0.smithi159.stdout:9/186: chown d4/l28 6877037 1 2024-02-28T23:07:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:08 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:08 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:07:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:08 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:07:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:08 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:07:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:08 smithi159 ceph-mon[28802]: Upgrade: Need to upgrade myself (mgr.smithi184.quvmnx) 2024-02-28T23:07:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:08 smithi159 ceph-mon[28802]: Upgrade: Need to upgrade myself (mgr.smithi184.quvmnx) 2024-02-28T23:07:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:08 smithi159 ceph-mon[28802]: pgmap v23: 65 pgs: 65 active+clean; 353 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 992 KiB/s rd, 23 MiB/s wr, 125 op/s 2024-02-28T23:07:08.727 INFO:tasks.workunit.client.0.smithi159.stdout:6/231: dwrite d0/d1b/d33/d11/d14/d49/f57 [0,4194304] 0 2024-02-28T23:07:08.728 INFO:tasks.workunit.client.0.smithi159.stdout:6/232: chown d0/d1b/d38/d52 1069527 1 2024-02-28T23:07:08.740 INFO:tasks.workunit.client.0.smithi159.stdout:7/180: mknod d5/d16/d1a/d24/c3b 0 2024-02-28T23:07:08.742 INFO:tasks.workunit.client.0.smithi159.stdout:4/281: dwrite d9/da/d1c/d23/d2d/d59/f5d [0,4194304] 0 2024-02-28T23:07:08.744 INFO:tasks.workunit.client.0.smithi159.stdout:3/213: symlink d0/l40 0 2024-02-28T23:07:08.747 INFO:tasks.workunit.client.0.smithi159.stdout:9/187: write d4/d17/d37/f38 [4405013,99574] 0 2024-02-28T23:07:08.748 INFO:tasks.workunit.client.0.smithi159.stdout:5/274: dwrite d8/d16/f1a [0,4194304] 0 2024-02-28T23:07:08.764 INFO:tasks.workunit.client.0.smithi159.stdout:6/233: truncate d0/f8 274906 0 2024-02-28T23:07:08.767 INFO:tasks.workunit.client.0.smithi159.stdout:2/196: getdents d9 0 2024-02-28T23:07:08.768 INFO:tasks.workunit.client.0.smithi159.stdout:6/234: stat d0/d1b/d38/d52/f27 0 2024-02-28T23:07:08.770 INFO:tasks.workunit.client.0.smithi159.stdout:2/197: stat d9/la 0 2024-02-28T23:07:08.772 INFO:tasks.workunit.client.0.smithi159.stdout:5/275: mknod d8/d19/d23/d2a/c52 0 2024-02-28T23:07:08.775 INFO:tasks.workunit.client.0.smithi159.stdout:5/276: read - d8/d19/d23/f49 zero size 2024-02-28T23:07:08.778 INFO:tasks.workunit.client.0.smithi159.stdout:5/277: write d8/d19/f27 [144748,117631] 0 2024-02-28T23:07:08.780 INFO:tasks.workunit.client.0.smithi159.stdout:8/272: rmdir d2/d11/d35/d56 0 2024-02-28T23:07:08.784 INFO:tasks.workunit.client.0.smithi159.stdout:9/188: dwrite d4/d17/d37/f38 [4194304,4194304] 0 2024-02-28T23:07:08.801 INFO:tasks.workunit.client.0.smithi159.stdout:3/214: dread d0/f23 [0,4194304] 0 2024-02-28T23:07:08.805 INFO:tasks.workunit.client.0.smithi159.stdout:5/278: dread d8/d19/f1f [0,4194304] 0 2024-02-28T23:07:08.808 INFO:tasks.workunit.client.0.smithi159.stdout:2/198: creat d9/d34/f3a x:0 0 0 2024-02-28T23:07:08.809 INFO:tasks.workunit.client.0.smithi159.stdout:7/181: truncate d5/d16/f30 3118460 0 2024-02-28T23:07:08.812 INFO:tasks.workunit.client.0.smithi159.stdout:3/215: unlink d0/c16 0 2024-02-28T23:07:08.814 INFO:tasks.workunit.client.0.smithi159.stdout:8/273: truncate d2/d3/f2a 540865 0 2024-02-28T23:07:08.822 INFO:tasks.workunit.client.0.smithi159.stdout:2/199: unlink d9/de/l22 0 2024-02-28T23:07:08.824 INFO:tasks.workunit.client.0.smithi159.stdout:2/200: write d9/d23/d2c/f32 [988799,5386] 0 2024-02-28T23:07:08.828 INFO:tasks.workunit.client.0.smithi159.stdout:2/201: fsync d9/d34/f3a 0 2024-02-28T23:07:08.831 INFO:tasks.workunit.client.0.smithi159.stdout:7/182: unlink d5/f21 0 2024-02-28T23:07:08.832 INFO:tasks.workunit.client.0.smithi159.stdout:7/183: readlink d5/d16/l20 0 2024-02-28T23:07:08.835 INFO:tasks.workunit.client.0.smithi159.stdout:9/189: getdents d4/d17 0 2024-02-28T23:07:08.836 INFO:tasks.workunit.client.0.smithi159.stdout:2/202: rename d9/de/d13/f14 to d9/de/d13/d31/f3b 0 2024-02-28T23:07:08.837 INFO:tasks.workunit.client.0.smithi159.stdout:2/203: stat d9 0 2024-02-28T23:07:08.837 INFO:tasks.workunit.client.0.smithi159.stdout:9/190: fsync d4/f11 0 2024-02-28T23:07:08.840 INFO:tasks.workunit.client.0.smithi159.stdout:7/184: creat d5/d16/d1a/f3c x:0 0 0 2024-02-28T23:07:08.842 INFO:tasks.workunit.client.0.smithi159.stdout:2/204: fsync d9/de/f2a 0 2024-02-28T23:07:08.843 INFO:tasks.workunit.client.0.smithi159.stdout:9/191: stat d4/l2f 0 2024-02-28T23:07:08.844 INFO:tasks.workunit.client.0.smithi159.stdout:6/235: dwrite d0/d1b/d33/d11/f2e [0,4194304] 0 2024-02-28T23:07:08.845 INFO:tasks.workunit.client.0.smithi159.stdout:5/279: write d8/f17 [761102,16299] 0 2024-02-28T23:07:08.850 INFO:tasks.workunit.client.0.smithi159.stdout:2/205: creat d9/f3c x:0 0 0 2024-02-28T23:07:08.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:08 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:08.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:08 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:07:08.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:08 smithi184 ceph-mon[36198]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:07:08.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:08 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:07:08.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:08 smithi184 ceph-mon[36198]: Upgrade: Need to upgrade myself (mgr.smithi184.quvmnx) 2024-02-28T23:07:08.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:08 smithi184 ceph-mon[36198]: Upgrade: Need to upgrade myself (mgr.smithi184.quvmnx) 2024-02-28T23:07:08.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:08 smithi184 ceph-mon[36198]: pgmap v23: 65 pgs: 65 active+clean; 353 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 992 KiB/s rd, 23 MiB/s wr, 125 op/s 2024-02-28T23:07:08.853 INFO:tasks.workunit.client.0.smithi159.stdout:9/192: creat d4/f3c x:0 0 0 2024-02-28T23:07:08.853 INFO:tasks.workunit.client.0.smithi159.stdout:3/216: write d0/d6/d3e/f22 [725657,31741] 0 2024-02-28T23:07:08.853 INFO:tasks.workunit.client.0.smithi159.stdout:3/217: stat d0/d6/d3e/lb 0 2024-02-28T23:07:08.855 INFO:tasks.workunit.client.0.smithi159.stdout:8/274: truncate d2/d3/f17 1726585 0 2024-02-28T23:07:08.859 INFO:tasks.workunit.client.0.smithi159.stdout:3/218: dread d0/fe [0,4194304] 0 2024-02-28T23:07:08.859 INFO:tasks.workunit.client.0.smithi159.stdout:6/236: mknod d0/d1b/d38/c5a 0 2024-02-28T23:07:08.863 INFO:tasks.workunit.client.0.smithi159.stdout:5/280: write d8/f13 [2022783,60672] 0 2024-02-28T23:07:08.863 INFO:tasks.workunit.client.0.smithi159.stdout:6/237: write d0/d1b/d33/d11/d34/f3e [2574368,32841] 0 2024-02-28T23:07:08.865 INFO:tasks.workunit.client.0.smithi159.stdout:9/193: mkdir d4/d3d 0 2024-02-28T23:07:08.866 INFO:tasks.workunit.client.0.smithi159.stdout:6/238: dread - d0/d1b/d33/d11/d14/d49/f4a zero size 2024-02-28T23:07:08.867 INFO:tasks.workunit.client.0.smithi159.stdout:8/275: rename d2/d11/d52/d26/d36/c33 to d2/d3/c5e 0 2024-02-28T23:07:08.871 INFO:tasks.workunit.client.0.smithi159.stdout:7/185: creat d5/f3d x:0 0 0 2024-02-28T23:07:08.877 INFO:tasks.workunit.client.0.smithi159.stdout:9/194: unlink d4/d17/d37/f38 0 2024-02-28T23:07:08.879 INFO:tasks.workunit.client.0.smithi159.stdout:8/276: mkdir d2/d11/d35/d5f 0 2024-02-28T23:07:08.880 INFO:tasks.workunit.client.0.smithi159.stdout:3/219: creat d0/d6/d34/f41 x:0 0 0 2024-02-28T23:07:08.883 INFO:tasks.workunit.client.0.smithi159.stdout:3/220: write d0/d6/f13 [6062744,81764] 0 2024-02-28T23:07:08.883 INFO:tasks.workunit.client.0.smithi159.stdout:8/277: write d2/d11/d52/d26/d36/f55 [4758212,31638] 0 2024-02-28T23:07:08.900 INFO:tasks.workunit.client.0.smithi159.stdout:6/239: dwrite d0/fb [0,4194304] 0 2024-02-28T23:07:08.900 INFO:tasks.workunit.client.0.smithi159.stdout:9/195: dwrite d4/d17/f2d [0,4194304] 0 2024-02-28T23:07:08.906 INFO:tasks.workunit.client.0.smithi159.stdout:9/196: read - d4/f3c zero size 2024-02-28T23:07:08.906 INFO:tasks.workunit.client.0.smithi159.stdout:2/206: mknod d9/de/d13/d31/d37/c3d 0 2024-02-28T23:07:08.907 INFO:tasks.workunit.client.0.smithi159.stdout:8/278: mknod d2/c60 0 2024-02-28T23:07:08.910 INFO:tasks.workunit.client.0.smithi159.stdout:7/186: mkdir d5/d16/d1a/d27/d3e 0 2024-02-28T23:07:08.913 INFO:tasks.workunit.client.0.smithi159.stdout:8/279: write d2/d3/f29 [902618,64086] 0 2024-02-28T23:07:08.913 INFO:tasks.workunit.client.0.smithi159.stdout:5/281: dwrite d8/d19/f1c [0,4194304] 0 2024-02-28T23:07:08.914 INFO:tasks.workunit.client.0.smithi159.stdout:9/197: mkdir d4/d3d/d3e 0 2024-02-28T23:07:08.923 INFO:tasks.workunit.client.0.smithi159.stdout:5/282: mknod d8/d16/c53 0 2024-02-28T23:07:08.923 INFO:tasks.workunit.client.0.smithi159.stdout:7/187: creat d5/d16/d1a/d27/d3e/f3f x:0 0 0 2024-02-28T23:07:08.923 INFO:tasks.workunit.client.0.smithi159.stdout:2/207: symlink d9/d36/l3e 0 2024-02-28T23:07:08.926 INFO:tasks.workunit.client.0.smithi159.stdout:8/280: truncate d2/d3/f3d 190340 0 2024-02-28T23:07:08.934 INFO:tasks.workunit.client.0.smithi159.stdout:2/208: write d9/f35 [1627947,25831] 0 2024-02-28T23:07:08.941 INFO:tasks.workunit.client.0.smithi159.stdout:6/240: dwrite d0/fa [0,4194304] 0 2024-02-28T23:07:08.946 INFO:tasks.workunit.client.0.smithi159.stdout:9/198: dwrite d4/d17/f2e [0,4194304] 0 2024-02-28T23:07:08.950 INFO:tasks.workunit.client.0.smithi159.stdout:7/188: rmdir d5/d16/d1a/d27 39 2024-02-28T23:07:08.952 INFO:tasks.workunit.client.0.smithi159.stdout:0/320: sync 2024-02-28T23:07:08.955 INFO:tasks.workunit.client.0.smithi159.stdout:1/188: sync 2024-02-28T23:07:08.955 INFO:tasks.workunit.client.0.smithi159.stdout:3/221: dwrite d0/d2b/f26 [0,4194304] 0 2024-02-28T23:07:08.958 INFO:tasks.workunit.client.0.smithi159.stdout:2/209: getdents d9/d36 0 2024-02-28T23:07:08.961 INFO:tasks.workunit.client.0.smithi159.stdout:6/241: fsync d0/d1b/d33/f3d 0 2024-02-28T23:07:08.965 INFO:tasks.workunit.client.0.smithi159.stdout:9/199: mknod d4/d17/c3f 0 2024-02-28T23:07:08.966 INFO:tasks.workunit.client.0.smithi159.stdout:8/281: dwrite d2/d3/f46 [0,4194304] 0 2024-02-28T23:07:08.967 INFO:tasks.workunit.client.0.smithi159.stdout:3/222: write d0/d2b/f26 [3953722,43096] 0 2024-02-28T23:07:08.969 INFO:tasks.workunit.client.0.smithi159.stdout:5/283: dwrite d8/d19/d23/f4a [0,4194304] 0 2024-02-28T23:07:08.971 INFO:tasks.workunit.client.0.smithi159.stdout:7/189: mkdir d5/d16/d40 0 2024-02-28T23:07:08.972 INFO:tasks.workunit.client.0.smithi159.stdout:2/210: write d9/de/d13/d31/f3b [3241170,31350] 0 2024-02-28T23:07:08.972 INFO:tasks.workunit.client.0.smithi159.stdout:1/189: creat d6/d12/d33/f3a x:0 0 0 2024-02-28T23:07:08.974 INFO:tasks.workunit.client.0.smithi159.stdout:9/200: chown d4/c1d 620729 1 2024-02-28T23:07:08.974 INFO:tasks.workunit.client.0.smithi159.stdout:7/190: dread - d5/d10/f34 zero size 2024-02-28T23:07:08.975 INFO:tasks.workunit.client.0.smithi159.stdout:6/242: dread - d0/d1b/d33/d11/d14/d49/f4a zero size 2024-02-28T23:07:08.983 INFO:tasks.workunit.client.0.smithi159.stdout:1/190: chown d6/d1d 557177719 1 2024-02-28T23:07:08.983 INFO:tasks.workunit.client.0.smithi159.stdout:8/282: write d2/d11/d52/d47/f51 [925150,83475] 0 2024-02-28T23:07:08.983 INFO:tasks.workunit.client.0.smithi159.stdout:6/243: read d0/f9 [3145042,13073] 0 2024-02-28T23:07:08.988 INFO:tasks.workunit.client.0.smithi159.stdout:2/211: creat d9/d36/f3f x:0 0 0 2024-02-28T23:07:08.992 INFO:tasks.workunit.client.0.smithi159.stdout:2/212: chown d9/de/d13/d31/d37/c3d 1506581 1 2024-02-28T23:07:08.997 INFO:tasks.workunit.client.0.smithi159.stdout:3/223: symlink d0/d6/d19/l42 0 2024-02-28T23:07:08.998 INFO:tasks.workunit.client.0.smithi159.stdout:8/283: symlink d2/d11/l61 0 2024-02-28T23:07:08.999 INFO:tasks.workunit.client.0.smithi159.stdout:0/321: link d0/f6 d0/de/f7a 0 2024-02-28T23:07:09.003 INFO:tasks.workunit.client.0.smithi159.stdout:9/201: dwrite d4/d17/f2a [0,4194304] 0 2024-02-28T23:07:09.005 INFO:tasks.workunit.client.0.smithi159.stdout:7/191: mknod d5/d16/d40/c41 0 2024-02-28T23:07:09.009 INFO:tasks.workunit.client.0.smithi159.stdout:3/224: getdents d0/d3f 0 2024-02-28T23:07:09.014 INFO:tasks.workunit.client.0.smithi159.stdout:8/284: write d2/d11/d52/d26/f50 [220650,61489] 0 2024-02-28T23:07:09.018 INFO:tasks.workunit.client.0.smithi159.stdout:7/192: write d5/d16/d1a/f3c [95554,17795] 0 2024-02-28T23:07:09.021 INFO:tasks.workunit.client.0.smithi159.stdout:9/202: symlink d4/l40 0 2024-02-28T23:07:09.024 INFO:tasks.workunit.client.0.smithi159.stdout:3/225: mknod d0/d6/d3e/c43 0 2024-02-28T23:07:09.027 INFO:tasks.workunit.client.0.smithi159.stdout:0/322: mknod d0/d5/d14/d25/d5c/c7b 0 2024-02-28T23:07:09.032 INFO:tasks.workunit.client.0.smithi159.stdout:3/226: write d0/f12 [4431775,129252] 0 2024-02-28T23:07:09.032 INFO:tasks.workunit.client.0.smithi159.stdout:8/285: rename d2/d11/d52/d26/f50 to d2/d11/d52/f62 0 2024-02-28T23:07:09.034 INFO:tasks.workunit.client.0.smithi159.stdout:7/193: dread - d5/d16/d1a/d27/d29/f33 zero size 2024-02-28T23:07:09.039 INFO:tasks.workunit.client.0.smithi159.stdout:2/213: dwrite d9/de/d13/d31/f3b [4194304,4194304] 0 2024-02-28T23:07:09.039 INFO:tasks.workunit.client.0.smithi159.stdout:9/203: mknod d4/d3d/c41 0 2024-02-28T23:07:09.040 INFO:tasks.workunit.client.0.smithi159.stdout:0/323: rmdir d0/d5/d38 39 2024-02-28T23:07:09.042 INFO:tasks.workunit.client.0.smithi159.stdout:6/244: dwrite d0/d1b/d33/d11/d34/f50 [0,4194304] 0 2024-02-28T23:07:09.046 INFO:tasks.workunit.client.0.smithi159.stdout:5/284: dwrite d8/d19/d23/d2a/f4b [0,4194304] 0 2024-02-28T23:07:09.048 INFO:tasks.workunit.client.0.smithi159.stdout:6/245: chown d0/d1b/l17 262199927 1 2024-02-28T23:07:09.051 INFO:tasks.workunit.client.0.smithi159.stdout:8/286: mknod d2/d11/d52/c63 0 2024-02-28T23:07:09.053 INFO:tasks.workunit.client.0.smithi159.stdout:0/324: chown d0/de/l30 1195542 1 2024-02-28T23:07:09.053 INFO:tasks.workunit.client.0.smithi159.stdout:9/204: truncate d4/f25 75259 0 2024-02-28T23:07:09.060 INFO:tasks.workunit.client.0.smithi159.stdout:2/214: fsync d9/f16 0 2024-02-28T23:07:09.061 INFO:tasks.workunit.client.0.smithi159.stdout:8/287: creat d2/d11/d52/d26/d36/f64 x:0 0 0 2024-02-28T23:07:09.067 INFO:tasks.workunit.client.0.smithi159.stdout:7/194: creat d5/d16/d1a/d27/d37/f42 x:0 0 0 2024-02-28T23:07:09.071 INFO:tasks.workunit.client.0.smithi159.stdout:7/195: readlink d5/d16/d1a/d27/d29/d2a/l2c 0 2024-02-28T23:07:09.072 INFO:tasks.workunit.client.0.smithi159.stdout:7/196: dread - d5/d10/f34 zero size 2024-02-28T23:07:09.074 INFO:tasks.workunit.client.0.smithi159.stdout:7/197: fsync d5/d10/f36 0 2024-02-28T23:07:09.075 INFO:tasks.workunit.client.0.smithi159.stdout:0/325: unlink d0/d5/d14/d25/d2c/c2f 0 2024-02-28T23:07:09.082 INFO:tasks.workunit.client.0.smithi159.stdout:3/227: link d0/d6/lf d0/d6/d3e/l44 0 2024-02-28T23:07:09.083 INFO:tasks.workunit.client.0.smithi159.stdout:5/285: creat d8/d19/f54 x:0 0 0 2024-02-28T23:07:09.084 INFO:tasks.workunit.client.0.smithi159.stdout:9/205: link l3 d4/d17/l42 0 2024-02-28T23:07:09.084 INFO:tasks.workunit.client.0.smithi159.stdout:2/215: dwrite d9/de/d13/d31/d37/f39 [4194304,4194304] 0 2024-02-28T23:07:09.089 INFO:tasks.workunit.client.0.smithi159.stdout:6/246: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:09.092 INFO:tasks.workunit.client.0.smithi159.stdout:9/206: creat d4/d17/f43 x:0 0 0 2024-02-28T23:07:09.095 INFO:tasks.workunit.client.0.smithi159.stdout:6/247: mkdir d0/d1b/d5b 0 2024-02-28T23:07:09.097 INFO:tasks.workunit.client.0.smithi159.stdout:8/288: truncate d2/d11/d52/d47/f51 162050 0 2024-02-28T23:07:09.104 INFO:tasks.workunit.client.0.smithi159.stdout:3/228: link d0/d6/d19/f2d d0/d6/d34/f45 0 2024-02-28T23:07:09.105 INFO:tasks.workunit.client.0.smithi159.stdout:8/289: mkdir d2/d11/d52/d47/d65 0 2024-02-28T23:07:09.109 INFO:tasks.workunit.client.0.smithi159.stdout:6/248: creat d0/d1b/d33/d11/d14/d49/f5c x:0 0 0 2024-02-28T23:07:09.114 INFO:tasks.workunit.client.0.smithi159.stdout:3/229: mknod d0/c46 0 2024-02-28T23:07:09.122 INFO:tasks.workunit.client.0.smithi159.stdout:3/230: mkdir d0/d47 0 2024-02-28T23:07:09.125 INFO:tasks.workunit.client.0.smithi159.stdout:3/231: stat d0/d6 0 2024-02-28T23:07:09.125 INFO:tasks.workunit.client.0.smithi159.stdout:2/216: dwrite d9/de/d13/d31/d37/f39 [0,4194304] 0 2024-02-28T23:07:09.128 INFO:tasks.workunit.client.0.smithi159.stdout:0/326: dwrite d0/d5/d14/d25/f39 [0,4194304] 0 2024-02-28T23:07:09.132 INFO:tasks.workunit.client.0.smithi159.stdout:3/232: chown d0/d6/l37 395 1 2024-02-28T23:07:09.134 INFO:tasks.workunit.client.0.smithi159.stdout:0/327: chown d0/de/l10 16 1 2024-02-28T23:07:09.134 INFO:tasks.workunit.client.0.smithi159.stdout:5/286: dwrite d8/d16/f33 [0,4194304] 0 2024-02-28T23:07:09.140 INFO:tasks.workunit.client.0.smithi159.stdout:9/207: dread d4/f13 [0,4194304] 0 2024-02-28T23:07:09.156 INFO:tasks.workunit.client.0.smithi159.stdout:9/208: dwrite d4/d17/f43 [0,4194304] 0 2024-02-28T23:07:09.175 INFO:tasks.workunit.client.0.smithi159.stdout:4/282: sync 2024-02-28T23:07:09.187 INFO:tasks.workunit.client.0.smithi159.stdout:4/283: dwrite d9/da/d1c/d23/f2f [0,4194304] 0 2024-02-28T23:07:09.188 INFO:tasks.workunit.client.0.smithi159.stdout:4/284: stat d9/da/d1c/d23/d2d/c36 0 2024-02-28T23:07:09.210 INFO:tasks.workunit.client.0.smithi159.stdout:8/290: truncate d2/d3/f20 931083 0 2024-02-28T23:07:09.211 INFO:tasks.workunit.client.0.smithi159.stdout:8/291: dread - d2/f5c zero size 2024-02-28T23:07:09.213 INFO:tasks.workunit.client.0.smithi159.stdout:8/292: fdatasync d2/d11/d52/d26/f5a 0 2024-02-28T23:07:09.214 INFO:tasks.workunit.client.0.smithi159.stdout:2/217: creat d9/de/d13/f40 x:0 0 0 2024-02-28T23:07:09.217 INFO:tasks.workunit.client.0.smithi159.stdout:3/233: mknod d0/d6/d3e/c48 0 2024-02-28T23:07:09.218 INFO:tasks.workunit.client.0.smithi159.stdout:5/287: symlink d8/d19/d23/d35/d38/l55 0 2024-02-28T23:07:09.220 INFO:tasks.workunit.client.0.smithi159.stdout:5/288: chown d8/d19/d23/l48 179 1 2024-02-28T23:07:09.223 INFO:tasks.workunit.client.0.smithi159.stdout:8/293: mknod d2/d11/d52/d26/d36/c66 0 2024-02-28T23:07:09.224 INFO:tasks.workunit.client.0.smithi159.stdout:0/328: creat d0/d5/d38/d63/f7c x:0 0 0 2024-02-28T23:07:09.225 INFO:tasks.workunit.client.0.smithi159.stdout:8/294: chown d2/d11/d52/f62 0 1 2024-02-28T23:07:09.226 INFO:tasks.workunit.client.0.smithi159.stdout:5/289: creat d8/d19/d23/f56 x:0 0 0 2024-02-28T23:07:09.228 INFO:tasks.workunit.client.0.smithi159.stdout:5/290: chown d8/d16/f1a 58050332 1 2024-02-28T23:07:09.231 INFO:tasks.workunit.client.0.smithi159.stdout:5/291: creat d8/d19/d23/f57 x:0 0 0 2024-02-28T23:07:09.231 INFO:tasks.workunit.client.0.smithi159.stdout:4/285: link d9/da/d1c/c2e d9/da/d1c/d23/d2d/d59/c67 0 2024-02-28T23:07:09.233 INFO:tasks.workunit.client.0.smithi159.stdout:8/295: getdents d2/d11/d52/d47 0 2024-02-28T23:07:09.233 INFO:tasks.workunit.client.0.smithi159.stdout:4/286: readlink d9/da/l65 0 2024-02-28T23:07:09.234 INFO:tasks.workunit.client.0.smithi159.stdout:4/287: chown d9/da/lf 1284804 1 2024-02-28T23:07:09.235 INFO:tasks.workunit.client.0.smithi159.stdout:5/292: creat d8/d19/d23/d35/d41/f58 x:0 0 0 2024-02-28T23:07:09.240 INFO:tasks.workunit.client.0.smithi159.stdout:5/293: mkdir d8/d59 0 2024-02-28T23:07:09.242 INFO:tasks.workunit.client.0.smithi159.stdout:5/294: fdatasync d8/d19/d23/f4d 0 2024-02-28T23:07:09.246 INFO:tasks.workunit.client.0.smithi159.stdout:5/295: rmdir d8/d19/d23/d35/d38 39 2024-02-28T23:07:09.251 INFO:tasks.workunit.client.0.smithi159.stdout:3/234: truncate d0/f35 347304 0 2024-02-28T23:07:09.252 INFO:tasks.workunit.client.0.smithi159.stdout:8/296: dwrite d2/d11/d52/d26/f5a [0,4194304] 0 2024-02-28T23:07:09.255 INFO:tasks.workunit.client.0.smithi159.stdout:3/235: mkdir d0/d6/d3e/d49 0 2024-02-28T23:07:09.255 INFO:tasks.workunit.client.0.smithi159.stdout:4/288: dwrite d9/da/d1c/d23/d2d/f41 [0,4194304] 0 2024-02-28T23:07:09.256 INFO:tasks.workunit.client.0.smithi159.stdout:5/296: dread d8/f21 [0,4194304] 0 2024-02-28T23:07:09.259 INFO:tasks.workunit.client.0.smithi159.stdout:3/236: stat d0/d6/d19/f2d 0 2024-02-28T23:07:09.263 INFO:tasks.workunit.client.0.smithi159.stdout:4/289: chown d9/da/l28 473946167 1 2024-02-28T23:07:09.265 INFO:tasks.workunit.client.0.smithi159.stdout:5/297: chown d8/c26 5580614 1 2024-02-28T23:07:09.265 INFO:tasks.workunit.client.0.smithi159.stdout:3/237: write d0/d6/d3e/f1d [30392,48467] 0 2024-02-28T23:07:09.274 INFO:tasks.workunit.client.0.smithi159.stdout:4/290: creat d9/d66/f68 x:0 0 0 2024-02-28T23:07:09.274 INFO:tasks.workunit.client.0.smithi159.stdout:5/298: creat d8/d19/d23/d2a/f5a x:0 0 0 2024-02-28T23:07:09.278 INFO:tasks.workunit.client.0.smithi159.stdout:8/297: dwrite d2/d11/d52/f54 [0,4194304] 0 2024-02-28T23:07:09.281 INFO:tasks.workunit.client.0.smithi159.stdout:4/291: rmdir d9/d20 39 2024-02-28T23:07:09.285 INFO:tasks.workunit.client.0.smithi159.stdout:5/299: mknod d8/d19/c5b 0 2024-02-28T23:07:09.286 INFO:tasks.workunit.client.0.smithi159.stdout:8/298: symlink d2/d11/d52/d26/d36/d38/l67 0 2024-02-28T23:07:09.287 INFO:tasks.workunit.client.0.smithi159.stdout:5/300: chown d8/d19/d23/f4d 0 1 2024-02-28T23:07:09.291 INFO:tasks.workunit.client.0.smithi159.stdout:4/292: creat d9/d42/f69 x:0 0 0 2024-02-28T23:07:09.298 INFO:tasks.workunit.client.0.smithi159.stdout:3/238: dread d0/d6/f13 [4194304,4194304] 0 2024-02-28T23:07:09.300 INFO:tasks.workunit.client.0.smithi159.stdout:4/293: getdents d9/da 0 2024-02-28T23:07:09.312 INFO:tasks.workunit.client.0.smithi159.stdout:5/301: dwrite d8/f34 [4194304,4194304] 0 2024-02-28T23:07:09.312 INFO:tasks.workunit.client.0.smithi159.stdout:3/239: rename d0/d6/d19/f3a to d0/d6/d3e/f4a 0 2024-02-28T23:07:09.312 INFO:tasks.workunit.client.0.smithi159.stdout:8/299: dwrite d2/d11/d52/d26/d36/d38/f49 [0,4194304] 0 2024-02-28T23:07:09.315 INFO:tasks.workunit.client.0.smithi159.stdout:3/240: write d0/f12 [2522778,85613] 0 2024-02-28T23:07:09.317 INFO:tasks.workunit.client.0.smithi159.stdout:3/241: fsync d0/d6/f32 0 2024-02-28T23:07:09.319 INFO:tasks.workunit.client.0.smithi159.stdout:8/300: mkdir d2/d11/d52/d47/d65/d68 0 2024-02-28T23:07:09.327 INFO:tasks.workunit.client.0.smithi159.stdout:8/301: mknod d2/d11/d52/d47/d65/c69 0 2024-02-28T23:07:09.329 INFO:tasks.workunit.client.0.smithi159.stdout:8/302: dread - d2/d11/d52/f4d zero size 2024-02-28T23:07:09.334 INFO:tasks.workunit.client.0.smithi159.stdout:8/303: creat d2/d11/d35/d5f/f6a x:0 0 0 2024-02-28T23:07:09.344 INFO:tasks.workunit.client.0.smithi159.stdout:4/294: dread d9/d20/f29 [0,4194304] 0 2024-02-28T23:07:09.356 INFO:tasks.workunit.client.0.smithi159.stdout:4/295: dread d9/da/d1c/d23/d2d/d59/f5d [0,4194304] 0 2024-02-28T23:07:09.359 INFO:tasks.workunit.client.0.smithi159.stdout:4/296: truncate d9/f5b 596231 0 2024-02-28T23:07:09.362 INFO:tasks.workunit.client.0.smithi159.stdout:4/297: read d9/da/d1c/d23/d2d/f41 [4025539,74385] 0 2024-02-28T23:07:09.363 INFO:tasks.workunit.client.0.smithi159.stdout:8/304: dwrite d2/d11/d52/d47/f51 [0,4194304] 0 2024-02-28T23:07:09.366 INFO:tasks.workunit.client.0.smithi159.stdout:8/305: chown d2/d11/d52/d26/d36/l43 227033 1 2024-02-28T23:07:09.369 INFO:tasks.workunit.client.0.smithi159.stdout:5/302: dread d8/d19/d23/d35/d38/f3e [0,4194304] 0 2024-02-28T23:07:09.369 INFO:tasks.workunit.client.0.smithi159.stdout:4/298: stat d9/l35 0 2024-02-28T23:07:09.370 INFO:tasks.workunit.client.0.smithi159.stdout:8/306: creat d2/d11/d52/d47/f6b x:0 0 0 2024-02-28T23:07:09.372 INFO:tasks.workunit.client.0.smithi159.stdout:4/299: creat d9/d42/d54/d55/f6a x:0 0 0 2024-02-28T23:07:09.374 INFO:tasks.workunit.client.0.smithi159.stdout:8/307: symlink d2/d11/d52/d47/d65/l6c 0 2024-02-28T23:07:09.375 INFO:tasks.workunit.client.0.smithi159.stdout:3/242: dread d0/d6/d3e/f1e [0,4194304] 0 2024-02-28T23:07:09.377 INFO:tasks.workunit.client.0.smithi159.stdout:5/303: link d8/f34 d8/d19/d23/f5c 0 2024-02-28T23:07:09.379 INFO:tasks.workunit.client.0.smithi159.stdout:4/300: fsync d9/d4c/f5a 0 2024-02-28T23:07:09.381 INFO:tasks.workunit.client.0.smithi159.stdout:5/304: creat d8/d19/d23/d35/d41/f5d x:0 0 0 2024-02-28T23:07:09.383 INFO:tasks.workunit.client.0.smithi159.stdout:5/305: write d8/d19/f1c [2210077,83435] 0 2024-02-28T23:07:09.385 INFO:tasks.workunit.client.0.smithi159.stdout:5/306: stat d8/d19/c2b 0 2024-02-28T23:07:09.391 INFO:tasks.workunit.client.0.smithi159.stdout:4/301: dread d9/da/f62 [0,4194304] 0 2024-02-28T23:07:09.393 INFO:tasks.workunit.client.0.smithi159.stdout:3/243: dwrite d0/d6/d3e/f22 [0,4194304] 0 2024-02-28T23:07:09.395 INFO:tasks.workunit.client.0.smithi159.stdout:8/308: truncate d2/d3/f3d 122284 0 2024-02-28T23:07:09.403 INFO:tasks.workunit.client.0.smithi159.stdout:8/309: creat d2/f6d x:0 0 0 2024-02-28T23:07:09.404 INFO:tasks.workunit.client.0.smithi159.stdout:3/244: read d0/f12 [2427325,116981] 0 2024-02-28T23:07:09.409 INFO:tasks.workunit.client.0.smithi159.stdout:8/310: mkdir d2/d11/d52/d6e 0 2024-02-28T23:07:09.411 INFO:tasks.workunit.client.0.smithi159.stdout:5/307: dread d8/d16/f33 [0,4194304] 0 2024-02-28T23:07:09.413 INFO:tasks.workunit.client.0.smithi159.stdout:3/245: rename d0/d6/d3e/d2f/f39 to d0/d6/d3e/d2f/f4b 0 2024-02-28T23:07:09.415 INFO:tasks.workunit.client.0.smithi159.stdout:5/308: write d8/d19/d23/d35/d41/f50 [784905,72687] 0 2024-02-28T23:07:09.416 INFO:tasks.workunit.client.0.smithi159.stdout:4/302: dwrite d9/f18 [4194304,4194304] 0 2024-02-28T23:07:09.422 INFO:tasks.workunit.client.0.smithi159.stdout:5/309: write d8/d19/d23/d35/d41/f5d [357472,125149] 0 2024-02-28T23:07:09.422 INFO:tasks.workunit.client.0.smithi159.stdout:4/303: creat d9/d66/f6b x:0 0 0 2024-02-28T23:07:09.426 INFO:tasks.workunit.client.0.smithi159.stdout:3/246: truncate d0/d6/d34/f45 878608 0 2024-02-28T23:07:09.433 INFO:tasks.workunit.client.0.smithi159.stdout:5/310: fdatasync d8/d19/d23/d35/d38/f3e 0 2024-02-28T23:07:09.435 INFO:tasks.workunit.client.0.smithi159.stdout:3/247: rmdir d0/d6/d34 39 2024-02-28T23:07:09.438 INFO:tasks.workunit.client.0.smithi159.stdout:4/304: rename d9/d66 to d9/d4c/d6c 0 2024-02-28T23:07:09.443 INFO:tasks.workunit.client.0.smithi159.stdout:5/311: creat d8/d19/d23/d35/f5e x:0 0 0 2024-02-28T23:07:09.444 INFO:tasks.workunit.client.0.smithi159.stdout:4/305: symlink d9/d20/l6d 0 2024-02-28T23:07:09.446 INFO:tasks.workunit.client.0.smithi159.stdout:3/248: creat d0/f4c x:0 0 0 2024-02-28T23:07:09.448 INFO:tasks.workunit.client.0.smithi159.stdout:4/306: write d9/d42/f69 [368026,90655] 0 2024-02-28T23:07:09.448 INFO:tasks.workunit.client.0.smithi159.stdout:5/312: dread d8/f21 [0,4194304] 0 2024-02-28T23:07:09.452 INFO:tasks.workunit.client.0.smithi159.stdout:4/307: read d9/da/f16 [550700,113395] 0 2024-02-28T23:07:09.455 INFO:tasks.workunit.client.0.smithi159.stdout:5/313: symlink d8/d19/d23/d35/d41/l5f 0 2024-02-28T23:07:09.456 INFO:tasks.workunit.client.0.smithi159.stdout:5/314: readlink d8/d19/l1b 0 2024-02-28T23:07:09.458 INFO:tasks.workunit.client.0.smithi159.stdout:3/249: rename d0/l1 to d0/d6/d3e/d49/l4d 0 2024-02-28T23:07:09.471 INFO:tasks.workunit.client.0.smithi159.stdout:4/308: dwrite d9/f4e [0,4194304] 0 2024-02-28T23:07:09.474 INFO:tasks.workunit.client.0.smithi159.stdout:4/309: readlink d9/da/d1c/d23/l38 0 2024-02-28T23:07:09.480 INFO:tasks.workunit.client.0.smithi159.stdout:4/310: mknod d9/c6e 0 2024-02-28T23:07:09.483 INFO:tasks.workunit.client.0.smithi159.stdout:4/311: write d9/da/d1c/f53 [3573547,128507] 0 2024-02-28T23:07:09.484 INFO:tasks.workunit.client.0.smithi159.stdout:4/312: fsync d9/d42/d54/d55/f6a 0 2024-02-28T23:07:09.487 INFO:tasks.workunit.client.0.smithi159.stdout:4/313: mknod d9/d42/d54/d56/c6f 0 2024-02-28T23:07:09.492 INFO:tasks.workunit.client.0.smithi159.stdout:4/314: truncate d9/da/d1c/d23/f37 861513 0 2024-02-28T23:07:09.493 INFO:tasks.workunit.client.0.smithi159.stdout:4/315: fdatasync d9/d20/f5e 0 2024-02-28T23:07:09.495 INFO:tasks.workunit.client.0.smithi159.stdout:4/316: dread - d9/da/d1c/d23/f63 zero size 2024-02-28T23:07:09.499 INFO:tasks.workunit.client.0.smithi159.stdout:4/317: link d9/d20/f22 d9/d42/d54/d56/f70 0 2024-02-28T23:07:09.500 INFO:tasks.workunit.client.0.smithi159.stdout:4/318: fdatasync d9/f4e 0 2024-02-28T23:07:09.503 INFO:tasks.workunit.client.0.smithi159.stdout:4/319: write d9/da/d1c/d23/d2d/d59/f5d [424962,45684] 0 2024-02-28T23:07:09.506 INFO:tasks.workunit.client.0.smithi159.stdout:4/320: mknod d9/da/d1c/d23/c71 0 2024-02-28T23:07:09.509 INFO:tasks.workunit.client.0.smithi159.stdout:4/321: unlink d9/d20/l6d 0 2024-02-28T23:07:09.510 INFO:tasks.workunit.client.0.smithi159.stdout:4/322: chown d9/da/d1c/d23/l38 90866 1 2024-02-28T23:07:09.520 INFO:tasks.workunit.client.0.smithi159.stdout:4/323: write d9/da/f62 [559147,58354] 0 2024-02-28T23:07:09.520 INFO:tasks.workunit.client.0.smithi159.stdout:4/324: creat d9/d42/d54/d55/f72 x:0 0 0 2024-02-28T23:07:09.637 INFO:tasks.workunit.client.0.smithi159.stdout:1/191: sync 2024-02-28T23:07:09.638 INFO:tasks.workunit.client.0.smithi159.stdout:7/198: sync 2024-02-28T23:07:09.645 INFO:tasks.workunit.client.0.smithi159.stdout:7/199: mknod d5/d16/d40/c43 0 2024-02-28T23:07:09.647 INFO:tasks.workunit.client.0.smithi159.stdout:7/200: dread - d5/d16/d1a/d27/d29/f33 zero size 2024-02-28T23:07:09.650 INFO:tasks.workunit.client.0.smithi159.stdout:7/201: symlink d5/d16/d1a/d27/d29/d2a/l44 0 2024-02-28T23:07:09.655 INFO:tasks.workunit.client.0.smithi159.stdout:7/202: write d5/d16/f19 [11830,22699] 0 2024-02-28T23:07:09.661 INFO:tasks.workunit.client.0.smithi159.stdout:1/192: dwrite d6/d12/d1a/f23 [0,4194304] 0 2024-02-28T23:07:09.662 INFO:tasks.workunit.client.0.smithi159.stdout:1/193: stat d6/d12/f14 0 2024-02-28T23:07:09.663 INFO:tasks.workunit.client.0.smithi159.stdout:7/203: rename d5/f26 to d5/d16/d1a/d27/d29/d2a/f45 0 2024-02-28T23:07:09.672 INFO:tasks.workunit.client.0.smithi159.stdout:1/194: link d6/d1d/d1f/c37 d6/d12/d1a/c3b 0 2024-02-28T23:07:09.674 INFO:tasks.workunit.client.0.smithi159.stdout:7/204: dread d5/f9 [0,4194304] 0 2024-02-28T23:07:09.677 INFO:tasks.workunit.client.0.smithi159.stdout:7/205: chown d5/d16/l20 53420740 1 2024-02-28T23:07:09.680 INFO:tasks.workunit.client.0.smithi159.stdout:7/206: mkdir d5/d16/d1a/d27/d46 0 2024-02-28T23:07:09.683 INFO:tasks.workunit.client.0.smithi159.stdout:7/207: chown d5/d16/d1a/d27/d29 45790 1 2024-02-28T23:07:09.689 INFO:tasks.workunit.client.0.smithi159.stdout:7/208: rename d5/d16/d1a/d27/f2d to d5/d10/f47 0 2024-02-28T23:07:09.691 INFO:tasks.workunit.client.0.smithi159.stdout:7/209: write d5/f12 [2088110,73946] 0 2024-02-28T23:07:09.692 INFO:tasks.workunit.client.0.smithi159.stdout:7/210: fsync d5/fd 0 2024-02-28T23:07:09.696 INFO:tasks.workunit.client.0.smithi159.stdout:7/211: creat d5/d16/d1a/d27/d3e/f48 x:0 0 0 2024-02-28T23:07:09.701 INFO:tasks.workunit.client.0.smithi159.stdout:7/212: getdents d5/d16/d1a/d24 0 2024-02-28T23:07:09.711 INFO:tasks.workunit.client.0.smithi159.stdout:1/195: dread d6/d12/d16/f1c [0,4194304] 0 2024-02-28T23:07:09.716 INFO:tasks.workunit.client.0.smithi159.stdout:4/325: write d9/d42/d54/d56/f70 [1298520,85746] 0 2024-02-28T23:07:09.719 INFO:tasks.workunit.client.0.smithi159.stdout:1/196: getdents d6/d12 0 2024-02-28T23:07:09.724 INFO:tasks.workunit.client.0.smithi159.stdout:4/326: symlink d9/da/l73 0 2024-02-28T23:07:09.725 INFO:tasks.workunit.client.0.smithi159.stdout:1/197: mkdir d6/d12/d33/d3c 0 2024-02-28T23:07:09.725 INFO:tasks.workunit.client.0.smithi159.stdout:7/213: dread d5/f12 [0,4194304] 0 2024-02-28T23:07:09.726 INFO:tasks.workunit.client.0.smithi159.stdout:7/214: dread - d5/d16/d1a/f38 zero size 2024-02-28T23:07:09.727 INFO:tasks.workunit.client.0.smithi159.stdout:4/327: rmdir d9/d42 39 2024-02-28T23:07:09.728 INFO:tasks.workunit.client.0.smithi159.stdout:4/328: stat d9/d20/f29 0 2024-02-28T23:07:09.728 INFO:tasks.workunit.client.0.smithi159.stdout:1/198: creat d6/d12/d1a/f3d x:0 0 0 2024-02-28T23:07:09.735 INFO:tasks.workunit.client.0.smithi159.stdout:1/199: mkdir d6/d1d/d1f/d3e 0 2024-02-28T23:07:09.736 INFO:tasks.workunit.client.0.smithi159.stdout:4/329: mknod d9/da/d1c/c74 0 2024-02-28T23:07:09.745 INFO:tasks.workunit.client.0.smithi159.stdout:4/330: rename d9/da/d1c/d23/l4f to d9/da/l75 0 2024-02-28T23:07:09.745 INFO:tasks.workunit.client.0.smithi159.stdout:7/215: write d5/d16/f1f [71004,58381] 0 2024-02-28T23:07:09.745 INFO:tasks.workunit.client.0.smithi159.stdout:1/200: dread d6/d12/d16/f28 [0,4194304] 0 2024-02-28T23:07:09.747 INFO:tasks.workunit.client.0.smithi159.stdout:7/216: truncate d5/f1e 1417070 0 2024-02-28T23:07:09.747 INFO:tasks.workunit.client.0.smithi159.stdout:4/331: symlink d9/da/d1c/d23/d2d/l76 0 2024-02-28T23:07:09.748 INFO:tasks.workunit.client.0.smithi159.stdout:1/201: write d6/fb [575541,12205] 0 2024-02-28T23:07:09.750 INFO:tasks.workunit.client.0.smithi159.stdout:7/217: write d5/d16/f1f [514249,6290] 0 2024-02-28T23:07:09.751 INFO:tasks.workunit.client.0.smithi159.stdout:1/202: read - d6/d12/f2a zero size 2024-02-28T23:07:09.753 INFO:tasks.workunit.client.0.smithi159.stdout:7/218: chown d5/d16/d1a/d24/f3a 259392 1 2024-02-28T23:07:09.754 INFO:tasks.workunit.client.0.smithi159.stdout:4/332: mkdir d9/d42/d54/d77 0 2024-02-28T23:07:09.755 INFO:tasks.workunit.client.0.smithi159.stdout:4/333: chown d9/f5b 1649 1 2024-02-28T23:07:09.757 INFO:tasks.workunit.client.0.smithi159.stdout:7/219: creat d5/d16/f49 x:0 0 0 2024-02-28T23:07:09.760 INFO:tasks.workunit.client.0.smithi159.stdout:7/220: truncate d5/d16/d1a/f38 123210 0 2024-02-28T23:07:09.762 INFO:tasks.workunit.client.0.smithi159.stdout:7/221: fsync d5/d16/d1a/f3c 0 2024-02-28T23:07:09.762 INFO:tasks.workunit.client.0.smithi159.stdout:4/334: rename d9/l25 to d9/da/d1c/d23/d2d/l78 0 2024-02-28T23:07:09.772 INFO:tasks.workunit.client.0.smithi159.stdout:4/335: getdents d9/da 0 2024-02-28T23:07:09.774 INFO:tasks.workunit.client.0.smithi159.stdout:7/222: dread f4 [4194304,4194304] 0 2024-02-28T23:07:09.775 INFO:tasks.workunit.client.0.smithi159.stdout:4/336: symlink d9/da/d1c/d23/d2d/l79 0 2024-02-28T23:07:09.777 INFO:tasks.workunit.client.0.smithi159.stdout:7/223: creat d5/d16/d1a/d27/d3e/f4a x:0 0 0 2024-02-28T23:07:09.778 INFO:tasks.workunit.client.0.smithi159.stdout:7/224: readlink d5/l7 0 2024-02-28T23:07:09.782 INFO:tasks.workunit.client.0.smithi159.stdout:7/225: symlink d5/d16/d1a/l4b 0 2024-02-28T23:07:09.794 INFO:tasks.workunit.client.0.smithi159.stdout:4/337: dwrite d9/da/d1c/d23/f24 [0,4194304] 0 2024-02-28T23:07:09.797 INFO:tasks.workunit.client.0.smithi159.stdout:7/226: dwrite d5/d10/f36 [0,4194304] 0 2024-02-28T23:07:09.799 INFO:tasks.workunit.client.0.smithi159.stdout:4/338: mkdir d9/da/d1c/d23/d7a 0 2024-02-28T23:07:09.803 INFO:tasks.workunit.client.0.smithi159.stdout:4/339: symlink d9/da/d1c/d23/d2d/l7b 0 2024-02-28T23:07:09.804 INFO:tasks.workunit.client.0.smithi159.stdout:9/209: sync 2024-02-28T23:07:09.808 INFO:tasks.workunit.client.0.smithi159.stdout:4/340: unlink d9/d42/f69 0 2024-02-28T23:07:09.811 INFO:tasks.workunit.client.0.smithi159.stdout:4/341: symlink d9/da/l7c 0 2024-02-28T23:07:09.828 INFO:tasks.workunit.client.0.smithi159.stdout:9/210: dwrite d4/f30 [0,4194304] 0 2024-02-28T23:07:09.831 INFO:tasks.workunit.client.0.smithi159.stdout:4/342: dwrite d9/f18 [4194304,4194304] 0 2024-02-28T23:07:09.833 INFO:tasks.workunit.client.0.smithi159.stdout:4/343: stat d9/da/d1c/d23/d2d/c36 0 2024-02-28T23:07:09.836 INFO:tasks.workunit.client.0.smithi159.stdout:4/344: readlink d9/d20/l45 0 2024-02-28T23:07:09.837 INFO:tasks.workunit.client.0.smithi159.stdout:9/211: rename l3 to d4/d17/l44 0 2024-02-28T23:07:09.838 INFO:tasks.workunit.client.0.smithi159.stdout:4/345: write d9/da/f3a [1021564,38854] 0 2024-02-28T23:07:09.848 INFO:tasks.workunit.client.0.smithi159.stdout:9/212: dread d4/f13 [0,4194304] 0 2024-02-28T23:07:09.849 INFO:tasks.workunit.client.0.smithi159.stdout:4/346: dread d9/da/fc [0,4194304] 0 2024-02-28T23:07:09.909 INFO:tasks.workunit.client.0.smithi159.stdout:9/213: write d4/d17/f24 [2816352,117827] 0 2024-02-28T23:07:09.910 INFO:tasks.workunit.client.0.smithi159.stdout:4/347: write d9/f1b [1126131,39534] 0 2024-02-28T23:07:09.910 INFO:tasks.workunit.client.0.smithi159.stdout:9/214: readlink d4/lb 0 2024-02-28T23:07:09.911 INFO:tasks.workunit.client.0.smithi159.stdout:9/215: rename d4 to d4/d45 22 2024-02-28T23:07:09.912 INFO:tasks.workunit.client.0.smithi159.stdout:4/348: stat d9/f19 0 2024-02-28T23:07:09.914 INFO:tasks.workunit.client.0.smithi159.stdout:4/349: read d9/da/fc [2663864,110996] 0 2024-02-28T23:07:09.915 INFO:tasks.workunit.client.0.smithi159.stdout:9/216: rename d4/d17/f27 to d4/d17/f46 0 2024-02-28T23:07:09.917 INFO:tasks.workunit.client.0.smithi159.stdout:9/217: write d4/d17/f29 [966946,82175] 0 2024-02-28T23:07:09.918 INFO:tasks.workunit.client.0.smithi159.stdout:4/350: symlink d9/d42/d54/d56/l7d 0 2024-02-28T23:07:09.920 INFO:tasks.workunit.client.0.smithi159.stdout:9/218: write d4/f36 [1038566,111804] 0 2024-02-28T23:07:09.922 INFO:tasks.workunit.client.0.smithi159.stdout:9/219: write d4/d17/f2e [3903064,43018] 0 2024-02-28T23:07:09.924 INFO:tasks.workunit.client.0.smithi159.stdout:4/351: rename d9/da/f62 to d9/da/f7e 0 2024-02-28T23:07:09.928 INFO:tasks.workunit.client.0.smithi159.stdout:9/220: symlink d4/d17/d37/l47 0 2024-02-28T23:07:09.930 INFO:tasks.workunit.client.0.smithi159.stdout:9/221: symlink d4/l48 0 2024-02-28T23:07:09.932 INFO:tasks.workunit.client.0.smithi159.stdout:4/352: creat d9/f7f x:0 0 0 2024-02-28T23:07:09.935 INFO:tasks.workunit.client.0.smithi159.stdout:9/222: creat d4/d17/f49 x:0 0 0 2024-02-28T23:07:09.936 INFO:tasks.workunit.client.0.smithi159.stdout:4/353: creat d9/d42/d54/f80 x:0 0 0 2024-02-28T23:07:09.941 INFO:tasks.workunit.client.0.smithi159.stdout:9/223: mkdir d4/d3d/d3e/d4a 0 2024-02-28T23:07:09.942 INFO:tasks.workunit.client.0.smithi159.stdout:9/224: write d4/f11 [3762204,64603] 0 2024-02-28T23:07:09.947 INFO:tasks.workunit.client.0.smithi159.stdout:9/225: link d4/d3d/c41 d4/d17/d37/c4b 0 2024-02-28T23:07:09.954 INFO:tasks.workunit.client.0.smithi159.stdout:4/354: dwrite d9/f3c [0,4194304] 0 2024-02-28T23:07:09.957 INFO:tasks.workunit.client.0.smithi159.stdout:4/355: mkdir d9/d20/d81 0 2024-02-28T23:07:09.961 INFO:tasks.workunit.client.0.smithi159.stdout:4/356: mknod d9/d42/d54/d56/c82 0 2024-02-28T23:07:09.964 INFO:tasks.workunit.client.0.smithi159.stdout:9/226: dwrite d4/d17/f24 [0,4194304] 0 2024-02-28T23:07:09.965 INFO:tasks.workunit.client.0.smithi159.stdout:4/357: truncate d9/da/d1c/d23/f24 5281641 0 2024-02-28T23:07:09.965 INFO:tasks.workunit.client.0.smithi159.stdout:9/227: fdatasync d4/d17/f29 0 2024-02-28T23:07:09.966 INFO:tasks.workunit.client.0.smithi159.stdout:4/358: dread - d9/d4c/f58 zero size 2024-02-28T23:07:09.983 INFO:tasks.workunit.client.0.smithi159.stdout:4/359: dwrite d9/da/d1c/f53 [0,4194304] 0 2024-02-28T23:07:09.985 INFO:tasks.workunit.client.0.smithi159.stdout:6/249: sync 2024-02-28T23:07:09.987 INFO:tasks.workunit.client.0.smithi159.stdout:6/250: readlink d0/d1b/d33/d11/l40 0 2024-02-28T23:07:09.987 INFO:tasks.workunit.client.0.smithi159.stdout:4/360: write d9/d4c/f58 [358567,80280] 0 2024-02-28T23:07:09.990 INFO:tasks.workunit.client.0.smithi159.stdout:4/361: creat d9/da/d1c/d23/d2d/f83 x:0 0 0 2024-02-28T23:07:09.993 INFO:tasks.workunit.client.0.smithi159.stdout:4/362: fdatasync d9/d4c/d6c/f6b 0 2024-02-28T23:07:09.997 INFO:tasks.workunit.client.0.smithi159.stdout:4/363: chown d9/da/d1c/c31 19 1 2024-02-28T23:07:10.000 INFO:tasks.workunit.client.0.smithi159.stdout:4/364: write d9/d4c/d6c/f68 [744733,94073] 0 2024-02-28T23:07:10.010 INFO:tasks.workunit.client.0.smithi159.stdout:6/251: dwrite d0/d1b/d33/d11/d14/d49/f5c [0,4194304] 0 2024-02-28T23:07:10.014 INFO:tasks.workunit.client.0.smithi159.stdout:6/252: write d0/d1b/f29 [454097,18808] 0 2024-02-28T23:07:10.018 INFO:tasks.workunit.client.0.smithi159.stdout:6/253: write d0/d1b/d33/d11/d34/f4c [512007,126439] 0 2024-02-28T23:07:10.026 INFO:tasks.workunit.client.0.smithi159.stdout:6/254: mkdir d0/d1b/d33/d11/d14/d5d 0 2024-02-28T23:07:10.028 INFO:tasks.workunit.client.0.smithi159.stdout:6/255: dread - d0/d1b/f3c zero size 2024-02-28T23:07:10.032 INFO:tasks.workunit.client.0.smithi159.stdout:6/256: mkdir d0/d1b/d33/d5e 0 2024-02-28T23:07:10.034 INFO:tasks.workunit.client.0.smithi159.stdout:6/257: write d0/d1b/f1f [4145991,24096] 0 2024-02-28T23:07:10.036 INFO:tasks.workunit.client.0.smithi159.stdout:4/365: dread d9/f1f [0,4194304] 0 2024-02-28T23:07:10.037 INFO:tasks.workunit.client.0.smithi159.stdout:6/258: chown d0/d1b/d33/d11/d34/f4c 1780 1 2024-02-28T23:07:10.044 INFO:tasks.workunit.client.0.smithi159.stdout:6/259: getdents d0/d1b 0 2024-02-28T23:07:10.046 INFO:tasks.workunit.client.0.smithi159.stdout:4/366: dread d9/f3c [0,4194304] 0 2024-02-28T23:07:10.048 INFO:tasks.workunit.client.0.smithi159.stdout:4/367: chown d9/da/f3a 1075079695 1 2024-02-28T23:07:10.049 INFO:tasks.workunit.client.0.smithi159.stdout:4/368: fdatasync d9/da/d1c/f53 0 2024-02-28T23:07:10.052 INFO:tasks.workunit.client.0.smithi159.stdout:4/369: creat d9/d20/f84 x:0 0 0 2024-02-28T23:07:10.053 INFO:tasks.workunit.client.0.smithi159.stdout:4/370: fdatasync d9/da/d1c/d23/f63 0 2024-02-28T23:07:10.055 INFO:tasks.workunit.client.0.smithi159.stdout:4/371: symlink d9/d20/l85 0 2024-02-28T23:07:10.058 INFO:tasks.workunit.client.0.smithi159.stdout:4/372: write d9/d42/d54/d55/f6a [562068,75124] 0 2024-02-28T23:07:10.059 INFO:tasks.workunit.client.0.smithi159.stdout:6/260: dwrite d0/d1b/d33/d11/f19 [0,4194304] 0 2024-02-28T23:07:10.063 INFO:tasks.workunit.client.0.smithi159.stdout:6/261: creat d0/d1b/d33/f5f x:0 0 0 2024-02-28T23:07:10.066 INFO:tasks.workunit.client.0.smithi159.stdout:6/262: creat d0/d1b/d33/d11/d14/d49/f60 x:0 0 0 2024-02-28T23:07:10.072 INFO:tasks.workunit.client.0.smithi159.stdout:6/263: rename d0/d1b/d33/d11/d34/f4c to d0/d1b/d38/f61 0 2024-02-28T23:07:10.074 INFO:tasks.workunit.client.0.smithi159.stdout:6/264: write d0/d1b/d38/d4d/f58 [748191,56444] 0 2024-02-28T23:07:10.088 INFO:tasks.workunit.client.0.smithi159.stdout:6/265: dwrite d0/fa [0,4194304] 0 2024-02-28T23:07:10.090 INFO:tasks.workunit.client.0.smithi159.stdout:6/266: dread - d0/d1b/d33/f5f zero size 2024-02-28T23:07:10.095 INFO:tasks.workunit.client.0.smithi159.stdout:4/373: dread d9/da/d1c/d23/d2d/f3d [0,4194304] 0 2024-02-28T23:07:10.099 INFO:tasks.workunit.client.0.smithi159.stdout:6/267: link d0/d1b/c2d d0/d1b/d38/d4e/c62 0 2024-02-28T23:07:10.101 INFO:tasks.workunit.client.0.smithi159.stdout:4/374: creat d9/da/d1c/f86 x:0 0 0 2024-02-28T23:07:10.103 INFO:tasks.workunit.client.0.smithi159.stdout:4/375: mkdir d9/d20/d87 0 2024-02-28T23:07:10.106 INFO:tasks.workunit.client.0.smithi159.stdout:6/268: dread d0/d1b/d33/d11/d14/f28 [0,4194304] 0 2024-02-28T23:07:10.106 INFO:tasks.workunit.client.0.smithi159.stdout:4/376: symlink d9/da/l88 0 2024-02-28T23:07:10.113 INFO:tasks.workunit.client.0.smithi159.stdout:6/269: link d0/d1b/c2d d0/c63 0 2024-02-28T23:07:10.116 INFO:tasks.workunit.client.0.smithi159.stdout:6/270: write d0/d1b/d33/d11/d14/f28 [1694434,118043] 0 2024-02-28T23:07:10.122 INFO:tasks.workunit.client.0.smithi159.stdout:4/377: dwrite d9/d20/f84 [0,4194304] 0 2024-02-28T23:07:10.125 INFO:tasks.workunit.client.0.smithi159.stdout:4/378: creat d9/d20/f89 x:0 0 0 2024-02-28T23:07:10.132 INFO:tasks.workunit.client.0.smithi159.stdout:4/379: write d9/da/d1c/f39 [709533,77253] 0 2024-02-28T23:07:10.133 INFO:tasks.workunit.client.0.smithi159.stdout:4/380: readlink d9/da/l14 0 2024-02-28T23:07:10.136 INFO:tasks.workunit.client.0.smithi159.stdout:2/218: sync 2024-02-28T23:07:10.136 INFO:tasks.workunit.client.0.smithi159.stdout:4/381: write d9/da/d1c/f1d [4207698,66944] 0 2024-02-28T23:07:10.137 INFO:tasks.workunit.client.0.smithi159.stdout:2/219: stat f6 0 2024-02-28T23:07:10.139 INFO:tasks.workunit.client.0.smithi159.stdout:6/271: dwrite d0/d1b/d33/d11/d14/d49/f5c [0,4194304] 0 2024-02-28T23:07:10.140 INFO:tasks.workunit.client.0.smithi159.stdout:4/382: fdatasync d9/d42/d54/d55/f72 0 2024-02-28T23:07:10.141 INFO:tasks.workunit.client.0.smithi159.stdout:2/220: symlink d9/d36/l41 0 2024-02-28T23:07:10.142 INFO:tasks.workunit.client.0.smithi159.stdout:6/272: read d0/f2a [6734,46555] 0 2024-02-28T23:07:10.149 INFO:tasks.workunit.client.0.smithi159.stdout:2/221: mknod d9/de/d13/d31/d37/c42 0 2024-02-28T23:07:10.156 INFO:tasks.workunit.client.0.smithi159.stdout:4/383: dread d9/f1f [0,4194304] 0 2024-02-28T23:07:10.157 INFO:tasks.workunit.client.0.smithi159.stdout:4/384: chown d9/da/d1c/d23/d2d 27310 1 2024-02-28T23:07:10.159 INFO:tasks.workunit.client.0.smithi159.stdout:4/385: chown d9/d42/d54/d56/l7d 6474 1 2024-02-28T23:07:10.160 INFO:tasks.workunit.client.0.smithi159.stdout:4/386: readlink d9/d42/d54/d56/l7d 0 2024-02-28T23:07:10.161 INFO:tasks.workunit.client.0.smithi159.stdout:4/387: read - d9/d20/f89 zero size 2024-02-28T23:07:10.162 INFO:tasks.workunit.client.0.smithi159.stdout:4/388: chown d9/c6e 0 1 2024-02-28T23:07:10.164 INFO:tasks.workunit.client.0.smithi159.stdout:4/389: symlink d9/d42/d54/d55/l8a 0 2024-02-28T23:07:10.167 INFO:tasks.workunit.client.0.smithi159.stdout:2/222: truncate d9/de/d13/d31/f3b 871276 0 2024-02-28T23:07:10.169 INFO:tasks.workunit.client.0.smithi159.stdout:4/390: rename d9/c49 to d9/d42/d54/c8b 0 2024-02-28T23:07:10.170 INFO:tasks.workunit.client.0.smithi159.stdout:2/223: mknod d9/de/d13/c43 0 2024-02-28T23:07:10.173 INFO:tasks.workunit.client.0.smithi159.stdout:4/391: creat d9/f8c x:0 0 0 2024-02-28T23:07:10.174 INFO:tasks.workunit.client.0.smithi159.stdout:2/224: dread d9/de/f2a [0,4194304] 0 2024-02-28T23:07:10.176 INFO:tasks.workunit.client.0.smithi159.stdout:4/392: unlink d9/d42/d54/d55/l8a 0 2024-02-28T23:07:10.181 INFO:tasks.workunit.client.0.smithi159.stdout:2/225: dread d9/de/f17 [0,4194304] 0 2024-02-28T23:07:10.181 INFO:tasks.workunit.client.0.smithi159.stdout:4/393: link d9/f1e d9/da/d1c/d23/d2d/f8d 0 2024-02-28T23:07:10.184 INFO:tasks.workunit.client.0.smithi159.stdout:4/394: mkdir d9/da/d1c/d8e 0 2024-02-28T23:07:10.184 INFO:tasks.workunit.client.0.smithi159.stdout:2/226: write d9/de/d13/d31/d37/f39 [1520736,115772] 0 2024-02-28T23:07:10.188 INFO:tasks.workunit.client.0.smithi159.stdout:2/227: mkdir d9/d34/d44 0 2024-02-28T23:07:10.189 INFO:tasks.workunit.client.0.smithi159.stdout:4/395: write d9/f3c [3920978,113373] 0 2024-02-28T23:07:10.192 INFO:tasks.workunit.client.0.smithi159.stdout:2/228: creat d9/de/d13/d31/f45 x:0 0 0 2024-02-28T23:07:10.192 INFO:tasks.workunit.client.0.smithi159.stdout:4/396: dread d9/d42/d54/f57 [0,4194304] 0 2024-02-28T23:07:10.195 INFO:tasks.workunit.client.0.smithi159.stdout:4/397: truncate d9/d20/f22 2329358 0 2024-02-28T23:07:10.196 INFO:tasks.workunit.client.0.smithi159.stdout:4/398: chown c1 71066 1 2024-02-28T23:07:10.197 INFO:tasks.workunit.client.0.smithi159.stdout:2/229: getdents d9/de/d13/d31/d37 0 2024-02-28T23:07:10.199 INFO:tasks.workunit.client.0.smithi159.stdout:2/230: mknod d9/d34/c46 0 2024-02-28T23:07:10.200 INFO:tasks.workunit.client.0.smithi159.stdout:4/399: rename d9/da/f16 to d9/d4c/f8f 0 2024-02-28T23:07:10.201 INFO:tasks.workunit.client.0.smithi159.stdout:2/231: dread d9/de/f17 [0,4194304] 0 2024-02-28T23:07:10.203 INFO:tasks.workunit.client.0.smithi159.stdout:4/400: creat d9/da/f90 x:0 0 0 2024-02-28T23:07:10.204 INFO:tasks.workunit.client.0.smithi159.stdout:4/401: write d9/da/f90 [973924,2557] 0 2024-02-28T23:07:10.206 INFO:tasks.workunit.client.0.smithi159.stdout:2/232: symlink d9/d23/d2c/l47 0 2024-02-28T23:07:10.208 INFO:tasks.workunit.client.0.smithi159.stdout:4/402: mknod d9/c91 0 2024-02-28T23:07:10.209 INFO:tasks.workunit.client.0.smithi159.stdout:2/233: stat d9/l28 0 2024-02-28T23:07:10.233 INFO:tasks.workunit.client.0.smithi159.stdout:2/234: write d9/de/f17 [295003,118982] 0 2024-02-28T23:07:10.234 INFO:tasks.workunit.client.0.smithi159.stdout:4/403: truncate d9/da/d1c/f1d 4113219 0 2024-02-28T23:07:10.236 INFO:tasks.workunit.client.0.smithi159.stdout:2/235: write d9/d23/d2c/f2d [2222579,43072] 0 2024-02-28T23:07:10.236 INFO:tasks.workunit.client.0.smithi159.stdout:4/404: fsync d9/d4c/f5a 0 2024-02-28T23:07:10.238 INFO:tasks.workunit.client.0.smithi159.stdout:2/236: truncate d9/de/f17 1208448 0 2024-02-28T23:07:10.244 INFO:tasks.workunit.client.0.smithi159.stdout:2/237: dread d9/de/f17 [0,4194304] 0 2024-02-28T23:07:10.245 INFO:tasks.workunit.client.0.smithi159.stdout:2/238: mknod d9/d23/c48 0 2024-02-28T23:07:10.247 INFO:tasks.workunit.client.0.smithi159.stdout:2/239: mknod d9/d34/c49 0 2024-02-28T23:07:10.250 INFO:tasks.workunit.client.0.smithi159.stdout:2/240: chown d9/de/d13/d31/c38 28327 1 2024-02-28T23:07:10.254 INFO:tasks.workunit.client.0.smithi159.stdout:4/405: truncate d9/f19 4513879 0 2024-02-28T23:07:10.255 INFO:tasks.workunit.client.0.smithi159.stdout:4/406: dread - d9/da/d1c/d23/f4d zero size 2024-02-28T23:07:10.260 INFO:tasks.workunit.client.0.smithi159.stdout:4/407: link d9/da/d1c/d23/f24 d9/d20/d87/f92 0 2024-02-28T23:07:10.262 INFO:tasks.workunit.client.0.smithi159.stdout:4/408: mknod d9/d42/d54/c93 0 2024-02-28T23:07:10.263 INFO:tasks.workunit.client.0.smithi159.stdout:4/409: read d9/d20/d87/f92 [4367263,52443] 0 2024-02-28T23:07:10.286 INFO:tasks.workunit.client.0.smithi159.stdout:1/203: sync 2024-02-28T23:07:10.286 INFO:tasks.workunit.client.0.smithi159.stdout:7/227: sync 2024-02-28T23:07:10.286 INFO:tasks.workunit.client.0.smithi159.stdout:3/250: sync 2024-02-28T23:07:10.286 INFO:tasks.workunit.client.0.smithi159.stdout:9/228: sync 2024-02-28T23:07:10.286 INFO:tasks.workunit.client.0.smithi159.stdout:8/311: sync 2024-02-28T23:07:10.286 INFO:tasks.workunit.client.0.smithi159.stdout:5/315: sync 2024-02-28T23:07:10.286 INFO:tasks.workunit.client.0.smithi159.stdout:0/329: sync 2024-02-28T23:07:10.287 INFO:tasks.workunit.client.0.smithi159.stdout:9/229: readlink d4/l16 0 2024-02-28T23:07:10.287 INFO:tasks.workunit.client.0.smithi159.stdout:3/251: fsync d0/f4c 0 2024-02-28T23:07:10.288 INFO:tasks.workunit.client.0.smithi159.stdout:0/330: stat d0/de/d75/d5f/f6b 0 2024-02-28T23:07:10.288 INFO:tasks.workunit.client.0.smithi159.stdout:5/316: dread - d8/d19/d23/f51 zero size 2024-02-28T23:07:10.289 INFO:tasks.workunit.client.0.smithi159.stdout:8/312: mknod d2/c6f 0 2024-02-28T23:07:10.293 INFO:tasks.workunit.client.0.smithi159.stdout:5/317: creat d8/d19/d23/d35/d41/f60 x:0 0 0 2024-02-28T23:07:10.293 INFO:tasks.workunit.client.0.smithi159.stdout:3/252: write d0/d6/d3e/d2f/f4b [3078138,98645] 0 2024-02-28T23:07:10.295 INFO:tasks.workunit.client.0.smithi159.stdout:7/228: rename d5/d16/d1a/d27/d29/d2a/l44 to d5/d16/d1a/d27/d46/l4c 0 2024-02-28T23:07:10.297 INFO:tasks.workunit.client.0.smithi159.stdout:3/253: dread - d0/d6/d3e/f4a zero size 2024-02-28T23:07:10.299 INFO:tasks.workunit.client.0.smithi159.stdout:3/254: dread - d0/f4c zero size 2024-02-28T23:07:10.299 INFO:tasks.workunit.client.0.smithi159.stdout:7/229: fdatasync d5/d16/d1a/d27/d29/f2f 0 2024-02-28T23:07:10.302 INFO:tasks.workunit.client.0.smithi159.stdout:9/230: dread d4/d17/f29 [0,4194304] 0 2024-02-28T23:07:10.302 INFO:tasks.workunit.client.0.smithi159.stdout:3/255: dread - d0/d6/d3e/f4a zero size 2024-02-28T23:07:10.302 INFO:tasks.workunit.client.0.smithi159.stdout:7/230: fsync d5/fe 0 2024-02-28T23:07:10.304 INFO:tasks.workunit.client.0.smithi159.stdout:7/231: dread - d5/d16/d1a/d27/d29/f33 zero size 2024-02-28T23:07:10.305 INFO:tasks.workunit.client.0.smithi159.stdout:8/313: rename d2/c4 to d2/d11/c70 0 2024-02-28T23:07:10.309 INFO:tasks.workunit.client.0.smithi159.stdout:0/331: dread d0/de/f7a [0,4194304] 0 2024-02-28T23:07:10.310 INFO:tasks.workunit.client.0.smithi159.stdout:3/256: mknod d0/d2b/c4e 0 2024-02-28T23:07:10.311 INFO:tasks.workunit.client.0.smithi159.stdout:5/318: rename d8/d19/d23/d35/d41/f47 to d8/d19/d23/f61 0 2024-02-28T23:07:10.314 INFO:tasks.workunit.client.0.smithi159.stdout:9/231: dread d4/d17/f2a [0,4194304] 0 2024-02-28T23:07:10.317 INFO:tasks.workunit.client.0.smithi159.stdout:5/319: fdatasync d8/f21 0 2024-02-28T23:07:10.318 INFO:tasks.workunit.client.0.smithi159.stdout:8/314: getdents d2/d11/d52/d6e 0 2024-02-28T23:07:10.329 INFO:tasks.workunit.client.0.smithi159.stdout:0/332: dwrite d0/d5/f7 [0,4194304] 0 2024-02-28T23:07:10.329 INFO:tasks.workunit.client.0.smithi159.stdout:5/320: creat d8/d19/d23/d35/f62 x:0 0 0 2024-02-28T23:07:10.333 INFO:tasks.workunit.client.0.smithi159.stdout:5/321: symlink d8/d16/l63 0 2024-02-28T23:07:10.334 INFO:tasks.workunit.client.0.smithi159.stdout:0/333: fsync d0/d5/d14/d25/d5c/f67 0 2024-02-28T23:07:10.340 INFO:tasks.workunit.client.0.smithi159.stdout:0/334: truncate d0/de/f68 914503 0 2024-02-28T23:07:10.340 INFO:tasks.workunit.client.0.smithi159.stdout:9/232: truncate d4/d17/f2a 2626443 0 2024-02-28T23:07:10.342 INFO:tasks.workunit.client.0.smithi159.stdout:5/322: getdents d8/d19 0 2024-02-28T23:07:10.343 INFO:tasks.workunit.client.0.smithi159.stdout:9/233: mkdir d4/d17/d4c 0 2024-02-28T23:07:10.343 INFO:tasks.workunit.client.0.smithi159.stdout:5/323: write d8/d19/f3c [2513807,98439] 0 2024-02-28T23:07:10.345 INFO:tasks.workunit.client.0.smithi159.stdout:9/234: read - d4/f3c zero size 2024-02-28T23:07:10.346 INFO:tasks.workunit.client.0.smithi159.stdout:0/335: rename d0/d5/d14/d25/d5c/f60 to d0/d5/d14/d34/f7d 0 2024-02-28T23:07:10.349 INFO:tasks.workunit.client.0.smithi159.stdout:8/315: dread d2/d11/d52/d26/d36/d38/f39 [4194304,4194304] 0 2024-02-28T23:07:10.349 INFO:tasks.workunit.client.0.smithi159.stdout:5/324: symlink d8/d19/d23/d35/d41/l64 0 2024-02-28T23:07:10.353 INFO:tasks.workunit.client.0.smithi159.stdout:0/336: link d0/d5/f53 d0/f7e 0 2024-02-28T23:07:10.354 INFO:tasks.workunit.client.0.smithi159.stdout:8/316: mknod d2/d11/d52/d26/d36/c71 0 2024-02-28T23:07:10.355 INFO:tasks.workunit.client.0.smithi159.stdout:5/325: mkdir d8/d19/d23/d35/d65 0 2024-02-28T23:07:10.357 INFO:tasks.workunit.client.0.smithi159.stdout:0/337: read d0/de/f4a [2785545,25235] 0 2024-02-28T23:07:10.359 INFO:tasks.workunit.client.0.smithi159.stdout:0/338: read - d0/d5/d14/d25/d2c/f44 zero size 2024-02-28T23:07:10.360 INFO:tasks.workunit.client.0.smithi159.stdout:8/317: unlink d2/d11/d52/d26/d36/d38/f57 0 2024-02-28T23:07:10.361 INFO:tasks.workunit.client.0.smithi159.stdout:0/339: dread - d0/de/d75/d5f/f72 zero size 2024-02-28T23:07:10.362 INFO:tasks.workunit.client.0.smithi159.stdout:5/326: symlink d8/d19/d23/d35/l66 0 2024-02-28T23:07:10.369 INFO:tasks.workunit.client.0.smithi159.stdout:0/340: creat d0/d5/d14/d25/d2c/f7f x:0 0 0 2024-02-28T23:07:10.379 INFO:tasks.workunit.client.0.smithi159.stdout:8/318: dwrite d2/d11/d52/d26/d36/d38/f49 [0,4194304] 0 2024-02-28T23:07:10.380 INFO:tasks.workunit.client.0.smithi159.stdout:5/327: dwrite d8/d19/f27 [0,4194304] 0 2024-02-28T23:07:10.383 INFO:tasks.workunit.client.0.smithi159.stdout:5/328: rmdir d8 39 2024-02-28T23:07:10.389 INFO:tasks.workunit.client.0.smithi159.stdout:5/329: chown d8/c9 2 1 2024-02-28T23:07:10.389 INFO:tasks.workunit.client.0.smithi159.stdout:9/235: dread d4/d17/d37/f3b [0,4194304] 0 2024-02-28T23:07:10.391 INFO:tasks.workunit.client.0.smithi159.stdout:0/341: write d0/de/f2b [379246,107380] 0 2024-02-28T23:07:10.397 INFO:tasks.workunit.client.0.smithi159.stdout:5/330: mkdir d8/d67 0 2024-02-28T23:07:10.402 INFO:tasks.workunit.client.0.smithi159.stdout:5/331: creat d8/d19/f68 x:0 0 0 2024-02-28T23:07:10.409 INFO:tasks.workunit.client.0.smithi159.stdout:8/319: dwrite d2/d3/f3c [0,4194304] 0 2024-02-28T23:07:10.409 INFO:tasks.workunit.client.0.smithi159.stdout:9/236: dread d4/d17/f43 [0,4194304] 0 2024-02-28T23:07:10.414 INFO:tasks.workunit.client.0.smithi159.stdout:5/332: read - d8/d19/d23/d35/f62 zero size 2024-02-28T23:07:10.418 INFO:tasks.workunit.client.0.smithi159.stdout:9/237: rename d4/l2c to d4/d3d/d3e/l4d 0 2024-02-28T23:07:10.419 INFO:tasks.workunit.client.0.smithi159.stdout:0/342: dwrite d0/d5/f33 [0,4194304] 0 2024-02-28T23:07:10.419 INFO:tasks.workunit.client.0.smithi159.stdout:5/333: fdatasync d8/d19/f36 0 2024-02-28T23:07:10.424 INFO:tasks.workunit.client.0.smithi159.stdout:0/343: chown d0/de/d46/f61 13104730 1 2024-02-28T23:07:10.424 INFO:tasks.workunit.client.0.smithi159.stdout:5/334: mknod d8/d19/d23/d35/d38/c69 0 2024-02-28T23:07:10.425 INFO:tasks.workunit.client.0.smithi159.stdout:0/344: symlink d0/d5/d38/d63/l80 0 2024-02-28T23:07:10.425 INFO:tasks.workunit.client.0.smithi159.stdout:9/238: truncate d4/d17/f43 4739195 0 2024-02-28T23:07:10.430 INFO:tasks.workunit.client.0.smithi159.stdout:5/335: creat d8/d16/f6a x:0 0 0 2024-02-28T23:07:10.430 INFO:tasks.workunit.client.0.smithi159.stdout:9/239: mkdir d4/d17/d4c/d4e 0 2024-02-28T23:07:10.431 INFO:tasks.workunit.client.0.smithi159.stdout:9/240: rmdir d4/d3d/d3e 39 2024-02-28T23:07:10.432 INFO:tasks.workunit.client.0.smithi159.stdout:5/336: chown d8/d19/c20 214008 1 2024-02-28T23:07:10.433 INFO:tasks.workunit.client.0.smithi159.stdout:9/241: symlink d4/d3d/l4f 0 2024-02-28T23:07:10.436 INFO:tasks.workunit.client.0.smithi159.stdout:5/337: rename d8/d19/d23/d35/d41/f60 to d8/d59/f6b 0 2024-02-28T23:07:10.445 INFO:tasks.workunit.client.0.smithi159.stdout:9/242: dwrite d4/f3c [0,4194304] 0 2024-02-28T23:07:10.452 INFO:tasks.workunit.client.0.smithi159.stdout:9/243: rename d4/d17/c31 to d4/d17/d4c/d4e/c50 0 2024-02-28T23:07:10.455 INFO:tasks.workunit.client.0.smithi159.stdout:9/244: symlink d4/d17/d4c/l51 0 2024-02-28T23:07:10.456 INFO:tasks.workunit.client.0.smithi159.stdout:9/245: write d4/d17/f29 [2020895,109111] 0 2024-02-28T23:07:10.462 INFO:tasks.workunit.client.0.smithi159.stdout:0/345: write d0/d5/d14/d25/d2c/d4b/f54 [1198585,119652] 0 2024-02-28T23:07:10.464 INFO:tasks.workunit.client.0.smithi159.stdout:5/338: write d8/f34 [770027,41741] 0 2024-02-28T23:07:10.465 INFO:tasks.workunit.client.0.smithi159.stdout:0/346: chown d0/d5/d14/d25/d2c/d4b 497169909 1 2024-02-28T23:07:10.468 INFO:tasks.workunit.client.0.smithi159.stdout:8/320: dwrite d2/f40 [0,4194304] 0 2024-02-28T23:07:10.479 INFO:tasks.workunit.client.0.smithi159.stdout:5/339: dread d8/fe [0,4194304] 0 2024-02-28T23:07:10.479 INFO:tasks.workunit.client.0.smithi159.stdout:9/246: dwrite d4/d17/f46 [0,4194304] 0 2024-02-28T23:07:10.488 INFO:tasks.workunit.client.0.smithi159.stdout:6/273: sync 2024-02-28T23:07:10.494 INFO:tasks.workunit.client.0.smithi159.stdout:8/321: dwrite d2/d3/f30 [0,4194304] 0 2024-02-28T23:07:10.498 INFO:tasks.workunit.client.0.smithi159.stdout:0/347: dwrite d0/f6 [0,4194304] 0 2024-02-28T23:07:10.508 INFO:tasks.workunit.client.0.smithi159.stdout:5/340: link d8/d19/d23/d35/d38/f3e d8/d19/d23/f6c 0 2024-02-28T23:07:10.509 INFO:tasks.workunit.client.0.smithi159.stdout:9/247: truncate d4/d17/f2a 3393147 0 2024-02-28T23:07:10.638 INFO:tasks.workunit.client.0.smithi159.stdout:8/322: mknod d2/c72 0 2024-02-28T23:07:10.644 INFO:tasks.workunit.client.0.smithi159.stdout:5/341: truncate d8/d19/d23/d35/d41/f5d 1383367 0 2024-02-28T23:07:10.644 INFO:tasks.workunit.client.0.smithi159.stdout:9/248: write d4/f13 [2243176,70408] 0 2024-02-28T23:07:10.653 INFO:tasks.workunit.client.0.smithi159.stdout:6/274: dread d0/fe [4194304,4194304] 0 2024-02-28T23:07:10.653 INFO:tasks.workunit.client.0.smithi159.stdout:5/342: mkdir d8/d19/d23/d35/d38/d6d 0 2024-02-28T23:07:10.654 INFO:tasks.workunit.client.0.smithi159.stdout:8/323: truncate d2/d11/f12 236244 0 2024-02-28T23:07:10.655 INFO:tasks.workunit.client.0.smithi159.stdout:8/324: readlink d2/d3/l7 0 2024-02-28T23:07:10.656 INFO:tasks.workunit.client.0.smithi159.stdout:6/275: rmdir d0 39 2024-02-28T23:07:10.658 INFO:tasks.workunit.client.0.smithi159.stdout:5/343: fdatasync d8/d19/f2d 0 2024-02-28T23:07:10.662 INFO:tasks.workunit.client.0.smithi159.stdout:5/344: write d8/d19/f68 [272399,107992] 0 2024-02-28T23:07:10.663 INFO:tasks.workunit.client.0.smithi159.stdout:6/276: chown d0/f2a 4 1 2024-02-28T23:07:10.665 INFO:tasks.workunit.client.0.smithi159.stdout:9/249: dwrite d4/f30 [0,4194304] 0 2024-02-28T23:07:10.670 INFO:tasks.workunit.client.0.smithi159.stdout:0/348: dread d0/fb [4194304,4194304] 0 2024-02-28T23:07:10.670 INFO:tasks.workunit.client.0.smithi159.stdout:8/325: mkdir d2/d73 0 2024-02-28T23:07:10.671 INFO:tasks.workunit.client.0.smithi159.stdout:5/345: mknod d8/d16/c6e 0 2024-02-28T23:07:10.680 INFO:tasks.workunit.client.0.smithi159.stdout:0/349: rename d0/de/f7a to d0/d5/d14/d34/f81 0 2024-02-28T23:07:10.682 INFO:tasks.workunit.client.0.smithi159.stdout:8/326: mkdir d2/d11/d74 0 2024-02-28T23:07:10.682 INFO:tasks.workunit.client.0.smithi159.stdout:9/250: dwrite d4/f5 [4194304,4194304] 0 2024-02-28T23:07:10.687 INFO:tasks.workunit.client.0.smithi159.stdout:0/350: creat d0/d5/d14/d34/d3d/f82 x:0 0 0 2024-02-28T23:07:10.695 INFO:tasks.workunit.client.0.smithi159.stdout:0/351: rmdir d0/d5/d14/d25/d5c 39 2024-02-28T23:07:10.697 INFO:tasks.workunit.client.0.smithi159.stdout:5/346: link d8/c25 d8/c6f 0 2024-02-28T23:07:10.700 INFO:tasks.workunit.client.0.smithi159.stdout:2/241: sync 2024-02-28T23:07:10.702 INFO:tasks.workunit.client.0.smithi159.stdout:2/242: write d9/d23/d2c/f32 [355005,117480] 0 2024-02-28T23:07:10.702 INFO:tasks.workunit.client.0.smithi159.stdout:0/352: link d0/d5/d14/d34/d3d/f82 d0/d5/d14/d34/d3d/f83 0 2024-02-28T23:07:10.703 INFO:tasks.workunit.client.0.smithi159.stdout:5/347: getdents d8/d67 0 2024-02-28T23:07:10.708 INFO:tasks.workunit.client.0.smithi159.stdout:2/243: creat d9/d23/d2c/f4a x:0 0 0 2024-02-28T23:07:10.709 INFO:tasks.workunit.client.0.smithi159.stdout:2/244: readlink d9/de/l27 0 2024-02-28T23:07:10.711 INFO:tasks.workunit.client.0.smithi159.stdout:2/245: truncate d9/de/d13/f40 909186 0 2024-02-28T23:07:10.711 INFO:tasks.workunit.client.0.smithi159.stdout:5/348: link d8/d19/d23/f4d d8/d67/f70 0 2024-02-28T23:07:10.713 INFO:tasks.workunit.client.0.smithi159.stdout:0/353: creat d0/d5/d14/d25/f84 x:0 0 0 2024-02-28T23:07:10.715 INFO:tasks.workunit.client.0.smithi159.stdout:0/354: fdatasync d0/d5/f3f 0 2024-02-28T23:07:10.720 INFO:tasks.workunit.client.0.smithi159.stdout:0/355: rmdir d0/d5/d14/d25/d5c 39 2024-02-28T23:07:10.721 INFO:tasks.workunit.client.0.smithi159.stdout:2/246: link d9/de/d13/l2e d9/de/l4b 0 2024-02-28T23:07:10.722 INFO:tasks.workunit.client.0.smithi159.stdout:2/247: stat d9/de/c1a 0 2024-02-28T23:07:10.722 INFO:tasks.workunit.client.0.smithi159.stdout:0/356: write d0/de/f2b [1011832,55507] 0 2024-02-28T23:07:10.725 INFO:tasks.workunit.client.0.smithi159.stdout:2/248: fsync d9/de/f2f 0 2024-02-28T23:07:10.726 INFO:tasks.workunit.client.0.smithi159.stdout:2/249: stat d9/f35 0 2024-02-28T23:07:10.729 INFO:tasks.workunit.client.0.smithi159.stdout:2/250: mknod d9/de/d13/d31/d37/c4c 0 2024-02-28T23:07:10.735 INFO:tasks.workunit.client.0.smithi159.stdout:2/251: link d9/de/d13/d31/d37/f39 d9/de/d13/d31/d37/f4d 0 2024-02-28T23:07:10.737 INFO:tasks.workunit.client.0.smithi159.stdout:2/252: symlink d9/d34/l4e 0 2024-02-28T23:07:10.753 INFO:tasks.workunit.client.0.smithi159.stdout:5/349: rmdir d8/d16 39 2024-02-28T23:07:10.875 INFO:tasks.workunit.client.0.smithi159.stdout:5/350: mkdir d8/d19/d23/d35/d71 0 2024-02-28T23:07:10.877 INFO:tasks.workunit.client.0.smithi159.stdout:8/327: write d2/d3/f17 [872401,108780] 0 2024-02-28T23:07:10.877 INFO:tasks.workunit.client.0.smithi159.stdout:9/251: truncate d4/f36 653843 0 2024-02-28T23:07:10.883 INFO:tasks.workunit.client.0.smithi159.stdout:2/253: write d9/de/ff [2854553,82611] 0 2024-02-28T23:07:10.885 INFO:tasks.workunit.client.0.smithi159.stdout:8/328: write d2/d11/d52/f4d [891087,4592] 0 2024-02-28T23:07:10.887 INFO:tasks.workunit.client.0.smithi159.stdout:9/252: mkdir d4/d52 0 2024-02-28T23:07:10.889 INFO:tasks.workunit.client.0.smithi159.stdout:2/254: getdents d9/d34/d44 0 2024-02-28T23:07:10.892 INFO:tasks.workunit.client.0.smithi159.stdout:2/255: truncate d9/de/f29 868878 0 2024-02-28T23:07:10.897 INFO:tasks.workunit.client.0.smithi159.stdout:2/256: chown d9/de/f17 43721105 1 2024-02-28T23:07:10.900 INFO:tasks.workunit.client.0.smithi159.stdout:2/257: mkdir d9/de/d13/d4f 0 2024-02-28T23:07:10.901 INFO:tasks.workunit.client.0.smithi159.stdout:9/253: dread d4/d17/f29 [0,4194304] 0 2024-02-28T23:07:10.904 INFO:tasks.workunit.client.0.smithi159.stdout:9/254: chown d4/c21 0 1 2024-02-28T23:07:10.907 INFO:tasks.workunit.client.0.smithi159.stdout:9/255: rmdir d4/d17 39 2024-02-28T23:07:10.912 INFO:tasks.workunit.client.0.smithi159.stdout:9/256: stat d4/d3d 0 2024-02-28T23:07:10.912 INFO:tasks.workunit.client.0.smithi159.stdout:8/329: dwrite d2/d11/d52/d47/f6b [0,4194304] 0 2024-02-28T23:07:10.918 INFO:tasks.workunit.client.0.smithi159.stdout:2/258: write d9/f16 [266305,95401] 0 2024-02-28T23:07:10.920 INFO:tasks.workunit.client.0.smithi159.stdout:8/330: creat d2/f75 x:0 0 0 2024-02-28T23:07:10.922 INFO:tasks.workunit.client.0.smithi159.stdout:2/259: write d9/de/d13/f40 [1706714,100461] 0 2024-02-28T23:07:10.923 INFO:tasks.workunit.client.0.smithi159.stdout:5/351: dwrite d8/f10 [0,4194304] 0 2024-02-28T23:07:10.926 INFO:tasks.workunit.client.0.smithi159.stdout:8/331: mknod d2/d11/d52/d26/d36/c76 0 2024-02-28T23:07:10.930 INFO:tasks.workunit.client.0.smithi159.stdout:8/332: chown d2/d11/d52/d26/c2e 88006340 1 2024-02-28T23:07:10.931 INFO:tasks.workunit.client.0.smithi159.stdout:5/352: rename d8/f18 to d8/d16/f72 0 2024-02-28T23:07:10.933 INFO:tasks.workunit.client.0.smithi159.stdout:8/333: fdatasync d2/d11/d52/d26/d36/f23 0 2024-02-28T23:07:10.943 INFO:tasks.workunit.client.0.smithi159.stdout:5/353: dread d8/d19/d23/d35/d41/f5d [0,4194304] 0 2024-02-28T23:07:10.945 INFO:tasks.workunit.client.0.smithi159.stdout:9/257: truncate d4/fe 208836 0 2024-02-28T23:07:10.948 INFO:tasks.workunit.client.0.smithi159.stdout:9/258: fdatasync d4/d17/f49 0 2024-02-28T23:07:10.952 INFO:tasks.workunit.client.0.smithi159.stdout:5/354: symlink d8/d19/d23/d35/d38/l73 0 2024-02-28T23:07:10.957 INFO:tasks.workunit.client.0.smithi159.stdout:9/259: rename d4/d3d/d3e/l4d to d4/d17/d37/l53 0 2024-02-28T23:07:10.958 INFO:tasks.workunit.client.0.smithi159.stdout:9/260: read d4/f5 [12377278,12948] 0 2024-02-28T23:07:10.962 INFO:tasks.workunit.client.0.smithi159.stdout:7/232: sync 2024-02-28T23:07:10.962 INFO:tasks.workunit.client.0.smithi159.stdout:1/204: sync 2024-02-28T23:07:10.962 INFO:tasks.workunit.client.0.smithi159.stdout:3/257: sync 2024-02-28T23:07:10.962 INFO:tasks.workunit.client.0.smithi159.stdout:4/410: sync 2024-02-28T23:07:10.965 INFO:tasks.workunit.client.0.smithi159.stdout:7/233: write d5/fd [4656445,104324] 0 2024-02-28T23:07:10.966 INFO:tasks.workunit.client.0.smithi159.stdout:2/260: dread d9/f11 [0,4194304] 0 2024-02-28T23:07:10.968 INFO:tasks.workunit.client.0.smithi159.stdout:3/258: mkdir d0/d2b/d4f 0 2024-02-28T23:07:10.968 INFO:tasks.workunit.client.0.smithi159.stdout:4/411: creat d9/da/d1c/d23/f94 x:0 0 0 2024-02-28T23:07:10.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:10 smithi159 ceph-mon[28802]: pgmap v24: 65 pgs: 65 active+clean; 707 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s rd, 82 MiB/s wr, 255 op/s 2024-02-28T23:07:10.972 INFO:tasks.workunit.client.0.smithi159.stdout:1/205: symlink d6/d12/d31/l3f 0 2024-02-28T23:07:10.975 INFO:tasks.workunit.client.0.smithi159.stdout:2/261: mkdir d9/d50 0 2024-02-28T23:07:10.976 INFO:tasks.workunit.client.0.smithi159.stdout:9/261: dread d4/d17/f2a [0,4194304] 0 2024-02-28T23:07:10.978 INFO:tasks.workunit.client.0.smithi159.stdout:9/262: fdatasync d4/f30 0 2024-02-28T23:07:10.985 INFO:tasks.workunit.client.0.smithi159.stdout:9/263: creat d4/d17/d37/f54 x:0 0 0 2024-02-28T23:07:10.985 INFO:tasks.workunit.client.0.smithi159.stdout:2/262: mknod d9/de/d13/c51 0 2024-02-28T23:07:10.988 INFO:tasks.workunit.client.0.smithi159.stdout:4/412: getdents d9/d42/d54 0 2024-02-28T23:07:10.989 INFO:tasks.workunit.client.0.smithi159.stdout:3/259: dread d0/d6/d34/f45 [0,4194304] 0 2024-02-28T23:07:10.991 INFO:tasks.workunit.client.0.smithi159.stdout:3/260: chown d0/d3f 26 1 2024-02-28T23:07:10.993 INFO:tasks.workunit.client.0.smithi159.stdout:2/263: read d9/d23/d2c/f2d [3383809,71443] 0 2024-02-28T23:07:10.994 INFO:tasks.workunit.client.0.smithi159.stdout:3/261: read - d0/d6/d34/f41 zero size 2024-02-28T23:07:10.996 INFO:tasks.workunit.client.0.smithi159.stdout:2/264: dread d9/de/f2a [0,4194304] 0 2024-02-28T23:07:11.002 INFO:tasks.workunit.client.0.smithi159.stdout:2/265: dread d9/de/f29 [0,4194304] 0 2024-02-28T23:07:11.003 INFO:tasks.workunit.client.0.smithi159.stdout:3/262: symlink d0/d47/l50 0 2024-02-28T23:07:11.004 INFO:tasks.workunit.client.0.smithi159.stdout:2/266: dread - d9/f3c zero size 2024-02-28T23:07:11.005 INFO:tasks.workunit.client.0.smithi159.stdout:3/263: stat d0/d2b/c4e 0 2024-02-28T23:07:11.006 INFO:tasks.workunit.client.0.smithi159.stdout:4/413: dread d9/da/d1c/d23/f24 [0,4194304] 0 2024-02-28T23:07:11.006 INFO:tasks.workunit.client.0.smithi159.stdout:7/234: dread d5/d16/f19 [0,4194304] 0 2024-02-28T23:07:11.007 INFO:tasks.workunit.client.0.smithi159.stdout:4/414: chown d9/d20/f29 12 1 2024-02-28T23:07:11.008 INFO:tasks.workunit.client.0.smithi159.stdout:7/235: chown d5/l8 3555 1 2024-02-28T23:07:11.008 INFO:tasks.workunit.client.0.smithi159.stdout:3/264: symlink d0/d2b/l51 0 2024-02-28T23:07:11.012 INFO:tasks.workunit.client.0.smithi159.stdout:4/415: write d9/d42/d54/d55/f72 [758753,95870] 0 2024-02-28T23:07:11.012 INFO:tasks.workunit.client.0.smithi159.stdout:9/264: rename d4/d17 to d4/d3d/d3e/d55 0 2024-02-28T23:07:11.015 INFO:tasks.workunit.client.0.smithi159.stdout:2/267: creat d9/de/d13/d4f/f52 x:0 0 0 2024-02-28T23:07:11.016 INFO:tasks.workunit.client.0.smithi159.stdout:4/416: write d9/da/f13 [3106594,103693] 0 2024-02-28T23:07:11.019 INFO:tasks.workunit.client.0.smithi159.stdout:3/265: write d0/d6/d3e/f4a [938739,71623] 0 2024-02-28T23:07:11.020 INFO:tasks.workunit.client.0.smithi159.stdout:7/236: rename d5/fd to d5/d16/d1a/d27/d29/d2a/f4d 0 2024-02-28T23:07:11.021 INFO:tasks.workunit.client.0.smithi159.stdout:1/206: dwrite d6/f20 [0,4194304] 0 2024-02-28T23:07:11.023 INFO:tasks.workunit.client.0.smithi159.stdout:3/266: read d0/f23 [3811755,45303] 0 2024-02-28T23:07:11.023 INFO:tasks.workunit.client.0.smithi159.stdout:1/207: chown d6/fb 4812096 1 2024-02-28T23:07:11.027 INFO:tasks.workunit.client.0.smithi159.stdout:2/268: creat d9/de/d13/d31/d37/f53 x:0 0 0 2024-02-28T23:07:11.028 INFO:tasks.workunit.client.0.smithi159.stdout:4/417: truncate d9/da/f47 1323549 0 2024-02-28T23:07:11.030 INFO:tasks.workunit.client.0.smithi159.stdout:2/269: chown d9/de/l27 45 1 2024-02-28T23:07:11.035 INFO:tasks.workunit.client.0.smithi159.stdout:3/267: rename d0/d6/d3e/l2c to d0/d6/d34/l52 0 2024-02-28T23:07:11.037 INFO:tasks.workunit.client.0.smithi159.stdout:7/237: dread d5/d16/f19 [0,4194304] 0 2024-02-28T23:07:11.040 INFO:tasks.workunit.client.0.smithi159.stdout:4/418: unlink d9/d20/l45 0 2024-02-28T23:07:11.042 INFO:tasks.workunit.client.0.smithi159.stdout:1/208: symlink d6/d1d/d1f/d3e/l40 0 2024-02-28T23:07:11.042 INFO:tasks.workunit.client.0.smithi159.stdout:9/265: dwrite d4/d3d/d3e/d55/f43 [4194304,4194304] 0 2024-02-28T23:07:11.043 INFO:tasks.workunit.client.0.smithi159.stdout:2/270: mkdir d9/d50/d54 0 2024-02-28T23:07:11.043 INFO:tasks.workunit.client.0.smithi159.stdout:4/419: dread - d9/d20/f5e zero size 2024-02-28T23:07:11.045 INFO:tasks.workunit.client.0.smithi159.stdout:1/209: write d6/d12/d1a/f23 [4296036,104105] 0 2024-02-28T23:07:11.047 INFO:tasks.workunit.client.0.smithi159.stdout:4/420: fsync d9/f1e 0 2024-02-28T23:07:11.048 INFO:tasks.workunit.client.0.smithi159.stdout:9/266: rmdir d4/d3d/d3e 39 2024-02-28T23:07:11.048 INFO:tasks.workunit.client.0.smithi159.stdout:2/271: chown d9/d23/d2c/l47 263 1 2024-02-28T23:07:11.050 INFO:tasks.workunit.client.0.smithi159.stdout:4/421: mkdir d9/d42/d95 0 2024-02-28T23:07:11.052 INFO:tasks.workunit.client.0.smithi159.stdout:9/267: fdatasync d4/d3d/d3e/d55/f1e 0 2024-02-28T23:07:11.057 INFO:tasks.workunit.client.0.smithi159.stdout:9/268: unlink d4/c1d 0 2024-02-28T23:07:11.060 INFO:tasks.workunit.client.0.smithi159.stdout:9/269: fdatasync d4/d3d/d3e/d55/f24 0 2024-02-28T23:07:11.062 INFO:tasks.workunit.client.0.smithi159.stdout:2/272: rename d9/de to d9/d23/d2c/d55 0 2024-02-28T23:07:11.065 INFO:tasks.workunit.client.0.smithi159.stdout:4/422: dread d9/f4e [0,4194304] 0 2024-02-28T23:07:11.069 INFO:tasks.workunit.client.0.smithi159.stdout:2/273: chown d9/d34/c49 971 1 2024-02-28T23:07:11.069 INFO:tasks.workunit.client.0.smithi159.stdout:3/268: truncate d0/d6/f13 4548371 0 2024-02-28T23:07:11.071 INFO:tasks.workunit.client.0.smithi159.stdout:3/269: fdatasync d0/fe 0 2024-02-28T23:07:11.071 INFO:tasks.workunit.client.0.smithi159.stdout:1/210: dwrite d6/d12/fe [0,4194304] 0 2024-02-28T23:07:11.074 INFO:tasks.workunit.client.0.smithi159.stdout:4/423: mknod d9/c96 0 2024-02-28T23:07:11.078 INFO:tasks.workunit.client.0.smithi159.stdout:2/274: symlink d9/l56 0 2024-02-28T23:07:11.084 INFO:tasks.workunit.client.0.smithi159.stdout:3/270: rename d0/d6/d19/c30 to d0/d6/d3e/d2f/c53 0 2024-02-28T23:07:11.086 INFO:tasks.workunit.client.0.smithi159.stdout:9/270: dwrite d4/d3d/d3e/d55/d37/f3b [0,4194304] 0 2024-02-28T23:07:11.088 INFO:tasks.workunit.client.0.smithi159.stdout:3/271: write d0/f12 [3178741,63347] 0 2024-02-28T23:07:11.091 INFO:tasks.workunit.client.0.smithi159.stdout:2/275: rename d9/l28 to d9/d34/d44/l57 0 2024-02-28T23:07:11.094 INFO:tasks.workunit.client.0.smithi159.stdout:3/272: truncate d0/d6/d34/f41 732854 0 2024-02-28T23:07:11.095 INFO:tasks.workunit.client.0.smithi159.stdout:2/276: fsync d9/d23/d2c/d55/ff 0 2024-02-28T23:07:11.098 INFO:tasks.workunit.client.0.smithi159.stdout:9/271: creat d4/d3d/d3e/d4a/f56 x:0 0 0 2024-02-28T23:07:11.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:10 smithi184 ceph-mon[36198]: pgmap v24: 65 pgs: 65 active+clean; 707 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s rd, 82 MiB/s wr, 255 op/s 2024-02-28T23:07:11.100 INFO:tasks.workunit.client.0.smithi159.stdout:4/424: dread d9/f3c [0,4194304] 0 2024-02-28T23:07:11.100 INFO:tasks.workunit.client.0.smithi159.stdout:2/277: symlink d9/d50/l58 0 2024-02-28T23:07:11.102 INFO:tasks.workunit.client.0.smithi159.stdout:1/211: dwrite d6/d12/d33/f3a [0,4194304] 0 2024-02-28T23:07:11.106 INFO:tasks.workunit.client.0.smithi159.stdout:2/278: write d9/f35 [795178,62596] 0 2024-02-28T23:07:11.106 INFO:tasks.workunit.client.0.smithi159.stdout:9/272: rename d4/d3d/d3e/d55/f2d to d4/d52/f57 0 2024-02-28T23:07:11.108 INFO:tasks.workunit.client.0.smithi159.stdout:9/273: stat d4/d3d/d3e/d55/c3f 0 2024-02-28T23:07:11.114 INFO:tasks.workunit.client.0.smithi159.stdout:9/274: dread d4/f25 [0,4194304] 0 2024-02-28T23:07:11.121 INFO:tasks.workunit.client.0.smithi159.stdout:2/279: write d9/f25 [7388342,120555] 0 2024-02-28T23:07:11.125 INFO:tasks.workunit.client.0.smithi159.stdout:9/275: symlink d4/d3d/d3e/d55/d37/l58 0 2024-02-28T23:07:11.126 INFO:tasks.workunit.client.0.smithi159.stdout:6/277: sync 2024-02-28T23:07:11.126 INFO:tasks.workunit.client.0.smithi159.stdout:0/357: sync 2024-02-28T23:07:11.127 INFO:tasks.workunit.client.0.smithi159.stdout:4/425: dwrite d9/d42/f60 [0,4194304] 0 2024-02-28T23:07:11.127 INFO:tasks.workunit.client.0.smithi159.stdout:1/212: dwrite d6/d1d/f1e [0,4194304] 0 2024-02-28T23:07:11.129 INFO:tasks.workunit.client.0.smithi159.stdout:6/278: chown d0/d1b/d33/d3f/c4f 44988792 1 2024-02-28T23:07:11.130 INFO:tasks.workunit.client.0.smithi159.stdout:9/276: read d4/d3d/d3e/d55/f24 [3397945,45009] 0 2024-02-28T23:07:11.133 INFO:tasks.workunit.client.0.smithi159.stdout:9/277: write d4/d3d/d3e/d4a/f56 [461247,41401] 0 2024-02-28T23:07:11.138 INFO:tasks.workunit.client.0.smithi159.stdout:9/278: truncate d4/d3d/d3e/d55/f49 332735 0 2024-02-28T23:07:11.144 INFO:tasks.workunit.client.0.smithi159.stdout:2/280: mkdir d9/d36/d59 0 2024-02-28T23:07:11.150 INFO:tasks.workunit.client.0.smithi159.stdout:1/213: creat d6/d12/d33/d3c/f41 x:0 0 0 2024-02-28T23:07:11.152 INFO:tasks.workunit.client.0.smithi159.stdout:2/281: read d9/d23/d2c/d55/ff [1667238,49034] 0 2024-02-28T23:07:11.153 INFO:tasks.workunit.client.0.smithi159.stdout:3/273: truncate d0/d6/d3e/f22 3008017 0 2024-02-28T23:07:11.159 INFO:tasks.workunit.client.0.smithi159.stdout:9/279: getdents d4/d52 0 2024-02-28T23:07:11.161 INFO:tasks.workunit.client.0.smithi159.stdout:3/274: fdatasync d0/d6/d34/f45 0 2024-02-28T23:07:11.161 INFO:tasks.workunit.client.0.smithi159.stdout:6/279: dwrite d0/d1b/f56 [0,4194304] 0 2024-02-28T23:07:11.166 INFO:tasks.workunit.client.0.smithi159.stdout:4/426: dwrite d9/f5b [0,4194304] 0 2024-02-28T23:07:11.169 INFO:tasks.workunit.client.0.smithi159.stdout:3/275: mkdir d0/d6/d19/d54 0 2024-02-28T23:07:11.175 INFO:tasks.workunit.client.0.smithi159.stdout:6/280: unlink d0/d1b/d38/d47/f55 0 2024-02-28T23:07:11.179 INFO:tasks.workunit.client.0.smithi159.stdout:9/280: creat d4/d3d/d3e/d4a/f59 x:0 0 0 2024-02-28T23:07:11.179 INFO:tasks.workunit.client.0.smithi159.stdout:4/427: creat d9/d42/d54/f97 x:0 0 0 2024-02-28T23:07:11.182 INFO:tasks.workunit.client.0.smithi159.stdout:3/276: mkdir d0/d2b/d55 0 2024-02-28T23:07:11.188 INFO:tasks.workunit.client.0.smithi159.stdout:0/358: dwrite d0/d5/d14/d34/f3c [0,4194304] 0 2024-02-28T23:07:11.189 INFO:tasks.workunit.client.0.smithi159.stdout:6/281: dread - d0/d1b/d33/d11/d14/d49/f60 zero size 2024-02-28T23:07:11.190 INFO:tasks.workunit.client.0.smithi159.stdout:3/277: write d0/d6/d34/f41 [293956,45038] 0 2024-02-28T23:07:11.192 INFO:tasks.workunit.client.0.smithi159.stdout:1/214: dwrite d6/d12/f2a [0,4194304] 0 2024-02-28T23:07:11.196 INFO:tasks.workunit.client.0.smithi159.stdout:1/215: chown d6/d12/d33/f3a 2 1 2024-02-28T23:07:11.199 INFO:tasks.workunit.client.0.smithi159.stdout:1/216: fdatasync d6/d12/d33/d3c/f41 0 2024-02-28T23:07:11.200 INFO:tasks.workunit.client.0.smithi159.stdout:2/282: dwrite d9/d23/d2c/d55/f29 [0,4194304] 0 2024-02-28T23:07:11.205 INFO:tasks.workunit.client.0.smithi159.stdout:4/428: mkdir d9/d4c/d6c/d98 0 2024-02-28T23:07:11.205 INFO:tasks.workunit.client.0.smithi159.stdout:4/429: stat d9/d4c 0 2024-02-28T23:07:11.213 INFO:tasks.workunit.client.0.smithi159.stdout:9/281: symlink d4/d3d/l5a 0 2024-02-28T23:07:11.213 INFO:tasks.workunit.client.0.smithi159.stdout:3/278: creat d0/d6/d3e/d2f/f56 x:0 0 0 2024-02-28T23:07:11.214 INFO:tasks.workunit.client.0.smithi159.stdout:9/282: dread - d4/f39 zero size 2024-02-28T23:07:11.216 INFO:tasks.workunit.client.0.smithi159.stdout:6/282: truncate d0/fb 4125197 0 2024-02-28T23:07:11.216 INFO:tasks.workunit.client.0.smithi159.stdout:1/217: creat d6/d12/d16/f42 x:0 0 0 2024-02-28T23:07:11.218 INFO:tasks.workunit.client.0.smithi159.stdout:9/283: write d4/d3d/d3e/d55/f49 [721648,79977] 0 2024-02-28T23:07:11.226 INFO:tasks.workunit.client.0.smithi159.stdout:0/359: creat d0/d5/d14/d25/f85 x:0 0 0 2024-02-28T23:07:11.228 INFO:tasks.workunit.client.0.smithi159.stdout:1/218: mknod d6/d1d/c43 0 2024-02-28T23:07:11.233 INFO:tasks.workunit.client.0.smithi159.stdout:2/283: getdents d9/d36 0 2024-02-28T23:07:11.236 INFO:tasks.workunit.client.0.smithi159.stdout:0/360: mknod d0/d5/d14/d25/d2c/c86 0 2024-02-28T23:07:11.243 INFO:tasks.workunit.client.0.smithi159.stdout:6/283: dwrite d0/d1b/f1a [0,4194304] 0 2024-02-28T23:07:11.245 INFO:tasks.workunit.client.0.smithi159.stdout:2/284: chown d9/d23/d2c/d55/d13/d31/c38 99220922 1 2024-02-28T23:07:11.246 INFO:tasks.workunit.client.0.smithi159.stdout:4/430: dwrite d9/da/fc [0,4194304] 0 2024-02-28T23:07:11.249 INFO:tasks.workunit.client.0.smithi159.stdout:9/284: dwrite d4/f39 [0,4194304] 0 2024-02-28T23:07:11.251 INFO:tasks.workunit.client.0.smithi159.stdout:3/279: write d0/f35 [1043820,21948] 0 2024-02-28T23:07:11.254 INFO:tasks.workunit.client.0.smithi159.stdout:0/361: truncate d0/d5/d14/d25/d2c/f44 558158 0 2024-02-28T23:07:11.261 INFO:tasks.workunit.client.0.smithi159.stdout:0/362: write d0/f3 [5260018,69345] 0 2024-02-28T23:07:11.265 INFO:tasks.workunit.client.0.smithi159.stdout:0/363: read - d0/d5/f50 zero size 2024-02-28T23:07:11.268 INFO:tasks.workunit.client.0.smithi159.stdout:3/280: fsync d0/d6/d34/f45 0 2024-02-28T23:07:11.271 INFO:tasks.workunit.client.0.smithi159.stdout:9/285: creat d4/d3d/f5b x:0 0 0 2024-02-28T23:07:11.271 INFO:tasks.workunit.client.0.smithi159.stdout:2/285: link d9/d23/d2c/f2d d9/d36/f5a 0 2024-02-28T23:07:11.276 INFO:tasks.workunit.client.0.smithi159.stdout:1/219: dwrite d6/d12/d1a/f38 [0,4194304] 0 2024-02-28T23:07:11.280 INFO:tasks.workunit.client.0.smithi159.stdout:6/284: truncate d0/fc 3152945 0 2024-02-28T23:07:11.285 INFO:tasks.workunit.client.0.smithi159.stdout:9/286: creat d4/d3d/d3e/d55/d4c/d4e/f5c x:0 0 0 2024-02-28T23:07:11.286 INFO:tasks.workunit.client.0.smithi159.stdout:4/431: dwrite d9/d4c/f8f [0,4194304] 0 2024-02-28T23:07:11.291 INFO:tasks.workunit.client.0.smithi159.stdout:3/281: truncate d0/d6/d19/f2d 807009 0 2024-02-28T23:07:11.301 INFO:tasks.workunit.client.0.smithi159.stdout:1/220: dread d6/f20 [0,4194304] 0 2024-02-28T23:07:11.302 INFO:tasks.workunit.client.0.smithi159.stdout:3/282: write d0/d2b/f26 [1791239,130385] 0 2024-02-28T23:07:11.306 INFO:tasks.workunit.client.0.smithi159.stdout:0/364: dwrite d0/d5/d14/d34/d3d/f65 [0,4194304] 0 2024-02-28T23:07:11.306 INFO:tasks.workunit.client.0.smithi159.stdout:7/238: sync 2024-02-28T23:07:11.306 INFO:tasks.workunit.client.0.smithi159.stdout:2/286: getdents d9/d36 0 2024-02-28T23:07:11.306 INFO:tasks.workunit.client.0.smithi159.stdout:5/355: sync 2024-02-28T23:07:11.306 INFO:tasks.workunit.client.0.smithi159.stdout:8/334: sync 2024-02-28T23:07:11.313 INFO:tasks.workunit.client.0.smithi159.stdout:8/335: stat d2/d11/d52/d6e 0 2024-02-28T23:07:11.316 INFO:tasks.workunit.client.0.smithi159.stdout:0/365: dread - d0/d5/f50 zero size 2024-02-28T23:07:11.319 INFO:tasks.workunit.client.0.smithi159.stdout:2/287: fsync d9/d23/d2c/d55/d13/d31/f45 0 2024-02-28T23:07:11.321 INFO:tasks.workunit.client.0.smithi159.stdout:1/221: creat d6/d1d/d1f/d3e/f44 x:0 0 0 2024-02-28T23:07:11.322 INFO:tasks.workunit.client.0.smithi159.stdout:5/356: write d8/d19/d23/d2a/f2f [3360869,54410] 0 2024-02-28T23:07:11.322 INFO:tasks.workunit.client.0.smithi159.stdout:8/336: read d2/f3a [2415099,87291] 0 2024-02-28T23:07:11.329 INFO:tasks.workunit.client.0.smithi159.stdout:1/222: write d6/d12/f2f [832087,74011] 0 2024-02-28T23:07:11.333 INFO:tasks.workunit.client.0.smithi159.stdout:6/285: dwrite d0/d1b/d33/f12 [0,4194304] 0 2024-02-28T23:07:11.333 INFO:tasks.workunit.client.0.smithi159.stdout:7/239: link d5/f18 d5/d16/d40/f4e 0 2024-02-28T23:07:11.340 INFO:tasks.workunit.client.0.smithi159.stdout:4/432: dwrite d9/d20/f48 [0,4194304] 0 2024-02-28T23:07:11.341 INFO:tasks.workunit.client.0.smithi159.stdout:8/337: mkdir d2/d11/d52/d26/d36/d38/d77 0 2024-02-28T23:07:11.341 INFO:tasks.workunit.client.0.smithi159.stdout:1/223: chown d6/d12/f18 1 1 2024-02-28T23:07:11.341 INFO:tasks.workunit.client.0.smithi159.stdout:9/287: dwrite d4/d3d/d3e/d4a/f56 [0,4194304] 0 2024-02-28T23:07:11.342 INFO:tasks.workunit.client.0.smithi159.stdout:4/433: stat d9/d4c/d6c/f6b 0 2024-02-28T23:07:11.353 INFO:tasks.workunit.client.0.smithi159.stdout:1/224: dread d6/d12/f18 [0,4194304] 0 2024-02-28T23:07:11.361 INFO:tasks.workunit.client.0.smithi159.stdout:2/288: dwrite d9/d23/d2c/d55/d13/d31/f45 [0,4194304] 0 2024-02-28T23:07:11.367 INFO:tasks.workunit.client.0.smithi159.stdout:0/366: dwrite d0/d5/d14/d25/f6d [0,4194304] 0 2024-02-28T23:07:11.371 INFO:tasks.workunit.client.0.smithi159.stdout:4/434: dwrite d9/d4c/f8f [0,4194304] 0 2024-02-28T23:07:11.372 INFO:tasks.workunit.client.0.smithi159.stdout:5/357: creat d8/d19/d23/d35/d38/d6d/f74 x:0 0 0 2024-02-28T23:07:11.373 INFO:tasks.workunit.client.0.smithi159.stdout:3/283: dread d0/f23 [0,4194304] 0 2024-02-28T23:07:11.377 INFO:tasks.workunit.client.0.smithi159.stdout:5/358: read - d8/d16/f6a zero size 2024-02-28T23:07:11.377 INFO:tasks.workunit.client.0.smithi159.stdout:6/286: getdents d0/d1b/d5b 0 2024-02-28T23:07:11.380 INFO:tasks.workunit.client.0.smithi159.stdout:8/338: symlink d2/d11/d52/d6e/l78 0 2024-02-28T23:07:11.380 INFO:tasks.workunit.client.0.smithi159.stdout:3/284: chown d0/d6/d3e/c43 18 1 2024-02-28T23:07:11.385 INFO:tasks.workunit.client.0.smithi159.stdout:8/339: write d2/f5c [351683,49054] 0 2024-02-28T23:07:11.396 INFO:tasks.workunit.client.0.smithi159.stdout:7/240: dwrite d5/fe [0,4194304] 0 2024-02-28T23:07:11.405 INFO:tasks.workunit.client.0.smithi159.stdout:9/288: creat d4/d3d/f5d x:0 0 0 2024-02-28T23:07:11.406 INFO:tasks.workunit.client.0.smithi159.stdout:3/285: mkdir d0/d6/d3e/d57 0 2024-02-28T23:07:11.406 INFO:tasks.workunit.client.0.smithi159.stdout:4/435: dread d9/d4c/f8f [0,4194304] 0 2024-02-28T23:07:11.410 INFO:tasks.workunit.client.0.smithi159.stdout:5/359: dwrite d8/d19/d23/d2a/f45 [4194304,4194304] 0 2024-02-28T23:07:11.412 INFO:tasks.workunit.client.0.smithi159.stdout:9/289: dread - d4/d3d/d3e/d4a/f59 zero size 2024-02-28T23:07:11.412 INFO:tasks.workunit.client.0.smithi159.stdout:2/289: creat d9/d23/d2c/d55/f5b x:0 0 0 2024-02-28T23:07:11.412 INFO:tasks.workunit.client.0.smithi159.stdout:7/241: symlink d5/d16/d40/l4f 0 2024-02-28T23:07:11.422 INFO:tasks.workunit.client.0.smithi159.stdout:3/286: dread d0/d6/d3e/f4a [0,4194304] 0 2024-02-28T23:07:11.425 INFO:tasks.workunit.client.0.smithi159.stdout:0/367: getdents d0/de 0 2024-02-28T23:07:11.428 INFO:tasks.workunit.client.0.smithi159.stdout:1/225: truncate d6/d12/f2a 1809382 0 2024-02-28T23:07:11.431 INFO:tasks.workunit.client.0.smithi159.stdout:4/436: dread d9/d42/d54/d55/f72 [0,4194304] 0 2024-02-28T23:07:11.432 INFO:tasks.workunit.client.0.smithi159.stdout:1/226: fsync d6/d12/f1b 0 2024-02-28T23:07:11.434 INFO:tasks.workunit.client.0.smithi159.stdout:5/360: dread - d8/d19/f40 zero size 2024-02-28T23:07:11.437 INFO:tasks.workunit.client.0.smithi159.stdout:4/437: read d9/d42/f60 [1772121,77695] 0 2024-02-28T23:07:11.438 INFO:tasks.workunit.client.0.smithi159.stdout:1/227: fsync d6/d12/f2f 0 2024-02-28T23:07:11.438 INFO:tasks.workunit.client.0.smithi159.stdout:2/290: mkdir d9/d23/d2c/d55/d13/d31/d37/d5c 0 2024-02-28T23:07:11.441 INFO:tasks.workunit.client.0.smithi159.stdout:8/340: dread d2/d3/f29 [0,4194304] 0 2024-02-28T23:07:11.443 INFO:tasks.workunit.client.0.smithi159.stdout:4/438: fdatasync d9/d42/d54/d55/f6a 0 2024-02-28T23:07:11.446 INFO:tasks.workunit.client.0.smithi159.stdout:9/290: dread d4/fe [0,4194304] 0 2024-02-28T23:07:11.446 INFO:tasks.workunit.client.0.smithi159.stdout:6/287: dwrite d0/d1b/f3c [0,4194304] 0 2024-02-28T23:07:11.449 INFO:tasks.workunit.client.0.smithi159.stdout:3/287: read d0/d6/d3e/f22 [2547330,49460] 0 2024-02-28T23:07:11.452 INFO:tasks.workunit.client.0.smithi159.stdout:5/361: unlink d8/d19/d23/f51 0 2024-02-28T23:07:11.458 INFO:tasks.workunit.client.0.smithi159.stdout:1/228: rename d6/c10 to d6/d12/c45 0 2024-02-28T23:07:11.462 INFO:tasks.workunit.client.0.smithi159.stdout:8/341: dread d2/d3/f20 [0,4194304] 0 2024-02-28T23:07:11.463 INFO:tasks.workunit.client.0.smithi159.stdout:0/368: creat d0/d5/d14/d78/f87 x:0 0 0 2024-02-28T23:07:11.469 INFO:tasks.workunit.client.0.smithi159.stdout:4/439: dread d9/d42/d54/d56/f70 [0,4194304] 0 2024-02-28T23:07:11.469 INFO:tasks.workunit.client.0.smithi159.stdout:4/440: chown d9/c91 724477 1 2024-02-28T23:07:11.476 INFO:tasks.workunit.client.0.smithi159.stdout:3/288: unlink d0/d2b/l51 0 2024-02-28T23:07:11.478 INFO:tasks.workunit.client.0.smithi159.stdout:3/289: truncate d0/d6/d3e/f1d 931546 0 2024-02-28T23:07:11.483 INFO:tasks.workunit.client.0.smithi159.stdout:7/242: getdents d5/d16/d1a/d27/d29 0 2024-02-28T23:07:11.486 INFO:tasks.workunit.client.0.smithi159.stdout:0/369: unlink d0/d5/d14/d34/d3d/c6a 0 2024-02-28T23:07:11.488 INFO:tasks.workunit.client.0.smithi159.stdout:9/291: dwrite d4/d3d/d3e/d4a/f56 [0,4194304] 0 2024-02-28T23:07:11.489 INFO:tasks.workunit.client.0.smithi159.stdout:9/292: readlink d4/l1f 0 2024-02-28T23:07:11.489 INFO:tasks.workunit.client.0.smithi159.stdout:4/441: unlink d9/d42/d54/d55/f72 0 2024-02-28T23:07:11.492 INFO:tasks.workunit.client.0.smithi159.stdout:5/362: mknod d8/d67/c75 0 2024-02-28T23:07:11.492 INFO:tasks.workunit.client.0.smithi159.stdout:6/288: write d0/f2a [2017067,53226] 0 2024-02-28T23:07:11.496 INFO:tasks.workunit.client.0.smithi159.stdout:5/363: truncate d8/d19/d23/d2a/f4e 385403 0 2024-02-28T23:07:11.498 INFO:tasks.workunit.client.0.smithi159.stdout:5/364: dread - d8/d19/d23/f49 zero size 2024-02-28T23:07:11.503 INFO:tasks.workunit.client.0.smithi159.stdout:0/370: symlink d0/d5/d14/d25/d2c/d4b/l88 0 2024-02-28T23:07:11.505 INFO:tasks.workunit.client.0.smithi159.stdout:0/371: chown d0/d5/d14/d34/d3d/f82 12391 1 2024-02-28T23:07:11.506 INFO:tasks.workunit.client.0.smithi159.stdout:9/293: creat d4/d3d/d3e/d55/d4c/d4e/f5e x:0 0 0 2024-02-28T23:07:11.506 INFO:tasks.workunit.client.0.smithi159.stdout:7/243: dwrite d5/d10/f36 [4194304,4194304] 0 2024-02-28T23:07:11.511 INFO:tasks.workunit.client.0.smithi159.stdout:3/290: creat d0/d6/d3e/d57/f58 x:0 0 0 2024-02-28T23:07:11.514 INFO:tasks.workunit.client.0.smithi159.stdout:6/289: symlink d0/d1b/d33/d3f/d44/l64 0 2024-02-28T23:07:11.514 INFO:tasks.workunit.client.0.smithi159.stdout:8/342: write d2/d11/f12 [828708,123630] 0 2024-02-28T23:07:11.517 INFO:tasks.workunit.client.0.smithi159.stdout:6/290: stat d0/d1b/d33/d11/d14/d49/f60 0 2024-02-28T23:07:11.519 INFO:tasks.workunit.client.0.smithi159.stdout:1/229: chown d6/d12/d1a/c3b 1580 1 2024-02-28T23:07:11.520 INFO:tasks.workunit.client.0.smithi159.stdout:5/365: creat d8/d19/d23/f76 x:0 0 0 2024-02-28T23:07:11.521 INFO:tasks.workunit.client.0.smithi159.stdout:0/372: creat d0/d5/d38/f89 x:0 0 0 2024-02-28T23:07:11.523 INFO:tasks.workunit.client.0.smithi159.stdout:8/343: dread d2/d11/d52/f62 [0,4194304] 0 2024-02-28T23:07:11.525 INFO:tasks.workunit.client.0.smithi159.stdout:1/230: mkdir d6/d1d/d46 0 2024-02-28T23:07:11.525 INFO:tasks.workunit.client.0.smithi159.stdout:6/291: fsync d0/d1b/d38/f61 0 2024-02-28T23:07:11.529 INFO:tasks.workunit.client.0.smithi159.stdout:4/442: link d9/d42/d54/c8b d9/d20/d81/c99 0 2024-02-28T23:07:11.534 INFO:tasks.workunit.client.0.smithi159.stdout:9/294: creat d4/f5f x:0 0 0 2024-02-28T23:07:11.535 INFO:tasks.workunit.client.0.smithi159.stdout:4/443: rmdir d9/d42/d54/d55 39 2024-02-28T23:07:11.538 INFO:tasks.workunit.client.0.smithi159.stdout:1/231: symlink d6/d12/d31/l47 0 2024-02-28T23:07:11.539 INFO:tasks.workunit.client.0.smithi159.stdout:8/344: mkdir d2/d11/d52/d26/d36/d38/d77/d79 0 2024-02-28T23:07:11.540 INFO:tasks.workunit.client.0.smithi159.stdout:6/292: symlink d0/d1b/d33/d5e/l65 0 2024-02-28T23:07:11.556 INFO:tasks.workunit.client.0.smithi159.stdout:5/366: dwrite d8/d19/d23/f49 [0,4194304] 0 2024-02-28T23:07:11.556 INFO:tasks.workunit.client.0.smithi159.stdout:1/232: truncate d6/d12/f14 3726528 0 2024-02-28T23:07:11.568 INFO:tasks.workunit.client.0.smithi159.stdout:7/244: dread d5/d10/f11 [0,4194304] 0 2024-02-28T23:07:11.571 INFO:tasks.workunit.client.0.smithi159.stdout:5/367: fdatasync d8/d19/d23/d2a/f43 0 2024-02-28T23:07:11.573 INFO:tasks.workunit.client.0.smithi159.stdout:1/233: mkdir d6/d12/d33/d48 0 2024-02-28T23:07:11.581 INFO:tasks.workunit.client.0.smithi159.stdout:1/234: fdatasync d6/f9 0 2024-02-28T23:07:11.586 INFO:tasks.workunit.client.0.smithi159.stdout:4/444: dwrite d9/da/d1c/d23/d2d/f3d [0,4194304] 0 2024-02-28T23:07:11.590 INFO:tasks.workunit.client.0.smithi159.stdout:0/373: dwrite d0/f7e [0,4194304] 0 2024-02-28T23:07:11.590 INFO:tasks.workunit.client.0.smithi159.stdout:7/245: mkdir d5/d16/d1a/d27/d29/d50 0 2024-02-28T23:07:11.591 INFO:tasks.workunit.client.0.smithi159.stdout:6/293: dwrite d0/fa [0,4194304] 0 2024-02-28T23:07:11.594 INFO:tasks.workunit.client.0.smithi159.stdout:4/445: creat d9/da/f9a x:0 0 0 2024-02-28T23:07:11.594 INFO:tasks.workunit.client.0.smithi159.stdout:8/345: dread d2/d11/d52/d26/d36/f55 [0,4194304] 0 2024-02-28T23:07:11.595 INFO:tasks.workunit.client.0.smithi159.stdout:3/291: dwrite d0/d6/d19/f2d [0,4194304] 0 2024-02-28T23:07:11.596 INFO:tasks.workunit.client.0.smithi159.stdout:1/235: mknod d6/d1d/d46/c49 0 2024-02-28T23:07:11.605 INFO:tasks.workunit.client.0.smithi159.stdout:8/346: stat d2/d3/f3d 0 2024-02-28T23:07:11.607 INFO:tasks.workunit.client.0.smithi159.stdout:5/368: read d8/d19/d23/d2a/f4e [263901,38157] 0 2024-02-28T23:07:11.608 INFO:tasks.workunit.client.0.smithi159.stdout:9/295: dread d4/d3d/d3e/d55/f2e [0,4194304] 0 2024-02-28T23:07:11.608 INFO:tasks.workunit.client.0.smithi159.stdout:0/374: read d0/d5/f33 [590967,26034] 0 2024-02-28T23:07:11.622 INFO:tasks.workunit.client.0.smithi159.stdout:7/246: read d5/d16/d1a/f3c [59813,105720] 0 2024-02-28T23:07:11.630 INFO:tasks.workunit.client.0.smithi159.stdout:4/446: creat d9/d42/d54/d55/f9b x:0 0 0 2024-02-28T23:07:11.632 INFO:tasks.workunit.client.0.smithi159.stdout:0/375: symlink d0/de/d75/l8a 0 2024-02-28T23:07:11.633 INFO:tasks.workunit.client.0.smithi159.stdout:5/369: mkdir d8/d19/d23/d35/d41/d77 0 2024-02-28T23:07:11.634 INFO:tasks.workunit.client.0.smithi159.stdout:1/236: dwrite d6/d1d/d1f/d3e/f44 [0,4194304] 0 2024-02-28T23:07:11.634 INFO:tasks.workunit.client.0.smithi159.stdout:4/447: chown d9/da/f3a 6290 1 2024-02-28T23:07:11.637 INFO:tasks.workunit.client.0.smithi159.stdout:6/294: dread d0/d1b/f3c [0,4194304] 0 2024-02-28T23:07:11.646 INFO:tasks.workunit.client.0.smithi159.stdout:9/296: dwrite d4/f13 [4194304,4194304] 0 2024-02-28T23:07:11.646 INFO:tasks.workunit.client.0.smithi159.stdout:0/376: creat d0/f8b x:0 0 0 2024-02-28T23:07:11.650 INFO:tasks.workunit.client.0.smithi159.stdout:8/347: creat d2/d11/d52/d26/d36/d38/d77/d79/f7a x:0 0 0 2024-02-28T23:07:11.654 INFO:tasks.workunit.client.0.smithi159.stdout:0/377: dread d0/f27 [0,4194304] 0 2024-02-28T23:07:11.654 INFO:tasks.workunit.client.0.smithi159.stdout:1/237: dwrite d6/f9 [0,4194304] 0 2024-02-28T23:07:11.662 INFO:tasks.workunit.client.0.smithi159.stdout:4/448: write d9/f3c [4922617,44239] 0 2024-02-28T23:07:11.670 INFO:tasks.workunit.client.0.smithi159.stdout:0/378: unlink d0/f7e 0 2024-02-28T23:07:11.673 INFO:tasks.workunit.client.0.smithi159.stdout:3/292: truncate d0/d2b/f26 1227325 0 2024-02-28T23:07:11.674 INFO:tasks.workunit.client.0.smithi159.stdout:5/370: creat d8/d19/f78 x:0 0 0 2024-02-28T23:07:11.675 INFO:tasks.workunit.client.0.smithi159.stdout:6/295: dwrite d0/fa [0,4194304] 0 2024-02-28T23:07:11.676 INFO:tasks.workunit.client.0.smithi159.stdout:3/293: chown d0/d6/d3e/d49 0 1 2024-02-28T23:07:11.678 INFO:tasks.workunit.client.0.smithi159.stdout:3/294: stat d0/d2b 0 2024-02-28T23:07:11.681 INFO:tasks.workunit.client.0.smithi159.stdout:1/238: creat d6/d12/d33/d48/f4a x:0 0 0 2024-02-28T23:07:11.682 INFO:tasks.workunit.client.0.smithi159.stdout:8/348: dread d2/d11/d52/d26/d36/f55 [0,4194304] 0 2024-02-28T23:07:11.687 INFO:tasks.workunit.client.0.smithi159.stdout:5/371: mkdir d8/d67/d79 0 2024-02-28T23:07:11.687 INFO:tasks.workunit.client.0.smithi159.stdout:2/291: sync 2024-02-28T23:07:11.687 INFO:tasks.workunit.client.0.smithi159.stdout:8/349: truncate d2/f6d 170942 0 2024-02-28T23:07:11.687 INFO:tasks.workunit.client.0.smithi159.stdout:7/247: write d5/f1e [510978,40967] 0 2024-02-28T23:07:11.691 INFO:tasks.workunit.client.0.smithi159.stdout:4/449: mkdir d9/d42/d54/d9c 0 2024-02-28T23:07:11.693 INFO:tasks.workunit.client.0.smithi159.stdout:3/295: dread d0/d6/d3e/f1d [0,4194304] 0 2024-02-28T23:07:11.697 INFO:tasks.workunit.client.0.smithi159.stdout:9/297: fdatasync d4/f13 0 2024-02-28T23:07:11.703 INFO:tasks.workunit.client.0.smithi159.stdout:6/296: dwrite d0/d1b/d33/f3d [0,4194304] 0 2024-02-28T23:07:11.705 INFO:tasks.workunit.client.0.smithi159.stdout:0/379: dwrite d0/d5/d14/d25/d2c/f44 [0,4194304] 0 2024-02-28T23:07:11.733 INFO:tasks.workunit.client.0.smithi159.stdout:5/372: read d8/d19/f1c [2099884,126105] 0 2024-02-28T23:07:11.734 INFO:tasks.workunit.client.0.smithi159.stdout:7/248: mkdir d5/d16/d1a/d27/d51 0 2024-02-28T23:07:11.740 INFO:tasks.workunit.client.0.smithi159.stdout:4/450: truncate d9/d42/f60 1147088 0 2024-02-28T23:07:11.744 INFO:tasks.workunit.client.0.smithi159.stdout:9/298: symlink d4/d3d/d3e/d55/d4c/l60 0 2024-02-28T23:07:11.745 INFO:tasks.workunit.client.0.smithi159.stdout:9/299: chown d4/l40 21 1 2024-02-28T23:07:11.753 INFO:tasks.workunit.client.0.smithi159.stdout:0/380: dread d0/d5/d14/d25/d5c/f6f [0,4194304] 0 2024-02-28T23:07:11.763 INFO:tasks.workunit.client.0.smithi159.stdout:6/297: dwrite d0/d1b/d33/d11/d14/d49/f4a [0,4194304] 0 2024-02-28T23:07:11.765 INFO:tasks.workunit.client.0.smithi159.stdout:6/298: chown d0/d1b/d38/d4e 32 1 2024-02-28T23:07:11.771 INFO:tasks.workunit.client.0.smithi159.stdout:0/381: dwrite d0/d5/d14/d25/f6d [0,4194304] 0 2024-02-28T23:07:11.783 INFO:tasks.workunit.client.0.smithi159.stdout:5/373: creat d8/d19/d23/d35/d38/d6d/f7a x:0 0 0 2024-02-28T23:07:11.786 INFO:tasks.workunit.client.0.smithi159.stdout:9/300: mknod d4/d3d/c61 0 2024-02-28T23:07:11.792 INFO:tasks.workunit.client.0.smithi159.stdout:8/350: getdents d2/d11/d52 0 2024-02-28T23:07:11.795 INFO:tasks.workunit.client.0.smithi159.stdout:8/351: chown d2/d11/d52/d26/d36/d38 60751 1 2024-02-28T23:07:11.797 INFO:tasks.workunit.client.0.smithi159.stdout:7/249: rmdir d5/d16/d1a/d27/d51 0 2024-02-28T23:07:11.798 INFO:tasks.workunit.client.0.smithi159.stdout:7/250: write d5/d16/d1a/d27/f31 [406527,14818] 0 2024-02-28T23:07:11.799 INFO:tasks.workunit.client.0.smithi159.stdout:9/301: mkdir d4/d3d/d3e/d55/d37/d62 0 2024-02-28T23:07:11.803 INFO:tasks.workunit.client.0.smithi159.stdout:8/352: symlink d2/d11/d52/d26/d36/d38/l7b 0 2024-02-28T23:07:11.805 INFO:tasks.workunit.client.0.smithi159.stdout:9/302: creat d4/d3d/d3e/d55/d4c/d4e/f63 x:0 0 0 2024-02-28T23:07:11.805 INFO:tasks.workunit.client.0.smithi159.stdout:8/353: chown d2/d11/d52/d26/d36/f23 19255 1 2024-02-28T23:07:11.808 INFO:tasks.workunit.client.0.smithi159.stdout:6/299: link d0/d1b/d33/d11/l40 d0/d1b/d33/d11/d14/d5d/l66 0 2024-02-28T23:07:11.808 INFO:tasks.workunit.client.0.smithi159.stdout:9/303: write d4/d3d/f5d [850954,27495] 0 2024-02-28T23:07:11.808 INFO:tasks.workunit.client.0.smithi159.stdout:2/292: write d9/d23/d2c/d55/d13/d31/d37/f39 [4362496,51277] 0 2024-02-28T23:07:11.810 INFO:tasks.workunit.client.0.smithi159.stdout:0/382: dwrite d0/f6 [0,4194304] 0 2024-02-28T23:07:11.814 INFO:tasks.workunit.client.0.smithi159.stdout:2/293: stat d9/d23/d2c/d55/d13/d31/d37/f53 0 2024-02-28T23:07:11.814 INFO:tasks.workunit.client.0.smithi159.stdout:0/383: fdatasync d0/de/f4a 0 2024-02-28T23:07:11.825 INFO:tasks.workunit.client.0.smithi159.stdout:6/300: unlink d0/d1b/d33/d11/d14/d49/f4a 0 2024-02-28T23:07:11.835 INFO:tasks.workunit.client.0.smithi159.stdout:9/304: dread d4/f30 [0,4194304] 0 2024-02-28T23:07:11.836 INFO:tasks.workunit.client.0.smithi159.stdout:7/251: link d5/l7 d5/d16/d1a/d27/d29/d50/l52 0 2024-02-28T23:07:11.840 INFO:tasks.workunit.client.0.smithi159.stdout:7/252: truncate d5/d16/d1a/d27/d3e/f4a 617858 0 2024-02-28T23:07:11.851 INFO:tasks.workunit.client.0.smithi159.stdout:7/253: unlink d5/c6 0 2024-02-28T23:07:11.853 INFO:tasks.workunit.client.0.smithi159.stdout:1/239: rename d6/f20 to d6/d12/d33/d3c/f4b 0 2024-02-28T23:07:11.856 INFO:tasks.workunit.client.0.smithi159.stdout:6/301: creat d0/d1b/d33/d11/f67 x:0 0 0 2024-02-28T23:07:11.860 INFO:tasks.workunit.client.0.smithi159.stdout:4/451: rename d9/da/d1c to d9/da/d1c/d9d 22 2024-02-28T23:07:11.861 INFO:tasks.workunit.client.0.smithi159.stdout:6/302: readlink d0/d1b/d33/d11/l31 0 2024-02-28T23:07:11.865 INFO:tasks.workunit.client.0.smithi159.stdout:6/303: read d0/d1b/d38/f61 [514217,57547] 0 2024-02-28T23:07:11.865 INFO:tasks.workunit.client.0.smithi159.stdout:4/452: mknod d9/d20/c9e 0 2024-02-28T23:07:11.865 INFO:tasks.workunit.client.0.smithi159.stdout:1/240: fsync d6/d12/d16/f28 0 2024-02-28T23:07:11.869 INFO:tasks.workunit.client.0.smithi159.stdout:4/453: truncate d9/d42/d54/f97 983906 0 2024-02-28T23:07:11.871 INFO:tasks.workunit.client.0.smithi159.stdout:1/241: creat d6/d1d/d46/f4c x:0 0 0 2024-02-28T23:07:11.876 INFO:tasks.workunit.client.0.smithi159.stdout:9/305: getdents d4/d3d/d3e/d55/d37 0 2024-02-28T23:07:11.877 INFO:tasks.workunit.client.0.smithi159.stdout:4/454: symlink d9/d42/d95/l9f 0 2024-02-28T23:07:11.881 INFO:tasks.workunit.client.0.smithi159.stdout:9/306: unlink d4/d3d/c61 0 2024-02-28T23:07:11.883 INFO:tasks.workunit.client.0.smithi159.stdout:5/374: rename d8/d19/f27 to d8/d16/f7b 0 2024-02-28T23:07:11.883 INFO:tasks.workunit.client.0.smithi159.stdout:1/242: dread d6/f9 [0,4194304] 0 2024-02-28T23:07:11.886 INFO:tasks.workunit.client.0.smithi159.stdout:1/243: read - d6/d1d/d46/f4c zero size 2024-02-28T23:07:11.886 INFO:tasks.workunit.client.0.smithi159.stdout:9/307: mkdir d4/d3d/d3e/d55/d4c/d4e/d64 0 2024-02-28T23:07:11.887 INFO:tasks.workunit.client.0.smithi159.stdout:5/375: write d8/d19/d23/f4a [1122641,83934] 0 2024-02-28T23:07:11.888 INFO:tasks.workunit.client.0.smithi159.stdout:1/244: truncate d6/fb 4947402 0 2024-02-28T23:07:11.890 INFO:tasks.workunit.client.0.smithi159.stdout:1/245: write d6/d12/d16/f24 [322687,26182] 0 2024-02-28T23:07:11.891 INFO:tasks.workunit.client.0.smithi159.stdout:5/376: write d8/d19/d23/d2a/f2f [3412402,76] 0 2024-02-28T23:07:11.895 INFO:tasks.workunit.client.0.smithi159.stdout:1/246: write d6/d12/d16/f28 [493645,91026] 0 2024-02-28T23:07:11.897 INFO:tasks.workunit.client.0.smithi159.stdout:9/308: symlink d4/d3d/d3e/d55/d37/d62/l65 0 2024-02-28T23:07:11.900 INFO:tasks.workunit.client.0.smithi159.stdout:0/384: rename d0/d5/d14/d25/f6d to d0/d5/d14/d78/f8c 0 2024-02-28T23:07:11.902 INFO:tasks.workunit.client.0.smithi159.stdout:0/385: dread - d0/d5/d14/d25/f85 zero size 2024-02-28T23:07:11.904 INFO:tasks.workunit.client.0.smithi159.stdout:5/377: truncate d8/d19/d23/d2a/f4e 903506 0 2024-02-28T23:07:11.905 INFO:tasks.workunit.client.0.smithi159.stdout:0/386: dread - d0/d5/d14/d25/d2c/f7f zero size 2024-02-28T23:07:11.907 INFO:tasks.workunit.client.0.smithi159.stdout:9/309: creat d4/d3d/d3e/f66 x:0 0 0 2024-02-28T23:07:11.907 INFO:tasks.workunit.client.0.smithi159.stdout:5/378: read - d8/d19/d23/f4d zero size 2024-02-28T23:07:11.908 INFO:tasks.workunit.client.0.smithi159.stdout:0/387: dread - d0/d5/d14/d34/d3d/f83 zero size 2024-02-28T23:07:11.910 INFO:tasks.workunit.client.0.smithi159.stdout:5/379: dread - d8/d59/f6b zero size 2024-02-28T23:07:11.916 INFO:tasks.workunit.client.0.smithi159.stdout:8/354: truncate d2/d11/d52/d47/f51 813503 0 2024-02-28T23:07:11.918 INFO:tasks.workunit.client.0.smithi159.stdout:2/294: write d9/d36/f5a [4091934,128481] 0 2024-02-28T23:07:11.920 INFO:tasks.workunit.client.0.smithi159.stdout:0/388: symlink d0/de/d75/l8d 0 2024-02-28T23:07:11.921 INFO:tasks.workunit.client.0.smithi159.stdout:9/310: write d4/d52/f57 [2747081,126461] 0 2024-02-28T23:07:11.923 INFO:tasks.workunit.client.0.smithi159.stdout:2/295: dread - d9/f3c zero size 2024-02-28T23:07:11.927 INFO:tasks.workunit.client.0.smithi159.stdout:0/389: chown d0/d5/d14/d34/f74 256794401 1 2024-02-28T23:07:11.927 INFO:tasks.workunit.client.0.smithi159.stdout:7/254: truncate d5/f12 4089854 0 2024-02-28T23:07:11.931 INFO:tasks.workunit.client.0.smithi159.stdout:2/296: write d9/d23/d2c/d55/d13/d31/d37/f4d [2014766,123591] 0 2024-02-28T23:07:11.931 INFO:tasks.workunit.client.0.smithi159.stdout:0/390: chown d0/f42 0 1 2024-02-28T23:07:11.932 INFO:tasks.workunit.client.0.smithi159.stdout:1/247: dwrite d6/d12/f15 [0,4194304] 0 2024-02-28T23:07:11.940 INFO:tasks.workunit.client.0.smithi159.stdout:4/455: rename d9/da/l88 to d9/da/d1c/la0 0 2024-02-28T23:07:11.944 INFO:tasks.workunit.client.0.smithi159.stdout:4/456: fdatasync d9/d42/d54/f80 0 2024-02-28T23:07:11.945 INFO:tasks.workunit.client.0.smithi159.stdout:6/304: truncate d0/fe 5689038 0 2024-02-28T23:07:11.950 INFO:tasks.workunit.client.0.smithi159.stdout:2/297: creat d9/d34/f5d x:0 0 0 2024-02-28T23:07:11.950 INFO:tasks.workunit.client.0.smithi159.stdout:9/311: dwrite d4/d3d/d3e/d4a/f56 [0,4194304] 0 2024-02-28T23:07:11.957 INFO:tasks.workunit.client.0.smithi159.stdout:2/298: stat d9/d23/d2c/d55/d13/d31/d37/d5c 0 2024-02-28T23:07:11.958 INFO:tasks.workunit.client.0.smithi159.stdout:9/312: truncate d4/d3d/f5b 723243 0 2024-02-28T23:07:11.961 INFO:tasks.workunit.client.0.smithi159.stdout:9/313: chown d4/d3d/d3e/d55/d4c/d4e 1388039 1 2024-02-28T23:07:11.979 INFO:tasks.workunit.client.0.smithi159.stdout:4/457: dread d9/d20/f22 [0,4194304] 0 2024-02-28T23:07:11.984 INFO:tasks.workunit.client.0.smithi159.stdout:3/296: dwrite d0/d2b/f26 [0,4194304] 0 2024-02-28T23:07:11.984 INFO:tasks.workunit.client.0.smithi159.stdout:9/314: symlink d4/d3d/d3e/d55/d4c/d4e/l67 0 2024-02-28T23:07:11.989 INFO:tasks.workunit.client.0.smithi159.stdout:4/458: dread d9/d42/d54/f57 [0,4194304] 0 2024-02-28T23:07:11.994 INFO:tasks.workunit.client.0.smithi159.stdout:4/459: truncate d9/da/f90 1437315 0 2024-02-28T23:07:11.997 INFO:tasks.workunit.client.0.smithi159.stdout:0/391: link d0/d5/d14/d25/d2c/d4b/l4d d0/d5/d14/d25/d5c/l8e 0 2024-02-28T23:07:12.001 INFO:tasks.workunit.client.0.smithi159.stdout:4/460: write d9/da/d1c/d23/d2d/f3d [3843264,123828] 0 2024-02-28T23:07:12.014 INFO:tasks.workunit.client.0.smithi159.stdout:9/315: dwrite d4/f30 [0,4194304] 0 2024-02-28T23:07:12.015 INFO:tasks.workunit.client.0.smithi159.stdout:4/461: dread d9/d42/d54/d56/f70 [0,4194304] 0 2024-02-28T23:07:12.024 INFO:tasks.workunit.client.0.smithi159.stdout:8/355: write d2/d11/d52/d26/d36/f23 [1214179,24690] 0 2024-02-28T23:07:12.027 INFO:tasks.workunit.client.0.smithi159.stdout:6/305: link d0/d1b/d33/d11/d14/l1c d0/d1b/d33/l68 0 2024-02-28T23:07:12.030 INFO:tasks.workunit.client.0.smithi159.stdout:0/392: dwrite d0/d5/d38/f89 [0,4194304] 0 2024-02-28T23:07:12.034 INFO:tasks.workunit.client.0.smithi159.stdout:9/316: dread d4/d3d/d3e/d55/f29 [0,4194304] 0 2024-02-28T23:07:12.038 INFO:tasks.workunit.client.0.smithi159.stdout:9/317: stat d4/f26 0 2024-02-28T23:07:12.042 INFO:tasks.workunit.client.0.smithi159.stdout:8/356: mkdir d2/d11/d52/d47/d7c 0 2024-02-28T23:07:12.046 INFO:tasks.workunit.client.0.smithi159.stdout:2/299: link d9/cd d9/c5e 0 2024-02-28T23:07:12.049 INFO:tasks.workunit.client.0.smithi159.stdout:4/462: symlink d9/d4c/d6c/d98/la1 0 2024-02-28T23:07:12.052 INFO:tasks.workunit.client.0.smithi159.stdout:9/318: symlink d4/d3d/d3e/d55/l68 0 2024-02-28T23:07:12.055 INFO:tasks.workunit.client.0.smithi159.stdout:5/380: dwrite d8/d19/f1f [0,4194304] 0 2024-02-28T23:07:12.055 INFO:tasks.workunit.client.0.smithi159.stdout:0/393: chown d0/d5/d14/c26 7 1 2024-02-28T23:07:12.057 INFO:tasks.workunit.client.0.smithi159.stdout:3/297: write d0/d6/d3e/f22 [3901346,25970] 0 2024-02-28T23:07:12.060 INFO:tasks.workunit.client.0.smithi159.stdout:9/319: chown d4/d3d/d3e/d55/d37/l53 96167 1 2024-02-28T23:07:12.061 INFO:tasks.workunit.client.0.smithi159.stdout:2/300: creat d9/d23/d2c/d55/d13/f5f x:0 0 0 2024-02-28T23:07:12.062 INFO:tasks.workunit.client.0.smithi159.stdout:3/298: fdatasync d0/f12 0 2024-02-28T23:07:12.065 INFO:tasks.workunit.client.0.smithi159.stdout:8/357: mknod d2/d11/d52/d47/d65/c7d 0 2024-02-28T23:07:12.065 INFO:tasks.workunit.client.0.smithi159.stdout:0/394: dread - d0/d5/d14/d25/d2c/f7f zero size 2024-02-28T23:07:12.068 INFO:tasks.workunit.client.0.smithi159.stdout:2/301: rename d9 to d9/d36/d60 22 2024-02-28T23:07:12.069 INFO:tasks.workunit.client.0.smithi159.stdout:1/248: dwrite d6/d12/f14 [4194304,4194304] 0 2024-02-28T23:07:12.074 INFO:tasks.workunit.client.0.smithi159.stdout:0/395: read d0/d5/d38/d63/f69 [2651545,5729] 0 2024-02-28T23:07:12.077 INFO:tasks.workunit.client.0.smithi159.stdout:5/381: symlink d8/d19/d23/d35/d38/l7c 0 2024-02-28T23:07:12.081 INFO:tasks.workunit.client.0.smithi159.stdout:0/396: write d0/d5/d14/d25/d5c/f67 [223014,58277] 0 2024-02-28T23:07:12.087 INFO:tasks.workunit.client.0.smithi159.stdout:9/320: creat d4/d3d/d3e/d55/d37/d62/f69 x:0 0 0 2024-02-28T23:07:12.087 INFO:tasks.workunit.client.0.smithi159.stdout:2/302: mknod d9/d23/d2c/d55/d13/d31/c61 0 2024-02-28T23:07:12.087 INFO:tasks.workunit.client.0.smithi159.stdout:1/249: mknod d6/d12/d33/d3c/c4d 0 2024-02-28T23:07:12.091 INFO:tasks.workunit.client.0.smithi159.stdout:4/463: creat d9/fa2 x:0 0 0 2024-02-28T23:07:12.092 INFO:tasks.workunit.client.0.smithi159.stdout:8/358: dwrite d2/ff [0,4194304] 0 2024-02-28T23:07:12.093 INFO:tasks.workunit.client.0.smithi159.stdout:5/382: rename d8/c26 to d8/d19/d23/d35/d71/c7d 0 2024-02-28T23:07:12.095 INFO:tasks.workunit.client.0.smithi159.stdout:6/306: dread d0/fc [0,4194304] 0 2024-02-28T23:07:12.097 INFO:tasks.workunit.client.0.smithi159.stdout:2/303: readlink d9/d23/d2c/d55/l4b 0 2024-02-28T23:07:12.100 INFO:tasks.workunit.client.0.smithi159.stdout:4/464: stat d9/l1a 0 2024-02-28T23:07:12.101 INFO:tasks.workunit.client.0.smithi159.stdout:8/359: fdatasync d2/f3a 0 2024-02-28T23:07:12.102 INFO:tasks.workunit.client.0.smithi159.stdout:5/383: truncate d8/d19/d23/d35/f5e 710798 0 2024-02-28T23:07:12.103 INFO:tasks.workunit.client.0.smithi159.stdout:2/304: mkdir d9/d50/d62 0 2024-02-28T23:07:12.105 INFO:tasks.workunit.client.0.smithi159.stdout:9/321: rmdir d4/d3d/d3e/d55/d4c/d4e/d64 0 2024-02-28T23:07:12.108 INFO:tasks.workunit.client.0.smithi159.stdout:6/307: rename d0/d1b/d33/d11/d34/f50 to d0/d1b/d38/d52/f69 0 2024-02-28T23:07:12.108 INFO:tasks.workunit.client.0.smithi159.stdout:1/250: dread d6/d12/f2f [0,4194304] 0 2024-02-28T23:07:12.112 INFO:tasks.workunit.client.0.smithi159.stdout:9/322: mkdir d4/d3d/d3e/d55/d37/d62/d6a 0 2024-02-28T23:07:12.115 INFO:tasks.workunit.client.0.smithi159.stdout:6/308: creat d0/d1b/d33/d11/d34/f6a x:0 0 0 2024-02-28T23:07:12.117 INFO:tasks.workunit.client.0.smithi159.stdout:8/360: creat d2/d11/d74/f7e x:0 0 0 2024-02-28T23:07:12.119 INFO:tasks.workunit.client.0.smithi159.stdout:1/251: mkdir d6/d12/d4e 0 2024-02-28T23:07:12.119 INFO:tasks.workunit.client.0.smithi159.stdout:6/309: dread - d0/d1b/d33/f59 zero size 2024-02-28T23:07:12.126 INFO:tasks.workunit.client.0.smithi159.stdout:2/305: getdents d9/d23/d2c 0 2024-02-28T23:07:12.126 INFO:tasks.workunit.client.0.smithi159.stdout:4/465: dwrite d9/da/d1c/d23/d2d/f3d [0,4194304] 0 2024-02-28T23:07:12.130 INFO:tasks.workunit.client.0.smithi159.stdout:2/306: stat d9/d23/d2c/d55/f29 0 2024-02-28T23:07:12.136 INFO:tasks.workunit.client.0.smithi159.stdout:9/323: dwrite d4/d3d/f5d [0,4194304] 0 2024-02-28T23:07:12.136 INFO:tasks.workunit.client.0.smithi159.stdout:8/361: rename d2/f3a to d2/d11/d52/d26/f7f 0 2024-02-28T23:07:12.142 INFO:tasks.workunit.client.0.smithi159.stdout:4/466: creat d9/d42/d54/d9c/fa3 x:0 0 0 2024-02-28T23:07:12.145 INFO:tasks.workunit.client.0.smithi159.stdout:2/307: symlink d9/d36/d59/l63 0 2024-02-28T23:07:12.150 INFO:tasks.workunit.client.0.smithi159.stdout:1/252: dwrite d6/d12/d16/f1c [0,4194304] 0 2024-02-28T23:07:12.156 INFO:tasks.workunit.client.0.smithi159.stdout:6/310: rename d0/d1b/d33/d11/d34/c42 to d0/d1b/d38/d4d/c6b 0 2024-02-28T23:07:12.156 INFO:tasks.workunit.client.0.smithi159.stdout:8/362: mknod d2/d3/c80 0 2024-02-28T23:07:12.158 INFO:tasks.workunit.client.0.smithi159.stdout:1/253: mknod d6/d12/d16/c4f 0 2024-02-28T23:07:12.161 INFO:tasks.workunit.client.0.smithi159.stdout:5/384: dread d8/f17 [0,4194304] 0 2024-02-28T23:07:12.162 INFO:tasks.workunit.client.0.smithi159.stdout:2/308: mknod d9/d23/d2c/d55/d13/d31/d37/d5c/c64 0 2024-02-28T23:07:12.167 INFO:tasks.workunit.client.0.smithi159.stdout:9/324: dwrite d4/d3d/d3e/d55/d4c/d4e/f5c [0,4194304] 0 2024-02-28T23:07:12.169 INFO:tasks.workunit.client.0.smithi159.stdout:8/363: mknod d2/d11/d52/d26/d36/d38/d77/c81 0 2024-02-28T23:07:12.175 INFO:tasks.workunit.client.0.smithi159.stdout:4/467: dwrite d9/fa2 [0,4194304] 0 2024-02-28T23:07:12.179 INFO:tasks.workunit.client.0.smithi159.stdout:8/364: read d2/d11/d52/f32 [69607,11651] 0 2024-02-28T23:07:12.184 INFO:tasks.workunit.client.0.smithi159.stdout:8/365: chown d2/d11/d52/d47/d7c 62 1 2024-02-28T23:07:12.184 INFO:tasks.workunit.client.0.smithi159.stdout:5/385: getdents d8/d67/d79 0 2024-02-28T23:07:12.185 INFO:tasks.workunit.client.0.smithi159.stdout:9/325: write d4/d3d/d3e/d55/f2e [1711171,18482] 0 2024-02-28T23:07:12.185 INFO:tasks.workunit.client.0.smithi159.stdout:2/309: creat d9/d50/d62/f65 x:0 0 0 2024-02-28T23:07:12.188 INFO:tasks.workunit.client.0.smithi159.stdout:1/254: dread d6/d1d/d1f/d3e/f44 [0,4194304] 0 2024-02-28T23:07:12.189 INFO:tasks.workunit.client.0.smithi159.stdout:4/468: creat d9/d4c/d6c/fa4 x:0 0 0 2024-02-28T23:07:12.190 INFO:tasks.workunit.client.0.smithi159.stdout:5/386: unlink d8/d19/d23/d35/d41/f50 0 2024-02-28T23:07:12.192 INFO:tasks.workunit.client.0.smithi159.stdout:4/469: fdatasync d9/d20/f48 0 2024-02-28T23:07:12.192 INFO:tasks.workunit.client.0.smithi159.stdout:2/310: write d9/d23/d2c/d55/d13/f5f [118524,5189] 0 2024-02-28T23:07:12.195 INFO:tasks.workunit.client.0.smithi159.stdout:2/311: chown d9/d23/d2c/d55/d13/d4f 1054786364 1 2024-02-28T23:07:12.196 INFO:tasks.workunit.client.0.smithi159.stdout:9/326: mkdir d4/d3d/d3e/d55/d4c/d4e/d6b 0 2024-02-28T23:07:12.197 INFO:tasks.workunit.client.0.smithi159.stdout:5/387: creat d8/d19/d23/f7e x:0 0 0 2024-02-28T23:07:12.204 INFO:tasks.workunit.client.0.smithi159.stdout:9/327: creat d4/d3d/d3e/d55/d37/f6c x:0 0 0 2024-02-28T23:07:12.205 INFO:tasks.workunit.client.0.smithi159.stdout:5/388: rmdir d8/d59 39 2024-02-28T23:07:12.208 INFO:tasks.workunit.client.0.smithi159.stdout:8/366: rename d2/d11/d52/d47/d65/c69 to d2/d11/d52/d26/c82 0 2024-02-28T23:07:12.208 INFO:tasks.workunit.client.0.smithi159.stdout:1/255: link c3 d6/d1d/c50 0 2024-02-28T23:07:12.211 INFO:tasks.workunit.client.0.smithi159.stdout:4/470: symlink d9/da/d1c/d23/d7a/la5 0 2024-02-28T23:07:12.213 INFO:tasks.workunit.client.0.smithi159.stdout:2/312: dwrite d9/d50/d62/f65 [0,4194304] 0 2024-02-28T23:07:12.214 INFO:tasks.workunit.client.0.smithi159.stdout:5/389: mknod d8/d67/c7f 0 2024-02-28T23:07:12.221 INFO:tasks.workunit.client.0.smithi159.stdout:4/471: rmdir d9/da 39 2024-02-28T23:07:12.223 INFO:tasks.workunit.client.0.smithi159.stdout:1/256: creat d6/d12/d33/f51 x:0 0 0 2024-02-28T23:07:12.229 INFO:tasks.workunit.client.0.smithi159.stdout:8/367: dwrite d2/f6d [0,4194304] 0 2024-02-28T23:07:12.236 INFO:tasks.workunit.client.0.smithi159.stdout:1/257: symlink d6/d12/d4e/l52 0 2024-02-28T23:07:12.237 INFO:tasks.workunit.client.0.smithi159.stdout:5/390: truncate d8/f17 3832910 0 2024-02-28T23:07:12.239 INFO:tasks.workunit.client.0.smithi159.stdout:2/313: truncate d9/d36/f5a 27736 0 2024-02-28T23:07:12.247 INFO:tasks.workunit.client.0.smithi159.stdout:5/391: rmdir d8/d19/d23/d2a 39 2024-02-28T23:07:12.248 INFO:tasks.workunit.client.0.smithi159.stdout:4/472: dwrite d9/d42/d54/f97 [0,4194304] 0 2024-02-28T23:07:12.249 INFO:tasks.workunit.client.0.smithi159.stdout:1/258: write d6/d12/d1a/f2b [4616554,88066] 0 2024-02-28T23:07:12.251 INFO:tasks.workunit.client.0.smithi159.stdout:9/328: dwrite d4/fe [0,4194304] 0 2024-02-28T23:07:12.258 INFO:tasks.workunit.client.0.smithi159.stdout:4/473: creat d9/d42/d54/d9c/fa6 x:0 0 0 2024-02-28T23:07:12.261 INFO:tasks.workunit.client.0.smithi159.stdout:9/329: mkdir d4/d52/d6d 0 2024-02-28T23:07:12.269 INFO:tasks.workunit.client.0.smithi159.stdout:8/368: dwrite d2/d11/d35/f3f [0,4194304] 0 2024-02-28T23:07:12.271 INFO:tasks.workunit.client.0.smithi159.stdout:4/474: mknod d9/d20/d81/ca7 0 2024-02-28T23:07:12.276 INFO:tasks.workunit.client.0.smithi159.stdout:8/369: creat d2/d3/f83 x:0 0 0 2024-02-28T23:07:12.278 INFO:tasks.workunit.client.0.smithi159.stdout:9/330: dread d4/d3d/d3e/d55/d4c/d4e/f5c [0,4194304] 0 2024-02-28T23:07:12.281 INFO:tasks.workunit.client.0.smithi159.stdout:8/370: readlink d2/d11/d52/d26/d36/d38/l7b 0 2024-02-28T23:07:12.284 INFO:tasks.workunit.client.0.smithi159.stdout:9/331: mkdir d4/d3d/d3e/d6e 0 2024-02-28T23:07:12.286 INFO:tasks.workunit.client.0.smithi159.stdout:8/371: fdatasync d2/d3/f14 0 2024-02-28T23:07:12.290 INFO:tasks.workunit.client.0.smithi159.stdout:9/332: fdatasync d4/d3d/d3e/d55/d37/f6c 0 2024-02-28T23:07:12.294 INFO:tasks.workunit.client.0.smithi159.stdout:8/372: stat d2/d11/d52/d26/l41 0 2024-02-28T23:07:12.295 INFO:tasks.workunit.client.0.smithi159.stdout:5/392: truncate d8/f17 3263422 0 2024-02-28T23:07:12.297 INFO:tasks.workunit.client.0.smithi159.stdout:9/333: mknod d4/d3d/d3e/d55/d4c/d4e/c6f 0 2024-02-28T23:07:12.299 INFO:tasks.workunit.client.0.smithi159.stdout:5/393: fdatasync d8/d16/f72 0 2024-02-28T23:07:12.302 INFO:tasks.workunit.client.0.smithi159.stdout:5/394: chown d8/d19/d23/d35/d38/c69 4061871 1 2024-02-28T23:07:12.421 INFO:tasks.workunit.client.0.smithi159.stdout:2/314: write d9/d23/d2c/f2d [195630,34949] 0 2024-02-28T23:07:12.423 INFO:tasks.workunit.client.0.smithi159.stdout:9/334: dread d4/d3d/d3e/d55/f29 [0,4194304] 0 2024-02-28T23:07:12.425 INFO:tasks.workunit.client.0.smithi159.stdout:5/395: creat d8/d59/f80 x:0 0 0 2024-02-28T23:07:12.426 INFO:tasks.workunit.client.0.smithi159.stdout:9/335: write d4/f3c [2894250,44779] 0 2024-02-28T23:07:12.433 INFO:tasks.workunit.client.0.smithi159.stdout:5/396: truncate d8/d19/d23/d35/f62 116961 0 2024-02-28T23:07:12.433 INFO:tasks.workunit.client.0.smithi159.stdout:4/475: dwrite d9/da/f47 [0,4194304] 0 2024-02-28T23:07:12.433 INFO:tasks.workunit.client.0.smithi159.stdout:9/336: readlink d4/d3d/d3e/d55/l44 0 2024-02-28T23:07:12.435 INFO:tasks.workunit.client.0.smithi159.stdout:4/476: fdatasync d9/d42/d54/f97 0 2024-02-28T23:07:12.437 INFO:tasks.workunit.client.0.smithi159.stdout:9/337: readlink d4/d3d/d3e/d55/d37/d62/l65 0 2024-02-28T23:07:12.439 INFO:tasks.workunit.client.0.smithi159.stdout:4/477: dread - d9/d42/d54/d9c/fa6 zero size 2024-02-28T23:07:12.440 INFO:tasks.workunit.client.0.smithi159.stdout:1/259: dread d6/d12/f1b [0,4194304] 0 2024-02-28T23:07:12.441 INFO:tasks.workunit.client.0.smithi159.stdout:5/397: symlink d8/d67/d79/l81 0 2024-02-28T23:07:12.443 INFO:tasks.workunit.client.0.smithi159.stdout:1/260: stat d6/d12/d33/d3c/f41 0 2024-02-28T23:07:12.443 INFO:tasks.workunit.client.0.smithi159.stdout:9/338: dread - d4/d3d/d3e/d4a/f59 zero size 2024-02-28T23:07:12.443 INFO:tasks.workunit.client.0.smithi159.stdout:5/398: readlink d8/d16/l63 0 2024-02-28T23:07:12.446 INFO:tasks.workunit.client.0.smithi159.stdout:1/261: fsync d6/d12/d1a/f3d 0 2024-02-28T23:07:12.447 INFO:tasks.workunit.client.0.smithi159.stdout:4/478: chown d9/d20/d81/c99 27320 1 2024-02-28T23:07:12.457 INFO:tasks.workunit.client.0.smithi159.stdout:5/399: rename d8/d19/c2b to d8/d19/d23/c82 0 2024-02-28T23:07:12.460 INFO:tasks.workunit.client.0.smithi159.stdout:1/262: link d6/d12/f2f d6/d12/d1a/f53 0 2024-02-28T23:07:12.461 INFO:tasks.workunit.client.0.smithi159.stdout:2/315: dread d9/f11 [0,4194304] 0 2024-02-28T23:07:12.463 INFO:tasks.workunit.client.0.smithi159.stdout:2/316: fsync d9/d23/d2c/d55/d13/d31/f45 0 2024-02-28T23:07:12.463 INFO:tasks.workunit.client.0.smithi159.stdout:1/263: mknod d6/d12/d4e/c54 0 2024-02-28T23:07:12.465 INFO:tasks.workunit.client.0.smithi159.stdout:2/317: chown d9/cd 322292205 1 2024-02-28T23:07:12.470 INFO:tasks.workunit.client.0.smithi159.stdout:2/318: creat d9/d50/d54/f66 x:0 0 0 2024-02-28T23:07:12.473 INFO:tasks.workunit.client.0.smithi159.stdout:2/319: creat d9/d23/d2c/f67 x:0 0 0 2024-02-28T23:07:12.474 INFO:tasks.workunit.client.0.smithi159.stdout:9/339: write d4/d3d/d3e/d55/f2a [2960827,68729] 0 2024-02-28T23:07:12.478 INFO:tasks.workunit.client.0.smithi159.stdout:2/320: creat d9/d50/d62/f68 x:0 0 0 2024-02-28T23:07:12.479 INFO:tasks.workunit.client.0.smithi159.stdout:1/264: fsync d6/d12/f2f 0 2024-02-28T23:07:12.482 INFO:tasks.workunit.client.0.smithi159.stdout:2/321: write d9/d23/d2c/d55/d13/d31/d37/f4d [2554147,42798] 0 2024-02-28T23:07:12.482 INFO:tasks.workunit.client.0.smithi159.stdout:9/340: unlink d4/d3d/d3e/d55/l44 0 2024-02-28T23:07:12.485 INFO:tasks.workunit.client.0.smithi159.stdout:2/322: fdatasync d9/d23/d2c/f32 0 2024-02-28T23:07:12.488 INFO:tasks.workunit.client.0.smithi159.stdout:1/265: rename d6/d1d/f1e to d6/d12/d33/d3c/f55 0 2024-02-28T23:07:12.488 INFO:tasks.workunit.client.0.smithi159.stdout:2/323: fsync d9/d23/d2c/d55/f5b 0 2024-02-28T23:07:12.490 INFO:tasks.workunit.client.0.smithi159.stdout:2/324: write d9/d23/d2c/f4a [554136,15033] 0 2024-02-28T23:07:12.492 INFO:tasks.workunit.client.0.smithi159.stdout:2/325: stat d9/f35 0 2024-02-28T23:07:12.492 INFO:tasks.workunit.client.0.smithi159.stdout:5/400: dwrite d8/d19/d23/f4d [0,4194304] 0 2024-02-28T23:07:12.496 INFO:tasks.workunit.client.0.smithi159.stdout:2/326: write d9/d23/d2c/d55/d13/d31/d37/f4d [1972555,78627] 0 2024-02-28T23:07:12.497 INFO:tasks.workunit.client.0.smithi159.stdout:1/266: creat d6/d12/d31/f56 x:0 0 0 2024-02-28T23:07:12.499 INFO:tasks.workunit.client.0.smithi159.stdout:1/267: chown d6/d1d/d1f/d3e/l40 34 1 2024-02-28T23:07:12.500 INFO:tasks.workunit.client.0.smithi159.stdout:5/401: link d8/d19/d23/d35/d38/f3e d8/d19/d23/d35/d65/f83 0 2024-02-28T23:07:12.503 INFO:tasks.workunit.client.0.smithi159.stdout:1/268: write d6/d12/d16/f28 [1499066,84691] 0 2024-02-28T23:07:12.505 INFO:tasks.workunit.client.0.smithi159.stdout:1/269: write d6/f2c [853377,33971] 0 2024-02-28T23:07:12.507 INFO:tasks.workunit.client.0.smithi159.stdout:7/255: sync 2024-02-28T23:07:12.509 INFO:tasks.workunit.client.0.smithi159.stdout:7/256: read - d5/f3d zero size 2024-02-28T23:07:12.514 INFO:tasks.workunit.client.0.smithi159.stdout:2/327: link d9/d23/d2c/d55/d13/c43 d9/c69 0 2024-02-28T23:07:12.528 INFO:tasks.workunit.client.0.smithi159.stdout:2/328: truncate d9/d23/d2c/d55/f2f 776714 0 2024-02-28T23:07:12.530 INFO:tasks.workunit.client.0.smithi159.stdout:1/270: getdents d6/d12/d31 0 2024-02-28T23:07:12.532 INFO:tasks.workunit.client.0.smithi159.stdout:1/271: chown d6/d12/fe 1 1 2024-02-28T23:07:12.543 INFO:tasks.workunit.client.0.smithi159.stdout:2/329: dread d9/d23/d2c/d55/d13/d31/f3b [0,4194304] 0 2024-02-28T23:07:12.548 INFO:tasks.workunit.client.0.smithi159.stdout:5/402: dwrite d8/f17 [0,4194304] 0 2024-02-28T23:07:12.550 INFO:tasks.workunit.client.0.smithi159.stdout:1/272: dwrite d6/d12/d16/f24 [0,4194304] 0 2024-02-28T23:07:12.554 INFO:tasks.workunit.client.0.smithi159.stdout:5/403: creat d8/d59/f84 x:0 0 0 2024-02-28T23:07:12.558 INFO:tasks.workunit.client.0.smithi159.stdout:1/273: dread - d6/d12/d33/f51 zero size 2024-02-28T23:07:12.564 INFO:tasks.workunit.client.0.smithi159.stdout:5/404: unlink d8/l28 0 2024-02-28T23:07:12.570 INFO:tasks.workunit.client.0.smithi159.stdout:5/405: link d8/d19/d23/d35/d41/l44 d8/d67/l85 0 2024-02-28T23:07:12.574 INFO:tasks.workunit.client.0.smithi159.stdout:5/406: fsync d8/f31 0 2024-02-28T23:07:12.574 INFO:tasks.workunit.client.0.smithi159.stdout:1/274: dwrite d6/d12/d1a/f23 [0,4194304] 0 2024-02-28T23:07:12.575 INFO:tasks.workunit.client.0.smithi159.stdout:2/330: dread f6 [0,4194304] 0 2024-02-28T23:07:12.580 INFO:tasks.workunit.client.0.smithi159.stdout:2/331: creat d9/d23/f6a x:0 0 0 2024-02-28T23:07:12.592 INFO:tasks.workunit.client.0.smithi159.stdout:5/407: dwrite d8/f3f [0,4194304] 0 2024-02-28T23:07:12.596 INFO:tasks.workunit.client.0.smithi159.stdout:1/275: truncate d6/d12/d16/f24 1149979 0 2024-02-28T23:07:12.599 INFO:tasks.workunit.client.0.smithi159.stdout:5/408: read d8/f10 [1572092,19022] 0 2024-02-28T23:07:12.601 INFO:tasks.workunit.client.0.smithi159.stdout:5/409: write d8/d59/f80 [805614,46071] 0 2024-02-28T23:07:12.606 INFO:tasks.workunit.client.0.smithi159.stdout:5/410: mknod d8/d19/d23/d35/d71/c86 0 2024-02-28T23:07:12.609 INFO:tasks.workunit.client.0.smithi159.stdout:5/411: creat d8/d19/d23/d35/d41/f87 x:0 0 0 2024-02-28T23:07:12.611 INFO:tasks.workunit.client.0.smithi159.stdout:5/412: mkdir d8/d67/d88 0 2024-02-28T23:07:12.625 INFO:tasks.workunit.client.0.smithi159.stdout:2/332: dread d9/d23/d2c/d55/f29 [0,4194304] 0 2024-02-28T23:07:12.629 INFO:tasks.workunit.client.0.smithi159.stdout:2/333: creat d9/d36/d59/f6b x:0 0 0 2024-02-28T23:07:12.631 INFO:tasks.workunit.client.0.smithi159.stdout:5/413: dwrite d8/f14 [4194304,4194304] 0 2024-02-28T23:07:12.631 INFO:tasks.workunit.client.0.smithi159.stdout:1/276: dread d6/d12/d1a/f38 [0,4194304] 0 2024-02-28T23:07:12.634 INFO:tasks.workunit.client.0.smithi159.stdout:2/334: read - d9/f33 zero size 2024-02-28T23:07:12.635 INFO:tasks.workunit.client.0.smithi159.stdout:1/277: symlink d6/d12/d16/l57 0 2024-02-28T23:07:12.639 INFO:tasks.workunit.client.0.smithi159.stdout:5/414: creat d8/d67/f89 x:0 0 0 2024-02-28T23:07:12.642 INFO:tasks.workunit.client.0.smithi159.stdout:1/278: write d6/d12/f14 [5125312,65129] 0 2024-02-28T23:07:12.643 INFO:tasks.workunit.client.0.smithi159.stdout:1/279: readlink l5 0 2024-02-28T23:07:12.644 INFO:tasks.workunit.client.0.smithi159.stdout:2/335: creat d9/d50/d54/f6c x:0 0 0 2024-02-28T23:07:12.650 INFO:tasks.workunit.client.0.smithi159.stdout:2/336: creat d9/d23/d2c/d55/d13/d31/f6d x:0 0 0 2024-02-28T23:07:12.653 INFO:tasks.workunit.client.0.smithi159.stdout:1/280: getdents d6/d12/d31 0 2024-02-28T23:07:12.655 INFO:tasks.workunit.client.0.smithi159.stdout:2/337: symlink d9/d36/d59/l6e 0 2024-02-28T23:07:12.657 INFO:tasks.workunit.client.0.smithi159.stdout:5/415: link d8/d19/d23/d35/c3a d8/d19/d23/d35/d41/d77/c8a 0 2024-02-28T23:07:12.658 INFO:tasks.workunit.client.0.smithi159.stdout:2/338: chown d9/d23/d2c/d55/d13/d31/d37/c4c 182872 1 2024-02-28T23:07:12.663 INFO:tasks.workunit.client.0.smithi159.stdout:1/281: link d6/d12/d16/l57 d6/d12/d33/l58 0 2024-02-28T23:07:12.666 INFO:tasks.workunit.client.0.smithi159.stdout:1/282: rmdir d6/d12/d31 39 2024-02-28T23:07:12.671 INFO:tasks.workunit.client.0.smithi159.stdout:1/283: mknod d6/d12/d33/d3c/c59 0 2024-02-28T23:07:12.673 INFO:tasks.workunit.client.0.smithi159.stdout:1/284: write d6/f9 [3709948,893] 0 2024-02-28T23:07:12.676 INFO:tasks.workunit.client.0.smithi159.stdout:1/285: mkdir d6/d12/d31/d5a 0 2024-02-28T23:07:12.720 INFO:tasks.workunit.client.0.smithi159.stdout:1/286: dwrite d6/d12/f18 [0,4194304] 0 2024-02-28T23:07:12.722 INFO:tasks.workunit.client.0.smithi159.stdout:1/287: symlink d6/d1d/l5b 0 2024-02-28T23:07:12.723 INFO:tasks.workunit.client.0.smithi159.stdout:1/288: fdatasync d6/d12/d1a/f2b 0 2024-02-28T23:07:12.728 INFO:tasks.workunit.client.0.smithi159.stdout:1/289: mknod d6/d12/d33/c5c 0 2024-02-28T23:07:12.729 INFO:tasks.workunit.client.0.smithi159.stdout:1/290: dread - d6/d12/d1a/f3d zero size 2024-02-28T23:07:12.731 INFO:tasks.workunit.client.0.smithi159.stdout:1/291: stat d6/d12/d33/d3c/c59 0 2024-02-28T23:07:12.733 INFO:tasks.workunit.client.0.smithi159.stdout:1/292: chown d6/d12/f14 38 1 2024-02-28T23:07:12.734 INFO:tasks.workunit.client.0.smithi159.stdout:3/299: sync 2024-02-28T23:07:12.740 INFO:tasks.workunit.client.0.smithi159.stdout:3/300: mkdir d0/d3f/d59 0 2024-02-28T23:07:12.741 INFO:tasks.workunit.client.0.smithi159.stdout:3/301: stat d0/d6/d3e/d2f 0 2024-02-28T23:07:12.756 INFO:tasks.workunit.client.0.smithi159.stdout:3/302: write d0/d6/d3e/f1d [888633,125060] 0 2024-02-28T23:07:12.765 INFO:tasks.workunit.client.0.smithi159.stdout:1/293: dwrite d6/d12/f2f [0,4194304] 0 2024-02-28T23:07:12.774 INFO:tasks.workunit.client.0.smithi159.stdout:3/303: dwrite d0/d6/d34/f41 [0,4194304] 0 2024-02-28T23:07:12.775 INFO:tasks.workunit.client.0.smithi159.stdout:1/294: rename d6/d12/c45 to d6/d12/c5d 0 2024-02-28T23:07:12.786 INFO:tasks.workunit.client.0.smithi159.stdout:3/304: getdents d0/d47 0 2024-02-28T23:07:12.795 INFO:tasks.workunit.client.0.smithi159.stdout:3/305: truncate d0/d6/d3e/d2f/f4b 2707930 0 2024-02-28T23:07:12.866 INFO:tasks.workunit.client.0.smithi159.stdout:3/306: read d0/d6/d3e/d2f/f4b [2555869,13143] 0 2024-02-28T23:07:12.885 INFO:tasks.workunit.client.0.smithi159.stdout:3/307: truncate d0/d6/d34/f45 548921 0 2024-02-28T23:07:12.887 INFO:tasks.workunit.client.0.smithi159.stdout:3/308: read d0/f35 [768569,60076] 0 2024-02-28T23:07:12.890 INFO:tasks.workunit.client.0.smithi159.stdout:3/309: read d0/d6/d34/f41 [1156501,122281] 0 2024-02-28T23:07:12.896 INFO:tasks.workunit.client.0.smithi159.stdout:3/310: creat d0/d6/d19/d54/f5a x:0 0 0 2024-02-28T23:07:12.897 INFO:tasks.workunit.client.0.smithi159.stdout:3/311: dread - d0/f4c zero size 2024-02-28T23:07:12.901 INFO:tasks.workunit.client.0.smithi159.stdout:3/312: creat d0/d6/d3e/f5b x:0 0 0 2024-02-28T23:07:12.904 INFO:tasks.workunit.client.0.smithi159.stdout:3/313: symlink d0/d3f/d59/l5c 0 2024-02-28T23:07:12.942 INFO:tasks.workunit.client.0.smithi159.stdout:3/314: dread d0/d6/f13 [0,4194304] 0 2024-02-28T23:07:12.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:12 smithi159 ceph-mon[28802]: pgmap v25: 65 pgs: 65 active+clean; 707 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s rd, 81 MiB/s wr, 180 op/s 2024-02-28T23:07:12.977 INFO:tasks.workunit.client.0.smithi159.stdout:3/315: write d0/d6/f13 [1339080,116863] 0 2024-02-28T23:07:12.981 INFO:tasks.workunit.client.0.smithi159.stdout:3/316: read d0/d6/d19/f3d [882068,126284] 0 2024-02-28T23:07:12.984 INFO:tasks.workunit.client.0.smithi159.stdout:3/317: symlink d0/d2b/l5d 0 2024-02-28T23:07:12.998 INFO:tasks.workunit.client.0.smithi159.stdout:0/397: sync 2024-02-28T23:07:12.999 INFO:tasks.workunit.client.0.smithi159.stdout:3/318: dwrite d0/d2b/f26 [0,4194304] 0 2024-02-28T23:07:13.004 INFO:tasks.workunit.client.0.smithi159.stdout:3/319: rmdir d0/d6/d3e/d49 39 2024-02-28T23:07:13.008 INFO:tasks.workunit.client.0.smithi159.stdout:0/398: mknod d0/d5/d14/c8f 0 2024-02-28T23:07:13.008 INFO:tasks.workunit.client.0.smithi159.stdout:0/399: read d0/f3 [4895955,105958] 0 2024-02-28T23:07:13.013 INFO:tasks.workunit.client.0.smithi159.stdout:0/400: rename d0/d5/d14/f70 to d0/d5/d38/f90 0 2024-02-28T23:07:13.017 INFO:tasks.workunit.client.0.smithi159.stdout:0/401: creat d0/d5/d38/f91 x:0 0 0 2024-02-28T23:07:13.022 INFO:tasks.workunit.client.0.smithi159.stdout:3/320: dwrite d0/fe [0,4194304] 0 2024-02-28T23:07:13.023 INFO:tasks.workunit.client.0.smithi159.stdout:3/321: fdatasync d0/f12 0 2024-02-28T23:07:13.025 INFO:tasks.workunit.client.0.smithi159.stdout:3/322: write d0/fe [248645,38770] 0 2024-02-28T23:07:13.026 INFO:tasks.workunit.client.0.smithi159.stdout:3/323: dread - d0/f4c zero size 2024-02-28T23:07:13.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:12 smithi184 ceph-mon[36198]: pgmap v25: 65 pgs: 65 active+clean; 707 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 6.6 MiB/s rd, 81 MiB/s wr, 180 op/s 2024-02-28T23:07:13.170 INFO:tasks.workunit.client.0.smithi159.stdout:6/311: sync 2024-02-28T23:07:13.211 INFO:tasks.workunit.client.0.smithi159.stdout:6/312: write d0/f9 [442134,66264] 0 2024-02-28T23:07:13.212 INFO:tasks.workunit.client.0.smithi159.stdout:6/313: chown d0/d1b/f1a 346771 1 2024-02-28T23:07:13.219 INFO:tasks.workunit.client.0.smithi159.stdout:6/314: rmdir d0/d1b/d33/d11/d34 39 2024-02-28T23:07:13.251 INFO:tasks.workunit.client.0.smithi159.stdout:8/373: sync 2024-02-28T23:07:13.251 INFO:tasks.workunit.client.0.smithi159.stdout:1/295: sync 2024-02-28T23:07:13.255 INFO:tasks.workunit.client.0.smithi159.stdout:6/315: dwrite d0/d1b/f56 [0,4194304] 0 2024-02-28T23:07:13.255 INFO:tasks.workunit.client.0.smithi159.stdout:1/296: readlink d6/d12/d16/l2d 0 2024-02-28T23:07:13.257 INFO:tasks.workunit.client.0.smithi159.stdout:6/316: fdatasync d0/fa 0 2024-02-28T23:07:13.258 INFO:tasks.workunit.client.0.smithi159.stdout:8/374: chown d2/d11/d52/d26/d36/f55 26 1 2024-02-28T23:07:13.260 INFO:tasks.workunit.client.0.smithi159.stdout:1/297: rmdir d6/d12/d31 39 2024-02-28T23:07:13.295 INFO:tasks.workunit.client.0.smithi159.stdout:6/317: dread d0/f2a [0,4194304] 0 2024-02-28T23:07:13.299 INFO:tasks.workunit.client.0.smithi159.stdout:1/298: dwrite d6/d1d/d1f/d3e/f44 [0,4194304] 0 2024-02-28T23:07:13.303 INFO:tasks.workunit.client.0.smithi159.stdout:1/299: dread - d6/d1d/d46/f4c zero size 2024-02-28T23:07:13.304 INFO:tasks.workunit.client.0.smithi159.stdout:8/375: dwrite d2/d3/f29 [0,4194304] 0 2024-02-28T23:07:13.308 INFO:tasks.workunit.client.0.smithi159.stdout:8/376: symlink d2/d11/d52/l84 0 2024-02-28T23:07:13.308 INFO:tasks.workunit.client.0.smithi159.stdout:6/318: link d0/d1b/d38/d52/c26 d0/d1b/d38/c6c 0 2024-02-28T23:07:13.311 INFO:tasks.workunit.client.0.smithi159.stdout:1/300: rename d6/d12/f2f to d6/d12/d4e/f5e 0 2024-02-28T23:07:13.313 INFO:tasks.workunit.client.0.smithi159.stdout:6/319: truncate d0/d1b/d33/d11/f67 452250 0 2024-02-28T23:07:13.318 INFO:tasks.workunit.client.0.smithi159.stdout:1/301: truncate d6/d12/f2a 1018562 0 2024-02-28T23:07:13.319 INFO:tasks.workunit.client.0.smithi159.stdout:8/377: creat d2/d11/f85 x:0 0 0 2024-02-28T23:07:13.323 INFO:tasks.workunit.client.0.smithi159.stdout:8/378: mknod d2/d11/d52/c86 0 2024-02-28T23:07:13.324 INFO:tasks.workunit.client.0.smithi159.stdout:9/341: sync 2024-02-28T23:07:13.324 INFO:tasks.workunit.client.0.smithi159.stdout:4/479: sync 2024-02-28T23:07:13.324 INFO:tasks.workunit.client.0.smithi159.stdout:2/339: sync 2024-02-28T23:07:13.325 INFO:tasks.workunit.client.0.smithi159.stdout:0/402: sync 2024-02-28T23:07:13.325 INFO:tasks.workunit.client.0.smithi159.stdout:5/416: sync 2024-02-28T23:07:13.325 INFO:tasks.workunit.client.0.smithi159.stdout:3/324: sync 2024-02-28T23:07:13.326 INFO:tasks.workunit.client.0.smithi159.stdout:7/257: sync 2024-02-28T23:07:13.330 INFO:tasks.workunit.client.0.smithi159.stdout:3/325: dread - d0/d6/d3e/d2f/f56 zero size 2024-02-28T23:07:13.335 INFO:tasks.workunit.client.0.smithi159.stdout:5/417: rmdir d8/d59 39 2024-02-28T23:07:13.335 INFO:tasks.workunit.client.0.smithi159.stdout:4/480: write d9/f5b [961686,118164] 0 2024-02-28T23:07:13.336 INFO:tasks.workunit.client.0.smithi159.stdout:8/379: write d2/d11/d52/d26/d36/f55 [2249097,102841] 0 2024-02-28T23:07:13.343 INFO:tasks.workunit.client.0.smithi159.stdout:3/326: rmdir d0/d6/d3e/d57 39 2024-02-28T23:07:13.347 INFO:tasks.workunit.client.0.smithi159.stdout:8/380: chown d2/d11/d52/d26/l4a 109593 1 2024-02-28T23:07:13.350 INFO:tasks.workunit.client.0.smithi159.stdout:1/302: dwrite d6/d12/d16/f24 [0,4194304] 0 2024-02-28T23:07:13.350 INFO:tasks.workunit.client.0.smithi159.stdout:3/327: write d0/d6/d3e/f22 [1775727,14089] 0 2024-02-28T23:07:13.354 INFO:tasks.workunit.client.0.smithi159.stdout:5/418: rename d8/d19/f2d to d8/f8b 0 2024-02-28T23:07:13.360 INFO:tasks.workunit.client.0.smithi159.stdout:8/381: rmdir d2/d11/d52/d26/d36/d38/d77 39 2024-02-28T23:07:13.360 INFO:tasks.workunit.client.0.smithi159.stdout:5/419: write d8/f34 [6581335,107087] 0 2024-02-28T23:07:13.367 INFO:tasks.workunit.client.0.smithi159.stdout:1/303: write d6/d12/d33/d3c/f4b [3621676,46196] 0 2024-02-28T23:07:13.369 INFO:tasks.workunit.client.0.smithi159.stdout:6/320: dread d0/d1b/d33/d11/d14/d49/f57 [0,4194304] 0 2024-02-28T23:07:13.369 INFO:tasks.workunit.client.0.smithi159.stdout:9/342: dwrite d4/d3d/d3e/d55/f1e [0,4194304] 0 2024-02-28T23:07:13.372 INFO:tasks.workunit.client.0.smithi159.stdout:0/403: rename d0/d5/d14/d34/f47 to d0/d5/d14/d34/d3d/f92 0 2024-02-28T23:07:13.373 INFO:tasks.workunit.client.0.smithi159.stdout:5/420: rmdir d8/d19/d23/d35 39 2024-02-28T23:07:13.375 INFO:tasks.workunit.client.0.smithi159.stdout:1/304: truncate d6/d12/d16/f42 667474 0 2024-02-28T23:07:13.378 INFO:tasks.workunit.client.0.smithi159.stdout:8/382: write d2/d11/d52/d26/d36/d38/f39 [8921584,103310] 0 2024-02-28T23:07:13.381 INFO:tasks.workunit.client.0.smithi159.stdout:4/481: dwrite d9/da/d1c/d23/d2d/f3d [0,4194304] 0 2024-02-28T23:07:13.385 INFO:tasks.workunit.client.0.smithi159.stdout:6/321: dread d0/d1b/d38/f61 [0,4194304] 0 2024-02-28T23:07:13.385 INFO:tasks.workunit.client.0.smithi159.stdout:7/258: dread d5/d16/f30 [0,4194304] 0 2024-02-28T23:07:13.385 INFO:tasks.workunit.client.0.smithi159.stdout:4/482: chown d9/d4c/d6c/f68 67 1 2024-02-28T23:07:13.389 INFO:tasks.workunit.client.0.smithi159.stdout:7/259: write d5/d10/f36 [4675367,35257] 0 2024-02-28T23:07:13.393 INFO:tasks.workunit.client.0.smithi159.stdout:0/404: mknod d0/d5/d14/d25/d5c/c93 0 2024-02-28T23:07:13.409 INFO:tasks.workunit.client.0.smithi159.stdout:0/405: unlink d0/f3 0 2024-02-28T23:07:13.415 INFO:tasks.workunit.client.0.smithi159.stdout:3/328: link d0/d6/d3e/l1f d0/d6/d3e/d2f/l5e 0 2024-02-28T23:07:13.419 INFO:tasks.workunit.client.0.smithi159.stdout:8/383: write d2/d3/f1f [942398,114262] 0 2024-02-28T23:07:13.422 INFO:tasks.workunit.client.0.smithi159.stdout:8/384: readlink d2/d11/l44 0 2024-02-28T23:07:13.424 INFO:tasks.workunit.client.0.smithi159.stdout:1/305: dread d6/d12/d33/d3c/f4b [0,4194304] 0 2024-02-28T23:07:13.427 INFO:tasks.workunit.client.0.smithi159.stdout:6/322: getdents d0/d1b/d38/d4e 0 2024-02-28T23:07:13.427 INFO:tasks.workunit.client.0.smithi159.stdout:1/306: readlink d6/d1d/l30 0 2024-02-28T23:07:13.435 INFO:tasks.workunit.client.0.smithi159.stdout:8/385: chown d2/d11/d52/d26/d36/d38/d77/c81 418 1 2024-02-28T23:07:13.435 INFO:tasks.workunit.client.0.smithi159.stdout:9/343: truncate d4/d3d/d3e/d55/f2e 3553505 0 2024-02-28T23:07:13.436 INFO:tasks.workunit.client.0.smithi159.stdout:0/406: dread d0/d5/d14/d25/d5c/f6f [0,4194304] 0 2024-02-28T23:07:13.437 INFO:tasks.workunit.client.0.smithi159.stdout:4/483: dread d9/d20/d87/f92 [0,4194304] 0 2024-02-28T23:07:13.437 INFO:tasks.workunit.client.0.smithi159.stdout:3/329: getdents d0/d2b/d4f 0 2024-02-28T23:07:13.437 INFO:tasks.workunit.client.0.smithi159.stdout:9/344: chown d4/l20 3 1 2024-02-28T23:07:13.438 INFO:tasks.workunit.client.0.smithi159.stdout:6/323: unlink d0/d1b/d33/d3f/d44/l54 0 2024-02-28T23:07:13.439 INFO:tasks.workunit.client.0.smithi159.stdout:6/324: fsync d0/f9 0 2024-02-28T23:07:13.443 INFO:tasks.workunit.client.0.smithi159.stdout:5/421: dread d8/d19/f3c [0,4194304] 0 2024-02-28T23:07:13.444 INFO:tasks.workunit.client.0.smithi159.stdout:1/307: link d6/d12/d16/f1c d6/d1d/d46/f5f 0 2024-02-28T23:07:13.446 INFO:tasks.workunit.client.0.smithi159.stdout:3/330: rmdir d0/d6/d34 39 2024-02-28T23:07:13.448 INFO:tasks.workunit.client.0.smithi159.stdout:3/331: dread - d0/d6/d3e/d2f/f56 zero size 2024-02-28T23:07:13.453 INFO:tasks.workunit.client.0.smithi159.stdout:7/260: dread d5/f12 [0,4194304] 0 2024-02-28T23:07:13.457 INFO:tasks.workunit.client.0.smithi159.stdout:7/261: truncate d5/d16/d1a/d27/f31 1224799 0 2024-02-28T23:07:13.459 INFO:tasks.workunit.client.0.smithi159.stdout:0/407: mkdir d0/d5/d14/d34/d6c/d94 0 2024-02-28T23:07:13.462 INFO:tasks.workunit.client.0.smithi159.stdout:0/408: chown d0/d5/d14/d34/d6c/d94 5 1 2024-02-28T23:07:13.467 INFO:tasks.workunit.client.0.smithi159.stdout:9/345: rename d4/l12 to d4/d3d/d3e/d55/d37/d62/l70 0 2024-02-28T23:07:13.468 INFO:tasks.workunit.client.0.smithi159.stdout:9/346: chown d4/l14 5370 1 2024-02-28T23:07:13.469 INFO:tasks.workunit.client.0.smithi159.stdout:3/332: dread d0/d6/d19/f2d [0,4194304] 0 2024-02-28T23:07:13.471 INFO:tasks.workunit.client.0.smithi159.stdout:5/422: creat d8/d19/d23/d2a/f8c x:0 0 0 2024-02-28T23:07:13.474 INFO:tasks.workunit.client.0.smithi159.stdout:7/262: chown d5/d16/l20 1 1 2024-02-28T23:07:13.474 INFO:tasks.workunit.client.0.smithi159.stdout:0/409: truncate d0/d5/d14/d34/d3d/f82 1002521 0 2024-02-28T23:07:13.475 INFO:tasks.workunit.client.0.smithi159.stdout:9/347: mkdir d4/d3d/d3e/d71 0 2024-02-28T23:07:13.478 INFO:tasks.workunit.client.0.smithi159.stdout:1/308: creat d6/d12/f60 x:0 0 0 2024-02-28T23:07:13.478 INFO:tasks.workunit.client.0.smithi159.stdout:2/340: sync 2024-02-28T23:07:13.482 INFO:tasks.workunit.client.0.smithi159.stdout:8/386: dread d2/f40 [0,4194304] 0 2024-02-28T23:07:13.482 INFO:tasks.workunit.client.0.smithi159.stdout:1/309: dread - d6/d1d/d46/f4c zero size 2024-02-28T23:07:13.484 INFO:tasks.workunit.client.0.smithi159.stdout:6/325: getdents d0/d1b/d38 0 2024-02-28T23:07:13.489 INFO:tasks.workunit.client.0.smithi159.stdout:9/348: readlink d4/d3d/d3e/d55/d4c/l51 0 2024-02-28T23:07:13.490 INFO:tasks.workunit.client.0.smithi159.stdout:0/410: rename d0/d5/d14/d25/d2c/c86 to d0/d5/d38/d76/c95 0 2024-02-28T23:07:13.492 INFO:tasks.workunit.client.0.smithi159.stdout:4/484: dwrite d9/d20/d87/f92 [4194304,4194304] 0 2024-02-28T23:07:13.492 INFO:tasks.workunit.client.0.smithi159.stdout:3/333: dwrite d0/d6/d3e/f1d [4194304,4194304] 0 2024-02-28T23:07:13.492 INFO:tasks.workunit.client.0.smithi159.stdout:1/310: symlink d6/d12/d4e/l61 0 2024-02-28T23:07:13.496 INFO:tasks.workunit.client.0.smithi159.stdout:5/423: creat d8/d19/d23/d35/d38/d6d/f8d x:0 0 0 2024-02-28T23:07:13.497 INFO:tasks.workunit.client.0.smithi159.stdout:7/263: creat d5/d16/d1a/d27/d29/d50/f53 x:0 0 0 2024-02-28T23:07:13.499 INFO:tasks.workunit.client.0.smithi159.stdout:6/326: unlink d0/d1b/d33/d11/d14/c32 0 2024-02-28T23:07:13.499 INFO:tasks.workunit.client.0.smithi159.stdout:9/349: creat d4/d3d/d3e/f72 x:0 0 0 2024-02-28T23:07:13.501 INFO:tasks.workunit.client.0.smithi159.stdout:0/411: mkdir d0/d5/d38/d76/d96 0 2024-02-28T23:07:13.502 INFO:tasks.workunit.client.0.smithi159.stdout:4/485: fsync d9/d4c/f8f 0 2024-02-28T23:07:13.505 INFO:tasks.workunit.client.0.smithi159.stdout:0/412: dread - d0/d5/d14/d25/f85 zero size 2024-02-28T23:07:13.507 INFO:tasks.workunit.client.0.smithi159.stdout:3/334: symlink d0/d6/d3e/d57/l5f 0 2024-02-28T23:07:13.510 INFO:tasks.workunit.client.0.smithi159.stdout:0/413: chown d0/d5/d14/c8f 155569204 1 2024-02-28T23:07:13.514 INFO:tasks.workunit.client.0.smithi159.stdout:7/264: rename d5/d16/d1a/d27/d46/l4c to d5/d16/d1a/d27/d46/l54 0 2024-02-28T23:07:13.518 INFO:tasks.workunit.client.0.smithi159.stdout:3/335: rmdir d0/d3f 39 2024-02-28T23:07:13.519 INFO:tasks.workunit.client.0.smithi159.stdout:9/350: stat d4/f26 0 2024-02-28T23:07:13.520 INFO:tasks.workunit.client.0.smithi159.stdout:7/265: fdatasync d5/d10/f34 0 2024-02-28T23:07:13.524 INFO:tasks.workunit.client.0.smithi159.stdout:3/336: read d0/d6/f32 [490029,119209] 0 2024-02-28T23:07:13.529 INFO:tasks.workunit.client.0.smithi159.stdout:8/387: write d2/d11/d52/d26/f31 [576829,22292] 0 2024-02-28T23:07:13.537 INFO:tasks.workunit.client.0.smithi159.stdout:6/327: dread d0/d1b/d38/d52/f27 [0,4194304] 0 2024-02-28T23:07:13.538 INFO:tasks.workunit.client.0.smithi159.stdout:3/337: truncate d0/d6/d19/f2d 706111 0 2024-02-28T23:07:13.540 INFO:tasks.workunit.client.0.smithi159.stdout:8/388: creat d2/d11/d52/d6e/f87 x:0 0 0 2024-02-28T23:07:13.541 INFO:tasks.workunit.client.0.smithi159.stdout:9/351: dread d4/d3d/f5d [0,4194304] 0 2024-02-28T23:07:13.542 INFO:tasks.workunit.client.0.smithi159.stdout:6/328: fdatasync d0/d1b/f56 0 2024-02-28T23:07:13.545 INFO:tasks.workunit.client.0.smithi159.stdout:5/424: dwrite d8/f15 [4194304,4194304] 0 2024-02-28T23:07:13.546 INFO:tasks.workunit.client.0.smithi159.stdout:8/389: chown d2/d3/f29 5488 1 2024-02-28T23:07:13.549 INFO:tasks.workunit.client.0.smithi159.stdout:9/352: creat d4/d3d/d3e/f73 x:0 0 0 2024-02-28T23:07:13.550 INFO:tasks.workunit.client.0.smithi159.stdout:0/414: dwrite d0/f1e [0,4194304] 0 2024-02-28T23:07:13.552 INFO:tasks.workunit.client.0.smithi159.stdout:5/425: creat d8/d67/f8e x:0 0 0 2024-02-28T23:07:13.558 INFO:tasks.workunit.client.0.smithi159.stdout:5/426: rmdir d8/d19 39 2024-02-28T23:07:13.560 INFO:tasks.workunit.client.0.smithi159.stdout:8/390: write d2/d11/d52/d6e/f87 [495174,118818] 0 2024-02-28T23:07:13.562 INFO:tasks.workunit.client.0.smithi159.stdout:9/353: creat d4/d3d/d3e/d55/d37/d62/f74 x:0 0 0 2024-02-28T23:07:13.567 INFO:tasks.workunit.client.0.smithi159.stdout:8/391: fdatasync d2/d11/d52/d26/d36/f64 0 2024-02-28T23:07:13.567 INFO:tasks.workunit.client.0.smithi159.stdout:3/338: dwrite d0/f12 [0,4194304] 0 2024-02-28T23:07:13.568 INFO:tasks.workunit.client.0.smithi159.stdout:9/354: stat d4/d3d/d3e/d55/d37/d62/l65 0 2024-02-28T23:07:13.571 INFO:tasks.workunit.client.0.smithi159.stdout:7/266: dread d5/d10/f47 [0,4194304] 0 2024-02-28T23:07:13.574 INFO:tasks.workunit.client.0.smithi159.stdout:8/392: symlink d2/d11/d52/d6e/l88 0 2024-02-28T23:07:13.574 INFO:tasks.workunit.client.0.smithi159.stdout:5/427: mkdir d8/d19/d23/d35/d38/d8f 0 2024-02-28T23:07:13.588 INFO:tasks.workunit.client.0.smithi159.stdout:3/339: symlink d0/d2b/d4f/l60 0 2024-02-28T23:07:13.589 INFO:tasks.workunit.client.0.smithi159.stdout:5/428: mkdir d8/d19/d23/d35/d71/d90 0 2024-02-28T23:07:13.594 INFO:tasks.workunit.client.0.smithi159.stdout:9/355: getdents d4/d3d/d3e/d55 0 2024-02-28T23:07:13.596 INFO:tasks.workunit.client.0.smithi159.stdout:8/393: rename d2/d11/d52/d26/d36/l43 to d2/d11/d52/d47/d65/l89 0 2024-02-28T23:07:13.599 INFO:tasks.workunit.client.0.smithi159.stdout:0/415: dwrite d0/d5/d14/d25/f39 [0,4194304] 0 2024-02-28T23:07:13.603 INFO:tasks.workunit.client.0.smithi159.stdout:9/356: symlink d4/d3d/d3e/d55/d37/l75 0 2024-02-28T23:07:13.603 INFO:tasks.workunit.client.0.smithi159.stdout:7/267: dread d5/f12 [0,4194304] 0 2024-02-28T23:07:13.605 INFO:tasks.workunit.client.0.smithi159.stdout:6/329: dread d0/d1b/d38/d52/f69 [0,4194304] 0 2024-02-28T23:07:13.605 INFO:tasks.workunit.client.0.smithi159.stdout:9/357: fsync d4/d3d/d3e/d55/d37/f6c 0 2024-02-28T23:07:13.606 INFO:tasks.workunit.client.0.smithi159.stdout:8/394: symlink d2/d11/d35/l8a 0 2024-02-28T23:07:13.606 INFO:tasks.workunit.client.0.smithi159.stdout:7/268: chown d5/d16/d1a/d27/d29 17 1 2024-02-28T23:07:13.607 INFO:tasks.workunit.client.0.smithi159.stdout:0/416: rmdir d0/d5 39 2024-02-28T23:07:13.609 INFO:tasks.workunit.client.0.smithi159.stdout:5/429: creat d8/d19/d23/f91 x:0 0 0 2024-02-28T23:07:13.616 INFO:tasks.workunit.client.0.smithi159.stdout:6/330: mkdir d0/d6d 0 2024-02-28T23:07:13.617 INFO:tasks.workunit.client.0.smithi159.stdout:3/340: dread d0/d6/d3e/f1d [0,4194304] 0 2024-02-28T23:07:13.619 INFO:tasks.workunit.client.0.smithi159.stdout:6/331: truncate d0/fc 4066774 0 2024-02-28T23:07:13.619 INFO:tasks.workunit.client.0.smithi159.stdout:7/269: dread - d5/d16/d1a/d27/d29/d2a/f2b zero size 2024-02-28T23:07:13.624 INFO:tasks.workunit.client.0.smithi159.stdout:0/417: fdatasync d0/d5/d14/d34/f7d 0 2024-02-28T23:07:13.624 INFO:tasks.workunit.client.0.smithi159.stdout:5/430: mkdir d8/d19/d23/d35/d41/d92 0 2024-02-28T23:07:13.626 INFO:tasks.workunit.client.0.smithi159.stdout:3/341: creat d0/d6/d19/d54/f61 x:0 0 0 2024-02-28T23:07:13.631 INFO:tasks.workunit.client.0.smithi159.stdout:7/270: dread f4 [4194304,4194304] 0 2024-02-28T23:07:13.632 INFO:tasks.workunit.client.0.smithi159.stdout:9/358: dwrite d4/d3d/d3e/d55/f2a [0,4194304] 0 2024-02-28T23:07:13.634 INFO:tasks.workunit.client.0.smithi159.stdout:9/359: stat d4/f3c 0 2024-02-28T23:07:13.635 INFO:tasks.workunit.client.0.smithi159.stdout:7/271: read - d5/d16/d1a/d24/f3a zero size 2024-02-28T23:07:13.637 INFO:tasks.workunit.client.0.smithi159.stdout:0/418: mkdir d0/de/d75/d5f/d97 0 2024-02-28T23:07:13.643 INFO:tasks.workunit.client.0.smithi159.stdout:5/431: mknod d8/d19/d23/d35/d41/c93 0 2024-02-28T23:07:13.652 INFO:tasks.workunit.client.0.smithi159.stdout:8/395: truncate d2/d11/d52/d26/d36/d38/f49 1829986 0 2024-02-28T23:07:13.653 INFO:tasks.workunit.client.0.smithi159.stdout:8/396: chown d2/d3/l1e 1 1 2024-02-28T23:07:13.655 INFO:tasks.workunit.client.0.smithi159.stdout:8/397: chown d2/d11/d52/d26/d36/d38 707770 1 2024-02-28T23:07:13.656 INFO:tasks.workunit.client.0.smithi159.stdout:3/342: creat d0/d6/d34/f62 x:0 0 0 2024-02-28T23:07:13.657 INFO:tasks.workunit.client.0.smithi159.stdout:6/332: dwrite d0/fb [4194304,4194304] 0 2024-02-28T23:07:13.660 INFO:tasks.workunit.client.0.smithi159.stdout:6/333: chown d0/d1b/d38/d4d 457467880 1 2024-02-28T23:07:13.662 INFO:tasks.workunit.client.0.smithi159.stdout:6/334: read - d0/d1b/d33/f5f zero size 2024-02-28T23:07:13.665 INFO:tasks.workunit.client.0.smithi159.stdout:5/432: write d8/d59/f6b [177735,12275] 0 2024-02-28T23:07:13.668 INFO:tasks.workunit.client.0.smithi159.stdout:7/272: write d5/f12 [4895835,40829] 0 2024-02-28T23:07:13.668 INFO:tasks.workunit.client.0.smithi159.stdout:9/360: getdents d4/d3d/d3e/d55/d4c 0 2024-02-28T23:07:13.677 INFO:tasks.workunit.client.0.smithi159.stdout:7/273: stat d5/d16/d1a/d27/d29/d2a/f2b 0 2024-02-28T23:07:13.679 INFO:tasks.workunit.client.0.smithi159.stdout:9/361: rmdir d4/d3d 39 2024-02-28T23:07:13.683 INFO:tasks.workunit.client.0.smithi159.stdout:5/433: dread d8/d19/f68 [0,4194304] 0 2024-02-28T23:07:13.686 INFO:tasks.workunit.client.0.smithi159.stdout:6/335: creat d0/d6d/f6e x:0 0 0 2024-02-28T23:07:13.687 INFO:tasks.workunit.client.0.smithi159.stdout:0/419: dread d0/d5/d14/d34/d3d/f92 [0,4194304] 0 2024-02-28T23:07:13.689 INFO:tasks.workunit.client.0.smithi159.stdout:8/398: dwrite d2/d11/d52/d26/d36/f55 [0,4194304] 0 2024-02-28T23:07:13.689 INFO:tasks.workunit.client.0.smithi159.stdout:3/343: dwrite d0/d6/d3e/f5b [0,4194304] 0 2024-02-28T23:07:13.692 INFO:tasks.workunit.client.0.smithi159.stdout:7/274: dread d5/f9 [0,4194304] 0 2024-02-28T23:07:13.695 INFO:tasks.workunit.client.0.smithi159.stdout:0/420: fdatasync d0/de/f2b 0 2024-02-28T23:07:13.706 INFO:tasks.workunit.client.0.smithi159.stdout:9/362: mkdir d4/d76 0 2024-02-28T23:07:13.706 INFO:tasks.workunit.client.0.smithi159.stdout:5/434: creat d8/d19/d23/d35/d71/d90/f94 x:0 0 0 2024-02-28T23:07:13.712 INFO:tasks.workunit.client.0.smithi159.stdout:7/275: mkdir d5/d16/d1a/d27/d55 0 2024-02-28T23:07:13.714 INFO:tasks.workunit.client.0.smithi159.stdout:0/421: dread - d0/d5/d38/f90 zero size 2024-02-28T23:07:13.719 INFO:tasks.workunit.client.0.smithi159.stdout:9/363: write d4/d3d/d3e/f72 [939940,125096] 0 2024-02-28T23:07:13.719 INFO:tasks.workunit.client.0.smithi159.stdout:8/399: write d2/d3/f13 [8766130,8149] 0 2024-02-28T23:07:13.722 INFO:tasks.workunit.client.0.smithi159.stdout:5/435: mknod d8/d19/d23/d35/d41/c95 0 2024-02-28T23:07:13.724 INFO:tasks.workunit.client.0.smithi159.stdout:5/436: chown d8/d19/f68 2044 1 2024-02-28T23:07:13.731 INFO:tasks.workunit.client.0.smithi159.stdout:9/364: rename d4/d3d/d3e/d71 to d4/d3d/d3e/d55/d37/d62/d77 0 2024-02-28T23:07:13.733 INFO:tasks.workunit.client.0.smithi159.stdout:6/336: getdents d0/d1b/d33/d11/d14/d49 0 2024-02-28T23:07:13.742 INFO:tasks.workunit.client.0.smithi159.stdout:5/437: dwrite d8/d19/d23/d2a/f4b [0,4194304] 0 2024-02-28T23:07:13.746 INFO:tasks.workunit.client.0.smithi159.stdout:6/337: dread d0/fb [4194304,4194304] 0 2024-02-28T23:07:13.749 INFO:tasks.workunit.client.0.smithi159.stdout:9/365: dwrite d4/d3d/d3e/d55/f46 [4194304,4194304] 0 2024-02-28T23:07:13.761 INFO:tasks.workunit.client.0.smithi159.stdout:6/338: rename d0/f2a to d0/d1b/d33/d11/d14/d5d/f6f 0 2024-02-28T23:07:13.764 INFO:tasks.workunit.client.0.smithi159.stdout:0/422: write d0/d5/d14/d34/d3d/f83 [1564945,32172] 0 2024-02-28T23:07:13.765 INFO:tasks.workunit.client.0.smithi159.stdout:7/276: dwrite d5/fb [0,4194304] 0 2024-02-28T23:07:13.768 INFO:tasks.workunit.client.0.smithi159.stdout:0/423: write d0/d5/d14/d25/d2c/f7f [741014,130708] 0 2024-02-28T23:07:13.769 INFO:tasks.workunit.client.0.smithi159.stdout:8/400: truncate d2/d3/f3c 3560133 0 2024-02-28T23:07:13.770 INFO:tasks.workunit.client.0.smithi159.stdout:0/424: chown d0/d5/f3f 986404 1 2024-02-28T23:07:13.772 INFO:tasks.workunit.client.0.smithi159.stdout:0/425: write d0/f6 [1906615,110699] 0 2024-02-28T23:07:13.776 INFO:tasks.workunit.client.0.smithi159.stdout:0/426: chown d0/de/d75 20579 1 2024-02-28T23:07:13.788 INFO:tasks.workunit.client.0.smithi159.stdout:0/427: symlink d0/d5/d14/d34/d6c/l98 0 2024-02-28T23:07:13.792 INFO:tasks.workunit.client.0.smithi159.stdout:8/401: mknod d2/d73/c8b 0 2024-02-28T23:07:13.794 INFO:tasks.workunit.client.0.smithi159.stdout:8/402: write d2/d3/f46 [3809707,54407] 0 2024-02-28T23:07:13.797 INFO:tasks.workunit.client.0.smithi159.stdout:7/277: rename d5/d16/d1a/d27/d29 to d5/d56 0 2024-02-28T23:07:13.801 INFO:tasks.workunit.client.0.smithi159.stdout:7/278: truncate d5/d16/d1a/d27/f31 1769103 0 2024-02-28T23:07:13.803 INFO:tasks.workunit.client.0.smithi159.stdout:9/366: truncate d4/d3d/d3e/d55/f2a 1083393 0 2024-02-28T23:07:13.806 INFO:tasks.workunit.client.0.smithi159.stdout:9/367: chown d4/l1f 186340 1 2024-02-28T23:07:13.808 INFO:tasks.workunit.client.0.smithi159.stdout:7/279: chown d5/d56/d2a/f45 171774250 1 2024-02-28T23:07:13.808 INFO:tasks.workunit.client.0.smithi159.stdout:8/403: mkdir d2/d3/d8c 0 2024-02-28T23:07:13.808 INFO:tasks.workunit.client.0.smithi159.stdout:9/368: fsync d4/f5f 0 2024-02-28T23:07:13.810 INFO:tasks.workunit.client.0.smithi159.stdout:8/404: chown d2/d11/d35 49087 1 2024-02-28T23:07:13.811 INFO:tasks.workunit.client.0.smithi159.stdout:9/369: stat d4/c10 0 2024-02-28T23:07:13.811 INFO:tasks.workunit.client.0.smithi159.stdout:6/339: dread d0/d1b/d33/d11/f19 [0,4194304] 0 2024-02-28T23:07:13.816 INFO:tasks.workunit.client.0.smithi159.stdout:9/370: stat d4/d3d/d3e/d55/d37/f54 0 2024-02-28T23:07:13.822 INFO:tasks.workunit.client.0.smithi159.stdout:8/405: dread d2/d3/f2a [0,4194304] 0 2024-02-28T23:07:13.824 INFO:tasks.workunit.client.0.smithi159.stdout:0/428: dread d0/d5/f33 [0,4194304] 0 2024-02-28T23:07:13.833 INFO:tasks.workunit.client.0.smithi159.stdout:7/280: rmdir d5/d16/d1a/d27/d55 0 2024-02-28T23:07:13.833 INFO:tasks.workunit.client.0.smithi159.stdout:7/281: stat d5/d56/d2a 0 2024-02-28T23:07:13.835 INFO:tasks.workunit.client.0.smithi159.stdout:9/371: dwrite d4/d3d/d3e/d55/f1e [0,4194304] 0 2024-02-28T23:07:13.836 INFO:tasks.workunit.client.0.smithi159.stdout:8/406: unlink d2/d11/d35/f3f 0 2024-02-28T23:07:13.841 INFO:tasks.workunit.client.0.smithi159.stdout:6/340: link d0/d1b/d33/f3d d0/d1b/d33/d11/d34/f70 0 2024-02-28T23:07:13.848 INFO:tasks.workunit.client.0.smithi159.stdout:7/282: creat d5/d16/d1a/d27/f57 x:0 0 0 2024-02-28T23:07:13.852 INFO:tasks.workunit.client.0.smithi159.stdout:0/429: dwrite d0/d5/f33 [0,4194304] 0 2024-02-28T23:07:13.855 INFO:tasks.workunit.client.0.smithi159.stdout:6/341: symlink d0/d1b/d38/d4e/l71 0 2024-02-28T23:07:13.857 INFO:tasks.workunit.client.0.smithi159.stdout:7/283: rename d5/d56/d2a/f2b to d5/d56/d50/f58 0 2024-02-28T23:07:13.858 INFO:tasks.workunit.client.0.smithi159.stdout:7/284: dread - d5/d56/f2f zero size 2024-02-28T23:07:13.860 INFO:tasks.workunit.client.0.smithi159.stdout:8/407: creat d2/d11/d52/d47/d65/d68/f8d x:0 0 0 2024-02-28T23:07:13.860 INFO:tasks.workunit.client.0.smithi159.stdout:7/285: dread - d5/d16/f49 zero size 2024-02-28T23:07:13.861 INFO:tasks.workunit.client.0.smithi159.stdout:9/372: mknod d4/d3d/d3e/d6e/c78 0 2024-02-28T23:07:13.861 INFO:tasks.workunit.client.0.smithi159.stdout:0/430: rmdir d0/d5 39 2024-02-28T23:07:13.864 INFO:tasks.workunit.client.0.smithi159.stdout:7/286: chown d5/d56/f33 633 1 2024-02-28T23:07:13.864 INFO:tasks.workunit.client.0.smithi159.stdout:0/431: readlink d0/de/d75/l51 0 2024-02-28T23:07:13.864 INFO:tasks.workunit.client.0.smithi159.stdout:6/342: mkdir d0/d1b/d38/d4e/d72 0 2024-02-28T23:07:13.864 INFO:tasks.workunit.client.0.smithi159.stdout:8/408: write d2/d11/d58/f59 [637448,125880] 0 2024-02-28T23:07:13.865 INFO:tasks.workunit.client.0.smithi159.stdout:6/343: truncate d0/d6d/f6e 129419 0 2024-02-28T23:07:13.865 INFO:tasks.workunit.client.0.smithi159.stdout:9/373: creat d4/d3d/d3e/d55/d37/f79 x:0 0 0 2024-02-28T23:07:13.869 INFO:tasks.workunit.client.0.smithi159.stdout:0/432: mknod d0/de/d46/c99 0 2024-02-28T23:07:13.878 INFO:tasks.workunit.client.0.smithi159.stdout:0/433: creat d0/d5/d38/f9a x:0 0 0 2024-02-28T23:07:13.884 INFO:tasks.workunit.client.0.smithi159.stdout:8/409: dwrite d2/d11/d52/d47/d65/d68/f8d [0,4194304] 0 2024-02-28T23:07:13.891 INFO:tasks.workunit.client.0.smithi159.stdout:8/410: mknod d2/d11/d52/d26/d36/c8e 0 2024-02-28T23:07:13.892 INFO:tasks.workunit.client.0.smithi159.stdout:6/344: dread d0/fc [0,4194304] 0 2024-02-28T23:07:13.897 INFO:tasks.workunit.client.0.smithi159.stdout:6/345: write d0/f9 [1815276,34093] 0 2024-02-28T23:07:13.899 INFO:tasks.workunit.client.0.smithi159.stdout:6/346: stat d0/f2b 0 2024-02-28T23:07:13.902 INFO:tasks.workunit.client.0.smithi159.stdout:8/411: dread d2/f5c [0,4194304] 0 2024-02-28T23:07:13.907 INFO:tasks.workunit.client.0.smithi159.stdout:7/287: dread f4 [0,4194304] 0 2024-02-28T23:07:13.910 INFO:tasks.workunit.client.0.smithi159.stdout:0/434: dread d0/de/f4a [0,4194304] 0 2024-02-28T23:07:13.912 INFO:tasks.workunit.client.0.smithi159.stdout:7/288: creat d5/d16/d1a/d24/f59 x:0 0 0 2024-02-28T23:07:13.913 INFO:tasks.workunit.client.0.smithi159.stdout:8/412: fdatasync d2/d11/d52/d26/d36/d38/f49 0 2024-02-28T23:07:13.914 INFO:tasks.workunit.client.0.smithi159.stdout:0/435: rename d0/f71 to d0/d5/d14/d34/d6c/f9b 0 2024-02-28T23:07:13.926 INFO:tasks.workunit.client.0.smithi159.stdout:7/289: getdents d5/d16/d1a/d27/d3e 0 2024-02-28T23:07:13.940 INFO:tasks.workunit.client.0.smithi159.stdout:6/347: write d0/d1b/d33/d11/d34/f70 [2695021,91090] 0 2024-02-28T23:07:13.943 INFO:tasks.workunit.client.0.smithi159.stdout:6/348: dread d0/d6d/f6e [0,4194304] 0 2024-02-28T23:07:13.946 INFO:tasks.workunit.client.0.smithi159.stdout:0/436: dread d0/d5/f53 [0,4194304] 0 2024-02-28T23:07:13.947 INFO:tasks.workunit.client.0.smithi159.stdout:7/290: creat d5/d56/f5a x:0 0 0 2024-02-28T23:07:13.948 INFO:tasks.workunit.client.0.smithi159.stdout:0/437: stat d0/d5/d38/d63/f7c 0 2024-02-28T23:07:13.951 INFO:tasks.workunit.client.0.smithi159.stdout:7/291: unlink f4 0 2024-02-28T23:07:13.955 INFO:tasks.workunit.client.0.smithi159.stdout:7/292: dread - d5/d16/d1a/d27/d37/f42 zero size 2024-02-28T23:07:13.957 INFO:tasks.workunit.client.0.smithi159.stdout:8/413: dwrite d2/d3/f20 [0,4194304] 0 2024-02-28T23:07:13.959 INFO:tasks.workunit.client.0.smithi159.stdout:6/349: dwrite d0/d1b/f1a [0,4194304] 0 2024-02-28T23:07:13.964 INFO:tasks.workunit.client.0.smithi159.stdout:8/414: truncate d2/d3/f14 721931 0 2024-02-28T23:07:13.966 INFO:tasks.workunit.client.0.smithi159.stdout:8/415: write d2/f75 [845157,88150] 0 2024-02-28T23:07:13.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:13 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:07:13.977 INFO:tasks.workunit.client.0.smithi159.stdout:7/293: dwrite d5/d10/f36 [4194304,4194304] 0 2024-02-28T23:07:13.985 INFO:tasks.workunit.client.0.smithi159.stdout:6/350: write d0/d1b/d33/f43 [3926570,993] 0 2024-02-28T23:07:13.990 INFO:tasks.workunit.client.0.smithi159.stdout:8/416: dwrite d2/d11/d52/d47/d65/d68/f8d [0,4194304] 0 2024-02-28T23:07:13.990 INFO:tasks.workunit.client.0.smithi159.stdout:7/294: truncate d5/d56/d50/f58 695137 0 2024-02-28T23:07:13.999 INFO:tasks.workunit.client.0.smithi159.stdout:7/295: mkdir d5/d56/d50/d5b 0 2024-02-28T23:07:14.002 INFO:tasks.workunit.client.0.smithi159.stdout:8/417: rename d2/d11/d52/d26/l41 to d2/d11/d52/d6e/l8f 0 2024-02-28T23:07:14.003 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:13 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:07:14.004 INFO:tasks.workunit.client.0.smithi159.stdout:7/296: truncate d5/fa 4095156 0 2024-02-28T23:07:14.008 INFO:tasks.workunit.client.0.smithi159.stdout:0/438: dread d0/de/d75/f21 [0,4194304] 0 2024-02-28T23:07:14.010 INFO:tasks.workunit.client.0.smithi159.stdout:7/297: symlink d5/d16/d1a/d27/d46/l5c 0 2024-02-28T23:07:14.011 INFO:tasks.workunit.client.0.smithi159.stdout:8/418: dread d2/d11/d52/d26/d36/f55 [4194304,4194304] 0 2024-02-28T23:07:14.013 INFO:tasks.workunit.client.0.smithi159.stdout:0/439: fdatasync d0/de/d75/f21 0 2024-02-28T23:07:14.014 INFO:tasks.workunit.client.0.smithi159.stdout:7/298: creat d5/d16/d40/f5d x:0 0 0 2024-02-28T23:07:14.017 INFO:tasks.workunit.client.0.smithi159.stdout:7/299: mknod d5/d56/c5e 0 2024-02-28T23:07:14.018 INFO:tasks.workunit.client.0.smithi159.stdout:0/440: dread d0/f3e [0,4194304] 0 2024-02-28T23:07:14.023 INFO:tasks.workunit.client.0.smithi159.stdout:7/300: creat d5/d16/f5f x:0 0 0 2024-02-28T23:07:14.027 INFO:tasks.workunit.client.0.smithi159.stdout:7/301: mkdir d5/d10/d60 0 2024-02-28T23:07:14.028 INFO:tasks.workunit.client.0.smithi159.stdout:8/419: dwrite d2/f75 [0,4194304] 0 2024-02-28T23:07:14.032 INFO:tasks.workunit.client.0.smithi159.stdout:7/302: write d5/d16/d1a/f3c [354749,118721] 0 2024-02-28T23:07:14.039 INFO:tasks.workunit.client.0.smithi159.stdout:7/303: truncate d5/d16/d1a/d27/f57 121287 0 2024-02-28T23:07:14.040 INFO:tasks.workunit.client.0.smithi159.stdout:0/441: dwrite d0/d5/d14/d25/f39 [4194304,4194304] 0 2024-02-28T23:07:14.041 INFO:tasks.workunit.client.0.smithi159.stdout:8/420: getdents d2/d11/d35 0 2024-02-28T23:07:14.046 INFO:tasks.workunit.client.0.smithi159.stdout:0/442: creat d0/de/f9c x:0 0 0 2024-02-28T23:07:14.047 INFO:tasks.workunit.client.0.smithi159.stdout:8/421: mknod d2/d73/c90 0 2024-02-28T23:07:14.050 INFO:tasks.workunit.client.0.smithi159.stdout:0/443: symlink d0/d5/d14/d34/d6c/l9d 0 2024-02-28T23:07:14.052 INFO:tasks.workunit.client.0.smithi159.stdout:8/422: symlink d2/d11/d74/l91 0 2024-02-28T23:07:14.053 INFO:tasks.workunit.client.0.smithi159.stdout:0/444: creat d0/d5/d14/d34/f9e x:0 0 0 2024-02-28T23:07:14.055 INFO:tasks.workunit.client.0.smithi159.stdout:8/423: dread - d2/d11/d52/d26/d36/d38/d77/d79/f7a zero size 2024-02-28T23:07:14.056 INFO:tasks.workunit.client.0.smithi159.stdout:0/445: symlink d0/d5/d14/d78/l9f 0 2024-02-28T23:07:14.059 INFO:tasks.workunit.client.0.smithi159.stdout:8/424: creat d2/d11/d35/d5f/f92 x:0 0 0 2024-02-28T23:07:14.060 INFO:tasks.workunit.client.0.smithi159.stdout:0/446: readlink d0/d5/d14/d34/d3d/l79 0 2024-02-28T23:07:14.063 INFO:tasks.workunit.client.0.smithi159.stdout:0/447: creat d0/d5/d14/d34/d6c/d94/fa0 x:0 0 0 2024-02-28T23:07:14.067 INFO:tasks.workunit.client.0.smithi159.stdout:0/448: rename d0/de/l10 to d0/d5/d38/d63/la1 0 2024-02-28T23:07:14.069 INFO:tasks.workunit.client.0.smithi159.stdout:0/449: write d0/d5/d14/d34/f3c [2007539,21810] 0 2024-02-28T23:07:14.074 INFO:tasks.workunit.client.0.smithi159.stdout:8/425: truncate d2/ff 995762 0 2024-02-28T23:07:14.077 INFO:tasks.workunit.client.0.smithi159.stdout:8/426: truncate d2/d11/d52/d26/d36/f64 67624 0 2024-02-28T23:07:14.079 INFO:tasks.workunit.client.0.smithi159.stdout:8/427: fdatasync d2/d11/d52/f62 0 2024-02-28T23:07:14.084 INFO:tasks.workunit.client.0.smithi159.stdout:0/450: dwrite d0/d5/d14/d25/d2c/f7f [0,4194304] 0 2024-02-28T23:07:14.096 INFO:tasks.workunit.client.0.smithi159.stdout:8/428: dwrite d2/d11/d52/f4d [0,4194304] 0 2024-02-28T23:07:14.101 INFO:tasks.workunit.client.0.smithi159.stdout:8/429: fdatasync d2/d11/d52/d26/f7f 0 2024-02-28T23:07:14.108 INFO:tasks.workunit.client.0.smithi159.stdout:8/430: getdents d2/d3 0 2024-02-28T23:07:14.108 INFO:tasks.workunit.client.0.smithi159.stdout:2/341: sync 2024-02-28T23:07:14.111 INFO:tasks.workunit.client.0.smithi159.stdout:2/342: chown d9/d23/d2c/d55/d13/f40 4 1 2024-02-28T23:07:14.112 INFO:tasks.workunit.client.0.smithi159.stdout:8/431: symlink d2/d11/d52/d6e/l93 0 2024-02-28T23:07:14.114 INFO:tasks.workunit.client.0.smithi159.stdout:2/343: chown d9/d23/d2c/d55/d13/f5f 973675654 1 2024-02-28T23:07:14.115 INFO:tasks.workunit.client.0.smithi159.stdout:2/344: dread - d9/f33 zero size 2024-02-28T23:07:14.118 INFO:tasks.workunit.client.0.smithi159.stdout:2/345: fdatasync d9/d23/d2c/d55/d13/d31/f45 0 2024-02-28T23:07:14.120 INFO:tasks.workunit.client.0.smithi159.stdout:2/346: fsync d9/d23/d2c/d55/d13/f40 0 2024-02-28T23:07:14.123 INFO:tasks.workunit.client.0.smithi159.stdout:2/347: symlink d9/d34/d44/l6f 0 2024-02-28T23:07:14.124 INFO:tasks.workunit.client.0.smithi159.stdout:2/348: chown d9/d23/d2c/f2d 1415054632 1 2024-02-28T23:07:14.127 INFO:tasks.workunit.client.0.smithi159.stdout:2/349: mknod d9/d36/c70 0 2024-02-28T23:07:14.127 INFO:tasks.workunit.client.0.smithi159.stdout:8/432: dwrite d2/d11/d52/d26/f5a [0,4194304] 0 2024-02-28T23:07:14.137 INFO:tasks.workunit.client.0.smithi159.stdout:8/433: dread d2/d3/f29 [0,4194304] 0 2024-02-28T23:07:14.140 INFO:tasks.workunit.client.0.smithi159.stdout:8/434: dread - d2/d11/d52/d26/d36/d38/f5d zero size 2024-02-28T23:07:14.144 INFO:tasks.workunit.client.0.smithi159.stdout:8/435: getdents d2/d11/d52/d26/d36/d38 0 2024-02-28T23:07:14.145 INFO:tasks.workunit.client.0.smithi159.stdout:8/436: dread - d2/d11/f85 zero size 2024-02-28T23:07:14.146 INFO:tasks.workunit.client.0.smithi159.stdout:8/437: dread - d2/d11/d35/d5f/f6a zero size 2024-02-28T23:07:14.148 INFO:tasks.workunit.client.0.smithi159.stdout:8/438: dread - d2/d11/d74/f7e zero size 2024-02-28T23:07:14.154 INFO:tasks.workunit.client.0.smithi159.stdout:8/439: write d2/d11/d52/d47/f51 [428624,119458] 0 2024-02-28T23:07:14.160 INFO:tasks.workunit.client.0.smithi159.stdout:8/440: write d2/d11/d52/d26/f4c [883927,87557] 0 2024-02-28T23:07:14.163 INFO:tasks.workunit.client.0.smithi159.stdout:8/441: creat d2/d11/d35/f94 x:0 0 0 2024-02-28T23:07:14.165 INFO:tasks.workunit.client.0.smithi159.stdout:8/442: unlink d2/d3/c3b 0 2024-02-28T23:07:14.172 INFO:tasks.workunit.client.0.smithi159.stdout:8/443: write d2/d11/d52/d26/d36/d38/f49 [2743617,18756] 0 2024-02-28T23:07:14.175 INFO:tasks.workunit.client.0.smithi159.stdout:8/444: creat d2/d3/d8c/f95 x:0 0 0 2024-02-28T23:07:14.177 INFO:tasks.workunit.client.0.smithi159.stdout:8/445: fsync d2/d11/d52/f54 0 2024-02-28T23:07:14.188 INFO:tasks.workunit.client.0.smithi159.stdout:8/446: dwrite d2/d3/f13 [0,4194304] 0 2024-02-28T23:07:14.192 INFO:tasks.workunit.client.0.smithi159.stdout:8/447: read d2/d11/d52/d26/d36/f23 [1061778,54447] 0 2024-02-28T23:07:14.215 INFO:tasks.workunit.client.0.smithi159.stdout:8/448: dread d2/d11/d52/d26/d36/d38/f49 [0,4194304] 0 2024-02-28T23:07:14.216 INFO:tasks.workunit.client.0.smithi159.stdout:8/449: write d2/d3/f83 [919346,19158] 0 2024-02-28T23:07:14.234 INFO:tasks.workunit.client.0.smithi159.stdout:8/450: dwrite d2/d3/f14 [0,4194304] 0 2024-02-28T23:07:14.238 INFO:tasks.workunit.client.0.smithi159.stdout:8/451: creat d2/d11/d52/d26/f96 x:0 0 0 2024-02-28T23:07:14.240 INFO:tasks.workunit.client.0.smithi159.stdout:8/452: write d2/d11/d52/d47/d65/d68/f8d [4146109,115993] 0 2024-02-28T23:07:14.243 INFO:tasks.workunit.client.0.smithi159.stdout:8/453: mknod d2/d11/d35/c97 0 2024-02-28T23:07:14.256 INFO:tasks.workunit.client.0.smithi159.stdout:8/454: dwrite d2/d11/d52/d26/d36/f55 [4194304,4194304] 0 2024-02-28T23:07:14.258 INFO:tasks.workunit.client.0.smithi159.stdout:8/455: fdatasync d2/d3/f29 0 2024-02-28T23:07:14.276 INFO:tasks.workunit.client.0.smithi159.stdout:8/456: dwrite d2/d3/f3d [0,4194304] 0 2024-02-28T23:07:14.278 INFO:tasks.workunit.client.0.smithi159.stdout:8/457: readlink d2/d3/l1c 0 2024-02-28T23:07:14.296 INFO:tasks.workunit.client.0.smithi159.stdout:8/458: write d2/d11/f12 [142045,31201] 0 2024-02-28T23:07:14.298 INFO:tasks.workunit.client.0.smithi159.stdout:8/459: fdatasync d2/d11/d74/f7e 0 2024-02-28T23:07:14.302 INFO:tasks.workunit.client.0.smithi159.stdout:1/311: sync 2024-02-28T23:07:14.305 INFO:tasks.workunit.client.0.smithi159.stdout:1/312: stat d6/d12/d33 0 2024-02-28T23:07:14.306 INFO:tasks.workunit.client.0.smithi159.stdout:8/460: dread d2/d11/d52/f32 [0,4194304] 0 2024-02-28T23:07:14.315 INFO:tasks.workunit.client.0.smithi159.stdout:8/461: dread d2/d3/f83 [0,4194304] 0 2024-02-28T23:07:14.319 INFO:tasks.workunit.client.0.smithi159.stdout:8/462: symlink d2/d11/d52/d26/d36/l98 0 2024-02-28T23:07:14.334 INFO:tasks.workunit.client.0.smithi159.stdout:1/313: dread d6/d12/f14 [0,4194304] 0 2024-02-28T23:07:14.335 INFO:tasks.workunit.client.0.smithi159.stdout:8/463: dwrite d2/d11/d52/d47/f51 [0,4194304] 0 2024-02-28T23:07:14.343 INFO:tasks.workunit.client.0.smithi159.stdout:1/314: creat d6/f62 x:0 0 0 2024-02-28T23:07:14.344 INFO:tasks.workunit.client.0.smithi159.stdout:1/315: chown l5 183424 1 2024-02-28T23:07:14.347 INFO:tasks.workunit.client.0.smithi159.stdout:1/316: mkdir d6/d1d/d1f/d3e/d63 0 2024-02-28T23:07:14.348 INFO:tasks.workunit.client.0.smithi159.stdout:1/317: chown d6 0 1 2024-02-28T23:07:14.350 INFO:tasks.workunit.client.0.smithi159.stdout:1/318: creat d6/d12/d16/f64 x:0 0 0 2024-02-28T23:07:14.352 INFO:tasks.workunit.client.0.smithi159.stdout:1/319: mknod d6/d12/d4e/c65 0 2024-02-28T23:07:14.357 INFO:tasks.workunit.client.0.smithi159.stdout:1/320: link d6/d12/d16/f42 d6/d1d/d1f/d3e/d63/f66 0 2024-02-28T23:07:14.360 INFO:tasks.workunit.client.0.smithi159.stdout:1/321: write d6/d12/d1a/f38 [404478,40264] 0 2024-02-28T23:07:14.361 INFO:tasks.workunit.client.0.smithi159.stdout:8/464: getdents d2/d11/d52/d26/d36 0 2024-02-28T23:07:14.363 INFO:tasks.workunit.client.0.smithi159.stdout:8/465: write d2/d3/f13 [1792639,99294] 0 2024-02-28T23:07:14.369 INFO:tasks.workunit.client.0.smithi159.stdout:8/466: rename d2/d11/d52/d26/d36/l2f to d2/d11/d52/d47/d65/l99 0 2024-02-28T23:07:14.373 INFO:tasks.workunit.client.0.smithi159.stdout:8/467: symlink d2/d73/l9a 0 2024-02-28T23:07:14.375 INFO:tasks.workunit.client.0.smithi159.stdout:1/322: dwrite d6/d12/d16/f28 [0,4194304] 0 2024-02-28T23:07:14.381 INFO:tasks.workunit.client.0.smithi159.stdout:8/468: rename d2/lb to d2/d11/d52/d26/d36/l9b 0 2024-02-28T23:07:14.385 INFO:tasks.workunit.client.0.smithi159.stdout:8/469: mkdir d2/d11/d35/d9c 0 2024-02-28T23:07:14.385 INFO:tasks.workunit.client.0.smithi159.stdout:8/470: chown d2 17 1 2024-02-28T23:07:14.405 INFO:tasks.workunit.client.0.smithi159.stdout:1/323: dwrite d6/d1d/d46/f5f [0,4194304] 0 2024-02-28T23:07:14.408 INFO:tasks.workunit.client.0.smithi159.stdout:1/324: mknod d6/d12/d33/d3c/c67 0 2024-02-28T23:07:14.409 INFO:tasks.workunit.client.0.smithi159.stdout:1/325: fdatasync d6/f62 0 2024-02-28T23:07:14.412 INFO:tasks.workunit.client.0.smithi159.stdout:1/326: creat d6/d1d/f68 x:0 0 0 2024-02-28T23:07:14.418 INFO:tasks.workunit.client.0.smithi159.stdout:1/327: rename d6/d12/d4e to d6/d12/d31/d69 0 2024-02-28T23:07:14.423 INFO:tasks.workunit.client.0.smithi159.stdout:4/486: sync 2024-02-28T23:07:14.423 INFO:tasks.workunit.client.0.smithi159.stdout:3/344: sync 2024-02-28T23:07:14.423 INFO:tasks.workunit.client.0.smithi159.stdout:1/328: getdents d6/d12/d33/d48 0 2024-02-28T23:07:14.426 INFO:tasks.workunit.client.0.smithi159.stdout:4/487: write d9/d20/f29 [910196,73356] 0 2024-02-28T23:07:14.428 INFO:tasks.workunit.client.0.smithi159.stdout:1/329: mkdir d6/d1d/d1f/d3e/d6a 0 2024-02-28T23:07:14.430 INFO:tasks.workunit.client.0.smithi159.stdout:3/345: mkdir d0/d6/d19/d54/d63 0 2024-02-28T23:07:14.434 INFO:tasks.workunit.client.0.smithi159.stdout:1/330: read d6/fb [173305,108879] 0 2024-02-28T23:07:14.436 INFO:tasks.workunit.client.0.smithi159.stdout:1/331: dread - d6/d12/f60 zero size 2024-02-28T23:07:14.439 INFO:tasks.workunit.client.0.smithi159.stdout:4/488: truncate d9/da/d1c/f53 2271474 0 2024-02-28T23:07:14.441 INFO:tasks.workunit.client.0.smithi159.stdout:3/346: creat d0/d3f/d59/f64 x:0 0 0 2024-02-28T23:07:14.441 INFO:tasks.workunit.client.0.smithi159.stdout:4/489: write d9/da/d1c/d23/f2f [2425532,78674] 0 2024-02-28T23:07:14.443 INFO:tasks.workunit.client.0.smithi159.stdout:4/490: read - d9/d42/d54/d9c/fa6 zero size 2024-02-28T23:07:14.447 INFO:tasks.workunit.client.0.smithi159.stdout:1/332: mknod d6/d1d/d1f/d3e/c6b 0 2024-02-28T23:07:14.448 INFO:tasks.workunit.client.0.smithi159.stdout:1/333: readlink d6/d12/d31/d69/l52 0 2024-02-28T23:07:14.448 INFO:tasks.workunit.client.0.smithi159.stdout:3/347: rename d0/f12 to d0/d2b/d4f/f65 0 2024-02-28T23:07:14.449 INFO:tasks.workunit.client.0.smithi159.stdout:3/348: chown d0/d6/d19/d54/f61 1725 1 2024-02-28T23:07:14.452 INFO:tasks.workunit.client.0.smithi159.stdout:1/334: creat d6/d12/d33/d3c/f6c x:0 0 0 2024-02-28T23:07:14.456 INFO:tasks.workunit.client.0.smithi159.stdout:3/349: creat d0/d6/d19/f66 x:0 0 0 2024-02-28T23:07:14.458 INFO:tasks.workunit.client.0.smithi159.stdout:3/350: fdatasync d0/d6/d3e/d57/f58 0 2024-02-28T23:07:14.460 INFO:tasks.workunit.client.0.smithi159.stdout:3/351: write d0/d6/f32 [380075,71291] 0 2024-02-28T23:07:14.462 INFO:tasks.workunit.client.0.smithi159.stdout:4/491: dwrite d9/da/f90 [0,4194304] 0 2024-02-28T23:07:14.464 INFO:tasks.workunit.client.0.smithi159.stdout:4/492: dread - d9/d42/d54/d9c/fa6 zero size 2024-02-28T23:07:14.466 INFO:tasks.workunit.client.0.smithi159.stdout:4/493: fdatasync d9/d20/f5e 0 2024-02-28T23:07:14.479 INFO:tasks.workunit.client.0.smithi159.stdout:1/335: dread d6/d12/d33/d3c/f4b [0,4194304] 0 2024-02-28T23:07:14.482 INFO:tasks.workunit.client.0.smithi159.stdout:4/494: dwrite d9/d20/f84 [0,4194304] 0 2024-02-28T23:07:14.485 INFO:tasks.workunit.client.0.smithi159.stdout:3/352: truncate d0/d6/d3e/f5b 2621672 0 2024-02-28T23:07:14.491 INFO:tasks.workunit.client.0.smithi159.stdout:4/495: mkdir d9/d42/d54/d55/da8 0 2024-02-28T23:07:14.491 INFO:tasks.workunit.client.0.smithi159.stdout:4/496: fsync d9/d20/f48 0 2024-02-28T23:07:14.494 INFO:tasks.workunit.client.0.smithi159.stdout:4/497: stat d9/da/d1c/d23/f94 0 2024-02-28T23:07:14.495 INFO:tasks.workunit.client.0.smithi159.stdout:1/336: dwrite d6/d12/d16/f24 [0,4194304] 0 2024-02-28T23:07:14.496 INFO:tasks.workunit.client.0.smithi159.stdout:4/498: write d9/f7f [513915,37415] 0 2024-02-28T23:07:14.503 INFO:tasks.workunit.client.0.smithi159.stdout:1/337: creat d6/d12/f6d x:0 0 0 2024-02-28T23:07:14.511 INFO:tasks.workunit.client.0.smithi159.stdout:3/353: dread d0/d6/d3e/f5b [0,4194304] 0 2024-02-28T23:07:14.521 INFO:tasks.workunit.client.0.smithi159.stdout:3/354: link d0/l18 d0/d6/d3e/d57/l67 0 2024-02-28T23:07:14.522 INFO:tasks.workunit.client.0.smithi159.stdout:1/338: dwrite d6/d12/d33/f51 [0,4194304] 0 2024-02-28T23:07:14.525 INFO:tasks.workunit.client.0.smithi159.stdout:3/355: symlink d0/d6/d34/l68 0 2024-02-28T23:07:14.525 INFO:tasks.workunit.client.0.smithi159.stdout:1/339: chown d6/d1d/d1f 5185 1 2024-02-28T23:07:14.527 INFO:tasks.workunit.client.0.smithi159.stdout:1/340: chown d6/f2c 101187 1 2024-02-28T23:07:14.532 INFO:tasks.workunit.client.0.smithi159.stdout:1/341: rmdir d6/d1d/d1f/d3e/d63 39 2024-02-28T23:07:14.535 INFO:tasks.workunit.client.0.smithi159.stdout:3/356: link d0/c14 d0/d6/d3e/c69 0 2024-02-28T23:07:14.538 INFO:tasks.workunit.client.0.smithi159.stdout:3/357: mkdir d0/d6/d19/d54/d6a 0 2024-02-28T23:07:14.546 INFO:tasks.workunit.client.0.smithi159.stdout:3/358: chown d0/d6/d3e/d57/l67 3417144 1 2024-02-28T23:07:14.547 INFO:tasks.workunit.client.0.smithi159.stdout:3/359: fsync d0/d6/d34/f62 0 2024-02-28T23:07:14.549 INFO:tasks.workunit.client.0.smithi159.stdout:1/342: dwrite d6/d12/d33/d48/f4a [0,4194304] 0 2024-02-28T23:07:14.554 INFO:tasks.workunit.client.0.smithi159.stdout:3/360: creat d0/d6/d3e/d2f/f6b x:0 0 0 2024-02-28T23:07:14.555 INFO:tasks.workunit.client.0.smithi159.stdout:1/343: write d6/d12/f1b [5990877,38695] 0 2024-02-28T23:07:14.555 INFO:tasks.workunit.client.0.smithi159.stdout:3/361: readlink d0/d3f/d59/l5c 0 2024-02-28T23:07:14.556 INFO:tasks.workunit.client.0.smithi159.stdout:1/344: chown d6/d12/d33 5 1 2024-02-28T23:07:14.559 INFO:tasks.workunit.client.0.smithi159.stdout:3/362: creat d0/d6/d3e/d57/f6c x:0 0 0 2024-02-28T23:07:14.561 INFO:tasks.workunit.client.0.smithi159.stdout:3/363: chown d0/l3b 4827084 1 2024-02-28T23:07:14.569 INFO:tasks.workunit.client.0.smithi159.stdout:3/364: rename d0/d6/d19 to d0/d6/d3e/d49/d6d 0 2024-02-28T23:07:14.570 INFO:tasks.workunit.client.0.smithi159.stdout:3/365: chown d0/d6/d3e/f4a 2124 1 2024-02-28T23:07:14.571 INFO:tasks.workunit.client.0.smithi159.stdout:1/345: dread d6/d12/d16/f28 [0,4194304] 0 2024-02-28T23:07:14.572 INFO:tasks.workunit.client.0.smithi159.stdout:3/366: rmdir d0/d3f/d59 39 2024-02-28T23:07:14.575 INFO:tasks.workunit.client.0.smithi159.stdout:3/367: chown d0/d6/d3e/d49/d6d/d54/f61 36019 1 2024-02-28T23:07:14.578 INFO:tasks.workunit.client.0.smithi159.stdout:3/368: fdatasync d0/d6/d34/f41 0 2024-02-28T23:07:14.594 INFO:tasks.workunit.client.0.smithi159.stdout:0/451: sync 2024-02-28T23:07:14.594 INFO:tasks.workunit.client.0.smithi159.stdout:7/304: sync 2024-02-28T23:07:14.594 INFO:tasks.workunit.client.0.smithi159.stdout:9/374: sync 2024-02-28T23:07:14.595 INFO:tasks.workunit.client.0.smithi159.stdout:3/369: dwrite d0/d6/d3e/d49/d6d/f3d [4194304,4194304] 0 2024-02-28T23:07:14.595 INFO:tasks.workunit.client.0.smithi159.stdout:2/350: sync 2024-02-28T23:07:14.595 INFO:tasks.workunit.client.0.smithi159.stdout:1/346: dread d6/d12/f15 [0,4194304] 0 2024-02-28T23:07:14.597 INFO:tasks.workunit.client.0.smithi159.stdout:6/351: sync 2024-02-28T23:07:14.597 INFO:tasks.workunit.client.0.smithi159.stdout:5/438: sync 2024-02-28T23:07:14.597 INFO:tasks.workunit.client.0.smithi159.stdout:2/351: write d9/f3c [402103,86631] 0 2024-02-28T23:07:14.599 INFO:tasks.workunit.client.0.smithi159.stdout:7/305: write d5/d16/d1a/d27/f57 [275042,78601] 0 2024-02-28T23:07:14.600 INFO:tasks.workunit.client.0.smithi159.stdout:9/375: fdatasync d4/f25 0 2024-02-28T23:07:14.601 INFO:tasks.workunit.client.0.smithi159.stdout:1/347: symlink d6/d12/d31/d69/l6e 0 2024-02-28T23:07:14.604 INFO:tasks.workunit.client.0.smithi159.stdout:3/370: mkdir d0/d2b/d55/d6e 0 2024-02-28T23:07:14.608 INFO:tasks.workunit.client.0.smithi159.stdout:5/439: creat d8/d19/d23/d35/d71/d90/f96 x:0 0 0 2024-02-28T23:07:14.611 INFO:tasks.workunit.client.0.smithi159.stdout:5/440: dread - d8/d19/d23/d35/d71/d90/f96 zero size 2024-02-28T23:07:14.611 INFO:tasks.workunit.client.0.smithi159.stdout:6/352: truncate d0/d6d/f6e 537898 0 2024-02-28T23:07:14.615 INFO:tasks.workunit.client.0.smithi159.stdout:9/376: symlink d4/d76/l7a 0 2024-02-28T23:07:14.618 INFO:tasks.workunit.client.0.smithi159.stdout:5/441: fsync d8/d16/f7b 0 2024-02-28T23:07:14.619 INFO:tasks.workunit.client.0.smithi159.stdout:7/306: dwrite d5/fe [0,4194304] 0 2024-02-28T23:07:14.623 INFO:tasks.workunit.client.0.smithi159.stdout:3/371: mknod d0/d2b/d55/d6e/c6f 0 2024-02-28T23:07:14.623 INFO:tasks.workunit.client.0.smithi159.stdout:1/348: creat d6/d1d/d1f/d3e/d6a/f6f x:0 0 0 2024-02-28T23:07:14.624 INFO:tasks.workunit.client.0.smithi159.stdout:3/372: chown d0/d6/d3e/l44 1147 1 2024-02-28T23:07:14.625 INFO:tasks.workunit.client.0.smithi159.stdout:2/352: link d9/d23/d2c/d55/d13/l18 d9/d36/d59/l71 0 2024-02-28T23:07:14.631 INFO:tasks.workunit.client.0.smithi159.stdout:5/442: symlink d8/d16/l97 0 2024-02-28T23:07:14.632 INFO:tasks.workunit.client.0.smithi159.stdout:7/307: creat d5/d16/d1a/d27/d46/f61 x:0 0 0 2024-02-28T23:07:14.636 INFO:tasks.workunit.client.0.smithi159.stdout:9/377: dwrite d4/fe [0,4194304] 0 2024-02-28T23:07:14.638 INFO:tasks.workunit.client.0.smithi159.stdout:7/308: chown d5/d16/d1a/d27/d3e/f3f 1374882648 1 2024-02-28T23:07:14.639 INFO:tasks.workunit.client.0.smithi159.stdout:3/373: mknod d0/d47/c70 0 2024-02-28T23:07:14.649 INFO:tasks.workunit.client.0.smithi159.stdout:9/378: fsync d4/f5 0 2024-02-28T23:07:14.651 INFO:tasks.workunit.client.0.smithi159.stdout:3/374: rename d0/d6/d3e/f22 to d0/d6/d3e/d57/f71 0 2024-02-28T23:07:14.652 INFO:tasks.workunit.client.0.smithi159.stdout:9/379: write d4/f11 [2195763,31445] 0 2024-02-28T23:07:14.655 INFO:tasks.workunit.client.0.smithi159.stdout:1/349: creat d6/d12/f70 x:0 0 0 2024-02-28T23:07:14.660 INFO:tasks.workunit.client.0.smithi159.stdout:7/309: unlink d5/fa 0 2024-02-28T23:07:14.661 INFO:tasks.workunit.client.0.smithi159.stdout:7/310: dread - d5/d10/f34 zero size 2024-02-28T23:07:14.663 INFO:tasks.workunit.client.0.smithi159.stdout:7/311: readlink d5/d56/d2a/l2c 0 2024-02-28T23:07:14.665 INFO:tasks.workunit.client.0.smithi159.stdout:9/380: mknod d4/d52/c7b 0 2024-02-28T23:07:14.666 INFO:tasks.workunit.client.0.smithi159.stdout:5/443: dwrite d8/d19/d23/d35/d41/f5d [0,4194304] 0 2024-02-28T23:07:14.668 INFO:tasks.workunit.client.0.smithi159.stdout:1/350: mknod d6/d12/d31/d69/c71 0 2024-02-28T23:07:14.669 INFO:tasks.workunit.client.0.smithi159.stdout:6/353: dread d0/d1b/f1a [4194304,4194304] 0 2024-02-28T23:07:14.672 INFO:tasks.workunit.client.0.smithi159.stdout:9/381: rename d4/d3d/d3e/d55/l68 to d4/d76/l7c 0 2024-02-28T23:07:14.674 INFO:tasks.workunit.client.0.smithi159.stdout:9/382: fsync d4/d3d/d3e/f72 0 2024-02-28T23:07:14.676 INFO:tasks.workunit.client.0.smithi159.stdout:5/444: mknod d8/d19/d23/d35/d38/d6d/c98 0 2024-02-28T23:07:14.681 INFO:tasks.workunit.client.0.smithi159.stdout:5/445: write d8/f14 [897034,38420] 0 2024-02-28T23:07:14.684 INFO:tasks.workunit.client.0.smithi159.stdout:6/354: creat d0/d1b/d33/d3f/f73 x:0 0 0 2024-02-28T23:07:14.685 INFO:tasks.workunit.client.0.smithi159.stdout:7/312: dwrite d5/d16/f1f [0,4194304] 0 2024-02-28T23:07:14.685 INFO:tasks.workunit.client.0.smithi159.stdout:1/351: mkdir d6/d12/d33/d72 0 2024-02-28T23:07:14.689 INFO:tasks.workunit.client.0.smithi159.stdout:9/383: mkdir d4/d52/d7d 0 2024-02-28T23:07:14.704 INFO:tasks.workunit.client.0.smithi159.stdout:9/384: rmdir d4/d3d/d3e/d55/d4c 39 2024-02-28T23:07:14.706 INFO:tasks.workunit.client.0.smithi159.stdout:3/375: link d0/d6/d3e/d2f/c3c d0/c72 0 2024-02-28T23:07:14.708 INFO:tasks.workunit.client.0.smithi159.stdout:9/385: dread - d4/d3d/d3e/d55/d37/d62/f69 zero size 2024-02-28T23:07:14.717 INFO:tasks.workunit.client.0.smithi159.stdout:6/355: dwrite d0/d1b/d33/d11/f19 [0,4194304] 0 2024-02-28T23:07:14.717 INFO:tasks.workunit.client.0.smithi159.stdout:4/499: sync 2024-02-28T23:07:14.717 INFO:tasks.workunit.client.0.smithi159.stdout:8/471: sync 2024-02-28T23:07:14.719 INFO:tasks.workunit.client.0.smithi159.stdout:7/313: link d5/fe d5/d16/d1a/d27/d3e/f62 0 2024-02-28T23:07:14.721 INFO:tasks.workunit.client.0.smithi159.stdout:3/376: mknod d0/d47/c73 0 2024-02-28T23:07:14.721 INFO:tasks.workunit.client.0.smithi159.stdout:1/352: dread d6/d12/d1a/f38 [0,4194304] 0 2024-02-28T23:07:14.724 INFO:tasks.workunit.client.0.smithi159.stdout:1/353: write d6/d12/f1b [5960926,45878] 0 2024-02-28T23:07:14.726 INFO:tasks.workunit.client.0.smithi159.stdout:1/354: stat d6/d12/d33/c5c 0 2024-02-28T23:07:14.726 INFO:tasks.workunit.client.0.smithi159.stdout:1/355: fdatasync d6/f2c 0 2024-02-28T23:07:14.732 INFO:tasks.workunit.client.0.smithi159.stdout:3/377: symlink d0/d2b/l74 0 2024-02-28T23:07:14.740 INFO:tasks.workunit.client.0.smithi159.stdout:7/314: chown d5/d16/d1a/d27/d46/l54 50064 1 2024-02-28T23:07:14.741 INFO:tasks.workunit.client.0.smithi159.stdout:7/315: stat d5/d16/d1a/d27/d37 0 2024-02-28T23:07:14.741 INFO:tasks.workunit.client.0.smithi159.stdout:5/446: truncate d8/f14 6693967 0 2024-02-28T23:07:14.745 INFO:tasks.workunit.client.0.smithi159.stdout:1/356: dwrite d6/d12/d31/f56 [0,4194304] 0 2024-02-28T23:07:14.749 INFO:tasks.workunit.client.0.smithi159.stdout:1/357: chown d6/d12/d31 258 1 2024-02-28T23:07:14.750 INFO:tasks.workunit.client.0.smithi159.stdout:3/378: rename d0/d6/d3e/d49 to d0/d2b/d55/d75 0 2024-02-28T23:07:14.752 INFO:tasks.workunit.client.0.smithi159.stdout:1/358: readlink d6/d12/l32 0 2024-02-28T23:07:14.754 INFO:tasks.workunit.client.0.smithi159.stdout:9/386: creat d4/d3d/f7e x:0 0 0 2024-02-28T23:07:14.755 INFO:tasks.workunit.client.0.smithi159.stdout:9/387: chown d4/l16 0 1 2024-02-28T23:07:14.760 INFO:tasks.workunit.client.0.smithi159.stdout:8/472: write d2/d11/d52/d47/f51 [4612611,76695] 0 2024-02-28T23:07:14.760 INFO:tasks.workunit.client.0.smithi159.stdout:4/500: write d9/d20/f22 [663167,75875] 0 2024-02-28T23:07:14.760 INFO:tasks.workunit.client.0.smithi159.stdout:7/316: symlink d5/d56/d50/l63 0 2024-02-28T23:07:14.761 INFO:tasks.workunit.client.0.smithi159.stdout:9/388: readlink d4/d3d/d3e/d55/l1c 0 2024-02-28T23:07:14.762 INFO:tasks.workunit.client.0.smithi159.stdout:5/447: read - d8/d19/d23/d2a/f32 zero size 2024-02-28T23:07:14.763 INFO:tasks.workunit.client.0.smithi159.stdout:9/389: stat d4/c10 0 2024-02-28T23:07:14.763 INFO:tasks.workunit.client.0.smithi159.stdout:5/448: stat d8/d19/f1f 0 2024-02-28T23:07:14.766 INFO:tasks.workunit.client.0.smithi159.stdout:9/390: write d4/d3d/d3e/f66 [553455,4789] 0 2024-02-28T23:07:14.770 INFO:tasks.workunit.client.0.smithi159.stdout:3/379: symlink d0/d6/d34/l76 0 2024-02-28T23:07:14.772 INFO:tasks.workunit.client.0.smithi159.stdout:1/359: write d6/d12/d16/f28 [2893904,63083] 0 2024-02-28T23:07:14.773 INFO:tasks.workunit.client.0.smithi159.stdout:4/501: rmdir d9/da 39 2024-02-28T23:07:14.779 INFO:tasks.workunit.client.0.smithi159.stdout:6/356: getdents d0/d1b/d33/d11/d14/d5d 0 2024-02-28T23:07:14.781 INFO:tasks.workunit.client.0.smithi159.stdout:8/473: mknod d2/d11/d52/d47/d65/c9d 0 2024-02-28T23:07:14.785 INFO:tasks.workunit.client.0.smithi159.stdout:5/449: read d8/d16/f1a [1780086,65012] 0 2024-02-28T23:07:14.785 INFO:tasks.workunit.client.0.smithi159.stdout:7/317: rmdir d5/d16/d1a/d27/d3e 39 2024-02-28T23:07:14.787 INFO:tasks.workunit.client.0.smithi159.stdout:7/318: chown d5/l7 82 1 2024-02-28T23:07:14.787 INFO:tasks.workunit.client.0.smithi159.stdout:9/391: mknod d4/d3d/d3e/d4a/c7f 0 2024-02-28T23:07:14.792 INFO:tasks.workunit.client.0.smithi159.stdout:4/502: rename d9/da/d1c/d23/d2d to d9/da/d1c/d23/d2d/da9 22 2024-02-28T23:07:14.795 INFO:tasks.workunit.client.0.smithi159.stdout:8/474: mkdir d2/d11/d52/d26/d36/d38/d77/d9e 0 2024-02-28T23:07:14.795 INFO:tasks.workunit.client.0.smithi159.stdout:4/503: chown d9/d20/d81/c99 8069677 1 2024-02-28T23:07:14.796 INFO:tasks.workunit.client.0.smithi159.stdout:4/504: dread - d9/da/f9a zero size 2024-02-28T23:07:14.800 INFO:tasks.workunit.client.0.smithi159.stdout:4/505: read d9/da/f13 [3379690,27598] 0 2024-02-28T23:07:14.802 INFO:tasks.workunit.client.0.smithi159.stdout:3/380: dread d0/d6/d3e/f1d [0,4194304] 0 2024-02-28T23:07:14.803 INFO:tasks.workunit.client.0.smithi159.stdout:4/506: fsync d9/da/f47 0 2024-02-28T23:07:14.806 INFO:tasks.workunit.client.0.smithi159.stdout:9/392: dwrite d4/d52/f57 [0,4194304] 0 2024-02-28T23:07:14.812 INFO:tasks.workunit.client.0.smithi159.stdout:0/452: sync 2024-02-28T23:07:14.813 INFO:tasks.workunit.client.0.smithi159.stdout:8/475: dwrite d2/d11/d74/f7e [0,4194304] 0 2024-02-28T23:07:14.817 INFO:tasks.workunit.client.0.smithi159.stdout:1/360: creat d6/d1d/d1f/d3e/f73 x:0 0 0 2024-02-28T23:07:14.829 INFO:tasks.workunit.client.0.smithi159.stdout:3/381: dwrite d0/d2b/d55/d75/d6d/f66 [0,4194304] 0 2024-02-28T23:07:14.838 INFO:tasks.workunit.client.0.smithi159.stdout:3/382: dread d0/d6/d3e/f5b [0,4194304] 0 2024-02-28T23:07:14.841 INFO:tasks.workunit.client.0.smithi159.stdout:8/476: creat d2/d11/d52/d26/d36/d38/d77/f9f x:0 0 0 2024-02-28T23:07:14.847 INFO:tasks.workunit.client.0.smithi159.stdout:1/361: creat d6/d1d/d1f/d3e/d63/f74 x:0 0 0 2024-02-28T23:07:14.851 INFO:tasks.workunit.client.0.smithi159.stdout:0/453: dread d0/fb [4194304,4194304] 0 2024-02-28T23:07:14.857 INFO:tasks.workunit.client.0.smithi159.stdout:1/362: mknod d6/d12/d33/c75 0 2024-02-28T23:07:14.858 INFO:tasks.workunit.client.0.smithi159.stdout:7/319: dwrite d5/d16/f1f [4194304,4194304] 0 2024-02-28T23:07:14.859 INFO:tasks.workunit.client.0.smithi159.stdout:8/477: mkdir d2/d11/d35/d9c/da0 0 2024-02-28T23:07:14.860 INFO:tasks.workunit.client.0.smithi159.stdout:5/450: dwrite d8/d19/d23/d2a/f3b [0,4194304] 0 2024-02-28T23:07:14.870 INFO:tasks.workunit.client.0.smithi159.stdout:0/454: unlink d0/f27 0 2024-02-28T23:07:14.871 INFO:tasks.workunit.client.0.smithi159.stdout:6/357: dwrite d0/f8 [0,4194304] 0 2024-02-28T23:07:14.873 INFO:tasks.workunit.client.0.smithi159.stdout:5/451: stat d8/d19/d23/d35/d38/d6d/f74 0 2024-02-28T23:07:14.874 INFO:tasks.workunit.client.0.smithi159.stdout:3/383: dwrite d0/d6/d34/f62 [0,4194304] 0 2024-02-28T23:07:14.875 INFO:tasks.workunit.client.0.smithi159.stdout:6/358: read - d0/d1b/d33/f5f zero size 2024-02-28T23:07:14.879 INFO:tasks.workunit.client.0.smithi159.stdout:0/455: write d0/d5/f50 [557733,71067] 0 2024-02-28T23:07:14.881 INFO:tasks.workunit.client.0.smithi159.stdout:1/363: mknod d6/d12/d33/d48/c76 0 2024-02-28T23:07:14.882 INFO:tasks.workunit.client.0.smithi159.stdout:7/320: mkdir d5/d16/d1a/d24/d64 0 2024-02-28T23:07:14.884 INFO:tasks.workunit.client.0.smithi159.stdout:9/393: write d4/f36 [159282,75408] 0 2024-02-28T23:07:14.884 INFO:tasks.workunit.client.0.smithi159.stdout:1/364: dread - d6/d1d/f68 zero size 2024-02-28T23:07:14.886 INFO:tasks.workunit.client.0.smithi159.stdout:8/478: write d2/d11/d52/d26/d36/d38/f49 [2105675,61494] 0 2024-02-28T23:07:14.891 INFO:tasks.workunit.client.0.smithi159.stdout:9/394: fsync d4/d3d/d3e/d55/f46 0 2024-02-28T23:07:14.894 INFO:tasks.workunit.client.0.smithi159.stdout:3/384: write d0/d2b/d4f/f65 [1299025,13962] 0 2024-02-28T23:07:14.900 INFO:tasks.workunit.client.0.smithi159.stdout:7/321: mkdir d5/d16/d1a/d27/d46/d65 0 2024-02-28T23:07:14.904 INFO:tasks.workunit.client.1.smithi184.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-02-28T23:07:14.906 INFO:tasks.workunit.client.0.smithi159.stdout:6/359: dread d0/f8 [0,4194304] 0 2024-02-28T23:07:14.918 INFO:tasks.workunit.client.0.smithi159.stdout:8/479: getdents d2/d11/d52/d47/d7c 0 2024-02-28T23:07:14.918 INFO:tasks.workunit.client.0.smithi159.stdout:0/456: write d0/d5/d14/f4f [74387,2460] 0 2024-02-28T23:07:14.919 INFO:tasks.workunit.client.1.smithi184.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T23:07:14.919 INFO:tasks.workunit.client.1.smithi184.stderr:+ make 2024-02-28T23:07:14.920 INFO:tasks.workunit.client.0.smithi159.stdout:6/360: readlink d0/d1b/d33/d11/l40 0 2024-02-28T23:07:14.924 INFO:tasks.workunit.client.0.smithi159.stdout:1/365: getdents d6/d12/d33/d48 0 2024-02-28T23:07:14.925 INFO:tasks.workunit.client.0.smithi159.stdout:5/452: dread d8/d19/d23/f4d [0,4194304] 0 2024-02-28T23:07:14.925 INFO:tasks.workunit.client.0.smithi159.stdout:9/395: dwrite d4/d52/f57 [0,4194304] 0 2024-02-28T23:07:14.935 INFO:tasks.workunit.client.0.smithi159.stdout:3/385: truncate d0/d2b/d55/d75/d6d/f66 3029919 0 2024-02-28T23:07:14.935 INFO:tasks.workunit.client.0.smithi159.stdout:6/361: write d0/d1b/f56 [807942,105791] 0 2024-02-28T23:07:14.937 INFO:tasks.workunit.client.0.smithi159.stdout:0/457: write d0/d5/ff [5335293,104925] 0 2024-02-28T23:07:14.938 INFO:tasks.workunit.client.0.smithi159.stdout:8/480: read d2/d3/f30 [4003474,60761] 0 2024-02-28T23:07:14.942 INFO:tasks.workunit.client.0.smithi159.stdout:6/362: write d0/d1b/f29 [677342,126416] 0 2024-02-28T23:07:14.943 INFO:tasks.workunit.client.0.smithi159.stdout:8/481: write d2/d3/f3d [967794,34516] 0 2024-02-28T23:07:14.946 INFO:tasks.workunit.client.0.smithi159.stdout:6/363: readlink d0/d1b/d33/l68 0 2024-02-28T23:07:14.949 INFO:tasks.workunit.client.0.smithi159.stdout:8/482: truncate d2/d11/d52/d26/f96 965994 0 2024-02-28T23:07:14.949 INFO:tasks.workunit.client.0.smithi159.stdout:1/366: creat d6/d12/d31/d69/f77 x:0 0 0 2024-02-28T23:07:14.952 INFO:tasks.workunit.client.0.smithi159.stdout:8/483: rename d2/d11/d52 to d2/d11/d52/d26/d36/d38/d77/da1 22 2024-02-28T23:07:14.954 INFO:tasks.workunit.client.0.smithi159.stdout:0/458: mknod d0/d5/d14/d78/ca2 0 2024-02-28T23:07:14.955 INFO:tasks.workunit.client.0.smithi159.stdout:6/364: readlink d0/d1b/l45 0 2024-02-28T23:07:14.957 INFO:tasks.workunit.client.0.smithi159.stdout:1/367: creat d6/d12/d1a/f78 x:0 0 0 2024-02-28T23:07:14.963 INFO:tasks.workunit.client.0.smithi159.stdout:9/396: dwrite d4/d3d/d3e/d55/d37/d62/f74 [0,4194304] 0 2024-02-28T23:07:14.971 INFO:tasks.workunit.client.0.smithi159.stdout:1/368: unlink d6/d12/d1a/f78 0 2024-02-28T23:07:14.975 INFO:tasks.workunit.client.0.smithi159.stdout:8/484: truncate d2/d3/f2a 396221 0 2024-02-28T23:07:14.981 INFO:tasks.workunit.client.0.smithi159.stdout:5/453: link d8/d19/f36 d8/d19/d23/d35/f99 0 2024-02-28T23:07:14.983 INFO:tasks.workunit.client.0.smithi159.stdout:3/386: getdents d0/d2b/d55/d75/d6d/d54 0 2024-02-28T23:07:14.984 INFO:tasks.workunit.client.0.smithi159.stdout:5/454: readlink d8/d19/d23/d35/d38/l73 0 2024-02-28T23:07:14.986 INFO:tasks.workunit.client.0.smithi159.stdout:9/397: dread d4/f3c [0,4194304] 0 2024-02-28T23:07:14.988 INFO:tasks.workunit.client.0.smithi159.stdout:1/369: creat d6/d12/d16/f79 x:0 0 0 2024-02-28T23:07:14.989 INFO:tasks.workunit.client.0.smithi159.stdout:3/387: mkdir d0/d2b/d55/d75/d6d/d54/d77 0 2024-02-28T23:07:14.992 INFO:tasks.workunit.client.0.smithi159.stdout:6/365: creat d0/d1b/d33/d11/d14/f74 x:0 0 0 2024-02-28T23:07:14.996 INFO:tasks.workunit.client.0.smithi159.stdout:9/398: chown d4/d3d/d3e/d55/d4c/d4e/f63 22 1 2024-02-28T23:07:14.996 INFO:tasks.workunit.client.0.smithi159.stdout:0/459: rename d0/de/d75/l41 to d0/d5/d14/d25/la3 0 2024-02-28T23:07:14.997 INFO:tasks.workunit.client.0.smithi159.stdout:9/399: stat d4/c21 0 2024-02-28T23:07:14.999 INFO:tasks.workunit.client.0.smithi159.stdout:9/400: readlink d4/d3d/d3e/d55/l1c 0 2024-02-28T23:07:15.000 INFO:tasks.workunit.client.0.smithi159.stdout:3/388: fsync d0/d3f/d59/f64 0 2024-02-28T23:07:15.001 INFO:tasks.workunit.client.0.smithi159.stdout:8/485: rename d2/d11/d52/d26/d36/d38/d77/d79/f7a to d2/d11/d35/d9c/fa2 0 2024-02-28T23:07:15.003 INFO:tasks.workunit.client.0.smithi159.stdout:1/370: dread d6/d1d/d46/f5f [0,4194304] 0 2024-02-28T23:07:15.004 INFO:tasks.workunit.client.0.smithi159.stdout:9/401: rmdir d4/d52 39 2024-02-28T23:07:15.006 INFO:tasks.workunit.client.0.smithi159.stdout:0/460: dread d0/d5/d14/d25/d2c/f43 [0,4194304] 0 2024-02-28T23:07:15.007 INFO:tasks.workunit.client.0.smithi159.stdout:9/402: read d4/f30 [404130,117996] 0 2024-02-28T23:07:15.009 INFO:tasks.workunit.client.0.smithi159.stdout:9/403: chown d4/d3d/d3e/d55/f1e 5165 1 2024-02-28T23:07:15.009 INFO:tasks.workunit.client.0.smithi159.stdout:8/486: mknod d2/ca3 0 2024-02-28T23:07:15.011 INFO:tasks.workunit.client.0.smithi159.stdout:8/487: fdatasync d2/d3/f46 0 2024-02-28T23:07:15.013 INFO:tasks.workunit.client.0.smithi159.stdout:1/371: rmdir d6/d12 39 2024-02-28T23:07:15.016 INFO:tasks.workunit.client.0.smithi159.stdout:0/461: truncate d0/de/d75/f21 1303962 0 2024-02-28T23:07:15.017 INFO:tasks.workunit.client.0.smithi159.stdout:9/404: truncate d4/f26 1072347 0 2024-02-28T23:07:15.019 INFO:tasks.workunit.client.0.smithi159.stdout:3/389: rmdir d0/d2b/d55/d75/d6d/d54/d77 0 2024-02-28T23:07:15.023 INFO:tasks.workunit.client.0.smithi159.stdout:0/462: creat d0/d5/d14/d34/d3d/fa4 x:0 0 0 2024-02-28T23:07:15.023 INFO:tasks.workunit.client.0.smithi159.stdout:8/488: getdents d2/d11/d52/d26/d36/d38/d77/d9e 0 2024-02-28T23:07:15.025 INFO:tasks.workunit.client.0.smithi159.stdout:3/390: write d0/f35 [1265737,30172] 0 2024-02-28T23:07:15.025 INFO:tasks.workunit.client.1.smithi184.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-02-28T23:07:15.026 INFO:tasks.workunit.client.0.smithi159.stdout:8/489: dread - d2/d11/d52/d26/d36/d38/f5d zero size 2024-02-28T23:07:15.027 INFO:tasks.workunit.client.0.smithi159.stdout:0/463: rename d0/l2 to d0/d5/d38/d76/la5 0 2024-02-28T23:07:15.028 INFO:tasks.workunit.client.0.smithi159.stdout:8/490: chown d2/d11/d52/d26/d36/l98 1242340190 1 2024-02-28T23:07:15.038 INFO:tasks.workunit.client.0.smithi159.stdout:9/405: truncate d4/d3d/d3e/d55/f29 255827 0 2024-02-28T23:07:15.040 INFO:tasks.workunit.client.0.smithi159.stdout:9/406: write d4/f39 [4335748,15167] 0 2024-02-28T23:07:15.040 INFO:tasks.workunit.client.0.smithi159.stdout:1/372: dwrite d6/d12/d31/d69/f5e [0,4194304] 0 2024-02-28T23:07:15.041 INFO:tasks.workunit.client.0.smithi159.stdout:0/464: write d0/d5/d14/d34/f74 [918434,69229] 0 2024-02-28T23:07:15.044 INFO:tasks.workunit.client.0.smithi159.stdout:9/407: dread - d4/d3d/d3e/f73 zero size 2024-02-28T23:07:15.047 INFO:tasks.workunit.client.0.smithi159.stdout:0/465: dread - d0/f42 zero size 2024-02-28T23:07:15.048 INFO:tasks.workunit.client.0.smithi159.stdout:1/373: symlink d6/d1d/d1f/d3e/d63/l7a 0 2024-02-28T23:07:15.048 INFO:tasks.workunit.client.0.smithi159.stdout:8/491: dwrite d2/fd [0,4194304] 0 2024-02-28T23:07:15.050 INFO:tasks.workunit.client.0.smithi159.stdout:0/466: dread - d0/d5/d14/d78/f87 zero size 2024-02-28T23:07:15.051 INFO:tasks.workunit.client.0.smithi159.stdout:8/492: read - d2/d11/d35/d5f/f92 zero size 2024-02-28T23:07:15.053 INFO:tasks.workunit.client.0.smithi159.stdout:8/493: chown d2/d3/d8c 9422039 1 2024-02-28T23:07:15.053 INFO:tasks.workunit.client.0.smithi159.stdout:9/408: rename d4/d3d/d3e/f66 to d4/d3d/d3e/d55/d37/d62/f80 0 2024-02-28T23:07:15.056 INFO:tasks.workunit.client.0.smithi159.stdout:9/409: chown d4/l16 4 1 2024-02-28T23:07:15.058 INFO:tasks.workunit.client.0.smithi159.stdout:8/494: write d2/d11/d52/d26/f96 [110882,79056] 0 2024-02-28T23:07:15.062 INFO:tasks.workunit.client.0.smithi159.stdout:0/467: rename d0/d5/f3a to d0/d5/d14/d78/fa6 0 2024-02-28T23:07:15.063 INFO:tasks.workunit.client.0.smithi159.stdout:9/410: creat d4/d52/d7d/f81 x:0 0 0 2024-02-28T23:07:15.064 INFO:tasks.workunit.client.0.smithi159.stdout:0/468: write d0/de/f9c [1024747,33313] 0 2024-02-28T23:07:15.066 INFO:tasks.workunit.client.0.smithi159.stdout:8/495: symlink d2/d11/d52/d26/d36/d38/d77/la4 0 2024-02-28T23:07:15.068 INFO:tasks.workunit.client.0.smithi159.stdout:9/411: mkdir d4/d3d/d3e/d55/d82 0 2024-02-28T23:07:15.069 INFO:tasks.workunit.client.0.smithi159.stdout:1/374: dwrite d6/d12/d1a/f53 [0,4194304] 0 2024-02-28T23:07:15.070 INFO:tasks.workunit.client.0.smithi159.stdout:0/469: creat d0/de/d46/fa7 x:0 0 0 2024-02-28T23:07:15.071 INFO:tasks.workunit.client.0.smithi159.stdout:1/375: dread - d6/d12/d1a/f3d zero size 2024-02-28T23:07:15.072 INFO:tasks.workunit.client.0.smithi159.stdout:2/353: sync 2024-02-28T23:07:15.074 INFO:tasks.workunit.client.0.smithi159.stdout:1/376: chown d6/d12/d31/d69/c65 3 1 2024-02-28T23:07:15.075 INFO:tasks.workunit.client.0.smithi159.stdout:0/470: chown d0/d5/d14/d34/d3d/f92 1580113 1 2024-02-28T23:07:15.080 INFO:tasks.workunit.client.0.smithi159.stdout:0/471: mkdir d0/d5/d14/d78/da8 0 2024-02-28T23:07:15.081 INFO:tasks.workunit.client.0.smithi159.stdout:1/377: truncate d6/d12/d16/f42 1477877 0 2024-02-28T23:07:15.086 INFO:tasks.workunit.client.0.smithi159.stdout:1/378: symlink d6/d12/d31/d69/l7b 0 2024-02-28T23:07:15.088 INFO:tasks.workunit.client.0.smithi159.stdout:1/379: stat d6/d12/f14 0 2024-02-28T23:07:15.088 INFO:tasks.workunit.client.0.smithi159.stdout:8/496: dwrite d2/d11/d52/d26/d36/d38/f49 [0,4194304] 0 2024-02-28T23:07:15.091 INFO:tasks.workunit.client.0.smithi159.stdout:9/412: write d4/d3d/d3e/d55/f29 [324663,26823] 0 2024-02-28T23:07:15.091 INFO:tasks.workunit.client.0.smithi159.stdout:1/380: chown d6/d1d/d46/c49 7634 1 2024-02-28T23:07:15.096 INFO:tasks.workunit.client.0.smithi159.stdout:9/413: symlink d4/d3d/d3e/d4a/l83 0 2024-02-28T23:07:15.098 INFO:tasks.workunit.client.0.smithi159.stdout:8/497: creat d2/d11/d52/d47/fa5 x:0 0 0 2024-02-28T23:07:15.099 INFO:tasks.workunit.client.0.smithi159.stdout:9/414: dread - d4/d52/d7d/f81 zero size 2024-02-28T23:07:15.101 INFO:tasks.workunit.client.0.smithi159.stdout:0/472: dwrite d0/d5/d38/f9a [0,4194304] 0 2024-02-28T23:07:15.105 INFO:tasks.workunit.client.0.smithi159.stdout:8/498: getdents d2/d11/d52/d26/d36/d38 0 2024-02-28T23:07:15.107 INFO:tasks.workunit.client.0.smithi159.stdout:8/499: dread - d2/d11/f85 zero size 2024-02-28T23:07:15.108 INFO:tasks.workunit.client.0.smithi159.stdout:0/473: creat d0/d5/d14/d25/fa9 x:0 0 0 2024-02-28T23:07:15.109 INFO:tasks.workunit.client.0.smithi159.stdout:1/381: dread d6/d12/f14 [0,4194304] 0 2024-02-28T23:07:15.112 INFO:tasks.workunit.client.0.smithi159.stdout:1/382: fdatasync d6/d12/d33/f51 0 2024-02-28T23:07:15.114 INFO:tasks.workunit.client.0.smithi159.stdout:8/500: rename d2/d11/d52/d26/f96 to d2/d3/fa6 0 2024-02-28T23:07:15.118 INFO:tasks.workunit.client.0.smithi159.stdout:8/501: getdents d2/d11/d35/d9c/da0 0 2024-02-28T23:07:15.122 INFO:tasks.workunit.client.0.smithi159.stdout:9/415: dwrite d4/d3d/d3e/d55/f29 [0,4194304] 0 2024-02-28T23:07:15.125 INFO:tasks.workunit.client.0.smithi159.stdout:8/502: write d2/d3/f3c [1955163,43421] 0 2024-02-28T23:07:15.126 INFO:tasks.workunit.client.0.smithi159.stdout:9/416: read d4/f3c [4056272,96857] 0 2024-02-28T23:07:15.128 INFO:tasks.workunit.client.0.smithi159.stdout:9/417: chown d4/d3d/d3e/d55/f24 9893 1 2024-02-28T23:07:15.133 INFO:tasks.workunit.client.0.smithi159.stdout:8/503: creat d2/d11/d52/d26/fa7 x:0 0 0 2024-02-28T23:07:15.135 INFO:tasks.workunit.client.0.smithi159.stdout:1/383: dwrite d6/d12/d31/d69/f5e [0,4194304] 0 2024-02-28T23:07:15.137 INFO:tasks.workunit.client.0.smithi159.stdout:9/418: rmdir d4/d3d/d3e/d55/d82 0 2024-02-28T23:07:15.138 INFO:tasks.workunit.client.0.smithi159.stdout:1/384: dread - d6/d12/d16/f79 zero size 2024-02-28T23:07:15.142 INFO:tasks.workunit.client.0.smithi159.stdout:1/385: mknod d6/c7c 0 2024-02-28T23:07:15.145 INFO:tasks.workunit.client.0.smithi159.stdout:1/386: read d6/d12/d16/f24 [4064629,77175] 0 2024-02-28T23:07:15.145 INFO:tasks.workunit.client.0.smithi159.stdout:9/419: symlink d4/d3d/d3e/d55/d4c/d4e/d6b/l84 0 2024-02-28T23:07:15.148 INFO:tasks.workunit.client.0.smithi159.stdout:9/420: write d4/d3d/d3e/d4a/f56 [76248,106590] 0 2024-02-28T23:07:15.153 INFO:tasks.workunit.client.0.smithi159.stdout:9/421: read - d4/d3d/d3e/d55/d4c/d4e/f5e zero size 2024-02-28T23:07:15.155 INFO:tasks.workunit.client.0.smithi159.stdout:0/474: dread d0/d5/d14/d34/d3d/f92 [0,4194304] 0 2024-02-28T23:07:15.156 INFO:tasks.workunit.client.0.smithi159.stdout:9/422: symlink d4/d3d/d3e/d55/d37/l85 0 2024-02-28T23:07:15.157 INFO:tasks.workunit.client.0.smithi159.stdout:8/504: dwrite d2/d11/f1b [0,4194304] 0 2024-02-28T23:07:15.160 INFO:tasks.workunit.client.0.smithi159.stdout:1/387: truncate d6/d12/f1b 2689863 0 2024-02-28T23:07:15.161 INFO:tasks.workunit.client.0.smithi159.stdout:8/505: read d2/d11/d52/d26/d36/d38/f49 [3254687,118048] 0 2024-02-28T23:07:15.162 INFO:tasks.workunit.client.0.smithi159.stdout:9/423: symlink d4/d3d/d3e/d55/d37/l86 0 2024-02-28T23:07:15.163 INFO:tasks.workunit.client.0.smithi159.stdout:1/388: dread - d6/d12/d16/f64 zero size 2024-02-28T23:07:15.163 INFO:tasks.workunit.client.0.smithi159.stdout:0/475: write d0/d5/f5e [636113,89533] 0 2024-02-28T23:07:15.164 INFO:tasks.workunit.client.0.smithi159.stdout:9/424: stat d4/d3d/d3e/d55/d37/l85 0 2024-02-28T23:07:15.170 INFO:tasks.workunit.client.0.smithi159.stdout:1/389: rename d6/d1d/d1f/d3e/d63/l7a to d6/d12/d33/l7d 0 2024-02-28T23:07:15.172 INFO:tasks.workunit.client.0.smithi159.stdout:9/425: mknod d4/d3d/d3e/d6e/c87 0 2024-02-28T23:07:15.173 INFO:tasks.workunit.client.0.smithi159.stdout:0/476: symlink d0/d5/d14/d78/laa 0 2024-02-28T23:07:15.174 INFO:tasks.workunit.client.0.smithi159.stdout:1/390: symlink d6/d12/d33/l7e 0 2024-02-28T23:07:15.175 INFO:tasks.workunit.client.0.smithi159.stdout:8/506: dread d2/d11/d52/d26/f4c [0,4194304] 0 2024-02-28T23:07:15.176 INFO:tasks.workunit.client.0.smithi159.stdout:9/426: chown d4/d3d/d3e/d55/d4c/d4e/d6b/l84 49877 1 2024-02-28T23:07:15.177 INFO:tasks.workunit.client.0.smithi159.stdout:0/477: rmdir d0/d5/d14/d25/d5c 39 2024-02-28T23:07:15.177 INFO:tasks.workunit.client.0.smithi159.stdout:8/507: chown d2/d3/d8c 23367553 1 2024-02-28T23:07:15.179 INFO:tasks.workunit.client.0.smithi159.stdout:8/508: chown d2/d73/c90 535109364 1 2024-02-28T23:07:15.180 INFO:tasks.workunit.client.0.smithi159.stdout:9/427: getdents d4/d52 0 2024-02-28T23:07:15.181 INFO:tasks.workunit.client.0.smithi159.stdout:8/509: symlink d2/d11/d52/la8 0 2024-02-28T23:07:15.183 INFO:tasks.workunit.client.0.smithi159.stdout:8/510: chown d2/d11/d52/d26/d36/l37 12437 1 2024-02-28T23:07:15.185 INFO:tasks.workunit.client.0.smithi159.stdout:8/511: mkdir d2/d11/d52/d6e/da9 0 2024-02-28T23:07:15.186 INFO:tasks.workunit.client.0.smithi159.stdout:8/512: rename d2 to d2/d11/d74/daa 22 2024-02-28T23:07:15.187 INFO:tasks.workunit.client.0.smithi159.stdout:9/428: link d4/d3d/d3e/d55/d4c/d4e/d6b/l84 d4/d3d/d3e/d55/d4c/l88 0 2024-02-28T23:07:15.190 INFO:tasks.workunit.client.0.smithi159.stdout:1/391: truncate d6/d12/d33/f3a 189749 0 2024-02-28T23:07:15.192 INFO:tasks.workunit.client.0.smithi159.stdout:0/478: dwrite d0/de/f2b [0,4194304] 0 2024-02-28T23:07:15.195 INFO:tasks.workunit.client.0.smithi159.stdout:9/429: creat d4/d3d/d3e/d55/d37/d62/d6a/f89 x:0 0 0 2024-02-28T23:07:15.196 INFO:tasks.workunit.client.0.smithi159.stdout:8/513: getdents d2/d11/d52/d26/d36/d38/d77/d9e 0 2024-02-28T23:07:15.197 INFO:tasks.workunit.client.0.smithi159.stdout:0/479: mkdir d0/d5/d14/d25/d2c/dab 0 2024-02-28T23:07:15.200 INFO:tasks.workunit.client.0.smithi159.stdout:9/430: symlink d4/d52/l8a 0 2024-02-28T23:07:15.201 INFO:tasks.workunit.client.0.smithi159.stdout:8/514: mknod d2/d11/d52/d6e/cab 0 2024-02-28T23:07:15.202 INFO:tasks.workunit.client.0.smithi159.stdout:8/515: read d2/fd [2241601,114610] 0 2024-02-28T23:07:15.205 INFO:tasks.workunit.client.0.smithi159.stdout:1/392: dread d6/d12/d31/f56 [0,4194304] 0 2024-02-28T23:07:15.206 INFO:tasks.workunit.client.0.smithi159.stdout:9/431: symlink d4/d3d/d3e/d55/d4c/d4e/d6b/l8b 0 2024-02-28T23:07:15.207 INFO:tasks.workunit.client.0.smithi159.stdout:1/393: chown d6/d12/d16/f79 12170 1 2024-02-28T23:07:15.209 INFO:tasks.workunit.client.0.smithi159.stdout:9/432: symlink d4/d52/l8c 0 2024-02-28T23:07:15.211 INFO:tasks.workunit.client.0.smithi159.stdout:0/480: dread d0/d5/d14/d34/d3d/f92 [0,4194304] 0 2024-02-28T23:07:15.212 INFO:tasks.workunit.client.0.smithi159.stdout:1/394: unlink d6/d12/d16/l57 0 2024-02-28T23:07:15.212 INFO:tasks.workunit.client.0.smithi159.stdout:9/433: creat d4/d52/d7d/f8d x:0 0 0 2024-02-28T23:07:15.213 INFO:tasks.workunit.client.0.smithi159.stdout:0/481: chown d0/d5/d14/f4f 3844175 1 2024-02-28T23:07:15.214 INFO:tasks.workunit.client.0.smithi159.stdout:9/434: chown d4/d3d/d3e/d55/f1e 60 1 2024-02-28T23:07:15.215 INFO:tasks.workunit.client.0.smithi159.stdout:1/395: rename d6/d1d/d1f/c37 to d6/d1d/c7f 0 2024-02-28T23:07:15.215 INFO:tasks.workunit.client.0.smithi159.stdout:9/435: chown d4/l48 11458 1 2024-02-28T23:07:15.217 INFO:tasks.workunit.client.0.smithi159.stdout:1/396: mknod d6/d12/d33/d72/c80 0 2024-02-28T23:07:15.220 INFO:tasks.workunit.client.0.smithi159.stdout:1/397: creat d6/d1d/d1f/f81 x:0 0 0 2024-02-28T23:07:15.223 INFO:tasks.workunit.client.0.smithi159.stdout:1/398: write d6/d1d/d1f/d3e/d6a/f6f [1021700,55816] 0 2024-02-28T23:07:15.224 INFO:tasks.workunit.client.0.smithi159.stdout:8/516: truncate d2/d11/d52/d26/d36/f55 8049871 0 2024-02-28T23:07:15.227 INFO:tasks.workunit.client.0.smithi159.stdout:1/399: write d6/d12/d31/d69/f77 [182402,4336] 0 2024-02-28T23:07:15.231 INFO:tasks.workunit.client.0.smithi159.stdout:8/517: creat d2/d11/d52/d47/d7c/fac x:0 0 0 2024-02-28T23:07:15.232 INFO:tasks.workunit.client.0.smithi159.stdout:1/400: creat d6/d1d/d46/f82 x:0 0 0 2024-02-28T23:07:15.235 INFO:tasks.workunit.client.0.smithi159.stdout:9/436: dwrite d4/f5f [0,4194304] 0 2024-02-28T23:07:15.239 INFO:tasks.workunit.client.0.smithi159.stdout:1/401: dread - d6/d12/d1a/f3d zero size 2024-02-28T23:07:15.240 INFO:tasks.workunit.client.0.smithi159.stdout:8/518: read d2/d11/d52/d26/f31 [392377,80717] 0 2024-02-28T23:07:15.244 INFO:tasks.workunit.client.0.smithi159.stdout:0/482: dwrite d0/de/f3b [0,4194304] 0 2024-02-28T23:07:15.245 INFO:tasks.workunit.client.0.smithi159.stdout:9/437: link d4/d52/f57 d4/d52/d7d/f8e 0 2024-02-28T23:07:15.246 INFO:tasks.workunit.client.0.smithi159.stdout:9/438: readlink d4/l2f 0 2024-02-28T23:07:15.247 INFO:tasks.workunit.client.0.smithi159.stdout:1/402: truncate d6/d1d/d1f/d3e/d6a/f6f 2039203 0 2024-02-28T23:07:15.253 INFO:tasks.workunit.client.0.smithi159.stdout:0/483: mknod d0/d5/d14/d34/d6c/d94/cac 0 2024-02-28T23:07:15.254 INFO:tasks.workunit.client.0.smithi159.stdout:1/403: symlink d6/d12/d31/d69/l83 0 2024-02-28T23:07:15.256 INFO:tasks.workunit.client.0.smithi159.stdout:9/439: write d4/d52/f57 [4085502,45218] 0 2024-02-28T23:07:15.257 INFO:tasks.workunit.client.0.smithi159.stdout:1/404: chown d6/d12/d16 162917 1 2024-02-28T23:07:15.258 INFO:tasks.workunit.client.0.smithi159.stdout:0/484: mkdir d0/d5/d38/d63/dad 0 2024-02-28T23:07:15.260 INFO:tasks.workunit.client.0.smithi159.stdout:1/405: write d6/d12/f6d [492534,99501] 0 2024-02-28T23:07:15.261 INFO:tasks.workunit.client.0.smithi159.stdout:9/440: mkdir d4/d3d/d3e/d55/d37/d62/d8f 0 2024-02-28T23:07:15.265 INFO:tasks.workunit.client.0.smithi159.stdout:0/485: symlink d0/de/d75/lae 0 2024-02-28T23:07:15.266 INFO:tasks.workunit.client.0.smithi159.stdout:8/519: dwrite d2/d11/d52/d47/fa5 [0,4194304] 0 2024-02-28T23:07:15.269 INFO:tasks.workunit.client.0.smithi159.stdout:8/520: rename d2 to d2/d11/d52/dad 22 2024-02-28T23:07:15.276 INFO:tasks.workunit.client.0.smithi159.stdout:9/441: getdents d4/d3d/d3e/d55/d37 0 2024-02-28T23:07:15.276 INFO:tasks.workunit.client.0.smithi159.stdout:1/406: truncate d6/d12/d1a/f23 4262728 0 2024-02-28T23:07:15.279 INFO:tasks.workunit.client.0.smithi159.stdout:1/407: readlink d6/d12/d31/d69/l52 0 2024-02-28T23:07:15.286 INFO:tasks.workunit.client.0.smithi159.stdout:9/442: rename d4/d52/d7d/f8e to d4/d3d/d3e/d55/d37/d62/f90 0 2024-02-28T23:07:15.286 INFO:tasks.workunit.client.0.smithi159.stdout:0/486: dwrite d0/d5/f3f [0,4194304] 0 2024-02-28T23:07:15.290 INFO:tasks.workunit.client.0.smithi159.stdout:0/487: readlink d0/d5/d38/d76/la5 0 2024-02-28T23:07:15.292 INFO:tasks.workunit.client.0.smithi159.stdout:1/408: mknod d6/d12/d33/d48/c84 0 2024-02-28T23:07:15.293 INFO:tasks.workunit.client.0.smithi159.stdout:9/443: fsync d4/d3d/d3e/d55/f2a 0 2024-02-28T23:07:15.293 INFO:tasks.workunit.client.0.smithi159.stdout:8/521: dwrite d2/d11/d52/d26/d36/d38/f5d [0,4194304] 0 2024-02-28T23:07:15.299 INFO:tasks.workunit.client.0.smithi159.stdout:1/409: mknod d6/d1d/d1f/c85 0 2024-02-28T23:07:15.303 INFO:tasks.workunit.client.0.smithi159.stdout:1/410: symlink d6/d1d/d1f/d3e/d6a/l86 0 2024-02-28T23:07:15.306 INFO:tasks.workunit.client.0.smithi159.stdout:1/411: rmdir d6/d12/d33/d72 39 2024-02-28T23:07:15.310 INFO:tasks.workunit.client.0.smithi159.stdout:1/412: truncate d6/d12/d33/d3c/f6c 101534 0 2024-02-28T23:07:15.312 INFO:tasks.workunit.client.0.smithi159.stdout:8/522: dread d2/d3/f2a [0,4194304] 0 2024-02-28T23:07:15.313 INFO:tasks.workunit.client.0.smithi159.stdout:9/444: dwrite d4/d3d/d3e/d55/d37/d62/f90 [0,4194304] 0 2024-02-28T23:07:15.314 INFO:tasks.workunit.client.0.smithi159.stdout:1/413: read d6/d12/d16/f24 [1560478,74305] 0 2024-02-28T23:07:15.315 INFO:tasks.workunit.client.0.smithi159.stdout:0/488: write d0/d5/d38/f90 [693748,18815] 0 2024-02-28T23:07:15.315 INFO:tasks.workunit.client.0.smithi159.stdout:1/414: read - d6/d1d/d1f/f81 zero size 2024-02-28T23:07:15.315 INFO:tasks.workunit.client.0.smithi159.stdout:8/523: write d2/d11/d52/d47/f51 [3202999,39323] 0 2024-02-28T23:07:15.317 INFO:tasks.workunit.client.0.smithi159.stdout:9/445: mkdir d4/d3d/d3e/d91 0 2024-02-28T23:07:15.319 INFO:tasks.workunit.client.0.smithi159.stdout:9/446: fdatasync d4/d3d/d3e/d4a/f56 0 2024-02-28T23:07:15.320 INFO:tasks.workunit.client.0.smithi159.stdout:9/447: stat d4/d3d/d3e/d55/c3f 0 2024-02-28T23:07:15.322 INFO:tasks.workunit.client.0.smithi159.stdout:0/489: mkdir d0/d5/d14/d34/d6c/daf 0 2024-02-28T23:07:15.323 INFO:tasks.workunit.client.0.smithi159.stdout:1/415: rmdir d6/d1d/d1f 39 2024-02-28T23:07:15.324 INFO:tasks.workunit.client.0.smithi159.stdout:0/490: write d0/de/d46/fa7 [1006805,118563] 0 2024-02-28T23:07:15.327 INFO:tasks.workunit.client.0.smithi159.stdout:9/448: truncate d4/d3d/d3e/d55/f24 3281144 0 2024-02-28T23:07:15.328 INFO:tasks.workunit.client.0.smithi159.stdout:0/491: truncate d0/de/f68 1309244 0 2024-02-28T23:07:15.328 INFO:tasks.workunit.client.0.smithi159.stdout:8/524: getdents d2/d11/d52/d26/d36/d38/d77/d79 0 2024-02-28T23:07:15.329 INFO:tasks.workunit.client.0.smithi159.stdout:0/492: fsync d0/d5/d14/d25/f84 0 2024-02-28T23:07:15.331 INFO:tasks.workunit.client.0.smithi159.stdout:0/493: rmdir d0/d5 39 2024-02-28T23:07:15.331 INFO:tasks.workunit.client.0.smithi159.stdout:8/525: read d2/d11/d52/d26/d36/d38/f39 [8353587,18180] 0 2024-02-28T23:07:15.335 INFO:tasks.workunit.client.0.smithi159.stdout:8/526: creat d2/d11/d52/d47/d7c/fae x:0 0 0 2024-02-28T23:07:15.336 INFO:tasks.workunit.client.0.smithi159.stdout:0/494: truncate d0/d5/d14/d34/d3d/fa4 374078 0 2024-02-28T23:07:15.337 INFO:tasks.workunit.client.0.smithi159.stdout:8/527: write d2/d11/d52/d47/f51 [938666,77648] 0 2024-02-28T23:07:15.338 INFO:tasks.workunit.client.0.smithi159.stdout:0/495: symlink d0/d5/d38/d76/lb0 0 2024-02-28T23:07:15.340 INFO:tasks.workunit.client.0.smithi159.stdout:8/528: creat d2/d73/faf x:0 0 0 2024-02-28T23:07:15.342 INFO:tasks.workunit.client.0.smithi159.stdout:8/529: chown d2/d11/d52/d6e/cab 129202981 1 2024-02-28T23:07:15.342 INFO:tasks.workunit.client.0.smithi159.stdout:0/496: creat d0/d5/d14/d78/da8/fb1 x:0 0 0 2024-02-28T23:07:15.344 INFO:tasks.workunit.client.0.smithi159.stdout:0/497: chown d0/d5/d14/d34/d3d/f82 15447309 1 2024-02-28T23:07:15.344 INFO:tasks.workunit.client.0.smithi159.stdout:8/530: write d2/d11/d52/d26/d36/d38/f5d [2738608,32710] 0 2024-02-28T23:07:15.346 INFO:tasks.workunit.client.0.smithi159.stdout:8/531: write d2/d11/d52/d6e/f87 [1660787,110239] 0 2024-02-28T23:07:15.347 INFO:tasks.workunit.client.0.smithi159.stdout:0/498: creat d0/d5/d38/d63/dad/fb2 x:0 0 0 2024-02-28T23:07:15.360 INFO:tasks.workunit.client.0.smithi159.stdout:0/499: dwrite d0/d5/d38/f91 [0,4194304] 0 2024-02-28T23:07:15.362 INFO:tasks.workunit.client.0.smithi159.stdout:0/500: stat d0/d5/d14/d25/c4e 0 2024-02-28T23:07:15.363 INFO:tasks.workunit.client.0.smithi159.stdout:0/501: fsync d0/d5/d14/d34/f74 0 2024-02-28T23:07:15.365 INFO:tasks.workunit.client.0.smithi159.stdout:0/502: write d0/d5/f7 [4814344,51711] 0 2024-02-28T23:07:15.368 INFO:tasks.workunit.client.0.smithi159.stdout:0/503: mknod d0/de/d75/d5f/cb3 0 2024-02-28T23:07:15.378 INFO:tasks.workunit.client.0.smithi159.stdout:0/504: dwrite d0/de/f9c [0,4194304] 0 2024-02-28T23:07:15.382 INFO:tasks.workunit.client.0.smithi159.stdout:0/505: creat d0/d5/d14/d25/fb4 x:0 0 0 2024-02-28T23:07:15.398 INFO:tasks.workunit.client.0.smithi159.stdout:0/506: dwrite d0/de/f4a [4194304,4194304] 0 2024-02-28T23:07:15.400 INFO:tasks.workunit.client.0.smithi159.stdout:0/507: fsync d0/d5/d14/d78/da8/fb1 0 2024-02-28T23:07:15.404 INFO:tasks.workunit.client.0.smithi159.stdout:0/508: mkdir d0/d5/d14/d25/db5 0 2024-02-28T23:07:15.405 INFO:tasks.workunit.client.0.smithi159.stdout:0/509: stat d0/de/f9c 0 2024-02-28T23:07:15.406 INFO:tasks.workunit.client.0.smithi159.stdout:0/510: stat d0/d5/c24 0 2024-02-28T23:07:15.409 INFO:tasks.workunit.client.0.smithi159.stdout:0/511: creat d0/d5/d14/d78/da8/fb6 x:0 0 0 2024-02-28T23:07:15.411 INFO:tasks.workunit.client.0.smithi159.stdout:0/512: mkdir d0/de/db7 0 2024-02-28T23:07:15.414 INFO:tasks.workunit.client.0.smithi159.stdout:0/513: mkdir d0/de/d75/db8 0 2024-02-28T23:07:15.431 INFO:tasks.workunit.client.0.smithi159.stdout:0/514: dwrite d0/d5/d14/d78/f87 [0,4194304] 0 2024-02-28T23:07:15.433 INFO:tasks.workunit.client.0.smithi159.stdout:0/515: write d0/d5/d14/d34/d6c/d94/fa0 [725387,92183] 0 2024-02-28T23:07:15.527 INFO:tasks.workunit.client.0.smithi159.stdout:9/449: dread d4/f5 [0,4194304] 0 2024-02-28T23:07:15.570 INFO:tasks.workunit.client.0.smithi159.stdout:9/450: dread d4/d3d/f5d [0,4194304] 0 2024-02-28T23:07:15.578 INFO:tasks.workunit.client.0.smithi159.stdout:9/451: getdents d4/d52 0 2024-02-28T23:07:15.585 INFO:tasks.workunit.client.0.smithi159.stdout:9/452: truncate d4/f5 921143 0 2024-02-28T23:07:15.589 INFO:tasks.workunit.client.0.smithi159.stdout:9/453: readlink d4/d3d/d3e/d55/d37/l58 0 2024-02-28T23:07:15.600 INFO:tasks.workunit.client.0.smithi159.stdout:9/454: rename d4/d3d/d3e/d55/d4c/d4e/f5c to d4/d3d/d3e/d55/d4c/f92 0 2024-02-28T23:07:15.603 INFO:tasks.workunit.client.0.smithi159.stdout:9/455: write d4/d3d/f7e [560856,66080] 0 2024-02-28T23:07:15.608 INFO:tasks.workunit.client.0.smithi159.stdout:4/507: sync 2024-02-28T23:07:15.613 INFO:tasks.workunit.client.0.smithi159.stdout:4/508: truncate d9/f4e 4461717 0 2024-02-28T23:07:15.613 INFO:tasks.workunit.client.0.smithi159.stdout:9/456: symlink d4/l93 0 2024-02-28T23:07:15.619 INFO:tasks.workunit.client.0.smithi159.stdout:4/509: symlink d9/d42/d95/laa 0 2024-02-28T23:07:15.629 INFO:tasks.workunit.client.0.smithi159.stdout:4/510: rename d9/da/f90 to d9/d42/fab 0 2024-02-28T23:07:15.647 INFO:tasks.workunit.client.0.smithi159.stdout:9/457: write d4/d3d/d3e/d55/f24 [2632862,63841] 0 2024-02-28T23:07:15.652 INFO:tasks.workunit.client.0.smithi159.stdout:4/511: rename d9/f7f to d9/da/d1c/d23/d2d/fac 0 2024-02-28T23:07:15.654 INFO:tasks.workunit.client.0.smithi159.stdout:4/512: chown d9/c6e 1 1 2024-02-28T23:07:15.680 INFO:tasks.workunit.client.0.smithi159.stdout:4/513: mkdir d9/da/d1c/dad 0 2024-02-28T23:07:15.687 INFO:tasks.workunit.client.0.smithi159.stdout:4/514: creat d9/d4c/fae x:0 0 0 2024-02-28T23:07:15.698 INFO:tasks.workunit.client.0.smithi159.stdout:9/458: dread d4/f39 [0,4194304] 0 2024-02-28T23:07:15.704 INFO:tasks.workunit.client.0.smithi159.stdout:7/322: sync 2024-02-28T23:07:15.704 INFO:tasks.workunit.client.0.smithi159.stdout:5/455: sync 2024-02-28T23:07:15.707 INFO:tasks.workunit.client.0.smithi159.stdout:5/456: stat d8/d19/d23/d35/d38/l73 0 2024-02-28T23:07:15.710 INFO:tasks.workunit.client.0.smithi159.stdout:9/459: rename d4/d3d/d3e/d55/d37/d62/l65 to d4/d3d/d3e/d55/d37/d62/d8f/l94 0 2024-02-28T23:07:15.714 INFO:tasks.workunit.client.0.smithi159.stdout:9/460: write d4/d3d/d3e/d55/f43 [2161921,67397] 0 2024-02-28T23:07:15.717 INFO:tasks.workunit.client.0.smithi159.stdout:5/457: creat d8/d19/d23/d35/d38/d6d/f9a x:0 0 0 2024-02-28T23:07:15.721 INFO:tasks.workunit.client.0.smithi159.stdout:7/323: rename d5/f9 to d5/d16/d1a/d27/d46/f66 0 2024-02-28T23:07:15.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:15 smithi159 ceph-mon[28802]: pgmap v26: 65 pgs: 65 active+clean; 922 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 117 MiB/s wr, 294 op/s 2024-02-28T23:07:15.731 INFO:tasks.workunit.client.0.smithi159.stdout:7/324: mknod d5/d16/c67 0 2024-02-28T23:07:15.733 INFO:tasks.workunit.client.0.smithi159.stdout:5/458: creat d8/f9b x:0 0 0 2024-02-28T23:07:15.734 INFO:tasks.workunit.client.0.smithi159.stdout:7/325: write d5/f12 [5397765,95977] 0 2024-02-28T23:07:15.743 INFO:tasks.workunit.client.0.smithi159.stdout:9/461: dread d4/d3d/d3e/d4a/f56 [0,4194304] 0 2024-02-28T23:07:15.745 INFO:tasks.workunit.client.0.smithi159.stdout:5/459: rename d8/d19/d23/d35/d71 to d8/d67/d79/d9c 0 2024-02-28T23:07:15.747 INFO:tasks.workunit.client.0.smithi159.stdout:7/326: mknod d5/d16/d1a/d27/c68 0 2024-02-28T23:07:15.752 INFO:tasks.workunit.client.0.smithi159.stdout:5/460: creat d8/d67/d79/d9c/d90/f9d x:0 0 0 2024-02-28T23:07:15.755 INFO:tasks.workunit.client.0.smithi159.stdout:7/327: creat d5/d56/d2a/f69 x:0 0 0 2024-02-28T23:07:15.757 INFO:tasks.workunit.client.0.smithi159.stdout:9/462: symlink d4/d3d/d3e/d91/l95 0 2024-02-28T23:07:15.762 INFO:tasks.workunit.client.0.smithi159.stdout:9/463: rename d4/d76/l7a to d4/d3d/d3e/d91/l96 0 2024-02-28T23:07:15.766 INFO:tasks.workunit.client.0.smithi159.stdout:9/464: fdatasync d4/f32 0 2024-02-28T23:07:15.771 INFO:tasks.workunit.client.0.smithi159.stdout:7/328: dwrite d5/d16/f49 [0,4194304] 0 2024-02-28T23:07:15.775 INFO:tasks.workunit.client.0.smithi159.stdout:9/465: symlink d4/d52/l97 0 2024-02-28T23:07:15.778 INFO:tasks.workunit.client.0.smithi159.stdout:9/466: write d4/d3d/d3e/d55/d4c/d4e/f5e [108906,102893] 0 2024-02-28T23:07:15.779 INFO:tasks.workunit.client.0.smithi159.stdout:9/467: readlink d4/l1f 0 2024-02-28T23:07:15.783 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:15 smithi184 ceph-mon[36198]: pgmap v26: 65 pgs: 65 active+clean; 922 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 18 MiB/s rd, 117 MiB/s wr, 294 op/s 2024-02-28T23:07:15.793 INFO:tasks.workunit.client.0.smithi159.stdout:7/329: getdents d5/d56 0 2024-02-28T23:07:15.803 INFO:tasks.workunit.client.0.smithi159.stdout:7/330: rename d5/d10/c35 to d5/c6a 0 2024-02-28T23:07:15.827 INFO:tasks.workunit.client.0.smithi159.stdout:9/468: dwrite d4/f32 [0,4194304] 0 2024-02-28T23:07:15.829 INFO:tasks.workunit.client.0.smithi159.stdout:9/469: dread - d4/d3d/d3e/f73 zero size 2024-02-28T23:07:15.831 INFO:tasks.workunit.client.0.smithi159.stdout:2/354: sync 2024-02-28T23:07:15.831 INFO:tasks.workunit.client.0.smithi159.stdout:3/391: sync 2024-02-28T23:07:15.831 INFO:tasks.workunit.client.0.smithi159.stdout:6/366: sync 2024-02-28T23:07:15.834 INFO:tasks.workunit.client.0.smithi159.stdout:3/392: readlink d0/d2b/l2a 0 2024-02-28T23:07:15.837 INFO:tasks.workunit.client.0.smithi159.stdout:7/331: truncate d5/d16/f1f 1950351 0 2024-02-28T23:07:15.839 INFO:tasks.workunit.client.0.smithi159.stdout:6/367: mknod d0/c75 0 2024-02-28T23:07:15.844 INFO:tasks.workunit.client.0.smithi159.stdout:7/332: rename d5/d16/f49 to d5/d56/d50/d5b/f6b 0 2024-02-28T23:07:15.846 INFO:tasks.workunit.client.0.smithi159.stdout:6/368: fdatasync d0/d1b/d33/d11/d34/f3e 0 2024-02-28T23:07:15.848 INFO:tasks.workunit.client.0.smithi159.stdout:3/393: getdents d0/d6/d34 0 2024-02-28T23:07:15.851 INFO:tasks.workunit.client.0.smithi159.stdout:3/394: stat d0/d2b/d55/d75 0 2024-02-28T23:07:15.851 INFO:tasks.workunit.client.0.smithi159.stdout:2/355: dwrite d9/d23/d2c/f67 [0,4194304] 0 2024-02-28T23:07:15.856 INFO:tasks.workunit.client.0.smithi159.stdout:2/356: chown d9/d23/d2c/d55/d13/d31/d37 85796681 1 2024-02-28T23:07:15.857 INFO:tasks.workunit.client.0.smithi159.stdout:9/470: dwrite d4/d3d/d3e/f73 [0,4194304] 0 2024-02-28T23:07:15.858 INFO:tasks.workunit.client.0.smithi159.stdout:5/461: sync 2024-02-28T23:07:15.858 INFO:tasks.workunit.client.0.smithi159.stdout:3/395: dread - d0/d6/d3e/d57/f6c zero size 2024-02-28T23:07:15.860 INFO:tasks.workunit.client.0.smithi159.stdout:5/462: stat d8/d19/d23/d2a/f4b 0 2024-02-28T23:07:15.862 INFO:tasks.workunit.client.0.smithi159.stdout:0/516: sync 2024-02-28T23:07:15.862 INFO:tasks.workunit.client.0.smithi159.stdout:8/532: sync 2024-02-28T23:07:15.863 INFO:tasks.workunit.client.0.smithi159.stdout:4/515: sync 2024-02-28T23:07:15.863 INFO:tasks.workunit.client.0.smithi159.stdout:1/416: sync 2024-02-28T23:07:15.864 INFO:tasks.workunit.client.0.smithi159.stdout:5/463: stat d8/d67/d79 0 2024-02-28T23:07:15.865 INFO:tasks.workunit.client.0.smithi159.stdout:6/369: mknod d0/d1b/d33/d11/d14/d49/c76 0 2024-02-28T23:07:15.865 INFO:tasks.workunit.client.0.smithi159.stdout:0/517: write d0/d5/d14/d25/f39 [5852505,24633] 0 2024-02-28T23:07:15.866 INFO:tasks.workunit.client.0.smithi159.stdout:4/516: stat d9/d20/d87/f92 0 2024-02-28T23:07:15.869 INFO:tasks.workunit.client.0.smithi159.stdout:4/517: dread - d9/da/f9a zero size 2024-02-28T23:07:15.869 INFO:tasks.workunit.client.0.smithi159.stdout:3/396: mkdir d0/d6/d3e/d2f/d78 0 2024-02-28T23:07:15.871 INFO:tasks.workunit.client.0.smithi159.stdout:8/533: fsync d2/d3/f20 0 2024-02-28T23:07:15.874 INFO:tasks.workunit.client.0.smithi159.stdout:4/518: dread - d9/d20/f5e zero size 2024-02-28T23:07:15.875 INFO:tasks.workunit.client.0.smithi159.stdout:8/534: stat d2/d73/c8b 0 2024-02-28T23:07:15.877 INFO:tasks.workunit.client.0.smithi159.stdout:9/471: rename d4/d3d/d3e/d55/d37/d62/f90 to d4/d76/f98 0 2024-02-28T23:07:15.879 INFO:tasks.workunit.client.0.smithi159.stdout:9/472: stat d4/l28 0 2024-02-28T23:07:15.880 INFO:tasks.workunit.client.0.smithi159.stdout:6/370: symlink d0/d1b/d38/d4d/l77 0 2024-02-28T23:07:15.882 INFO:tasks.workunit.client.0.smithi159.stdout:8/535: dread d2/d3/f2a [0,4194304] 0 2024-02-28T23:07:15.883 INFO:tasks.workunit.client.0.smithi159.stdout:0/518: creat d0/d5/d14/d34/d3d/fb9 x:0 0 0 2024-02-28T23:07:15.884 INFO:tasks.workunit.client.0.smithi159.stdout:2/357: dwrite d9/d23/d2c/f32 [0,4194304] 0 2024-02-28T23:07:15.884 INFO:tasks.workunit.client.0.smithi159.stdout:9/473: chown d4/d3d/d3e/d91/l95 122363463 1 2024-02-28T23:07:15.885 INFO:tasks.workunit.client.0.smithi159.stdout:9/474: chown d4/d76 0 1 2024-02-28T23:07:15.886 INFO:tasks.workunit.client.0.smithi159.stdout:3/397: mkdir d0/d3f/d59/d79 0 2024-02-28T23:07:15.890 INFO:tasks.workunit.client.0.smithi159.stdout:1/417: creat d6/d12/d31/d5a/f87 x:0 0 0 2024-02-28T23:07:15.891 INFO:tasks.workunit.client.0.smithi159.stdout:1/418: chown d6/d12 196874094 1 2024-02-28T23:07:15.892 INFO:tasks.workunit.client.0.smithi159.stdout:5/464: rename d8/d19/d23/l48 to d8/d19/d23/d35/d38/l9e 0 2024-02-28T23:07:15.894 INFO:tasks.workunit.client.0.smithi159.stdout:5/465: readlink d8/d19/d23/d35/d38/l73 0 2024-02-28T23:07:15.896 INFO:tasks.workunit.client.0.smithi159.stdout:6/371: mknod d0/d1b/d38/d4d/c78 0 2024-02-28T23:07:15.899 INFO:tasks.workunit.client.0.smithi159.stdout:0/519: mknod d0/d5/d14/d25/d2c/d4b/cba 0 2024-02-28T23:07:15.900 INFO:tasks.workunit.client.0.smithi159.stdout:5/466: truncate d8/d19/d23/d35/f62 620495 0 2024-02-28T23:07:15.907 INFO:tasks.workunit.client.0.smithi159.stdout:1/419: mkdir d6/d1d/d46/d88 0 2024-02-28T23:07:15.912 INFO:tasks.workunit.client.0.smithi159.stdout:3/398: mknod d0/d6/d3e/c7a 0 2024-02-28T23:07:15.915 INFO:tasks.workunit.client.0.smithi159.stdout:0/520: fdatasync d0/d5/d38/d63/f7c 0 2024-02-28T23:07:15.917 INFO:tasks.workunit.client.0.smithi159.stdout:8/536: truncate d2/d11/d52/d26/d36/f55 11258 0 2024-02-28T23:07:15.918 INFO:tasks.workunit.client.0.smithi159.stdout:6/372: fsync d0/d6d/f6e 0 2024-02-28T23:07:15.919 INFO:tasks.workunit.client.0.smithi159.stdout:1/420: fsync d6/d12/d16/f24 0 2024-02-28T23:07:15.919 INFO:tasks.workunit.client.0.smithi159.stdout:8/537: read - d2/d11/d35/d5f/f6a zero size 2024-02-28T23:07:15.923 INFO:tasks.workunit.client.0.smithi159.stdout:0/521: dread - d0/d5/d14/d34/f9e zero size 2024-02-28T23:07:15.923 INFO:tasks.workunit.client.0.smithi159.stdout:5/467: dwrite d8/d16/f6a [0,4194304] 0 2024-02-28T23:07:15.923 INFO:tasks.workunit.client.0.smithi159.stdout:3/399: creat d0/d3f/d59/f7b x:0 0 0 2024-02-28T23:07:15.927 INFO:tasks.workunit.client.0.smithi159.stdout:9/475: getdents d4 0 2024-02-28T23:07:15.931 INFO:tasks.workunit.client.0.smithi159.stdout:5/468: read d8/d19/f1f [2914937,23431] 0 2024-02-28T23:07:15.936 INFO:tasks.workunit.client.0.smithi159.stdout:1/421: symlink d6/d1d/d46/l89 0 2024-02-28T23:07:15.938 INFO:tasks.workunit.client.0.smithi159.stdout:0/522: truncate d0/f3e 1101375 0 2024-02-28T23:07:15.938 INFO:tasks.workunit.client.0.smithi159.stdout:8/538: mknod d2/d11/d52/d47/cb0 0 2024-02-28T23:07:15.938 INFO:tasks.workunit.client.0.smithi159.stdout:9/476: write d4/d52/d7d/f8d [148634,34097] 0 2024-02-28T23:07:15.940 INFO:tasks.workunit.client.0.smithi159.stdout:6/373: rename d0/d1b/d33/d3f/d44/l64 to d0/d1b/d33/l79 0 2024-02-28T23:07:15.944 INFO:tasks.workunit.client.0.smithi159.stdout:1/422: stat d6/d12/f18 0 2024-02-28T23:07:15.946 INFO:tasks.workunit.client.0.smithi159.stdout:0/523: chown d0/de/c4c 157 1 2024-02-28T23:07:15.947 INFO:tasks.workunit.client.0.smithi159.stdout:1/423: dread - d6/d1d/f68 zero size 2024-02-28T23:07:15.949 INFO:tasks.workunit.client.1.smithi184.stderr:++ readlink -f fsstress 2024-02-28T23:07:15.952 INFO:tasks.workunit.client.0.smithi159.stdout:7/333: dwrite f3 [0,4194304] 0 2024-02-28T23:07:15.954 INFO:tasks.workunit.client.0.smithi159.stdout:4/519: write d9/da/d1c/d23/d2d/f8d [1912654,39272] 0 2024-02-28T23:07:15.954 INFO:tasks.workunit.client.1.smithi184.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-02-28T23:07:15.954 INFO:tasks.workunit.client.1.smithi184.stderr:+ popd 2024-02-28T23:07:15.957 INFO:tasks.workunit.client.1.smithi184.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-02-28T23:07:15.958 INFO:tasks.workunit.client.1.smithi184.stderr:+ popd 2024-02-28T23:07:15.958 INFO:tasks.workunit.client.0.smithi159.stdout:2/358: dread d9/d23/d2c/d55/d13/d31/d37/f39 [0,4194304] 0 2024-02-28T23:07:15.959 INFO:tasks.workunit.client.1.smithi184.stdout:~/cephtest/mnt.1/client.1/tmp 2024-02-28T23:07:15.960 INFO:tasks.workunit.client.1.smithi184.stderr:++ mktemp -d -p . 2024-02-28T23:07:15.964 INFO:tasks.workunit.client.0.smithi159.stdout:3/400: dwrite d0/d6/d3e/d2f/f56 [0,4194304] 0 2024-02-28T23:07:15.965 INFO:tasks.workunit.client.0.smithi159.stdout:5/469: creat d8/d19/d23/d2a/f9f x:0 0 0 2024-02-28T23:07:15.971 INFO:tasks.workunit.client.1.smithi184.stderr:+ T=./tmp.gyegImHuqM 2024-02-28T23:07:15.971 INFO:tasks.workunit.client.1.smithi184.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.gyegImHuqM -l 1 -n 1000 -p 10 -v 2024-02-28T23:07:15.971 INFO:tasks.workunit.client.0.smithi159.stdout:6/374: mkdir d0/d1b/d33/d3f/d44/d7a 0 2024-02-28T23:07:15.973 INFO:tasks.workunit.client.0.smithi159.stdout:6/375: read d0/f8 [578949,123573] 0 2024-02-28T23:07:15.976 INFO:tasks.workunit.client.0.smithi159.stdout:6/376: chown d0/d1b/d33/f43 442014 1 2024-02-28T23:07:15.988 INFO:tasks.workunit.client.1.smithi184.stdout:seed = 1708171590 2024-02-28T23:07:15.991 INFO:tasks.workunit.client.0.smithi159.stdout:5/470: rmdir d8/d67 39 2024-02-28T23:07:15.997 INFO:tasks.workunit.client.0.smithi159.stdout:5/471: fdatasync d8/f31 0 2024-02-28T23:07:15.997 INFO:tasks.workunit.client.0.smithi159.stdout:4/520: dread d9/d20/f29 [0,4194304] 0 2024-02-28T23:07:15.997 INFO:tasks.workunit.client.0.smithi159.stdout:6/377: dwrite d0/d1b/d33/d11/d14/f74 [0,4194304] 0 2024-02-28T23:07:16.005 INFO:tasks.workunit.client.0.smithi159.stdout:0/524: mknod d0/d5/d14/d34/d6c/daf/cbb 0 2024-02-28T23:07:16.007 INFO:tasks.workunit.client.0.smithi159.stdout:0/525: read - d0/d5/d14/d34/f9e zero size 2024-02-28T23:07:16.008 INFO:tasks.workunit.client.1.smithi184.stdout:0/0: dwrite - no filename 2024-02-28T23:07:16.013 INFO:tasks.workunit.client.0.smithi159.stdout:8/539: link d2/d11/d52/d26/d36/d38/f39 d2/d11/d52/d47/d65/d68/fb1 0 2024-02-28T23:07:16.016 INFO:tasks.workunit.client.1.smithi184.stdout:1/0: link - no file 2024-02-28T23:07:16.019 INFO:tasks.workunit.client.0.smithi159.stdout:6/378: dwrite d0/d1b/d33/d11/f67 [0,4194304] 0 2024-02-28T23:07:16.028 INFO:tasks.workunit.client.1.smithi184.stdout:0/1: mkdir d0 0 2024-02-28T23:07:16.032 INFO:tasks.workunit.client.0.smithi159.stdout:8/540: dread d2/d11/d52/d47/d65/d68/fb1 [8388608,4194304] 0 2024-02-28T23:07:16.033 INFO:tasks.workunit.client.1.smithi184.stdout:4/0: truncate - no filename 2024-02-28T23:07:16.037 INFO:tasks.workunit.client.0.smithi159.stdout:9/477: link d4/l40 d4/d3d/d3e/d55/d37/d62/d8f/l99 0 2024-02-28T23:07:16.037 INFO:tasks.workunit.client.1.smithi184.stdout:1/1: mknod c0 0 2024-02-28T23:07:16.040 INFO:tasks.workunit.client.0.smithi159.stdout:9/478: stat d4/f13 0 2024-02-28T23:07:16.042 INFO:tasks.workunit.client.1.smithi184.stdout:5/0: dread - no filename 2024-02-28T23:07:16.042 INFO:tasks.workunit.client.1.smithi184.stdout:5/1: rmdir - no directory 2024-02-28T23:07:16.044 INFO:tasks.workunit.client.1.smithi184.stdout:3/0: symlink l0 0 2024-02-28T23:07:16.044 INFO:tasks.workunit.client.1.smithi184.stdout:3/1: dread - no filename 2024-02-28T23:07:16.044 INFO:tasks.workunit.client.1.smithi184.stdout:3/2: dwrite - no filename 2024-02-28T23:07:16.044 INFO:tasks.workunit.client.1.smithi184.stdout:3/3: readlink l0 0 2024-02-28T23:07:16.045 INFO:tasks.workunit.client.1.smithi184.stdout:3/4: readlink l0 0 2024-02-28T23:07:16.045 INFO:tasks.workunit.client.1.smithi184.stdout:3/5: write - no filename 2024-02-28T23:07:16.045 INFO:tasks.workunit.client.1.smithi184.stdout:3/6: stat l0 0 2024-02-28T23:07:16.046 INFO:tasks.workunit.client.0.smithi159.stdout:0/526: rename d0/d5/d38/d63/dad/fb2 to d0/d5/d14/d34/d6c/fbc 0 2024-02-28T23:07:16.047 INFO:tasks.workunit.client.0.smithi159.stdout:5/472: dwrite d8/d19/f3c [0,4194304] 0 2024-02-28T23:07:16.051 INFO:tasks.workunit.client.1.smithi184.stdout:1/2: mknod c1 0 2024-02-28T23:07:16.053 INFO:tasks.workunit.client.1.smithi184.stdout:0/2: symlink d0/l1 0 2024-02-28T23:07:16.054 INFO:tasks.workunit.client.0.smithi159.stdout:6/379: mknod d0/d1b/d33/d11/d14/d5d/c7b 0 2024-02-28T23:07:16.054 INFO:tasks.workunit.client.1.smithi184.stdout:0/3: readlink d0/l1 0 2024-02-28T23:07:16.054 INFO:tasks.workunit.client.1.smithi184.stdout:0/4: truncate - no filename 2024-02-28T23:07:16.055 INFO:tasks.workunit.client.0.smithi159.stdout:6/380: chown d0/d1b/d33/d3f 89 1 2024-02-28T23:07:16.059 INFO:tasks.workunit.client.0.smithi159.stdout:3/401: dwrite d0/d6/d3e/f1e [0,4194304] 0 2024-02-28T23:07:16.061 INFO:tasks.workunit.client.1.smithi184.stdout:3/7: mkdir d1 0 2024-02-28T23:07:16.061 INFO:tasks.workunit.client.1.smithi184.stdout:3/8: dread - no filename 2024-02-28T23:07:16.061 INFO:tasks.workunit.client.1.smithi184.stdout:3/9: dread - no filename 2024-02-28T23:07:16.061 INFO:tasks.workunit.client.1.smithi184.stdout:3/10: dwrite - no filename 2024-02-28T23:07:16.061 INFO:tasks.workunit.client.1.smithi184.stdout:3/11: dwrite - no filename 2024-02-28T23:07:16.065 INFO:tasks.workunit.client.0.smithi159.stdout:4/521: creat d9/da/d1c/d8e/faf x:0 0 0 2024-02-28T23:07:16.065 INFO:tasks.workunit.client.0.smithi159.stdout:2/359: write d9/d23/d2c/d55/f2f [92110,52417] 0 2024-02-28T23:07:16.066 INFO:tasks.workunit.client.1.smithi184.stdout:4/1: symlink l0 0 2024-02-28T23:07:16.069 INFO:tasks.workunit.client.0.smithi159.stdout:2/360: write d9/d23/d2c/f4a [344063,128749] 0 2024-02-28T23:07:16.071 INFO:tasks.workunit.client.0.smithi159.stdout:1/424: getdents d6/d12/d16 0 2024-02-28T23:07:16.071 INFO:tasks.workunit.client.1.smithi184.stdout:1/3: creat f2 x:0 0 0 2024-02-28T23:07:16.072 INFO:tasks.workunit.client.1.smithi184.stdout:0/5: creat d0/f2 x:0 0 0 2024-02-28T23:07:16.073 INFO:tasks.workunit.client.1.smithi184.stdout:1/4: dread - f2 zero size 2024-02-28T23:07:16.075 INFO:tasks.workunit.client.1.smithi184.stdout:7/0: dwrite - no filename 2024-02-28T23:07:16.075 INFO:tasks.workunit.client.1.smithi184.stdout:7/1: link - no file 2024-02-28T23:07:16.075 INFO:tasks.workunit.client.1.smithi184.stdout:7/2: dread - no filename 2024-02-28T23:07:16.077 INFO:tasks.workunit.client.0.smithi159.stdout:6/381: dwrite d0/d1b/d33/d11/f19 [0,4194304] 0 2024-02-28T23:07:16.080 INFO:tasks.workunit.client.1.smithi184.stdout:5/2: symlink l0 0 2024-02-28T23:07:16.080 INFO:tasks.workunit.client.0.smithi159.stdout:3/402: fdatasync d0/d6/d3e/f1d 0 2024-02-28T23:07:16.081 INFO:tasks.workunit.client.0.smithi159.stdout:0/527: dread d0/d5/ff [0,4194304] 0 2024-02-28T23:07:16.082 INFO:tasks.workunit.client.1.smithi184.stdout:4/2: mkdir d1 0 2024-02-28T23:07:16.083 INFO:tasks.workunit.client.0.smithi159.stdout:3/403: stat d0/d2b/l5d 0 2024-02-28T23:07:16.083 INFO:tasks.workunit.client.0.smithi159.stdout:4/522: fsync d9/d42/fab 0 2024-02-28T23:07:16.086 INFO:tasks.workunit.client.0.smithi159.stdout:5/473: symlink d8/d67/d79/la0 0 2024-02-28T23:07:16.088 INFO:tasks.workunit.client.1.smithi184.stdout:6/0: symlink l0 0 2024-02-28T23:07:16.088 INFO:tasks.workunit.client.1.smithi184.stdout:6/1: truncate - no filename 2024-02-28T23:07:16.088 INFO:tasks.workunit.client.1.smithi184.stdout:2/0: rename - no filename 2024-02-28T23:07:16.088 INFO:tasks.workunit.client.1.smithi184.stdout:2/1: dwrite - no filename 2024-02-28T23:07:16.088 INFO:tasks.workunit.client.1.smithi184.stdout:2/2: write - no filename 2024-02-28T23:07:16.089 INFO:tasks.workunit.client.1.smithi184.stdout:3/12: mknod d1/c2 0 2024-02-28T23:07:16.090 INFO:tasks.workunit.client.1.smithi184.stdout:3/13: dread - no filename 2024-02-28T23:07:16.090 INFO:tasks.workunit.client.1.smithi184.stdout:3/14: dwrite - no filename 2024-02-28T23:07:16.090 INFO:tasks.workunit.client.1.smithi184.stdout:3/15: dread - no filename 2024-02-28T23:07:16.090 INFO:tasks.workunit.client.1.smithi184.stdout:3/16: truncate - no filename 2024-02-28T23:07:16.092 INFO:tasks.workunit.client.1.smithi184.stdout:5/3: symlink l1 0 2024-02-28T23:07:16.092 INFO:tasks.workunit.client.1.smithi184.stdout:5/4: dwrite - no filename 2024-02-28T23:07:16.092 INFO:tasks.workunit.client.1.smithi184.stdout:5/5: dwrite - no filename 2024-02-28T23:07:16.093 INFO:tasks.workunit.client.0.smithi159.stdout:0/528: creat d0/d5/d38/d63/fbd x:0 0 0 2024-02-28T23:07:16.097 INFO:tasks.workunit.client.0.smithi159.stdout:3/404: dread d0/f35 [0,4194304] 0 2024-02-28T23:07:16.098 INFO:tasks.workunit.client.0.smithi159.stdout:8/541: getdents d2/d11/d52/d6e 0 2024-02-28T23:07:16.099 INFO:tasks.workunit.client.1.smithi184.stdout:7/3: creat f0 x:0 0 0 2024-02-28T23:07:16.099 INFO:tasks.workunit.client.0.smithi159.stdout:6/382: fsync d0/d1b/f3c 0 2024-02-28T23:07:16.103 INFO:tasks.workunit.client.1.smithi184.stdout:3/17: rmdir d1 39 2024-02-28T23:07:16.104 INFO:tasks.workunit.client.1.smithi184.stdout:3/18: dwrite - no filename 2024-02-28T23:07:16.104 INFO:tasks.workunit.client.0.smithi159.stdout:6/383: write d0/d1b/d38/d4d/f58 [1397056,75887] 0 2024-02-28T23:07:16.104 INFO:tasks.workunit.client.0.smithi159.stdout:5/474: rename d8/f10 to d8/d19/d23/d35/d38/d8f/fa1 0 2024-02-28T23:07:16.104 INFO:tasks.workunit.client.1.smithi184.stdout:5/6: rename l0 to l2 0 2024-02-28T23:07:16.104 INFO:tasks.workunit.client.1.smithi184.stdout:5/7: write - no filename 2024-02-28T23:07:16.107 INFO:tasks.workunit.client.0.smithi159.stdout:6/384: truncate d0/d1b/d33/f43 4350429 0 2024-02-28T23:07:16.107 INFO:tasks.workunit.client.0.smithi159.stdout:2/361: getdents d9/d50/d62 0 2024-02-28T23:07:16.110 INFO:tasks.workunit.client.0.smithi159.stdout:6/385: readlink d0/d1b/d33/d11/l40 0 2024-02-28T23:07:16.111 INFO:tasks.workunit.client.1.smithi184.stdout:4/3: creat d1/f2 x:0 0 0 2024-02-28T23:07:16.112 INFO:tasks.workunit.client.1.smithi184.stdout:2/3: mkdir d0 0 2024-02-28T23:07:16.112 INFO:tasks.workunit.client.1.smithi184.stdout:2/4: truncate - no filename 2024-02-28T23:07:16.112 INFO:tasks.workunit.client.0.smithi159.stdout:0/529: dwrite d0/d5/d14/d25/f84 [0,4194304] 0 2024-02-28T23:07:16.116 INFO:tasks.workunit.client.1.smithi184.stdout:5/8: chown l1 122761 1 2024-02-28T23:07:16.116 INFO:tasks.workunit.client.1.smithi184.stdout:5/9: dwrite - no filename 2024-02-28T23:07:16.119 INFO:tasks.workunit.client.0.smithi159.stdout:1/425: dread d6/d12/d33/d3c/f55 [0,4194304] 0 2024-02-28T23:07:16.120 INFO:tasks.workunit.client.1.smithi184.stdout:0/6: dwrite d0/f2 [0,4194304] 0 2024-02-28T23:07:16.120 INFO:tasks.workunit.client.1.smithi184.stdout:1/5: dwrite f2 [0,4194304] 0 2024-02-28T23:07:16.123 INFO:tasks.workunit.client.1.smithi184.stdout:4/4: fdatasync d1/f2 0 2024-02-28T23:07:16.125 INFO:tasks.workunit.client.0.smithi159.stdout:8/542: rename d2/c60 to d2/d11/d74/cb2 0 2024-02-28T23:07:16.125 INFO:tasks.workunit.client.1.smithi184.stdout:0/7: chown d0/f2 4056 1 2024-02-28T23:07:16.131 INFO:tasks.workunit.client.0.smithi159.stdout:0/530: symlink d0/de/d75/lbe 0 2024-02-28T23:07:16.135 INFO:tasks.workunit.client.1.smithi184.stdout:1/6: symlink l3 0 2024-02-28T23:07:16.135 INFO:tasks.workunit.client.0.smithi159.stdout:1/426: unlink d6/d12/f60 0 2024-02-28T23:07:16.136 INFO:tasks.workunit.client.1.smithi184.stdout:0/8: mknod d0/c3 0 2024-02-28T23:07:16.138 INFO:tasks.workunit.client.0.smithi159.stdout:5/475: dread d8/f13 [0,4194304] 0 2024-02-28T23:07:16.140 INFO:tasks.workunit.client.1.smithi184.stdout:3/19: rename l0 to d1/l3 0 2024-02-28T23:07:16.141 INFO:tasks.workunit.client.1.smithi184.stdout:3/20: dwrite - no filename 2024-02-28T23:07:16.141 INFO:tasks.workunit.client.0.smithi159.stdout:3/405: rename d0/d3f/d59 to d0/d2b/d55/d75/d6d/d54/d7c 0 2024-02-28T23:07:16.144 INFO:tasks.workunit.client.1.smithi184.stdout:6/2: getdents . 0 2024-02-28T23:07:16.144 INFO:tasks.workunit.client.1.smithi184.stdout:6/3: truncate - no filename 2024-02-28T23:07:16.145 INFO:tasks.workunit.client.1.smithi184.stdout:0/9: chown d0/f2 4095572 1 2024-02-28T23:07:16.147 INFO:tasks.workunit.client.0.smithi159.stdout:4/523: dwrite d9/da/d1c/d23/f63 [0,4194304] 0 2024-02-28T23:07:16.148 INFO:tasks.workunit.client.0.smithi159.stdout:3/406: chown d0/d2b/d4f 2577 1 2024-02-28T23:07:16.149 INFO:tasks.workunit.client.1.smithi184.stdout:8/0: mknod c0 0 2024-02-28T23:07:16.149 INFO:tasks.workunit.client.1.smithi184.stdout:8/1: fsync - no filename 2024-02-28T23:07:16.149 INFO:tasks.workunit.client.1.smithi184.stdout:7/4: dwrite f0 [0,4194304] 0 2024-02-28T23:07:16.159 INFO:tasks.workunit.client.0.smithi159.stdout:0/531: dread d0/f3e [0,4194304] 0 2024-02-28T23:07:16.159 INFO:tasks.workunit.client.0.smithi159.stdout:6/386: dread d0/fa [0,4194304] 0 2024-02-28T23:07:16.169 INFO:tasks.workunit.client.0.smithi159.stdout:4/524: dwrite d9/da/d1c/d23/f2f [0,4194304] 0 2024-02-28T23:07:16.169 INFO:tasks.workunit.client.1.smithi184.stdout:1/7: symlink l4 0 2024-02-28T23:07:16.172 INFO:tasks.workunit.client.0.smithi159.stdout:4/525: chown d9/da/d1c/d23/d2d/f41 10333 1 2024-02-28T23:07:16.173 INFO:tasks.workunit.client.1.smithi184.stdout:4/5: dwrite d1/f2 [0,4194304] 0 2024-02-28T23:07:16.174 INFO:tasks.workunit.client.1.smithi184.stdout:3/21: mkdir d1/d4 0 2024-02-28T23:07:16.175 INFO:tasks.workunit.client.1.smithi184.stdout:6/4: unlink l0 0 2024-02-28T23:07:16.178 INFO:tasks.workunit.client.1.smithi184.stdout:0/10: dread d0/f2 [0,4194304] 0 2024-02-28T23:07:16.179 INFO:tasks.workunit.client.0.smithi159.stdout:2/362: creat d9/d23/d2c/d55/f72 x:0 0 0 2024-02-28T23:07:16.180 INFO:tasks.workunit.client.1.smithi184.stdout:8/2: unlink c0 0 2024-02-28T23:07:16.181 INFO:tasks.workunit.client.1.smithi184.stdout:8/3: readlink - no filename 2024-02-28T23:07:16.181 INFO:tasks.workunit.client.1.smithi184.stdout:8/4: write - no filename 2024-02-28T23:07:16.181 INFO:tasks.workunit.client.1.smithi184.stdout:0/11: chown d0 36380886 1 2024-02-28T23:07:16.184 INFO:tasks.workunit.client.0.smithi159.stdout:6/387: write d0/d1b/d33/d11/d14/d5d/f6f [786240,2345] 0 2024-02-28T23:07:16.184 INFO:tasks.workunit.client.0.smithi159.stdout:2/363: write d9/d23/d2c/f4a [1217956,32219] 0 2024-02-28T23:07:16.187 INFO:tasks.workunit.client.1.smithi184.stdout:4/6: write d1/f2 [2014351,106893] 0 2024-02-28T23:07:16.190 INFO:tasks.workunit.client.1.smithi184.stdout:7/5: creat f1 x:0 0 0 2024-02-28T23:07:16.191 INFO:tasks.workunit.client.1.smithi184.stdout:2/5: rmdir d0 0 2024-02-28T23:07:16.191 INFO:tasks.workunit.client.1.smithi184.stdout:2/6: truncate - no filename 2024-02-28T23:07:16.193 INFO:tasks.workunit.client.0.smithi159.stdout:5/476: creat d8/fa2 x:0 0 0 2024-02-28T23:07:16.194 INFO:tasks.workunit.client.1.smithi184.stdout:6/5: mknod c1 0 2024-02-28T23:07:16.194 INFO:tasks.workunit.client.1.smithi184.stdout:8/5: mkdir d1 0 2024-02-28T23:07:16.200 INFO:tasks.workunit.client.1.smithi184.stdout:6/6: stat c1 0 2024-02-28T23:07:16.200 INFO:tasks.workunit.client.0.smithi159.stdout:1/427: link d6/d1d/l30 d6/d12/d33/d48/l8a 0 2024-02-28T23:07:16.201 INFO:tasks.workunit.client.1.smithi184.stdout:3/22: mkdir d1/d4/d5 0 2024-02-28T23:07:16.201 INFO:tasks.workunit.client.1.smithi184.stdout:6/7: stat c1 0 2024-02-28T23:07:16.201 INFO:tasks.workunit.client.1.smithi184.stdout:3/23: dwrite - no filename 2024-02-28T23:07:16.201 INFO:tasks.workunit.client.0.smithi159.stdout:4/526: mknod d9/d20/d87/cb0 0 2024-02-28T23:07:16.202 INFO:tasks.workunit.client.1.smithi184.stdout:7/6: symlink l2 0 2024-02-28T23:07:16.204 INFO:tasks.workunit.client.0.smithi159.stdout:8/543: dwrite d2/d3/f17 [0,4194304] 0 2024-02-28T23:07:16.204 INFO:tasks.workunit.client.0.smithi159.stdout:4/527: chown d9/da/lf 918512145 1 2024-02-28T23:07:16.205 INFO:tasks.workunit.client.0.smithi159.stdout:2/364: dread d9/d23/d2c/d55/d13/d31/d37/f4d [4194304,4194304] 0 2024-02-28T23:07:16.206 INFO:tasks.workunit.client.1.smithi184.stdout:0/12: write d0/f2 [2336442,81351] 0 2024-02-28T23:07:16.206 INFO:tasks.workunit.client.0.smithi159.stdout:8/544: write d2/d3/f46 [1959674,75238] 0 2024-02-28T23:07:16.209 INFO:tasks.workunit.client.1.smithi184.stdout:7/7: read f0 [1414191,47317] 0 2024-02-28T23:07:16.211 INFO:tasks.workunit.client.1.smithi184.stdout:6/8: rename c1 to c2 0 2024-02-28T23:07:16.211 INFO:tasks.workunit.client.1.smithi184.stdout:6/9: truncate - no filename 2024-02-28T23:07:16.211 INFO:tasks.workunit.client.0.smithi159.stdout:1/428: chown d6/d1d/d1f/d3e/d63/f74 2003 1 2024-02-28T23:07:16.215 INFO:tasks.workunit.client.0.smithi159.stdout:3/407: getdents d0 0 2024-02-28T23:07:16.217 INFO:tasks.workunit.client.1.smithi184.stdout:1/8: dwrite f2 [4194304,4194304] 0 2024-02-28T23:07:16.217 INFO:tasks.workunit.client.1.smithi184.stdout:1/9: rmdir - no directory 2024-02-28T23:07:16.217 INFO:tasks.workunit.client.0.smithi159.stdout:3/408: fsync d0/d2b/d4f/f65 0 2024-02-28T23:07:16.218 INFO:tasks.workunit.client.1.smithi184.stdout:8/6: creat d1/f2 x:0 0 0 2024-02-28T23:07:16.219 INFO:tasks.workunit.client.1.smithi184.stdout:1/10: chown f2 0 1 2024-02-28T23:07:16.221 INFO:tasks.workunit.client.1.smithi184.stdout:3/24: unlink d1/l3 0 2024-02-28T23:07:16.223 INFO:tasks.workunit.client.1.smithi184.stdout:3/25: chown d1/d4 4126565 1 2024-02-28T23:07:16.223 INFO:tasks.workunit.client.1.smithi184.stdout:0/13: rename d0/l1 to d0/l4 0 2024-02-28T23:07:16.224 INFO:tasks.workunit.client.1.smithi184.stdout:0/14: rename d0 to d0/d5 22 2024-02-28T23:07:16.226 INFO:tasks.workunit.client.0.smithi159.stdout:0/532: dwrite d0/d5/d38/d63/f69 [0,4194304] 0 2024-02-28T23:07:16.226 INFO:tasks.workunit.client.1.smithi184.stdout:7/8: creat f3 x:0 0 0 2024-02-28T23:07:16.229 INFO:tasks.workunit.client.1.smithi184.stdout:6/10: creat f3 x:0 0 0 2024-02-28T23:07:16.230 INFO:tasks.workunit.client.0.smithi159.stdout:1/429: dwrite d6/d12/d16/f28 [0,4194304] 0 2024-02-28T23:07:16.233 INFO:tasks.workunit.client.1.smithi184.stdout:4/7: link l0 d1/l3 0 2024-02-28T23:07:16.234 INFO:tasks.workunit.client.1.smithi184.stdout:6/11: write f3 [475956,58992] 0 2024-02-28T23:07:16.235 INFO:tasks.workunit.client.1.smithi184.stdout:8/7: symlink d1/l3 0 2024-02-28T23:07:16.237 INFO:tasks.workunit.client.0.smithi159.stdout:6/388: dwrite d0/d6d/f6e [0,4194304] 0 2024-02-28T23:07:16.238 INFO:tasks.workunit.client.1.smithi184.stdout:1/11: creat f5 x:0 0 0 2024-02-28T23:07:16.239 INFO:tasks.workunit.client.1.smithi184.stdout:1/12: stat l3 0 2024-02-28T23:07:16.241 INFO:tasks.workunit.client.0.smithi159.stdout:1/430: rmdir d6/d12/d31/d69 39 2024-02-28T23:07:16.241 INFO:tasks.workunit.client.1.smithi184.stdout:8/8: write d1/f2 [914609,4577] 0 2024-02-28T23:07:16.243 INFO:tasks.workunit.client.0.smithi159.stdout:8/545: creat d2/d11/fb3 x:0 0 0 2024-02-28T23:07:16.245 INFO:tasks.workunit.client.1.smithi184.stdout:3/26: mkdir d1/d4/d6 0 2024-02-28T23:07:16.246 INFO:tasks.workunit.client.0.smithi159.stdout:8/546: write d2/d11/d35/d5f/f6a [949012,121229] 0 2024-02-28T23:07:16.246 INFO:tasks.workunit.client.0.smithi159.stdout:0/533: fsync d0/d5/d14/d25/f31 0 2024-02-28T23:07:16.247 INFO:tasks.workunit.client.1.smithi184.stdout:1/13: dread - f5 zero size 2024-02-28T23:07:16.248 INFO:tasks.workunit.client.1.smithi184.stdout:0/15: creat d0/f6 x:0 0 0 2024-02-28T23:07:16.249 INFO:tasks.workunit.client.1.smithi184.stdout:4/8: mkdir d1/d4 0 2024-02-28T23:07:16.251 INFO:tasks.workunit.client.0.smithi159.stdout:6/389: creat d0/d1b/d33/d11/f7c x:0 0 0 2024-02-28T23:07:16.252 INFO:tasks.workunit.client.0.smithi159.stdout:1/431: write d6/d12/d33/f51 [3770423,106352] 0 2024-02-28T23:07:16.254 INFO:tasks.workunit.client.1.smithi184.stdout:0/16: mknod d0/c7 0 2024-02-28T23:07:16.254 INFO:tasks.workunit.client.1.smithi184.stdout:6/12: chown c2 164 1 2024-02-28T23:07:16.257 INFO:tasks.workunit.client.0.smithi159.stdout:6/390: mknod d0/d6d/c7d 0 2024-02-28T23:07:16.259 INFO:tasks.workunit.client.1.smithi184.stdout:6/13: chown c2 0 1 2024-02-28T23:07:16.261 INFO:tasks.workunit.client.1.smithi184.stdout:8/9: truncate d1/f2 1794815 0 2024-02-28T23:07:16.262 INFO:tasks.workunit.client.0.smithi159.stdout:6/391: readlink d0/d1b/d33/d11/l40 0 2024-02-28T23:07:16.263 INFO:tasks.workunit.client.1.smithi184.stdout:1/14: link l3 l6 0 2024-02-28T23:07:16.266 INFO:tasks.workunit.client.0.smithi159.stdout:0/534: link d0/d5/d14/d25/f31 d0/de/d75/db8/fbf 0 2024-02-28T23:07:16.267 INFO:tasks.workunit.client.1.smithi184.stdout:7/9: dwrite f1 [0,4194304] 0 2024-02-28T23:07:16.269 INFO:tasks.workunit.client.1.smithi184.stdout:4/9: creat d1/d4/f5 x:0 0 0 2024-02-28T23:07:16.269 INFO:tasks.workunit.client.1.smithi184.stdout:8/10: symlink d1/l4 0 2024-02-28T23:07:16.269 INFO:tasks.workunit.client.0.smithi159.stdout:2/365: dwrite d9/d34/f3a [0,4194304] 0 2024-02-28T23:07:16.269 INFO:tasks.workunit.client.1.smithi184.stdout:1/15: symlink l7 0 2024-02-28T23:07:16.273 INFO:tasks.workunit.client.1.smithi184.stdout:1/16: chown l7 1032 1 2024-02-28T23:07:16.274 INFO:tasks.workunit.client.1.smithi184.stdout:1/17: chown l7 2678078 1 2024-02-28T23:07:16.275 INFO:tasks.workunit.client.0.smithi159.stdout:6/392: symlink d0/d1b/d33/d11/d14/d49/l7e 0 2024-02-28T23:07:16.279 INFO:tasks.workunit.client.0.smithi159.stdout:0/535: symlink d0/de/lc0 0 2024-02-28T23:07:16.285 INFO:tasks.workunit.client.0.smithi159.stdout:5/477: write d8/d19/f54 [349336,28777] 0 2024-02-28T23:07:16.286 INFO:tasks.workunit.client.0.smithi159.stdout:8/547: dwrite d2/d3/f14 [0,4194304] 0 2024-02-28T23:07:16.288 INFO:tasks.workunit.client.0.smithi159.stdout:1/432: dwrite d6/d1d/d46/f4c [0,4194304] 0 2024-02-28T23:07:16.288 INFO:tasks.workunit.client.1.smithi184.stdout:1/18: fsync f2 0 2024-02-28T23:07:16.291 INFO:tasks.workunit.client.1.smithi184.stdout:1/19: dread - f5 zero size 2024-02-28T23:07:16.292 INFO:tasks.workunit.client.1.smithi184.stdout:7/10: dread f0 [0,4194304] 0 2024-02-28T23:07:16.293 INFO:tasks.workunit.client.0.smithi159.stdout:0/536: dread d0/f3e [0,4194304] 0 2024-02-28T23:07:16.294 INFO:tasks.workunit.client.1.smithi184.stdout:0/17: rename d0/l4 to d0/l8 0 2024-02-28T23:07:16.296 INFO:tasks.workunit.client.0.smithi159.stdout:8/548: unlink d2/d11/d35/f94 0 2024-02-28T23:07:16.299 INFO:tasks.workunit.client.0.smithi159.stdout:5/478: stat d8/d19/d23/c82 0 2024-02-28T23:07:16.301 INFO:tasks.workunit.client.1.smithi184.stdout:1/20: mknod c8 0 2024-02-28T23:07:16.302 INFO:tasks.workunit.client.0.smithi159.stdout:1/433: creat d6/d1d/d1f/d3e/d6a/f8b x:0 0 0 2024-02-28T23:07:16.302 INFO:tasks.workunit.client.0.smithi159.stdout:5/479: fsync d8/d16/f72 0 2024-02-28T23:07:16.303 INFO:tasks.workunit.client.1.smithi184.stdout:4/10: dwrite d1/d4/f5 [0,4194304] 0 2024-02-28T23:07:16.304 INFO:tasks.workunit.client.1.smithi184.stdout:6/14: getdents . 0 2024-02-28T23:07:16.304 INFO:tasks.workunit.client.1.smithi184.stdout:0/18: fsync d0/f6 0 2024-02-28T23:07:16.306 INFO:tasks.workunit.client.0.smithi159.stdout:6/393: dread d0/d1b/d33/d11/f19 [0,4194304] 0 2024-02-28T23:07:16.306 INFO:tasks.workunit.client.1.smithi184.stdout:1/21: creat f9 x:0 0 0 2024-02-28T23:07:16.307 INFO:tasks.workunit.client.0.smithi159.stdout:0/537: truncate d0/d5/d14/d34/d6c/fbc 612063 0 2024-02-28T23:07:16.308 INFO:tasks.workunit.client.0.smithi159.stdout:2/366: dwrite d9/d23/d2c/d55/d13/d31/d37/f4d [4194304,4194304] 0 2024-02-28T23:07:16.309 INFO:tasks.workunit.client.1.smithi184.stdout:4/11: readlink d1/l3 0 2024-02-28T23:07:16.309 INFO:tasks.workunit.client.0.smithi159.stdout:0/538: fdatasync d0/f6 0 2024-02-28T23:07:16.310 INFO:tasks.workunit.client.1.smithi184.stdout:4/12: fsync d1/f2 0 2024-02-28T23:07:16.311 INFO:tasks.workunit.client.0.smithi159.stdout:6/394: readlink d0/d1b/d33/d11/d14/l25 0 2024-02-28T23:07:16.312 INFO:tasks.workunit.client.1.smithi184.stdout:0/19: rename d0/c3 to d0/c9 0 2024-02-28T23:07:16.313 INFO:tasks.workunit.client.0.smithi159.stdout:2/367: write d9/f35 [1319965,29710] 0 2024-02-28T23:07:16.319 INFO:tasks.workunit.client.0.smithi159.stdout:1/434: fsync d6/d12/fe 0 2024-02-28T23:07:16.320 INFO:tasks.workunit.client.0.smithi159.stdout:5/480: mkdir d8/d19/d23/d35/d65/da3 0 2024-02-28T23:07:16.321 INFO:tasks.workunit.client.1.smithi184.stdout:7/11: write f1 [4213503,56974] 0 2024-02-28T23:07:16.322 INFO:tasks.workunit.client.0.smithi159.stdout:2/368: symlink d9/d36/l73 0 2024-02-28T23:07:16.324 INFO:tasks.workunit.client.0.smithi159.stdout:6/395: link d0/d1b/d38/d4d/f58 d0/d1b/d38/d52/f7f 0 2024-02-28T23:07:16.325 INFO:tasks.workunit.client.0.smithi159.stdout:0/539: symlink d0/d5/d14/lc1 0 2024-02-28T23:07:16.325 INFO:tasks.workunit.client.1.smithi184.stdout:6/15: dread f3 [0,4194304] 0 2024-02-28T23:07:16.326 INFO:tasks.workunit.client.0.smithi159.stdout:3/409: dwrite d0/d2b/d55/d75/d6d/f2d [0,4194304] 0 2024-02-28T23:07:16.327 INFO:tasks.workunit.client.0.smithi159.stdout:1/435: creat d6/d1d/d1f/f8c x:0 0 0 2024-02-28T23:07:16.328 INFO:tasks.workunit.client.1.smithi184.stdout:7/12: unlink f1 0 2024-02-28T23:07:16.332 INFO:tasks.workunit.client.0.smithi159.stdout:5/481: creat d8/d67/d79/fa4 x:0 0 0 2024-02-28T23:07:16.334 INFO:tasks.workunit.client.1.smithi184.stdout:6/16: mknod c4 0 2024-02-28T23:07:16.336 INFO:tasks.workunit.client.1.smithi184.stdout:8/11: getdents d1 0 2024-02-28T23:07:16.337 INFO:tasks.workunit.client.0.smithi159.stdout:1/436: creat d6/d12/d33/d3c/f8d x:0 0 0 2024-02-28T23:07:16.337 INFO:tasks.workunit.client.0.smithi159.stdout:6/396: truncate d0/fe 3056036 0 2024-02-28T23:07:16.339 INFO:tasks.workunit.client.0.smithi159.stdout:5/482: rename d8/d67/d79/d9c to d8/d19/d23/d35/d38/d8f/da5 0 2024-02-28T23:07:16.339 INFO:tasks.workunit.client.0.smithi159.stdout:6/397: read d0/d6d/f6e [2649134,116287] 0 2024-02-28T23:07:16.346 INFO:tasks.workunit.client.0.smithi159.stdout:6/398: mkdir d0/d1b/d33/d11/d34/d80 0 2024-02-28T23:07:16.347 INFO:tasks.workunit.client.0.smithi159.stdout:8/549: dread d2/d3/f83 [0,4194304] 0 2024-02-28T23:07:16.348 INFO:tasks.workunit.client.1.smithi184.stdout:6/17: creat f5 x:0 0 0 2024-02-28T23:07:16.349 INFO:tasks.workunit.client.0.smithi159.stdout:5/483: rename d8/d19/d23/f7e to d8/d67/d88/fa6 0 2024-02-28T23:07:16.350 INFO:tasks.workunit.client.0.smithi159.stdout:2/369: dwrite d9/d36/d59/f6b [0,4194304] 0 2024-02-28T23:07:16.351 INFO:tasks.workunit.client.0.smithi159.stdout:2/370: stat f6 0 2024-02-28T23:07:16.352 INFO:tasks.workunit.client.1.smithi184.stdout:8/12: write d1/f2 [1564597,55656] 0 2024-02-28T23:07:16.354 INFO:tasks.workunit.client.1.smithi184.stdout:1/22: dwrite f9 [0,4194304] 0 2024-02-28T23:07:16.354 INFO:tasks.workunit.client.1.smithi184.stdout:6/18: symlink l6 0 2024-02-28T23:07:16.355 INFO:tasks.workunit.client.0.smithi159.stdout:8/550: creat d2/d3/d8c/fb4 x:0 0 0 2024-02-28T23:07:16.358 INFO:tasks.workunit.client.0.smithi159.stdout:5/484: creat d8/d19/d23/d35/d38/fa7 x:0 0 0 2024-02-28T23:07:16.360 INFO:tasks.workunit.client.0.smithi159.stdout:8/551: write d2/d11/d35/d5f/f92 [313284,128235] 0 2024-02-28T23:07:16.360 INFO:tasks.workunit.client.0.smithi159.stdout:2/371: creat d9/d34/f74 x:0 0 0 2024-02-28T23:07:16.361 INFO:tasks.workunit.client.1.smithi184.stdout:0/20: dwrite d0/f6 [0,4194304] 0 2024-02-28T23:07:16.369 INFO:tasks.workunit.client.0.smithi159.stdout:2/372: symlink d9/l75 0 2024-02-28T23:07:16.369 INFO:tasks.workunit.client.0.smithi159.stdout:5/485: rmdir d8/d19/d23/d35/d38/d6d 39 2024-02-28T23:07:16.369 INFO:tasks.workunit.client.0.smithi159.stdout:2/373: write d9/d23/d2c/d55/d13/d31/d37/f4d [7467234,95864] 0 2024-02-28T23:07:16.374 INFO:tasks.workunit.client.0.smithi159.stdout:2/374: write d9/d36/f5a [7791,129542] 0 2024-02-28T23:07:16.377 INFO:tasks.workunit.client.0.smithi159.stdout:5/486: truncate d8/d59/f80 1652193 0 2024-02-28T23:07:16.377 INFO:tasks.workunit.client.1.smithi184.stdout:7/13: dread f0 [0,4194304] 0 2024-02-28T23:07:16.379 INFO:tasks.workunit.client.0.smithi159.stdout:8/552: link d2/c6f d2/d11/d58/cb5 0 2024-02-28T23:07:16.381 INFO:tasks.workunit.client.0.smithi159.stdout:5/487: dread - d8/d67/d79/fa4 zero size 2024-02-28T23:07:16.381 INFO:tasks.workunit.client.0.smithi159.stdout:2/375: chown d9/d23/d2c/d55/d13/d31/f3b 60000388 1 2024-02-28T23:07:16.382 INFO:tasks.workunit.client.1.smithi184.stdout:8/13: read d1/f2 [1482198,54872] 0 2024-02-28T23:07:16.383 INFO:tasks.workunit.client.0.smithi159.stdout:7/334: sync 2024-02-28T23:07:16.384 INFO:tasks.workunit.client.1.smithi184.stdout:7/14: write f3 [855557,36314] 0 2024-02-28T23:07:16.386 INFO:tasks.workunit.client.0.smithi159.stdout:5/488: fdatasync d8/d16/f1e 0 2024-02-28T23:07:16.386 INFO:tasks.workunit.client.0.smithi159.stdout:0/540: write d0/d5/d14/d34/f7d [140356,48268] 0 2024-02-28T23:07:16.388 INFO:tasks.workunit.client.0.smithi159.stdout:2/376: readlink d9/d23/d2c/d55/l27 0 2024-02-28T23:07:16.393 INFO:tasks.workunit.client.0.smithi159.stdout:8/553: mkdir d2/d11/d52/d47/db6 0 2024-02-28T23:07:16.396 INFO:tasks.workunit.client.0.smithi159.stdout:1/437: truncate d6/d12/d16/f1c 1063579 0 2024-02-28T23:07:16.397 INFO:tasks.workunit.client.1.smithi184.stdout:1/23: dread f9 [0,4194304] 0 2024-02-28T23:07:16.397 INFO:tasks.workunit.client.1.smithi184.stdout:7/15: creat f4 x:0 0 0 2024-02-28T23:07:16.398 INFO:tasks.workunit.client.0.smithi159.stdout:1/438: chown l5 24168 1 2024-02-28T23:07:16.400 INFO:tasks.workunit.client.0.smithi159.stdout:1/439: write d6/d12/d33/d3c/f41 [202952,28884] 0 2024-02-28T23:07:16.401 INFO:tasks.workunit.client.0.smithi159.stdout:5/489: creat d8/d19/d23/d35/d38/d8f/da5/d90/fa8 x:0 0 0 2024-02-28T23:07:16.401 INFO:tasks.workunit.client.0.smithi159.stdout:2/377: read d9/f16 [441667,104925] 0 2024-02-28T23:07:16.403 INFO:tasks.workunit.client.1.smithi184.stdout:1/24: fsync f5 0 2024-02-28T23:07:16.404 INFO:tasks.workunit.client.0.smithi159.stdout:5/490: dread - d8/d19/d23/d2a/f32 zero size 2024-02-28T23:07:16.404 INFO:tasks.workunit.client.0.smithi159.stdout:6/399: write d0/fb [674103,25370] 0 2024-02-28T23:07:16.404 INFO:tasks.workunit.client.1.smithi184.stdout:7/16: creat f5 x:0 0 0 2024-02-28T23:07:16.405 INFO:tasks.workunit.client.0.smithi159.stdout:0/541: mknod d0/d5/d14/d25/d2c/dab/cc2 0 2024-02-28T23:07:16.406 INFO:tasks.workunit.client.0.smithi159.stdout:3/410: fdatasync d0/d6/d34/f45 0 2024-02-28T23:07:16.406 INFO:tasks.workunit.client.1.smithi184.stdout:0/21: dwrite d0/f6 [0,4194304] 0 2024-02-28T23:07:16.408 INFO:tasks.workunit.client.0.smithi159.stdout:3/411: readlink d0/l1a 0 2024-02-28T23:07:16.409 INFO:tasks.workunit.client.0.smithi159.stdout:6/400: truncate d0/d1b/d33/f59 741155 0 2024-02-28T23:07:16.409 INFO:tasks.workunit.client.1.smithi184.stdout:8/14: write d1/f2 [1943747,63244] 0 2024-02-28T23:07:16.409 INFO:tasks.workunit.client.1.smithi184.stdout:6/19: dwrite f3 [0,4194304] 0 2024-02-28T23:07:16.410 INFO:tasks.workunit.client.0.smithi159.stdout:6/401: stat d0/d1b/d33/d3f/d44 0 2024-02-28T23:07:16.415 INFO:tasks.workunit.client.0.smithi159.stdout:8/554: rename d2/d11/d52/d47/d65/l89 to d2/d11/d35/lb7 0 2024-02-28T23:07:16.415 INFO:tasks.workunit.client.0.smithi159.stdout:1/440: chown d6/d12/d33/d48/l8a 3026243 1 2024-02-28T23:07:16.415 INFO:tasks.workunit.client.1.smithi184.stdout:7/17: mkdir d6 0 2024-02-28T23:07:16.418 INFO:tasks.workunit.client.0.smithi159.stdout:8/555: chown d2/d11/l61 47 1 2024-02-28T23:07:16.421 INFO:tasks.workunit.client.0.smithi159.stdout:0/542: creat d0/d5/d14/d25/d2c/d4b/fc3 x:0 0 0 2024-02-28T23:07:16.423 INFO:tasks.workunit.client.0.smithi159.stdout:1/441: write d6/d1d/d1f/f81 [80122,123309] 0 2024-02-28T23:07:16.426 INFO:tasks.workunit.client.0.smithi159.stdout:6/402: creat d0/d1b/f81 x:0 0 0 2024-02-28T23:07:16.426 INFO:tasks.workunit.client.1.smithi184.stdout:8/15: creat d1/f5 x:0 0 0 2024-02-28T23:07:16.427 INFO:tasks.workunit.client.0.smithi159.stdout:1/442: chown d6/d12 95 1 2024-02-28T23:07:16.430 INFO:tasks.workunit.client.0.smithi159.stdout:5/491: dwrite d8/d19/d23/d35/d41/f87 [0,4194304] 0 2024-02-28T23:07:16.430 INFO:tasks.workunit.client.1.smithi184.stdout:0/22: dwrite d0/f2 [0,4194304] 0 2024-02-28T23:07:16.431 INFO:tasks.workunit.client.0.smithi159.stdout:2/378: dwrite d9/d50/d62/f68 [0,4194304] 0 2024-02-28T23:07:16.434 INFO:tasks.workunit.client.0.smithi159.stdout:6/403: write d0/d1b/d33/d11/d14/d5d/f6f [1361921,113748] 0 2024-02-28T23:07:16.436 INFO:tasks.workunit.client.1.smithi184.stdout:6/20: dwrite f3 [0,4194304] 0 2024-02-28T23:07:16.438 INFO:tasks.workunit.client.1.smithi184.stdout:8/16: mkdir d1/d6 0 2024-02-28T23:07:16.442 INFO:tasks.workunit.client.1.smithi184.stdout:7/18: creat d6/f7 x:0 0 0 2024-02-28T23:07:16.443 INFO:tasks.workunit.client.0.smithi159.stdout:8/556: write d2/d3/f30 [2945516,13720] 0 2024-02-28T23:07:16.443 INFO:tasks.workunit.client.1.smithi184.stdout:7/19: chown f5 8856895 1 2024-02-28T23:07:16.459 INFO:tasks.workunit.client.1.smithi184.stdout:6/21: unlink c4 0 2024-02-28T23:07:16.460 INFO:tasks.workunit.client.1.smithi184.stdout:6/22: chown f3 7 1 2024-02-28T23:07:16.462 INFO:tasks.workunit.client.0.smithi159.stdout:0/543: symlink d0/d5/d14/d25/d2c/d4b/lc4 0 2024-02-28T23:07:16.465 INFO:tasks.workunit.client.1.smithi184.stdout:8/17: dwrite d1/f2 [0,4194304] 0 2024-02-28T23:07:16.467 INFO:tasks.workunit.client.1.smithi184.stdout:1/25: truncate f9 3220081 0 2024-02-28T23:07:16.467 INFO:tasks.workunit.client.0.smithi159.stdout:8/557: dread d2/d11/d52/d26/d36/d38/f5d [0,4194304] 0 2024-02-28T23:07:16.468 INFO:tasks.workunit.client.1.smithi184.stdout:7/20: rename d6/f7 to d6/f8 0 2024-02-28T23:07:16.471 INFO:tasks.workunit.client.0.smithi159.stdout:8/558: chown d2/d11/d52/d26 347135626 1 2024-02-28T23:07:16.472 INFO:tasks.workunit.client.1.smithi184.stdout:7/21: write f3 [771814,86170] 0 2024-02-28T23:07:16.473 INFO:tasks.workunit.client.0.smithi159.stdout:3/412: truncate d0/d6/d3e/f1e 1431335 0 2024-02-28T23:07:16.477 INFO:tasks.workunit.client.1.smithi184.stdout:8/18: mknod d1/d6/c7 0 2024-02-28T23:07:16.479 INFO:tasks.workunit.client.1.smithi184.stdout:7/22: mkdir d6/d9 0 2024-02-28T23:07:16.479 INFO:tasks.workunit.client.1.smithi184.stdout:8/19: readlink d1/l3 0 2024-02-28T23:07:16.481 INFO:tasks.workunit.client.1.smithi184.stdout:8/20: dread - d1/f5 zero size 2024-02-28T23:07:16.481 INFO:tasks.workunit.client.0.smithi159.stdout:0/544: mkdir d0/d5/d14/d25/d2c/dab/dc5 0 2024-02-28T23:07:16.483 INFO:tasks.workunit.client.1.smithi184.stdout:8/21: chown d1/l4 39 1 2024-02-28T23:07:16.486 INFO:tasks.workunit.client.1.smithi184.stdout:8/22: fsync d1/f5 0 2024-02-28T23:07:16.486 INFO:tasks.workunit.client.0.smithi159.stdout:0/545: chown d0/d5/d14/d78/l9f 125571 1 2024-02-28T23:07:16.486 INFO:tasks.workunit.client.0.smithi159.stdout:3/413: symlink d0/d6/d34/l7d 0 2024-02-28T23:07:16.487 INFO:tasks.workunit.client.0.smithi159.stdout:1/443: mknod d6/d1d/c8e 0 2024-02-28T23:07:16.487 INFO:tasks.workunit.client.0.smithi159.stdout:6/404: mkdir d0/d82 0 2024-02-28T23:07:16.487 INFO:tasks.workunit.client.1.smithi184.stdout:7/23: mkdir d6/d9/da 0 2024-02-28T23:07:16.488 INFO:tasks.workunit.client.0.smithi159.stdout:0/546: readlink d0/de/d75/l8d 0 2024-02-28T23:07:16.488 INFO:tasks.workunit.client.1.smithi184.stdout:7/24: fdatasync f4 0 2024-02-28T23:07:16.489 INFO:tasks.workunit.client.1.smithi184.stdout:0/23: fsync d0/f2 0 2024-02-28T23:07:16.490 INFO:tasks.workunit.client.1.smithi184.stdout:7/25: dread - f4 zero size 2024-02-28T23:07:16.491 INFO:tasks.workunit.client.1.smithi184.stdout:1/26: dwrite f5 [0,4194304] 0 2024-02-28T23:07:16.492 INFO:tasks.workunit.client.0.smithi159.stdout:2/379: creat d9/f76 x:0 0 0 2024-02-28T23:07:16.496 INFO:tasks.workunit.client.1.smithi184.stdout:0/24: creat d0/fa x:0 0 0 2024-02-28T23:07:16.498 INFO:tasks.workunit.client.1.smithi184.stdout:0/25: write d0/fa [43919,94822] 0 2024-02-28T23:07:16.502 INFO:tasks.workunit.client.1.smithi184.stdout:8/23: dread d1/f2 [0,4194304] 0 2024-02-28T23:07:16.502 INFO:tasks.workunit.client.1.smithi184.stdout:1/27: creat fa x:0 0 0 2024-02-28T23:07:16.503 INFO:tasks.workunit.client.0.smithi159.stdout:6/405: dwrite d0/d1b/d33/f5f [0,4194304] 0 2024-02-28T23:07:16.504 INFO:tasks.workunit.client.0.smithi159.stdout:1/444: symlink d6/d1d/l8f 0 2024-02-28T23:07:16.505 INFO:tasks.workunit.client.0.smithi159.stdout:8/559: link d2/d73/c8b d2/d11/d52/d26/d36/d38/d77/d79/cb8 0 2024-02-28T23:07:16.511 INFO:tasks.workunit.client.1.smithi184.stdout:0/26: unlink d0/fa 0 2024-02-28T23:07:16.511 INFO:tasks.workunit.client.0.smithi159.stdout:8/560: write d2/d11/d52/d26/fa7 [878175,83196] 0 2024-02-28T23:07:16.512 INFO:tasks.workunit.client.0.smithi159.stdout:3/414: mknod d0/d6/c7e 0 2024-02-28T23:07:16.512 INFO:tasks.workunit.client.0.smithi159.stdout:6/406: chown d0/d1b/d38/d4d/c78 3 1 2024-02-28T23:07:16.517 INFO:tasks.workunit.client.1.smithi184.stdout:7/26: dwrite f4 [0,4194304] 0 2024-02-28T23:07:16.517 INFO:tasks.workunit.client.1.smithi184.stdout:1/28: chown l6 9 1 2024-02-28T23:07:16.517 INFO:tasks.workunit.client.0.smithi159.stdout:8/561: dread - d2/d11/d52/d47/d7c/fae zero size 2024-02-28T23:07:16.518 INFO:tasks.workunit.client.0.smithi159.stdout:2/380: symlink d9/d36/d59/l77 0 2024-02-28T23:07:16.518 INFO:tasks.workunit.client.0.smithi159.stdout:0/547: dwrite d0/d5/d14/d34/f9e [0,4194304] 0 2024-02-28T23:07:16.520 INFO:tasks.workunit.client.1.smithi184.stdout:8/24: mknod d1/c8 0 2024-02-28T23:07:16.523 INFO:tasks.workunit.client.0.smithi159.stdout:8/562: write d2/d11/d52/d26/f7f [358693,45451] 0 2024-02-28T23:07:16.526 INFO:tasks.workunit.client.1.smithi184.stdout:7/27: dread f0 [0,4194304] 0 2024-02-28T23:07:16.527 INFO:tasks.workunit.client.1.smithi184.stdout:7/28: dread - f5 zero size 2024-02-28T23:07:16.532 INFO:tasks.workunit.client.0.smithi159.stdout:4/528: sync 2024-02-28T23:07:16.532 INFO:tasks.workunit.client.0.smithi159.stdout:9/479: sync 2024-02-28T23:07:16.532 INFO:tasks.workunit.client.1.smithi184.stdout:0/27: chown d0/c9 2 1 2024-02-28T23:07:16.533 INFO:tasks.workunit.client.1.smithi184.stdout:1/29: unlink l3 0 2024-02-28T23:07:16.534 INFO:tasks.workunit.client.0.smithi159.stdout:9/480: chown d4/fe 11 1 2024-02-28T23:07:16.534 INFO:tasks.workunit.client.0.smithi159.stdout:1/445: dwrite d6/d1d/d46/f82 [0,4194304] 0 2024-02-28T23:07:16.536 INFO:tasks.workunit.client.0.smithi159.stdout:4/529: write d9/da/d1c/d23/d2d/f8d [1591177,83608] 0 2024-02-28T23:07:16.538 INFO:tasks.workunit.client.1.smithi184.stdout:8/25: symlink d1/l9 0 2024-02-28T23:07:16.539 INFO:tasks.workunit.client.1.smithi184.stdout:8/26: readlink d1/l9 0 2024-02-28T23:07:16.542 INFO:tasks.workunit.client.0.smithi159.stdout:4/530: write d9/da/d1c/d23/f63 [1454498,19762] 0 2024-02-28T23:07:16.543 INFO:tasks.workunit.client.1.smithi184.stdout:1/30: creat fb x:0 0 0 2024-02-28T23:07:16.545 INFO:tasks.workunit.client.0.smithi159.stdout:5/492: dwrite d8/d19/d23/f4f [0,4194304] 0 2024-02-28T23:07:16.546 INFO:tasks.workunit.client.1.smithi184.stdout:0/28: rename d0/f2 to d0/fb 0 2024-02-28T23:07:16.546 INFO:tasks.workunit.client.1.smithi184.stdout:1/31: write f2 [3937331,1846] 0 2024-02-28T23:07:16.550 INFO:tasks.workunit.client.1.smithi184.stdout:1/32: truncate fa 59837 0 2024-02-28T23:07:16.550 INFO:tasks.workunit.client.1.smithi184.stdout:7/29: dwrite f5 [0,4194304] 0 2024-02-28T23:07:16.550 INFO:tasks.workunit.client.0.smithi159.stdout:2/381: rename d9/d23/d2c/d55/d13/d31/c61 to d9/d23/d2c/d55/d13/d31/d37/c78 0 2024-02-28T23:07:16.552 INFO:tasks.workunit.client.1.smithi184.stdout:7/30: write f4 [1725301,40532] 0 2024-02-28T23:07:16.555 INFO:tasks.workunit.client.1.smithi184.stdout:7/31: rename d6 to d6/d9/db 22 2024-02-28T23:07:16.556 INFO:tasks.workunit.client.1.smithi184.stdout:7/32: dread - d6/f8 zero size 2024-02-28T23:07:16.566 INFO:tasks.workunit.client.1.smithi184.stdout:0/29: creat d0/fc x:0 0 0 2024-02-28T23:07:16.570 INFO:tasks.workunit.client.1.smithi184.stdout:7/33: mkdir d6/d9/da/dc 0 2024-02-28T23:07:16.570 INFO:tasks.workunit.client.0.smithi159.stdout:3/415: creat d0/d6/d3e/f7f x:0 0 0 2024-02-28T23:07:16.570 INFO:tasks.workunit.client.0.smithi159.stdout:0/548: write d0/d5/d38/d63/f7c [857317,37178] 0 2024-02-28T23:07:16.572 INFO:tasks.workunit.client.0.smithi159.stdout:4/531: mkdir d9/d42/db1 0 2024-02-28T23:07:16.574 INFO:tasks.workunit.client.0.smithi159.stdout:6/407: rmdir d0/d1b/d33/d11/d34/d80 0 2024-02-28T23:07:16.579 INFO:tasks.workunit.client.0.smithi159.stdout:2/382: creat d9/d23/d2c/f79 x:0 0 0 2024-02-28T23:07:16.580 INFO:tasks.workunit.client.1.smithi184.stdout:8/27: dwrite d1/f2 [4194304,4194304] 0 2024-02-28T23:07:16.580 INFO:tasks.workunit.client.0.smithi159.stdout:5/493: dread d8/d19/d23/d2a/f4e [0,4194304] 0 2024-02-28T23:07:16.583 INFO:tasks.workunit.client.1.smithi184.stdout:0/30: dread d0/fb [0,4194304] 0 2024-02-28T23:07:16.585 INFO:tasks.workunit.client.1.smithi184.stdout:0/31: chown d0 22173 1 2024-02-28T23:07:16.587 INFO:tasks.workunit.client.1.smithi184.stdout:7/34: dread f4 [0,4194304] 0 2024-02-28T23:07:16.590 INFO:tasks.workunit.client.0.smithi159.stdout:8/563: creat d2/d11/d35/d9c/da0/fb9 x:0 0 0 2024-02-28T23:07:16.593 INFO:tasks.workunit.client.0.smithi159.stdout:4/532: dwrite d9/d20/f84 [0,4194304] 0 2024-02-28T23:07:16.595 INFO:tasks.workunit.client.0.smithi159.stdout:8/564: stat d2/d11/d52/d47/d65/d68 0 2024-02-28T23:07:16.597 INFO:tasks.workunit.client.1.smithi184.stdout:1/33: link f5 fc 0 2024-02-28T23:07:16.598 INFO:tasks.workunit.client.0.smithi159.stdout:1/446: symlink d6/d12/d31/l90 0 2024-02-28T23:07:16.599 INFO:tasks.workunit.client.1.smithi184.stdout:1/34: chown fc 269084377 1 2024-02-28T23:07:16.600 INFO:tasks.workunit.client.1.smithi184.stdout:8/28: dwrite d1/f5 [0,4194304] 0 2024-02-28T23:07:16.601 INFO:tasks.workunit.client.1.smithi184.stdout:8/29: stat d1/c8 0 2024-02-28T23:07:16.606 INFO:tasks.workunit.client.1.smithi184.stdout:0/32: mkdir d0/dd 0 2024-02-28T23:07:16.610 INFO:tasks.workunit.client.1.smithi184.stdout:7/35: symlink d6/ld 0 2024-02-28T23:07:16.611 INFO:tasks.workunit.client.1.smithi184.stdout:7/36: stat l2 0 2024-02-28T23:07:16.613 INFO:tasks.workunit.client.0.smithi159.stdout:2/383: dwrite d9/d23/d2c/d55/f72 [0,4194304] 0 2024-02-28T23:07:16.614 INFO:tasks.workunit.client.0.smithi159.stdout:7/335: sync 2024-02-28T23:07:16.614 INFO:tasks.workunit.client.0.smithi159.stdout:4/533: dread d9/d20/f84 [0,4194304] 0 2024-02-28T23:07:16.625 INFO:tasks.workunit.client.1.smithi184.stdout:8/30: mkdir d1/da 0 2024-02-28T23:07:16.625 INFO:tasks.workunit.client.0.smithi159.stdout:4/534: stat d9/da/d1c/d23/d2d/fac 0 2024-02-28T23:07:16.626 INFO:tasks.workunit.client.1.smithi184.stdout:8/31: chown d1/c8 8 1 2024-02-28T23:07:16.627 INFO:tasks.workunit.client.1.smithi184.stdout:1/35: dread f2 [4194304,4194304] 0 2024-02-28T23:07:16.627 INFO:tasks.workunit.client.0.smithi159.stdout:9/481: link d4/d52/l8c d4/l9a 0 2024-02-28T23:07:16.630 INFO:tasks.workunit.client.0.smithi159.stdout:3/416: symlink d0/d2b/d55/d75/d6d/d54/d6a/l80 0 2024-02-28T23:07:16.633 INFO:tasks.workunit.client.0.smithi159.stdout:3/417: truncate d0/d6/d3e/d57/f58 261322 0 2024-02-28T23:07:16.634 INFO:tasks.workunit.client.0.smithi159.stdout:1/447: rename d6/d12/l32 to d6/d12/d33/d3c/l91 0 2024-02-28T23:07:16.638 INFO:tasks.workunit.client.0.smithi159.stdout:0/549: link d0/d5/d14/d25/fb4 d0/d5/d14/d34/d6c/daf/fc6 0 2024-02-28T23:07:16.638 INFO:tasks.workunit.client.0.smithi159.stdout:6/408: mknod d0/d1b/d38/d4e/d72/c83 0 2024-02-28T23:07:16.639 INFO:tasks.workunit.client.0.smithi159.stdout:5/494: mknod d8/d19/d23/d35/d65/da3/ca9 0 2024-02-28T23:07:16.642 INFO:tasks.workunit.client.0.smithi159.stdout:2/384: rename d9/d23/d2c/d55/l4b to d9/d36/d59/l7a 0 2024-02-28T23:07:16.642 INFO:tasks.workunit.client.1.smithi184.stdout:8/32: dread d1/f2 [4194304,4194304] 0 2024-02-28T23:07:16.644 INFO:tasks.workunit.client.0.smithi159.stdout:4/535: mknod d9/cb2 0 2024-02-28T23:07:16.645 INFO:tasks.workunit.client.0.smithi159.stdout:6/409: write d0/d1b/f1a [191979,117506] 0 2024-02-28T23:07:16.650 INFO:tasks.workunit.client.0.smithi159.stdout:9/482: write d4/d3d/d3e/d55/d37/d62/f74 [3334082,49743] 0 2024-02-28T23:07:16.651 INFO:tasks.workunit.client.1.smithi184.stdout:8/33: mknod d1/d6/cb 0 2024-02-28T23:07:16.652 INFO:tasks.workunit.client.0.smithi159.stdout:3/418: creat d0/d2b/d55/d75/d6d/d54/d63/f81 x:0 0 0 2024-02-28T23:07:16.655 INFO:tasks.workunit.client.1.smithi184.stdout:0/33: dwrite d0/fb [4194304,4194304] 0 2024-02-28T23:07:16.657 INFO:tasks.workunit.client.0.smithi159.stdout:7/336: rename d5/d16/d40/c43 to d5/d56/d50/c6c 0 2024-02-28T23:07:16.658 INFO:tasks.workunit.client.0.smithi159.stdout:0/550: creat d0/d5/d38/d76/d96/fc7 x:0 0 0 2024-02-28T23:07:16.661 INFO:tasks.workunit.client.0.smithi159.stdout:1/448: dwrite d6/d12/d31/d69/f77 [0,4194304] 0 2024-02-28T23:07:16.663 INFO:tasks.workunit.client.1.smithi184.stdout:1/36: dwrite fc [0,4194304] 0 2024-02-28T23:07:16.664 INFO:tasks.workunit.client.1.smithi184.stdout:8/34: dread d1/f2 [0,4194304] 0 2024-02-28T23:07:16.666 INFO:tasks.workunit.client.0.smithi159.stdout:4/536: creat d9/d42/d54/d56/fb3 x:0 0 0 2024-02-28T23:07:16.667 INFO:tasks.workunit.client.0.smithi159.stdout:6/410: read d0/f7 [2976870,83237] 0 2024-02-28T23:07:16.668 INFO:tasks.workunit.client.0.smithi159.stdout:3/419: dread d0/d6/d3e/d2f/f56 [0,4194304] 0 2024-02-28T23:07:16.670 INFO:tasks.workunit.client.0.smithi159.stdout:3/420: chown d0/l1a 1652 1 2024-02-28T23:07:16.676 INFO:tasks.workunit.client.0.smithi159.stdout:9/483: creat d4/d3d/d3e/d55/d37/f9b x:0 0 0 2024-02-28T23:07:16.678 INFO:tasks.workunit.client.0.smithi159.stdout:9/484: stat d4/d3d/d3e/d55/d37/d62/f74 0 2024-02-28T23:07:16.679 INFO:tasks.workunit.client.0.smithi159.stdout:1/449: dread d6/d12/d31/d69/f77 [0,4194304] 0 2024-02-28T23:07:16.682 INFO:tasks.workunit.client.0.smithi159.stdout:2/385: link d9/d36/f5a d9/d23/d2c/d55/d13/d31/d37/d5c/f7b 0 2024-02-28T23:07:16.685 INFO:tasks.workunit.client.0.smithi159.stdout:3/421: creat d0/f82 x:0 0 0 2024-02-28T23:07:16.690 INFO:tasks.workunit.client.0.smithi159.stdout:1/450: write d6/d12/d33/d3c/f4b [1718723,52320] 0 2024-02-28T23:07:16.707 INFO:tasks.workunit.client.0.smithi159.stdout:1/451: dwrite d6/d1d/d1f/d3e/d6a/f6f [0,4194304] 0 2024-02-28T23:07:16.709 INFO:tasks.workunit.client.0.smithi159.stdout:9/485: creat d4/d3d/d3e/d55/d4c/d4e/f9c x:0 0 0 2024-02-28T23:07:16.712 INFO:tasks.workunit.client.0.smithi159.stdout:9/486: truncate d4/d3d/d3e/d55/d4c/d4e/f63 1046179 0 2024-02-28T23:07:16.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:16 smithi159 ceph-mon[28802]: pgmap v27: 65 pgs: 65 active+clean; 1.0 GiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 22 MiB/s rd, 120 MiB/s wr, 307 op/s 2024-02-28T23:07:16.735 INFO:tasks.workunit.client.0.smithi159.stdout:0/551: truncate d0/d5/d14/d25/f77 214500 0 2024-02-28T23:07:16.737 INFO:tasks.workunit.client.0.smithi159.stdout:0/552: fsync d0/d5/d14/d34/d3d/f65 0 2024-02-28T23:07:16.737 INFO:tasks.workunit.client.0.smithi159.stdout:4/537: creat d9/d42/db1/fb4 x:0 0 0 2024-02-28T23:07:16.739 INFO:tasks.workunit.client.0.smithi159.stdout:2/386: symlink d9/d36/l7c 0 2024-02-28T23:07:16.744 INFO:tasks.workunit.client.0.smithi159.stdout:5/495: getdents d8/d19 0 2024-02-28T23:07:16.746 INFO:tasks.workunit.client.0.smithi159.stdout:5/496: dread - d8/d19/d23/d2a/f9f zero size 2024-02-28T23:07:16.750 INFO:tasks.workunit.client.0.smithi159.stdout:1/452: mkdir d6/d12/d1a/d92 0 2024-02-28T23:07:16.752 INFO:tasks.workunit.client.0.smithi159.stdout:1/453: fsync d6/d12/d33/d48/f4a 0 2024-02-28T23:07:16.756 INFO:tasks.workunit.client.0.smithi159.stdout:9/487: write d4/d52/d7d/f81 [586514,61424] 0 2024-02-28T23:07:16.757 INFO:tasks.workunit.client.0.smithi159.stdout:4/538: dread - d9/da/d1c/d23/f4d zero size 2024-02-28T23:07:16.762 INFO:tasks.workunit.client.0.smithi159.stdout:5/497: rename d8/d67 to d8/d19/d23/d35/d41/daa 0 2024-02-28T23:07:16.766 INFO:tasks.workunit.client.0.smithi159.stdout:6/411: write d0/f7 [4861346,116872] 0 2024-02-28T23:07:16.768 INFO:tasks.workunit.client.0.smithi159.stdout:6/412: readlink d0/d1b/d33/d11/d14/l1c 0 2024-02-28T23:07:16.775 INFO:tasks.workunit.client.0.smithi159.stdout:6/413: rmdir d0/d1b/d33/d11/d34 39 2024-02-28T23:07:16.779 INFO:tasks.workunit.client.0.smithi159.stdout:3/422: fsync d0/d2b/d55/d75/d6d/f3d 0 2024-02-28T23:07:16.788 INFO:tasks.workunit.client.0.smithi159.stdout:2/387: getdents d9/d23 0 2024-02-28T23:07:16.793 INFO:tasks.workunit.client.0.smithi159.stdout:2/388: fdatasync d9/d23/d2c/d55/f17 0 2024-02-28T23:07:16.804 INFO:tasks.workunit.client.0.smithi159.stdout:3/423: getdents d0/d2b/d55/d75/d6d 0 2024-02-28T23:07:16.808 INFO:tasks.workunit.client.0.smithi159.stdout:2/389: dwrite d9/d34/f3a [0,4194304] 0 2024-02-28T23:07:16.811 INFO:tasks.workunit.client.0.smithi159.stdout:2/390: chown d9/d23/d2c/d55/d13/d31/d37/c3d 157499 1 2024-02-28T23:07:16.828 INFO:tasks.workunit.client.0.smithi159.stdout:3/424: dwrite d0/d6/d3e/f4a [0,4194304] 0 2024-02-28T23:07:16.830 INFO:tasks.workunit.client.0.smithi159.stdout:2/391: dwrite d9/d23/d2c/d55/f72 [0,4194304] 0 2024-02-28T23:07:16.838 INFO:tasks.workunit.client.0.smithi159.stdout:2/392: creat d9/d36/d59/f7d x:0 0 0 2024-02-28T23:07:16.840 INFO:tasks.workunit.client.0.smithi159.stdout:2/393: write d9/d36/d59/f6b [611442,78699] 0 2024-02-28T23:07:16.848 INFO:tasks.workunit.client.0.smithi159.stdout:2/394: creat d9/d36/f7e x:0 0 0 2024-02-28T23:07:16.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:16 smithi184 ceph-mon[36198]: pgmap v27: 65 pgs: 65 active+clean; 1.0 GiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 22 MiB/s rd, 120 MiB/s wr, 307 op/s 2024-02-28T23:07:16.884 INFO:tasks.workunit.client.0.smithi159.stdout:5/498: truncate d8/f34 418182 0 2024-02-28T23:07:16.887 INFO:tasks.workunit.client.0.smithi159.stdout:5/499: fdatasync d8/d19/d23/d35/d41/f58 0 2024-02-28T23:07:16.888 INFO:tasks.workunit.client.0.smithi159.stdout:6/414: write d0/d1b/d33/d11/d14/d49/f5c [3576561,101356] 0 2024-02-28T23:07:16.892 INFO:tasks.workunit.client.1.smithi184.stdout:0/34: creat d0/fe x:0 0 0 2024-02-28T23:07:16.893 INFO:tasks.workunit.client.0.smithi159.stdout:6/415: creat d0/d1b/d38/d4d/f84 x:0 0 0 2024-02-28T23:07:16.894 INFO:tasks.workunit.client.0.smithi159.stdout:6/416: stat d0/d1b/f81 0 2024-02-28T23:07:16.899 INFO:tasks.workunit.client.0.smithi159.stdout:5/500: link d8/d19/f78 d8/d16/fab 0 2024-02-28T23:07:16.901 INFO:tasks.workunit.client.0.smithi159.stdout:6/417: symlink d0/d1b/d33/d11/d14/d49/l85 0 2024-02-28T23:07:16.902 INFO:tasks.workunit.client.1.smithi184.stdout:1/37: dread f5 [0,4194304] 0 2024-02-28T23:07:16.902 INFO:tasks.workunit.client.1.smithi184.stdout:8/35: mkdir d1/da/dc 0 2024-02-28T23:07:16.905 INFO:tasks.workunit.client.0.smithi159.stdout:6/418: mkdir d0/d1b/d38/d4e/d86 0 2024-02-28T23:07:16.907 INFO:tasks.workunit.client.1.smithi184.stdout:1/38: write fc [2596666,22090] 0 2024-02-28T23:07:16.909 INFO:tasks.workunit.client.1.smithi184.stdout:8/36: mknod d1/d6/cd 0 2024-02-28T23:07:16.909 INFO:tasks.workunit.client.1.smithi184.stdout:0/35: rmdir d0/dd 0 2024-02-28T23:07:16.909 INFO:tasks.workunit.client.0.smithi159.stdout:6/419: creat d0/d1b/d33/d5e/f87 x:0 0 0 2024-02-28T23:07:16.910 INFO:tasks.workunit.client.1.smithi184.stdout:0/36: chown d0 230 1 2024-02-28T23:07:16.912 INFO:tasks.workunit.client.1.smithi184.stdout:8/37: mknod d1/ce 0 2024-02-28T23:07:16.912 INFO:tasks.workunit.client.1.smithi184.stdout:0/37: write d0/fb [6258048,35328] 0 2024-02-28T23:07:16.914 INFO:tasks.workunit.client.1.smithi184.stdout:0/38: fdatasync d0/f6 0 2024-02-28T23:07:16.917 INFO:tasks.workunit.client.1.smithi184.stdout:0/39: write d0/fb [3324283,73333] 0 2024-02-28T23:07:16.918 INFO:tasks.workunit.client.0.smithi159.stdout:8/565: sync 2024-02-28T23:07:16.918 INFO:tasks.workunit.client.1.smithi184.stdout:0/40: dread - d0/fc zero size 2024-02-28T23:07:16.921 INFO:tasks.workunit.client.0.smithi159.stdout:8/566: unlink d2/d3/f29 0 2024-02-28T23:07:16.923 INFO:tasks.workunit.client.1.smithi184.stdout:0/41: mkdir d0/df 0 2024-02-28T23:07:16.924 INFO:tasks.workunit.client.1.smithi184.stdout:0/42: stat d0/fc 0 2024-02-28T23:07:16.928 INFO:tasks.workunit.client.1.smithi184.stdout:8/38: dwrite d1/f5 [0,4194304] 0 2024-02-28T23:07:16.930 INFO:tasks.workunit.client.0.smithi159.stdout:5/501: dread d8/f14 [0,4194304] 0 2024-02-28T23:07:16.934 INFO:tasks.workunit.client.0.smithi159.stdout:4/539: symlink d9/d42/lb5 0 2024-02-28T23:07:16.935 INFO:tasks.workunit.client.0.smithi159.stdout:5/502: creat d8/d19/d23/d35/d65/fac x:0 0 0 2024-02-28T23:07:16.938 INFO:tasks.workunit.client.1.smithi184.stdout:0/43: dread d0/fb [0,4194304] 0 2024-02-28T23:07:16.938 INFO:tasks.workunit.client.1.smithi184.stdout:0/44: stat d0 0 2024-02-28T23:07:16.939 INFO:tasks.workunit.client.1.smithi184.stdout:0/45: write d0/fe [214818,129486] 0 2024-02-28T23:07:16.940 INFO:tasks.workunit.client.1.smithi184.stdout:8/39: dread d1/f2 [0,4194304] 0 2024-02-28T23:07:16.941 INFO:tasks.workunit.client.1.smithi184.stdout:8/40: chown d1/l4 728 1 2024-02-28T23:07:16.943 INFO:tasks.workunit.client.0.smithi159.stdout:3/425: truncate d0/d6/d3e/d2f/f4b 487536 0 2024-02-28T23:07:16.948 INFO:tasks.workunit.client.0.smithi159.stdout:0/553: dwrite d0/d5/d14/d25/f77 [0,4194304] 0 2024-02-28T23:07:16.950 INFO:tasks.workunit.client.0.smithi159.stdout:2/395: creat d9/d23/f7f x:0 0 0 2024-02-28T23:07:16.951 INFO:tasks.workunit.client.1.smithi184.stdout:0/46: getdents d0/df 0 2024-02-28T23:07:16.951 INFO:tasks.workunit.client.0.smithi159.stdout:2/396: stat d9/d23/d2c/d55/d13/c51 0 2024-02-28T23:07:16.955 INFO:tasks.workunit.client.1.smithi184.stdout:0/47: symlink d0/l10 0 2024-02-28T23:07:16.960 INFO:tasks.workunit.client.1.smithi184.stdout:8/41: dwrite d1/f2 [0,4194304] 0 2024-02-28T23:07:16.962 INFO:tasks.workunit.client.1.smithi184.stdout:0/48: getdents d0/df 0 2024-02-28T23:07:16.967 INFO:tasks.workunit.client.1.smithi184.stdout:8/42: mkdir d1/da/df 0 2024-02-28T23:07:16.968 INFO:tasks.workunit.client.1.smithi184.stdout:8/43: write d1/f5 [490017,102718] 0 2024-02-28T23:07:16.969 INFO:tasks.workunit.client.0.smithi159.stdout:2/397: dwrite d9/d36/f7e [0,4194304] 0 2024-02-28T23:07:16.970 INFO:tasks.workunit.client.1.smithi184.stdout:0/49: readlink d0/l8 0 2024-02-28T23:07:16.970 INFO:tasks.workunit.client.1.smithi184.stdout:8/44: chown d1/da/dc 425962531 1 2024-02-28T23:07:16.976 INFO:tasks.workunit.client.1.smithi184.stdout:8/45: mkdir d1/da/d10 0 2024-02-28T23:07:16.990 INFO:tasks.workunit.client.1.smithi184.stdout:8/46: dread d1/f2 [0,4194304] 0 2024-02-28T23:07:16.990 INFO:tasks.workunit.client.0.smithi159.stdout:4/540: creat d9/d4c/d6c/d98/fb6 x:0 0 0 2024-02-28T23:07:16.992 INFO:tasks.workunit.client.1.smithi184.stdout:8/47: readlink d1/l4 0 2024-02-28T23:07:16.992 INFO:tasks.workunit.client.0.smithi159.stdout:5/503: chown d8/d19/d23/d35/d38/d6d/f74 81 1 2024-02-28T23:07:16.993 INFO:tasks.workunit.client.0.smithi159.stdout:3/426: fsync d0/d6/d34/f41 0 2024-02-28T23:07:16.999 INFO:tasks.workunit.client.0.smithi159.stdout:4/541: creat d9/d4c/fb7 x:0 0 0 2024-02-28T23:07:16.999 INFO:tasks.workunit.client.0.smithi159.stdout:0/554: creat d0/d5/d14/d25/db5/fc8 x:0 0 0 2024-02-28T23:07:16.999 INFO:tasks.workunit.client.1.smithi184.stdout:8/48: mknod d1/da/df/c11 0 2024-02-28T23:07:17.001 INFO:tasks.workunit.client.0.smithi159.stdout:2/398: mkdir d9/d80 0 2024-02-28T23:07:17.003 INFO:tasks.workunit.client.0.smithi159.stdout:4/542: creat d9/d20/d87/fb8 x:0 0 0 2024-02-28T23:07:17.005 INFO:tasks.workunit.client.1.smithi184.stdout:8/49: mknod d1/da/dc/c12 0 2024-02-28T23:07:17.006 INFO:tasks.workunit.client.1.smithi184.stdout:1/39: write f9 [885065,123689] 0 2024-02-28T23:07:17.007 INFO:tasks.workunit.client.1.smithi184.stdout:8/50: write d1/f5 [1354743,113327] 0 2024-02-28T23:07:17.007 INFO:tasks.workunit.client.0.smithi159.stdout:5/504: creat d8/d19/d23/d35/d41/d77/fad x:0 0 0 2024-02-28T23:07:17.009 INFO:tasks.workunit.client.1.smithi184.stdout:1/40: write f5 [4492169,2150] 0 2024-02-28T23:07:17.011 INFO:tasks.workunit.client.0.smithi159.stdout:2/399: rename d9/d34/f3a to d9/d34/d44/f81 0 2024-02-28T23:07:17.011 INFO:tasks.workunit.client.0.smithi159.stdout:6/420: write d0/d1b/f1f [5175185,129916] 0 2024-02-28T23:07:17.012 INFO:tasks.workunit.client.0.smithi159.stdout:0/555: creat d0/d5/d14/d25/d2c/dab/dc5/fc9 x:0 0 0 2024-02-28T23:07:17.013 INFO:tasks.workunit.client.0.smithi159.stdout:2/400: fsync d9/f76 0 2024-02-28T23:07:17.014 INFO:tasks.workunit.client.0.smithi159.stdout:6/421: fdatasync d0/d1b/d33/f59 0 2024-02-28T23:07:17.016 INFO:tasks.workunit.client.0.smithi159.stdout:2/401: readlink d9/d23/d2c/l47 0 2024-02-28T23:07:17.016 INFO:tasks.workunit.client.1.smithi184.stdout:8/51: creat d1/d6/f13 x:0 0 0 2024-02-28T23:07:17.018 INFO:tasks.workunit.client.0.smithi159.stdout:3/427: creat d0/d6/f83 x:0 0 0 2024-02-28T23:07:17.020 INFO:tasks.workunit.client.1.smithi184.stdout:1/41: write fb [667888,35166] 0 2024-02-28T23:07:17.021 INFO:tasks.workunit.client.1.smithi184.stdout:1/42: read fc [4139950,9551] 0 2024-02-28T23:07:17.021 INFO:tasks.workunit.client.0.smithi159.stdout:3/428: chown d0/d6/lf 213773340 1 2024-02-28T23:07:17.021 INFO:tasks.workunit.client.1.smithi184.stdout:1/43: stat fb 0 2024-02-28T23:07:17.023 INFO:tasks.workunit.client.0.smithi159.stdout:4/543: dwrite d9/da/f7e [0,4194304] 0 2024-02-28T23:07:17.027 INFO:tasks.workunit.client.0.smithi159.stdout:4/544: truncate d9/d20/d87/fb8 608822 0 2024-02-28T23:07:17.035 INFO:tasks.workunit.client.0.smithi159.stdout:2/402: creat d9/d23/d2c/f82 x:0 0 0 2024-02-28T23:07:17.035 INFO:tasks.workunit.client.0.smithi159.stdout:3/429: mknod d0/d2b/d4f/c84 0 2024-02-28T23:07:17.035 INFO:tasks.workunit.client.0.smithi159.stdout:3/430: fsync d0/d2b/f26 0 2024-02-28T23:07:17.036 INFO:tasks.workunit.client.1.smithi184.stdout:1/44: mknod cd 0 2024-02-28T23:07:17.037 INFO:tasks.workunit.client.1.smithi184.stdout:8/52: link d1/l4 d1/l14 0 2024-02-28T23:07:17.039 INFO:tasks.workunit.client.0.smithi159.stdout:4/545: mknod d9/d42/cb9 0 2024-02-28T23:07:17.040 INFO:tasks.workunit.client.0.smithi159.stdout:2/403: fsync d9/f11 0 2024-02-28T23:07:17.040 INFO:tasks.workunit.client.0.smithi159.stdout:2/404: stat d9/f11 0 2024-02-28T23:07:17.041 INFO:tasks.workunit.client.1.smithi184.stdout:1/45: truncate f2 2121621 0 2024-02-28T23:07:17.042 INFO:tasks.workunit.client.1.smithi184.stdout:8/53: creat d1/da/dc/f15 x:0 0 0 2024-02-28T23:07:17.046 INFO:tasks.workunit.client.0.smithi159.stdout:4/546: creat d9/d42/d54/d9c/fba x:0 0 0 2024-02-28T23:07:17.048 INFO:tasks.workunit.client.0.smithi159.stdout:2/405: truncate d9/d23/d2c/d55/d13/d31/d37/f53 371093 0 2024-02-28T23:07:17.048 INFO:tasks.workunit.client.0.smithi159.stdout:0/556: link d0/d5/d14/c1b d0/d5/d14/cca 0 2024-02-28T23:07:17.050 INFO:tasks.workunit.client.0.smithi159.stdout:0/557: write d0/d5/d38/f91 [2055464,92950] 0 2024-02-28T23:07:17.051 INFO:tasks.workunit.client.0.smithi159.stdout:0/558: chown d0/d5/f50 64591 1 2024-02-28T23:07:17.052 INFO:tasks.workunit.client.0.smithi159.stdout:2/406: mkdir d9/d23/d2c/d55/d83 0 2024-02-28T23:07:17.057 INFO:tasks.workunit.client.0.smithi159.stdout:0/559: unlink d0/de/d75/c52 0 2024-02-28T23:07:17.062 INFO:tasks.workunit.client.0.smithi159.stdout:4/547: dwrite d9/d42/fab [0,4194304] 0 2024-02-28T23:07:17.066 INFO:tasks.workunit.client.0.smithi159.stdout:9/488: sync 2024-02-28T23:07:17.066 INFO:tasks.workunit.client.0.smithi159.stdout:7/337: sync 2024-02-28T23:07:17.068 INFO:tasks.workunit.client.0.smithi159.stdout:1/454: sync 2024-02-28T23:07:17.077 INFO:tasks.workunit.client.0.smithi159.stdout:1/455: write d6/f62 [975888,74698] 0 2024-02-28T23:07:17.078 INFO:tasks.workunit.client.0.smithi159.stdout:2/407: dwrite d9/d23/d2c/d55/d13/d31/d37/f4d [4194304,4194304] 0 2024-02-28T23:07:17.078 INFO:tasks.workunit.client.0.smithi159.stdout:7/338: unlink d5/d16/d1a/d27/f57 0 2024-02-28T23:07:17.090 INFO:tasks.workunit.client.0.smithi159.stdout:9/489: chown d4/d3d/d3e/d55/f2e 17818 1 2024-02-28T23:07:17.092 INFO:tasks.workunit.client.0.smithi159.stdout:4/548: dwrite d9/da/f9a [0,4194304] 0 2024-02-28T23:07:17.099 INFO:tasks.workunit.client.0.smithi159.stdout:6/422: dwrite d0/d1b/d33/d11/d14/f28 [0,4194304] 0 2024-02-28T23:07:17.106 INFO:tasks.workunit.client.0.smithi159.stdout:2/408: rename d9/d23/d2c/d55/d13/d31 to d9/d50/d54/d84 0 2024-02-28T23:07:17.113 INFO:tasks.workunit.client.0.smithi159.stdout:6/423: mkdir d0/d1b/d38/d4e/d72/d88 0 2024-02-28T23:07:17.113 INFO:tasks.workunit.client.0.smithi159.stdout:7/339: dread d5/f12 [4194304,4194304] 0 2024-02-28T23:07:17.116 INFO:tasks.workunit.client.0.smithi159.stdout:1/456: creat d6/d12/f93 x:0 0 0 2024-02-28T23:07:17.119 INFO:tasks.workunit.client.0.smithi159.stdout:4/549: rename d9/d20/d87/f92 to d9/d4c/d6c/fbb 0 2024-02-28T23:07:17.119 INFO:tasks.workunit.client.0.smithi159.stdout:4/550: readlink d9/l35 0 2024-02-28T23:07:17.121 INFO:tasks.workunit.client.0.smithi159.stdout:2/409: symlink d9/d23/d2c/l85 0 2024-02-28T23:07:17.124 INFO:tasks.workunit.client.0.smithi159.stdout:9/490: creat d4/f9d x:0 0 0 2024-02-28T23:07:17.127 INFO:tasks.workunit.client.0.smithi159.stdout:7/340: dread d5/d16/d1a/f3c [0,4194304] 0 2024-02-28T23:07:17.128 INFO:tasks.workunit.client.0.smithi159.stdout:0/560: dwrite d0/d5/d14/d25/d2c/f43 [0,4194304] 0 2024-02-28T23:07:17.128 INFO:tasks.workunit.client.0.smithi159.stdout:6/424: mknod d0/d1b/d33/d3f/c89 0 2024-02-28T23:07:17.133 INFO:tasks.workunit.client.0.smithi159.stdout:6/425: write d0/d1b/d33/d11/d14/d49/f5c [534681,128378] 0 2024-02-28T23:07:17.134 INFO:tasks.workunit.client.1.smithi184.stdout:1/46: dwrite f5 [4194304,4194304] 0 2024-02-28T23:07:17.139 INFO:tasks.workunit.client.0.smithi159.stdout:1/457: rename d6/d12/f6d to d6/d1d/d46/d88/f94 0 2024-02-28T23:07:17.147 INFO:tasks.workunit.client.0.smithi159.stdout:3/431: write d0/d6/d3e/d2f/f4b [888683,77767] 0 2024-02-28T23:07:17.150 INFO:tasks.workunit.client.0.smithi159.stdout:9/491: chown d4/d3d/d3e/d91/l96 3213605 1 2024-02-28T23:07:17.154 INFO:tasks.workunit.client.0.smithi159.stdout:6/426: dwrite d0/d1b/f1f [0,4194304] 0 2024-02-28T23:07:17.154 INFO:tasks.workunit.client.0.smithi159.stdout:7/341: unlink d5/d10/f47 0 2024-02-28T23:07:17.155 INFO:tasks.workunit.client.0.smithi159.stdout:6/427: fdatasync d0/fb 0 2024-02-28T23:07:17.158 INFO:tasks.workunit.client.1.smithi184.stdout:1/47: link fa fe 0 2024-02-28T23:07:17.161 INFO:tasks.workunit.client.0.smithi159.stdout:0/561: mkdir d0/d5/d14/d25/d2c/dab/dc5/dcb 0 2024-02-28T23:07:17.166 INFO:tasks.workunit.client.0.smithi159.stdout:2/410: write d9/d50/d54/d84/d37/d5c/f7b [567070,118282] 0 2024-02-28T23:07:17.168 INFO:tasks.workunit.client.0.smithi159.stdout:3/432: unlink d0/d2b/d55/d75/d6d/c2e 0 2024-02-28T23:07:17.171 INFO:tasks.workunit.client.0.smithi159.stdout:7/342: symlink d5/d16/d1a/d24/l6d 0 2024-02-28T23:07:17.173 INFO:tasks.workunit.client.0.smithi159.stdout:2/411: read d9/d23/d2c/f32 [615565,115988] 0 2024-02-28T23:07:17.176 INFO:tasks.workunit.client.0.smithi159.stdout:6/428: dwrite d0/d1b/d33/d3f/f73 [0,4194304] 0 2024-02-28T23:07:17.177 INFO:tasks.workunit.client.1.smithi184.stdout:1/48: creat ff x:0 0 0 2024-02-28T23:07:17.181 INFO:tasks.workunit.client.0.smithi159.stdout:0/562: creat d0/d5/d14/d78/fcc x:0 0 0 2024-02-28T23:07:17.181 INFO:tasks.workunit.client.0.smithi159.stdout:8/567: sync 2024-02-28T23:07:17.181 INFO:tasks.workunit.client.0.smithi159.stdout:9/492: mkdir d4/d3d/d3e/d55/d9e 0 2024-02-28T23:07:17.182 INFO:tasks.workunit.client.0.smithi159.stdout:9/493: chown d4/d3d/d3e 22 1 2024-02-28T23:07:17.183 INFO:tasks.workunit.client.0.smithi159.stdout:1/458: rename d6/f2c to d6/d12/d33/f95 0 2024-02-28T23:07:17.184 INFO:tasks.workunit.client.0.smithi159.stdout:3/433: mknod d0/d2b/d55/d75/d6d/d54/d7c/c85 0 2024-02-28T23:07:17.187 INFO:tasks.workunit.client.0.smithi159.stdout:7/343: creat d5/d16/d1a/d24/f6e x:0 0 0 2024-02-28T23:07:17.197 INFO:tasks.workunit.client.1.smithi184.stdout:1/49: dwrite ff [0,4194304] 0 2024-02-28T23:07:17.199 INFO:tasks.workunit.client.1.smithi184.stdout:1/50: symlink l10 0 2024-02-28T23:07:17.204 INFO:tasks.workunit.client.1.smithi184.stdout:1/51: creat f11 x:0 0 0 2024-02-28T23:07:17.205 INFO:tasks.workunit.client.1.smithi184.stdout:1/52: read f9 [1541847,5014] 0 2024-02-28T23:07:17.207 INFO:tasks.workunit.client.1.smithi184.stdout:1/53: creat f12 x:0 0 0 2024-02-28T23:07:17.208 INFO:tasks.workunit.client.1.smithi184.stdout:1/54: chown f5 3148 1 2024-02-28T23:07:17.211 INFO:tasks.workunit.client.1.smithi184.stdout:1/55: fdatasync fb 0 2024-02-28T23:07:17.213 INFO:tasks.workunit.client.1.smithi184.stdout:1/56: truncate fe 522655 0 2024-02-28T23:07:17.215 INFO:tasks.workunit.client.1.smithi184.stdout:1/57: creat f13 x:0 0 0 2024-02-28T23:07:17.221 INFO:tasks.workunit.client.1.smithi184.stdout:1/58: dread fb [0,4194304] 0 2024-02-28T23:07:17.222 INFO:tasks.workunit.client.0.smithi159.stdout:3/434: chown d0/d6/d3e/c43 9892516 1 2024-02-28T23:07:17.225 INFO:tasks.workunit.client.0.smithi159.stdout:9/494: symlink d4/d52/d7d/l9f 0 2024-02-28T23:07:17.225 INFO:tasks.workunit.client.0.smithi159.stdout:8/568: read d2/d11/d52/d47/f6b [602836,48896] 0 2024-02-28T23:07:17.226 INFO:tasks.workunit.client.0.smithi159.stdout:4/551: dwrite d9/da/d1c/f53 [0,4194304] 0 2024-02-28T23:07:17.227 INFO:tasks.workunit.client.1.smithi184.stdout:1/59: rename c8 to c14 0 2024-02-28T23:07:17.228 INFO:tasks.workunit.client.1.smithi184.stdout:1/60: chown fb 170065 1 2024-02-28T23:07:17.229 INFO:tasks.workunit.client.0.smithi159.stdout:1/459: creat d6/d12/f96 x:0 0 0 2024-02-28T23:07:17.230 INFO:tasks.workunit.client.1.smithi184.stdout:1/61: write f13 [322200,29864] 0 2024-02-28T23:07:17.233 INFO:tasks.workunit.client.0.smithi159.stdout:4/552: write d9/d42/d54/d56/fb3 [396991,56398] 0 2024-02-28T23:07:17.234 INFO:tasks.workunit.client.0.smithi159.stdout:7/344: creat d5/d16/d1a/d27/d46/d65/f6f x:0 0 0 2024-02-28T23:07:17.236 INFO:tasks.workunit.client.0.smithi159.stdout:6/429: dread d0/d1b/d33/f5f [0,4194304] 0 2024-02-28T23:07:17.239 INFO:tasks.workunit.client.0.smithi159.stdout:6/430: write d0/d1b/d33/d11/d14/d49/f5c [2440596,17936] 0 2024-02-28T23:07:17.240 INFO:tasks.workunit.client.0.smithi159.stdout:9/495: rename d4/f9d to d4/d3d/d3e/d55/d4c/fa0 0 2024-02-28T23:07:17.241 INFO:tasks.workunit.client.0.smithi159.stdout:0/563: link d0/d5/d14/d25/d5c/c7b d0/d5/d14/d25/db5/ccd 0 2024-02-28T23:07:17.243 INFO:tasks.workunit.client.0.smithi159.stdout:4/553: symlink d9/da/d1c/d23/d2d/lbc 0 2024-02-28T23:07:17.244 INFO:tasks.workunit.client.0.smithi159.stdout:0/564: readlink d0/d5/d14/d78/laa 0 2024-02-28T23:07:17.249 INFO:tasks.workunit.client.0.smithi159.stdout:9/496: rmdir d4/d3d/d3e/d55/d4c/d4e 39 2024-02-28T23:07:17.249 INFO:tasks.workunit.client.0.smithi159.stdout:6/431: write d0/d1b/d33/d11/d34/f6a [6589,69422] 0 2024-02-28T23:07:17.249 INFO:tasks.workunit.client.0.smithi159.stdout:8/569: dread d2/d3/f14 [0,4194304] 0 2024-02-28T23:07:17.250 INFO:tasks.workunit.client.1.smithi184.stdout:1/62: dwrite ff [0,4194304] 0 2024-02-28T23:07:17.252 INFO:tasks.workunit.client.0.smithi159.stdout:4/554: truncate d9/f1f 55745 0 2024-02-28T23:07:17.253 INFO:tasks.workunit.client.0.smithi159.stdout:0/565: rmdir d0/d5/d14/d34/d6c/daf 39 2024-02-28T23:07:17.254 INFO:tasks.workunit.client.0.smithi159.stdout:4/555: chown d9/da/d1c/d8e/faf 8918972 1 2024-02-28T23:07:17.256 INFO:tasks.workunit.client.0.smithi159.stdout:9/497: rmdir d4/d3d 39 2024-02-28T23:07:17.258 INFO:tasks.workunit.client.0.smithi159.stdout:7/345: creat d5/d16/d1a/f70 x:0 0 0 2024-02-28T23:07:17.262 INFO:tasks.workunit.client.0.smithi159.stdout:6/432: creat d0/d1b/f8a x:0 0 0 2024-02-28T23:07:17.263 INFO:tasks.workunit.client.0.smithi159.stdout:1/460: write d6/d1d/d1f/d3e/d63/f66 [353473,95431] 0 2024-02-28T23:07:17.266 INFO:tasks.workunit.client.0.smithi159.stdout:9/498: readlink d4/d3d/d3e/d55/d37/l75 0 2024-02-28T23:07:17.267 INFO:tasks.workunit.client.0.smithi159.stdout:8/570: mkdir d2/d11/d52/d47/db6/dba 0 2024-02-28T23:07:17.271 INFO:tasks.workunit.client.0.smithi159.stdout:3/435: dread d0/d2b/f26 [0,4194304] 0 2024-02-28T23:07:17.272 INFO:tasks.workunit.client.0.smithi159.stdout:4/556: mknod d9/da/d1c/dad/cbd 0 2024-02-28T23:07:17.275 INFO:tasks.workunit.client.0.smithi159.stdout:7/346: mknod d5/d16/d1a/d27/d3e/c71 0 2024-02-28T23:07:17.277 INFO:tasks.workunit.client.0.smithi159.stdout:8/571: rename d2/d11/c1a to d2/d11/d52/d47/d65/cbb 0 2024-02-28T23:07:17.280 INFO:tasks.workunit.client.0.smithi159.stdout:0/566: truncate d0/d5/d14/d34/d3d/f82 1352978 0 2024-02-28T23:07:17.281 INFO:tasks.workunit.client.1.smithi184.stdout:1/63: dwrite fe [0,4194304] 0 2024-02-28T23:07:17.282 INFO:tasks.workunit.client.0.smithi159.stdout:1/461: write d6/d12/d16/f24 [2384906,25079] 0 2024-02-28T23:07:17.282 INFO:tasks.workunit.client.1.smithi184.stdout:1/64: write fa [2789452,42773] 0 2024-02-28T23:07:17.288 INFO:tasks.workunit.client.0.smithi159.stdout:6/433: dwrite d0/d1b/f3c [0,4194304] 0 2024-02-28T23:07:17.293 INFO:tasks.workunit.client.1.smithi184.stdout:1/65: rename f5 to f15 0 2024-02-28T23:07:17.294 INFO:tasks.workunit.client.1.smithi184.stdout:1/66: write f11 [716429,119732] 0 2024-02-28T23:07:17.295 INFO:tasks.workunit.client.1.smithi184.stdout:1/67: write fe [3885907,124914] 0 2024-02-28T23:07:17.297 INFO:tasks.workunit.client.0.smithi159.stdout:4/557: creat d9/fbe x:0 0 0 2024-02-28T23:07:17.297 INFO:tasks.workunit.client.0.smithi159.stdout:7/347: dwrite d5/d16/d40/f5d [0,4194304] 0 2024-02-28T23:07:17.302 INFO:tasks.workunit.client.0.smithi159.stdout:0/567: mknod d0/d5/d14/d25/d2c/dab/dc5/dcb/cce 0 2024-02-28T23:07:17.303 INFO:tasks.workunit.client.0.smithi159.stdout:9/499: getdents d4 0 2024-02-28T23:07:17.306 INFO:tasks.workunit.client.0.smithi159.stdout:8/572: symlink d2/lbc 0 2024-02-28T23:07:17.308 INFO:tasks.workunit.client.0.smithi159.stdout:1/462: mkdir d6/d12/d1a/d92/d97 0 2024-02-28T23:07:17.312 INFO:tasks.workunit.client.1.smithi184.stdout:1/68: dread f11 [0,4194304] 0 2024-02-28T23:07:17.312 INFO:tasks.workunit.client.0.smithi159.stdout:6/434: rename d0/d1b/d38/d47 to d0/d1b/d33/d3f/d44/d8b 0 2024-02-28T23:07:17.315 INFO:tasks.workunit.client.0.smithi159.stdout:4/558: creat d9/d20/fbf x:0 0 0 2024-02-28T23:07:17.318 INFO:tasks.workunit.client.0.smithi159.stdout:8/573: symlink d2/d11/d52/d47/d65/lbd 0 2024-02-28T23:07:17.319 INFO:tasks.workunit.client.0.smithi159.stdout:8/574: readlink d2/d3/l1e 0 2024-02-28T23:07:17.319 INFO:tasks.workunit.client.0.smithi159.stdout:1/463: creat d6/d12/d33/d48/f98 x:0 0 0 2024-02-28T23:07:17.320 INFO:tasks.workunit.client.0.smithi159.stdout:1/464: stat d6/d12/d33/f51 0 2024-02-28T23:07:17.320 INFO:tasks.workunit.client.0.smithi159.stdout:7/348: mknod d5/d10/d60/c72 0 2024-02-28T23:07:17.321 INFO:tasks.workunit.client.0.smithi159.stdout:8/575: write d2/d11/d52/d47/d7c/fac [209700,69482] 0 2024-02-28T23:07:17.322 INFO:tasks.workunit.client.0.smithi159.stdout:7/349: dread - d5/d56/d50/f53 zero size 2024-02-28T23:07:17.323 INFO:tasks.workunit.client.0.smithi159.stdout:6/435: rename d0/d1b/d33/d11/d14/d5d to d0/d1b/d33/d8c 0 2024-02-28T23:07:17.323 INFO:tasks.workunit.client.0.smithi159.stdout:1/465: truncate d6/d12/d33/f51 4695639 0 2024-02-28T23:07:17.327 INFO:tasks.workunit.client.0.smithi159.stdout:4/559: rename d9/da/d1c/f53 to d9/da/fc0 0 2024-02-28T23:07:17.330 INFO:tasks.workunit.client.0.smithi159.stdout:0/568: creat d0/d5/d14/d34/d6c/fcf x:0 0 0 2024-02-28T23:07:17.331 INFO:tasks.workunit.client.0.smithi159.stdout:8/576: fdatasync d2/d11/d52/d26/d36/f55 0 2024-02-28T23:07:17.333 INFO:tasks.workunit.client.0.smithi159.stdout:9/500: write d4/f13 [4815568,71036] 0 2024-02-28T23:07:17.334 INFO:tasks.workunit.client.0.smithi159.stdout:4/560: rmdir d9/d42/d95 39 2024-02-28T23:07:17.336 INFO:tasks.workunit.client.1.smithi184.stdout:1/69: truncate fc 4592066 0 2024-02-28T23:07:17.341 INFO:tasks.workunit.client.0.smithi159.stdout:6/436: rmdir d0/d82 0 2024-02-28T23:07:17.342 INFO:tasks.workunit.client.0.smithi159.stdout:4/561: mknod d9/da/d1c/d23/cc1 0 2024-02-28T23:07:17.344 INFO:tasks.workunit.client.0.smithi159.stdout:9/501: truncate d4/d3d/d3e/d55/f49 1640046 0 2024-02-28T23:07:17.348 INFO:tasks.workunit.client.1.smithi184.stdout:1/70: rename f12 to f16 0 2024-02-28T23:07:17.348 INFO:tasks.workunit.client.1.smithi184.stdout:1/71: write fe [4848524,17604] 0 2024-02-28T23:07:17.353 INFO:tasks.workunit.client.0.smithi159.stdout:8/577: dwrite d2/d3/fa6 [0,4194304] 0 2024-02-28T23:07:17.353 INFO:tasks.workunit.client.0.smithi159.stdout:9/502: rename d4/d52/d6d to d4/d3d/d3e/d55/d37/d62/d77/da1 0 2024-02-28T23:07:17.354 INFO:tasks.workunit.client.0.smithi159.stdout:8/578: stat d2/d11/d52/d26/l4a 0 2024-02-28T23:07:17.355 INFO:tasks.workunit.client.0.smithi159.stdout:0/569: truncate d0/d5/d38/f9a 2679774 0 2024-02-28T23:07:17.358 INFO:tasks.workunit.client.0.smithi159.stdout:6/437: rename d0/d1b/d38/d4e/c62 to d0/d1b/d38/d4e/c8d 0 2024-02-28T23:07:17.361 INFO:tasks.workunit.client.0.smithi159.stdout:9/503: symlink d4/d3d/d3e/d55/d37/d62/d77/la2 0 2024-02-28T23:07:17.363 INFO:tasks.workunit.client.1.smithi184.stdout:1/72: getdents . 0 2024-02-28T23:07:17.364 INFO:tasks.workunit.client.0.smithi159.stdout:0/570: creat d0/d5/d14/d25/d2c/dab/fd0 x:0 0 0 2024-02-28T23:07:17.365 INFO:tasks.workunit.client.0.smithi159.stdout:4/562: link d9/c6e d9/d4c/cc2 0 2024-02-28T23:07:17.367 INFO:tasks.workunit.client.1.smithi184.stdout:1/73: creat f17 x:0 0 0 2024-02-28T23:07:17.368 INFO:tasks.workunit.client.0.smithi159.stdout:8/579: mknod d2/d11/d52/d26/d36/d38/d77/d9e/cbe 0 2024-02-28T23:07:17.369 INFO:tasks.workunit.client.0.smithi159.stdout:0/571: truncate d0/d5/d14/d25/fa9 473796 0 2024-02-28T23:07:17.371 INFO:tasks.workunit.client.0.smithi159.stdout:4/563: unlink d9/da/fc 0 2024-02-28T23:07:17.374 INFO:tasks.workunit.client.1.smithi184.stdout:1/74: readlink l6 0 2024-02-28T23:07:17.376 INFO:tasks.workunit.client.0.smithi159.stdout:0/572: chown d0/d5/d38/d63/la1 20481 1 2024-02-28T23:07:17.376 INFO:tasks.workunit.client.0.smithi159.stdout:6/438: dwrite d0/d1b/f3c [0,4194304] 0 2024-02-28T23:07:17.379 INFO:tasks.workunit.client.0.smithi159.stdout:4/564: mkdir d9/da/d1c/dc3 0 2024-02-28T23:07:17.381 INFO:tasks.workunit.client.0.smithi159.stdout:0/573: mknod d0/d5/d38/d76/cd1 0 2024-02-28T23:07:17.383 INFO:tasks.workunit.client.0.smithi159.stdout:5/505: sync 2024-02-28T23:07:17.385 INFO:tasks.workunit.client.0.smithi159.stdout:6/439: creat d0/d1b/d33/d3f/d44/d7a/f8e x:0 0 0 2024-02-28T23:07:17.386 INFO:tasks.workunit.client.0.smithi159.stdout:8/580: write d2/d11/d52/d47/f6b [2156695,16758] 0 2024-02-28T23:07:17.388 INFO:tasks.workunit.client.1.smithi184.stdout:1/75: write f9 [2095177,57738] 0 2024-02-28T23:07:17.388 INFO:tasks.workunit.client.0.smithi159.stdout:8/581: dread - d2/d11/d35/d9c/da0/fb9 zero size 2024-02-28T23:07:17.389 INFO:tasks.workunit.client.0.smithi159.stdout:4/565: creat d9/d42/d54/d77/fc4 x:0 0 0 2024-02-28T23:07:17.389 INFO:tasks.workunit.client.0.smithi159.stdout:8/582: readlink d2/d11/d52/l24 0 2024-02-28T23:07:17.390 INFO:tasks.workunit.client.1.smithi184.stdout:1/76: stat fc 0 2024-02-28T23:07:17.392 INFO:tasks.workunit.client.0.smithi159.stdout:8/583: stat d2/d11/f4b 0 2024-02-28T23:07:17.393 INFO:tasks.workunit.client.0.smithi159.stdout:0/574: dread d0/d5/f5e [0,4194304] 0 2024-02-28T23:07:17.395 INFO:tasks.workunit.client.0.smithi159.stdout:8/584: write d2/d11/d52/d26/d36/f64 [1026109,98067] 0 2024-02-28T23:07:17.399 INFO:tasks.workunit.client.0.smithi159.stdout:8/585: creat d2/d11/d74/fbf x:0 0 0 2024-02-28T23:07:17.399 INFO:tasks.workunit.client.0.smithi159.stdout:0/575: chown d0/d5/d14/d34/d3d/f83 3 1 2024-02-28T23:07:17.400 INFO:tasks.workunit.client.1.smithi184.stdout:1/77: rename f13 to f18 0 2024-02-28T23:07:17.406 INFO:tasks.workunit.client.1.smithi184.stdout:1/78: rename fc to f19 0 2024-02-28T23:07:17.415 INFO:tasks.workunit.client.1.smithi184.stdout:1/79: dread fe [0,4194304] 0 2024-02-28T23:07:17.432 INFO:tasks.workunit.client.1.smithi184.stdout:1/80: dwrite f16 [0,4194304] 0 2024-02-28T23:07:17.434 INFO:tasks.workunit.client.1.smithi184.stdout:1/81: write f17 [792907,129622] 0 2024-02-28T23:07:17.452 INFO:tasks.workunit.client.1.smithi184.stdout:1/82: dwrite fa [0,4194304] 0 2024-02-28T23:07:17.453 INFO:tasks.workunit.client.1.smithi184.stdout:1/83: stat f16 0 2024-02-28T23:07:17.463 INFO:tasks.workunit.client.1.smithi184.stdout:1/84: getdents . 0 2024-02-28T23:07:17.463 INFO:tasks.workunit.client.1.smithi184.stdout:1/85: fdatasync f17 0 2024-02-28T23:07:17.466 INFO:tasks.workunit.client.1.smithi184.stdout:1/86: symlink l1a 0 2024-02-28T23:07:17.474 INFO:tasks.workunit.client.1.smithi184.stdout:5/10: sync 2024-02-28T23:07:17.474 INFO:tasks.workunit.client.1.smithi184.stdout:9/0: sync 2024-02-28T23:07:17.474 INFO:tasks.workunit.client.1.smithi184.stdout:9/1: rename - no filename 2024-02-28T23:07:17.474 INFO:tasks.workunit.client.1.smithi184.stdout:9/2: rename - no filename 2024-02-28T23:07:17.474 INFO:tasks.workunit.client.1.smithi184.stdout:9/3: dread - no filename 2024-02-28T23:07:17.477 INFO:tasks.workunit.client.1.smithi184.stdout:1/87: write f15 [4719399,111575] 0 2024-02-28T23:07:17.479 INFO:tasks.workunit.client.1.smithi184.stdout:5/11: rename l2 to l3 0 2024-02-28T23:07:17.480 INFO:tasks.workunit.client.1.smithi184.stdout:9/4: symlink l0 0 2024-02-28T23:07:17.481 INFO:tasks.workunit.client.1.smithi184.stdout:9/5: chown l0 56 1 2024-02-28T23:07:17.482 INFO:tasks.workunit.client.1.smithi184.stdout:1/88: write f19 [4932733,17980] 0 2024-02-28T23:07:17.482 INFO:tasks.workunit.client.1.smithi184.stdout:9/6: chown l0 56402 1 2024-02-28T23:07:17.482 INFO:tasks.workunit.client.1.smithi184.stdout:9/7: dwrite - no filename 2024-02-28T23:07:17.482 INFO:tasks.workunit.client.1.smithi184.stdout:9/8: fdatasync - no filename 2024-02-28T23:07:17.483 INFO:tasks.workunit.client.1.smithi184.stdout:5/12: rename l1 to l4 0 2024-02-28T23:07:17.484 INFO:tasks.workunit.client.1.smithi184.stdout:9/9: chown l0 11 1 2024-02-28T23:07:17.487 INFO:tasks.workunit.client.1.smithi184.stdout:5/13: creat f5 x:0 0 0 2024-02-28T23:07:17.488 INFO:tasks.workunit.client.1.smithi184.stdout:9/10: mknod c1 0 2024-02-28T23:07:17.488 INFO:tasks.workunit.client.1.smithi184.stdout:9/11: dwrite - no filename 2024-02-28T23:07:17.490 INFO:tasks.workunit.client.1.smithi184.stdout:9/12: mknod c2 0 2024-02-28T23:07:17.490 INFO:tasks.workunit.client.1.smithi184.stdout:9/13: dwrite - no filename 2024-02-28T23:07:17.491 INFO:tasks.workunit.client.1.smithi184.stdout:9/14: stat c2 0 2024-02-28T23:07:17.491 INFO:tasks.workunit.client.1.smithi184.stdout:9/15: dwrite - no filename 2024-02-28T23:07:17.491 INFO:tasks.workunit.client.1.smithi184.stdout:9/16: write - no filename 2024-02-28T23:07:17.494 INFO:tasks.workunit.client.1.smithi184.stdout:9/17: mknod c3 0 2024-02-28T23:07:17.499 INFO:tasks.workunit.client.0.smithi159.stdout:6/440: dwrite d0/d1b/d33/d11/d14/d49/f5c [0,4194304] 0 2024-02-28T23:07:17.499 INFO:tasks.workunit.client.1.smithi184.stdout:9/18: creat f4 x:0 0 0 2024-02-28T23:07:17.501 INFO:tasks.workunit.client.1.smithi184.stdout:9/19: dread - f4 zero size 2024-02-28T23:07:17.503 INFO:tasks.workunit.client.1.smithi184.stdout:9/20: readlink l0 0 2024-02-28T23:07:17.505 INFO:tasks.workunit.client.1.smithi184.stdout:5/14: link l3 l6 0 2024-02-28T23:07:17.506 INFO:tasks.workunit.client.0.smithi159.stdout:6/441: mknod d0/d1b/d33/d8c/c8f 0 2024-02-28T23:07:17.507 INFO:tasks.workunit.client.0.smithi159.stdout:0/576: symlink d0/de/d75/ld2 0 2024-02-28T23:07:17.509 INFO:tasks.workunit.client.0.smithi159.stdout:8/586: getdents d2/d11/d52/d26/d36/d38/d77/d9e 0 2024-02-28T23:07:17.509 INFO:tasks.workunit.client.1.smithi184.stdout:5/15: write f5 [844919,761] 0 2024-02-28T23:07:17.513 INFO:tasks.workunit.client.0.smithi159.stdout:6/442: rename d0/c75 to d0/d1b/d38/d4e/d72/d88/c90 0 2024-02-28T23:07:17.515 INFO:tasks.workunit.client.1.smithi184.stdout:1/89: dwrite f2 [0,4194304] 0 2024-02-28T23:07:17.516 INFO:tasks.workunit.client.0.smithi159.stdout:8/587: creat d2/d11/d52/d26/d36/d38/d77/d9e/fc0 x:0 0 0 2024-02-28T23:07:17.517 INFO:tasks.workunit.client.0.smithi159.stdout:6/443: mkdir d0/d1b/d33/d3f/d44/d91 0 2024-02-28T23:07:17.519 INFO:tasks.workunit.client.1.smithi184.stdout:1/90: mknod c1b 0 2024-02-28T23:07:17.520 INFO:tasks.workunit.client.1.smithi184.stdout:5/16: dread f5 [0,4194304] 0 2024-02-28T23:07:17.521 INFO:tasks.workunit.client.0.smithi159.stdout:8/588: mkdir d2/d11/d52/d26/d36/d38/d77/d9e/dc1 0 2024-02-28T23:07:17.522 INFO:tasks.workunit.client.0.smithi159.stdout:6/444: symlink d0/d1b/d33/d11/l92 0 2024-02-28T23:07:17.526 INFO:tasks.workunit.client.0.smithi159.stdout:0/577: dwrite d0/de/f68 [0,4194304] 0 2024-02-28T23:07:17.529 INFO:tasks.workunit.client.0.smithi159.stdout:6/445: unlink d0/d1b/d33/f12 0 2024-02-28T23:07:17.530 INFO:tasks.workunit.client.0.smithi159.stdout:6/446: write d0/f9 [3034475,680] 0 2024-02-28T23:07:17.531 INFO:tasks.workunit.client.1.smithi184.stdout:5/17: stat l6 0 2024-02-28T23:07:17.533 INFO:tasks.workunit.client.0.smithi159.stdout:6/447: stat d0/d1b/d33/d3f/d44/d7a 0 2024-02-28T23:07:17.536 INFO:tasks.workunit.client.0.smithi159.stdout:6/448: write d0/d1b/d33/d11/f2e [4097075,9734] 0 2024-02-28T23:07:17.537 INFO:tasks.workunit.client.0.smithi159.stdout:6/449: write d0/f2b [2893592,86] 0 2024-02-28T23:07:17.540 INFO:tasks.workunit.client.0.smithi159.stdout:0/578: getdents d0/de/db7 0 2024-02-28T23:07:17.543 INFO:tasks.workunit.client.1.smithi184.stdout:9/21: dwrite f4 [0,4194304] 0 2024-02-28T23:07:17.543 INFO:tasks.workunit.client.1.smithi184.stdout:1/91: dread fe [0,4194304] 0 2024-02-28T23:07:17.545 INFO:tasks.workunit.client.1.smithi184.stdout:5/18: getdents . 0 2024-02-28T23:07:17.545 INFO:tasks.workunit.client.0.smithi159.stdout:0/579: mknod d0/d5/d14/d34/cd3 0 2024-02-28T23:07:17.547 INFO:tasks.workunit.client.1.smithi184.stdout:9/22: mkdir d5 0 2024-02-28T23:07:17.548 INFO:tasks.workunit.client.0.smithi159.stdout:8/589: write d2/d11/d52/d26/d36/d38/f5d [2609633,49278] 0 2024-02-28T23:07:17.551 INFO:tasks.workunit.client.1.smithi184.stdout:5/19: getdents . 0 2024-02-28T23:07:17.552 INFO:tasks.workunit.client.0.smithi159.stdout:0/580: write d0/d5/d14/d25/d2c/f43 [3782658,110757] 0 2024-02-28T23:07:17.552 INFO:tasks.workunit.client.0.smithi159.stdout:6/450: mknod d0/d1b/d33/d11/c93 0 2024-02-28T23:07:17.554 INFO:tasks.workunit.client.0.smithi159.stdout:8/590: rename d2/d11/d52/d47/d7c to d2/d73/dc2 0 2024-02-28T23:07:17.559 INFO:tasks.workunit.client.0.smithi159.stdout:8/591: truncate d2/d11/d52/d6e/f87 2000665 0 2024-02-28T23:07:17.560 INFO:tasks.workunit.client.0.smithi159.stdout:6/451: getdents d0/d1b/d38 0 2024-02-28T23:07:17.563 INFO:tasks.workunit.client.1.smithi184.stdout:9/23: truncate f4 2178304 0 2024-02-28T23:07:17.564 INFO:tasks.workunit.client.1.smithi184.stdout:5/20: truncate f5 654500 0 2024-02-28T23:07:17.572 INFO:tasks.workunit.client.0.smithi159.stdout:0/581: dwrite d0/d5/d14/d34/f74 [0,4194304] 0 2024-02-28T23:07:17.574 INFO:tasks.workunit.client.1.smithi184.stdout:5/21: dread f5 [0,4194304] 0 2024-02-28T23:07:17.578 INFO:tasks.workunit.client.0.smithi159.stdout:8/592: dwrite d2/d11/f1b [0,4194304] 0 2024-02-28T23:07:17.580 INFO:tasks.workunit.client.0.smithi159.stdout:6/452: dwrite d0/f2b [0,4194304] 0 2024-02-28T23:07:17.582 INFO:tasks.workunit.client.1.smithi184.stdout:9/24: dwrite f4 [0,4194304] 0 2024-02-28T23:07:17.583 INFO:tasks.workunit.client.1.smithi184.stdout:5/22: rename f5 to f7 0 2024-02-28T23:07:17.587 INFO:tasks.workunit.client.0.smithi159.stdout:0/582: rename d0/de/d75/f21 to d0/d5/d14/d25/d2c/fd4 0 2024-02-28T23:07:17.590 INFO:tasks.workunit.client.1.smithi184.stdout:5/23: creat f8 x:0 0 0 2024-02-28T23:07:17.593 INFO:tasks.workunit.client.0.smithi159.stdout:6/453: mkdir d0/d1b/d38/d4e/d86/d94 0 2024-02-28T23:07:17.594 INFO:tasks.workunit.client.0.smithi159.stdout:0/583: dread d0/d5/d14/d34/d3d/fa4 [0,4194304] 0 2024-02-28T23:07:17.595 INFO:tasks.workunit.client.1.smithi184.stdout:9/25: dread f4 [0,4194304] 0 2024-02-28T23:07:17.596 INFO:tasks.workunit.client.1.smithi184.stdout:9/26: chown c2 381141975 1 2024-02-28T23:07:17.596 INFO:tasks.workunit.client.0.smithi159.stdout:8/593: truncate d2/d3/fa6 28701 0 2024-02-28T23:07:17.599 INFO:tasks.workunit.client.0.smithi159.stdout:0/584: creat d0/de/fd5 x:0 0 0 2024-02-28T23:07:17.603 INFO:tasks.workunit.client.0.smithi159.stdout:8/594: mknod d2/d11/d52/d26/d36/d38/d77/d9e/cc3 0 2024-02-28T23:07:17.603 INFO:tasks.workunit.client.0.smithi159.stdout:0/585: write d0/d5/d14/d34/f9e [2607401,33756] 0 2024-02-28T23:07:17.609 INFO:tasks.workunit.client.0.smithi159.stdout:8/595: unlink d2/f40 0 2024-02-28T23:07:17.611 INFO:tasks.workunit.client.1.smithi184.stdout:5/24: getdents . 0 2024-02-28T23:07:17.611 INFO:tasks.workunit.client.1.smithi184.stdout:5/25: rmdir - no directory 2024-02-28T23:07:17.612 INFO:tasks.workunit.client.0.smithi159.stdout:0/586: fdatasync d0/d5/d14/d25/d5c/f6f 0 2024-02-28T23:07:17.613 INFO:tasks.workunit.client.0.smithi159.stdout:6/454: dwrite d0/d1b/d33/d5e/f87 [0,4194304] 0 2024-02-28T23:07:17.616 INFO:tasks.workunit.client.1.smithi184.stdout:5/26: symlink l9 0 2024-02-28T23:07:17.618 INFO:tasks.workunit.client.1.smithi184.stdout:5/27: chown f7 128940439 1 2024-02-28T23:07:17.618 INFO:tasks.workunit.client.1.smithi184.stdout:9/27: dwrite f4 [0,4194304] 0 2024-02-28T23:07:17.619 INFO:tasks.workunit.client.1.smithi184.stdout:9/28: readlink l0 0 2024-02-28T23:07:17.622 INFO:tasks.workunit.client.0.smithi159.stdout:6/455: creat d0/d6d/f95 x:0 0 0 2024-02-28T23:07:17.624 INFO:tasks.workunit.client.0.smithi159.stdout:0/587: write d0/d5/d14/d34/d3d/fa4 [674291,32016] 0 2024-02-28T23:07:17.624 INFO:tasks.workunit.client.1.smithi184.stdout:5/28: mknod ca 0 2024-02-28T23:07:17.625 INFO:tasks.workunit.client.1.smithi184.stdout:5/29: write f8 [43052,523] 0 2024-02-28T23:07:17.625 INFO:tasks.workunit.client.0.smithi159.stdout:6/456: chown d0/d1b/d38/d52/f7f 171300 1 2024-02-28T23:07:17.626 INFO:tasks.workunit.client.0.smithi159.stdout:8/596: mkdir d2/d11/d52/d26/d36/d38/d77/d9e/dc1/dc4 0 2024-02-28T23:07:17.627 INFO:tasks.workunit.client.1.smithi184.stdout:9/29: unlink f4 0 2024-02-28T23:07:17.627 INFO:tasks.workunit.client.1.smithi184.stdout:9/30: dread - no filename 2024-02-28T23:07:17.629 INFO:tasks.workunit.client.1.smithi184.stdout:9/31: chown c1 10 1 2024-02-28T23:07:17.629 INFO:tasks.workunit.client.1.smithi184.stdout:9/32: write - no filename 2024-02-28T23:07:17.631 INFO:tasks.workunit.client.1.smithi184.stdout:5/30: mkdir db 0 2024-02-28T23:07:17.635 INFO:tasks.workunit.client.0.smithi159.stdout:8/597: mkdir d2/d11/d52/d26/d36/d38/d77/dc5 0 2024-02-28T23:07:17.637 INFO:tasks.workunit.client.1.smithi184.stdout:9/33: getdents d5 0 2024-02-28T23:07:17.637 INFO:tasks.workunit.client.1.smithi184.stdout:2/7: sync 2024-02-28T23:07:17.637 INFO:tasks.workunit.client.1.smithi184.stdout:5/31: mknod db/cc 0 2024-02-28T23:07:17.637 INFO:tasks.workunit.client.1.smithi184.stdout:3/27: sync 2024-02-28T23:07:17.638 INFO:tasks.workunit.client.0.smithi159.stdout:8/598: readlink d2/d11/d52/la8 0 2024-02-28T23:07:17.638 INFO:tasks.workunit.client.1.smithi184.stdout:9/34: readlink l0 0 2024-02-28T23:07:17.638 INFO:tasks.workunit.client.1.smithi184.stdout:9/35: dread - no filename 2024-02-28T23:07:17.638 INFO:tasks.workunit.client.1.smithi184.stdout:9/36: dread - no filename 2024-02-28T23:07:17.639 INFO:tasks.workunit.client.1.smithi184.stdout:5/32: chown ca 0 1 2024-02-28T23:07:17.639 INFO:tasks.workunit.client.0.smithi159.stdout:0/588: creat d0/fd6 x:0 0 0 2024-02-28T23:07:17.642 INFO:tasks.workunit.client.0.smithi159.stdout:8/599: creat d2/d11/d52/fc6 x:0 0 0 2024-02-28T23:07:17.642 INFO:tasks.workunit.client.1.smithi184.stdout:9/37: creat d5/f6 x:0 0 0 2024-02-28T23:07:17.645 INFO:tasks.workunit.client.0.smithi159.stdout:6/457: dwrite d0/d1b/d33/d11/f2e [0,4194304] 0 2024-02-28T23:07:17.646 INFO:tasks.workunit.client.1.smithi184.stdout:3/28: rename d1/c2 to d1/d4/c7 0 2024-02-28T23:07:17.647 INFO:tasks.workunit.client.1.smithi184.stdout:9/38: creat d5/f7 x:0 0 0 2024-02-28T23:07:17.647 INFO:tasks.workunit.client.1.smithi184.stdout:3/29: stat d1/d4/d6 0 2024-02-28T23:07:17.649 INFO:tasks.workunit.client.1.smithi184.stdout:9/39: dread - d5/f6 zero size 2024-02-28T23:07:17.649 INFO:tasks.workunit.client.1.smithi184.stdout:9/40: readlink l0 0 2024-02-28T23:07:17.650 INFO:tasks.workunit.client.0.smithi159.stdout:6/458: mkdir d0/d1b/d38/d96 0 2024-02-28T23:07:17.650 INFO:tasks.workunit.client.1.smithi184.stdout:9/41: truncate d5/f6 309879 0 2024-02-28T23:07:17.654 INFO:tasks.workunit.client.0.smithi159.stdout:8/600: link d2/d11/d35/d5f/f6a d2/d11/d52/d26/d36/d38/d77/dc5/fc7 0 2024-02-28T23:07:17.657 INFO:tasks.workunit.client.1.smithi184.stdout:9/42: mknod d5/c8 0 2024-02-28T23:07:17.658 INFO:tasks.workunit.client.1.smithi184.stdout:9/43: write d5/f6 [286069,54490] 0 2024-02-28T23:07:17.661 INFO:tasks.workunit.client.0.smithi159.stdout:0/589: dwrite d0/d5/f33 [0,4194304] 0 2024-02-28T23:07:17.664 INFO:tasks.workunit.client.0.smithi159.stdout:0/590: dread - d0/de/fd5 zero size 2024-02-28T23:07:17.664 INFO:tasks.workunit.client.0.smithi159.stdout:8/601: truncate d2/d3/f1d 5014884 0 2024-02-28T23:07:17.666 INFO:tasks.workunit.client.1.smithi184.stdout:5/33: write f7 [1262733,17625] 0 2024-02-28T23:07:17.668 INFO:tasks.workunit.client.0.smithi159.stdout:6/459: dwrite d0/d1b/f1f [0,4194304] 0 2024-02-28T23:07:17.669 INFO:tasks.workunit.client.1.smithi184.stdout:3/30: chown d1/d4/c7 239832600 1 2024-02-28T23:07:17.669 INFO:tasks.workunit.client.1.smithi184.stdout:3/31: write - no filename 2024-02-28T23:07:17.670 INFO:tasks.workunit.client.1.smithi184.stdout:3/32: chown d1/d4/c7 1 1 2024-02-28T23:07:17.671 INFO:tasks.workunit.client.1.smithi184.stdout:3/33: dread - no filename 2024-02-28T23:07:17.671 INFO:tasks.workunit.client.0.smithi159.stdout:6/460: truncate d0/d1b/f8a 246757 0 2024-02-28T23:07:17.675 INFO:tasks.workunit.client.0.smithi159.stdout:0/591: unlink d0/d5/d38/d63/la1 0 2024-02-28T23:07:17.677 INFO:tasks.workunit.client.0.smithi159.stdout:6/461: symlink d0/d1b/d38/d4e/d86/l97 0 2024-02-28T23:07:17.681 INFO:tasks.workunit.client.1.smithi184.stdout:5/34: dread f7 [0,4194304] 0 2024-02-28T23:07:17.681 INFO:tasks.workunit.client.0.smithi159.stdout:6/462: dread d0/d1b/f8a [0,4194304] 0 2024-02-28T23:07:17.682 INFO:tasks.workunit.client.0.smithi159.stdout:0/592: fsync d0/d5/d14/d34/d6c/daf/fc6 0 2024-02-28T23:07:17.684 INFO:tasks.workunit.client.1.smithi184.stdout:5/35: write f8 [369299,52291] 0 2024-02-28T23:07:17.684 INFO:tasks.workunit.client.0.smithi159.stdout:6/463: write d0/d1b/d33/d11/d14/f74 [4351530,91943] 0 2024-02-28T23:07:17.687 INFO:tasks.workunit.client.0.smithi159.stdout:0/593: truncate d0/d5/d14/d78/f87 4194859 0 2024-02-28T23:07:17.688 INFO:tasks.workunit.client.0.smithi159.stdout:0/594: fdatasync d0/fb 0 2024-02-28T23:07:17.689 INFO:tasks.workunit.client.0.smithi159.stdout:6/464: creat d0/d1b/f98 x:0 0 0 2024-02-28T23:07:17.693 INFO:tasks.workunit.client.0.smithi159.stdout:0/595: mknod d0/d5/d14/d34/cd7 0 2024-02-28T23:07:17.695 INFO:tasks.workunit.client.0.smithi159.stdout:0/596: chown d0/d5/f53 1 1 2024-02-28T23:07:17.698 INFO:tasks.workunit.client.0.smithi159.stdout:0/597: dread - d0/d5/d14/d78/da8/fb1 zero size 2024-02-28T23:07:17.698 INFO:tasks.workunit.client.0.smithi159.stdout:6/465: mkdir d0/d1b/d33/d11/d14/d99 0 2024-02-28T23:07:17.702 INFO:tasks.workunit.client.0.smithi159.stdout:6/466: mknod d0/d1b/d38/c9a 0 2024-02-28T23:07:17.704 INFO:tasks.workunit.client.0.smithi159.stdout:8/602: dread d2/d11/d52/d26/d36/d38/f49 [0,4194304] 0 2024-02-28T23:07:17.705 INFO:tasks.workunit.client.0.smithi159.stdout:8/603: readlink d2/d11/d52/d6e/l88 0 2024-02-28T23:07:17.706 INFO:tasks.workunit.client.0.smithi159.stdout:8/604: chown d2/f15 1395846 1 2024-02-28T23:07:17.709 INFO:tasks.workunit.client.0.smithi159.stdout:0/598: truncate d0/d5/d14/d78/f8c 2680162 0 2024-02-28T23:07:17.712 INFO:tasks.workunit.client.0.smithi159.stdout:8/605: dread d2/d11/d52/d26/f31 [0,4194304] 0 2024-02-28T23:07:17.716 INFO:tasks.workunit.client.0.smithi159.stdout:0/599: mkdir d0/d5/d38/d63/dd8 0 2024-02-28T23:07:17.717 INFO:tasks.workunit.client.0.smithi159.stdout:8/606: dread d2/d11/d35/d5f/f92 [0,4194304] 0 2024-02-28T23:07:17.722 INFO:tasks.workunit.client.0.smithi159.stdout:0/600: mknod d0/d5/d14/d25/d2c/cd9 0 2024-02-28T23:07:17.723 INFO:tasks.workunit.client.0.smithi159.stdout:0/601: fdatasync d0/d5/d14/d34/f3c 0 2024-02-28T23:07:17.725 INFO:tasks.workunit.client.0.smithi159.stdout:8/607: mkdir d2/d11/d52/d26/d36/d38/d77/dc8 0 2024-02-28T23:07:17.728 INFO:tasks.workunit.client.1.smithi184.stdout:4/13: sync 2024-02-28T23:07:17.728 INFO:tasks.workunit.client.1.smithi184.stdout:6/23: sync 2024-02-28T23:07:17.728 INFO:tasks.workunit.client.1.smithi184.stdout:7/37: sync 2024-02-28T23:07:17.733 INFO:tasks.workunit.client.0.smithi159.stdout:0/602: link d0/de/l32 d0/d5/d14/d25/d2c/lda 0 2024-02-28T23:07:17.740 INFO:tasks.workunit.client.0.smithi159.stdout:8/608: dwrite d2/d3/f83 [0,4194304] 0 2024-02-28T23:07:17.744 INFO:tasks.workunit.client.0.smithi159.stdout:6/467: truncate d0/f2b 1548946 0 2024-02-28T23:07:17.747 INFO:tasks.workunit.client.0.smithi159.stdout:2/412: sync 2024-02-28T23:07:17.747 INFO:tasks.workunit.client.0.smithi159.stdout:8/609: mkdir d2/d73/dc9 0 2024-02-28T23:07:17.748 INFO:tasks.workunit.client.0.smithi159.stdout:6/468: write d0/d1b/d33/d11/f7c [97702,12313] 0 2024-02-28T23:07:17.751 INFO:tasks.workunit.client.0.smithi159.stdout:0/603: dwrite d0/d5/d38/d63/fbd [0,4194304] 0 2024-02-28T23:07:17.753 INFO:tasks.workunit.client.0.smithi159.stdout:2/413: mknod d9/d50/d54/d84/d37/d5c/c86 0 2024-02-28T23:07:17.754 INFO:tasks.workunit.client.0.smithi159.stdout:0/604: chown d0/d5/d14/d25/d2c/d4b/fc3 442875 1 2024-02-28T23:07:17.758 INFO:tasks.workunit.client.0.smithi159.stdout:2/414: creat d9/d36/f87 x:0 0 0 2024-02-28T23:07:17.760 INFO:tasks.workunit.client.0.smithi159.stdout:6/469: creat d0/d1b/d38/d4e/d86/d94/f9b x:0 0 0 2024-02-28T23:07:17.762 INFO:tasks.workunit.client.1.smithi184.stdout:1/92: sync 2024-02-28T23:07:17.762 INFO:tasks.workunit.client.1.smithi184.stdout:0/50: sync 2024-02-28T23:07:17.762 INFO:tasks.workunit.client.1.smithi184.stdout:8/54: sync 2024-02-28T23:07:17.763 INFO:tasks.workunit.client.0.smithi159.stdout:0/605: chown d0/d5/d14/d25/db5/ccd 28 1 2024-02-28T23:07:17.764 INFO:tasks.workunit.client.0.smithi159.stdout:6/470: write d0/d1b/d38/d4e/d86/d94/f9b [1047703,40863] 0 2024-02-28T23:07:17.765 INFO:tasks.workunit.client.1.smithi184.stdout:2/8: sync 2024-02-28T23:07:17.765 INFO:tasks.workunit.client.1.smithi184.stdout:2/9: fdatasync - no filename 2024-02-28T23:07:17.765 INFO:tasks.workunit.client.1.smithi184.stdout:2/10: rmdir - no directory 2024-02-28T23:07:17.765 INFO:tasks.workunit.client.1.smithi184.stdout:2/11: dread - no filename 2024-02-28T23:07:17.765 INFO:tasks.workunit.client.1.smithi184.stdout:2/12: write - no filename 2024-02-28T23:07:17.765 INFO:tasks.workunit.client.1.smithi184.stdout:2/13: read - no filename 2024-02-28T23:07:17.766 INFO:tasks.workunit.client.0.smithi159.stdout:0/606: fsync d0/d5/d14/d78/da8/fb6 0 2024-02-28T23:07:17.769 INFO:tasks.workunit.client.0.smithi159.stdout:8/610: dread d2/d11/d52/f4d [0,4194304] 0 2024-02-28T23:07:17.771 INFO:tasks.workunit.client.0.smithi159.stdout:8/611: chown d2/d11/d52/d26/d36/f55 3 1 2024-02-28T23:07:17.772 INFO:tasks.workunit.client.1.smithi184.stdout:6/24: dwrite f5 [0,4194304] 0 2024-02-28T23:07:17.779 INFO:tasks.workunit.client.1.smithi184.stdout:6/25: chown f3 3007888 1 2024-02-28T23:07:17.779 INFO:tasks.workunit.client.0.smithi159.stdout:6/471: creat d0/d1b/d5b/f9c x:0 0 0 2024-02-28T23:07:17.780 INFO:tasks.workunit.client.1.smithi184.stdout:7/38: dwrite f3 [0,4194304] 0 2024-02-28T23:07:17.782 INFO:tasks.workunit.client.1.smithi184.stdout:4/14: dwrite d1/d4/f5 [4194304,4194304] 0 2024-02-28T23:07:17.785 INFO:tasks.workunit.client.1.smithi184.stdout:4/15: write d1/d4/f5 [3965790,86274] 0 2024-02-28T23:07:17.787 INFO:tasks.workunit.client.0.smithi159.stdout:0/607: creat d0/de/d75/fdb x:0 0 0 2024-02-28T23:07:17.792 INFO:tasks.workunit.client.0.smithi159.stdout:8/612: dwrite d2/d3/f17 [0,4194304] 0 2024-02-28T23:07:17.794 INFO:tasks.workunit.client.0.smithi159.stdout:0/608: creat d0/de/d46/fdc x:0 0 0 2024-02-28T23:07:17.803 INFO:tasks.workunit.client.1.smithi184.stdout:6/26: dread f3 [0,4194304] 0 2024-02-28T23:07:17.803 INFO:tasks.workunit.client.1.smithi184.stdout:1/93: dwrite f17 [0,4194304] 0 2024-02-28T23:07:17.804 INFO:tasks.workunit.client.1.smithi184.stdout:6/27: chown f3 15308 1 2024-02-28T23:07:17.805 INFO:tasks.workunit.client.0.smithi159.stdout:0/609: symlink d0/d5/d38/d76/ldd 0 2024-02-28T23:07:17.807 INFO:tasks.workunit.client.1.smithi184.stdout:6/28: chown f3 5194634 1 2024-02-28T23:07:17.821 INFO:tasks.workunit.client.0.smithi159.stdout:3/436: sync 2024-02-28T23:07:17.822 INFO:tasks.workunit.client.0.smithi159.stdout:2/415: truncate d9/d23/d2c/d55/f72 3488945 0 2024-02-28T23:07:17.822 INFO:tasks.workunit.client.0.smithi159.stdout:2/416: stat d9/d23/d2c 0 2024-02-28T23:07:17.827 INFO:tasks.workunit.client.0.smithi159.stdout:2/417: rename d9/d36/f87 to d9/d36/f88 0 2024-02-28T23:07:17.829 INFO:tasks.workunit.client.0.smithi159.stdout:3/437: mknod d0/c86 0 2024-02-28T23:07:17.829 INFO:tasks.workunit.client.0.smithi159.stdout:2/418: chown d9/d50/d54/d84/d37/d5c/c64 7910750 1 2024-02-28T23:07:17.831 INFO:tasks.workunit.client.0.smithi159.stdout:2/419: truncate d9/d34/f5d 370751 0 2024-02-28T23:07:17.835 INFO:tasks.workunit.client.0.smithi159.stdout:6/472: write d0/d1b/d33/d11/d14/d49/f60 [397459,47386] 0 2024-02-28T23:07:17.837 INFO:tasks.workunit.client.0.smithi159.stdout:6/473: chown d0/d1b/d38/d96 1 1 2024-02-28T23:07:17.838 INFO:tasks.workunit.client.0.smithi159.stdout:6/474: readlink d0/d1b/d33/d11/l31 0 2024-02-28T23:07:17.839 INFO:tasks.workunit.client.0.smithi159.stdout:2/420: rename d9/d23/d2c/d55/d13/l2e to d9/d50/d54/l89 0 2024-02-28T23:07:17.851 INFO:tasks.workunit.client.0.smithi159.stdout:8/613: dwrite d2/d3/f20 [0,4194304] 0 2024-02-28T23:07:17.854 INFO:tasks.workunit.client.1.smithi184.stdout:0/51: sync 2024-02-28T23:07:17.857 INFO:tasks.workunit.client.0.smithi159.stdout:0/610: dwrite d0/f42 [0,4194304] 0 2024-02-28T23:07:17.859 INFO:tasks.workunit.client.0.smithi159.stdout:8/614: unlink d2/d11/d35/d9c/fa2 0 2024-02-28T23:07:17.864 INFO:tasks.workunit.client.1.smithi184.stdout:9/44: creat d5/f9 x:0 0 0 2024-02-28T23:07:17.865 INFO:tasks.workunit.client.1.smithi184.stdout:9/45: chown c1 494391 1 2024-02-28T23:07:17.872 INFO:tasks.workunit.client.1.smithi184.stdout:5/36: mknod db/cd 0 2024-02-28T23:07:17.873 INFO:tasks.workunit.client.0.smithi159.stdout:0/611: link d0/d5/d14/d25/d2c/d4b/f54 d0/d5/d38/fde 0 2024-02-28T23:07:17.878 INFO:tasks.workunit.client.0.smithi159.stdout:0/612: symlink d0/d5/d14/d25/d2c/dab/dc5/ldf 0 2024-02-28T23:07:17.879 INFO:tasks.workunit.client.1.smithi184.stdout:2/14: symlink l1 0 2024-02-28T23:07:17.879 INFO:tasks.workunit.client.1.smithi184.stdout:2/15: dread - no filename 2024-02-28T23:07:17.880 INFO:tasks.workunit.client.1.smithi184.stdout:8/55: unlink d1/da/df/c11 0 2024-02-28T23:07:17.881 INFO:tasks.workunit.client.0.smithi159.stdout:3/438: truncate d0/d6/d3e/d57/f71 1620130 0 2024-02-28T23:07:17.882 INFO:tasks.workunit.client.0.smithi159.stdout:0/613: dread - d0/d5/d14/d25/f58 zero size 2024-02-28T23:07:17.884 INFO:tasks.workunit.client.0.smithi159.stdout:0/614: dread - d0/d5/d14/d25/f85 zero size 2024-02-28T23:07:17.886 INFO:tasks.workunit.client.1.smithi184.stdout:7/39: mknod d6/ce 0 2024-02-28T23:07:17.887 INFO:tasks.workunit.client.1.smithi184.stdout:7/40: read f5 [535573,94161] 0 2024-02-28T23:07:17.887 INFO:tasks.workunit.client.1.smithi184.stdout:4/16: symlink d1/l6 0 2024-02-28T23:07:17.889 INFO:tasks.workunit.client.1.smithi184.stdout:4/17: write d1/d4/f5 [2716385,8929] 0 2024-02-28T23:07:17.890 INFO:tasks.workunit.client.0.smithi159.stdout:2/421: write d9/d50/d54/d84/f3b [862798,90359] 0 2024-02-28T23:07:17.891 INFO:tasks.workunit.client.1.smithi184.stdout:4/18: write d1/d4/f5 [7620416,49119] 0 2024-02-28T23:07:17.892 INFO:tasks.workunit.client.0.smithi159.stdout:4/566: sync 2024-02-28T23:07:17.892 INFO:tasks.workunit.client.0.smithi159.stdout:7/350: sync 2024-02-28T23:07:17.892 INFO:tasks.workunit.client.0.smithi159.stdout:5/506: sync 2024-02-28T23:07:17.892 INFO:tasks.workunit.client.0.smithi159.stdout:9/504: sync 2024-02-28T23:07:17.892 INFO:tasks.workunit.client.0.smithi159.stdout:1/466: sync 2024-02-28T23:07:17.892 INFO:tasks.workunit.client.1.smithi184.stdout:6/29: creat f7 x:0 0 0 2024-02-28T23:07:17.893 INFO:tasks.workunit.client.1.smithi184.stdout:6/30: readlink l6 0 2024-02-28T23:07:17.893 INFO:tasks.workunit.client.1.smithi184.stdout:4/19: stat d1/d4 0 2024-02-28T23:07:17.894 INFO:tasks.workunit.client.1.smithi184.stdout:0/52: write d0/fb [3178608,46614] 0 2024-02-28T23:07:17.894 INFO:tasks.workunit.client.1.smithi184.stdout:6/31: stat f7 0 2024-02-28T23:07:17.895 INFO:tasks.workunit.client.1.smithi184.stdout:4/20: write d1/f2 [1873305,52859] 0 2024-02-28T23:07:17.899 INFO:tasks.workunit.client.0.smithi159.stdout:9/505: chown d4/l28 127095 1 2024-02-28T23:07:17.899 INFO:tasks.workunit.client.0.smithi159.stdout:6/475: dwrite d0/d1b/d33/d11/d34/f35 [4194304,4194304] 0 2024-02-28T23:07:17.901 INFO:tasks.workunit.client.0.smithi159.stdout:4/567: chown d9/l32 52714 1 2024-02-28T23:07:17.901 INFO:tasks.workunit.client.0.smithi159.stdout:9/506: readlink d4/l1f 0 2024-02-28T23:07:17.902 INFO:tasks.workunit.client.0.smithi159.stdout:1/467: fsync d6/d1d/d1f/d3e/d63/f66 0 2024-02-28T23:07:17.902 INFO:tasks.workunit.client.0.smithi159.stdout:5/507: dread - d8/d19/d23/d35/d38/d6d/f8d zero size 2024-02-28T23:07:17.904 INFO:tasks.workunit.client.0.smithi159.stdout:2/422: chown d9/d23/d2c/d55/d13/c21 8 1 2024-02-28T23:07:17.905 INFO:tasks.workunit.client.1.smithi184.stdout:3/34: mknod d1/d4/d6/c8 0 2024-02-28T23:07:17.905 INFO:tasks.workunit.client.1.smithi184.stdout:3/35: dwrite - no filename 2024-02-28T23:07:17.905 INFO:tasks.workunit.client.1.smithi184.stdout:3/36: fdatasync - no filename 2024-02-28T23:07:17.905 INFO:tasks.workunit.client.1.smithi184.stdout:3/37: chown d1 11203651 1 2024-02-28T23:07:17.906 INFO:tasks.workunit.client.0.smithi159.stdout:1/468: readlink d6/d12/d31/d69/l61 0 2024-02-28T23:07:17.907 INFO:tasks.workunit.client.0.smithi159.stdout:3/439: dwrite d0/d6/f83 [0,4194304] 0 2024-02-28T23:07:17.909 INFO:tasks.workunit.client.0.smithi159.stdout:2/423: read - d9/d36/d59/f7d zero size 2024-02-28T23:07:17.910 INFO:tasks.workunit.client.1.smithi184.stdout:5/37: dread f7 [0,4194304] 0 2024-02-28T23:07:17.911 INFO:tasks.workunit.client.1.smithi184.stdout:2/16: rename l1 to l2 0 2024-02-28T23:07:17.912 INFO:tasks.workunit.client.0.smithi159.stdout:0/615: dread d0/de/f68 [0,4194304] 0 2024-02-28T23:07:17.914 INFO:tasks.workunit.client.1.smithi184.stdout:8/56: mkdir d1/da/dc/d16 0 2024-02-28T23:07:17.914 INFO:tasks.workunit.client.0.smithi159.stdout:7/351: mknod d5/d16/d1a/d27/d3e/c73 0 2024-02-28T23:07:17.918 INFO:tasks.workunit.client.1.smithi184.stdout:5/38: dread f8 [0,4194304] 0 2024-02-28T23:07:17.919 INFO:tasks.workunit.client.0.smithi159.stdout:7/352: truncate d5/d56/f2f 824922 0 2024-02-28T23:07:17.920 INFO:tasks.workunit.client.1.smithi184.stdout:5/39: chown l4 0 1 2024-02-28T23:07:17.920 INFO:tasks.workunit.client.0.smithi159.stdout:6/476: unlink d0/d1b/d33/d11/d14/l25 0 2024-02-28T23:07:17.921 INFO:tasks.workunit.client.0.smithi159.stdout:7/353: readlink d5/d56/d2a/l2c 0 2024-02-28T23:07:17.925 INFO:tasks.workunit.client.0.smithi159.stdout:4/568: mkdir d9/da/dc5 0 2024-02-28T23:07:17.929 INFO:tasks.workunit.client.0.smithi159.stdout:9/507: creat d4/d76/fa3 x:0 0 0 2024-02-28T23:07:17.932 INFO:tasks.workunit.client.0.smithi159.stdout:3/440: stat d0/d6/d3e/d2f/c3c 0 2024-02-28T23:07:17.933 INFO:tasks.workunit.client.1.smithi184.stdout:0/53: rmdir d0 39 2024-02-28T23:07:17.936 INFO:tasks.workunit.client.1.smithi184.stdout:6/32: creat f8 x:0 0 0 2024-02-28T23:07:17.940 INFO:tasks.workunit.client.0.smithi159.stdout:5/508: unlink d8/f34 0 2024-02-28T23:07:17.942 INFO:tasks.workunit.client.0.smithi159.stdout:9/508: dwrite d4/d3d/d3e/f73 [0,4194304] 0 2024-02-28T23:07:17.943 INFO:tasks.workunit.client.1.smithi184.stdout:3/38: mknod d1/d4/d6/c9 0 2024-02-28T23:07:17.947 INFO:tasks.workunit.client.0.smithi159.stdout:4/569: dread - d9/da/d1c/d23/f94 zero size 2024-02-28T23:07:17.948 INFO:tasks.workunit.client.0.smithi159.stdout:0/616: write d0/d5/d14/d25/f58 [687134,115234] 0 2024-02-28T23:07:17.948 INFO:tasks.workunit.client.0.smithi159.stdout:7/354: write d5/d56/d2a/f4d [1711355,8402] 0 2024-02-28T23:07:17.949 INFO:tasks.workunit.client.1.smithi184.stdout:8/57: rename d1/d6 to d1/da/d10/d17 0 2024-02-28T23:07:17.951 INFO:tasks.workunit.client.0.smithi159.stdout:9/509: write d4/d52/d7d/f8d [125430,116301] 0 2024-02-28T23:07:17.951 INFO:tasks.workunit.client.0.smithi159.stdout:4/570: chown d9/d4c/c5c 925309523 1 2024-02-28T23:07:17.954 INFO:tasks.workunit.client.0.smithi159.stdout:7/355: chown d5/d16/d1a/d27/d37 21421056 1 2024-02-28T23:07:17.958 INFO:tasks.workunit.client.0.smithi159.stdout:9/510: chown d4/d3d/d3e/d55/d37/d62/d77/la2 475 1 2024-02-28T23:07:17.959 INFO:tasks.workunit.client.1.smithi184.stdout:5/40: rename db/cd to db/ce 0 2024-02-28T23:07:17.960 INFO:tasks.workunit.client.0.smithi159.stdout:5/509: dread d8/d59/f80 [0,4194304] 0 2024-02-28T23:07:17.964 INFO:tasks.workunit.client.1.smithi184.stdout:7/41: symlink d6/d9/da/dc/lf 0 2024-02-28T23:07:17.965 INFO:tasks.workunit.client.0.smithi159.stdout:9/511: stat d4/d3d/d3e/d55/d37/d62/f74 0 2024-02-28T23:07:17.965 INFO:tasks.workunit.client.0.smithi159.stdout:2/424: creat d9/d80/f8a x:0 0 0 2024-02-28T23:07:17.966 INFO:tasks.workunit.client.1.smithi184.stdout:7/42: write f3 [1360538,117453] 0 2024-02-28T23:07:17.966 INFO:tasks.workunit.client.1.smithi184.stdout:1/94: creat f1c x:0 0 0 2024-02-28T23:07:17.968 INFO:tasks.workunit.client.0.smithi159.stdout:9/512: chown d4/d3d/d3e/d55/f24 131 1 2024-02-28T23:07:17.971 INFO:tasks.workunit.client.1.smithi184.stdout:6/33: mknod c9 0 2024-02-28T23:07:17.977 INFO:tasks.workunit.client.1.smithi184.stdout:3/39: creat d1/d4/d6/fa x:0 0 0 2024-02-28T23:07:17.978 INFO:tasks.workunit.client.0.smithi159.stdout:6/477: dread d0/d1b/d33/d11/d14/f21 [0,4194304] 0 2024-02-28T23:07:17.986 INFO:tasks.workunit.client.1.smithi184.stdout:8/58: readlink d1/l14 0 2024-02-28T23:07:17.991 INFO:tasks.workunit.client.1.smithi184.stdout:7/43: write f5 [1541483,7765] 0 2024-02-28T23:07:17.992 INFO:tasks.workunit.client.1.smithi184.stdout:1/95: fdatasync fb 0 2024-02-28T23:07:17.993 INFO:tasks.workunit.client.1.smithi184.stdout:1/96: fsync f15 0 2024-02-28T23:07:17.994 INFO:tasks.workunit.client.1.smithi184.stdout:6/34: rename f5 to fa 0 2024-02-28T23:07:17.995 INFO:tasks.workunit.client.1.smithi184.stdout:4/21: link d1/l3 d1/d4/l7 0 2024-02-28T23:07:17.996 INFO:tasks.workunit.client.1.smithi184.stdout:9/46: getdents d5 0 2024-02-28T23:07:17.999 INFO:tasks.workunit.client.1.smithi184.stdout:3/40: creat d1/d4/fb x:0 0 0 2024-02-28T23:07:18.004 INFO:tasks.workunit.client.1.smithi184.stdout:8/59: rmdir d1/da/dc 39 2024-02-28T23:07:18.006 INFO:tasks.workunit.client.1.smithi184.stdout:0/54: creat d0/df/f11 x:0 0 0 2024-02-28T23:07:18.011 INFO:tasks.workunit.client.1.smithi184.stdout:6/35: unlink c2 0 2024-02-28T23:07:18.016 INFO:tasks.workunit.client.1.smithi184.stdout:3/41: creat d1/d4/d6/fc x:0 0 0 2024-02-28T23:07:18.016 INFO:tasks.workunit.client.1.smithi184.stdout:2/17: link l2 l3 0 2024-02-28T23:07:18.017 INFO:tasks.workunit.client.1.smithi184.stdout:2/18: dwrite - no filename 2024-02-28T23:07:18.017 INFO:tasks.workunit.client.1.smithi184.stdout:5/41: link ca db/cf 0 2024-02-28T23:07:18.019 INFO:tasks.workunit.client.0.smithi159.stdout:0/617: rmdir d0/d5/d14/d34/d6c 39 2024-02-28T23:07:18.021 INFO:tasks.workunit.client.1.smithi184.stdout:0/55: symlink d0/l12 0 2024-02-28T23:07:18.022 INFO:tasks.workunit.client.0.smithi159.stdout:1/469: creat d6/d1d/f99 x:0 0 0 2024-02-28T23:07:18.023 INFO:tasks.workunit.client.0.smithi159.stdout:1/470: chown d6/d1d/d1f/f8c 51336 1 2024-02-28T23:07:18.024 INFO:tasks.workunit.client.1.smithi184.stdout:4/22: dwrite d1/d4/f5 [4194304,4194304] 0 2024-02-28T23:07:18.024 INFO:tasks.workunit.client.0.smithi159.stdout:1/471: readlink d6/d12/d16/l36 0 2024-02-28T23:07:18.031 INFO:tasks.workunit.client.1.smithi184.stdout:9/47: dwrite d5/f6 [0,4194304] 0 2024-02-28T23:07:18.032 INFO:tasks.workunit.client.1.smithi184.stdout:2/19: creat f4 x:0 0 0 2024-02-28T23:07:18.035 INFO:tasks.workunit.client.0.smithi159.stdout:3/441: unlink d0/d6/d3e/d57/f71 0 2024-02-28T23:07:18.037 INFO:tasks.workunit.client.0.smithi159.stdout:3/442: dread - d0/d6/d3e/d57/f6c zero size 2024-02-28T23:07:18.038 INFO:tasks.workunit.client.0.smithi159.stdout:9/513: symlink d4/d3d/d3e/d91/la4 0 2024-02-28T23:07:18.039 INFO:tasks.workunit.client.0.smithi159.stdout:0/618: dread d0/de/f3b [0,4194304] 0 2024-02-28T23:07:18.039 INFO:tasks.workunit.client.1.smithi184.stdout:8/60: mkdir d1/da/dc/d18 0 2024-02-28T23:07:18.044 INFO:tasks.workunit.client.1.smithi184.stdout:5/42: chown l6 5692 1 2024-02-28T23:07:18.046 INFO:tasks.workunit.client.1.smithi184.stdout:7/44: dwrite d6/f8 [0,4194304] 0 2024-02-28T23:07:18.049 INFO:tasks.workunit.client.0.smithi159.stdout:1/472: stat d6/d12/d33/d72 0 2024-02-28T23:07:18.049 INFO:tasks.workunit.client.1.smithi184.stdout:4/23: unlink d1/d4/l7 0 2024-02-28T23:07:18.051 INFO:tasks.workunit.client.1.smithi184.stdout:2/20: creat f5 x:0 0 0 2024-02-28T23:07:18.053 INFO:tasks.workunit.client.1.smithi184.stdout:9/48: creat d5/fa x:0 0 0 2024-02-28T23:07:18.054 INFO:tasks.workunit.client.0.smithi159.stdout:7/356: link d5/d56/f2f d5/d16/d40/f74 0 2024-02-28T23:07:18.055 INFO:tasks.workunit.client.1.smithi184.stdout:6/36: link f3 fb 0 2024-02-28T23:07:18.056 INFO:tasks.workunit.client.1.smithi184.stdout:1/97: getdents . 0 2024-02-28T23:07:18.056 INFO:tasks.workunit.client.0.smithi159.stdout:5/510: write d8/fe [565630,10556] 0 2024-02-28T23:07:18.057 INFO:tasks.workunit.client.1.smithi184.stdout:2/21: read - f4 zero size 2024-02-28T23:07:18.057 INFO:tasks.workunit.client.1.smithi184.stdout:7/45: readlink d6/d9/da/dc/lf 0 2024-02-28T23:07:18.059 INFO:tasks.workunit.client.0.smithi159.stdout:9/514: symlink d4/d76/la5 0 2024-02-28T23:07:18.062 INFO:tasks.workunit.client.0.smithi159.stdout:9/515: dread - d4/d3d/d3e/d55/d37/d62/f69 zero size 2024-02-28T23:07:18.062 INFO:tasks.workunit.client.1.smithi184.stdout:0/56: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:18.063 INFO:tasks.workunit.client.1.smithi184.stdout:5/43: dread f7 [0,4194304] 0 2024-02-28T23:07:18.064 INFO:tasks.workunit.client.1.smithi184.stdout:4/24: mkdir d1/d8 0 2024-02-28T23:07:18.064 INFO:tasks.workunit.client.1.smithi184.stdout:0/57: fsync d0/f6 0 2024-02-28T23:07:18.064 INFO:tasks.workunit.client.1.smithi184.stdout:4/25: chown d1/d8 1461 1 2024-02-28T23:07:18.070 INFO:tasks.workunit.client.1.smithi184.stdout:8/61: creat d1/da/dc/d18/f19 x:0 0 0 2024-02-28T23:07:18.073 INFO:tasks.workunit.client.1.smithi184.stdout:9/49: mkdir d5/db 0 2024-02-28T23:07:18.074 INFO:tasks.workunit.client.1.smithi184.stdout:2/22: symlink l6 0 2024-02-28T23:07:18.075 INFO:tasks.workunit.client.1.smithi184.stdout:9/50: fsync d5/f9 0 2024-02-28T23:07:18.076 INFO:tasks.workunit.client.0.smithi159.stdout:2/425: link d9/d23/d2c/d55/d13/l15 d9/d50/d54/d84/d37/d5c/l8b 0 2024-02-28T23:07:18.077 INFO:tasks.workunit.client.1.smithi184.stdout:6/37: fsync fb 0 2024-02-28T23:07:18.077 INFO:tasks.workunit.client.1.smithi184.stdout:2/23: truncate f5 237314 0 2024-02-28T23:07:18.079 INFO:tasks.workunit.client.0.smithi159.stdout:9/516: mkdir d4/d3d/d3e/d55/d37/d62/da6 0 2024-02-28T23:07:18.079 INFO:tasks.workunit.client.1.smithi184.stdout:5/44: chown db/ce 3 1 2024-02-28T23:07:18.082 INFO:tasks.workunit.client.0.smithi159.stdout:6/478: fsync d0/d1b/f29 0 2024-02-28T23:07:18.084 INFO:tasks.workunit.client.1.smithi184.stdout:1/98: getdents . 0 2024-02-28T23:07:18.085 INFO:tasks.workunit.client.1.smithi184.stdout:4/26: unlink d1/d4/f5 0 2024-02-28T23:07:18.086 INFO:tasks.workunit.client.0.smithi159.stdout:3/443: dread d0/d2b/d4f/f65 [0,4194304] 0 2024-02-28T23:07:18.087 INFO:tasks.workunit.client.1.smithi184.stdout:7/46: dwrite d6/f8 [4194304,4194304] 0 2024-02-28T23:07:18.087 INFO:tasks.workunit.client.0.smithi159.stdout:7/357: mkdir d5/d16/d1a/d27/d75 0 2024-02-28T23:07:18.087 INFO:tasks.workunit.client.1.smithi184.stdout:4/27: fsync d1/f2 0 2024-02-28T23:07:18.088 INFO:tasks.workunit.client.0.smithi159.stdout:0/619: truncate d0/d5/d14/d34/d3d/f92 2216738 0 2024-02-28T23:07:18.090 INFO:tasks.workunit.client.1.smithi184.stdout:4/28: chown d1/d4 0 1 2024-02-28T23:07:18.091 INFO:tasks.workunit.client.1.smithi184.stdout:6/38: mkdir dc 0 2024-02-28T23:07:18.092 INFO:tasks.workunit.client.1.smithi184.stdout:4/29: stat d1/f2 0 2024-02-28T23:07:18.092 INFO:tasks.workunit.client.1.smithi184.stdout:1/99: dread f18 [0,4194304] 0 2024-02-28T23:07:18.092 INFO:tasks.workunit.client.1.smithi184.stdout:0/58: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:18.093 INFO:tasks.workunit.client.0.smithi159.stdout:2/426: creat d9/d50/d54/d84/d37/f8c x:0 0 0 2024-02-28T23:07:18.094 INFO:tasks.workunit.client.1.smithi184.stdout:5/45: unlink db/cc 0 2024-02-28T23:07:18.097 INFO:tasks.workunit.client.0.smithi159.stdout:2/427: write d9/d50/d54/d84/d37/f8c [110556,63198] 0 2024-02-28T23:07:18.099 INFO:tasks.workunit.client.0.smithi159.stdout:0/620: dread d0/d5/d14/d34/d3d/f82 [0,4194304] 0 2024-02-28T23:07:18.101 INFO:tasks.workunit.client.0.smithi159.stdout:3/444: truncate d0/d6/d34/f41 1145315 0 2024-02-28T23:07:18.101 INFO:tasks.workunit.client.0.smithi159.stdout:2/428: chown d9/d23/d2c/d55/l27 2 1 2024-02-28T23:07:18.104 INFO:tasks.workunit.client.0.smithi159.stdout:0/621: chown d0/f3e 1 1 2024-02-28T23:07:18.104 INFO:tasks.workunit.client.0.smithi159.stdout:7/358: rename d5/d16/d40/f5d to d5/d16/d1a/d27/d3e/f76 0 2024-02-28T23:07:18.109 INFO:tasks.workunit.client.0.smithi159.stdout:9/517: mknod d4/d3d/d3e/d55/d9e/ca7 0 2024-02-28T23:07:18.110 INFO:tasks.workunit.client.1.smithi184.stdout:1/100: creat f1d x:0 0 0 2024-02-28T23:07:18.110 INFO:tasks.workunit.client.0.smithi159.stdout:0/622: truncate d0/d5/d38/d63/fbd 4439847 0 2024-02-28T23:07:18.110 INFO:tasks.workunit.client.0.smithi159.stdout:7/359: write d5/d16/d1a/d27/f31 [2048918,73145] 0 2024-02-28T23:07:18.110 INFO:tasks.workunit.client.1.smithi184.stdout:1/101: fdatasync f1d 0 2024-02-28T23:07:18.111 INFO:tasks.workunit.client.1.smithi184.stdout:0/59: dread d0/f6 [0,4194304] 0 2024-02-28T23:07:18.112 INFO:tasks.workunit.client.0.smithi159.stdout:1/473: getdents d6/d12 0 2024-02-28T23:07:18.114 INFO:tasks.workunit.client.1.smithi184.stdout:8/62: creat d1/da/f1a x:0 0 0 2024-02-28T23:07:18.114 INFO:tasks.workunit.client.0.smithi159.stdout:5/511: dwrite d8/d19/d23/d35/d38/d6d/f8d [0,4194304] 0 2024-02-28T23:07:18.115 INFO:tasks.workunit.client.0.smithi159.stdout:1/474: stat d6/d1d/d1f 0 2024-02-28T23:07:18.117 INFO:tasks.workunit.client.1.smithi184.stdout:7/47: dwrite f3 [0,4194304] 0 2024-02-28T23:07:18.117 INFO:tasks.workunit.client.0.smithi159.stdout:2/429: readlink d9/d34/d44/l57 0 2024-02-28T23:07:18.119 INFO:tasks.workunit.client.1.smithi184.stdout:4/30: rename d1/l3 to d1/d8/l9 0 2024-02-28T23:07:18.120 INFO:tasks.workunit.client.0.smithi159.stdout:6/479: dwrite d0/d1b/d33/d11/f7c [0,4194304] 0 2024-02-28T23:07:18.123 INFO:tasks.workunit.client.1.smithi184.stdout:1/102: mknod c1e 0 2024-02-28T23:07:18.125 INFO:tasks.workunit.client.1.smithi184.stdout:0/60: mkdir d0/df/d13 0 2024-02-28T23:07:18.131 INFO:tasks.workunit.client.1.smithi184.stdout:0/61: write d0/fb [9412708,61582] 0 2024-02-28T23:07:18.131 INFO:tasks.workunit.client.1.smithi184.stdout:2/24: link l3 l7 0 2024-02-28T23:07:18.132 INFO:tasks.workunit.client.0.smithi159.stdout:0/623: read d0/de/d46/f61 [271564,34243] 0 2024-02-28T23:07:18.137 INFO:tasks.workunit.client.0.smithi159.stdout:9/518: rmdir d4/d52/d7d 39 2024-02-28T23:07:18.140 INFO:tasks.workunit.client.0.smithi159.stdout:1/475: creat d6/d12/f9a x:0 0 0 2024-02-28T23:07:18.141 INFO:tasks.workunit.client.0.smithi159.stdout:2/430: mkdir d9/d50/d54/d8d 0 2024-02-28T23:07:18.143 INFO:tasks.workunit.client.1.smithi184.stdout:1/103: mknod c1f 0 2024-02-28T23:07:18.143 INFO:tasks.workunit.client.1.smithi184.stdout:4/31: dread d1/f2 [0,4194304] 0 2024-02-28T23:07:18.145 INFO:tasks.workunit.client.0.smithi159.stdout:6/480: rename d0/d1b/d33/d3f/d44/d91 to d0/d1b/d33/d11/d34/d9d 0 2024-02-28T23:07:18.146 INFO:tasks.workunit.client.1.smithi184.stdout:4/32: write d1/f2 [2817395,74554] 0 2024-02-28T23:07:18.150 INFO:tasks.workunit.client.1.smithi184.stdout:5/46: link db/cf db/c10 0 2024-02-28T23:07:18.153 INFO:tasks.workunit.client.1.smithi184.stdout:8/63: dwrite d1/da/f1a [0,4194304] 0 2024-02-28T23:07:18.155 INFO:tasks.workunit.client.0.smithi159.stdout:1/476: dwrite d6/d1d/d1f/d3e/f44 [4194304,4194304] 0 2024-02-28T23:07:18.156 INFO:tasks.workunit.client.1.smithi184.stdout:8/64: fdatasync d1/f5 0 2024-02-28T23:07:18.156 INFO:tasks.workunit.client.1.smithi184.stdout:1/104: mkdir d20 0 2024-02-28T23:07:18.157 INFO:tasks.workunit.client.0.smithi159.stdout:1/477: fsync d6/d1d/d1f/d3e/f73 0 2024-02-28T23:07:18.158 INFO:tasks.workunit.client.1.smithi184.stdout:0/62: creat d0/df/d13/f14 x:0 0 0 2024-02-28T23:07:18.163 INFO:tasks.workunit.client.0.smithi159.stdout:2/431: creat d9/d50/d54/f8e x:0 0 0 2024-02-28T23:07:18.164 INFO:tasks.workunit.client.1.smithi184.stdout:7/48: dwrite f4 [0,4194304] 0 2024-02-28T23:07:18.171 INFO:tasks.workunit.client.0.smithi159.stdout:9/519: rename d4/d3d/d3e/d55/f24 to d4/d76/fa8 0 2024-02-28T23:07:18.176 INFO:tasks.workunit.client.1.smithi184.stdout:4/33: dwrite d1/f2 [0,4194304] 0 2024-02-28T23:07:18.176 INFO:tasks.workunit.client.0.smithi159.stdout:0/624: link d0/d5/d14/d25/f85 d0/d5/d38/d76/d96/fe0 0 2024-02-28T23:07:18.178 INFO:tasks.workunit.client.0.smithi159.stdout:3/445: link d0/c14 d0/d2b/d55/d75/d6d/d54/d7c/c87 0 2024-02-28T23:07:18.180 INFO:tasks.workunit.client.0.smithi159.stdout:7/360: dwrite d5/d16/d40/f74 [0,4194304] 0 2024-02-28T23:07:18.181 INFO:tasks.workunit.client.1.smithi184.stdout:0/63: creat d0/df/f15 x:0 0 0 2024-02-28T23:07:18.185 INFO:tasks.workunit.client.0.smithi159.stdout:7/361: fsync d5/d16/d1a/d27/f31 0 2024-02-28T23:07:18.186 INFO:tasks.workunit.client.1.smithi184.stdout:3/42: sync 2024-02-28T23:07:18.188 INFO:tasks.workunit.client.1.smithi184.stdout:3/43: fsync d1/d4/fb 0 2024-02-28T23:07:18.189 INFO:tasks.workunit.client.0.smithi159.stdout:7/362: readlink d5/d56/d50/l52 0 2024-02-28T23:07:18.190 INFO:tasks.workunit.client.1.smithi184.stdout:1/105: symlink d20/l21 0 2024-02-28T23:07:18.191 INFO:tasks.workunit.client.0.smithi159.stdout:6/481: stat d0/d1b/d38/c6c 0 2024-02-28T23:07:18.192 INFO:tasks.workunit.client.1.smithi184.stdout:8/65: creat d1/da/dc/d16/f1b x:0 0 0 2024-02-28T23:07:18.193 INFO:tasks.workunit.client.1.smithi184.stdout:8/66: read - d1/da/dc/d18/f19 zero size 2024-02-28T23:07:18.194 INFO:tasks.workunit.client.1.smithi184.stdout:1/106: dread f11 [0,4194304] 0 2024-02-28T23:07:18.198 INFO:tasks.workunit.client.1.smithi184.stdout:0/64: symlink d0/l16 0 2024-02-28T23:07:18.200 INFO:tasks.workunit.client.1.smithi184.stdout:5/47: link db/cf db/c11 0 2024-02-28T23:07:18.205 INFO:tasks.workunit.client.1.smithi184.stdout:2/25: sync 2024-02-28T23:07:18.205 INFO:tasks.workunit.client.1.smithi184.stdout:9/51: sync 2024-02-28T23:07:18.205 INFO:tasks.workunit.client.1.smithi184.stdout:6/39: sync 2024-02-28T23:07:18.205 INFO:tasks.workunit.client.1.smithi184.stdout:9/52: readlink l0 0 2024-02-28T23:07:18.206 INFO:tasks.workunit.client.1.smithi184.stdout:7/49: link d6/f8 d6/d9/da/f10 0 2024-02-28T23:07:18.206 INFO:tasks.workunit.client.1.smithi184.stdout:1/107: dread f16 [0,4194304] 0 2024-02-28T23:07:18.208 INFO:tasks.workunit.client.0.smithi159.stdout:3/446: dwrite d0/d2b/d55/d75/d6d/d54/d63/f81 [0,4194304] 0 2024-02-28T23:07:18.208 INFO:tasks.workunit.client.0.smithi159.stdout:9/520: fsync d4/d3d/d3e/d55/d37/f3b 0 2024-02-28T23:07:18.210 INFO:tasks.workunit.client.0.smithi159.stdout:9/521: fsync d4/f11 0 2024-02-28T23:07:18.210 INFO:tasks.workunit.client.1.smithi184.stdout:3/44: mknod d1/d4/d6/cd 0 2024-02-28T23:07:18.211 INFO:tasks.workunit.client.1.smithi184.stdout:4/34: fdatasync d1/f2 0 2024-02-28T23:07:18.212 INFO:tasks.workunit.client.1.smithi184.stdout:4/35: fdatasync d1/f2 0 2024-02-28T23:07:18.213 INFO:tasks.workunit.client.1.smithi184.stdout:4/36: stat d1 0 2024-02-28T23:07:18.213 INFO:tasks.workunit.client.1.smithi184.stdout:8/67: creat d1/da/dc/d18/f1c x:0 0 0 2024-02-28T23:07:18.216 INFO:tasks.workunit.client.1.smithi184.stdout:8/68: read - d1/da/dc/d18/f1c zero size 2024-02-28T23:07:18.217 INFO:tasks.workunit.client.0.smithi159.stdout:2/432: symlink d9/d50/d54/d8d/l8f 0 2024-02-28T23:07:18.217 INFO:tasks.workunit.client.1.smithi184.stdout:0/65: creat d0/f17 x:0 0 0 2024-02-28T23:07:18.219 INFO:tasks.workunit.client.1.smithi184.stdout:5/48: mkdir db/d12 0 2024-02-28T23:07:18.222 INFO:tasks.workunit.client.1.smithi184.stdout:2/26: creat f8 x:0 0 0 2024-02-28T23:07:18.225 INFO:tasks.workunit.client.0.smithi159.stdout:0/625: symlink d0/d5/d14/le1 0 2024-02-28T23:07:18.226 INFO:tasks.workunit.client.1.smithi184.stdout:9/53: creat d5/fc x:0 0 0 2024-02-28T23:07:18.230 INFO:tasks.workunit.client.1.smithi184.stdout:0/66: dread d0/fb [4194304,4194304] 0 2024-02-28T23:07:18.230 INFO:tasks.workunit.client.1.smithi184.stdout:7/50: mknod d6/d9/da/c11 0 2024-02-28T23:07:18.231 INFO:tasks.workunit.client.0.smithi159.stdout:3/447: rmdir d0/d2b/d4f 39 2024-02-28T23:07:18.232 INFO:tasks.workunit.client.1.smithi184.stdout:3/45: mknod d1/d4/d6/ce 0 2024-02-28T23:07:18.232 INFO:tasks.workunit.client.0.smithi159.stdout:3/448: fsync d0/d6/d3e/d57/f58 0 2024-02-28T23:07:18.233 INFO:tasks.workunit.client.1.smithi184.stdout:3/46: chown d1 70 1 2024-02-28T23:07:18.233 INFO:tasks.workunit.client.1.smithi184.stdout:3/47: chown d1/d4/c7 58 1 2024-02-28T23:07:18.234 INFO:tasks.workunit.client.1.smithi184.stdout:6/40: dread fb [0,4194304] 0 2024-02-28T23:07:18.235 INFO:tasks.workunit.client.0.smithi159.stdout:1/478: mknod d6/d12/d1a/d92/c9b 0 2024-02-28T23:07:18.236 INFO:tasks.workunit.client.0.smithi159.stdout:9/522: dread d4/d52/d7d/f8d [0,4194304] 0 2024-02-28T23:07:18.237 INFO:tasks.workunit.client.0.smithi159.stdout:2/433: mknod d9/d36/d59/c90 0 2024-02-28T23:07:18.238 INFO:tasks.workunit.client.0.smithi159.stdout:9/523: dread - d4/d3d/d3e/d55/d37/d62/f69 zero size 2024-02-28T23:07:18.241 INFO:tasks.workunit.client.0.smithi159.stdout:9/524: write d4/d52/d7d/f81 [1688957,55762] 0 2024-02-28T23:07:18.242 INFO:tasks.workunit.client.1.smithi184.stdout:0/67: dread d0/fc [0,4194304] 0 2024-02-28T23:07:18.242 INFO:tasks.workunit.client.1.smithi184.stdout:0/68: readlink d0/l10 0 2024-02-28T23:07:18.243 INFO:tasks.workunit.client.1.smithi184.stdout:2/27: readlink l7 0 2024-02-28T23:07:18.245 INFO:tasks.workunit.client.1.smithi184.stdout:0/69: read d0/f6 [2866888,127546] 0 2024-02-28T23:07:18.249 INFO:tasks.workunit.client.1.smithi184.stdout:7/51: creat d6/d9/da/dc/f12 x:0 0 0 2024-02-28T23:07:18.249 INFO:tasks.workunit.client.0.smithi159.stdout:1/479: write d6/d12/d16/f79 [960655,110808] 0 2024-02-28T23:07:18.250 INFO:tasks.workunit.client.1.smithi184.stdout:2/28: dread f5 [0,4194304] 0 2024-02-28T23:07:18.250 INFO:tasks.workunit.client.0.smithi159.stdout:6/482: creat d0/d1b/f9e x:0 0 0 2024-02-28T23:07:18.252 INFO:tasks.workunit.client.0.smithi159.stdout:6/483: readlink d0/d1b/d33/d11/d14/d49/l7e 0 2024-02-28T23:07:18.252 INFO:tasks.workunit.client.1.smithi184.stdout:7/52: write f5 [4378712,93730] 0 2024-02-28T23:07:18.252 INFO:tasks.workunit.client.1.smithi184.stdout:3/48: unlink d1/d4/d6/c9 0 2024-02-28T23:07:18.253 INFO:tasks.workunit.client.1.smithi184.stdout:9/54: rmdir d5 39 2024-02-28T23:07:18.253 INFO:tasks.workunit.client.1.smithi184.stdout:2/29: write f4 [190503,13752] 0 2024-02-28T23:07:18.254 INFO:tasks.workunit.client.0.smithi159.stdout:2/434: creat d9/d23/d2c/f91 x:0 0 0 2024-02-28T23:07:18.256 INFO:tasks.workunit.client.1.smithi184.stdout:7/53: read d6/f8 [1518124,60231] 0 2024-02-28T23:07:18.256 INFO:tasks.workunit.client.1.smithi184.stdout:6/41: dwrite f7 [0,4194304] 0 2024-02-28T23:07:18.256 INFO:tasks.workunit.client.1.smithi184.stdout:8/69: mknod d1/da/c1d 0 2024-02-28T23:07:18.257 INFO:tasks.workunit.client.1.smithi184.stdout:3/49: dread - d1/d4/fb zero size 2024-02-28T23:07:18.258 INFO:tasks.workunit.client.1.smithi184.stdout:7/54: write f4 [2028257,33249] 0 2024-02-28T23:07:18.258 INFO:tasks.workunit.client.0.smithi159.stdout:7/363: link d5/d16/d1a/f3c d5/d16/d1a/d24/f77 0 2024-02-28T23:07:18.259 INFO:tasks.workunit.client.1.smithi184.stdout:5/49: getdents db/d12 0 2024-02-28T23:07:18.261 INFO:tasks.workunit.client.0.smithi159.stdout:0/626: fsync d0/d5/d14/d78/fa6 0 2024-02-28T23:07:18.275 INFO:tasks.workunit.client.1.smithi184.stdout:0/70: truncate d0/fb 6709576 0 2024-02-28T23:07:18.276 INFO:tasks.workunit.client.0.smithi159.stdout:7/364: dwrite d5/d16/d1a/d27/d46/f61 [0,4194304] 0 2024-02-28T23:07:18.277 INFO:tasks.workunit.client.1.smithi184.stdout:2/30: dwrite f8 [0,4194304] 0 2024-02-28T23:07:18.277 INFO:tasks.workunit.client.1.smithi184.stdout:2/31: readlink l2 0 2024-02-28T23:07:18.278 INFO:tasks.workunit.client.0.smithi159.stdout:0/627: unlink d0/d5/d14/d34/cd3 0 2024-02-28T23:07:18.280 INFO:tasks.workunit.client.0.smithi159.stdout:0/628: chown d0/d5/d14/d34/d3d/f83 509 1 2024-02-28T23:07:18.280 INFO:tasks.workunit.client.0.smithi159.stdout:9/525: chown d4/d3d/d3e/d55/d4c/d4e/c50 3 1 2024-02-28T23:07:18.284 INFO:tasks.workunit.client.0.smithi159.stdout:2/435: write d9/d50/d54/f66 [641476,39678] 0 2024-02-28T23:07:18.285 INFO:tasks.workunit.client.0.smithi159.stdout:1/480: getdents d6/d12/d1a/d92/d97 0 2024-02-28T23:07:18.288 INFO:tasks.workunit.client.1.smithi184.stdout:8/70: mknod d1/da/d10/c1e 0 2024-02-28T23:07:18.293 INFO:tasks.workunit.client.0.smithi159.stdout:6/484: mknod d0/d1b/d38/d96/c9f 0 2024-02-28T23:07:18.295 INFO:tasks.workunit.client.1.smithi184.stdout:7/55: mkdir d6/d9/d13 0 2024-02-28T23:07:18.296 INFO:tasks.workunit.client.1.smithi184.stdout:7/56: chown d6/d9/da/dc 1 1 2024-02-28T23:07:18.298 INFO:tasks.workunit.client.1.smithi184.stdout:3/50: unlink d1/d4/d6/fc 0 2024-02-28T23:07:18.299 INFO:tasks.workunit.client.1.smithi184.stdout:5/50: creat db/f13 x:0 0 0 2024-02-28T23:07:18.300 INFO:tasks.workunit.client.0.smithi159.stdout:7/365: symlink d5/d16/d1a/d24/l78 0 2024-02-28T23:07:18.302 INFO:tasks.workunit.client.0.smithi159.stdout:3/449: getdents d0/d6/d3e/d2f 0 2024-02-28T23:07:18.302 INFO:tasks.workunit.client.0.smithi159.stdout:7/366: dread - d5/d16/d1a/f70 zero size 2024-02-28T23:07:18.302 INFO:tasks.workunit.client.1.smithi184.stdout:1/108: getdents d20 0 2024-02-28T23:07:18.303 INFO:tasks.workunit.client.0.smithi159.stdout:3/450: stat d0/d6/d3e/f1d 0 2024-02-28T23:07:18.305 INFO:tasks.workunit.client.0.smithi159.stdout:9/526: creat d4/d3d/d3e/d55/d37/d62/d77/fa9 x:0 0 0 2024-02-28T23:07:18.305 INFO:tasks.workunit.client.1.smithi184.stdout:4/37: link d1/d8/l9 d1/d8/la 0 2024-02-28T23:07:18.307 INFO:tasks.workunit.client.1.smithi184.stdout:4/38: fdatasync d1/f2 0 2024-02-28T23:07:18.307 INFO:tasks.workunit.client.0.smithi159.stdout:2/436: creat d9/d34/d44/f92 x:0 0 0 2024-02-28T23:07:18.307 INFO:tasks.workunit.client.0.smithi159.stdout:9/527: read d4/d76/fa8 [1333359,17174] 0 2024-02-28T23:07:18.308 INFO:tasks.workunit.client.1.smithi184.stdout:0/71: creat d0/df/d13/f18 x:0 0 0 2024-02-28T23:07:18.310 INFO:tasks.workunit.client.1.smithi184.stdout:4/39: write d1/f2 [2875583,103782] 0 2024-02-28T23:07:18.311 INFO:tasks.workunit.client.1.smithi184.stdout:4/40: stat d1/l6 0 2024-02-28T23:07:18.312 INFO:tasks.workunit.client.0.smithi159.stdout:0/629: dread d0/d5/d14/d25/f84 [0,4194304] 0 2024-02-28T23:07:18.312 INFO:tasks.workunit.client.0.smithi159.stdout:6/485: creat d0/d1b/d33/d3f/d44/fa0 x:0 0 0 2024-02-28T23:07:18.313 INFO:tasks.workunit.client.1.smithi184.stdout:4/41: chown d1/d4 15209 1 2024-02-28T23:07:18.316 INFO:tasks.workunit.client.1.smithi184.stdout:8/71: creat d1/da/df/f1f x:0 0 0 2024-02-28T23:07:18.318 INFO:tasks.workunit.client.0.smithi159.stdout:3/451: unlink d0/d6/d34/l52 0 2024-02-28T23:07:18.318 INFO:tasks.workunit.client.0.smithi159.stdout:7/367: dread d5/d16/d1a/d27/d3e/f4a [0,4194304] 0 2024-02-28T23:07:18.318 INFO:tasks.workunit.client.1.smithi184.stdout:3/51: dwrite d1/d4/d6/fa [0,4194304] 0 2024-02-28T23:07:18.319 INFO:tasks.workunit.client.0.smithi159.stdout:1/481: mkdir d6/d1d/d1f/d3e/d9c 0 2024-02-28T23:07:18.320 INFO:tasks.workunit.client.0.smithi159.stdout:1/482: dread - d6/d1d/f68 zero size 2024-02-28T23:07:18.321 INFO:tasks.workunit.client.1.smithi184.stdout:6/42: rename f7 to dc/fd 0 2024-02-28T23:07:18.321 INFO:tasks.workunit.client.1.smithi184.stdout:3/52: write d1/d4/d6/fa [2575270,100719] 0 2024-02-28T23:07:18.322 INFO:tasks.workunit.client.1.smithi184.stdout:9/55: rename d5 to d5/dd 22 2024-02-28T23:07:18.325 INFO:tasks.workunit.client.0.smithi159.stdout:6/486: creat d0/d6d/fa1 x:0 0 0 2024-02-28T23:07:18.327 INFO:tasks.workunit.client.1.smithi184.stdout:4/42: dread d1/f2 [0,4194304] 0 2024-02-28T23:07:18.328 INFO:tasks.workunit.client.1.smithi184.stdout:5/51: read f8 [296072,128077] 0 2024-02-28T23:07:18.330 INFO:tasks.workunit.client.1.smithi184.stdout:4/43: write d1/f2 [2588190,70207] 0 2024-02-28T23:07:18.335 INFO:tasks.workunit.client.0.smithi159.stdout:2/437: rename d9/d23/d2c/d55/d13/l18 to d9/d50/d54/d84/d37/d5c/l93 0 2024-02-28T23:07:18.338 INFO:tasks.workunit.client.1.smithi184.stdout:0/72: creat d0/df/f19 x:0 0 0 2024-02-28T23:07:18.340 INFO:tasks.workunit.client.0.smithi159.stdout:3/452: mkdir d0/d47/d88 0 2024-02-28T23:07:18.341 INFO:tasks.workunit.client.1.smithi184.stdout:8/72: mkdir d1/da/df/d20 0 2024-02-28T23:07:18.341 INFO:tasks.workunit.client.0.smithi159.stdout:9/528: link d4/d3d/d3e/d55/d37/l85 d4/d76/laa 0 2024-02-28T23:07:18.343 INFO:tasks.workunit.client.0.smithi159.stdout:3/453: chown d0/d6/d3e/d57/l5f 20491 1 2024-02-28T23:07:18.343 INFO:tasks.workunit.client.0.smithi159.stdout:7/368: rename d5/d56/f33 to d5/d16/d1a/d24/d64/f79 0 2024-02-28T23:07:18.343 INFO:tasks.workunit.client.0.smithi159.stdout:9/529: dread - d4/d3d/d3e/d55/d4c/d4e/f9c zero size 2024-02-28T23:07:18.344 INFO:tasks.workunit.client.1.smithi184.stdout:8/73: chown d1/da/c1d 3758441 1 2024-02-28T23:07:18.344 INFO:tasks.workunit.client.1.smithi184.stdout:3/53: dwrite d1/d4/d6/fa [0,4194304] 0 2024-02-28T23:07:18.345 INFO:tasks.workunit.client.0.smithi159.stdout:0/630: link d0/d5/f3f d0/d5/fe2 0 2024-02-28T23:07:18.345 INFO:tasks.workunit.client.0.smithi159.stdout:9/530: chown d4/c21 120716993 1 2024-02-28T23:07:18.347 INFO:tasks.workunit.client.0.smithi159.stdout:6/487: fsync d0/f2b 0 2024-02-28T23:07:18.347 INFO:tasks.workunit.client.0.smithi159.stdout:9/531: chown d4/f36 14052 1 2024-02-28T23:07:18.348 INFO:tasks.workunit.client.1.smithi184.stdout:1/109: getdents d20 0 2024-02-28T23:07:18.349 INFO:tasks.workunit.client.1.smithi184.stdout:7/57: mkdir d6/d9/d13/d14 0 2024-02-28T23:07:18.350 INFO:tasks.workunit.client.1.smithi184.stdout:8/74: truncate d1/da/dc/f15 927244 0 2024-02-28T23:07:18.353 INFO:tasks.workunit.client.1.smithi184.stdout:2/32: link l6 l9 0 2024-02-28T23:07:18.353 INFO:tasks.workunit.client.0.smithi159.stdout:2/438: dread d9/d34/d44/f81 [0,4194304] 0 2024-02-28T23:07:18.354 INFO:tasks.workunit.client.0.smithi159.stdout:1/483: dread d6/d12/d1a/f38 [0,4194304] 0 2024-02-28T23:07:18.354 INFO:tasks.workunit.client.0.smithi159.stdout:4/571: sync 2024-02-28T23:07:18.354 INFO:tasks.workunit.client.0.smithi159.stdout:8/615: sync 2024-02-28T23:07:18.354 INFO:tasks.workunit.client.1.smithi184.stdout:8/75: write d1/da/d10/d17/f13 [514853,5448] 0 2024-02-28T23:07:18.355 INFO:tasks.workunit.client.1.smithi184.stdout:0/73: dread d0/f6 [0,4194304] 0 2024-02-28T23:07:18.356 INFO:tasks.workunit.client.1.smithi184.stdout:4/44: dwrite d1/f2 [0,4194304] 0 2024-02-28T23:07:18.358 INFO:tasks.workunit.client.1.smithi184.stdout:3/54: symlink d1/lf 0 2024-02-28T23:07:18.365 INFO:tasks.workunit.client.1.smithi184.stdout:1/110: creat d20/f22 x:0 0 0 2024-02-28T23:07:18.365 INFO:tasks.workunit.client.1.smithi184.stdout:8/76: chown d1/da/df/f1f 102 1 2024-02-28T23:07:18.365 INFO:tasks.workunit.client.1.smithi184.stdout:2/33: creat fa x:0 0 0 2024-02-28T23:07:18.365 INFO:tasks.workunit.client.1.smithi184.stdout:1/111: fdatasync f1d 0 2024-02-28T23:07:18.365 INFO:tasks.workunit.client.0.smithi159.stdout:4/572: readlink d9/da/d1c/d23/d2d/lbc 0 2024-02-28T23:07:18.366 INFO:tasks.workunit.client.0.smithi159.stdout:9/532: link d4/d3d/d3e/d55/d37/f6c d4/d3d/d3e/d4a/fab 0 2024-02-28T23:07:18.368 INFO:tasks.workunit.client.0.smithi159.stdout:6/488: rmdir d0/d1b/d33/d11/d14/d99 0 2024-02-28T23:07:18.369 INFO:tasks.workunit.client.1.smithi184.stdout:2/34: creat fb x:0 0 0 2024-02-28T23:07:18.371 INFO:tasks.workunit.client.1.smithi184.stdout:9/56: getdents d5 0 2024-02-28T23:07:18.374 INFO:tasks.workunit.client.0.smithi159.stdout:8/616: dwrite d2/d3/f2a [0,4194304] 0 2024-02-28T23:07:18.375 INFO:tasks.workunit.client.1.smithi184.stdout:2/35: write fb [607980,85918] 0 2024-02-28T23:07:18.375 INFO:tasks.workunit.client.0.smithi159.stdout:0/631: dwrite d0/de/fd5 [0,4194304] 0 2024-02-28T23:07:18.376 INFO:tasks.workunit.client.0.smithi159.stdout:1/484: link d6/d1d/d1f/d3e/d6a/f8b d6/d12/d1a/d92/f9d 0 2024-02-28T23:07:18.377 INFO:tasks.workunit.client.0.smithi159.stdout:8/617: readlink d2/d11/d52/d47/d65/lbd 0 2024-02-28T23:07:18.378 INFO:tasks.workunit.client.1.smithi184.stdout:1/112: creat d20/f23 x:0 0 0 2024-02-28T23:07:18.382 INFO:tasks.workunit.client.1.smithi184.stdout:9/57: write d5/f6 [2648927,27875] 0 2024-02-28T23:07:18.382 INFO:tasks.workunit.client.1.smithi184.stdout:5/52: link ca db/d12/c14 0 2024-02-28T23:07:18.384 INFO:tasks.workunit.client.0.smithi159.stdout:0/632: dread d0/de/d46/f61 [0,4194304] 0 2024-02-28T23:07:18.388 INFO:tasks.workunit.client.1.smithi184.stdout:2/36: read f4 [87691,9569] 0 2024-02-28T23:07:18.391 INFO:tasks.workunit.client.0.smithi159.stdout:4/573: dwrite d9/da/d1c/d23/d2d/fac [0,4194304] 0 2024-02-28T23:07:18.396 INFO:tasks.workunit.client.1.smithi184.stdout:7/58: dwrite f5 [0,4194304] 0 2024-02-28T23:07:18.397 INFO:tasks.workunit.client.1.smithi184.stdout:5/53: fsync db/f13 0 2024-02-28T23:07:18.397 INFO:tasks.workunit.client.1.smithi184.stdout:7/59: readlink l2 0 2024-02-28T23:07:18.399 INFO:tasks.workunit.client.1.smithi184.stdout:8/77: dwrite d1/f5 [0,4194304] 0 2024-02-28T23:07:18.399 INFO:tasks.workunit.client.0.smithi159.stdout:6/489: rename d0/d1b/d38 to d0/d1b/d33/d11/d34/d9d/da2 0 2024-02-28T23:07:18.399 INFO:tasks.workunit.client.1.smithi184.stdout:6/43: sync 2024-02-28T23:07:18.400 INFO:tasks.workunit.client.0.smithi159.stdout:6/490: chown d0/d1b/d33/d11 79536 1 2024-02-28T23:07:18.402 INFO:tasks.workunit.client.0.smithi159.stdout:8/618: rmdir d2/d11/d35/d5f 39 2024-02-28T23:07:18.403 INFO:tasks.workunit.client.0.smithi159.stdout:8/619: chown d2/d11/d52/d47/d65 24153149 1 2024-02-28T23:07:18.407 INFO:tasks.workunit.client.1.smithi184.stdout:5/54: write db/f13 [423699,20620] 0 2024-02-28T23:07:18.411 INFO:tasks.workunit.client.0.smithi159.stdout:2/439: link d9/d50/d54/d84/d37/f53 d9/d50/d54/f94 0 2024-02-28T23:07:18.414 INFO:tasks.workunit.client.1.smithi184.stdout:0/74: dwrite d0/df/d13/f14 [0,4194304] 0 2024-02-28T23:07:18.421 INFO:tasks.workunit.client.0.smithi159.stdout:5/512: sync 2024-02-28T23:07:18.423 INFO:tasks.workunit.client.0.smithi159.stdout:5/513: read - d8/d16/fab zero size 2024-02-28T23:07:18.425 INFO:tasks.workunit.client.0.smithi159.stdout:8/620: dwrite d2/d11/d52/d26/d36/f64 [0,4194304] 0 2024-02-28T23:07:18.426 INFO:tasks.workunit.client.1.smithi184.stdout:7/60: creat d6/f15 x:0 0 0 2024-02-28T23:07:18.427 INFO:tasks.workunit.client.0.smithi159.stdout:5/514: chown d8/d19/d23/d35/f99 298738 1 2024-02-28T23:07:18.428 INFO:tasks.workunit.client.0.smithi159.stdout:8/621: dread - d2/d11/d52/d26/d36/d38/d77/f9f zero size 2024-02-28T23:07:18.429 INFO:tasks.workunit.client.0.smithi159.stdout:9/533: mkdir d4/d3d/d3e/d55/d37/d62/da6/dac 0 2024-02-28T23:07:18.432 INFO:tasks.workunit.client.1.smithi184.stdout:6/44: truncate fb 518978 0 2024-02-28T23:07:18.433 INFO:tasks.workunit.client.0.smithi159.stdout:8/622: write d2/d3/f3d [265807,54874] 0 2024-02-28T23:07:18.434 INFO:tasks.workunit.client.0.smithi159.stdout:7/369: truncate d5/d16/d1a/d27/d3e/f76 3565129 0 2024-02-28T23:07:18.435 INFO:tasks.workunit.client.0.smithi159.stdout:8/623: read d2/d3/f14 [3089597,28438] 0 2024-02-28T23:07:18.436 INFO:tasks.workunit.client.1.smithi184.stdout:1/113: dwrite ff [0,4194304] 0 2024-02-28T23:07:18.436 INFO:tasks.workunit.client.1.smithi184.stdout:4/45: truncate d1/f2 2477739 0 2024-02-28T23:07:18.441 INFO:tasks.workunit.client.0.smithi159.stdout:3/454: dread d0/fe [4194304,4194304] 0 2024-02-28T23:07:18.447 INFO:tasks.workunit.client.1.smithi184.stdout:7/61: dread f5 [0,4194304] 0 2024-02-28T23:07:18.447 INFO:tasks.workunit.client.1.smithi184.stdout:8/78: rmdir d1/da/d10 39 2024-02-28T23:07:18.449 INFO:tasks.workunit.client.1.smithi184.stdout:8/79: chown d1/da/dc/d18 26 1 2024-02-28T23:07:18.450 INFO:tasks.workunit.client.0.smithi159.stdout:1/485: mknod d6/d1d/d1f/d3e/d9c/c9e 0 2024-02-28T23:07:18.451 INFO:tasks.workunit.client.1.smithi184.stdout:8/80: read - d1/da/dc/d18/f19 zero size 2024-02-28T23:07:18.453 INFO:tasks.workunit.client.1.smithi184.stdout:9/58: mkdir d5/db/de 0 2024-02-28T23:07:18.454 INFO:tasks.workunit.client.0.smithi159.stdout:6/491: dwrite d0/d1b/f1a [4194304,4194304] 0 2024-02-28T23:07:18.454 INFO:tasks.workunit.client.1.smithi184.stdout:8/81: write d1/f5 [878267,70851] 0 2024-02-28T23:07:18.457 INFO:tasks.workunit.client.0.smithi159.stdout:6/492: chown d0/d1b/d33/d11/d34/d9d/da2/d4d 27 1 2024-02-28T23:07:18.462 INFO:tasks.workunit.client.1.smithi184.stdout:0/75: creat d0/df/d13/f1a x:0 0 0 2024-02-28T23:07:18.464 INFO:tasks.workunit.client.1.smithi184.stdout:2/37: write f5 [323359,110133] 0 2024-02-28T23:07:18.464 INFO:tasks.workunit.client.1.smithi184.stdout:2/38: rmdir - no directory 2024-02-28T23:07:18.465 INFO:tasks.workunit.client.1.smithi184.stdout:3/55: truncate d1/d4/d6/fa 3465548 0 2024-02-28T23:07:18.467 INFO:tasks.workunit.client.1.smithi184.stdout:2/39: truncate f5 668506 0 2024-02-28T23:07:18.468 INFO:tasks.workunit.client.1.smithi184.stdout:6/45: mkdir dc/de 0 2024-02-28T23:07:18.469 INFO:tasks.workunit.client.1.smithi184.stdout:3/56: truncate d1/d4/fb 78051 0 2024-02-28T23:07:18.477 INFO:tasks.workunit.client.1.smithi184.stdout:1/114: rename f18 to d20/f24 0 2024-02-28T23:07:18.478 INFO:tasks.workunit.client.0.smithi159.stdout:7/370: rmdir d5/d56/d50 39 2024-02-28T23:07:18.479 INFO:tasks.workunit.client.1.smithi184.stdout:5/55: write f8 [198364,11952] 0 2024-02-28T23:07:18.479 INFO:tasks.workunit.client.1.smithi184.stdout:8/82: symlink d1/da/dc/d18/l21 0 2024-02-28T23:07:18.480 INFO:tasks.workunit.client.1.smithi184.stdout:0/76: symlink d0/l1b 0 2024-02-28T23:07:18.480 INFO:tasks.workunit.client.0.smithi159.stdout:3/455: dread d0/d6/d3e/d2f/f56 [0,4194304] 0 2024-02-28T23:07:18.482 INFO:tasks.workunit.client.0.smithi159.stdout:0/633: link d0/de/l20 d0/d5/d14/d25/db5/le3 0 2024-02-28T23:07:18.485 INFO:tasks.workunit.client.1.smithi184.stdout:2/40: creat fc x:0 0 0 2024-02-28T23:07:18.486 INFO:tasks.workunit.client.1.smithi184.stdout:5/56: dread f7 [0,4194304] 0 2024-02-28T23:07:18.488 INFO:tasks.workunit.client.0.smithi159.stdout:6/493: rename d0/d1b/d33/f5f to d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/fa3 0 2024-02-28T23:07:18.488 INFO:tasks.workunit.client.0.smithi159.stdout:9/534: dread d4/d3d/d3e/d55/d37/d62/f74 [0,4194304] 0 2024-02-28T23:07:18.491 INFO:tasks.workunit.client.0.smithi159.stdout:4/574: creat d9/d42/fc6 x:0 0 0 2024-02-28T23:07:18.492 INFO:tasks.workunit.client.0.smithi159.stdout:9/535: truncate d4/d3d/d3e/d55/d37/f79 564089 0 2024-02-28T23:07:18.495 INFO:tasks.workunit.client.1.smithi184.stdout:7/62: link d6/f15 d6/f16 0 2024-02-28T23:07:18.495 INFO:tasks.workunit.client.1.smithi184.stdout:4/46: dwrite d1/f2 [0,4194304] 0 2024-02-28T23:07:18.496 INFO:tasks.workunit.client.0.smithi159.stdout:2/440: creat d9/d23/d2c/d55/f95 x:0 0 0 2024-02-28T23:07:18.498 INFO:tasks.workunit.client.1.smithi184.stdout:9/59: rename l0 to d5/db/lf 0 2024-02-28T23:07:18.500 INFO:tasks.workunit.client.1.smithi184.stdout:3/57: dwrite d1/d4/fb [0,4194304] 0 2024-02-28T23:07:18.503 INFO:tasks.workunit.client.1.smithi184.stdout:9/60: truncate d5/f9 436586 0 2024-02-28T23:07:18.506 INFO:tasks.workunit.client.1.smithi184.stdout:8/83: creat d1/da/df/f22 x:0 0 0 2024-02-28T23:07:18.510 INFO:tasks.workunit.client.0.smithi159.stdout:4/575: mkdir d9/d42/d54/d9c/dc7 0 2024-02-28T23:07:18.515 INFO:tasks.workunit.client.0.smithi159.stdout:9/536: dread - d4/d3d/d3e/d4a/f59 zero size 2024-02-28T23:07:18.516 INFO:tasks.workunit.client.1.smithi184.stdout:9/61: dread d5/f6 [0,4194304] 0 2024-02-28T23:07:18.517 INFO:tasks.workunit.client.0.smithi159.stdout:5/515: dwrite d8/d19/d23/d35/d41/f58 [0,4194304] 0 2024-02-28T23:07:18.517 INFO:tasks.workunit.client.1.smithi184.stdout:4/47: symlink d1/lb 0 2024-02-28T23:07:18.520 INFO:tasks.workunit.client.0.smithi159.stdout:3/456: creat d0/d2b/d55/d75/d6d/d54/d7c/d79/f89 x:0 0 0 2024-02-28T23:07:18.522 INFO:tasks.workunit.client.0.smithi159.stdout:5/516: chown d8/d19/d23/d35/d38/d8f/fa1 573 1 2024-02-28T23:07:18.522 INFO:tasks.workunit.client.1.smithi184.stdout:0/77: rename d0/c7 to d0/df/c1c 0 2024-02-28T23:07:18.524 INFO:tasks.workunit.client.0.smithi159.stdout:6/494: dwrite d0/f8 [0,4194304] 0 2024-02-28T23:07:18.526 INFO:tasks.workunit.client.1.smithi184.stdout:0/78: write d0/df/f15 [306696,11542] 0 2024-02-28T23:07:18.530 INFO:tasks.workunit.client.0.smithi159.stdout:6/495: fdatasync d0/d1b/d33/d11/d34/d9d/da2/d4d/f84 0 2024-02-28T23:07:18.531 INFO:tasks.workunit.client.1.smithi184.stdout:0/79: truncate d0/fe 890200 0 2024-02-28T23:07:18.532 INFO:tasks.workunit.client.1.smithi184.stdout:0/80: chown d0/l16 3601 1 2024-02-28T23:07:18.534 INFO:tasks.workunit.client.1.smithi184.stdout:0/81: write d0/f6 [754528,126403] 0 2024-02-28T23:07:18.535 INFO:tasks.workunit.client.0.smithi159.stdout:7/371: rename d5/d16/d1a/d27/d3e/f62 to d5/f7a 0 2024-02-28T23:07:18.538 INFO:tasks.workunit.client.0.smithi159.stdout:9/537: read d4/d3d/d3e/d55/d4c/f92 [3115188,10330] 0 2024-02-28T23:07:18.540 INFO:tasks.workunit.client.0.smithi159.stdout:5/517: mknod d8/d19/d23/d35/d65/da3/cae 0 2024-02-28T23:07:18.542 INFO:tasks.workunit.client.0.smithi159.stdout:7/372: write d5/d56/d2a/f4d [2666556,82004] 0 2024-02-28T23:07:18.542 INFO:tasks.workunit.client.0.smithi159.stdout:0/634: write d0/de/d75/d5f/f72 [868992,37740] 0 2024-02-28T23:07:18.543 INFO:tasks.workunit.client.1.smithi184.stdout:8/84: dwrite d1/f2 [4194304,4194304] 0 2024-02-28T23:07:18.550 INFO:tasks.workunit.client.1.smithi184.stdout:5/57: truncate db/f13 238282 0 2024-02-28T23:07:18.551 INFO:tasks.workunit.client.1.smithi184.stdout:4/48: mkdir d1/dc 0 2024-02-28T23:07:18.552 INFO:tasks.workunit.client.1.smithi184.stdout:4/49: chown d1/d8/la 4 1 2024-02-28T23:07:18.553 INFO:tasks.workunit.client.0.smithi159.stdout:3/457: dwrite d0/d2b/d55/d75/d6d/f3d [0,4194304] 0 2024-02-28T23:07:18.556 INFO:tasks.workunit.client.0.smithi159.stdout:2/441: dwrite d9/d23/d2c/d55/f5b [0,4194304] 0 2024-02-28T23:07:18.556 INFO:tasks.workunit.client.0.smithi159.stdout:1/486: rename d6/d12/d31/d69/c54 to d6/d1d/d46/c9f 0 2024-02-28T23:07:18.556 INFO:tasks.workunit.client.1.smithi184.stdout:7/63: rename d6/f15 to d6/d9/da/f17 0 2024-02-28T23:07:18.559 INFO:tasks.workunit.client.1.smithi184.stdout:2/41: link l3 ld 0 2024-02-28T23:07:18.560 INFO:tasks.workunit.client.1.smithi184.stdout:7/64: truncate d6/d9/da/dc/f12 874156 0 2024-02-28T23:07:18.561 INFO:tasks.workunit.client.1.smithi184.stdout:0/82: mkdir d0/d1d 0 2024-02-28T23:07:18.562 INFO:tasks.workunit.client.1.smithi184.stdout:3/58: fsync d1/d4/d6/fa 0 2024-02-28T23:07:18.564 INFO:tasks.workunit.client.1.smithi184.stdout:1/115: getdents d20 0 2024-02-28T23:07:18.568 INFO:tasks.workunit.client.1.smithi184.stdout:9/62: mkdir d5/db/de/d10 0 2024-02-28T23:07:18.574 INFO:tasks.workunit.client.0.smithi159.stdout:4/576: dwrite d9/da/f3a [0,4194304] 0 2024-02-28T23:07:18.574 INFO:tasks.workunit.client.1.smithi184.stdout:6/46: truncate fb 377008 0 2024-02-28T23:07:18.575 INFO:tasks.workunit.client.0.smithi159.stdout:5/518: fdatasync d8/d19/d23/d2a/f2f 0 2024-02-28T23:07:18.581 INFO:tasks.workunit.client.1.smithi184.stdout:2/42: creat fe x:0 0 0 2024-02-28T23:07:18.581 INFO:tasks.workunit.client.0.smithi159.stdout:9/538: dread d4/f5 [0,4194304] 0 2024-02-28T23:07:18.582 INFO:tasks.workunit.client.0.smithi159.stdout:7/373: creat d5/d56/d50/d5b/f7b x:0 0 0 2024-02-28T23:07:18.584 INFO:tasks.workunit.client.1.smithi184.stdout:0/83: rename d0/df/f19 to d0/d1d/f1e 0 2024-02-28T23:07:18.586 INFO:tasks.workunit.client.1.smithi184.stdout:1/116: dwrite f19 [0,4194304] 0 2024-02-28T23:07:18.586 INFO:tasks.workunit.client.0.smithi159.stdout:7/374: fdatasync d5/d10/f34 0 2024-02-28T23:07:18.586 INFO:tasks.workunit.client.0.smithi159.stdout:2/442: read d9/d23/d2c/d55/f72 [1546166,124146] 0 2024-02-28T23:07:18.587 INFO:tasks.workunit.client.1.smithi184.stdout:3/59: fsync d1/d4/d6/fa 0 2024-02-28T23:07:18.588 INFO:tasks.workunit.client.0.smithi159.stdout:0/635: rename d0/d5/d14/d25/d5c/c93 to d0/d5/d14/d34/d6c/daf/ce4 0 2024-02-28T23:07:18.589 INFO:tasks.workunit.client.1.smithi184.stdout:3/60: fdatasync d1/d4/fb 0 2024-02-28T23:07:18.592 INFO:tasks.workunit.client.0.smithi159.stdout:5/519: write d8/f8b [2553812,45068] 0 2024-02-28T23:07:18.598 INFO:tasks.workunit.client.1.smithi184.stdout:5/58: symlink db/d12/l15 0 2024-02-28T23:07:18.600 INFO:tasks.workunit.client.0.smithi159.stdout:6/496: getdents d0/d1b/d33/d11/d14/d49 0 2024-02-28T23:07:18.602 INFO:tasks.workunit.client.1.smithi184.stdout:3/61: dread d1/d4/d6/fa [0,4194304] 0 2024-02-28T23:07:18.604 INFO:tasks.workunit.client.1.smithi184.stdout:2/43: creat ff x:0 0 0 2024-02-28T23:07:18.605 INFO:tasks.workunit.client.0.smithi159.stdout:2/443: unlink d9/d34/d44/f81 0 2024-02-28T23:07:18.607 INFO:tasks.workunit.client.0.smithi159.stdout:3/458: rename d0/d2b/d4f/f65 to d0/d2b/d55/f8a 0 2024-02-28T23:07:18.613 INFO:tasks.workunit.client.0.smithi159.stdout:0/636: mknod d0/de/ce5 0 2024-02-28T23:07:18.614 INFO:tasks.workunit.client.0.smithi159.stdout:3/459: truncate d0/d2b/d55/d75/d6d/d54/d7c/f7b 441779 0 2024-02-28T23:07:18.620 INFO:tasks.workunit.client.1.smithi184.stdout:0/84: mkdir d0/d1f 0 2024-02-28T23:07:18.621 INFO:tasks.workunit.client.1.smithi184.stdout:0/85: dread - d0/df/d13/f18 zero size 2024-02-28T23:07:18.622 INFO:tasks.workunit.client.1.smithi184.stdout:2/44: dwrite ff [0,4194304] 0 2024-02-28T23:07:18.622 INFO:tasks.workunit.client.1.smithi184.stdout:2/45: write f8 [751814,109697] 0 2024-02-28T23:07:18.623 INFO:tasks.workunit.client.1.smithi184.stdout:1/117: rename f11 to d20/f25 0 2024-02-28T23:07:18.625 INFO:tasks.workunit.client.1.smithi184.stdout:7/65: truncate d6/d9/da/dc/f12 656218 0 2024-02-28T23:07:18.626 INFO:tasks.workunit.client.1.smithi184.stdout:9/63: creat d5/db/de/d10/f11 x:0 0 0 2024-02-28T23:07:18.631 INFO:tasks.workunit.client.1.smithi184.stdout:6/47: creat dc/de/ff x:0 0 0 2024-02-28T23:07:18.633 INFO:tasks.workunit.client.1.smithi184.stdout:5/59: chown db/cf 514358 1 2024-02-28T23:07:18.640 INFO:tasks.workunit.client.1.smithi184.stdout:2/46: mkdir d10 0 2024-02-28T23:07:18.641 INFO:tasks.workunit.client.1.smithi184.stdout:1/118: symlink d20/l26 0 2024-02-28T23:07:18.641 INFO:tasks.workunit.client.1.smithi184.stdout:2/47: write f8 [4367497,104033] 0 2024-02-28T23:07:18.642 INFO:tasks.workunit.client.1.smithi184.stdout:1/119: dread - f1d zero size 2024-02-28T23:07:18.643 INFO:tasks.workunit.client.1.smithi184.stdout:9/64: mkdir d5/db/de/d10/d12 0 2024-02-28T23:07:18.644 INFO:tasks.workunit.client.1.smithi184.stdout:9/65: fsync d5/fc 0 2024-02-28T23:07:18.644 INFO:tasks.workunit.client.1.smithi184.stdout:8/85: link d1/da/d10/c1e d1/da/dc/c23 0 2024-02-28T23:07:18.647 INFO:tasks.workunit.client.1.smithi184.stdout:6/48: dread fb [0,4194304] 0 2024-02-28T23:07:18.649 INFO:tasks.workunit.client.1.smithi184.stdout:9/66: rmdir d5/db 39 2024-02-28T23:07:18.650 INFO:tasks.workunit.client.1.smithi184.stdout:8/86: mknod d1/da/dc/c24 0 2024-02-28T23:07:18.651 INFO:tasks.workunit.client.1.smithi184.stdout:8/87: stat d1/da/c1d 0 2024-02-28T23:07:18.653 INFO:tasks.workunit.client.1.smithi184.stdout:2/48: creat d10/f11 x:0 0 0 2024-02-28T23:07:18.654 INFO:tasks.workunit.client.1.smithi184.stdout:6/49: mkdir dc/de/d10 0 2024-02-28T23:07:18.655 INFO:tasks.workunit.client.1.smithi184.stdout:0/86: getdents d0 0 2024-02-28T23:07:18.656 INFO:tasks.workunit.client.1.smithi184.stdout:6/50: dread - dc/de/ff zero size 2024-02-28T23:07:18.656 INFO:tasks.workunit.client.1.smithi184.stdout:2/49: read f8 [1937344,126583] 0 2024-02-28T23:07:18.666 INFO:tasks.workunit.client.1.smithi184.stdout:0/87: symlink d0/l20 0 2024-02-28T23:07:18.666 INFO:tasks.workunit.client.1.smithi184.stdout:6/51: unlink fa 0 2024-02-28T23:07:18.667 INFO:tasks.workunit.client.1.smithi184.stdout:2/50: readlink l3 0 2024-02-28T23:07:18.670 INFO:tasks.workunit.client.1.smithi184.stdout:8/88: dread d1/da/d10/d17/f13 [0,4194304] 0 2024-02-28T23:07:18.671 INFO:tasks.workunit.client.1.smithi184.stdout:7/66: dread d6/d9/da/dc/f12 [0,4194304] 0 2024-02-28T23:07:18.674 INFO:tasks.workunit.client.1.smithi184.stdout:2/51: dread fb [0,4194304] 0 2024-02-28T23:07:18.677 INFO:tasks.workunit.client.1.smithi184.stdout:9/67: dwrite d5/f9 [0,4194304] 0 2024-02-28T23:07:18.678 INFO:tasks.workunit.client.1.smithi184.stdout:5/60: dwrite db/f13 [0,4194304] 0 2024-02-28T23:07:18.697 INFO:tasks.workunit.client.1.smithi184.stdout:4/50: sync 2024-02-28T23:07:18.698 INFO:tasks.workunit.client.1.smithi184.stdout:4/51: write d1/f2 [4806150,84577] 0 2024-02-28T23:07:18.700 INFO:tasks.workunit.client.1.smithi184.stdout:4/52: write d1/f2 [2884669,73636] 0 2024-02-28T23:07:18.720 INFO:tasks.workunit.client.1.smithi184.stdout:0/88: rmdir d0 39 2024-02-28T23:07:18.720 INFO:tasks.workunit.client.1.smithi184.stdout:6/52: mknod dc/c11 0 2024-02-28T23:07:18.721 INFO:tasks.workunit.client.1.smithi184.stdout:6/53: readlink l6 0 2024-02-28T23:07:18.722 INFO:tasks.workunit.client.1.smithi184.stdout:8/89: creat d1/da/dc/d16/f25 x:0 0 0 2024-02-28T23:07:18.723 INFO:tasks.workunit.client.1.smithi184.stdout:2/52: mknod d10/c12 0 2024-02-28T23:07:18.725 INFO:tasks.workunit.client.1.smithi184.stdout:9/68: stat d5/db/de/d10/f11 0 2024-02-28T23:07:18.727 INFO:tasks.workunit.client.0.smithi159.stdout:5/520: write d8/d19/d23/d2a/f43 [573429,23043] 0 2024-02-28T23:07:18.727 INFO:tasks.workunit.client.0.smithi159.stdout:3/460: mkdir d0/d2b/d55/d75/d6d/d8b 0 2024-02-28T23:07:18.727 INFO:tasks.workunit.client.0.smithi159.stdout:4/577: dwrite d9/da/d1c/d23/f4d [0,4194304] 0 2024-02-28T23:07:18.729 INFO:tasks.workunit.client.0.smithi159.stdout:2/444: symlink d9/l96 0 2024-02-28T23:07:18.733 INFO:tasks.workunit.client.0.smithi159.stdout:1/487: dread d6/d12/f14 [4194304,4194304] 0 2024-02-28T23:07:18.733 INFO:tasks.workunit.client.0.smithi159.stdout:9/539: getdents d4/d3d/d3e/d55/d9e 0 2024-02-28T23:07:18.733 INFO:tasks.workunit.client.0.smithi159.stdout:4/578: write d9/d42/d54/d77/fc4 [632070,112869] 0 2024-02-28T23:07:18.738 INFO:tasks.workunit.client.0.smithi159.stdout:9/540: chown d4/d3d/d3e/d55/d9e 0 1 2024-02-28T23:07:18.738 INFO:tasks.workunit.client.0.smithi159.stdout:7/375: getdents d5/d10 0 2024-02-28T23:07:18.738 INFO:tasks.workunit.client.1.smithi184.stdout:9/69: dread d5/f9 [0,4194304] 0 2024-02-28T23:07:18.739 INFO:tasks.workunit.client.1.smithi184.stdout:6/54: unlink fb 0 2024-02-28T23:07:18.739 INFO:tasks.workunit.client.0.smithi159.stdout:9/541: write d4/d3d/d3e/f73 [1423641,19169] 0 2024-02-28T23:07:18.740 INFO:tasks.workunit.client.1.smithi184.stdout:0/89: fdatasync d0/df/f15 0 2024-02-28T23:07:18.740 INFO:tasks.workunit.client.0.smithi159.stdout:5/521: symlink d8/d19/d23/d35/d65/da3/laf 0 2024-02-28T23:07:18.741 INFO:tasks.workunit.client.1.smithi184.stdout:0/90: write d0/df/f15 [1325504,63774] 0 2024-02-28T23:07:18.744 INFO:tasks.workunit.client.0.smithi159.stdout:9/542: chown d4/d3d/d3e/d55/d37/f79 11917 1 2024-02-28T23:07:18.745 INFO:tasks.workunit.client.0.smithi159.stdout:1/488: write d6/d12/f93 [620648,87138] 0 2024-02-28T23:07:18.748 INFO:tasks.workunit.client.1.smithi184.stdout:8/90: rmdir d1/da/d10/d17 39 2024-02-28T23:07:18.748 INFO:tasks.workunit.client.1.smithi184.stdout:7/67: creat d6/d9/d13/d14/f18 x:0 0 0 2024-02-28T23:07:18.750 INFO:tasks.workunit.client.0.smithi159.stdout:9/543: stat d4/d3d/d3e/d4a/c7f 0 2024-02-28T23:07:18.750 INFO:tasks.workunit.client.0.smithi159.stdout:7/376: read - d5/d16/d40/f4e zero size 2024-02-28T23:07:18.750 INFO:tasks.workunit.client.1.smithi184.stdout:2/53: mkdir d10/d13 0 2024-02-28T23:07:18.757 INFO:tasks.workunit.client.0.smithi159.stdout:3/461: dwrite d0/d2b/d55/d75/d6d/d54/d7c/d79/f89 [0,4194304] 0 2024-02-28T23:07:18.758 INFO:tasks.workunit.client.0.smithi159.stdout:2/445: dwrite d9/d23/d2c/f82 [0,4194304] 0 2024-02-28T23:07:18.761 INFO:tasks.workunit.client.1.smithi184.stdout:4/53: link d1/f2 d1/dc/fd 0 2024-02-28T23:07:18.762 INFO:tasks.workunit.client.0.smithi159.stdout:4/579: mkdir d9/d42/dc8 0 2024-02-28T23:07:18.762 INFO:tasks.workunit.client.1.smithi184.stdout:4/54: chown d1/d8/l9 59070266 1 2024-02-28T23:07:18.763 INFO:tasks.workunit.client.1.smithi184.stdout:4/55: chown l0 9 1 2024-02-28T23:07:18.765 INFO:tasks.workunit.client.1.smithi184.stdout:3/62: sync 2024-02-28T23:07:18.765 INFO:tasks.workunit.client.1.smithi184.stdout:1/120: sync 2024-02-28T23:07:18.772 INFO:tasks.workunit.client.1.smithi184.stdout:6/55: rmdir dc/de 39 2024-02-28T23:07:18.774 INFO:tasks.workunit.client.1.smithi184.stdout:7/68: creat d6/f19 x:0 0 0 2024-02-28T23:07:18.780 INFO:tasks.workunit.client.0.smithi159.stdout:2/446: creat d9/d50/d54/d84/f97 x:0 0 0 2024-02-28T23:07:18.782 INFO:tasks.workunit.client.1.smithi184.stdout:2/54: truncate f4 1168055 0 2024-02-28T23:07:18.782 INFO:tasks.workunit.client.1.smithi184.stdout:5/61: link l6 db/l16 0 2024-02-28T23:07:18.784 INFO:tasks.workunit.client.0.smithi159.stdout:4/580: rmdir d9/da 39 2024-02-28T23:07:18.788 INFO:tasks.workunit.client.0.smithi159.stdout:3/462: mknod d0/d6/d3e/c8c 0 2024-02-28T23:07:18.791 INFO:tasks.workunit.client.1.smithi184.stdout:1/121: rename d20/f23 to d20/f27 0 2024-02-28T23:07:18.792 INFO:tasks.workunit.client.1.smithi184.stdout:1/122: readlink l7 0 2024-02-28T23:07:18.793 INFO:tasks.workunit.client.0.smithi159.stdout:1/489: rename d6/d1d/l5b to d6/la0 0 2024-02-28T23:07:18.794 INFO:tasks.workunit.client.1.smithi184.stdout:3/63: mknod d1/d4/d6/c10 0 2024-02-28T23:07:18.795 INFO:tasks.workunit.client.1.smithi184.stdout:3/64: readlink d1/lf 0 2024-02-28T23:07:18.795 INFO:tasks.workunit.client.0.smithi159.stdout:4/581: mkdir d9/d42/d54/d77/dc9 0 2024-02-28T23:07:18.801 INFO:tasks.workunit.client.0.smithi159.stdout:1/490: write d6/d12/f96 [326386,5448] 0 2024-02-28T23:07:18.802 INFO:tasks.workunit.client.1.smithi184.stdout:8/91: creat d1/da/df/d20/f26 x:0 0 0 2024-02-28T23:07:18.804 INFO:tasks.workunit.client.1.smithi184.stdout:2/55: creat d10/f14 x:0 0 0 2024-02-28T23:07:18.806 INFO:tasks.workunit.client.1.smithi184.stdout:5/62: unlink db/f13 0 2024-02-28T23:07:18.806 INFO:tasks.workunit.client.1.smithi184.stdout:8/92: dread - d1/da/dc/d18/f19 zero size 2024-02-28T23:07:18.807 INFO:tasks.workunit.client.1.smithi184.stdout:9/70: creat d5/f13 x:0 0 0 2024-02-28T23:07:18.810 INFO:tasks.workunit.client.1.smithi184.stdout:1/123: fdatasync d20/f24 0 2024-02-28T23:07:18.811 INFO:tasks.workunit.client.0.smithi159.stdout:4/582: dread - d9/da/d1c/d23/d2d/f83 zero size 2024-02-28T23:07:18.811 INFO:tasks.workunit.client.1.smithi184.stdout:9/71: chown c1 1 1 2024-02-28T23:07:18.811 INFO:tasks.workunit.client.1.smithi184.stdout:8/93: chown d1/ce 4589 1 2024-02-28T23:07:18.813 INFO:tasks.workunit.client.1.smithi184.stdout:3/65: mknod d1/d4/d6/c11 0 2024-02-28T23:07:18.817 INFO:tasks.workunit.client.1.smithi184.stdout:6/56: rmdir dc/de 39 2024-02-28T23:07:18.817 INFO:tasks.workunit.client.1.smithi184.stdout:9/72: stat d5/db/de/d10/f11 0 2024-02-28T23:07:18.817 INFO:tasks.workunit.client.1.smithi184.stdout:3/66: fsync d1/d4/d6/fa 0 2024-02-28T23:07:18.818 INFO:tasks.workunit.client.0.smithi159.stdout:1/491: creat d6/d12/fa1 x:0 0 0 2024-02-28T23:07:18.820 INFO:tasks.workunit.client.1.smithi184.stdout:4/56: dwrite d1/f2 [0,4194304] 0 2024-02-28T23:07:18.820 INFO:tasks.workunit.client.0.smithi159.stdout:4/583: link d9/f1e d9/d42/d54/d77/fca 0 2024-02-28T23:07:18.822 INFO:tasks.workunit.client.1.smithi184.stdout:1/124: creat d20/f28 x:0 0 0 2024-02-28T23:07:18.823 INFO:tasks.workunit.client.0.smithi159.stdout:4/584: creat d9/da/d1c/d8e/fcb x:0 0 0 2024-02-28T23:07:18.826 INFO:tasks.workunit.client.0.smithi159.stdout:1/492: rename d6/d12/fa1 to d6/d12/d31/d5a/fa2 0 2024-02-28T23:07:18.832 INFO:tasks.workunit.client.1.smithi184.stdout:2/56: mkdir d10/d13/d15 0 2024-02-28T23:07:18.832 INFO:tasks.workunit.client.0.smithi159.stdout:4/585: readlink d9/da/l52 0 2024-02-28T23:07:18.834 INFO:tasks.workunit.client.1.smithi184.stdout:9/73: readlink d5/db/lf 0 2024-02-28T23:07:18.836 INFO:tasks.workunit.client.0.smithi159.stdout:4/586: creat d9/d42/d54/d77/fcc x:0 0 0 2024-02-28T23:07:18.839 INFO:tasks.workunit.client.0.smithi159.stdout:1/493: creat d6/d12/d1a/fa3 x:0 0 0 2024-02-28T23:07:18.841 INFO:tasks.workunit.client.0.smithi159.stdout:1/494: truncate d6/d12/d1a/fa3 75339 0 2024-02-28T23:07:18.841 INFO:tasks.workunit.client.0.smithi159.stdout:4/587: unlink d9/da/l65 0 2024-02-28T23:07:18.841 INFO:tasks.workunit.client.1.smithi184.stdout:4/57: rename d1/l6 to d1/dc/le 0 2024-02-28T23:07:18.842 INFO:tasks.workunit.client.0.smithi159.stdout:1/495: chown d6/d12/d1a/d92/d97 15 1 2024-02-28T23:07:18.842 INFO:tasks.workunit.client.1.smithi184.stdout:5/63: dwrite f8 [0,4194304] 0 2024-02-28T23:07:18.843 INFO:tasks.workunit.client.1.smithi184.stdout:7/69: getdents d6/d9/da 0 2024-02-28T23:07:18.845 INFO:tasks.workunit.client.1.smithi184.stdout:6/57: mkdir dc/de/d12 0 2024-02-28T23:07:18.846 INFO:tasks.workunit.client.1.smithi184.stdout:7/70: chown l2 474690891 1 2024-02-28T23:07:18.846 INFO:tasks.workunit.client.1.smithi184.stdout:2/57: stat l6 0 2024-02-28T23:07:18.848 INFO:tasks.workunit.client.0.smithi159.stdout:1/496: read d6/d12/d33/d3c/f55 [5307,13870] 0 2024-02-28T23:07:18.851 INFO:tasks.workunit.client.1.smithi184.stdout:9/74: creat d5/db/f14 x:0 0 0 2024-02-28T23:07:18.853 INFO:tasks.workunit.client.0.smithi159.stdout:1/497: symlink d6/d12/d1a/la4 0 2024-02-28T23:07:18.858 INFO:tasks.workunit.client.1.smithi184.stdout:4/58: mkdir d1/dc/df 0 2024-02-28T23:07:18.858 INFO:tasks.workunit.client.0.smithi159.stdout:4/588: dwrite d9/da/f47 [4194304,4194304] 0 2024-02-28T23:07:18.861 INFO:tasks.workunit.client.1.smithi184.stdout:2/58: creat d10/f16 x:0 0 0 2024-02-28T23:07:18.863 INFO:tasks.workunit.client.1.smithi184.stdout:2/59: readlink l6 0 2024-02-28T23:07:18.863 INFO:tasks.workunit.client.1.smithi184.stdout:7/71: creat d6/d9/da/dc/f1a x:0 0 0 2024-02-28T23:07:18.865 INFO:tasks.workunit.client.0.smithi159.stdout:4/589: chown d9/da/d1c/c30 0 1 2024-02-28T23:07:18.870 INFO:tasks.workunit.client.1.smithi184.stdout:5/64: fsync f8 0 2024-02-28T23:07:18.871 INFO:tasks.workunit.client.1.smithi184.stdout:9/75: mknod d5/db/de/d10/d12/c15 0 2024-02-28T23:07:18.873 INFO:tasks.workunit.client.1.smithi184.stdout:1/125: dwrite d20/f25 [0,4194304] 0 2024-02-28T23:07:18.874 INFO:tasks.workunit.client.1.smithi184.stdout:6/58: creat dc/f13 x:0 0 0 2024-02-28T23:07:18.876 INFO:tasks.workunit.client.1.smithi184.stdout:2/60: rename l9 to d10/d13/l17 0 2024-02-28T23:07:18.876 INFO:tasks.workunit.client.1.smithi184.stdout:6/59: chown f8 15741 1 2024-02-28T23:07:18.877 INFO:tasks.workunit.client.1.smithi184.stdout:7/72: truncate d6/f8 2844138 0 2024-02-28T23:07:18.878 INFO:tasks.workunit.client.1.smithi184.stdout:6/60: read - f8 zero size 2024-02-28T23:07:18.878 INFO:tasks.workunit.client.1.smithi184.stdout:9/76: creat d5/db/f16 x:0 0 0 2024-02-28T23:07:18.879 INFO:tasks.workunit.client.1.smithi184.stdout:2/61: truncate f5 1485551 0 2024-02-28T23:07:18.880 INFO:tasks.workunit.client.1.smithi184.stdout:2/62: dread - fe zero size 2024-02-28T23:07:18.880 INFO:tasks.workunit.client.1.smithi184.stdout:6/61: chown f8 8 1 2024-02-28T23:07:18.881 INFO:tasks.workunit.client.1.smithi184.stdout:5/65: rename ca to db/c17 0 2024-02-28T23:07:18.883 INFO:tasks.workunit.client.1.smithi184.stdout:2/63: read f8 [3841163,42770] 0 2024-02-28T23:07:18.883 INFO:tasks.workunit.client.1.smithi184.stdout:4/59: dread d1/f2 [0,4194304] 0 2024-02-28T23:07:18.884 INFO:tasks.workunit.client.0.smithi159.stdout:4/590: dwrite d9/d42/d54/d9c/fba [0,4194304] 0 2024-02-28T23:07:18.886 INFO:tasks.workunit.client.1.smithi184.stdout:7/73: creat d6/d9/da/dc/f1b x:0 0 0 2024-02-28T23:07:18.888 INFO:tasks.workunit.client.1.smithi184.stdout:7/74: chown d6 4718387 1 2024-02-28T23:07:18.890 INFO:tasks.workunit.client.1.smithi184.stdout:3/67: sync 2024-02-28T23:07:18.893 INFO:tasks.workunit.client.1.smithi184.stdout:1/126: dread ff [0,4194304] 0 2024-02-28T23:07:18.893 INFO:tasks.workunit.client.1.smithi184.stdout:3/68: chown d1/lf 558319 1 2024-02-28T23:07:18.894 INFO:tasks.workunit.client.1.smithi184.stdout:4/60: rename d1/f2 to d1/f10 0 2024-02-28T23:07:18.896 INFO:tasks.workunit.client.1.smithi184.stdout:7/75: rename d6/ld to d6/d9/d13/d14/l1c 0 2024-02-28T23:07:18.899 INFO:tasks.workunit.client.0.smithi159.stdout:4/591: dread d9/d42/f60 [0,4194304] 0 2024-02-28T23:07:18.899 INFO:tasks.workunit.client.0.smithi159.stdout:4/592: chown d9/da/d1c/d23/d2d/f41 2062 1 2024-02-28T23:07:18.899 INFO:tasks.workunit.client.1.smithi184.stdout:6/62: creat dc/f14 x:0 0 0 2024-02-28T23:07:18.899 INFO:tasks.workunit.client.1.smithi184.stdout:4/61: rmdir d1/dc 39 2024-02-28T23:07:18.901 INFO:tasks.workunit.client.0.smithi159.stdout:5/522: rmdir d8 39 2024-02-28T23:07:18.903 INFO:tasks.workunit.client.1.smithi184.stdout:4/62: chown d1/d8/l9 40258192 1 2024-02-28T23:07:18.903 INFO:tasks.workunit.client.1.smithi184.stdout:9/77: dwrite d5/f13 [0,4194304] 0 2024-02-28T23:07:18.904 INFO:tasks.workunit.client.1.smithi184.stdout:5/66: dread f8 [0,4194304] 0 2024-02-28T23:07:18.906 INFO:tasks.workunit.client.1.smithi184.stdout:6/63: creat dc/de/f15 x:0 0 0 2024-02-28T23:07:18.909 INFO:tasks.workunit.client.1.smithi184.stdout:7/76: symlink d6/d9/d13/l1d 0 2024-02-28T23:07:18.911 INFO:tasks.workunit.client.1.smithi184.stdout:2/64: dwrite f8 [0,4194304] 0 2024-02-28T23:07:18.914 INFO:tasks.workunit.client.0.smithi159.stdout:4/593: unlink d9/d20/f29 0 2024-02-28T23:07:18.915 INFO:tasks.workunit.client.1.smithi184.stdout:1/127: link c1e d20/c29 0 2024-02-28T23:07:18.919 INFO:tasks.workunit.client.1.smithi184.stdout:1/128: dread fb [0,4194304] 0 2024-02-28T23:07:18.922 INFO:tasks.workunit.client.1.smithi184.stdout:1/129: write f1d [507563,44259] 0 2024-02-28T23:07:18.924 INFO:tasks.workunit.client.1.smithi184.stdout:5/67: mkdir db/d12/d18 0 2024-02-28T23:07:18.925 INFO:tasks.workunit.client.1.smithi184.stdout:0/91: write d0/fc [992310,45726] 0 2024-02-28T23:07:18.926 INFO:tasks.workunit.client.0.smithi159.stdout:7/377: write d5/fe [3198711,91714] 0 2024-02-28T23:07:18.927 INFO:tasks.workunit.client.1.smithi184.stdout:7/77: mkdir d6/d9/d13/d1e 0 2024-02-28T23:07:18.929 INFO:tasks.workunit.client.1.smithi184.stdout:2/65: dwrite fe [0,4194304] 0 2024-02-28T23:07:18.930 INFO:tasks.workunit.client.0.smithi159.stdout:7/378: fdatasync d5/d16/d1a/d27/d46/d65/f6f 0 2024-02-28T23:07:18.930 INFO:tasks.workunit.client.1.smithi184.stdout:2/66: dread - fc zero size 2024-02-28T23:07:18.931 INFO:tasks.workunit.client.0.smithi159.stdout:2/447: getdents d9/d50/d54/d84 0 2024-02-28T23:07:18.932 INFO:tasks.workunit.client.1.smithi184.stdout:2/67: read - d10/f16 zero size 2024-02-28T23:07:18.935 INFO:tasks.workunit.client.1.smithi184.stdout:9/78: mkdir d5/d17 0 2024-02-28T23:07:18.936 INFO:tasks.workunit.client.0.smithi159.stdout:2/448: truncate d9/d50/d54/d84/f3b 1281064 0 2024-02-28T23:07:18.938 INFO:tasks.workunit.client.0.smithi159.stdout:1/498: getdents d6 0 2024-02-28T23:07:18.939 INFO:tasks.workunit.client.0.smithi159.stdout:2/449: chown d9/d36/d59/l6e 3569902 1 2024-02-28T23:07:18.941 INFO:tasks.workunit.client.0.smithi159.stdout:9/544: dwrite d4/d3d/d3e/d4a/fab [0,4194304] 0 2024-02-28T23:07:18.941 INFO:tasks.workunit.client.1.smithi184.stdout:1/130: dwrite d20/f25 [0,4194304] 0 2024-02-28T23:07:18.942 INFO:tasks.workunit.client.1.smithi184.stdout:1/131: readlink l1a 0 2024-02-28T23:07:18.943 INFO:tasks.workunit.client.0.smithi159.stdout:1/499: truncate d6/d1d/f68 197916 0 2024-02-28T23:07:18.944 INFO:tasks.workunit.client.0.smithi159.stdout:2/450: rename d9/d50 to d9/d50/d54/d84/d98 22 2024-02-28T23:07:18.947 INFO:tasks.workunit.client.1.smithi184.stdout:6/64: mkdir dc/de/d10/d16 0 2024-02-28T23:07:18.947 INFO:tasks.workunit.client.1.smithi184.stdout:4/63: dwrite d1/dc/fd [0,4194304] 0 2024-02-28T23:07:18.955 INFO:tasks.workunit.client.0.smithi159.stdout:3/463: write d0/d2b/d55/d75/d6d/d54/f5a [939533,86877] 0 2024-02-28T23:07:18.957 INFO:tasks.workunit.client.0.smithi159.stdout:9/545: mkdir d4/d3d/d3e/dad 0 2024-02-28T23:07:18.959 INFO:tasks.workunit.client.1.smithi184.stdout:5/68: write f7 [383370,112081] 0 2024-02-28T23:07:18.959 INFO:tasks.workunit.client.1.smithi184.stdout:3/69: getdents d1/d4 0 2024-02-28T23:07:18.962 INFO:tasks.workunit.client.1.smithi184.stdout:0/92: symlink d0/df/d13/l21 0 2024-02-28T23:07:18.963 INFO:tasks.workunit.client.1.smithi184.stdout:7/78: creat d6/d9/d13/f1f x:0 0 0 2024-02-28T23:07:18.964 INFO:tasks.workunit.client.1.smithi184.stdout:2/68: fsync fb 0 2024-02-28T23:07:18.964 INFO:tasks.workunit.client.1.smithi184.stdout:3/70: chown d1/d4/d6 242 1 2024-02-28T23:07:18.965 INFO:tasks.workunit.client.0.smithi159.stdout:6/497: sync 2024-02-28T23:07:18.965 INFO:tasks.workunit.client.0.smithi159.stdout:8/624: sync 2024-02-28T23:07:18.967 INFO:tasks.workunit.client.1.smithi184.stdout:9/79: creat d5/db/de/d10/f18 x:0 0 0 2024-02-28T23:07:18.967 INFO:tasks.workunit.client.0.smithi159.stdout:8/625: readlink d2/d11/d52/d26/d36/d38/l7b 0 2024-02-28T23:07:18.968 INFO:tasks.workunit.client.1.smithi184.stdout:0/93: write d0/df/f11 [898812,29079] 0 2024-02-28T23:07:18.969 INFO:tasks.workunit.client.1.smithi184.stdout:1/132: rename cd to d20/c2a 0 2024-02-28T23:07:18.971 INFO:tasks.workunit.client.1.smithi184.stdout:6/65: rename dc/de to dc/de/d12/d17 22 2024-02-28T23:07:18.972 INFO:tasks.workunit.client.1.smithi184.stdout:8/94: truncate d1/da/f1a 969090 0 2024-02-28T23:07:18.976 INFO:tasks.workunit.client.1.smithi184.stdout:4/64: dwrite d1/dc/fd [4194304,4194304] 0 2024-02-28T23:07:18.976 INFO:tasks.workunit.client.1.smithi184.stdout:7/79: unlink d6/d9/d13/d14/f18 0 2024-02-28T23:07:18.985 INFO:tasks.workunit.client.1.smithi184.stdout:9/80: creat d5/db/de/d10/d12/f19 x:0 0 0 2024-02-28T23:07:18.988 INFO:tasks.workunit.client.1.smithi184.stdout:0/94: mknod d0/df/d13/c22 0 2024-02-28T23:07:18.989 INFO:tasks.workunit.client.1.smithi184.stdout:3/71: dread d1/d4/d6/fa [0,4194304] 0 2024-02-28T23:07:18.991 INFO:tasks.workunit.client.1.smithi184.stdout:2/69: dwrite fa [0,4194304] 0 2024-02-28T23:07:18.992 INFO:tasks.workunit.client.1.smithi184.stdout:3/72: stat d1/d4/fb 0 2024-02-28T23:07:18.995 INFO:tasks.workunit.client.1.smithi184.stdout:0/95: write d0/df/f11 [1721895,28987] 0 2024-02-28T23:07:19.002 INFO:tasks.workunit.client.1.smithi184.stdout:4/65: dwrite d1/dc/fd [0,4194304] 0 2024-02-28T23:07:19.006 INFO:tasks.workunit.client.1.smithi184.stdout:5/69: rename db/l16 to db/d12/l19 0 2024-02-28T23:07:19.012 INFO:tasks.workunit.client.1.smithi184.stdout:7/80: creat d6/d9/da/dc/f20 x:0 0 0 2024-02-28T23:07:19.012 INFO:tasks.workunit.client.1.smithi184.stdout:0/96: dread d0/fe [0,4194304] 0 2024-02-28T23:07:19.013 INFO:tasks.workunit.client.1.smithi184.stdout:5/70: truncate f7 2291779 0 2024-02-28T23:07:19.016 INFO:tasks.workunit.client.0.smithi159.stdout:5/523: dwrite d8/f14 [0,4194304] 0 2024-02-28T23:07:19.016 INFO:tasks.workunit.client.1.smithi184.stdout:2/70: creat d10/f18 x:0 0 0 2024-02-28T23:07:19.017 INFO:tasks.workunit.client.1.smithi184.stdout:5/71: write f7 [2752642,1898] 0 2024-02-28T23:07:19.020 INFO:tasks.workunit.client.1.smithi184.stdout:9/81: dwrite d5/fc [0,4194304] 0 2024-02-28T23:07:19.021 INFO:tasks.workunit.client.0.smithi159.stdout:5/524: write d8/f13 [1942363,130876] 0 2024-02-28T23:07:19.022 INFO:tasks.workunit.client.1.smithi184.stdout:3/73: symlink d1/l12 0 2024-02-28T23:07:19.024 INFO:tasks.workunit.client.1.smithi184.stdout:3/74: read d1/d4/fb [3484883,7968] 0 2024-02-28T23:07:19.025 INFO:tasks.workunit.client.1.smithi184.stdout:8/95: symlink d1/da/d10/d17/l27 0 2024-02-28T23:07:19.030 INFO:tasks.workunit.client.1.smithi184.stdout:8/96: write d1/f5 [2076154,7550] 0 2024-02-28T23:07:19.031 INFO:tasks.workunit.client.0.smithi159.stdout:4/594: link d9/da/d1c/d23/d2d/d59/c67 d9/d4c/d6c/ccd 0 2024-02-28T23:07:19.033 INFO:tasks.workunit.client.1.smithi184.stdout:9/82: truncate d5/db/de/d10/f11 480221 0 2024-02-28T23:07:19.038 INFO:tasks.workunit.client.1.smithi184.stdout:7/81: dread f4 [0,4194304] 0 2024-02-28T23:07:19.039 INFO:tasks.workunit.client.1.smithi184.stdout:5/72: dread f8 [0,4194304] 0 2024-02-28T23:07:19.039 INFO:tasks.workunit.client.0.smithi159.stdout:2/451: creat d9/d50/d54/d84/d37/d5c/f99 x:0 0 0 2024-02-28T23:07:19.043 INFO:tasks.workunit.client.0.smithi159.stdout:2/452: truncate d9/d23/f7f 541491 0 2024-02-28T23:07:19.046 INFO:tasks.workunit.client.1.smithi184.stdout:6/66: write dc/fd [1333150,13648] 0 2024-02-28T23:07:19.047 INFO:tasks.workunit.client.1.smithi184.stdout:6/67: chown dc/de/f15 1516 1 2024-02-28T23:07:19.048 INFO:tasks.workunit.client.0.smithi159.stdout:3/464: truncate d0/d6/d3e/f5b 2929361 0 2024-02-28T23:07:19.048 INFO:tasks.workunit.client.1.smithi184.stdout:1/133: getdents d20 0 2024-02-28T23:07:19.049 INFO:tasks.workunit.client.1.smithi184.stdout:6/68: dread - dc/f14 zero size 2024-02-28T23:07:19.049 INFO:tasks.workunit.client.0.smithi159.stdout:3/465: chown d0/d6/d3e/c8c 21203700 1 2024-02-28T23:07:19.050 INFO:tasks.workunit.client.0.smithi159.stdout:6/498: symlink d0/d1b/d33/d3f/la4 0 2024-02-28T23:07:19.050 INFO:tasks.workunit.client.1.smithi184.stdout:6/69: truncate dc/de/ff 792388 0 2024-02-28T23:07:19.053 INFO:tasks.workunit.client.0.smithi159.stdout:8/626: creat d2/d11/d52/d26/d36/d38/d77/fca x:0 0 0 2024-02-28T23:07:19.054 INFO:tasks.workunit.client.1.smithi184.stdout:3/75: rename d1/d4/d6/c8 to d1/d4/d5/c13 0 2024-02-28T23:07:19.056 INFO:tasks.workunit.client.1.smithi184.stdout:4/66: link d1/dc/fd d1/d4/f11 0 2024-02-28T23:07:19.056 INFO:tasks.workunit.client.0.smithi159.stdout:8/627: write d2/d11/d52/d26/d36/d38/d77/f9f [712747,108613] 0 2024-02-28T23:07:19.057 INFO:tasks.workunit.client.0.smithi159.stdout:4/595: creat d9/da/d1c/d8e/fce x:0 0 0 2024-02-28T23:07:19.059 INFO:tasks.workunit.client.0.smithi159.stdout:7/379: getdents d5 0 2024-02-28T23:07:19.060 INFO:tasks.workunit.client.1.smithi184.stdout:8/97: creat d1/da/df/f28 x:0 0 0 2024-02-28T23:07:19.061 INFO:tasks.workunit.client.1.smithi184.stdout:9/83: mkdir d5/db/de/d10/d12/d1a 0 2024-02-28T23:07:19.063 INFO:tasks.workunit.client.0.smithi159.stdout:5/525: mknod d8/d19/d23/d35/cb0 0 2024-02-28T23:07:19.065 INFO:tasks.workunit.client.1.smithi184.stdout:1/134: dwrite f9 [0,4194304] 0 2024-02-28T23:07:19.065 INFO:tasks.workunit.client.0.smithi159.stdout:4/596: creat d9/da/fcf x:0 0 0 2024-02-28T23:07:19.066 INFO:tasks.workunit.client.1.smithi184.stdout:1/135: write d20/f25 [4263117,73520] 0 2024-02-28T23:07:19.067 INFO:tasks.workunit.client.1.smithi184.stdout:2/71: creat d10/d13/d15/f19 x:0 0 0 2024-02-28T23:07:19.069 INFO:tasks.workunit.client.1.smithi184.stdout:3/76: dread d1/d4/fb [0,4194304] 0 2024-02-28T23:07:19.069 INFO:tasks.workunit.client.0.smithi159.stdout:8/628: mknod d2/d11/d52/d26/d36/d38/d77/d79/ccb 0 2024-02-28T23:07:19.073 INFO:tasks.workunit.client.0.smithi159.stdout:7/380: unlink d5/d56/d50/l63 0 2024-02-28T23:07:19.075 INFO:tasks.workunit.client.0.smithi159.stdout:0/637: sync 2024-02-28T23:07:19.075 INFO:tasks.workunit.client.0.smithi159.stdout:7/381: readlink d5/d16/d1a/d27/d46/l5c 0 2024-02-28T23:07:19.076 INFO:tasks.workunit.client.0.smithi159.stdout:3/466: fsync d0/f35 0 2024-02-28T23:07:19.085 INFO:tasks.workunit.client.0.smithi159.stdout:1/500: rename d6/d12/d33/l58 to d6/d12/d31/la5 0 2024-02-28T23:07:19.088 INFO:tasks.workunit.client.1.smithi184.stdout:8/98: mkdir d1/da/dc/d16/d29 0 2024-02-28T23:07:19.089 INFO:tasks.workunit.client.0.smithi159.stdout:7/382: dwrite d5/d16/d40/f74 [0,4194304] 0 2024-02-28T23:07:19.091 INFO:tasks.workunit.client.0.smithi159.stdout:0/638: creat d0/d5/d14/d25/d2c/dab/dc5/dcb/fe6 x:0 0 0 2024-02-28T23:07:19.093 INFO:tasks.workunit.client.0.smithi159.stdout:0/639: readlink d0/d5/d14/d78/laa 0 2024-02-28T23:07:19.098 INFO:tasks.workunit.client.1.smithi184.stdout:5/73: creat db/d12/d18/f1a x:0 0 0 2024-02-28T23:07:19.102 INFO:tasks.workunit.client.0.smithi159.stdout:5/526: rename d8/d19/d23/d35/d38/d8f/fa1 to d8/d19/d23/d35/d41/fb1 0 2024-02-28T23:07:19.104 INFO:tasks.workunit.client.1.smithi184.stdout:1/136: creat d20/f2b x:0 0 0 2024-02-28T23:07:19.105 INFO:tasks.workunit.client.0.smithi159.stdout:1/501: creat d6/d12/d1a/d92/fa6 x:0 0 0 2024-02-28T23:07:19.105 INFO:tasks.workunit.client.1.smithi184.stdout:1/137: write f17 [2303627,60273] 0 2024-02-28T23:07:19.106 INFO:tasks.workunit.client.0.smithi159.stdout:9/546: dwrite d4/d3d/f5b [0,4194304] 0 2024-02-28T23:07:19.106 INFO:tasks.workunit.client.0.smithi159.stdout:1/502: chown d6/d12/d1a/d92 1295 1 2024-02-28T23:07:19.107 INFO:tasks.workunit.client.1.smithi184.stdout:2/72: creat d10/d13/f1a x:0 0 0 2024-02-28T23:07:19.107 INFO:tasks.workunit.client.1.smithi184.stdout:1/138: read d20/f24 [290257,7689] 0 2024-02-28T23:07:19.107 INFO:tasks.workunit.client.1.smithi184.stdout:2/73: chown fe 254860921 1 2024-02-28T23:07:19.108 INFO:tasks.workunit.client.0.smithi159.stdout:7/383: creat d5/d16/d1a/d27/d3e/f7c x:0 0 0 2024-02-28T23:07:19.108 INFO:tasks.workunit.client.0.smithi159.stdout:1/503: chown d6/d1d/l8f 876981899 1 2024-02-28T23:07:19.110 INFO:tasks.workunit.client.1.smithi184.stdout:3/77: creat d1/d4/f14 x:0 0 0 2024-02-28T23:07:19.113 INFO:tasks.workunit.client.0.smithi159.stdout:0/640: rmdir d0/d5/d14/d25/d5c 39 2024-02-28T23:07:19.118 INFO:tasks.workunit.client.0.smithi159.stdout:4/597: link d9/da/d1c/f86 d9/d42/db1/fd0 0 2024-02-28T23:07:19.118 INFO:tasks.workunit.client.1.smithi184.stdout:9/84: rmdir d5/db 39 2024-02-28T23:07:19.119 INFO:tasks.workunit.client.0.smithi159.stdout:0/641: readlink d0/d5/d38/d76/ldd 0 2024-02-28T23:07:19.122 INFO:tasks.workunit.client.1.smithi184.stdout:0/97: link d0/df/c1c d0/df/c23 0 2024-02-28T23:07:19.125 INFO:tasks.workunit.client.1.smithi184.stdout:7/82: truncate f3 3943398 0 2024-02-28T23:07:19.126 INFO:tasks.workunit.client.1.smithi184.stdout:5/74: creat db/d12/d18/f1b x:0 0 0 2024-02-28T23:07:19.128 INFO:tasks.workunit.client.0.smithi159.stdout:5/527: creat d8/d16/fb2 x:0 0 0 2024-02-28T23:07:19.131 INFO:tasks.workunit.client.0.smithi159.stdout:9/547: creat d4/fae x:0 0 0 2024-02-28T23:07:19.135 INFO:tasks.workunit.client.1.smithi184.stdout:2/74: creat d10/d13/d15/f1b x:0 0 0 2024-02-28T23:07:19.138 INFO:tasks.workunit.client.1.smithi184.stdout:3/78: rename d1/d4/c7 to d1/d4/c15 0 2024-02-28T23:07:19.140 INFO:tasks.workunit.client.1.smithi184.stdout:1/139: rmdir d20 39 2024-02-28T23:07:19.141 INFO:tasks.workunit.client.1.smithi184.stdout:6/70: rmdir dc/de/d12 0 2024-02-28T23:07:19.142 INFO:tasks.workunit.client.0.smithi159.stdout:8/629: getdents d2/d11 0 2024-02-28T23:07:19.143 INFO:tasks.workunit.client.1.smithi184.stdout:4/67: creat d1/f12 x:0 0 0 2024-02-28T23:07:19.145 INFO:tasks.workunit.client.0.smithi159.stdout:8/630: write d2/d11/d52/f54 [3142106,50405] 0 2024-02-28T23:07:19.145 INFO:tasks.workunit.client.0.smithi159.stdout:3/467: write d0/d6/d34/f41 [854312,5479] 0 2024-02-28T23:07:19.147 INFO:tasks.workunit.client.0.smithi159.stdout:0/642: mkdir d0/de/de7 0 2024-02-28T23:07:19.149 INFO:tasks.workunit.client.0.smithi159.stdout:5/528: readlink d8/d19/d23/d35/d41/daa/l85 0 2024-02-28T23:07:19.151 INFO:tasks.workunit.client.0.smithi159.stdout:4/598: dread d9/d42/d54/d77/fca [0,4194304] 0 2024-02-28T23:07:19.152 INFO:tasks.workunit.client.0.smithi159.stdout:0/643: write d0/d5/f50 [426487,95766] 0 2024-02-28T23:07:19.154 INFO:tasks.workunit.client.1.smithi184.stdout:5/75: mkdir db/d12/d1c 0 2024-02-28T23:07:19.154 INFO:tasks.workunit.client.0.smithi159.stdout:0/644: write d0/de/fd5 [2914529,59438] 0 2024-02-28T23:07:19.155 INFO:tasks.workunit.client.0.smithi159.stdout:7/384: unlink d5/d16/c32 0 2024-02-28T23:07:19.156 INFO:tasks.workunit.client.1.smithi184.stdout:5/76: chown f7 268685266 1 2024-02-28T23:07:19.157 INFO:tasks.workunit.client.1.smithi184.stdout:3/79: symlink d1/l16 0 2024-02-28T23:07:19.158 INFO:tasks.workunit.client.0.smithi159.stdout:1/504: mkdir d6/d12/d33/da7 0 2024-02-28T23:07:19.162 INFO:tasks.workunit.client.1.smithi184.stdout:6/71: symlink dc/de/d10/l18 0 2024-02-28T23:07:19.166 INFO:tasks.workunit.client.1.smithi184.stdout:2/75: dwrite fc [0,4194304] 0 2024-02-28T23:07:19.171 INFO:tasks.workunit.client.1.smithi184.stdout:3/80: rmdir d1/d4/d5 39 2024-02-28T23:07:19.172 INFO:tasks.workunit.client.1.smithi184.stdout:2/76: stat d10/d13/f1a 0 2024-02-28T23:07:19.174 INFO:tasks.workunit.client.1.smithi184.stdout:8/99: getdents d1/da/d10/d17 0 2024-02-28T23:07:19.175 INFO:tasks.workunit.client.0.smithi159.stdout:3/468: write d0/d2b/f29 [442908,83304] 0 2024-02-28T23:07:19.175 INFO:tasks.workunit.client.0.smithi159.stdout:0/645: stat d0/d5/d14/d78/f8c 0 2024-02-28T23:07:19.175 INFO:tasks.workunit.client.1.smithi184.stdout:4/68: symlink d1/dc/df/l13 0 2024-02-28T23:07:19.179 INFO:tasks.workunit.client.1.smithi184.stdout:2/77: chown d10/c12 13370139 1 2024-02-28T23:07:19.180 INFO:tasks.workunit.client.1.smithi184.stdout:8/100: fsync d1/da/df/d20/f26 0 2024-02-28T23:07:19.181 INFO:tasks.workunit.client.1.smithi184.stdout:0/98: dwrite d0/d1d/f1e [0,4194304] 0 2024-02-28T23:07:19.185 INFO:tasks.workunit.client.1.smithi184.stdout:6/72: creat dc/de/d10/f19 x:0 0 0 2024-02-28T23:07:19.185 INFO:tasks.workunit.client.1.smithi184.stdout:1/140: dwrite fa [0,4194304] 0 2024-02-28T23:07:19.188 INFO:tasks.workunit.client.0.smithi159.stdout:9/548: truncate d4/d3d/f7e 1287317 0 2024-02-28T23:07:19.188 INFO:tasks.workunit.client.1.smithi184.stdout:1/141: fdatasync f2 0 2024-02-28T23:07:19.193 INFO:tasks.workunit.client.1.smithi184.stdout:2/78: symlink d10/d13/l1c 0 2024-02-28T23:07:19.195 INFO:tasks.workunit.client.1.smithi184.stdout:0/99: write d0/d1d/f1e [5151588,41335] 0 2024-02-28T23:07:19.196 INFO:tasks.workunit.client.0.smithi159.stdout:0/646: rmdir d0/d5/d14/d34/d6c/d94 39 2024-02-28T23:07:19.197 INFO:tasks.workunit.client.0.smithi159.stdout:8/631: dread d2/d11/f12 [0,4194304] 0 2024-02-28T23:07:19.197 INFO:tasks.workunit.client.1.smithi184.stdout:4/69: dread d1/f10 [4194304,4194304] 0 2024-02-28T23:07:19.197 INFO:tasks.workunit.client.1.smithi184.stdout:8/101: rmdir d1/da/d10 39 2024-02-28T23:07:19.197 INFO:tasks.workunit.client.1.smithi184.stdout:3/81: dwrite d1/d4/fb [0,4194304] 0 2024-02-28T23:07:19.201 INFO:tasks.workunit.client.0.smithi159.stdout:1/505: rename d6/d12/d16/f28 to d6/d1d/d1f/fa8 0 2024-02-28T23:07:19.201 INFO:tasks.workunit.client.1.smithi184.stdout:3/82: truncate d1/d4/fb 5202252 0 2024-02-28T23:07:19.205 INFO:tasks.workunit.client.1.smithi184.stdout:7/83: getdents d6/d9/d13 0 2024-02-28T23:07:19.210 INFO:tasks.workunit.client.1.smithi184.stdout:6/73: rename l6 to dc/de/l1a 0 2024-02-28T23:07:19.211 INFO:tasks.workunit.client.0.smithi159.stdout:7/385: dwrite d5/d16/d1a/d27/d3e/f3f [0,4194304] 0 2024-02-28T23:07:19.212 INFO:tasks.workunit.client.1.smithi184.stdout:6/74: stat dc/f14 0 2024-02-28T23:07:19.216 INFO:tasks.workunit.client.1.smithi184.stdout:2/79: unlink f5 0 2024-02-28T23:07:19.217 INFO:tasks.workunit.client.0.smithi159.stdout:5/529: dwrite d8/d19/d23/f91 [0,4194304] 0 2024-02-28T23:07:19.218 INFO:tasks.workunit.client.1.smithi184.stdout:2/80: fsync d10/f16 0 2024-02-28T23:07:19.218 INFO:tasks.workunit.client.1.smithi184.stdout:8/102: dwrite d1/da/dc/d18/f19 [0,4194304] 0 2024-02-28T23:07:19.219 INFO:tasks.workunit.client.1.smithi184.stdout:2/81: chown ff 3623 1 2024-02-28T23:07:19.220 INFO:tasks.workunit.client.0.smithi159.stdout:9/549: fsync d4/f39 0 2024-02-28T23:07:19.220 INFO:tasks.workunit.client.0.smithi159.stdout:4/599: dread d9/f1b [0,4194304] 0 2024-02-28T23:07:19.220 INFO:tasks.workunit.client.1.smithi184.stdout:2/82: stat l3 0 2024-02-28T23:07:19.222 INFO:tasks.workunit.client.1.smithi184.stdout:4/70: creat d1/dc/df/f14 x:0 0 0 2024-02-28T23:07:19.223 INFO:tasks.workunit.client.1.smithi184.stdout:2/83: dread - d10/d13/f1a zero size 2024-02-28T23:07:19.224 INFO:tasks.workunit.client.0.smithi159.stdout:4/600: chown d9/da/d1c/d23/d2d/f41 1862647739 1 2024-02-28T23:07:19.225 INFO:tasks.workunit.client.1.smithi184.stdout:0/100: dread d0/fe [0,4194304] 0 2024-02-28T23:07:19.225 INFO:tasks.workunit.client.1.smithi184.stdout:7/84: rmdir d6/d9 39 2024-02-28T23:07:19.226 INFO:tasks.workunit.client.0.smithi159.stdout:4/601: fdatasync d9/da/f47 0 2024-02-28T23:07:19.229 INFO:tasks.workunit.client.0.smithi159.stdout:3/469: creat d0/d3f/f8d x:0 0 0 2024-02-28T23:07:19.231 INFO:tasks.workunit.client.1.smithi184.stdout:1/142: creat d20/f2c x:0 0 0 2024-02-28T23:07:19.235 INFO:tasks.workunit.client.1.smithi184.stdout:9/85: sync 2024-02-28T23:07:19.236 INFO:tasks.workunit.client.1.smithi184.stdout:8/103: rename d1/f5 to d1/da/dc/d16/d29/f2a 0 2024-02-28T23:07:19.237 INFO:tasks.workunit.client.1.smithi184.stdout:4/71: mknod d1/d4/c15 0 2024-02-28T23:07:19.238 INFO:tasks.workunit.client.0.smithi159.stdout:4/602: unlink d9/da/f7e 0 2024-02-28T23:07:19.238 INFO:tasks.workunit.client.0.smithi159.stdout:0/647: dread d0/d5/ff [4194304,4194304] 0 2024-02-28T23:07:19.249 INFO:tasks.workunit.client.0.smithi159.stdout:5/530: write d8/d19/f1c [3326180,109672] 0 2024-02-28T23:07:19.252 INFO:tasks.workunit.client.1.smithi184.stdout:3/83: truncate d1/d4/d6/fa 329868 0 2024-02-28T23:07:19.253 INFO:tasks.workunit.client.1.smithi184.stdout:3/84: readlink d1/lf 0 2024-02-28T23:07:19.253 INFO:tasks.workunit.client.1.smithi184.stdout:1/143: rmdir d20 39 2024-02-28T23:07:19.256 INFO:tasks.workunit.client.0.smithi159.stdout:1/506: link d6/d12/f15 d6/d1d/d46/d88/fa9 0 2024-02-28T23:07:19.257 INFO:tasks.workunit.client.1.smithi184.stdout:6/75: fdatasync f3 0 2024-02-28T23:07:19.258 INFO:tasks.workunit.client.1.smithi184.stdout:4/72: dwrite d1/dc/df/f14 [0,4194304] 0 2024-02-28T23:07:19.268 INFO:tasks.workunit.client.0.smithi159.stdout:8/632: truncate d2/d11/d52/d47/d65/d68/f8d 972089 0 2024-02-28T23:07:19.269 INFO:tasks.workunit.client.0.smithi159.stdout:3/470: write d0/d2b/d55/d75/d6d/f66 [888655,45548] 0 2024-02-28T23:07:19.269 INFO:tasks.workunit.client.1.smithi184.stdout:8/104: mknod d1/da/dc/c2b 0 2024-02-28T23:07:19.270 INFO:tasks.workunit.client.0.smithi159.stdout:7/386: truncate d5/d56/d2a/f4d 147113 0 2024-02-28T23:07:19.275 INFO:tasks.workunit.client.0.smithi159.stdout:8/633: truncate d2/d3/d8c/f95 191223 0 2024-02-28T23:07:19.275 INFO:tasks.workunit.client.0.smithi159.stdout:5/531: symlink d8/d19/d23/d35/d38/d8f/lb3 0 2024-02-28T23:07:19.280 INFO:tasks.workunit.client.0.smithi159.stdout:1/507: creat d6/d12/d33/d3c/faa x:0 0 0 2024-02-28T23:07:19.281 INFO:tasks.workunit.client.0.smithi159.stdout:4/603: creat d9/d42/dc8/fd1 x:0 0 0 2024-02-28T23:07:19.281 INFO:tasks.workunit.client.1.smithi184.stdout:1/144: fsync d20/f28 0 2024-02-28T23:07:19.282 INFO:tasks.workunit.client.1.smithi184.stdout:3/85: rename d1 to d1/d4/d5/d17 22 2024-02-28T23:07:19.283 INFO:tasks.workunit.client.0.smithi159.stdout:1/508: read d6/d12/d31/f56 [1583265,114889] 0 2024-02-28T23:07:19.284 INFO:tasks.workunit.client.1.smithi184.stdout:6/76: creat dc/de/d10/f1b x:0 0 0 2024-02-28T23:07:19.286 INFO:tasks.workunit.client.1.smithi184.stdout:6/77: chown dc/de/f15 0 1 2024-02-28T23:07:19.287 INFO:tasks.workunit.client.0.smithi159.stdout:5/532: chown d8/d19/d23/f4d 8611365 1 2024-02-28T23:07:19.288 INFO:tasks.workunit.client.0.smithi159.stdout:5/533: readlink d8/d19/d23/d35/d41/daa/d79/la0 0 2024-02-28T23:07:19.293 INFO:tasks.workunit.client.1.smithi184.stdout:2/84: truncate fc 3705272 0 2024-02-28T23:07:19.293 INFO:tasks.workunit.client.1.smithi184.stdout:6/78: write dc/f13 [924025,32990] 0 2024-02-28T23:07:19.293 INFO:tasks.workunit.client.0.smithi159.stdout:9/550: getdents d4/d3d/d3e/d55 0 2024-02-28T23:07:19.294 INFO:tasks.workunit.client.1.smithi184.stdout:2/85: write fe [3440750,32650] 0 2024-02-28T23:07:19.297 INFO:tasks.workunit.client.1.smithi184.stdout:9/86: rename d5/db/de/d10/f11 to d5/db/de/d10/f1b 0 2024-02-28T23:07:19.297 INFO:tasks.workunit.client.1.smithi184.stdout:6/79: truncate dc/de/d10/f19 1026488 0 2024-02-28T23:07:19.302 INFO:tasks.workunit.client.0.smithi159.stdout:0/648: rename d0/d5/d14/d25/d2c/dab/dc5/dcb to d0/de/d75/de8 0 2024-02-28T23:07:19.304 INFO:tasks.workunit.client.0.smithi159.stdout:3/471: mknod d0/d47/d88/c8e 0 2024-02-28T23:07:19.305 INFO:tasks.workunit.client.1.smithi184.stdout:7/85: creat d6/d9/d13/d1e/f21 x:0 0 0 2024-02-28T23:07:19.305 INFO:tasks.workunit.client.1.smithi184.stdout:5/77: sync 2024-02-28T23:07:19.305 INFO:tasks.workunit.client.1.smithi184.stdout:1/145: creat d20/f2d x:0 0 0 2024-02-28T23:07:19.306 INFO:tasks.workunit.client.1.smithi184.stdout:6/80: dread dc/de/d10/f19 [0,4194304] 0 2024-02-28T23:07:19.306 INFO:tasks.workunit.client.1.smithi184.stdout:3/86: dwrite d1/d4/fb [4194304,4194304] 0 2024-02-28T23:07:19.307 INFO:tasks.workunit.client.0.smithi159.stdout:1/509: mknod d6/d12/d33/d3c/cab 0 2024-02-28T23:07:19.307 INFO:tasks.workunit.client.1.smithi184.stdout:1/146: read fa [1248549,99563] 0 2024-02-28T23:07:19.307 INFO:tasks.workunit.client.1.smithi184.stdout:5/78: write db/d12/d18/f1b [632369,39902] 0 2024-02-28T23:07:19.309 INFO:tasks.workunit.client.1.smithi184.stdout:6/81: write dc/f13 [1410414,121285] 0 2024-02-28T23:07:19.311 INFO:tasks.workunit.client.0.smithi159.stdout:1/510: truncate d6/d12/d1a/d92/fa6 957592 0 2024-02-28T23:07:19.314 INFO:tasks.workunit.client.0.smithi159.stdout:7/387: truncate d5/d56/d50/f58 642394 0 2024-02-28T23:07:19.316 INFO:tasks.workunit.client.0.smithi159.stdout:7/388: write d5/d10/f36 [4140290,71841] 0 2024-02-28T23:07:19.317 INFO:tasks.workunit.client.1.smithi184.stdout:7/86: dread f4 [0,4194304] 0 2024-02-28T23:07:19.320 INFO:tasks.workunit.client.0.smithi159.stdout:5/534: fsync d8/f3f 0 2024-02-28T23:07:19.330 INFO:tasks.workunit.client.0.smithi159.stdout:3/472: dwrite d0/d6/f32 [0,4194304] 0 2024-02-28T23:07:19.330 INFO:tasks.workunit.client.0.smithi159.stdout:7/389: truncate d5/d56/d50/d5b/f7b 756573 0 2024-02-28T23:07:19.332 INFO:tasks.workunit.client.1.smithi184.stdout:0/101: sync 2024-02-28T23:07:19.343 INFO:tasks.workunit.client.0.smithi159.stdout:4/604: symlink d9/d42/ld2 0 2024-02-28T23:07:19.345 INFO:tasks.workunit.client.0.smithi159.stdout:1/511: dwrite d6/d12/d1a/fa3 [0,4194304] 0 2024-02-28T23:07:19.351 INFO:tasks.workunit.client.1.smithi184.stdout:3/87: symlink d1/d4/d6/l18 0 2024-02-28T23:07:19.352 INFO:tasks.workunit.client.1.smithi184.stdout:3/88: dread - d1/d4/f14 zero size 2024-02-28T23:07:19.353 INFO:tasks.workunit.client.1.smithi184.stdout:3/89: chown d1 29470333 1 2024-02-28T23:07:19.355 INFO:tasks.workunit.client.1.smithi184.stdout:3/90: readlink d1/d4/d6/l18 0 2024-02-28T23:07:19.356 INFO:tasks.workunit.client.1.smithi184.stdout:3/91: dread - d1/d4/f14 zero size 2024-02-28T23:07:19.358 INFO:tasks.workunit.client.1.smithi184.stdout:3/92: readlink d1/lf 0 2024-02-28T23:07:19.360 INFO:tasks.workunit.client.1.smithi184.stdout:1/147: symlink d20/l2e 0 2024-02-28T23:07:19.366 INFO:tasks.workunit.client.1.smithi184.stdout:5/79: creat db/d12/f1d x:0 0 0 2024-02-28T23:07:19.366 INFO:tasks.workunit.client.1.smithi184.stdout:4/73: truncate d1/d4/f11 7829166 0 2024-02-28T23:07:19.368 INFO:tasks.workunit.client.1.smithi184.stdout:6/82: rmdir dc/de/d10 39 2024-02-28T23:07:19.371 INFO:tasks.workunit.client.1.smithi184.stdout:1/148: dread f1d [0,4194304] 0 2024-02-28T23:07:19.373 INFO:tasks.workunit.client.0.smithi159.stdout:6/499: sync 2024-02-28T23:07:19.373 INFO:tasks.workunit.client.0.smithi159.stdout:2/453: sync 2024-02-28T23:07:19.374 INFO:tasks.workunit.client.0.smithi159.stdout:7/390: creat d5/d16/d1a/d24/d64/f7d x:0 0 0 2024-02-28T23:07:19.375 INFO:tasks.workunit.client.0.smithi159.stdout:7/391: read - d5/f3d zero size 2024-02-28T23:07:19.376 INFO:tasks.workunit.client.0.smithi159.stdout:6/500: fsync d0/d1b/d33/d3f/f73 0 2024-02-28T23:07:19.377 INFO:tasks.workunit.client.0.smithi159.stdout:6/501: chown d0/d1b/d33/f18 1046864517 1 2024-02-28T23:07:19.379 INFO:tasks.workunit.client.0.smithi159.stdout:9/551: dread d4/f5f [0,4194304] 0 2024-02-28T23:07:19.380 INFO:tasks.workunit.client.1.smithi184.stdout:0/102: mknod d0/d1d/c24 0 2024-02-28T23:07:19.383 INFO:tasks.workunit.client.0.smithi159.stdout:0/649: creat d0/d5/d38/d63/dd8/fe9 x:0 0 0 2024-02-28T23:07:19.383 INFO:tasks.workunit.client.0.smithi159.stdout:0/650: chown d0/d5/d14/d34/d6c/f9b 1 1 2024-02-28T23:07:19.384 INFO:tasks.workunit.client.1.smithi184.stdout:0/103: chown d0/l10 28886240 1 2024-02-28T23:07:19.384 INFO:tasks.workunit.client.1.smithi184.stdout:2/86: link fa d10/f1d 0 2024-02-28T23:07:19.384 INFO:tasks.workunit.client.1.smithi184.stdout:8/105: creat d1/da/f2c x:0 0 0 2024-02-28T23:07:19.385 INFO:tasks.workunit.client.0.smithi159.stdout:1/512: symlink d6/d1d/d1f/lac 0 2024-02-28T23:07:19.386 INFO:tasks.workunit.client.0.smithi159.stdout:5/535: dread d8/d19/d23/d35/d65/f83 [0,4194304] 0 2024-02-28T23:07:19.387 INFO:tasks.workunit.client.0.smithi159.stdout:8/634: getdents d2/d11/d52/d26/d36/d38/d77 0 2024-02-28T23:07:19.389 INFO:tasks.workunit.client.0.smithi159.stdout:8/635: fsync d2/d11/d35/d9c/da0/fb9 0 2024-02-28T23:07:19.391 INFO:tasks.workunit.client.0.smithi159.stdout:8/636: chown d2/d3/f2a 511382047 1 2024-02-28T23:07:19.394 INFO:tasks.workunit.client.0.smithi159.stdout:2/454: creat d9/d50/d54/f9a x:0 0 0 2024-02-28T23:07:19.397 INFO:tasks.workunit.client.0.smithi159.stdout:6/502: chown d0/d1b/f3c 42697513 1 2024-02-28T23:07:19.401 INFO:tasks.workunit.client.1.smithi184.stdout:5/80: creat db/f1e x:0 0 0 2024-02-28T23:07:19.401 INFO:tasks.workunit.client.0.smithi159.stdout:9/552: stat d4/l16 0 2024-02-28T23:07:19.403 INFO:tasks.workunit.client.0.smithi159.stdout:9/553: fsync d4/d3d/d3e/d55/f43 0 2024-02-28T23:07:19.405 INFO:tasks.workunit.client.1.smithi184.stdout:1/149: mknod d20/c2f 0 2024-02-28T23:07:19.405 INFO:tasks.workunit.client.0.smithi159.stdout:5/536: fsync d8/d19/d23/d2a/f4b 0 2024-02-28T23:07:19.409 INFO:tasks.workunit.client.1.smithi184.stdout:2/87: mkdir d10/d13/d1e 0 2024-02-28T23:07:19.410 INFO:tasks.workunit.client.1.smithi184.stdout:7/87: dwrite f0 [0,4194304] 0 2024-02-28T23:07:19.410 INFO:tasks.workunit.client.0.smithi159.stdout:5/537: truncate d8/d19/d23/d35/d38/d8f/da5/d90/fa8 359395 0 2024-02-28T23:07:19.411 INFO:tasks.workunit.client.0.smithi159.stdout:7/392: symlink d5/d16/d1a/d27/d75/l7e 0 2024-02-28T23:07:19.412 INFO:tasks.workunit.client.1.smithi184.stdout:2/88: fdatasync d10/d13/d15/f1b 0 2024-02-28T23:07:19.412 INFO:tasks.workunit.client.0.smithi159.stdout:7/393: readlink d5/d56/d50/l52 0 2024-02-28T23:07:19.414 INFO:tasks.workunit.client.1.smithi184.stdout:9/87: link d5/f9 d5/db/de/d10/f1c 0 2024-02-28T23:07:19.415 INFO:tasks.workunit.client.0.smithi159.stdout:4/605: creat d9/d42/d54/fd3 x:0 0 0 2024-02-28T23:07:19.417 INFO:tasks.workunit.client.1.smithi184.stdout:9/88: write d5/db/f16 [724433,84037] 0 2024-02-28T23:07:19.418 INFO:tasks.workunit.client.0.smithi159.stdout:6/503: symlink d0/d1b/d33/d11/d34/la5 0 2024-02-28T23:07:19.421 INFO:tasks.workunit.client.1.smithi184.stdout:5/81: dread f8 [0,4194304] 0 2024-02-28T23:07:19.422 INFO:tasks.workunit.client.0.smithi159.stdout:6/504: truncate d0/d1b/d33/d3f/d44/d7a/f8e 468528 0 2024-02-28T23:07:19.422 INFO:tasks.workunit.client.1.smithi184.stdout:3/93: truncate d1/d4/d6/fa 195423 0 2024-02-28T23:07:19.425 INFO:tasks.workunit.client.1.smithi184.stdout:3/94: write d1/d4/f14 [524316,59831] 0 2024-02-28T23:07:19.426 INFO:tasks.workunit.client.0.smithi159.stdout:1/513: truncate d6/d12/d16/f42 490564 0 2024-02-28T23:07:19.426 INFO:tasks.workunit.client.1.smithi184.stdout:1/150: symlink d20/l30 0 2024-02-28T23:07:19.427 INFO:tasks.workunit.client.1.smithi184.stdout:0/104: creat d0/d1f/f25 x:0 0 0 2024-02-28T23:07:19.429 INFO:tasks.workunit.client.0.smithi159.stdout:3/473: getdents d0/d47 0 2024-02-28T23:07:19.429 INFO:tasks.workunit.client.1.smithi184.stdout:1/151: stat f19 0 2024-02-28T23:07:19.429 INFO:tasks.workunit.client.1.smithi184.stdout:2/89: mkdir d10/d1f 0 2024-02-28T23:07:19.431 INFO:tasks.workunit.client.0.smithi159.stdout:3/474: stat d0/d6/d3e/f1d 0 2024-02-28T23:07:19.431 INFO:tasks.workunit.client.1.smithi184.stdout:7/88: creat d6/d9/d13/d1e/f22 x:0 0 0 2024-02-28T23:07:19.434 INFO:tasks.workunit.client.0.smithi159.stdout:3/475: truncate d0/f82 102998 0 2024-02-28T23:07:19.434 INFO:tasks.workunit.client.1.smithi184.stdout:7/89: chown d6/d9/d13/d1e/f21 6240 1 2024-02-28T23:07:19.435 INFO:tasks.workunit.client.0.smithi159.stdout:2/455: dwrite d9/d23/d2c/d55/f2a [0,4194304] 0 2024-02-28T23:07:19.436 INFO:tasks.workunit.client.0.smithi159.stdout:3/476: chown d0/d6/d3e/d57 9334 1 2024-02-28T23:07:19.437 INFO:tasks.workunit.client.1.smithi184.stdout:5/82: mkdir db/d1f 0 2024-02-28T23:07:19.438 INFO:tasks.workunit.client.1.smithi184.stdout:5/83: fdatasync db/d12/f1d 0 2024-02-28T23:07:19.442 INFO:tasks.workunit.client.0.smithi159.stdout:9/554: rename d4/l20 to d4/d3d/d3e/d55/d4c/d4e/d6b/laf 0 2024-02-28T23:07:19.442 INFO:tasks.workunit.client.1.smithi184.stdout:3/95: rmdir d1/d4/d5 39 2024-02-28T23:07:19.446 INFO:tasks.workunit.client.1.smithi184.stdout:0/105: creat d0/d1f/f26 x:0 0 0 2024-02-28T23:07:19.449 INFO:tasks.workunit.client.0.smithi159.stdout:6/505: dwrite d0/d1b/d33/f59 [0,4194304] 0 2024-02-28T23:07:19.450 INFO:tasks.workunit.client.1.smithi184.stdout:0/106: write d0/f6 [968863,40249] 0 2024-02-28T23:07:19.453 INFO:tasks.workunit.client.0.smithi159.stdout:8/637: creat d2/d11/d35/fcc x:0 0 0 2024-02-28T23:07:19.456 INFO:tasks.workunit.client.0.smithi159.stdout:5/538: fsync d8/d19/d23/f56 0 2024-02-28T23:07:19.458 INFO:tasks.workunit.client.1.smithi184.stdout:6/83: dwrite dc/de/d10/f19 [0,4194304] 0 2024-02-28T23:07:19.458 INFO:tasks.workunit.client.0.smithi159.stdout:8/638: readlink d2/d11/d52/d26/d36/d38/l7b 0 2024-02-28T23:07:19.458 INFO:tasks.workunit.client.0.smithi159.stdout:1/514: dwrite d6/d12/d1a/f53 [4194304,4194304] 0 2024-02-28T23:07:19.459 INFO:tasks.workunit.client.0.smithi159.stdout:4/606: creat d9/d20/d87/fd4 x:0 0 0 2024-02-28T23:07:19.461 INFO:tasks.workunit.client.0.smithi159.stdout:4/607: read - d9/d42/d54/d77/fcc zero size 2024-02-28T23:07:19.464 INFO:tasks.workunit.client.0.smithi159.stdout:2/456: symlink d9/d50/d62/l9b 0 2024-02-28T23:07:19.470 INFO:tasks.workunit.client.1.smithi184.stdout:8/106: creat d1/da/d10/f2d x:0 0 0 2024-02-28T23:07:19.472 INFO:tasks.workunit.client.0.smithi159.stdout:7/394: rename d5/d10/c23 to d5/d56/d50/d5b/c7f 0 2024-02-28T23:07:19.480 INFO:tasks.workunit.client.1.smithi184.stdout:1/152: rename d20/c29 to d20/c31 0 2024-02-28T23:07:19.481 INFO:tasks.workunit.client.0.smithi159.stdout:8/639: dwrite d2/d11/d52/d26/d36/f64 [0,4194304] 0 2024-02-28T23:07:19.481 INFO:tasks.workunit.client.0.smithi159.stdout:6/506: symlink d0/d1b/d33/d11/d34/d9d/da2/d52/la6 0 2024-02-28T23:07:19.485 INFO:tasks.workunit.client.1.smithi184.stdout:0/107: mkdir d0/df/d13/d27 0 2024-02-28T23:07:19.486 INFO:tasks.workunit.client.1.smithi184.stdout:4/74: write d1/f10 [1437911,99474] 0 2024-02-28T23:07:19.487 INFO:tasks.workunit.client.0.smithi159.stdout:1/515: symlink d6/d12/d1a/lad 0 2024-02-28T23:07:19.488 INFO:tasks.workunit.client.1.smithi184.stdout:0/108: readlink d0/l16 0 2024-02-28T23:07:19.488 INFO:tasks.workunit.client.1.smithi184.stdout:9/89: creat d5/f1d x:0 0 0 2024-02-28T23:07:19.489 INFO:tasks.workunit.client.0.smithi159.stdout:1/516: chown d6/d1d/l25 15714 1 2024-02-28T23:07:19.490 INFO:tasks.workunit.client.1.smithi184.stdout:6/84: symlink dc/de/d10/l1c 0 2024-02-28T23:07:19.492 INFO:tasks.workunit.client.0.smithi159.stdout:1/517: write d6/d12/d16/f79 [250724,121922] 0 2024-02-28T23:07:19.494 INFO:tasks.workunit.client.1.smithi184.stdout:3/96: mknod d1/d4/d5/c19 0 2024-02-28T23:07:19.494 INFO:tasks.workunit.client.0.smithi159.stdout:1/518: fsync d6/d12/d33/d3c/faa 0 2024-02-28T23:07:19.496 INFO:tasks.workunit.client.0.smithi159.stdout:7/395: fdatasync d5/d16/d1a/d27/d46/f66 0 2024-02-28T23:07:19.499 INFO:tasks.workunit.client.1.smithi184.stdout:1/153: mkdir d20/d32 0 2024-02-28T23:07:19.500 INFO:tasks.workunit.client.1.smithi184.stdout:1/154: fdatasync f2 0 2024-02-28T23:07:19.501 INFO:tasks.workunit.client.0.smithi159.stdout:8/640: creat d2/d11/d52/d47/d65/d68/fcd x:0 0 0 2024-02-28T23:07:19.504 INFO:tasks.workunit.client.0.smithi159.stdout:6/507: read - d0/d1b/f81 zero size 2024-02-28T23:07:19.505 INFO:tasks.workunit.client.0.smithi159.stdout:8/641: write d2/d11/d52/d26/d36/d38/f5d [1689490,22393] 0 2024-02-28T23:07:19.505 INFO:tasks.workunit.client.0.smithi159.stdout:6/508: readlink d0/d1b/d33/d11/d34/la5 0 2024-02-28T23:07:19.507 INFO:tasks.workunit.client.0.smithi159.stdout:6/509: dread - d0/d6d/f95 zero size 2024-02-28T23:07:19.507 INFO:tasks.workunit.client.1.smithi184.stdout:0/109: creat d0/d1f/f28 x:0 0 0 2024-02-28T23:07:19.507 INFO:tasks.workunit.client.1.smithi184.stdout:4/75: dwrite d1/f10 [4194304,4194304] 0 2024-02-28T23:07:19.508 INFO:tasks.workunit.client.0.smithi159.stdout:5/539: mkdir d8/db4 0 2024-02-28T23:07:19.509 INFO:tasks.workunit.client.0.smithi159.stdout:5/540: chown d8/d19/d23/d35/d65/da3 19 1 2024-02-28T23:07:19.510 INFO:tasks.workunit.client.1.smithi184.stdout:4/76: read d1/dc/df/f14 [2090055,5730] 0 2024-02-28T23:07:19.511 INFO:tasks.workunit.client.0.smithi159.stdout:4/608: mknod d9/da/d1c/dc3/cd5 0 2024-02-28T23:07:19.512 INFO:tasks.workunit.client.1.smithi184.stdout:4/77: write d1/dc/fd [2129371,76688] 0 2024-02-28T23:07:19.513 INFO:tasks.workunit.client.0.smithi159.stdout:2/457: write d9/d23/d2c/d55/f72 [3941953,96002] 0 2024-02-28T23:07:19.514 INFO:tasks.workunit.client.1.smithi184.stdout:3/97: mknod d1/d4/d6/c1a 0 2024-02-28T23:07:19.514 INFO:tasks.workunit.client.1.smithi184.stdout:4/78: fsync d1/dc/df/f14 0 2024-02-28T23:07:19.517 INFO:tasks.workunit.client.1.smithi184.stdout:9/90: dread d5/f6 [0,4194304] 0 2024-02-28T23:07:19.518 INFO:tasks.workunit.client.0.smithi159.stdout:3/477: link d0/d6/d34/f62 d0/f8f 0 2024-02-28T23:07:19.518 INFO:tasks.workunit.client.0.smithi159.stdout:2/458: read - d9/f33 zero size 2024-02-28T23:07:19.520 INFO:tasks.workunit.client.1.smithi184.stdout:1/155: rmdir d20 39 2024-02-28T23:07:19.521 INFO:tasks.workunit.client.1.smithi184.stdout:2/90: getdents d10/d13/d15 0 2024-02-28T23:07:19.523 INFO:tasks.workunit.client.0.smithi159.stdout:9/555: dread d4/d52/d7d/f8d [0,4194304] 0 2024-02-28T23:07:19.524 INFO:tasks.workunit.client.0.smithi159.stdout:1/519: readlink d6/d12/d31/la5 0 2024-02-28T23:07:19.526 INFO:tasks.workunit.client.1.smithi184.stdout:6/85: mknod dc/c1d 0 2024-02-28T23:07:19.530 INFO:tasks.workunit.client.1.smithi184.stdout:7/90: getdents d6/d9/d13 0 2024-02-28T23:07:19.531 INFO:tasks.workunit.client.1.smithi184.stdout:6/86: read dc/fd [61832,33876] 0 2024-02-28T23:07:19.532 INFO:tasks.workunit.client.1.smithi184.stdout:0/110: dwrite d0/d1f/f26 [0,4194304] 0 2024-02-28T23:07:19.535 INFO:tasks.workunit.client.0.smithi159.stdout:5/541: mkdir d8/d19/d23/d35/d65/db5 0 2024-02-28T23:07:19.535 INFO:tasks.workunit.client.1.smithi184.stdout:5/84: sync 2024-02-28T23:07:19.538 INFO:tasks.workunit.client.0.smithi159.stdout:4/609: mknod d9/d4c/d6c/cd6 0 2024-02-28T23:07:19.539 INFO:tasks.workunit.client.1.smithi184.stdout:1/156: write d20/f24 [97964,110903] 0 2024-02-28T23:07:19.540 INFO:tasks.workunit.client.0.smithi159.stdout:3/478: symlink d0/d2b/d55/d75/d6d/d54/d7c/l90 0 2024-02-28T23:07:19.540 INFO:tasks.workunit.client.1.smithi184.stdout:0/111: chown d0/d1f/f26 106793 1 2024-02-28T23:07:19.542 INFO:tasks.workunit.client.1.smithi184.stdout:2/91: symlink d10/d13/d15/l20 0 2024-02-28T23:07:19.542 INFO:tasks.workunit.client.1.smithi184.stdout:1/157: fdatasync f9 0 2024-02-28T23:07:19.543 INFO:tasks.workunit.client.0.smithi159.stdout:2/459: mknod d9/d23/d2c/d55/d13/d4f/c9c 0 2024-02-28T23:07:19.544 INFO:tasks.workunit.client.1.smithi184.stdout:9/91: creat d5/d17/f1e x:0 0 0 2024-02-28T23:07:19.545 INFO:tasks.workunit.client.0.smithi159.stdout:7/396: dwrite d5/d16/d1a/f38 [0,4194304] 0 2024-02-28T23:07:19.547 INFO:tasks.workunit.client.1.smithi184.stdout:0/112: write d0/df/f11 [1071243,51838] 0 2024-02-28T23:07:19.547 INFO:tasks.workunit.client.1.smithi184.stdout:4/79: dwrite d1/f12 [0,4194304] 0 2024-02-28T23:07:19.549 INFO:tasks.workunit.client.1.smithi184.stdout:3/98: dwrite d1/d4/fb [0,4194304] 0 2024-02-28T23:07:19.550 INFO:tasks.workunit.client.0.smithi159.stdout:7/397: fsync d5/d16/d1a/d27/d46/f61 0 2024-02-28T23:07:19.550 INFO:tasks.workunit.client.0.smithi159.stdout:7/398: dread - d5/d16/d1a/d24/f6e zero size 2024-02-28T23:07:19.554 INFO:tasks.workunit.client.0.smithi159.stdout:1/520: rmdir d6/d1d/d46/d88 39 2024-02-28T23:07:19.562 INFO:tasks.workunit.client.0.smithi159.stdout:8/642: symlink d2/d11/d52/d6e/da9/lce 0 2024-02-28T23:07:19.562 INFO:tasks.workunit.client.1.smithi184.stdout:5/85: unlink db/ce 0 2024-02-28T23:07:19.563 INFO:tasks.workunit.client.0.smithi159.stdout:8/643: readlink d2/d11/d35/l8a 0 2024-02-28T23:07:19.563 INFO:tasks.workunit.client.0.smithi159.stdout:4/610: dread d9/da/d1c/d23/d2d/fac [0,4194304] 0 2024-02-28T23:07:19.564 INFO:tasks.workunit.client.1.smithi184.stdout:1/158: unlink d20/l30 0 2024-02-28T23:07:19.566 INFO:tasks.workunit.client.0.smithi159.stdout:8/644: stat d2/d11/d52/d6e/l78 0 2024-02-28T23:07:19.567 INFO:tasks.workunit.client.1.smithi184.stdout:0/113: dwrite d0/f17 [0,4194304] 0 2024-02-28T23:07:19.568 INFO:tasks.workunit.client.0.smithi159.stdout:4/611: write d9/d42/d54/d77/fc4 [705065,87064] 0 2024-02-28T23:07:19.569 INFO:tasks.workunit.client.0.smithi159.stdout:3/479: fdatasync d0/d6/f13 0 2024-02-28T23:07:19.573 INFO:tasks.workunit.client.0.smithi159.stdout:8/645: chown d2/d11/d52/d26/d36/d38/d77/dc5/fc7 21993 1 2024-02-28T23:07:19.578 INFO:tasks.workunit.client.1.smithi184.stdout:2/92: mkdir d10/d1f/d21 0 2024-02-28T23:07:19.582 INFO:tasks.workunit.client.0.smithi159.stdout:7/399: dwrite d5/d56/d50/d5b/f7b [0,4194304] 0 2024-02-28T23:07:19.582 INFO:tasks.workunit.client.1.smithi184.stdout:1/159: mknod d20/c33 0 2024-02-28T23:07:19.583 INFO:tasks.workunit.client.0.smithi159.stdout:6/510: creat d0/d1b/d33/d11/fa7 x:0 0 0 2024-02-28T23:07:19.583 INFO:tasks.workunit.client.1.smithi184.stdout:0/114: dread d0/d1d/f1e [0,4194304] 0 2024-02-28T23:07:19.583 INFO:tasks.workunit.client.0.smithi159.stdout:3/480: read d0/d2b/d55/d75/d6d/f2d [2470286,10158] 0 2024-02-28T23:07:19.584 INFO:tasks.workunit.client.1.smithi184.stdout:1/160: write f19 [5330719,90908] 0 2024-02-28T23:07:19.587 INFO:tasks.workunit.client.1.smithi184.stdout:1/161: truncate f19 6284530 0 2024-02-28T23:07:19.587 INFO:tasks.workunit.client.1.smithi184.stdout:6/87: creat dc/de/f1e x:0 0 0 2024-02-28T23:07:19.588 INFO:tasks.workunit.client.0.smithi159.stdout:6/511: read d0/d1b/d33/d11/f7c [1232802,67642] 0 2024-02-28T23:07:19.588 INFO:tasks.workunit.client.0.smithi159.stdout:7/400: chown d5/d56/d2a/f69 430403 1 2024-02-28T23:07:19.589 INFO:tasks.workunit.client.0.smithi159.stdout:4/612: mkdir d9/d42/d54/d9c/dd7 0 2024-02-28T23:07:19.590 INFO:tasks.workunit.client.0.smithi159.stdout:8/646: read d2/d3/f3c [2859615,98577] 0 2024-02-28T23:07:19.592 INFO:tasks.workunit.client.0.smithi159.stdout:8/647: write d2/d3/f83 [513861,100292] 0 2024-02-28T23:07:19.597 INFO:tasks.workunit.client.1.smithi184.stdout:5/86: link db/d12/d18/f1b db/d12/d18/f20 0 2024-02-28T23:07:19.610 INFO:tasks.workunit.client.0.smithi159.stdout:6/512: creat d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88/fa8 x:0 0 0 2024-02-28T23:07:19.611 INFO:tasks.workunit.client.1.smithi184.stdout:8/107: sync 2024-02-28T23:07:19.611 INFO:tasks.workunit.client.1.smithi184.stdout:2/93: creat d10/d13/d1e/f22 x:0 0 0 2024-02-28T23:07:19.611 INFO:tasks.workunit.client.0.smithi159.stdout:5/542: dwrite d8/d19/d23/d35/d41/daa/f8e [0,4194304] 0 2024-02-28T23:07:19.612 INFO:tasks.workunit.client.1.smithi184.stdout:2/94: read - d10/f16 zero size 2024-02-28T23:07:19.613 INFO:tasks.workunit.client.0.smithi159.stdout:6/513: stat d0/d1b/d33 0 2024-02-28T23:07:19.613 INFO:tasks.workunit.client.0.smithi159.stdout:9/556: write d4/d3d/d3e/d55/d37/f54 [339640,91266] 0 2024-02-28T23:07:19.615 INFO:tasks.workunit.client.0.smithi159.stdout:7/401: dwrite d5/d56/d50/d5b/f7b [0,4194304] 0 2024-02-28T23:07:19.615 INFO:tasks.workunit.client.0.smithi159.stdout:5/543: truncate d8/d19/f36 1690187 0 2024-02-28T23:07:19.617 INFO:tasks.workunit.client.0.smithi159.stdout:8/648: symlink d2/d11/d52/lcf 0 2024-02-28T23:07:19.620 INFO:tasks.workunit.client.0.smithi159.stdout:2/460: rmdir d9/d23/d2c/d55/d83 0 2024-02-28T23:07:19.620 INFO:tasks.workunit.client.1.smithi184.stdout:1/162: creat d20/d32/f34 x:0 0 0 2024-02-28T23:07:19.620 INFO:tasks.workunit.client.1.smithi184.stdout:9/92: dwrite d5/db/de/d10/f1c [0,4194304] 0 2024-02-28T23:07:19.621 INFO:tasks.workunit.client.1.smithi184.stdout:8/108: mknod d1/da/df/d20/c2e 0 2024-02-28T23:07:19.625 INFO:tasks.workunit.client.0.smithi159.stdout:1/521: creat d6/d12/d31/fae x:0 0 0 2024-02-28T23:07:19.625 INFO:tasks.workunit.client.1.smithi184.stdout:5/87: mkdir db/d12/d1c/d21 0 2024-02-28T23:07:19.626 INFO:tasks.workunit.client.0.smithi159.stdout:4/613: dwrite d9/d4c/fb7 [0,4194304] 0 2024-02-28T23:07:19.627 INFO:tasks.workunit.client.1.smithi184.stdout:4/80: truncate d1/dc/fd 5504259 0 2024-02-28T23:07:19.628 INFO:tasks.workunit.client.1.smithi184.stdout:4/81: readlink d1/d8/la 0 2024-02-28T23:07:19.629 INFO:tasks.workunit.client.1.smithi184.stdout:0/115: dwrite d0/d1d/f1e [0,4194304] 0 2024-02-28T23:07:19.630 INFO:tasks.workunit.client.1.smithi184.stdout:7/91: sync 2024-02-28T23:07:19.631 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:19 smithi159 ceph-mon[28802]: pgmap v28: 65 pgs: 65 active+clean; 1.0 GiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 22 MiB/s rd, 110 MiB/s wr, 276 op/s 2024-02-28T23:07:19.635 INFO:tasks.workunit.client.1.smithi184.stdout:3/99: truncate d1/d4/fb 5729351 0 2024-02-28T23:07:19.635 INFO:tasks.workunit.client.1.smithi184.stdout:6/88: rmdir dc/de 39 2024-02-28T23:07:19.644 INFO:tasks.workunit.client.1.smithi184.stdout:1/163: creat d20/f35 x:0 0 0 2024-02-28T23:07:19.644 INFO:tasks.workunit.client.1.smithi184.stdout:8/109: dread d1/da/dc/d18/f19 [0,4194304] 0 2024-02-28T23:07:19.644 INFO:tasks.workunit.client.1.smithi184.stdout:9/93: rename d5/d17/f1e to d5/db/f1f 0 2024-02-28T23:07:19.646 INFO:tasks.workunit.client.0.smithi159.stdout:3/481: fsync d0/d6/d3e/f5b 0 2024-02-28T23:07:19.648 INFO:tasks.workunit.client.1.smithi184.stdout:5/88: dwrite db/d12/d18/f1a [0,4194304] 0 2024-02-28T23:07:19.649 INFO:tasks.workunit.client.0.smithi159.stdout:6/514: dread - d0/d1b/f98 zero size 2024-02-28T23:07:19.651 INFO:tasks.workunit.client.1.smithi184.stdout:7/92: symlink d6/d9/da/l23 0 2024-02-28T23:07:19.652 INFO:tasks.workunit.client.0.smithi159.stdout:9/557: write d4/f39 [1494447,21884] 0 2024-02-28T23:07:19.655 INFO:tasks.workunit.client.0.smithi159.stdout:9/558: chown d4/d3d/d3e/d55/c33 2088090 1 2024-02-28T23:07:19.657 INFO:tasks.workunit.client.0.smithi159.stdout:9/559: fdatasync d4/d3d/d3e/d55/d4c/d4e/f9c 0 2024-02-28T23:07:19.662 INFO:tasks.workunit.client.0.smithi159.stdout:7/402: rmdir d5/d16/d40 39 2024-02-28T23:07:19.664 INFO:tasks.workunit.client.1.smithi184.stdout:6/89: dwrite f8 [0,4194304] 0 2024-02-28T23:07:19.677 INFO:tasks.workunit.client.0.smithi159.stdout:0/651: sync 2024-02-28T23:07:19.678 INFO:tasks.workunit.client.0.smithi159.stdout:3/482: dread d0/d6/d34/f41 [0,4194304] 0 2024-02-28T23:07:19.678 INFO:tasks.workunit.client.1.smithi184.stdout:3/100: rename d1/d4/d6/l18 to d1/d4/d5/l1b 0 2024-02-28T23:07:19.682 INFO:tasks.workunit.client.0.smithi159.stdout:4/614: creat d9/da/d1c/d23/d7a/fd8 x:0 0 0 2024-02-28T23:07:19.685 INFO:tasks.workunit.client.0.smithi159.stdout:3/483: dread d0/d2b/d55/d75/d6d/d54/d7c/f7b [0,4194304] 0 2024-02-28T23:07:19.685 INFO:tasks.workunit.client.1.smithi184.stdout:5/89: mknod db/d12/d1c/c22 0 2024-02-28T23:07:19.686 INFO:tasks.workunit.client.1.smithi184.stdout:2/95: dwrite fb [0,4194304] 0 2024-02-28T23:07:19.687 INFO:tasks.workunit.client.0.smithi159.stdout:1/522: dread d6/d12/d16/f42 [0,4194304] 0 2024-02-28T23:07:19.691 INFO:tasks.workunit.client.1.smithi184.stdout:2/96: dread - d10/f16 zero size 2024-02-28T23:07:19.692 INFO:tasks.workunit.client.0.smithi159.stdout:8/649: write d2/d11/d52/d26/d36/f55 [910332,72527] 0 2024-02-28T23:07:19.692 INFO:tasks.workunit.client.0.smithi159.stdout:2/461: write d9/d36/f3f [22591,88674] 0 2024-02-28T23:07:19.694 INFO:tasks.workunit.client.0.smithi159.stdout:8/650: fdatasync d2/d3/f83 0 2024-02-28T23:07:19.695 INFO:tasks.workunit.client.0.smithi159.stdout:9/560: unlink d4/d3d/d3e/d6e/c87 0 2024-02-28T23:07:19.700 INFO:tasks.workunit.client.1.smithi184.stdout:4/82: sync 2024-02-28T23:07:19.703 INFO:tasks.workunit.client.0.smithi159.stdout:5/544: dwrite f6 [0,4194304] 0 2024-02-28T23:07:19.703 INFO:tasks.workunit.client.1.smithi184.stdout:5/90: dwrite f8 [0,4194304] 0 2024-02-28T23:07:19.704 INFO:tasks.workunit.client.1.smithi184.stdout:1/164: dwrite f16 [0,4194304] 0 2024-02-28T23:07:19.705 INFO:tasks.workunit.client.0.smithi159.stdout:0/652: mknod d0/de/cea 0 2024-02-28T23:07:19.706 INFO:tasks.workunit.client.0.smithi159.stdout:4/615: creat d9/d42/d54/d56/fd9 x:0 0 0 2024-02-28T23:07:19.706 INFO:tasks.workunit.client.1.smithi184.stdout:1/165: write d20/f25 [2743929,41837] 0 2024-02-28T23:07:19.722 INFO:tasks.workunit.client.0.smithi159.stdout:2/462: dwrite d9/f33 [0,4194304] 0 2024-02-28T23:07:19.725 INFO:tasks.workunit.client.0.smithi159.stdout:9/561: dwrite d4/d3d/d3e/f73 [0,4194304] 0 2024-02-28T23:07:19.727 INFO:tasks.workunit.client.1.smithi184.stdout:4/83: dread d1/dc/df/f14 [0,4194304] 0 2024-02-28T23:07:19.729 INFO:tasks.workunit.client.1.smithi184.stdout:9/94: sync 2024-02-28T23:07:19.729 INFO:tasks.workunit.client.1.smithi184.stdout:4/84: fdatasync d1/f12 0 2024-02-28T23:07:19.732 INFO:tasks.workunit.client.1.smithi184.stdout:1/166: dwrite d20/f35 [0,4194304] 0 2024-02-28T23:07:19.732 INFO:tasks.workunit.client.0.smithi159.stdout:8/651: dread d2/d11/d52/d26/d36/f23 [0,4194304] 0 2024-02-28T23:07:19.734 INFO:tasks.workunit.client.1.smithi184.stdout:0/116: truncate d0/df/d13/f14 768737 0 2024-02-28T23:07:19.735 INFO:tasks.workunit.client.1.smithi184.stdout:1/167: write f9 [1226729,97565] 0 2024-02-28T23:07:19.736 INFO:tasks.workunit.client.0.smithi159.stdout:3/484: dread d0/d2b/d55/d75/d6d/f66 [0,4194304] 0 2024-02-28T23:07:19.737 INFO:tasks.workunit.client.1.smithi184.stdout:0/117: write d0/f6 [4274457,70112] 0 2024-02-28T23:07:19.740 INFO:tasks.workunit.client.1.smithi184.stdout:1/168: write f9 [1948549,54624] 0 2024-02-28T23:07:19.747 INFO:tasks.workunit.client.1.smithi184.stdout:4/85: dread d1/dc/df/f14 [0,4194304] 0 2024-02-28T23:07:19.747 INFO:tasks.workunit.client.0.smithi159.stdout:7/403: dread d5/d16/f19 [0,4194304] 0 2024-02-28T23:07:19.749 INFO:tasks.workunit.client.0.smithi159.stdout:7/404: stat d5/d16/d1a/d27/d3e/c73 0 2024-02-28T23:07:19.756 INFO:tasks.workunit.client.0.smithi159.stdout:7/405: write d5/d16/d1a/d27/d3e/f7c [219250,49119] 0 2024-02-28T23:07:19.758 INFO:tasks.workunit.client.0.smithi159.stdout:7/406: chown d5/f12 34 1 2024-02-28T23:07:19.759 INFO:tasks.workunit.client.0.smithi159.stdout:9/562: fsync d4/d3d/d3e/d55/d4c/fa0 0 2024-02-28T23:07:19.762 INFO:tasks.workunit.client.0.smithi159.stdout:2/463: dread d9/d50/d54/f94 [0,4194304] 0 2024-02-28T23:07:19.762 INFO:tasks.workunit.client.0.smithi159.stdout:8/652: creat d2/d11/d74/fd0 x:0 0 0 2024-02-28T23:07:19.762 INFO:tasks.workunit.client.0.smithi159.stdout:3/485: rmdir d0 39 2024-02-28T23:07:19.763 INFO:tasks.workunit.client.0.smithi159.stdout:0/653: dread d0/fb [0,4194304] 0 2024-02-28T23:07:19.763 INFO:tasks.workunit.client.0.smithi159.stdout:9/563: write d4/d3d/d3e/f73 [1921787,69170] 0 2024-02-28T23:07:19.763 INFO:tasks.workunit.client.1.smithi184.stdout:0/118: dwrite d0/d1d/f1e [4194304,4194304] 0 2024-02-28T23:07:19.766 INFO:tasks.workunit.client.0.smithi159.stdout:8/653: readlink d2/d11/d52/d47/d65/l6c 0 2024-02-28T23:07:19.768 INFO:tasks.workunit.client.0.smithi159.stdout:6/515: getdents d0/d1b/d33/d11/d34/d9d/da2 0 2024-02-28T23:07:19.781 INFO:tasks.workunit.client.0.smithi159.stdout:2/464: creat d9/d23/d2c/d55/d13/d4f/f9d x:0 0 0 2024-02-28T23:07:19.784 INFO:tasks.workunit.client.0.smithi159.stdout:1/523: link d6/d12/f96 d6/d12/d33/faf 0 2024-02-28T23:07:19.786 INFO:tasks.workunit.client.0.smithi159.stdout:6/516: creat d0/d1b/d33/d3f/d44/d7a/fa9 x:0 0 0 2024-02-28T23:07:19.793 INFO:tasks.workunit.client.0.smithi159.stdout:6/517: truncate d0/d1b/f9e 880854 0 2024-02-28T23:07:19.793 INFO:tasks.workunit.client.0.smithi159.stdout:8/654: rename d2/d11/d52/d26/d36/c5b to d2/d11/d58/cd1 0 2024-02-28T23:07:19.798 INFO:tasks.workunit.client.0.smithi159.stdout:0/654: chown d0/d5/d14/d25/d5c/l8e 515161 1 2024-02-28T23:07:19.803 INFO:tasks.workunit.client.0.smithi159.stdout:7/407: dread d5/fb [0,4194304] 0 2024-02-28T23:07:19.807 INFO:tasks.workunit.client.0.smithi159.stdout:5/545: write d8/d19/f36 [1960685,96513] 0 2024-02-28T23:07:19.811 INFO:tasks.workunit.client.0.smithi159.stdout:4/616: write d9/da/d1c/d23/d2d/f83 [373595,419] 0 2024-02-28T23:07:19.820 INFO:tasks.workunit.client.0.smithi159.stdout:8/655: unlink d2/d11/d52/d47/fa5 0 2024-02-28T23:07:19.822 INFO:tasks.workunit.client.0.smithi159.stdout:2/465: mknod d9/c9e 0 2024-02-28T23:07:19.830 INFO:tasks.workunit.client.0.smithi159.stdout:1/524: symlink d6/d12/d33/da7/lb0 0 2024-02-28T23:07:19.834 INFO:tasks.workunit.client.0.smithi159.stdout:7/408: creat d5/d56/d50/f80 x:0 0 0 2024-02-28T23:07:19.839 INFO:tasks.workunit.client.0.smithi159.stdout:4/617: chown d9/d20/l4a 1 1 2024-02-28T23:07:19.840 INFO:tasks.workunit.client.0.smithi159.stdout:4/618: chown d9/da/l7c 300115511 1 2024-02-28T23:07:19.845 INFO:tasks.workunit.client.0.smithi159.stdout:2/466: creat d9/d50/d54/d84/f9f x:0 0 0 2024-02-28T23:07:19.849 INFO:tasks.workunit.client.0.smithi159.stdout:9/564: truncate d4/d3d/d3e/d55/d37/d62/f80 128047 0 2024-02-28T23:07:19.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:19 smithi184 ceph-mon[36198]: pgmap v28: 65 pgs: 65 active+clean; 1.0 GiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 22 MiB/s rd, 110 MiB/s wr, 276 op/s 2024-02-28T23:07:19.851 INFO:tasks.workunit.client.0.smithi159.stdout:1/525: dread - d6/d12/f70 zero size 2024-02-28T23:07:19.852 INFO:tasks.workunit.client.0.smithi159.stdout:6/518: write d0/d1b/f29 [1274338,65855] 0 2024-02-28T23:07:19.854 INFO:tasks.workunit.client.0.smithi159.stdout:6/519: stat d0/d1b/d33/d11/d34/d9d 0 2024-02-28T23:07:19.856 INFO:tasks.workunit.client.0.smithi159.stdout:7/409: mkdir d5/d16/d1a/d27/d46/d65/d81 0 2024-02-28T23:07:19.858 INFO:tasks.workunit.client.0.smithi159.stdout:4/619: symlink d9/da/d1c/dad/lda 0 2024-02-28T23:07:19.860 INFO:tasks.workunit.client.0.smithi159.stdout:4/620: chown d9/da/d1c/d23/cc1 188064 1 2024-02-28T23:07:19.860 INFO:tasks.workunit.client.0.smithi159.stdout:6/520: dread d0/d1b/d33/d11/d34/f6a [0,4194304] 0 2024-02-28T23:07:19.866 INFO:tasks.workunit.client.0.smithi159.stdout:3/486: truncate d0/d6/d3e/d2f/f4b 398510 0 2024-02-28T23:07:19.866 INFO:tasks.workunit.client.0.smithi159.stdout:2/467: symlink d9/d23/d2c/d55/d13/la0 0 2024-02-28T23:07:19.866 INFO:tasks.workunit.client.0.smithi159.stdout:6/521: fdatasync d0/d6d/fa1 0 2024-02-28T23:07:19.866 INFO:tasks.workunit.client.0.smithi159.stdout:8/656: mknod d2/d11/d52/d26/d36/d38/d77/dc5/cd2 0 2024-02-28T23:07:19.869 INFO:tasks.workunit.client.0.smithi159.stdout:3/487: read - d0/d2b/d55/d75/d6d/d54/d7c/f64 zero size 2024-02-28T23:07:19.870 INFO:tasks.workunit.client.0.smithi159.stdout:3/488: chown d0/d6/f32 7153 1 2024-02-28T23:07:19.870 INFO:tasks.workunit.client.0.smithi159.stdout:9/565: mkdir d4/d3d/d3e/d55/d37/d62/db0 0 2024-02-28T23:07:19.877 INFO:tasks.workunit.client.0.smithi159.stdout:7/410: fsync d5/d10/f11 0 2024-02-28T23:07:19.879 INFO:tasks.workunit.client.0.smithi159.stdout:4/621: truncate d9/da/d1c/d23/f37 1892550 0 2024-02-28T23:07:19.880 INFO:tasks.workunit.client.0.smithi159.stdout:5/546: dwrite d8/d19/d23/d35/f5e [0,4194304] 0 2024-02-28T23:07:19.882 INFO:tasks.workunit.client.0.smithi159.stdout:2/468: symlink d9/d50/d54/d84/d37/d5c/la1 0 2024-02-28T23:07:19.884 INFO:tasks.workunit.client.0.smithi159.stdout:5/547: stat d8/d19/d23/d35/d41/d77 0 2024-02-28T23:07:19.893 INFO:tasks.workunit.client.0.smithi159.stdout:0/655: getdents d0/d5/d14/d78/da8 0 2024-02-28T23:07:19.896 INFO:tasks.workunit.client.0.smithi159.stdout:8/657: mknod d2/d11/d52/d47/d65/cd3 0 2024-02-28T23:07:19.896 INFO:tasks.workunit.client.0.smithi159.stdout:9/566: dwrite d4/d3d/d3e/d55/d4c/d4e/f63 [0,4194304] 0 2024-02-28T23:07:19.903 INFO:tasks.workunit.client.0.smithi159.stdout:9/567: dread - d4/d3d/d3e/d55/d37/d62/f69 zero size 2024-02-28T23:07:19.903 INFO:tasks.workunit.client.0.smithi159.stdout:1/526: symlink d6/d12/d31/lb1 0 2024-02-28T23:07:19.914 INFO:tasks.workunit.client.0.smithi159.stdout:2/469: dwrite d9/d36/f3f [0,4194304] 0 2024-02-28T23:07:19.919 INFO:tasks.workunit.client.0.smithi159.stdout:3/489: dread d0/f8f [0,4194304] 0 2024-02-28T23:07:19.925 INFO:tasks.workunit.client.0.smithi159.stdout:4/622: symlink d9/d42/d54/d9c/ldb 0 2024-02-28T23:07:19.937 INFO:tasks.workunit.client.0.smithi159.stdout:1/527: mknod d6/d12/d16/cb2 0 2024-02-28T23:07:19.939 INFO:tasks.workunit.client.0.smithi159.stdout:1/528: readlink d6/d12/d31/d69/l52 0 2024-02-28T23:07:19.940 INFO:tasks.workunit.client.0.smithi159.stdout:1/529: dread - d6/d12/f70 zero size 2024-02-28T23:07:19.941 INFO:tasks.workunit.client.0.smithi159.stdout:2/470: mkdir d9/d50/d54/d84/da2 0 2024-02-28T23:07:19.945 INFO:tasks.workunit.client.0.smithi159.stdout:3/490: truncate d0/d6/d3e/d2f/f56 551455 0 2024-02-28T23:07:19.947 INFO:tasks.workunit.client.0.smithi159.stdout:7/411: dread d5/d16/f1f [0,4194304] 0 2024-02-28T23:07:19.950 INFO:tasks.workunit.client.0.smithi159.stdout:4/623: unlink d9/da/f3a 0 2024-02-28T23:07:19.953 INFO:tasks.workunit.client.0.smithi159.stdout:5/548: write d8/d19/f2e [3933469,74815] 0 2024-02-28T23:07:19.960 INFO:tasks.workunit.client.0.smithi159.stdout:1/530: mkdir d6/d1d/d1f/d3e/d9c/db3 0 2024-02-28T23:07:19.962 INFO:tasks.workunit.client.0.smithi159.stdout:2/471: creat d9/d50/d54/d84/d37/d5c/fa3 x:0 0 0 2024-02-28T23:07:19.968 INFO:tasks.workunit.client.0.smithi159.stdout:9/568: dread d4/fe [0,4194304] 0 2024-02-28T23:07:20.010 INFO:tasks.workunit.client.0.smithi159.stdout:6/522: link d0/d1b/d33/l79 d0/d6d/laa 0 2024-02-28T23:07:20.014 INFO:tasks.workunit.client.0.smithi159.stdout:6/523: read d0/d1b/f9e [463258,1816] 0 2024-02-28T23:07:20.014 INFO:tasks.workunit.client.0.smithi159.stdout:0/656: link d0/d5/d14/d25/d2c/f7f d0/d5/d14/d34/feb 0 2024-02-28T23:07:20.016 INFO:tasks.workunit.client.0.smithi159.stdout:0/657: write d0/de/f4a [5705154,13678] 0 2024-02-28T23:07:20.019 INFO:tasks.workunit.client.0.smithi159.stdout:0/658: readlink d0/de/d75/ld2 0 2024-02-28T23:07:20.022 INFO:tasks.workunit.client.0.smithi159.stdout:3/491: mknod d0/d6/d3e/c91 0 2024-02-28T23:07:20.025 INFO:tasks.workunit.client.1.smithi184.stdout:7/93: rename d6/d9/d13/l1d to d6/d9/d13/d14/l24 0 2024-02-28T23:07:20.025 INFO:tasks.workunit.client.0.smithi159.stdout:7/412: rmdir d5/d16/d40 39 2024-02-28T23:07:20.027 INFO:tasks.workunit.client.1.smithi184.stdout:3/101: read d1/d4/fb [340661,115682] 0 2024-02-28T23:07:20.028 INFO:tasks.workunit.client.0.smithi159.stdout:2/472: rename d9/d50/d54/d8d/l8f to d9/d50/d54/d8d/la4 0 2024-02-28T23:07:20.037 INFO:tasks.workunit.client.1.smithi184.stdout:6/90: symlink dc/de/d10/l1f 0 2024-02-28T23:07:20.043 INFO:tasks.workunit.client.0.smithi159.stdout:6/524: rename d0/d1b/d33/d11/d14/d49/f57 to d0/d6d/fab 0 2024-02-28T23:07:20.047 INFO:tasks.workunit.client.0.smithi159.stdout:5/549: mknod d8/d19/d23/d35/d65/db5/cb6 0 2024-02-28T23:07:20.049 INFO:tasks.workunit.client.0.smithi159.stdout:3/492: symlink d0/d2b/d55/d75/d6d/d54/d6a/l92 0 2024-02-28T23:07:20.052 INFO:tasks.workunit.client.1.smithi184.stdout:9/95: creat d5/db/f20 x:0 0 0 2024-02-28T23:07:20.053 INFO:tasks.workunit.client.0.smithi159.stdout:7/413: rmdir d5 39 2024-02-28T23:07:20.054 INFO:tasks.workunit.client.0.smithi159.stdout:2/473: symlink d9/d80/la5 0 2024-02-28T23:07:20.056 INFO:tasks.workunit.client.0.smithi159.stdout:2/474: write d9/f33 [2459612,32006] 0 2024-02-28T23:07:20.056 INFO:tasks.workunit.client.1.smithi184.stdout:9/96: write d5/db/f16 [1677088,121422] 0 2024-02-28T23:07:20.057 INFO:tasks.workunit.client.1.smithi184.stdout:1/169: rename d20/f28 to d20/f36 0 2024-02-28T23:07:20.057 INFO:tasks.workunit.client.0.smithi159.stdout:2/475: fsync d9/d50/d54/f9a 0 2024-02-28T23:07:20.060 INFO:tasks.workunit.client.1.smithi184.stdout:4/86: creat d1/dc/df/f16 x:0 0 0 2024-02-28T23:07:20.063 INFO:tasks.workunit.client.0.smithi159.stdout:0/659: symlink d0/de/db7/lec 0 2024-02-28T23:07:20.063 INFO:tasks.workunit.client.1.smithi184.stdout:0/119: stat d0/df/c1c 0 2024-02-28T23:07:20.065 INFO:tasks.workunit.client.1.smithi184.stdout:8/110: creat d1/da/d10/f2f x:0 0 0 2024-02-28T23:07:20.065 INFO:tasks.workunit.client.0.smithi159.stdout:0/660: dread - d0/d5/d14/d34/d6c/f9b zero size 2024-02-28T23:07:20.068 INFO:tasks.workunit.client.0.smithi159.stdout:3/493: rmdir d0/d47 39 2024-02-28T23:07:20.069 INFO:tasks.workunit.client.0.smithi159.stdout:0/661: write d0/d5/d38/d63/fbd [987140,91713] 0 2024-02-28T23:07:20.069 INFO:tasks.workunit.client.1.smithi184.stdout:0/120: read d0/d1d/f1e [7885158,48623] 0 2024-02-28T23:07:20.072 INFO:tasks.workunit.client.1.smithi184.stdout:8/111: dread - d1/da/dc/d16/f1b zero size 2024-02-28T23:07:20.079 INFO:tasks.workunit.client.0.smithi159.stdout:2/476: unlink d9/d50/d54/d84/d37/d5c/c64 0 2024-02-28T23:07:20.081 INFO:tasks.workunit.client.1.smithi184.stdout:1/170: dread f2 [0,4194304] 0 2024-02-28T23:07:20.081 INFO:tasks.workunit.client.0.smithi159.stdout:2/477: chown d9/d50/d54/d84/f9f 1017284803 1 2024-02-28T23:07:20.087 INFO:tasks.workunit.client.0.smithi159.stdout:4/624: write d9/f19 [4818880,100254] 0 2024-02-28T23:07:20.089 INFO:tasks.workunit.client.0.smithi159.stdout:1/531: dwrite d6/d12/d33/faf [0,4194304] 0 2024-02-28T23:07:20.091 INFO:tasks.workunit.client.1.smithi184.stdout:9/97: rename d5/db/de/d10/d12/f19 to d5/db/de/f21 0 2024-02-28T23:07:20.092 INFO:tasks.workunit.client.1.smithi184.stdout:7/94: symlink d6/l25 0 2024-02-28T23:07:20.093 INFO:tasks.workunit.client.0.smithi159.stdout:3/494: write d0/f8f [2162412,21201] 0 2024-02-28T23:07:20.098 INFO:tasks.workunit.client.0.smithi159.stdout:7/414: mknod d5/d56/d50/d5b/c82 0 2024-02-28T23:07:20.105 INFO:tasks.workunit.client.0.smithi159.stdout:9/569: link d4/l93 d4/d3d/d3e/d6e/lb1 0 2024-02-28T23:07:20.109 INFO:tasks.workunit.client.1.smithi184.stdout:8/112: creat d1/da/df/d20/f30 x:0 0 0 2024-02-28T23:07:20.110 INFO:tasks.workunit.client.0.smithi159.stdout:2/478: creat d9/d50/d62/fa6 x:0 0 0 2024-02-28T23:07:20.114 INFO:tasks.workunit.client.0.smithi159.stdout:2/479: readlink d9/d23/d2c/d55/d13/la0 0 2024-02-28T23:07:20.114 INFO:tasks.workunit.client.0.smithi159.stdout:4/625: rename d9/d42/d54/d77 to d9/da/d1c/d8e/ddc 0 2024-02-28T23:07:20.116 INFO:tasks.workunit.client.0.smithi159.stdout:0/662: dwrite d0/de/f3b [4194304,4194304] 0 2024-02-28T23:07:20.117 INFO:tasks.workunit.client.0.smithi159.stdout:4/626: stat d9/d42/db1 0 2024-02-28T23:07:20.118 INFO:tasks.workunit.client.1.smithi184.stdout:1/171: creat d20/d32/f37 x:0 0 0 2024-02-28T23:07:20.119 INFO:tasks.workunit.client.1.smithi184.stdout:1/172: chown f2 1605 1 2024-02-28T23:07:20.119 INFO:tasks.workunit.client.1.smithi184.stdout:5/91: dwrite db/d12/d18/f1b [0,4194304] 0 2024-02-28T23:07:20.122 INFO:tasks.workunit.client.0.smithi159.stdout:0/663: truncate d0/de/d75/de8/fe6 330835 0 2024-02-28T23:07:20.123 INFO:tasks.workunit.client.0.smithi159.stdout:3/495: creat d0/d2b/d55/d75/f93 x:0 0 0 2024-02-28T23:07:20.125 INFO:tasks.workunit.client.1.smithi184.stdout:2/97: write fc [4230236,83462] 0 2024-02-28T23:07:20.127 INFO:tasks.workunit.client.1.smithi184.stdout:9/98: symlink d5/db/de/d10/l22 0 2024-02-28T23:07:20.128 INFO:tasks.workunit.client.1.smithi184.stdout:2/98: write fb [3531615,75881] 0 2024-02-28T23:07:20.136 INFO:tasks.workunit.client.1.smithi184.stdout:7/95: read d6/d9/da/f10 [938056,96787] 0 2024-02-28T23:07:20.138 INFO:tasks.workunit.client.1.smithi184.stdout:2/99: write d10/f14 [150204,71513] 0 2024-02-28T23:07:20.139 INFO:tasks.workunit.client.0.smithi159.stdout:1/532: mkdir d6/d1d/d46/d88/db4 0 2024-02-28T23:07:20.144 INFO:tasks.workunit.client.1.smithi184.stdout:2/100: chown f8 297222 1 2024-02-28T23:07:20.144 INFO:tasks.workunit.client.0.smithi159.stdout:5/550: dwrite d8/d19/d23/d35/d38/d8f/da5/d90/f96 [0,4194304] 0 2024-02-28T23:07:20.147 INFO:tasks.workunit.client.1.smithi184.stdout:5/92: dread f7 [0,4194304] 0 2024-02-28T23:07:20.148 INFO:tasks.workunit.client.0.smithi159.stdout:5/551: stat d8/d19/d23/d35/d65/db5/cb6 0 2024-02-28T23:07:20.152 INFO:tasks.workunit.client.0.smithi159.stdout:9/570: dread d4/d3d/f5d [0,4194304] 0 2024-02-28T23:07:20.154 INFO:tasks.workunit.client.1.smithi184.stdout:9/99: dread d5/db/de/d10/f1b [0,4194304] 0 2024-02-28T23:07:20.155 INFO:tasks.workunit.client.0.smithi159.stdout:5/552: read d8/d16/f1a [480367,31989] 0 2024-02-28T23:07:20.155 INFO:tasks.workunit.client.1.smithi184.stdout:6/91: dwrite dc/fd [4194304,4194304] 0 2024-02-28T23:07:20.157 INFO:tasks.workunit.client.1.smithi184.stdout:2/101: truncate d10/d13/d15/f19 719900 0 2024-02-28T23:07:20.157 INFO:tasks.workunit.client.1.smithi184.stdout:1/173: dread f15 [0,4194304] 0 2024-02-28T23:07:20.159 INFO:tasks.workunit.client.0.smithi159.stdout:0/664: unlink d0/d5/d14/d25/d2c/dab/cc2 0 2024-02-28T23:07:20.164 INFO:tasks.workunit.client.1.smithi184.stdout:9/100: write d5/db/f14 [364082,125145] 0 2024-02-28T23:07:20.164 INFO:tasks.workunit.client.1.smithi184.stdout:9/101: dread - d5/f7 zero size 2024-02-28T23:07:20.165 INFO:tasks.workunit.client.1.smithi184.stdout:9/102: dread - d5/f7 zero size 2024-02-28T23:07:20.169 INFO:tasks.workunit.client.0.smithi159.stdout:1/533: stat d6/d12/d1a/c3b 0 2024-02-28T23:07:20.171 INFO:tasks.workunit.client.0.smithi159.stdout:7/415: truncate d5/fe 3241924 0 2024-02-28T23:07:20.173 INFO:tasks.workunit.client.1.smithi184.stdout:3/102: dwrite d1/d4/d6/fa [0,4194304] 0 2024-02-28T23:07:20.174 INFO:tasks.workunit.client.1.smithi184.stdout:7/96: creat d6/d9/f26 x:0 0 0 2024-02-28T23:07:20.174 INFO:tasks.workunit.client.0.smithi159.stdout:4/627: creat d9/da/d1c/d8e/ddc/dc9/fdd x:0 0 0 2024-02-28T23:07:20.175 INFO:tasks.workunit.client.0.smithi159.stdout:4/628: chown d9/da/dc5 10 1 2024-02-28T23:07:20.177 INFO:tasks.workunit.client.1.smithi184.stdout:2/102: dread f8 [0,4194304] 0 2024-02-28T23:07:20.183 INFO:tasks.workunit.client.1.smithi184.stdout:4/87: dwrite d1/d4/f11 [0,4194304] 0 2024-02-28T23:07:20.185 INFO:tasks.workunit.client.1.smithi184.stdout:9/103: dread d5/db/f16 [0,4194304] 0 2024-02-28T23:07:20.187 INFO:tasks.workunit.client.0.smithi159.stdout:5/553: creat d8/d19/d23/d35/d38/d8f/da5/d90/fb7 x:0 0 0 2024-02-28T23:07:20.189 INFO:tasks.workunit.client.1.smithi184.stdout:9/104: read d5/db/f16 [983126,81610] 0 2024-02-28T23:07:20.189 INFO:tasks.workunit.client.1.smithi184.stdout:0/121: dwrite d0/df/d13/f14 [0,4194304] 0 2024-02-28T23:07:20.191 INFO:tasks.workunit.client.0.smithi159.stdout:2/480: link d9/d50/d54/d84/d37/d5c/l8b d9/d23/la7 0 2024-02-28T23:07:20.192 INFO:tasks.workunit.client.1.smithi184.stdout:9/105: readlink d5/db/de/d10/l22 0 2024-02-28T23:07:20.199 INFO:tasks.workunit.client.0.smithi159.stdout:3/496: write d0/f4c [370471,54773] 0 2024-02-28T23:07:20.199 INFO:tasks.workunit.client.0.smithi159.stdout:4/629: rename d9/da/d1c/d23/d2d/d59/f5d to d9/da/d1c/d8e/ddc/dc9/fde 0 2024-02-28T23:07:20.202 INFO:tasks.workunit.client.0.smithi159.stdout:5/554: symlink d8/d19/d23/d35/d65/da3/lb8 0 2024-02-28T23:07:20.205 INFO:tasks.workunit.client.0.smithi159.stdout:4/630: write d9/d42/db1/fb4 [745401,46987] 0 2024-02-28T23:07:20.208 INFO:tasks.workunit.client.1.smithi184.stdout:8/113: creat d1/da/f31 x:0 0 0 2024-02-28T23:07:20.208 INFO:tasks.workunit.client.1.smithi184.stdout:4/88: dwrite d1/dc/df/f16 [0,4194304] 0 2024-02-28T23:07:20.210 INFO:tasks.workunit.client.0.smithi159.stdout:7/416: mkdir d5/d16/d1a/d27/d46/d65/d81/d83 0 2024-02-28T23:07:20.210 INFO:tasks.workunit.client.1.smithi184.stdout:7/97: creat d6/d9/da/dc/f27 x:0 0 0 2024-02-28T23:07:20.212 INFO:tasks.workunit.client.1.smithi184.stdout:2/103: mknod d10/d1f/c23 0 2024-02-28T23:07:20.215 INFO:tasks.workunit.client.0.smithi159.stdout:7/417: rename d5/d16/d1a/d27 to d5/d16/d1a/d27/d46/d84 22 2024-02-28T23:07:20.216 INFO:tasks.workunit.client.0.smithi159.stdout:0/665: link d0/de/f2b d0/de/d75/db8/fed 0 2024-02-28T23:07:20.218 INFO:tasks.workunit.client.1.smithi184.stdout:5/93: mknod db/d12/d1c/d21/c23 0 2024-02-28T23:07:20.219 INFO:tasks.workunit.client.0.smithi159.stdout:4/631: truncate d9/da/d1c/d8e/fcb 248713 0 2024-02-28T23:07:20.220 INFO:tasks.workunit.client.1.smithi184.stdout:0/122: creat d0/df/d13/f29 x:0 0 0 2024-02-28T23:07:20.220 INFO:tasks.workunit.client.0.smithi159.stdout:5/555: symlink d8/d19/d23/d2a/lb9 0 2024-02-28T23:07:20.222 INFO:tasks.workunit.client.1.smithi184.stdout:5/94: read db/d12/d18/f1a [459384,114333] 0 2024-02-28T23:07:20.222 INFO:tasks.workunit.client.1.smithi184.stdout:9/106: creat d5/db/de/f23 x:0 0 0 2024-02-28T23:07:20.224 INFO:tasks.workunit.client.0.smithi159.stdout:1/534: dread d6/f9 [0,4194304] 0 2024-02-28T23:07:20.224 INFO:tasks.workunit.client.1.smithi184.stdout:4/89: fsync d1/f10 0 2024-02-28T23:07:20.225 INFO:tasks.workunit.client.1.smithi184.stdout:3/103: mkdir d1/d4/d1c 0 2024-02-28T23:07:20.227 INFO:tasks.workunit.client.1.smithi184.stdout:4/90: readlink d1/d8/l9 0 2024-02-28T23:07:20.230 INFO:tasks.workunit.client.1.smithi184.stdout:2/104: dwrite d10/d13/d15/f1b [0,4194304] 0 2024-02-28T23:07:20.233 INFO:tasks.workunit.client.0.smithi159.stdout:3/497: dwrite d0/d2b/f29 [0,4194304] 0 2024-02-28T23:07:20.233 INFO:tasks.workunit.client.0.smithi159.stdout:7/418: rename d5/d10/f34 to d5/d10/f85 0 2024-02-28T23:07:20.236 INFO:tasks.workunit.client.1.smithi184.stdout:8/114: mkdir d1/da/dc/d16/d32 0 2024-02-28T23:07:20.239 INFO:tasks.workunit.client.1.smithi184.stdout:6/92: creat dc/de/f20 x:0 0 0 2024-02-28T23:07:20.240 INFO:tasks.workunit.client.0.smithi159.stdout:1/535: rmdir d6/d12/d33 39 2024-02-28T23:07:20.246 INFO:tasks.workunit.client.1.smithi184.stdout:0/123: dwrite d0/d1f/f25 [0,4194304] 0 2024-02-28T23:07:20.246 INFO:tasks.workunit.client.1.smithi184.stdout:3/104: dread d1/d4/d6/fa [0,4194304] 0 2024-02-28T23:07:20.246 INFO:tasks.workunit.client.0.smithi159.stdout:0/666: dwrite d0/d5/d14/d78/da8/fb6 [0,4194304] 0 2024-02-28T23:07:20.251 INFO:tasks.workunit.client.0.smithi159.stdout:0/667: readlink d0/d5/d14/d34/d6c/l98 0 2024-02-28T23:07:20.256 INFO:tasks.workunit.client.0.smithi159.stdout:2/481: dwrite d9/d23/d2c/d55/f17 [0,4194304] 0 2024-02-28T23:07:20.258 INFO:tasks.workunit.client.0.smithi159.stdout:3/498: rmdir d0/d6 39 2024-02-28T23:07:20.267 INFO:tasks.workunit.client.1.smithi184.stdout:2/105: rename d10/d13/d1e to d10/d13/d15/d24 0 2024-02-28T23:07:20.267 INFO:tasks.workunit.client.1.smithi184.stdout:0/124: dwrite d0/df/d13/f29 [0,4194304] 0 2024-02-28T23:07:20.267 INFO:tasks.workunit.client.1.smithi184.stdout:6/93: dread dc/f13 [0,4194304] 0 2024-02-28T23:07:20.269 INFO:tasks.workunit.client.1.smithi184.stdout:6/94: readlink dc/de/d10/l1f 0 2024-02-28T23:07:20.270 INFO:tasks.workunit.client.1.smithi184.stdout:6/95: chown dc/de/f1e 965 1 2024-02-28T23:07:20.286 INFO:tasks.workunit.client.0.smithi159.stdout:7/419: fsync d5/d16/d40/f4e 0 2024-02-28T23:07:20.287 INFO:tasks.workunit.client.1.smithi184.stdout:1/174: getdents d20/d32 0 2024-02-28T23:07:20.292 INFO:tasks.workunit.client.0.smithi159.stdout:0/668: symlink d0/d5/d38/d63/dd8/lee 0 2024-02-28T23:07:20.295 INFO:tasks.workunit.client.0.smithi159.stdout:4/632: write d9/d42/db1/fd0 [749155,58472] 0 2024-02-28T23:07:20.296 INFO:tasks.workunit.client.0.smithi159.stdout:3/499: mknod d0/d2b/d55/d75/d6d/d54/c94 0 2024-02-28T23:07:20.297 INFO:tasks.workunit.client.1.smithi184.stdout:5/95: mknod db/d1f/c24 0 2024-02-28T23:07:20.298 INFO:tasks.workunit.client.1.smithi184.stdout:5/96: stat f8 0 2024-02-28T23:07:20.300 INFO:tasks.workunit.client.1.smithi184.stdout:3/105: symlink d1/l1d 0 2024-02-28T23:07:20.302 INFO:tasks.workunit.client.0.smithi159.stdout:0/669: symlink d0/d5/d14/d25/d2c/lef 0 2024-02-28T23:07:20.303 INFO:tasks.workunit.client.0.smithi159.stdout:1/536: dread d6/d12/d31/d69/f77 [0,4194304] 0 2024-02-28T23:07:20.304 INFO:tasks.workunit.client.0.smithi159.stdout:4/633: dread - d9/d4c/d6c/fa4 zero size 2024-02-28T23:07:20.304 INFO:tasks.workunit.client.1.smithi184.stdout:2/106: symlink d10/d13/d15/l25 0 2024-02-28T23:07:20.306 INFO:tasks.workunit.client.1.smithi184.stdout:0/125: symlink d0/d1d/l2a 0 2024-02-28T23:07:20.306 INFO:tasks.workunit.client.0.smithi159.stdout:4/634: chown d9/d4c/d6c/d98/la1 28 1 2024-02-28T23:07:20.307 INFO:tasks.workunit.client.0.smithi159.stdout:3/500: fdatasync d0/d2b/d55/f8a 0 2024-02-28T23:07:20.308 INFO:tasks.workunit.client.1.smithi184.stdout:6/96: creat dc/de/d10/f21 x:0 0 0 2024-02-28T23:07:20.308 INFO:tasks.workunit.client.0.smithi159.stdout:4/635: chown d9/f19 1292039529 1 2024-02-28T23:07:20.309 INFO:tasks.workunit.client.1.smithi184.stdout:8/115: mkdir d1/da/d33 0 2024-02-28T23:07:20.311 INFO:tasks.workunit.client.1.smithi184.stdout:8/116: dread - d1/da/df/d20/f30 zero size 2024-02-28T23:07:20.312 INFO:tasks.workunit.client.1.smithi184.stdout:1/175: symlink d20/d32/l38 0 2024-02-28T23:07:20.314 INFO:tasks.workunit.client.0.smithi159.stdout:7/420: write d5/d16/d1a/d24/f3a [294136,130953] 0 2024-02-28T23:07:20.317 INFO:tasks.workunit.client.0.smithi159.stdout:7/421: dread - d5/d10/f85 zero size 2024-02-28T23:07:20.317 INFO:tasks.workunit.client.0.smithi159.stdout:3/501: write d0/d2b/d55/d75/d6d/f66 [2659481,126215] 0 2024-02-28T23:07:20.317 INFO:tasks.workunit.client.1.smithi184.stdout:9/107: creat d5/f24 x:0 0 0 2024-02-28T23:07:20.317 INFO:tasks.workunit.client.1.smithi184.stdout:5/97: mkdir db/d12/d1c/d21/d25 0 2024-02-28T23:07:20.319 INFO:tasks.workunit.client.0.smithi159.stdout:0/670: mknod d0/d5/d14/d25/cf0 0 2024-02-28T23:07:20.320 INFO:tasks.workunit.client.1.smithi184.stdout:0/126: dwrite d0/df/d13/f14 [0,4194304] 0 2024-02-28T23:07:20.322 INFO:tasks.workunit.client.0.smithi159.stdout:4/636: creat d9/d42/d54/d55/da8/fdf x:0 0 0 2024-02-28T23:07:20.323 INFO:tasks.workunit.client.1.smithi184.stdout:3/106: mkdir d1/d4/d6/d1e 0 2024-02-28T23:07:20.323 INFO:tasks.workunit.client.1.smithi184.stdout:2/107: symlink d10/d1f/l26 0 2024-02-28T23:07:20.325 INFO:tasks.workunit.client.1.smithi184.stdout:6/97: unlink dc/de/ff 0 2024-02-28T23:07:20.326 INFO:tasks.workunit.client.1.smithi184.stdout:2/108: write fb [2844851,45339] 0 2024-02-28T23:07:20.326 INFO:tasks.workunit.client.1.smithi184.stdout:6/98: chown f3 177707172 1 2024-02-28T23:07:20.327 INFO:tasks.workunit.client.0.smithi159.stdout:2/482: dread f6 [0,4194304] 0 2024-02-28T23:07:20.327 INFO:tasks.workunit.client.1.smithi184.stdout:8/117: symlink d1/da/dc/d18/l34 0 2024-02-28T23:07:20.329 INFO:tasks.workunit.client.0.smithi159.stdout:7/422: mknod d5/d56/d50/d5b/c86 0 2024-02-28T23:07:20.330 INFO:tasks.workunit.client.0.smithi159.stdout:1/537: creat d6/d1d/d1f/d3e/fb5 x:0 0 0 2024-02-28T23:07:20.331 INFO:tasks.workunit.client.1.smithi184.stdout:5/98: mknod db/d1f/c26 0 2024-02-28T23:07:20.333 INFO:tasks.workunit.client.1.smithi184.stdout:1/176: dwrite d20/f22 [0,4194304] 0 2024-02-28T23:07:20.334 INFO:tasks.workunit.client.0.smithi159.stdout:2/483: truncate d9/d50/d54/d84/d37/d5c/f7b 1411516 0 2024-02-28T23:07:20.340 INFO:tasks.workunit.client.0.smithi159.stdout:4/637: rmdir d9/da/d1c/d23/d2d 39 2024-02-28T23:07:20.342 INFO:tasks.workunit.client.1.smithi184.stdout:3/107: mkdir d1/d4/d6/d1f 0 2024-02-28T23:07:20.343 INFO:tasks.workunit.client.0.smithi159.stdout:1/538: mkdir d6/d12/d16/db6 0 2024-02-28T23:07:20.346 INFO:tasks.workunit.client.0.smithi159.stdout:8/658: sync 2024-02-28T23:07:20.349 INFO:tasks.workunit.client.0.smithi159.stdout:7/423: dread - d5/d16/d1a/d27/d37/f42 zero size 2024-02-28T23:07:20.349 INFO:tasks.workunit.client.0.smithi159.stdout:3/502: dwrite d0/d6/d3e/f4a [4194304,4194304] 0 2024-02-28T23:07:20.350 INFO:tasks.workunit.client.1.smithi184.stdout:2/109: dwrite d10/f11 [0,4194304] 0 2024-02-28T23:07:20.351 INFO:tasks.workunit.client.1.smithi184.stdout:8/118: dwrite d1/da/df/f28 [0,4194304] 0 2024-02-28T23:07:20.352 INFO:tasks.workunit.client.0.smithi159.stdout:3/503: read d0/f4c [401869,81213] 0 2024-02-28T23:07:20.357 INFO:tasks.workunit.client.0.smithi159.stdout:2/484: creat d9/d50/d54/d84/fa8 x:0 0 0 2024-02-28T23:07:20.358 INFO:tasks.workunit.client.1.smithi184.stdout:5/99: creat db/d1f/f27 x:0 0 0 2024-02-28T23:07:20.364 INFO:tasks.workunit.client.0.smithi159.stdout:1/539: unlink d6/d12/d1a/d92/c9b 0 2024-02-28T23:07:20.365 INFO:tasks.workunit.client.0.smithi159.stdout:1/540: dread - d6/d12/f9a zero size 2024-02-28T23:07:20.366 INFO:tasks.workunit.client.1.smithi184.stdout:4/91: sync 2024-02-28T23:07:20.366 INFO:tasks.workunit.client.1.smithi184.stdout:7/98: sync 2024-02-28T23:07:20.369 INFO:tasks.workunit.client.1.smithi184.stdout:0/127: dwrite d0/fe [0,4194304] 0 2024-02-28T23:07:20.374 INFO:tasks.workunit.client.1.smithi184.stdout:0/128: truncate d0/df/d13/f1a 485638 0 2024-02-28T23:07:20.376 INFO:tasks.workunit.client.1.smithi184.stdout:8/119: mknod d1/da/dc/d18/c35 0 2024-02-28T23:07:20.378 INFO:tasks.workunit.client.1.smithi184.stdout:0/129: truncate d0/df/f15 2348368 0 2024-02-28T23:07:20.380 INFO:tasks.workunit.client.1.smithi184.stdout:6/99: mknod dc/c22 0 2024-02-28T23:07:20.384 INFO:tasks.workunit.client.1.smithi184.stdout:0/130: dread d0/df/d13/f1a [0,4194304] 0 2024-02-28T23:07:20.385 INFO:tasks.workunit.client.1.smithi184.stdout:4/92: dwrite d1/f10 [0,4194304] 0 2024-02-28T23:07:20.386 INFO:tasks.workunit.client.1.smithi184.stdout:0/131: stat d0/df/d13/c22 0 2024-02-28T23:07:20.389 INFO:tasks.workunit.client.0.smithi159.stdout:0/671: link d0/d5/d14/d25/c48 d0/de/d75/db8/cf1 0 2024-02-28T23:07:20.392 INFO:tasks.workunit.client.0.smithi159.stdout:7/424: write d5/d16/f1f [1942642,105312] 0 2024-02-28T23:07:20.400 INFO:tasks.workunit.client.0.smithi159.stdout:0/672: dread - d0/d5/d14/d25/d2c/dab/dc5/fc9 zero size 2024-02-28T23:07:20.400 INFO:tasks.workunit.client.0.smithi159.stdout:1/541: rename d6/d1d/c29 to d6/d12/d16/db6/cb7 0 2024-02-28T23:07:20.406 INFO:tasks.workunit.client.0.smithi159.stdout:4/638: getdents d9/d42/d54/d9c 0 2024-02-28T23:07:20.407 INFO:tasks.workunit.client.0.smithi159.stdout:4/639: fsync d9/d20/d87/fd4 0 2024-02-28T23:07:20.409 INFO:tasks.workunit.client.0.smithi159.stdout:0/673: rmdir d0/d5/d38 39 2024-02-28T23:07:20.412 INFO:tasks.workunit.client.0.smithi159.stdout:1/542: mkdir d6/d1d/d1f/db8 0 2024-02-28T23:07:20.421 INFO:tasks.workunit.client.0.smithi159.stdout:4/640: truncate d9/f18 1193242 0 2024-02-28T23:07:20.421 INFO:tasks.workunit.client.0.smithi159.stdout:0/674: creat d0/d5/d14/d25/d2c/dab/ff2 x:0 0 0 2024-02-28T23:07:20.422 INFO:tasks.workunit.client.1.smithi184.stdout:3/108: link d1/d4/d6/cd d1/d4/d6/d1f/c20 0 2024-02-28T23:07:20.423 INFO:tasks.workunit.client.0.smithi159.stdout:4/641: chown d9/d42/lb5 149140 1 2024-02-28T23:07:20.424 INFO:tasks.workunit.client.0.smithi159.stdout:8/659: write d2/d11/d35/d5f/f92 [76500,117325] 0 2024-02-28T23:07:20.425 INFO:tasks.workunit.client.0.smithi159.stdout:1/543: chown d6/d12/d33/da7/lb0 1962624346 1 2024-02-28T23:07:20.427 INFO:tasks.workunit.client.0.smithi159.stdout:8/660: fsync d2/d11/d74/fbf 0 2024-02-28T23:07:20.427 INFO:tasks.workunit.client.1.smithi184.stdout:3/109: chown d1/d4/fb 1264983417 1 2024-02-28T23:07:20.427 INFO:tasks.workunit.client.1.smithi184.stdout:1/177: getdents d20 0 2024-02-28T23:07:20.428 INFO:tasks.workunit.client.0.smithi159.stdout:1/544: fsync d6/d12/d33/d3c/f6c 0 2024-02-28T23:07:20.430 INFO:tasks.workunit.client.1.smithi184.stdout:1/178: read d20/f25 [2555422,22166] 0 2024-02-28T23:07:20.431 INFO:tasks.workunit.client.0.smithi159.stdout:2/485: dread d9/d36/d59/f6b [0,4194304] 0 2024-02-28T23:07:20.431 INFO:tasks.workunit.client.0.smithi159.stdout:0/675: stat d0/d5/d14/d34/d6c/d94/cac 0 2024-02-28T23:07:20.431 INFO:tasks.workunit.client.1.smithi184.stdout:5/100: link db/c17 db/c28 0 2024-02-28T23:07:20.433 INFO:tasks.workunit.client.1.smithi184.stdout:6/100: dwrite dc/de/f1e [0,4194304] 0 2024-02-28T23:07:20.434 INFO:tasks.workunit.client.1.smithi184.stdout:5/101: chown l4 477 1 2024-02-28T23:07:20.435 INFO:tasks.workunit.client.0.smithi159.stdout:4/642: mknod d9/d4c/d6c/d98/ce0 0 2024-02-28T23:07:20.436 INFO:tasks.workunit.client.1.smithi184.stdout:2/110: dwrite f8 [0,4194304] 0 2024-02-28T23:07:20.436 INFO:tasks.workunit.client.1.smithi184.stdout:4/93: dread d1/dc/fd [0,4194304] 0 2024-02-28T23:07:20.439 INFO:tasks.workunit.client.1.smithi184.stdout:2/111: chown ff 931725 1 2024-02-28T23:07:20.439 INFO:tasks.workunit.client.1.smithi184.stdout:6/101: write dc/de/f15 [995863,102876] 0 2024-02-28T23:07:20.442 INFO:tasks.workunit.client.1.smithi184.stdout:7/99: dwrite d6/f8 [0,4194304] 0 2024-02-28T23:07:20.443 INFO:tasks.workunit.client.1.smithi184.stdout:2/112: rename d10/d13/d15 to d10/d13/d15/d24/d27 22 2024-02-28T23:07:20.446 INFO:tasks.workunit.client.1.smithi184.stdout:0/132: truncate d0/fc 1318444 0 2024-02-28T23:07:20.448 INFO:tasks.workunit.client.1.smithi184.stdout:1/179: mknod d20/c39 0 2024-02-28T23:07:20.450 INFO:tasks.workunit.client.0.smithi159.stdout:7/425: dwrite d5/f7a [0,4194304] 0 2024-02-28T23:07:20.451 INFO:tasks.workunit.client.1.smithi184.stdout:9/108: sync 2024-02-28T23:07:20.454 INFO:tasks.workunit.client.1.smithi184.stdout:9/109: write d5/f24 [383797,113379] 0 2024-02-28T23:07:20.457 INFO:tasks.workunit.client.0.smithi159.stdout:2/486: mkdir d9/d23/da9 0 2024-02-28T23:07:20.459 INFO:tasks.workunit.client.1.smithi184.stdout:5/102: dread db/d12/d18/f20 [0,4194304] 0 2024-02-28T23:07:20.459 INFO:tasks.workunit.client.1.smithi184.stdout:9/110: write d5/f13 [3555061,4128] 0 2024-02-28T23:07:20.464 INFO:tasks.workunit.client.1.smithi184.stdout:6/102: dwrite dc/de/d10/f1b [0,4194304] 0 2024-02-28T23:07:20.465 INFO:tasks.workunit.client.0.smithi159.stdout:0/676: symlink d0/d5/d14/d25/d2c/dab/dc5/lf3 0 2024-02-28T23:07:20.467 INFO:tasks.workunit.client.0.smithi159.stdout:0/677: chown d0/d5/d14/d25/d2c/dab/dc5 14 1 2024-02-28T23:07:20.468 INFO:tasks.workunit.client.1.smithi184.stdout:6/103: dread - dc/f14 zero size 2024-02-28T23:07:20.469 INFO:tasks.workunit.client.0.smithi159.stdout:0/678: stat d0/de/d46/f61 0 2024-02-28T23:07:20.471 INFO:tasks.workunit.client.1.smithi184.stdout:4/94: rename d1/d8/l9 to d1/d8/l17 0 2024-02-28T23:07:20.476 INFO:tasks.workunit.client.1.smithi184.stdout:8/120: sync 2024-02-28T23:07:20.480 INFO:tasks.workunit.client.1.smithi184.stdout:8/121: dread - d1/da/df/f1f zero size 2024-02-28T23:07:20.481 INFO:tasks.workunit.client.1.smithi184.stdout:6/104: dread f8 [0,4194304] 0 2024-02-28T23:07:20.482 INFO:tasks.workunit.client.1.smithi184.stdout:8/122: readlink d1/l3 0 2024-02-28T23:07:20.483 INFO:tasks.workunit.client.1.smithi184.stdout:7/100: creat d6/d9/d13/f28 x:0 0 0 2024-02-28T23:07:20.484 INFO:tasks.workunit.client.1.smithi184.stdout:6/105: fsync dc/de/d10/f19 0 2024-02-28T23:07:20.484 INFO:tasks.workunit.client.1.smithi184.stdout:3/110: getdents d1/d4/d1c 0 2024-02-28T23:07:20.485 INFO:tasks.workunit.client.1.smithi184.stdout:6/106: dread - dc/f14 zero size 2024-02-28T23:07:20.486 INFO:tasks.workunit.client.1.smithi184.stdout:7/101: chown d6/d9/da/dc/lf 5 1 2024-02-28T23:07:20.490 INFO:tasks.workunit.client.0.smithi159.stdout:7/426: mknod d5/d10/d60/c87 0 2024-02-28T23:07:20.492 INFO:tasks.workunit.client.1.smithi184.stdout:1/180: read f19 [5023462,90399] 0 2024-02-28T23:07:20.493 INFO:tasks.workunit.client.0.smithi159.stdout:8/661: dread d2/d3/f1d [0,4194304] 0 2024-02-28T23:07:20.494 INFO:tasks.workunit.client.1.smithi184.stdout:3/111: dread d1/d4/f14 [0,4194304] 0 2024-02-28T23:07:20.494 INFO:tasks.workunit.client.0.smithi159.stdout:2/487: fsync d9/d23/d2c/d55/d13/d4f/f52 0 2024-02-28T23:07:20.496 INFO:tasks.workunit.client.0.smithi159.stdout:8/662: truncate d2/d3/f17 5187801 0 2024-02-28T23:07:20.497 INFO:tasks.workunit.client.0.smithi159.stdout:0/679: creat d0/de/ff4 x:0 0 0 2024-02-28T23:07:20.500 INFO:tasks.workunit.client.1.smithi184.stdout:8/123: dwrite d1/da/dc/d16/f1b [0,4194304] 0 2024-02-28T23:07:20.501 INFO:tasks.workunit.client.1.smithi184.stdout:0/133: dread d0/d1d/f1e [0,4194304] 0 2024-02-28T23:07:20.503 INFO:tasks.workunit.client.0.smithi159.stdout:1/545: truncate d6/f62 875178 0 2024-02-28T23:07:20.506 INFO:tasks.workunit.client.0.smithi159.stdout:7/427: stat d5/d56/d2a/f4d 0 2024-02-28T23:07:20.507 INFO:tasks.workunit.client.1.smithi184.stdout:9/111: mknod d5/db/de/d10/d12/c25 0 2024-02-28T23:07:20.510 INFO:tasks.workunit.client.1.smithi184.stdout:2/113: dwrite fa [0,4194304] 0 2024-02-28T23:07:20.510 INFO:tasks.workunit.client.0.smithi159.stdout:0/680: mkdir d0/d5/d14/d34/d3d/df5 0 2024-02-28T23:07:20.517 INFO:tasks.workunit.client.0.smithi159.stdout:4/643: getdents d9/d42/dc8 0 2024-02-28T23:07:20.519 INFO:tasks.workunit.client.0.smithi159.stdout:2/488: link d9/f11 d9/d50/faa 0 2024-02-28T23:07:20.525 INFO:tasks.workunit.client.1.smithi184.stdout:2/114: dwrite d10/f1d [0,4194304] 0 2024-02-28T23:07:20.527 INFO:tasks.workunit.client.0.smithi159.stdout:7/428: mkdir d5/d56/d50/d88 0 2024-02-28T23:07:20.528 INFO:tasks.workunit.client.1.smithi184.stdout:3/112: rmdir d1/d4 39 2024-02-28T23:07:20.533 INFO:tasks.workunit.client.0.smithi159.stdout:8/663: dread d2/d11/d52/f62 [0,4194304] 0 2024-02-28T23:07:20.534 INFO:tasks.workunit.client.0.smithi159.stdout:2/489: rename d9/d23/d2c/d55/ff to d9/d23/da9/fab 0 2024-02-28T23:07:20.535 INFO:tasks.workunit.client.0.smithi159.stdout:1/546: dwrite d6/d12/f9a [0,4194304] 0 2024-02-28T23:07:20.536 INFO:tasks.workunit.client.0.smithi159.stdout:2/490: chown d9/d23/d2c 216 1 2024-02-28T23:07:20.540 INFO:tasks.workunit.client.1.smithi184.stdout:0/134: rmdir d0/df 39 2024-02-28T23:07:20.544 INFO:tasks.workunit.client.1.smithi184.stdout:5/103: symlink db/d12/d1c/d21/d25/l29 0 2024-02-28T23:07:20.545 INFO:tasks.workunit.client.0.smithi159.stdout:1/547: write d6/d1d/d1f/fa8 [452312,24602] 0 2024-02-28T23:07:20.546 INFO:tasks.workunit.client.0.smithi159.stdout:7/429: dread d5/d16/d1a/d27/d3e/f4a [0,4194304] 0 2024-02-28T23:07:20.548 INFO:tasks.workunit.client.0.smithi159.stdout:7/430: read - d5/d10/f85 zero size 2024-02-28T23:07:20.548 INFO:tasks.workunit.client.0.smithi159.stdout:2/491: rename d9/c5e to d9/d50/cac 0 2024-02-28T23:07:20.549 INFO:tasks.workunit.client.1.smithi184.stdout:4/95: symlink d1/l18 0 2024-02-28T23:07:20.549 INFO:tasks.workunit.client.1.smithi184.stdout:1/181: dwrite d20/f36 [0,4194304] 0 2024-02-28T23:07:20.552 INFO:tasks.workunit.client.0.smithi159.stdout:8/664: creat d2/d73/dc2/fd4 x:0 0 0 2024-02-28T23:07:20.552 INFO:tasks.workunit.client.0.smithi159.stdout:1/548: chown d6/d12/d33/da7/lb0 56475 1 2024-02-28T23:07:20.556 INFO:tasks.workunit.client.0.smithi159.stdout:8/665: write d2/d73/dc2/fd4 [464730,63550] 0 2024-02-28T23:07:20.557 INFO:tasks.workunit.client.0.smithi159.stdout:1/549: dread - d6/d1d/d1f/d3e/fb5 zero size 2024-02-28T23:07:20.561 INFO:tasks.workunit.client.0.smithi159.stdout:7/431: mknod d5/d16/d1a/d27/d75/c89 0 2024-02-28T23:07:20.567 INFO:tasks.workunit.client.0.smithi159.stdout:2/492: dread d9/d36/f3f [0,4194304] 0 2024-02-28T23:07:20.573 INFO:tasks.workunit.client.0.smithi159.stdout:6/525: sync 2024-02-28T23:07:20.575 INFO:tasks.workunit.client.0.smithi159.stdout:4/644: dread d9/fa2 [0,4194304] 0 2024-02-28T23:07:20.578 INFO:tasks.workunit.client.0.smithi159.stdout:7/432: creat d5/d16/d1a/d27/d46/d65/d81/d83/f8a x:0 0 0 2024-02-28T23:07:20.579 INFO:tasks.workunit.client.1.smithi184.stdout:6/107: link dc/de/f1e dc/de/d10/f23 0 2024-02-28T23:07:20.580 INFO:tasks.workunit.client.0.smithi159.stdout:7/433: readlink d5/d16/d1a/d27/d46/l54 0 2024-02-28T23:07:20.580 INFO:tasks.workunit.client.1.smithi184.stdout:8/124: symlink d1/da/dc/d16/d32/l36 0 2024-02-28T23:07:20.582 INFO:tasks.workunit.client.1.smithi184.stdout:6/108: chown dc/c1d 500 1 2024-02-28T23:07:20.582 INFO:tasks.workunit.client.0.smithi159.stdout:6/526: mkdir d0/d1b/d33/d5e/dac 0 2024-02-28T23:07:20.586 INFO:tasks.workunit.client.1.smithi184.stdout:3/113: fsync d1/d4/fb 0 2024-02-28T23:07:20.587 INFO:tasks.workunit.client.1.smithi184.stdout:2/115: dread ff [0,4194304] 0 2024-02-28T23:07:20.588 INFO:tasks.workunit.client.0.smithi159.stdout:4/645: unlink d9/da/d1c/d23/f94 0 2024-02-28T23:07:20.589 INFO:tasks.workunit.client.1.smithi184.stdout:4/96: dwrite d1/dc/df/f16 [0,4194304] 0 2024-02-28T23:07:20.590 INFO:tasks.workunit.client.1.smithi184.stdout:9/112: rename d5/db/de/d10/d12/d1a to d5/d26 0 2024-02-28T23:07:20.590 INFO:tasks.workunit.client.0.smithi159.stdout:8/666: dwrite d2/ff [0,4194304] 0 2024-02-28T23:07:20.593 INFO:tasks.workunit.client.1.smithi184.stdout:6/109: creat dc/de/d10/f24 x:0 0 0 2024-02-28T23:07:20.594 INFO:tasks.workunit.client.0.smithi159.stdout:2/493: link d9/d23/d2c/d55/d13/d4f/f52 d9/d36/d59/fad 0 2024-02-28T23:07:20.596 INFO:tasks.workunit.client.1.smithi184.stdout:9/113: chown d5/f24 3 1 2024-02-28T23:07:20.600 INFO:tasks.workunit.client.0.smithi159.stdout:4/646: fdatasync d9/d20/f84 0 2024-02-28T23:07:20.600 INFO:tasks.workunit.client.0.smithi159.stdout:2/494: write d9/d80/f8a [160473,32656] 0 2024-02-28T23:07:20.602 INFO:tasks.workunit.client.0.smithi159.stdout:6/527: rename d0/d1b/d33/d11/c93 to d0/cad 0 2024-02-28T23:07:20.603 INFO:tasks.workunit.client.1.smithi184.stdout:5/104: rename db/d12/d18/f1b to db/d12/d1c/d21/f2a 0 2024-02-28T23:07:20.604 INFO:tasks.workunit.client.0.smithi159.stdout:8/667: symlink d2/d11/d35/ld5 0 2024-02-28T23:07:20.605 INFO:tasks.workunit.client.1.smithi184.stdout:4/97: mkdir d1/d8/d19 0 2024-02-28T23:07:20.609 INFO:tasks.workunit.client.1.smithi184.stdout:1/182: dread ff [0,4194304] 0 2024-02-28T23:07:20.610 INFO:tasks.workunit.client.1.smithi184.stdout:5/105: stat db/d12/d18 0 2024-02-28T23:07:20.611 INFO:tasks.workunit.client.0.smithi159.stdout:6/528: mknod d0/d1b/d33/d11/d34/d9d/da2/d96/cae 0 2024-02-28T23:07:20.612 INFO:tasks.workunit.client.1.smithi184.stdout:7/102: sync 2024-02-28T23:07:20.612 INFO:tasks.workunit.client.1.smithi184.stdout:2/116: dread ff [0,4194304] 0 2024-02-28T23:07:20.616 INFO:tasks.workunit.client.1.smithi184.stdout:3/114: dwrite d1/d4/fb [4194304,4194304] 0 2024-02-28T23:07:20.617 INFO:tasks.workunit.client.0.smithi159.stdout:4/647: mkdir d9/da/d1c/d23/d2d/de1 0 2024-02-28T23:07:20.619 INFO:tasks.workunit.client.1.smithi184.stdout:8/125: dwrite d1/da/dc/d16/d29/f2a [0,4194304] 0 2024-02-28T23:07:20.619 INFO:tasks.workunit.client.0.smithi159.stdout:8/668: unlink d2/d11/d74/cb2 0 2024-02-28T23:07:20.621 INFO:tasks.workunit.client.0.smithi159.stdout:4/648: write d9/da/d1c/d23/d2d/f83 [242035,571] 0 2024-02-28T23:07:20.621 INFO:tasks.workunit.client.0.smithi159.stdout:7/434: truncate d5/f7a 522294 0 2024-02-28T23:07:20.623 INFO:tasks.workunit.client.0.smithi159.stdout:2/495: dread d9/f35 [0,4194304] 0 2024-02-28T23:07:20.624 INFO:tasks.workunit.client.1.smithi184.stdout:6/110: dread dc/fd [4194304,4194304] 0 2024-02-28T23:07:20.625 INFO:tasks.workunit.client.1.smithi184.stdout:4/98: creat d1/d8/d19/f1a x:0 0 0 2024-02-28T23:07:20.627 INFO:tasks.workunit.client.1.smithi184.stdout:7/103: symlink d6/d9/da/l29 0 2024-02-28T23:07:20.628 INFO:tasks.workunit.client.0.smithi159.stdout:6/529: chown d0/d1b/d33/d11/d34/d9d/da2/d4d/c51 15798 1 2024-02-28T23:07:20.632 INFO:tasks.workunit.client.0.smithi159.stdout:6/530: chown d0/d1b/d33/d11/d34/c48 0 1 2024-02-28T23:07:20.633 INFO:tasks.workunit.client.1.smithi184.stdout:7/104: write d6/d9/d13/f28 [179666,18045] 0 2024-02-28T23:07:20.635 INFO:tasks.workunit.client.1.smithi184.stdout:9/114: dwrite d5/f7 [0,4194304] 0 2024-02-28T23:07:20.636 INFO:tasks.workunit.client.1.smithi184.stdout:9/115: stat c1 0 2024-02-28T23:07:20.636 INFO:tasks.workunit.client.1.smithi184.stdout:1/183: rename d20/f36 to d20/f3a 0 2024-02-28T23:07:20.638 INFO:tasks.workunit.client.1.smithi184.stdout:5/106: dread f7 [0,4194304] 0 2024-02-28T23:07:20.638 INFO:tasks.workunit.client.0.smithi159.stdout:6/531: write d0/d1b/d33/d11/d14/d49/f60 [851784,106611] 0 2024-02-28T23:07:20.640 INFO:tasks.workunit.client.0.smithi159.stdout:4/649: truncate d9/d42/d54/d55/f6a 1277767 0 2024-02-28T23:07:20.641 INFO:tasks.workunit.client.1.smithi184.stdout:8/126: symlink d1/l37 0 2024-02-28T23:07:20.641 INFO:tasks.workunit.client.1.smithi184.stdout:6/111: symlink dc/de/d10/l25 0 2024-02-28T23:07:20.643 INFO:tasks.workunit.client.0.smithi159.stdout:7/435: mknod d5/d16/d1a/d27/d46/d65/c8b 0 2024-02-28T23:07:20.645 INFO:tasks.workunit.client.0.smithi159.stdout:4/650: truncate d9/da/d1c/d8e/fcb 492002 0 2024-02-28T23:07:20.649 INFO:tasks.workunit.client.1.smithi184.stdout:4/99: creat d1/d8/f1b x:0 0 0 2024-02-28T23:07:20.651 INFO:tasks.workunit.client.1.smithi184.stdout:7/105: creat d6/d9/d13/d14/f2a x:0 0 0 2024-02-28T23:07:20.655 INFO:tasks.workunit.client.1.smithi184.stdout:9/116: dwrite d5/f7 [0,4194304] 0 2024-02-28T23:07:20.655 INFO:tasks.workunit.client.1.smithi184.stdout:1/184: mknod d20/d32/c3b 0 2024-02-28T23:07:20.668 INFO:tasks.workunit.client.1.smithi184.stdout:4/100: symlink d1/dc/l1c 0 2024-02-28T23:07:20.668 INFO:tasks.workunit.client.1.smithi184.stdout:0/135: sync 2024-02-28T23:07:20.670 INFO:tasks.workunit.client.0.smithi159.stdout:8/669: dwrite d2/d3/f13 [4194304,4194304] 0 2024-02-28T23:07:20.671 INFO:tasks.workunit.client.1.smithi184.stdout:8/127: dwrite d1/da/df/f1f [0,4194304] 0 2024-02-28T23:07:20.672 INFO:tasks.workunit.client.1.smithi184.stdout:3/115: creat d1/f21 x:0 0 0 2024-02-28T23:07:20.674 INFO:tasks.workunit.client.0.smithi159.stdout:2/496: write f6 [1713609,126458] 0 2024-02-28T23:07:20.684 INFO:tasks.workunit.client.0.smithi159.stdout:4/651: getdents d9/d42/d54 0 2024-02-28T23:07:20.686 INFO:tasks.workunit.client.1.smithi184.stdout:2/117: getdents d10/d1f 0 2024-02-28T23:07:20.686 INFO:tasks.workunit.client.1.smithi184.stdout:7/106: dread f0 [0,4194304] 0 2024-02-28T23:07:20.691 INFO:tasks.workunit.client.0.smithi159.stdout:4/652: write d9/d4c/d6c/d98/fb6 [688698,114278] 0 2024-02-28T23:07:20.693 INFO:tasks.workunit.client.0.smithi159.stdout:6/532: truncate d0/f7 4294682 0 2024-02-28T23:07:20.694 INFO:tasks.workunit.client.1.smithi184.stdout:2/118: write d10/d13/f1a [632007,104508] 0 2024-02-28T23:07:20.694 INFO:tasks.workunit.client.0.smithi159.stdout:7/436: write d5/d16/d1a/f3c [1263034,10371] 0 2024-02-28T23:07:20.695 INFO:tasks.workunit.client.0.smithi159.stdout:4/653: chown d9/d4c/fae 1165964 1 2024-02-28T23:07:20.696 INFO:tasks.workunit.client.1.smithi184.stdout:7/107: dread - d6/d9/da/dc/f27 zero size 2024-02-28T23:07:20.697 INFO:tasks.workunit.client.0.smithi159.stdout:8/670: creat d2/d11/d52/d26/d36/d38/d77/d9e/dc1/dc4/fd6 x:0 0 0 2024-02-28T23:07:20.698 INFO:tasks.workunit.client.1.smithi184.stdout:9/117: dwrite d5/fc [4194304,4194304] 0 2024-02-28T23:07:20.700 INFO:tasks.workunit.client.1.smithi184.stdout:4/101: write d1/dc/fd [6117855,113847] 0 2024-02-28T23:07:20.703 INFO:tasks.workunit.client.1.smithi184.stdout:8/128: creat d1/da/dc/d18/f38 x:0 0 0 2024-02-28T23:07:20.704 INFO:tasks.workunit.client.0.smithi159.stdout:4/654: creat d9/d4c/d6c/d98/fe2 x:0 0 0 2024-02-28T23:07:20.704 INFO:tasks.workunit.client.0.smithi159.stdout:7/437: creat d5/d56/d50/f8c x:0 0 0 2024-02-28T23:07:20.704 INFO:tasks.workunit.client.1.smithi184.stdout:9/118: dread - d5/db/de/d10/f18 zero size 2024-02-28T23:07:20.706 INFO:tasks.workunit.client.1.smithi184.stdout:5/107: dwrite db/d12/d18/f1a [0,4194304] 0 2024-02-28T23:07:20.706 INFO:tasks.workunit.client.1.smithi184.stdout:6/112: creat dc/f26 x:0 0 0 2024-02-28T23:07:20.707 INFO:tasks.workunit.client.0.smithi159.stdout:6/533: rename d0/d1b/d33/d11/d14/d49/l85 to d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/laf 0 2024-02-28T23:07:20.712 INFO:tasks.workunit.client.0.smithi159.stdout:6/534: stat d0/d1b/d33/d11/d34/d9d/da2/d4e/d86 0 2024-02-28T23:07:20.712 INFO:tasks.workunit.client.1.smithi184.stdout:8/129: chown d1/da/df/d20 106037 1 2024-02-28T23:07:20.713 INFO:tasks.workunit.client.1.smithi184.stdout:2/119: symlink d10/d1f/l28 0 2024-02-28T23:07:20.714 INFO:tasks.workunit.client.0.smithi159.stdout:7/438: truncate d5/d56/d50/d5b/f7b 5198378 0 2024-02-28T23:07:20.714 INFO:tasks.workunit.client.1.smithi184.stdout:7/108: creat d6/d9/da/dc/f2b x:0 0 0 2024-02-28T23:07:20.715 INFO:tasks.workunit.client.1.smithi184.stdout:5/108: write db/d12/d18/f1a [4577601,62540] 0 2024-02-28T23:07:20.716 INFO:tasks.workunit.client.1.smithi184.stdout:1/185: link l10 d20/l3c 0 2024-02-28T23:07:20.716 INFO:tasks.workunit.client.1.smithi184.stdout:3/116: dwrite d1/f21 [0,4194304] 0 2024-02-28T23:07:20.717 INFO:tasks.workunit.client.1.smithi184.stdout:0/136: mkdir d0/df/d13/d27/d2b 0 2024-02-28T23:07:20.719 INFO:tasks.workunit.client.1.smithi184.stdout:1/186: chown d20/d32 58434140 1 2024-02-28T23:07:20.721 INFO:tasks.workunit.client.1.smithi184.stdout:6/113: mknod dc/de/d10/d16/c27 0 2024-02-28T23:07:20.721 INFO:tasks.workunit.client.1.smithi184.stdout:8/130: write d1/da/f31 [627705,14888] 0 2024-02-28T23:07:20.722 INFO:tasks.workunit.client.0.smithi159.stdout:8/671: dwrite d2/d11/d74/fd0 [0,4194304] 0 2024-02-28T23:07:20.724 INFO:tasks.workunit.client.1.smithi184.stdout:0/137: write d0/fe [2464064,100139] 0 2024-02-28T23:07:20.725 INFO:tasks.workunit.client.1.smithi184.stdout:1/187: write d20/f2d [132200,120210] 0 2024-02-28T23:07:20.726 INFO:tasks.workunit.client.0.smithi159.stdout:7/439: rename d5/d16/d40/f74 to d5/d16/d1a/d27/d46/f8d 0 2024-02-28T23:07:20.728 INFO:tasks.workunit.client.1.smithi184.stdout:3/117: chown d1/d4/d6/c11 22 1 2024-02-28T23:07:20.729 INFO:tasks.workunit.client.1.smithi184.stdout:6/114: chown dc/de/d10/l25 69 1 2024-02-28T23:07:20.729 INFO:tasks.workunit.client.1.smithi184.stdout:2/120: symlink d10/d1f/l29 0 2024-02-28T23:07:20.731 INFO:tasks.workunit.client.1.smithi184.stdout:7/109: mknod d6/d9/d13/d1e/c2c 0 2024-02-28T23:07:20.735 INFO:tasks.workunit.client.0.smithi159.stdout:8/672: unlink d2/d11/d52/d26/d36/d38/f49 0 2024-02-28T23:07:20.735 INFO:tasks.workunit.client.1.smithi184.stdout:4/102: dread d1/f10 [0,4194304] 0 2024-02-28T23:07:20.736 INFO:tasks.workunit.client.1.smithi184.stdout:5/109: creat db/d12/d1c/f2b x:0 0 0 2024-02-28T23:07:20.737 INFO:tasks.workunit.client.1.smithi184.stdout:7/110: dread d6/d9/da/dc/f12 [0,4194304] 0 2024-02-28T23:07:20.737 INFO:tasks.workunit.client.1.smithi184.stdout:9/119: dwrite d5/db/de/d10/f1c [0,4194304] 0 2024-02-28T23:07:20.737 INFO:tasks.workunit.client.1.smithi184.stdout:1/188: rmdir d20 39 2024-02-28T23:07:20.738 INFO:tasks.workunit.client.1.smithi184.stdout:5/110: truncate db/d1f/f27 745560 0 2024-02-28T23:07:20.740 INFO:tasks.workunit.client.0.smithi159.stdout:7/440: write d5/f12 [4787465,96219] 0 2024-02-28T23:07:20.746 INFO:tasks.workunit.client.1.smithi184.stdout:8/131: creat d1/da/dc/d16/d32/f39 x:0 0 0 2024-02-28T23:07:20.747 INFO:tasks.workunit.client.0.smithi159.stdout:6/535: link d0/d1b/l4b d0/d1b/d33/d11/d34/d9d/da2/d4e/lb0 0 2024-02-28T23:07:20.748 INFO:tasks.workunit.client.1.smithi184.stdout:8/132: fsync d1/da/dc/d16/d29/f2a 0 2024-02-28T23:07:20.749 INFO:tasks.workunit.client.0.smithi159.stdout:7/441: fdatasync d5/f1e 0 2024-02-28T23:07:20.753 INFO:tasks.workunit.client.1.smithi184.stdout:6/115: creat dc/de/d10/f28 x:0 0 0 2024-02-28T23:07:20.760 INFO:tasks.workunit.client.1.smithi184.stdout:2/121: rename ld to d10/d13/d15/l2a 0 2024-02-28T23:07:20.767 INFO:tasks.workunit.client.0.smithi159.stdout:9/571: sync 2024-02-28T23:07:20.773 INFO:tasks.workunit.client.1.smithi184.stdout:7/111: symlink d6/d9/d13/d14/l2d 0 2024-02-28T23:07:20.776 INFO:tasks.workunit.client.1.smithi184.stdout:9/120: creat d5/db/de/d10/d12/f27 x:0 0 0 2024-02-28T23:07:20.777 INFO:tasks.workunit.client.1.smithi184.stdout:9/121: chown d5/db/f14 10 1 2024-02-28T23:07:20.778 INFO:tasks.workunit.client.1.smithi184.stdout:5/111: truncate f7 1609167 0 2024-02-28T23:07:20.778 INFO:tasks.workunit.client.1.smithi184.stdout:9/122: chown d5/db/de/d10/f1c 1384 1 2024-02-28T23:07:20.782 INFO:tasks.workunit.client.0.smithi159.stdout:9/572: fsync d4/f30 0 2024-02-28T23:07:20.786 INFO:tasks.workunit.client.1.smithi184.stdout:7/112: dwrite d6/d9/da/dc/f20 [0,4194304] 0 2024-02-28T23:07:20.788 INFO:tasks.workunit.client.1.smithi184.stdout:7/113: write d6/d9/f26 [449163,120010] 0 2024-02-28T23:07:20.789 INFO:tasks.workunit.client.0.smithi159.stdout:7/442: dwrite d5/d56/f2f [0,4194304] 0 2024-02-28T23:07:20.798 INFO:tasks.workunit.client.0.smithi159.stdout:6/536: dread d0/d1b/d33/d11/d14/f28 [0,4194304] 0 2024-02-28T23:07:20.801 INFO:tasks.workunit.client.1.smithi184.stdout:4/103: symlink d1/l1d 0 2024-02-28T23:07:20.802 INFO:tasks.workunit.client.1.smithi184.stdout:3/118: write d1/d4/f14 [58139,87995] 0 2024-02-28T23:07:20.803 INFO:tasks.workunit.client.1.smithi184.stdout:6/116: rmdir dc/de 39 2024-02-28T23:07:20.805 INFO:tasks.workunit.client.1.smithi184.stdout:2/122: rmdir d10 39 2024-02-28T23:07:20.805 INFO:tasks.workunit.client.1.smithi184.stdout:3/119: write d1/f21 [199514,47738] 0 2024-02-28T23:07:20.808 INFO:tasks.workunit.client.1.smithi184.stdout:2/123: write f8 [4601032,20458] 0 2024-02-28T23:07:20.810 INFO:tasks.workunit.client.1.smithi184.stdout:1/189: mknod d20/d32/c3d 0 2024-02-28T23:07:20.811 INFO:tasks.workunit.client.1.smithi184.stdout:1/190: read - f1c zero size 2024-02-28T23:07:20.811 INFO:tasks.workunit.client.1.smithi184.stdout:0/138: dwrite d0/df/d13/f1a [0,4194304] 0 2024-02-28T23:07:20.815 INFO:tasks.workunit.client.0.smithi159.stdout:8/673: truncate d2/d11/d52/d26/d36/d38/f39 7379773 0 2024-02-28T23:07:20.816 INFO:tasks.workunit.client.0.smithi159.stdout:8/674: chown d2/d11/d52/d26/d36 22326 1 2024-02-28T23:07:20.819 INFO:tasks.workunit.client.0.smithi159.stdout:6/537: fdatasync d0/d1b/d33/f18 0 2024-02-28T23:07:20.821 INFO:tasks.workunit.client.1.smithi184.stdout:3/120: dwrite d1/d4/f14 [0,4194304] 0 2024-02-28T23:07:20.822 INFO:tasks.workunit.client.1.smithi184.stdout:9/123: creat d5/d17/f28 x:0 0 0 2024-02-28T23:07:20.832 INFO:tasks.workunit.client.1.smithi184.stdout:3/121: dread d1/d4/fb [4194304,4194304] 0 2024-02-28T23:07:20.832 INFO:tasks.workunit.client.0.smithi159.stdout:7/443: symlink d5/d16/l8e 0 2024-02-28T23:07:20.833 INFO:tasks.workunit.client.1.smithi184.stdout:7/114: creat d6/d9/d13/d14/f2e x:0 0 0 2024-02-28T23:07:20.836 INFO:tasks.workunit.client.0.smithi159.stdout:8/675: dwrite d2/d73/faf [0,4194304] 0 2024-02-28T23:07:20.838 INFO:tasks.workunit.client.1.smithi184.stdout:4/104: mknod d1/dc/df/c1e 0 2024-02-28T23:07:20.847 INFO:tasks.workunit.client.1.smithi184.stdout:4/105: dread d1/f10 [4194304,4194304] 0 2024-02-28T23:07:20.847 INFO:tasks.workunit.client.0.smithi159.stdout:6/538: rename d0/d1b/d33/d5e to d0/d1b/d33/d11/d34/d9d/da2/d52/db1 0 2024-02-28T23:07:20.848 INFO:tasks.workunit.client.1.smithi184.stdout:6/117: chown dc/de/d10/d16/c27 2897064 1 2024-02-28T23:07:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:20 smithi184 ceph-mon[36198]: pgmap v29: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 40 MiB/s rd, 183 MiB/s wr, 417 op/s 2024-02-28T23:07:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:20 smithi184 ceph-mon[36198]: Upgrade: Updating mgr.smithi159.pobewk 2024-02-28T23:07:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:20 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:20 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.pobewk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T23:07:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:20 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T23:07:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:20 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:07:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:20 smithi184 ceph-mon[36198]: Deploying daemon mgr.smithi159.pobewk on smithi159 2024-02-28T23:07:20.851 INFO:tasks.workunit.client.1.smithi184.stdout:7/115: dwrite d6/d9/da/dc/f2b [0,4194304] 0 2024-02-28T23:07:20.851 INFO:tasks.workunit.client.0.smithi159.stdout:9/573: link d4/d3d/d3e/d55/d37/c4b d4/d3d/d3e/d55/d37/cb2 0 2024-02-28T23:07:20.854 INFO:tasks.workunit.client.1.smithi184.stdout:7/116: read - d6/d9/d13/f1f zero size 2024-02-28T23:07:20.862 INFO:tasks.workunit.client.1.smithi184.stdout:2/124: fsync d10/d13/f1a 0 2024-02-28T23:07:20.864 INFO:tasks.workunit.client.1.smithi184.stdout:2/125: chown d10/d13/d15/l25 3635604 1 2024-02-28T23:07:20.865 INFO:tasks.workunit.client.1.smithi184.stdout:0/139: rmdir d0/d1d 39 2024-02-28T23:07:20.865 INFO:tasks.workunit.client.1.smithi184.stdout:0/140: chown d0/df/d13/d27 10373 1 2024-02-28T23:07:20.866 INFO:tasks.workunit.client.0.smithi159.stdout:8/676: dwrite d2/d11/d35/d9c/da0/fb9 [0,4194304] 0 2024-02-28T23:07:20.867 INFO:tasks.workunit.client.1.smithi184.stdout:1/191: mkdir d20/d32/d3e 0 2024-02-28T23:07:20.876 INFO:tasks.workunit.client.1.smithi184.stdout:9/124: mkdir d5/db/d29 0 2024-02-28T23:07:20.877 INFO:tasks.workunit.client.1.smithi184.stdout:8/133: creat d1/da/f3a x:0 0 0 2024-02-28T23:07:20.879 INFO:tasks.workunit.client.1.smithi184.stdout:9/125: write d5/db/de/f23 [164782,18415] 0 2024-02-28T23:07:20.879 INFO:tasks.workunit.client.0.smithi159.stdout:8/677: mkdir d2/d11/d52/d26/d36/d38/d77/d79/dd7 0 2024-02-28T23:07:20.880 INFO:tasks.workunit.client.1.smithi184.stdout:3/122: rename d1/d4/d6/c11 to d1/d4/d6/d1f/c22 0 2024-02-28T23:07:20.886 INFO:tasks.workunit.client.1.smithi184.stdout:4/106: creat d1/d4/f1f x:0 0 0 2024-02-28T23:07:20.887 INFO:tasks.workunit.client.1.smithi184.stdout:4/107: stat d1/dc 0 2024-02-28T23:07:20.888 INFO:tasks.workunit.client.0.smithi159.stdout:5/556: sync 2024-02-28T23:07:20.891 INFO:tasks.workunit.client.0.smithi159.stdout:6/539: getdents d0/d1b 0 2024-02-28T23:07:20.892 INFO:tasks.workunit.client.0.smithi159.stdout:5/557: read d8/f13 [1395986,11477] 0 2024-02-28T23:07:20.893 INFO:tasks.workunit.client.0.smithi159.stdout:9/574: getdents d4/d3d/d3e/d4a 0 2024-02-28T23:07:20.894 INFO:tasks.workunit.client.0.smithi159.stdout:8/678: symlink d2/d11/d52/d47/db6/dba/ld8 0 2024-02-28T23:07:20.896 INFO:tasks.workunit.client.1.smithi184.stdout:2/126: unlink fc 0 2024-02-28T23:07:20.898 INFO:tasks.workunit.client.1.smithi184.stdout:2/127: stat d10/d13/d15/f1b 0 2024-02-28T23:07:20.900 INFO:tasks.workunit.client.1.smithi184.stdout:2/128: write d10/d13/d15/d24/f22 [353980,40605] 0 2024-02-28T23:07:20.901 INFO:tasks.workunit.client.1.smithi184.stdout:0/141: creat d0/df/d13/d27/f2c x:0 0 0 2024-02-28T23:07:20.901 INFO:tasks.workunit.client.0.smithi159.stdout:7/444: dwrite d5/d16/d1a/d24/d64/f79 [0,4194304] 0 2024-02-28T23:07:20.906 INFO:tasks.workunit.client.1.smithi184.stdout:5/112: write f7 [1129694,19019] 0 2024-02-28T23:07:20.911 INFO:tasks.workunit.client.1.smithi184.stdout:9/126: creat d5/db/de/d10/f2a x:0 0 0 2024-02-28T23:07:20.913 INFO:tasks.workunit.client.0.smithi159.stdout:8/679: creat d2/d11/d52/d26/d36/d38/d77/dc5/fd9 x:0 0 0 2024-02-28T23:07:20.919 INFO:tasks.workunit.client.1.smithi184.stdout:9/127: truncate d5/db/de/f23 729290 0 2024-02-28T23:07:20.919 INFO:tasks.workunit.client.0.smithi159.stdout:8/680: mknod d2/d11/d52/d47/db6/dba/cda 0 2024-02-28T23:07:20.920 INFO:tasks.workunit.client.0.smithi159.stdout:8/681: stat d2/d3/f1f 0 2024-02-28T23:07:20.921 INFO:tasks.workunit.client.1.smithi184.stdout:9/128: dread - d5/f1d zero size 2024-02-28T23:07:20.921 INFO:tasks.workunit.client.1.smithi184.stdout:1/192: creat d20/d32/d3e/f3f x:0 0 0 2024-02-28T23:07:20.923 INFO:tasks.workunit.client.0.smithi159.stdout:8/682: chown d2/d3/l1e 415 1 2024-02-28T23:07:20.924 INFO:tasks.workunit.client.1.smithi184.stdout:5/113: creat db/d12/f2c x:0 0 0 2024-02-28T23:07:20.926 INFO:tasks.workunit.client.0.smithi159.stdout:7/445: getdents d5/d16/d1a/d27/d46 0 2024-02-28T23:07:20.926 INFO:tasks.workunit.client.1.smithi184.stdout:7/117: dwrite d6/d9/da/f17 [0,4194304] 0 2024-02-28T23:07:20.928 INFO:tasks.workunit.client.1.smithi184.stdout:1/193: mknod d20/d32/d3e/c40 0 2024-02-28T23:07:20.929 INFO:tasks.workunit.client.0.smithi159.stdout:8/683: write d2/d11/d52/d26/f7f [3531867,105935] 0 2024-02-28T23:07:20.930 INFO:tasks.workunit.client.0.smithi159.stdout:5/558: dwrite d8/d19/d23/d2a/f45 [4194304,4194304] 0 2024-02-28T23:07:20.931 INFO:tasks.workunit.client.1.smithi184.stdout:6/118: rename dc/f13 to dc/de/f29 0 2024-02-28T23:07:20.931 INFO:tasks.workunit.client.1.smithi184.stdout:1/194: write d20/f2d [1176508,78609] 0 2024-02-28T23:07:20.931 INFO:tasks.workunit.client.1.smithi184.stdout:0/142: dwrite d0/df/d13/f1a [0,4194304] 0 2024-02-28T23:07:20.935 INFO:tasks.workunit.client.0.smithi159.stdout:8/684: chown d2/d11/d52/d26/d36/c76 315738310 1 2024-02-28T23:07:20.936 INFO:tasks.workunit.client.1.smithi184.stdout:1/195: readlink l4 0 2024-02-28T23:07:20.936 INFO:tasks.workunit.client.1.smithi184.stdout:3/123: creat d1/d4/f23 x:0 0 0 2024-02-28T23:07:20.937 INFO:tasks.workunit.client.1.smithi184.stdout:5/114: symlink db/d12/l2d 0 2024-02-28T23:07:20.938 INFO:tasks.workunit.client.1.smithi184.stdout:3/124: chown d1/d4/d1c 404601 1 2024-02-28T23:07:20.939 INFO:tasks.workunit.client.0.smithi159.stdout:7/446: symlink d5/d10/d60/l8f 0 2024-02-28T23:07:20.939 INFO:tasks.workunit.client.0.smithi159.stdout:8/685: truncate d2/d73/dc2/fac 979998 0 2024-02-28T23:07:20.941 INFO:tasks.workunit.client.1.smithi184.stdout:7/118: write f4 [4765323,74994] 0 2024-02-28T23:07:20.944 INFO:tasks.workunit.client.0.smithi159.stdout:9/575: dread d4/d3d/d3e/d55/f46 [0,4194304] 0 2024-02-28T23:07:20.944 INFO:tasks.workunit.client.1.smithi184.stdout:8/134: rename d1/ce to d1/da/dc/d16/d29/c3b 0 2024-02-28T23:07:20.947 INFO:tasks.workunit.client.1.smithi184.stdout:9/129: dwrite d5/d17/f28 [0,4194304] 0 2024-02-28T23:07:20.957 INFO:tasks.workunit.client.1.smithi184.stdout:5/115: mkdir db/d12/d18/d2e 0 2024-02-28T23:07:20.959 INFO:tasks.workunit.client.1.smithi184.stdout:5/116: write db/d12/d1c/f2b [871483,34069] 0 2024-02-28T23:07:20.960 INFO:tasks.workunit.client.1.smithi184.stdout:5/117: stat f8 0 2024-02-28T23:07:20.961 INFO:tasks.workunit.client.1.smithi184.stdout:6/119: mkdir dc/de/d2a 0 2024-02-28T23:07:20.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/135: dread d1/da/d10/d17/f13 [0,4194304] 0 2024-02-28T23:07:20.964 INFO:tasks.workunit.client.1.smithi184.stdout:7/119: mkdir d6/d9/d13/d1e/d2f 0 2024-02-28T23:07:20.966 INFO:tasks.workunit.client.1.smithi184.stdout:8/136: dread - d1/da/dc/d16/d32/f39 zero size 2024-02-28T23:07:20.967 INFO:tasks.workunit.client.1.smithi184.stdout:0/143: symlink d0/d1d/l2d 0 2024-02-28T23:07:20.969 INFO:tasks.workunit.client.0.smithi159.stdout:9/576: mkdir d4/d3d/d3e/d55/d9e/db3 0 2024-02-28T23:07:20.969 INFO:tasks.workunit.client.1.smithi184.stdout:8/137: truncate d1/da/dc/d16/d32/f39 89209 0 2024-02-28T23:07:20.970 INFO:tasks.workunit.client.0.smithi159.stdout:5/559: creat d8/d19/d23/d35/d38/fba x:0 0 0 2024-02-28T23:07:20.975 INFO:tasks.workunit.client.0.smithi159.stdout:7/447: dwrite d5/fb [0,4194304] 0 2024-02-28T23:07:20.975 INFO:tasks.workunit.client.1.smithi184.stdout:5/118: mkdir db/d12/d1c/d21/d2f 0 2024-02-28T23:07:20.977 INFO:tasks.workunit.client.1.smithi184.stdout:2/129: dread fe [0,4194304] 0 2024-02-28T23:07:20.981 INFO:tasks.workunit.client.1.smithi184.stdout:4/108: rename d1/d8/l17 to d1/dc/l20 0 2024-02-28T23:07:20.985 INFO:tasks.workunit.client.0.smithi159.stdout:8/686: truncate d2/d3/f30 3789374 0 2024-02-28T23:07:21.003 INFO:tasks.workunit.client.1.smithi184.stdout:8/138: symlink d1/da/dc/d18/l3c 0 2024-02-28T23:07:21.003 INFO:tasks.workunit.client.1.smithi184.stdout:1/196: link d20/d32/c3d d20/c41 0 2024-02-28T23:07:21.004 INFO:tasks.workunit.client.1.smithi184.stdout:5/119: unlink l4 0 2024-02-28T23:07:21.007 INFO:tasks.workunit.client.1.smithi184.stdout:0/144: mknod d0/c2e 0 2024-02-28T23:07:21.007 INFO:tasks.workunit.client.1.smithi184.stdout:2/130: creat d10/d13/d15/f2b x:0 0 0 2024-02-28T23:07:21.008 INFO:tasks.workunit.client.1.smithi184.stdout:3/125: getdents d1/d4 0 2024-02-28T23:07:21.015 INFO:tasks.workunit.client.0.smithi159.stdout:8/687: dread d2/d3/f83 [0,4194304] 0 2024-02-28T23:07:21.016 INFO:tasks.workunit.client.0.smithi159.stdout:8/688: chown d2/d3/f20 3499073 1 2024-02-28T23:07:21.016 INFO:tasks.workunit.client.1.smithi184.stdout:7/120: link f4 d6/f30 0 2024-02-28T23:07:21.020 INFO:tasks.workunit.client.1.smithi184.stdout:8/139: mknod d1/da/df/c3d 0 2024-02-28T23:07:21.026 INFO:tasks.workunit.client.1.smithi184.stdout:9/130: truncate d5/db/f14 317395 0 2024-02-28T23:07:21.026 INFO:tasks.workunit.client.1.smithi184.stdout:8/140: write d1/da/d10/f2d [379576,118685] 0 2024-02-28T23:07:21.027 INFO:tasks.workunit.client.0.smithi159.stdout:5/560: fsync d8/f15 0 2024-02-28T23:07:21.029 INFO:tasks.workunit.client.1.smithi184.stdout:5/120: dread db/d12/d1c/d21/f2a [0,4194304] 0 2024-02-28T23:07:21.031 INFO:tasks.workunit.client.1.smithi184.stdout:3/126: mkdir d1/d4/d6/d1f/d24 0 2024-02-28T23:07:21.033 INFO:tasks.workunit.client.1.smithi184.stdout:7/121: rename d6/d9/f26 to d6/d9/da/f31 0 2024-02-28T23:07:21.034 INFO:tasks.workunit.client.0.smithi159.stdout:7/448: write d5/d56/d50/d5b/f6b [3843228,104215] 0 2024-02-28T23:07:21.035 INFO:tasks.workunit.client.0.smithi159.stdout:8/689: rmdir d2/d11/d35/d9c 39 2024-02-28T23:07:21.036 INFO:tasks.workunit.client.0.smithi159.stdout:8/690: chown d2/d73 29 1 2024-02-28T23:07:21.037 INFO:tasks.workunit.client.1.smithi184.stdout:2/131: dwrite d10/f16 [0,4194304] 0 2024-02-28T23:07:21.038 INFO:tasks.workunit.client.0.smithi159.stdout:8/691: write d2/d73/dc2/fd4 [662417,28610] 0 2024-02-28T23:07:21.039 INFO:tasks.workunit.client.1.smithi184.stdout:4/109: dread d1/f12 [0,4194304] 0 2024-02-28T23:07:21.039 INFO:tasks.workunit.client.1.smithi184.stdout:2/132: read d10/f1d [1183315,126948] 0 2024-02-28T23:07:21.042 INFO:tasks.workunit.client.1.smithi184.stdout:2/133: write fb [1432926,3502] 0 2024-02-28T23:07:21.043 INFO:tasks.workunit.client.0.smithi159.stdout:5/561: mknod d8/d19/d23/d35/d65/da3/cbb 0 2024-02-28T23:07:21.043 INFO:tasks.workunit.client.1.smithi184.stdout:0/145: dread d0/fc [0,4194304] 0 2024-02-28T23:07:21.044 INFO:tasks.workunit.client.1.smithi184.stdout:7/122: symlink d6/d9/d13/d14/l32 0 2024-02-28T23:07:21.046 INFO:tasks.workunit.client.1.smithi184.stdout:9/131: dread d5/db/de/d10/f1c [0,4194304] 0 2024-02-28T23:07:21.048 INFO:tasks.workunit.client.0.smithi159.stdout:7/449: dread d5/d56/d50/f58 [0,4194304] 0 2024-02-28T23:07:21.048 INFO:tasks.workunit.client.1.smithi184.stdout:1/197: dread f9 [0,4194304] 0 2024-02-28T23:07:21.049 INFO:tasks.workunit.client.0.smithi159.stdout:8/692: mkdir d2/d11/d74/ddb 0 2024-02-28T23:07:21.050 INFO:tasks.workunit.client.1.smithi184.stdout:1/198: chown d20/f35 4102719 1 2024-02-28T23:07:21.050 INFO:tasks.workunit.client.1.smithi184.stdout:9/132: read d5/f24 [42847,44268] 0 2024-02-28T23:07:21.050 INFO:tasks.workunit.client.1.smithi184.stdout:2/134: dread d10/d13/d15/d24/f22 [0,4194304] 0 2024-02-28T23:07:21.050 INFO:tasks.workunit.client.1.smithi184.stdout:4/110: mknod d1/d4/c21 0 2024-02-28T23:07:21.051 INFO:tasks.workunit.client.1.smithi184.stdout:1/199: dread - d20/f27 zero size 2024-02-28T23:07:21.051 INFO:tasks.workunit.client.1.smithi184.stdout:4/111: fdatasync d1/d8/d19/f1a 0 2024-02-28T23:07:21.055 INFO:tasks.workunit.client.0.smithi159.stdout:5/562: rename d8/d19/d23/d35/l66 to d8/d19/d23/d35/d38/d6d/lbc 0 2024-02-28T23:07:21.055 INFO:tasks.workunit.client.1.smithi184.stdout:3/127: getdents d1/d4/d6/d1f/d24 0 2024-02-28T23:07:21.057 INFO:tasks.workunit.client.1.smithi184.stdout:0/146: creat d0/df/d13/f2f x:0 0 0 2024-02-28T23:07:21.058 INFO:tasks.workunit.client.0.smithi159.stdout:8/693: creat d2/d11/d52/d47/d65/d68/fdc x:0 0 0 2024-02-28T23:07:21.063 INFO:tasks.workunit.client.1.smithi184.stdout:2/135: creat d10/d13/f2c x:0 0 0 2024-02-28T23:07:21.064 INFO:tasks.workunit.client.0.smithi159.stdout:5/563: rename d8/d19/d23/f57 to d8/d19/d23/d35/d65/fbd 0 2024-02-28T23:07:21.065 INFO:tasks.workunit.client.1.smithi184.stdout:9/133: creat d5/db/de/d10/f2b x:0 0 0 2024-02-28T23:07:21.066 INFO:tasks.workunit.client.0.smithi159.stdout:7/450: dwrite d5/d16/d1a/d24/f3a [0,4194304] 0 2024-02-28T23:07:21.066 INFO:tasks.workunit.client.0.smithi159.stdout:8/694: symlink d2/d11/d52/d26/d36/d38/d77/ldd 0 2024-02-28T23:07:21.067 INFO:tasks.workunit.client.1.smithi184.stdout:9/134: chown d5/f13 11 1 2024-02-28T23:07:21.068 INFO:tasks.workunit.client.1.smithi184.stdout:1/200: mknod d20/c42 0 2024-02-28T23:07:21.070 INFO:tasks.workunit.client.0.smithi159.stdout:5/564: dread - d8/d19/d23/f76 zero size 2024-02-28T23:07:21.070 INFO:tasks.workunit.client.1.smithi184.stdout:0/147: dwrite d0/f17 [0,4194304] 0 2024-02-28T23:07:21.072 INFO:tasks.workunit.client.0.smithi159.stdout:5/565: chown d8/d19/d23/d35/d41/daa/d79/la0 359 1 2024-02-28T23:07:21.073 INFO:tasks.workunit.client.1.smithi184.stdout:0/148: write d0/df/d13/f2f [301540,79109] 0 2024-02-28T23:07:21.076 INFO:tasks.workunit.client.0.smithi159.stdout:7/451: mknod d5/d56/d50/d5b/c90 0 2024-02-28T23:07:21.076 INFO:tasks.workunit.client.1.smithi184.stdout:4/112: rmdir d1/dc 39 2024-02-28T23:07:21.078 INFO:tasks.workunit.client.0.smithi159.stdout:7/452: write d5/d16/d1a/f70 [460860,102132] 0 2024-02-28T23:07:21.082 INFO:tasks.workunit.client.0.smithi159.stdout:8/695: dwrite d2/d3/f13 [4194304,4194304] 0 2024-02-28T23:07:21.085 INFO:tasks.workunit.client.1.smithi184.stdout:7/123: mkdir d6/d9/d13/d1e/d2f/d33 0 2024-02-28T23:07:21.086 INFO:tasks.workunit.client.0.smithi159.stdout:2/497: sync 2024-02-28T23:07:21.086 INFO:tasks.workunit.client.0.smithi159.stdout:3/504: sync 2024-02-28T23:07:21.086 INFO:tasks.workunit.client.0.smithi159.stdout:0/681: sync 2024-02-28T23:07:21.087 INFO:tasks.workunit.client.0.smithi159.stdout:4/655: sync 2024-02-28T23:07:21.087 INFO:tasks.workunit.client.0.smithi159.stdout:1/550: sync 2024-02-28T23:07:21.088 INFO:tasks.workunit.client.1.smithi184.stdout:7/124: chown d6/d9/d13/d1e/c2c 34353 1 2024-02-28T23:07:21.090 INFO:tasks.workunit.client.1.smithi184.stdout:9/135: dwrite d5/f13 [0,4194304] 0 2024-02-28T23:07:21.090 INFO:tasks.workunit.client.0.smithi159.stdout:1/551: dread - d6/d12/d31/fae zero size 2024-02-28T23:07:21.091 INFO:tasks.workunit.client.0.smithi159.stdout:4/656: fsync d9/d42/dc8/fd1 0 2024-02-28T23:07:21.092 INFO:tasks.workunit.client.1.smithi184.stdout:0/149: dread d0/df/d13/f2f [0,4194304] 0 2024-02-28T23:07:21.094 INFO:tasks.workunit.client.0.smithi159.stdout:7/453: dread d5/f7a [0,4194304] 0 2024-02-28T23:07:21.095 INFO:tasks.workunit.client.0.smithi159.stdout:1/552: dread - d6/d12/d31/fae zero size 2024-02-28T23:07:21.095 INFO:tasks.workunit.client.0.smithi159.stdout:0/682: fdatasync d0/de/f68 0 2024-02-28T23:07:21.097 INFO:tasks.workunit.client.0.smithi159.stdout:7/454: stat d5/d16/d1a/d24/l6d 0 2024-02-28T23:07:21.098 INFO:tasks.workunit.client.0.smithi159.stdout:0/683: stat d0/d5/d14/d25/f85 0 2024-02-28T23:07:21.098 INFO:tasks.workunit.client.0.smithi159.stdout:3/505: read d0/d6/d3e/f1e [273135,11298] 0 2024-02-28T23:07:21.099 INFO:tasks.workunit.client.1.smithi184.stdout:3/128: rename d1/d4/d5/l1b to d1/d4/d6/d1f/d24/l25 0 2024-02-28T23:07:21.101 INFO:tasks.workunit.client.1.smithi184.stdout:7/125: write f0 [3550397,83477] 0 2024-02-28T23:07:21.103 INFO:tasks.workunit.client.1.smithi184.stdout:9/136: mkdir d5/d17/d2c 0 2024-02-28T23:07:21.106 INFO:tasks.workunit.client.0.smithi159.stdout:1/553: chown d6/d12/f1b 831576 1 2024-02-28T23:07:21.106 INFO:tasks.workunit.client.0.smithi159.stdout:9/577: truncate d4/f39 3881023 0 2024-02-28T23:07:21.108 INFO:tasks.workunit.client.0.smithi159.stdout:8/696: dread d2/d73/faf [0,4194304] 0 2024-02-28T23:07:21.112 INFO:tasks.workunit.client.0.smithi159.stdout:7/455: truncate d5/d56/f5a 159222 0 2024-02-28T23:07:21.113 INFO:tasks.workunit.client.1.smithi184.stdout:4/113: dwrite d1/f10 [4194304,4194304] 0 2024-02-28T23:07:21.113 INFO:tasks.workunit.client.1.smithi184.stdout:3/129: dread d1/d4/f14 [0,4194304] 0 2024-02-28T23:07:21.113 INFO:tasks.workunit.client.1.smithi184.stdout:6/120: sync 2024-02-28T23:07:21.114 INFO:tasks.workunit.client.0.smithi159.stdout:1/554: truncate d6/d1d/d1f/d3e/d6a/f8b 659411 0 2024-02-28T23:07:21.115 INFO:tasks.workunit.client.1.smithi184.stdout:6/121: write dc/de/d10/f28 [73259,28983] 0 2024-02-28T23:07:21.118 INFO:tasks.workunit.client.0.smithi159.stdout:3/506: symlink d0/d6/d34/l95 0 2024-02-28T23:07:21.120 INFO:tasks.workunit.client.0.smithi159.stdout:1/555: read d6/fb [1550021,37379] 0 2024-02-28T23:07:21.120 INFO:tasks.workunit.client.0.smithi159.stdout:4/657: unlink d9/d20/c2a 0 2024-02-28T23:07:21.122 INFO:tasks.workunit.client.0.smithi159.stdout:0/684: dread d0/d5/d14/d78/da8/fb6 [0,4194304] 0 2024-02-28T23:07:21.126 INFO:tasks.workunit.client.1.smithi184.stdout:7/126: mkdir d6/d9/d13/d1e/d2f/d34 0 2024-02-28T23:07:21.127 INFO:tasks.workunit.client.1.smithi184.stdout:3/130: dwrite d1/d4/f14 [0,4194304] 0 2024-02-28T23:07:21.128 INFO:tasks.workunit.client.1.smithi184.stdout:9/137: creat d5/db/de/d10/d12/f2d x:0 0 0 2024-02-28T23:07:21.130 INFO:tasks.workunit.client.1.smithi184.stdout:1/201: link c1b d20/c43 0 2024-02-28T23:07:21.132 INFO:tasks.workunit.client.0.smithi159.stdout:7/456: mknod d5/d16/d1a/d24/d64/c91 0 2024-02-28T23:07:21.133 INFO:tasks.workunit.client.0.smithi159.stdout:7/457: chown d5/d16/d1a/d27/d46 0 1 2024-02-28T23:07:21.134 INFO:tasks.workunit.client.0.smithi159.stdout:9/578: dread d4/d3d/d3e/d55/d4c/d4e/f5e [0,4194304] 0 2024-02-28T23:07:21.141 INFO:tasks.workunit.client.1.smithi184.stdout:2/136: rename f4 to d10/f2d 0 2024-02-28T23:07:21.143 INFO:tasks.workunit.client.0.smithi159.stdout:5/566: write d8/d16/fab [581016,114436] 0 2024-02-28T23:07:21.144 INFO:tasks.workunit.client.1.smithi184.stdout:1/202: dwrite fb [0,4194304] 0 2024-02-28T23:07:21.147 INFO:tasks.workunit.client.0.smithi159.stdout:6/540: sync 2024-02-28T23:07:21.150 INFO:tasks.workunit.client.0.smithi159.stdout:8/697: dwrite d2/d11/f4b [0,4194304] 0 2024-02-28T23:07:21.155 INFO:tasks.workunit.client.1.smithi184.stdout:4/114: unlink d1/dc/l1c 0 2024-02-28T23:07:21.158 INFO:tasks.workunit.client.1.smithi184.stdout:6/122: creat dc/de/d2a/f2b x:0 0 0 2024-02-28T23:07:21.160 INFO:tasks.workunit.client.0.smithi159.stdout:7/458: creat d5/d16/d1a/d27/d46/d65/d81/f92 x:0 0 0 2024-02-28T23:07:21.161 INFO:tasks.workunit.client.0.smithi159.stdout:9/579: readlink d4/l9 0 2024-02-28T23:07:21.164 INFO:tasks.workunit.client.0.smithi159.stdout:7/459: stat d5/d16/d1a/c1c 0 2024-02-28T23:07:21.169 INFO:tasks.workunit.client.1.smithi184.stdout:0/150: rename d0/d1d/f1e to d0/df/f30 0 2024-02-28T23:07:21.170 INFO:tasks.workunit.client.0.smithi159.stdout:4/658: dwrite d9/da/d1c/d23/f24 [0,4194304] 0 2024-02-28T23:07:21.174 INFO:tasks.workunit.client.0.smithi159.stdout:2/498: dwrite d9/d23/d2c/d55/d13/f5f [0,4194304] 0 2024-02-28T23:07:21.174 INFO:tasks.workunit.client.0.smithi159.stdout:5/567: rmdir d8 39 2024-02-28T23:07:21.181 INFO:tasks.workunit.client.0.smithi159.stdout:1/556: link d6/d12/d33/d3c/f4b d6/fb9 0 2024-02-28T23:07:21.181 INFO:tasks.workunit.client.1.smithi184.stdout:7/127: fdatasync f3 0 2024-02-28T23:07:21.183 INFO:tasks.workunit.client.1.smithi184.stdout:1/203: creat d20/d32/f44 x:0 0 0 2024-02-28T23:07:21.184 INFO:tasks.workunit.client.0.smithi159.stdout:8/698: creat d2/d3/fde x:0 0 0 2024-02-28T23:07:21.185 INFO:tasks.workunit.client.1.smithi184.stdout:9/138: mknod d5/d17/d2c/c2e 0 2024-02-28T23:07:21.188 INFO:tasks.workunit.client.0.smithi159.stdout:3/507: link d0/d6/d34/l68 d0/d2b/d55/d6e/l96 0 2024-02-28T23:07:21.189 INFO:tasks.workunit.client.0.smithi159.stdout:0/685: write d0/d5/d14/d34/d6c/d94/fa0 [1326505,39513] 0 2024-02-28T23:07:21.193 INFO:tasks.workunit.client.0.smithi159.stdout:0/686: read d0/de/f2b [368086,109452] 0 2024-02-28T23:07:21.200 INFO:tasks.workunit.client.0.smithi159.stdout:2/499: rename d9/d36/d59/l77 to d9/d34/lae 0 2024-02-28T23:07:21.203 INFO:tasks.workunit.client.0.smithi159.stdout:2/500: read - d9/d50/d54/d84/f97 zero size 2024-02-28T23:07:21.204 INFO:tasks.workunit.client.0.smithi159.stdout:9/580: mknod d4/cb4 0 2024-02-28T23:07:21.205 INFO:tasks.workunit.client.1.smithi184.stdout:4/115: mkdir d1/dc/df/d22 0 2024-02-28T23:07:21.205 INFO:tasks.workunit.client.1.smithi184.stdout:6/123: symlink dc/de/d2a/l2c 0 2024-02-28T23:07:21.206 INFO:tasks.workunit.client.1.smithi184.stdout:0/151: mkdir d0/df/d13/d27/d31 0 2024-02-28T23:07:21.207 INFO:tasks.workunit.client.1.smithi184.stdout:4/116: stat d1/f12 0 2024-02-28T23:07:21.210 INFO:tasks.workunit.client.1.smithi184.stdout:9/139: mkdir d5/db/de/d10/d12/d2f 0 2024-02-28T23:07:21.213 INFO:tasks.workunit.client.1.smithi184.stdout:9/140: truncate d5/db/de/f21 800531 0 2024-02-28T23:07:21.216 INFO:tasks.workunit.client.1.smithi184.stdout:4/117: creat d1/dc/f23 x:0 0 0 2024-02-28T23:07:21.217 INFO:tasks.workunit.client.0.smithi159.stdout:0/687: creat d0/d5/d38/ff6 x:0 0 0 2024-02-28T23:07:21.217 INFO:tasks.workunit.client.1.smithi184.stdout:4/118: stat d1/d4 0 2024-02-28T23:07:21.218 INFO:tasks.workunit.client.1.smithi184.stdout:7/128: creat d6/f35 x:0 0 0 2024-02-28T23:07:21.220 INFO:tasks.workunit.client.1.smithi184.stdout:9/141: creat d5/db/de/d10/f30 x:0 0 0 2024-02-28T23:07:21.220 INFO:tasks.workunit.client.0.smithi159.stdout:6/541: getdents d0/d1b/d33/d11/d14 0 2024-02-28T23:07:21.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:20 smithi159 ceph-mon[28802]: pgmap v29: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 40 MiB/s rd, 183 MiB/s wr, 417 op/s 2024-02-28T23:07:21.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:20 smithi159 ceph-mon[28802]: Upgrade: Updating mgr.smithi159.pobewk 2024-02-28T23:07:21.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:20 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:21.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:20 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.pobewk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T23:07:21.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:20 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T23:07:21.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:20 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:07:21.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:20 smithi159 ceph-mon[28802]: Deploying daemon mgr.smithi159.pobewk on smithi159 2024-02-28T23:07:21.225 INFO:tasks.workunit.client.0.smithi159.stdout:2/501: truncate d9/d23/da9/fab 2417218 0 2024-02-28T23:07:21.225 INFO:tasks.workunit.client.0.smithi159.stdout:9/581: read d4/d3d/d3e/d55/d37/f3b [509324,105778] 0 2024-02-28T23:07:21.226 INFO:tasks.workunit.client.1.smithi184.stdout:4/119: write d1/dc/df/f16 [1067469,75215] 0 2024-02-28T23:07:21.227 INFO:tasks.workunit.client.0.smithi159.stdout:0/688: creat d0/d5/d14/d25/d2c/dab/dc5/ff7 x:0 0 0 2024-02-28T23:07:21.227 INFO:tasks.workunit.client.0.smithi159.stdout:3/508: getdents d0/d2b/d55/d75/d6d/d54/d6a 0 2024-02-28T23:07:21.227 INFO:tasks.workunit.client.0.smithi159.stdout:0/689: stat d0/d5/d38/d63 0 2024-02-28T23:07:21.228 INFO:tasks.workunit.client.1.smithi184.stdout:6/124: dwrite dc/de/d10/f1b [4194304,4194304] 0 2024-02-28T23:07:21.229 INFO:tasks.workunit.client.1.smithi184.stdout:4/120: mknod d1/d4/c24 0 2024-02-28T23:07:21.229 INFO:tasks.workunit.client.0.smithi159.stdout:2/502: symlink d9/d36/laf 0 2024-02-28T23:07:21.229 INFO:tasks.workunit.client.0.smithi159.stdout:0/690: chown d0/de/d46/f61 1300 1 2024-02-28T23:07:21.230 INFO:tasks.workunit.client.0.smithi159.stdout:5/568: getdents d8/d19/d23/d35/d38 0 2024-02-28T23:07:21.231 INFO:tasks.workunit.client.1.smithi184.stdout:7/129: creat d6/d9/d13/d1e/d2f/d33/f36 x:0 0 0 2024-02-28T23:07:21.232 INFO:tasks.workunit.client.1.smithi184.stdout:7/130: stat d6/d9 0 2024-02-28T23:07:21.234 INFO:tasks.workunit.client.1.smithi184.stdout:6/125: creat dc/de/d10/d16/f2d x:0 0 0 2024-02-28T23:07:21.234 INFO:tasks.workunit.client.0.smithi159.stdout:9/582: rmdir d4/d3d/d3e/d55 39 2024-02-28T23:07:21.236 INFO:tasks.workunit.client.0.smithi159.stdout:1/557: rename d6/d1d/d1f/d3e/fb5 to d6/d12/fba 0 2024-02-28T23:07:21.238 INFO:tasks.workunit.client.0.smithi159.stdout:3/509: symlink d0/d2b/d55/d75/d6d/d54/d6a/l97 0 2024-02-28T23:07:21.239 INFO:tasks.workunit.client.0.smithi159.stdout:2/503: mknod d9/d34/cb0 0 2024-02-28T23:07:21.241 INFO:tasks.workunit.client.1.smithi184.stdout:6/126: write dc/fd [1997652,60477] 0 2024-02-28T23:07:21.245 INFO:tasks.workunit.client.1.smithi184.stdout:7/131: link d6/f16 d6/d9/da/f37 0 2024-02-28T23:07:21.245 INFO:tasks.workunit.client.1.smithi184.stdout:4/121: link d1/d4/c24 d1/d8/d19/c25 0 2024-02-28T23:07:21.246 INFO:tasks.workunit.client.1.smithi184.stdout:4/122: chown d1/d4/f11 472670 1 2024-02-28T23:07:21.247 INFO:tasks.workunit.client.1.smithi184.stdout:4/123: chown d1/f12 13657822 1 2024-02-28T23:07:21.249 INFO:tasks.workunit.client.1.smithi184.stdout:4/124: rename d1/dc to d1/dc/df/d22/d26 22 2024-02-28T23:07:21.250 INFO:tasks.workunit.client.0.smithi159.stdout:3/510: creat d0/d2b/d55/d75/d6d/d54/d7c/d79/f98 x:0 0 0 2024-02-28T23:07:21.251 INFO:tasks.workunit.client.1.smithi184.stdout:6/127: mknod dc/c2e 0 2024-02-28T23:07:21.252 INFO:tasks.workunit.client.0.smithi159.stdout:6/542: dread d0/d1b/d33/d11/d14/f21 [0,4194304] 0 2024-02-28T23:07:21.252 INFO:tasks.workunit.client.1.smithi184.stdout:4/125: mkdir d1/dc/df/d27 0 2024-02-28T23:07:21.253 INFO:tasks.workunit.client.1.smithi184.stdout:4/126: dread - d1/dc/f23 zero size 2024-02-28T23:07:21.254 INFO:tasks.workunit.client.0.smithi159.stdout:2/504: mknod d9/d50/d54/d84/da2/cb1 0 2024-02-28T23:07:21.255 INFO:tasks.workunit.client.1.smithi184.stdout:4/127: readlink d1/lb 0 2024-02-28T23:07:21.255 INFO:tasks.workunit.client.0.smithi159.stdout:2/505: fsync d9/d50/d54/f9a 0 2024-02-28T23:07:21.255 INFO:tasks.workunit.client.0.smithi159.stdout:1/558: rename d6/d1d/l25 to d6/d1d/d46/lbb 0 2024-02-28T23:07:21.257 INFO:tasks.workunit.client.0.smithi159.stdout:9/583: truncate d4/d3d/d3e/d55/f43 3657001 0 2024-02-28T23:07:21.258 INFO:tasks.workunit.client.0.smithi159.stdout:6/543: creat d0/d1b/d5b/fb2 x:0 0 0 2024-02-28T23:07:21.259 INFO:tasks.workunit.client.0.smithi159.stdout:3/511: creat d0/d47/d88/f99 x:0 0 0 2024-02-28T23:07:21.260 INFO:tasks.workunit.client.1.smithi184.stdout:8/141: sync 2024-02-28T23:07:21.260 INFO:tasks.workunit.client.0.smithi159.stdout:6/544: chown d0/d1b/d33/d3f/d44/d7a/f8e 1 1 2024-02-28T23:07:21.262 INFO:tasks.workunit.client.0.smithi159.stdout:2/506: truncate d9/d23/f6a 753913 0 2024-02-28T23:07:21.264 INFO:tasks.workunit.client.0.smithi159.stdout:6/545: write d0/d1b/d33/d11/f2e [5208968,90853] 0 2024-02-28T23:07:21.265 INFO:tasks.workunit.client.0.smithi159.stdout:3/512: unlink d0/d2b/d4f/c84 0 2024-02-28T23:07:21.265 INFO:tasks.workunit.client.0.smithi159.stdout:1/559: truncate d6/d1d/d46/f5f 2047402 0 2024-02-28T23:07:21.267 INFO:tasks.workunit.client.1.smithi184.stdout:8/142: rename d1/da/dc/d18/f1c to d1/da/df/d20/f3e 0 2024-02-28T23:07:21.269 INFO:tasks.workunit.client.0.smithi159.stdout:1/560: write d6/d12/d31/d69/f5e [1108402,109431] 0 2024-02-28T23:07:21.269 INFO:tasks.workunit.client.0.smithi159.stdout:6/546: chown d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/fa3 89820 1 2024-02-28T23:07:21.271 INFO:tasks.workunit.client.0.smithi159.stdout:3/513: mknod d0/d2b/d55/d75/d6d/d54/d7c/c9a 0 2024-02-28T23:07:21.272 INFO:tasks.workunit.client.0.smithi159.stdout:1/561: fdatasync d6/d1d/d1f/d3e/f44 0 2024-02-28T23:07:21.272 INFO:tasks.workunit.client.1.smithi184.stdout:8/143: symlink d1/da/df/l3f 0 2024-02-28T23:07:21.284 INFO:tasks.workunit.client.0.smithi159.stdout:3/514: mkdir d0/d2b/d55/d75/d6d/d54/d7c/d79/d9b 0 2024-02-28T23:07:21.286 INFO:tasks.workunit.client.1.smithi184.stdout:9/142: read d5/db/f16 [245232,20250] 0 2024-02-28T23:07:21.287 INFO:tasks.workunit.client.0.smithi159.stdout:3/515: chown d0/d6/lf 1240471 1 2024-02-28T23:07:21.290 INFO:tasks.workunit.client.0.smithi159.stdout:2/507: dwrite d9/d50/d54/d84/fa8 [0,4194304] 0 2024-02-28T23:07:21.290 INFO:tasks.workunit.client.1.smithi184.stdout:8/144: dread d1/da/df/f1f [0,4194304] 0 2024-02-28T23:07:21.294 INFO:tasks.workunit.client.1.smithi184.stdout:9/143: symlink d5/db/de/d10/d12/d2f/l31 0 2024-02-28T23:07:21.296 INFO:tasks.workunit.client.1.smithi184.stdout:3/131: truncate d1/d4/f14 149948 0 2024-02-28T23:07:21.298 INFO:tasks.workunit.client.0.smithi159.stdout:6/547: dwrite d0/d1b/d33/d11/d14/d49/f60 [0,4194304] 0 2024-02-28T23:07:21.298 INFO:tasks.workunit.client.0.smithi159.stdout:9/584: dread d4/f26 [0,4194304] 0 2024-02-28T23:07:21.300 INFO:tasks.workunit.client.0.smithi159.stdout:2/508: dread d9/d80/f8a [0,4194304] 0 2024-02-28T23:07:21.301 INFO:tasks.workunit.client.0.smithi159.stdout:7/460: write f3 [4422753,85317] 0 2024-02-28T23:07:21.305 INFO:tasks.workunit.client.0.smithi159.stdout:9/585: rmdir d4/d3d/d3e 39 2024-02-28T23:07:21.309 INFO:tasks.workunit.client.1.smithi184.stdout:9/144: mknod d5/d17/d2c/c32 0 2024-02-28T23:07:21.309 INFO:tasks.workunit.client.0.smithi159.stdout:7/461: mknod d5/d16/d1a/d27/d37/c93 0 2024-02-28T23:07:21.309 INFO:tasks.workunit.client.0.smithi159.stdout:8/699: write d2/f15 [968378,62043] 0 2024-02-28T23:07:21.310 INFO:tasks.workunit.client.1.smithi184.stdout:8/145: creat d1/da/f40 x:0 0 0 2024-02-28T23:07:21.310 INFO:tasks.workunit.client.0.smithi159.stdout:6/548: fsync d0/d6d/fab 0 2024-02-28T23:07:21.314 INFO:tasks.workunit.client.1.smithi184.stdout:3/132: mkdir d1/d4/d6/d1f/d26 0 2024-02-28T23:07:21.316 INFO:tasks.workunit.client.0.smithi159.stdout:1/562: dread d6/d12/d16/f79 [0,4194304] 0 2024-02-28T23:07:21.318 INFO:tasks.workunit.client.0.smithi159.stdout:2/509: read d9/d23/d2c/f2d [607016,30263] 0 2024-02-28T23:07:21.319 INFO:tasks.workunit.client.1.smithi184.stdout:9/145: symlink d5/db/de/d10/d12/l33 0 2024-02-28T23:07:21.321 INFO:tasks.workunit.client.0.smithi159.stdout:7/462: chown d5/d16/c39 364 1 2024-02-28T23:07:21.326 INFO:tasks.workunit.client.0.smithi159.stdout:7/463: read d5/d16/d1a/d27/f31 [1976786,56489] 0 2024-02-28T23:07:21.328 INFO:tasks.workunit.client.1.smithi184.stdout:8/146: truncate d1/da/f1a 856693 0 2024-02-28T23:07:21.329 INFO:tasks.workunit.client.1.smithi184.stdout:4/128: getdents d1/d4 0 2024-02-28T23:07:21.331 INFO:tasks.workunit.client.0.smithi159.stdout:9/586: fdatasync d4/d76/fa8 0 2024-02-28T23:07:21.333 INFO:tasks.workunit.client.1.smithi184.stdout:0/152: dwrite d0/df/d13/f2f [0,4194304] 0 2024-02-28T23:07:21.333 INFO:tasks.workunit.client.1.smithi184.stdout:3/133: creat d1/d4/d1c/f27 x:0 0 0 2024-02-28T23:07:21.334 INFO:tasks.workunit.client.0.smithi159.stdout:1/563: dwrite d6/d12/d33/f51 [0,4194304] 0 2024-02-28T23:07:21.335 INFO:tasks.workunit.client.1.smithi184.stdout:5/121: sync 2024-02-28T23:07:21.335 INFO:tasks.workunit.client.1.smithi184.stdout:8/147: write d1/da/dc/d16/d32/f39 [359962,102654] 0 2024-02-28T23:07:21.336 INFO:tasks.workunit.client.0.smithi159.stdout:8/700: mknod d2/d11/d52/d26/d36/d38/d77/cdf 0 2024-02-28T23:07:21.336 INFO:tasks.workunit.client.1.smithi184.stdout:3/134: write d1/f21 [4506731,95850] 0 2024-02-28T23:07:21.339 INFO:tasks.workunit.client.0.smithi159.stdout:8/701: stat d2/d11/d52/d6e/l8f 0 2024-02-28T23:07:21.343 INFO:tasks.workunit.client.0.smithi159.stdout:7/464: creat d5/d10/d60/f94 x:0 0 0 2024-02-28T23:07:21.344 INFO:tasks.workunit.client.1.smithi184.stdout:7/132: rmdir d6/d9 39 2024-02-28T23:07:21.346 INFO:tasks.workunit.client.0.smithi159.stdout:7/465: chown d5/d10/f36 20667 1 2024-02-28T23:07:21.348 INFO:tasks.workunit.client.0.smithi159.stdout:5/569: write d8/d19/d23/f5c [8806,41297] 0 2024-02-28T23:07:21.350 INFO:tasks.workunit.client.0.smithi159.stdout:1/564: mknod d6/d12/d1a/d92/cbc 0 2024-02-28T23:07:21.354 INFO:tasks.workunit.client.0.smithi159.stdout:0/691: dwrite d0/d5/f7 [4194304,4194304] 0 2024-02-28T23:07:21.354 INFO:tasks.workunit.client.1.smithi184.stdout:4/129: dwrite d1/dc/df/f16 [0,4194304] 0 2024-02-28T23:07:21.358 INFO:tasks.workunit.client.1.smithi184.stdout:8/148: unlink d1/da/d10/d17/cd 0 2024-02-28T23:07:21.365 INFO:tasks.workunit.client.1.smithi184.stdout:3/135: symlink d1/d4/d6/d1f/l28 0 2024-02-28T23:07:21.366 INFO:tasks.workunit.client.1.smithi184.stdout:5/122: write db/d12/d1c/d21/f2a [2443481,79236] 0 2024-02-28T23:07:21.371 INFO:tasks.workunit.client.1.smithi184.stdout:2/137: sync 2024-02-28T23:07:21.371 INFO:tasks.workunit.client.1.smithi184.stdout:3/136: write d1/d4/d1c/f27 [230368,88189] 0 2024-02-28T23:07:21.371 INFO:tasks.workunit.client.1.smithi184.stdout:6/128: sync 2024-02-28T23:07:21.371 INFO:tasks.workunit.client.1.smithi184.stdout:1/204: sync 2024-02-28T23:07:21.374 INFO:tasks.workunit.client.1.smithi184.stdout:0/153: mknod d0/df/d13/d27/d2b/c32 0 2024-02-28T23:07:21.375 INFO:tasks.workunit.client.1.smithi184.stdout:4/130: symlink d1/d8/d19/l28 0 2024-02-28T23:07:21.375 INFO:tasks.workunit.client.0.smithi159.stdout:6/549: dread d0/f7 [0,4194304] 0 2024-02-28T23:07:21.376 INFO:tasks.workunit.client.0.smithi159.stdout:2/510: rename d9/d23/d2c/d55/d13/l1c to d9/lb2 0 2024-02-28T23:07:21.376 INFO:tasks.workunit.client.1.smithi184.stdout:4/131: readlink d1/l18 0 2024-02-28T23:07:21.377 INFO:tasks.workunit.client.1.smithi184.stdout:2/138: readlink d10/d13/d15/l20 0 2024-02-28T23:07:21.378 INFO:tasks.workunit.client.1.smithi184.stdout:7/133: dread d6/d9/da/f31 [0,4194304] 0 2024-02-28T23:07:21.378 INFO:tasks.workunit.client.1.smithi184.stdout:1/205: readlink d20/l2e 0 2024-02-28T23:07:21.378 INFO:tasks.workunit.client.1.smithi184.stdout:6/129: chown dc/de/d10/f21 397053 1 2024-02-28T23:07:21.379 INFO:tasks.workunit.client.1.smithi184.stdout:7/134: dread - d6/f19 zero size 2024-02-28T23:07:21.380 INFO:tasks.workunit.client.1.smithi184.stdout:5/123: rename db/d12/d1c/d21/c23 to db/c30 0 2024-02-28T23:07:21.381 INFO:tasks.workunit.client.1.smithi184.stdout:1/206: chown d20/c33 336884 1 2024-02-28T23:07:21.383 INFO:tasks.workunit.client.1.smithi184.stdout:0/154: symlink d0/df/d13/d27/l33 0 2024-02-28T23:07:21.385 INFO:tasks.workunit.client.0.smithi159.stdout:6/550: read d0/d1b/d33/d11/d34/d9d/da2/d52/f7f [92364,104392] 0 2024-02-28T23:07:21.386 INFO:tasks.workunit.client.1.smithi184.stdout:8/149: chown d1/da/f1a 779972077 1 2024-02-28T23:07:21.392 INFO:tasks.workunit.client.1.smithi184.stdout:2/139: creat d10/d13/d15/f2e x:0 0 0 2024-02-28T23:07:21.393 INFO:tasks.workunit.client.1.smithi184.stdout:1/207: symlink d20/l45 0 2024-02-28T23:07:21.394 INFO:tasks.workunit.client.0.smithi159.stdout:7/466: mkdir d5/d16/d1a/d27/d95 0 2024-02-28T23:07:21.400 INFO:tasks.workunit.client.0.smithi159.stdout:7/467: truncate d5/d56/d2a/f45 138977 0 2024-02-28T23:07:21.400 INFO:tasks.workunit.client.1.smithi184.stdout:4/132: mkdir d1/d29 0 2024-02-28T23:07:21.401 INFO:tasks.workunit.client.0.smithi159.stdout:3/516: dwrite d0/d2b/d55/d75/d6d/d54/d7c/f7b [0,4194304] 0 2024-02-28T23:07:21.402 INFO:tasks.workunit.client.1.smithi184.stdout:9/146: write d5/f6 [679294,73514] 0 2024-02-28T23:07:21.403 INFO:tasks.workunit.client.0.smithi159.stdout:7/468: chown d5/d16/d1a/c1c 252547130 1 2024-02-28T23:07:21.404 INFO:tasks.workunit.client.1.smithi184.stdout:0/155: mknod d0/df/d13/d27/c34 0 2024-02-28T23:07:21.404 INFO:tasks.workunit.client.0.smithi159.stdout:6/551: dread d0/f2b [0,4194304] 0 2024-02-28T23:07:21.407 INFO:tasks.workunit.client.1.smithi184.stdout:8/150: creat d1/da/d10/d17/f41 x:0 0 0 2024-02-28T23:07:21.412 INFO:tasks.workunit.client.1.smithi184.stdout:6/130: link dc/de/d10/f28 dc/de/d10/d16/f2f 0 2024-02-28T23:07:21.412 INFO:tasks.workunit.client.0.smithi159.stdout:1/565: creat d6/d1d/d46/fbd x:0 0 0 2024-02-28T23:07:21.414 INFO:tasks.workunit.client.1.smithi184.stdout:3/137: dread d1/d4/d6/fa [0,4194304] 0 2024-02-28T23:07:21.414 INFO:tasks.workunit.client.1.smithi184.stdout:2/140: creat d10/d1f/f2f x:0 0 0 2024-02-28T23:07:21.416 INFO:tasks.workunit.client.1.smithi184.stdout:1/208: mkdir d20/d46 0 2024-02-28T23:07:21.417 INFO:tasks.workunit.client.1.smithi184.stdout:5/124: getdents db/d12/d18/d2e 0 2024-02-28T23:07:21.417 INFO:tasks.workunit.client.1.smithi184.stdout:1/209: dread - d20/f2b zero size 2024-02-28T23:07:21.418 INFO:tasks.workunit.client.1.smithi184.stdout:3/138: truncate d1/d4/f23 973303 0 2024-02-28T23:07:21.419 INFO:tasks.workunit.client.1.smithi184.stdout:4/133: mknod d1/d8/c2a 0 2024-02-28T23:07:21.419 INFO:tasks.workunit.client.0.smithi159.stdout:5/570: write d8/d19/d23/d35/f62 [112933,120620] 0 2024-02-28T23:07:21.424 INFO:tasks.workunit.client.1.smithi184.stdout:8/151: dread d1/da/dc/d16/d29/f2a [0,4194304] 0 2024-02-28T23:07:21.425 INFO:tasks.workunit.client.0.smithi159.stdout:3/517: mknod d0/d6/d34/c9c 0 2024-02-28T23:07:21.425 INFO:tasks.workunit.client.1.smithi184.stdout:5/125: write db/d12/d1c/d21/f2a [2193972,69280] 0 2024-02-28T23:07:21.426 INFO:tasks.workunit.client.1.smithi184.stdout:0/156: dread d0/fb [4194304,4194304] 0 2024-02-28T23:07:21.428 INFO:tasks.workunit.client.1.smithi184.stdout:5/126: fsync db/d12/f2c 0 2024-02-28T23:07:21.430 INFO:tasks.workunit.client.1.smithi184.stdout:5/127: readlink db/d12/l15 0 2024-02-28T23:07:21.433 INFO:tasks.workunit.client.0.smithi159.stdout:6/552: creat d0/d1b/d33/d3f/d44/d8b/fb3 x:0 0 0 2024-02-28T23:07:21.434 INFO:tasks.workunit.client.1.smithi184.stdout:4/134: dread d1/f10 [4194304,4194304] 0 2024-02-28T23:07:21.436 INFO:tasks.workunit.client.0.smithi159.stdout:8/702: getdents d2/d11/d52/d47/d65 0 2024-02-28T23:07:21.438 INFO:tasks.workunit.client.0.smithi159.stdout:9/587: dwrite d4/d3d/d3e/d55/f43 [0,4194304] 0 2024-02-28T23:07:21.438 INFO:tasks.workunit.client.0.smithi159.stdout:8/703: stat d2/d73/faf 0 2024-02-28T23:07:21.441 INFO:tasks.workunit.client.0.smithi159.stdout:2/511: creat d9/fb3 x:0 0 0 2024-02-28T23:07:21.443 INFO:tasks.workunit.client.1.smithi184.stdout:8/152: mkdir d1/da/dc/d16/d32/d42 0 2024-02-28T23:07:21.443 INFO:tasks.workunit.client.1.smithi184.stdout:7/135: dwrite d6/d9/da/dc/f12 [0,4194304] 0 2024-02-28T23:07:21.446 INFO:tasks.workunit.client.1.smithi184.stdout:0/157: creat d0/d1d/f35 x:0 0 0 2024-02-28T23:07:21.446 INFO:tasks.workunit.client.0.smithi159.stdout:0/692: getdents d0/d5/d14/d25 0 2024-02-28T23:07:21.448 INFO:tasks.workunit.client.0.smithi159.stdout:6/553: unlink d0/d1b/d33/d11/f2e 0 2024-02-28T23:07:21.449 INFO:tasks.workunit.client.0.smithi159.stdout:3/518: dwrite d0/d2b/d55/d75/d6d/d54/d7c/d79/f98 [0,4194304] 0 2024-02-28T23:07:21.449 INFO:tasks.workunit.client.1.smithi184.stdout:1/210: dread f15 [0,4194304] 0 2024-02-28T23:07:21.451 INFO:tasks.workunit.client.1.smithi184.stdout:3/139: creat d1/d4/d6/d1f/d26/f29 x:0 0 0 2024-02-28T23:07:21.455 INFO:tasks.workunit.client.1.smithi184.stdout:5/128: unlink f7 0 2024-02-28T23:07:21.456 INFO:tasks.workunit.client.0.smithi159.stdout:6/554: truncate d0/d1b/d33/d3f/d44/d7a/fa9 576999 0 2024-02-28T23:07:21.458 INFO:tasks.workunit.client.1.smithi184.stdout:4/135: readlink d1/dc/l20 0 2024-02-28T23:07:21.460 INFO:tasks.workunit.client.1.smithi184.stdout:4/136: write d1/d4/f1f [958330,120921] 0 2024-02-28T23:07:21.464 INFO:tasks.workunit.client.0.smithi159.stdout:9/588: unlink d4/d3d/d3e/d91/l96 0 2024-02-28T23:07:21.465 INFO:tasks.workunit.client.1.smithi184.stdout:6/131: creat dc/f30 x:0 0 0 2024-02-28T23:07:21.465 INFO:tasks.workunit.client.0.smithi159.stdout:2/512: dwrite f6 [0,4194304] 0 2024-02-28T23:07:21.466 INFO:tasks.workunit.client.1.smithi184.stdout:6/132: dread - dc/de/d10/f24 zero size 2024-02-28T23:07:21.467 INFO:tasks.workunit.client.0.smithi159.stdout:9/589: chown d4/d3d/d3e/d55/d37/d62/f74 26264 1 2024-02-28T23:07:21.474 INFO:tasks.workunit.client.0.smithi159.stdout:7/469: creat d5/d16/d1a/f96 x:0 0 0 2024-02-28T23:07:21.475 INFO:tasks.workunit.client.1.smithi184.stdout:4/137: dwrite d1/dc/df/f16 [0,4194304] 0 2024-02-28T23:07:21.475 INFO:tasks.workunit.client.0.smithi159.stdout:3/519: symlink d0/d47/l9d 0 2024-02-28T23:07:21.476 INFO:tasks.workunit.client.0.smithi159.stdout:7/470: dread d5/fe [0,4194304] 0 2024-02-28T23:07:21.477 INFO:tasks.workunit.client.1.smithi184.stdout:9/147: dwrite d5/db/f14 [0,4194304] 0 2024-02-28T23:07:21.482 INFO:tasks.workunit.client.0.smithi159.stdout:1/566: creat d6/d12/fbe x:0 0 0 2024-02-28T23:07:21.482 INFO:tasks.workunit.client.0.smithi159.stdout:4/659: sync 2024-02-28T23:07:21.483 INFO:tasks.workunit.client.1.smithi184.stdout:4/138: dread d1/d4/f1f [0,4194304] 0 2024-02-28T23:07:21.484 INFO:tasks.workunit.client.1.smithi184.stdout:1/211: fdatasync f19 0 2024-02-28T23:07:21.484 INFO:tasks.workunit.client.1.smithi184.stdout:1/212: chown fa 5429297 1 2024-02-28T23:07:21.490 INFO:tasks.workunit.client.1.smithi184.stdout:3/140: creat d1/d4/d6/d1f/d26/f2a x:0 0 0 2024-02-28T23:07:21.492 INFO:tasks.workunit.client.0.smithi159.stdout:8/704: mknod d2/d11/d35/d9c/ce0 0 2024-02-28T23:07:21.492 INFO:tasks.workunit.client.1.smithi184.stdout:5/129: mknod db/d12/d1c/c31 0 2024-02-28T23:07:21.495 INFO:tasks.workunit.client.1.smithi184.stdout:5/130: write db/d12/d1c/d21/f2a [4890716,62804] 0 2024-02-28T23:07:21.497 INFO:tasks.workunit.client.0.smithi159.stdout:2/513: creat d9/d23/da9/fb4 x:0 0 0 2024-02-28T23:07:21.497 INFO:tasks.workunit.client.1.smithi184.stdout:5/131: write f8 [2042622,109372] 0 2024-02-28T23:07:21.499 INFO:tasks.workunit.client.0.smithi159.stdout:5/571: dwrite d8/ff [0,4194304] 0 2024-02-28T23:07:21.500 INFO:tasks.workunit.client.1.smithi184.stdout:2/141: getdents d10/d13/d15/d24 0 2024-02-28T23:07:21.504 INFO:tasks.workunit.client.0.smithi159.stdout:7/471: dwrite d5/d56/d50/f8c [0,4194304] 0 2024-02-28T23:07:21.505 INFO:tasks.workunit.client.0.smithi159.stdout:8/705: read d2/d3/f13 [620072,55390] 0 2024-02-28T23:07:21.505 INFO:tasks.workunit.client.1.smithi184.stdout:8/153: mkdir d1/da/d10/d43 0 2024-02-28T23:07:21.507 INFO:tasks.workunit.client.1.smithi184.stdout:8/154: fdatasync d1/da/dc/d16/d29/f2a 0 2024-02-28T23:07:21.509 INFO:tasks.workunit.client.1.smithi184.stdout:8/155: chown d1/c8 47907060 1 2024-02-28T23:07:21.511 INFO:tasks.workunit.client.1.smithi184.stdout:3/141: dwrite d1/d4/d6/d1f/d26/f29 [0,4194304] 0 2024-02-28T23:07:21.511 INFO:tasks.workunit.client.0.smithi159.stdout:7/472: truncate d5/d16/d1a/d27/d3e/f7c 733641 0 2024-02-28T23:07:21.514 INFO:tasks.workunit.client.1.smithi184.stdout:4/139: unlink d1/d4/c21 0 2024-02-28T23:07:21.515 INFO:tasks.workunit.client.1.smithi184.stdout:8/156: chown d1/da/d10/d17/f13 18319 1 2024-02-28T23:07:21.517 INFO:tasks.workunit.client.0.smithi159.stdout:2/514: creat d9/d23/da9/fb5 x:0 0 0 2024-02-28T23:07:21.521 INFO:tasks.workunit.client.0.smithi159.stdout:5/572: creat d8/d59/fbe x:0 0 0 2024-02-28T23:07:21.523 INFO:tasks.workunit.client.1.smithi184.stdout:5/132: chown db/c28 0 1 2024-02-28T23:07:21.529 INFO:tasks.workunit.client.1.smithi184.stdout:6/133: write dc/de/f1e [2900115,38961] 0 2024-02-28T23:07:21.529 INFO:tasks.workunit.client.1.smithi184.stdout:2/142: rename d10/d1f/l29 to d10/d13/d15/d24/l30 0 2024-02-28T23:07:21.529 INFO:tasks.workunit.client.1.smithi184.stdout:7/136: sync 2024-02-28T23:07:21.529 INFO:tasks.workunit.client.1.smithi184.stdout:6/134: readlink dc/de/d10/l25 0 2024-02-28T23:07:21.531 INFO:tasks.workunit.client.0.smithi159.stdout:8/706: rmdir d2/d11/d52/d26 39 2024-02-28T23:07:21.531 INFO:tasks.workunit.client.1.smithi184.stdout:9/148: mknod d5/db/d29/c34 0 2024-02-28T23:07:21.533 INFO:tasks.workunit.client.0.smithi159.stdout:7/473: creat d5/d56/d2a/f97 x:0 0 0 2024-02-28T23:07:21.534 INFO:tasks.workunit.client.1.smithi184.stdout:0/158: truncate d0/df/f15 737193 0 2024-02-28T23:07:21.537 INFO:tasks.workunit.client.1.smithi184.stdout:3/142: creat d1/d4/d6/d1f/f2b x:0 0 0 2024-02-28T23:07:21.538 INFO:tasks.workunit.client.1.smithi184.stdout:4/140: dwrite d1/d8/d19/f1a [0,4194304] 0 2024-02-28T23:07:21.540 INFO:tasks.workunit.client.1.smithi184.stdout:5/133: mkdir db/d1f/d32 0 2024-02-28T23:07:21.541 INFO:tasks.workunit.client.0.smithi159.stdout:1/567: rename d6/d12/d33/f95 to d6/d12/d33/fbf 0 2024-02-28T23:07:21.542 INFO:tasks.workunit.client.1.smithi184.stdout:3/143: read d1/d4/d6/fa [3955930,26751] 0 2024-02-28T23:07:21.544 INFO:tasks.workunit.client.1.smithi184.stdout:4/141: chown d1/d8/f1b 37461521 1 2024-02-28T23:07:21.546 INFO:tasks.workunit.client.0.smithi159.stdout:0/693: truncate d0/d5/d14/d34/f9e 1116646 0 2024-02-28T23:07:21.548 INFO:tasks.workunit.client.1.smithi184.stdout:6/135: dwrite dc/f14 [0,4194304] 0 2024-02-28T23:07:21.548 INFO:tasks.workunit.client.0.smithi159.stdout:6/555: dread d0/fe [0,4194304] 0 2024-02-28T23:07:21.549 INFO:tasks.workunit.client.0.smithi159.stdout:6/556: fsync d0/f8 0 2024-02-28T23:07:21.549 INFO:tasks.workunit.client.0.smithi159.stdout:9/590: truncate d4/d3d/f7e 1180871 0 2024-02-28T23:07:21.550 INFO:tasks.workunit.client.1.smithi184.stdout:6/136: truncate dc/de/f20 615016 0 2024-02-28T23:07:21.553 INFO:tasks.workunit.client.1.smithi184.stdout:1/213: sync 2024-02-28T23:07:21.554 INFO:tasks.workunit.client.1.smithi184.stdout:9/149: rename d5/db/de/d10/f1b to d5/db/d29/f35 0 2024-02-28T23:07:21.557 INFO:tasks.workunit.client.0.smithi159.stdout:5/573: rmdir d8/d59 39 2024-02-28T23:07:21.560 INFO:tasks.workunit.client.1.smithi184.stdout:5/134: unlink db/d12/d1c/c22 0 2024-02-28T23:07:21.560 INFO:tasks.workunit.client.0.smithi159.stdout:4/660: write d9/d20/f48 [612437,66697] 0 2024-02-28T23:07:21.565 INFO:tasks.workunit.client.0.smithi159.stdout:1/568: write d6/d12/d31/d5a/fa2 [420276,71448] 0 2024-02-28T23:07:21.565 INFO:tasks.workunit.client.0.smithi159.stdout:3/520: truncate d0/d2b/d55/d75/d6d/d54/d7c/d79/f89 3120921 0 2024-02-28T23:07:21.565 INFO:tasks.workunit.client.1.smithi184.stdout:5/135: dread db/d1f/f27 [0,4194304] 0 2024-02-28T23:07:21.568 INFO:tasks.workunit.client.0.smithi159.stdout:1/569: dread d6/d1d/f68 [0,4194304] 0 2024-02-28T23:07:21.569 INFO:tasks.workunit.client.0.smithi159.stdout:0/694: unlink d0/f8b 0 2024-02-28T23:07:21.573 INFO:tasks.workunit.client.1.smithi184.stdout:7/137: link d6/d9/da/dc/f2b d6/d9/d13/d1e/d2f/f38 0 2024-02-28T23:07:21.575 INFO:tasks.workunit.client.0.smithi159.stdout:6/557: chown d0/cad 44 1 2024-02-28T23:07:21.578 INFO:tasks.workunit.client.0.smithi159.stdout:6/558: fsync d0/d1b/d33/f43 0 2024-02-28T23:07:21.579 INFO:tasks.workunit.client.0.smithi159.stdout:9/591: mkdir d4/d3d/d3e/d55/d4c/d4e/d6b/db5 0 2024-02-28T23:07:21.579 INFO:tasks.workunit.client.1.smithi184.stdout:0/159: rename d0/l12 to d0/df/d13/d27/l36 0 2024-02-28T23:07:21.580 INFO:tasks.workunit.client.0.smithi159.stdout:9/592: read - d4/fae zero size 2024-02-28T23:07:21.581 INFO:tasks.workunit.client.1.smithi184.stdout:9/150: rmdir d5/db/d29 39 2024-02-28T23:07:21.583 INFO:tasks.workunit.client.1.smithi184.stdout:1/214: creat d20/f47 x:0 0 0 2024-02-28T23:07:21.584 INFO:tasks.workunit.client.0.smithi159.stdout:5/574: dwrite d8/d19/d23/d35/f62 [0,4194304] 0 2024-02-28T23:07:21.584 INFO:tasks.workunit.client.1.smithi184.stdout:4/142: dwrite d1/dc/df/f14 [0,4194304] 0 2024-02-28T23:07:21.585 INFO:tasks.workunit.client.1.smithi184.stdout:9/151: readlink d5/db/de/d10/d12/d2f/l31 0 2024-02-28T23:07:21.586 INFO:tasks.workunit.client.0.smithi159.stdout:0/695: mknod d0/de/d75/d5f/cf8 0 2024-02-28T23:07:21.590 INFO:tasks.workunit.client.1.smithi184.stdout:8/157: dwrite d1/da/dc/d18/f19 [0,4194304] 0 2024-02-28T23:07:21.600 INFO:tasks.workunit.client.0.smithi159.stdout:2/515: getdents d9/d34 0 2024-02-28T23:07:21.600 INFO:tasks.workunit.client.1.smithi184.stdout:5/136: readlink l6 0 2024-02-28T23:07:21.600 INFO:tasks.workunit.client.1.smithi184.stdout:0/160: dwrite d0/d1f/f28 [0,4194304] 0 2024-02-28T23:07:21.601 INFO:tasks.workunit.client.1.smithi184.stdout:0/161: readlink d0/l16 0 2024-02-28T23:07:21.604 INFO:tasks.workunit.client.0.smithi159.stdout:6/559: dwrite d0/d1b/d33/d8c/f6f [0,4194304] 0 2024-02-28T23:07:21.605 INFO:tasks.workunit.client.0.smithi159.stdout:3/521: dread d0/d6/d34/f45 [0,4194304] 0 2024-02-28T23:07:21.610 INFO:tasks.workunit.client.1.smithi184.stdout:7/138: rmdir d6/d9/d13/d14 39 2024-02-28T23:07:21.612 INFO:tasks.workunit.client.1.smithi184.stdout:7/139: chown d6/l25 272881 1 2024-02-28T23:07:21.612 INFO:tasks.workunit.client.0.smithi159.stdout:7/474: truncate d5/d16/d1a/f3c 935600 0 2024-02-28T23:07:21.613 INFO:tasks.workunit.client.1.smithi184.stdout:9/152: dwrite d5/db/de/d10/f2b [0,4194304] 0 2024-02-28T23:07:21.614 INFO:tasks.workunit.client.1.smithi184.stdout:7/140: chown d6/d9/da/dc/f2b 81 1 2024-02-28T23:07:21.615 INFO:tasks.workunit.client.0.smithi159.stdout:9/593: dwrite d4/d3d/d3e/d55/d4c/d4e/f63 [4194304,4194304] 0 2024-02-28T23:07:21.615 INFO:tasks.workunit.client.1.smithi184.stdout:9/153: chown d5/fc 969 1 2024-02-28T23:07:21.619 INFO:tasks.workunit.client.1.smithi184.stdout:9/154: chown d5/f7 0 1 2024-02-28T23:07:21.619 INFO:tasks.workunit.client.0.smithi159.stdout:3/522: truncate d0/d6/d3e/d57/f6c 828985 0 2024-02-28T23:07:21.620 INFO:tasks.workunit.client.1.smithi184.stdout:3/144: rename d1/d4/d6/fa to d1/d4/d6/d1f/f2c 0 2024-02-28T23:07:21.622 INFO:tasks.workunit.client.1.smithi184.stdout:2/143: getdents d10/d13/d15 0 2024-02-28T23:07:21.622 INFO:tasks.workunit.client.1.smithi184.stdout:6/137: truncate dc/de/f29 755445 0 2024-02-28T23:07:21.627 INFO:tasks.workunit.client.1.smithi184.stdout:1/215: creat d20/d32/f48 x:0 0 0 2024-02-28T23:07:21.628 INFO:tasks.workunit.client.1.smithi184.stdout:1/216: write d20/f2d [456922,6102] 0 2024-02-28T23:07:21.629 INFO:tasks.workunit.client.0.smithi159.stdout:6/560: dwrite d0/d1b/d33/d3f/d44/d7a/f8e [0,4194304] 0 2024-02-28T23:07:21.630 INFO:tasks.workunit.client.0.smithi159.stdout:5/575: creat d8/d19/d23/d35/d38/d8f/da5/fbf x:0 0 0 2024-02-28T23:07:21.631 INFO:tasks.workunit.client.1.smithi184.stdout:4/143: symlink d1/d8/l2b 0 2024-02-28T23:07:21.638 INFO:tasks.workunit.client.0.smithi159.stdout:0/696: creat d0/d5/d14/d25/d2c/d4b/ff9 x:0 0 0 2024-02-28T23:07:21.642 INFO:tasks.workunit.client.1.smithi184.stdout:1/217: dwrite d20/f2b [0,4194304] 0 2024-02-28T23:07:21.653 INFO:tasks.workunit.client.0.smithi159.stdout:3/523: dwrite d0/d6/f32 [0,4194304] 0 2024-02-28T23:07:21.655 INFO:tasks.workunit.client.0.smithi159.stdout:4/661: rename d9/da/d1c/d8e/faf to d9/d20/fe3 0 2024-02-28T23:07:21.673 INFO:tasks.workunit.client.0.smithi159.stdout:7/475: mkdir d5/d16/d1a/d27/d46/d65/d81/d98 0 2024-02-28T23:07:21.680 INFO:tasks.workunit.client.0.smithi159.stdout:4/662: dwrite d9/d20/d87/fb8 [0,4194304] 0 2024-02-28T23:07:21.690 INFO:tasks.workunit.client.1.smithi184.stdout:9/155: rename d5/db/f14 to d5/d26/f36 0 2024-02-28T23:07:21.704 INFO:tasks.workunit.client.1.smithi184.stdout:9/156: dwrite d5/f13 [4194304,4194304] 0 2024-02-28T23:07:21.723 INFO:tasks.workunit.client.0.smithi159.stdout:6/561: fsync d0/f7 0 2024-02-28T23:07:21.748 INFO:tasks.workunit.client.1.smithi184.stdout:2/144: rmdir d10/d13/d15/d24 39 2024-02-28T23:07:21.750 INFO:tasks.workunit.client.1.smithi184.stdout:6/138: mknod dc/de/d10/c31 0 2024-02-28T23:07:21.756 INFO:tasks.workunit.client.1.smithi184.stdout:4/144: chown d1/d4/c24 66488 1 2024-02-28T23:07:21.770 INFO:tasks.workunit.client.0.smithi159.stdout:7/476: creat d5/d16/d1a/d27/d46/f99 x:0 0 0 2024-02-28T23:07:21.771 INFO:tasks.workunit.client.1.smithi184.stdout:7/141: write f3 [228585,51170] 0 2024-02-28T23:07:21.772 INFO:tasks.workunit.client.0.smithi159.stdout:4/663: symlink d9/d42/db1/le4 0 2024-02-28T23:07:21.775 INFO:tasks.workunit.client.1.smithi184.stdout:5/137: creat db/d1f/d32/f33 x:0 0 0 2024-02-28T23:07:21.776 INFO:tasks.workunit.client.0.smithi159.stdout:9/594: mkdir d4/d3d/d3e/d55/d4c/db6 0 2024-02-28T23:07:21.776 INFO:tasks.workunit.client.1.smithi184.stdout:5/138: fdatasync db/f1e 0 2024-02-28T23:07:21.779 INFO:tasks.workunit.client.1.smithi184.stdout:5/139: stat db/d12/d1c/f2b 0 2024-02-28T23:07:21.779 INFO:tasks.workunit.client.0.smithi159.stdout:5/576: symlink d8/d59/lc0 0 2024-02-28T23:07:21.784 INFO:tasks.workunit.client.1.smithi184.stdout:1/218: dwrite f9 [0,4194304] 0 2024-02-28T23:07:21.789 INFO:tasks.workunit.client.0.smithi159.stdout:6/562: creat d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/fb4 x:0 0 0 2024-02-28T23:07:21.794 INFO:tasks.workunit.client.1.smithi184.stdout:9/157: mknod d5/d17/c37 0 2024-02-28T23:07:21.796 INFO:tasks.workunit.client.0.smithi159.stdout:5/577: dread d8/d19/d23/d35/f99 [0,4194304] 0 2024-02-28T23:07:21.802 INFO:tasks.workunit.client.1.smithi184.stdout:4/145: mknod d1/dc/df/c2c 0 2024-02-28T23:07:21.812 INFO:tasks.workunit.client.1.smithi184.stdout:2/145: dread d10/f2d [0,4194304] 0 2024-02-28T23:07:21.812 INFO:tasks.workunit.client.0.smithi159.stdout:4/664: mknod d9/d42/d54/d55/ce5 0 2024-02-28T23:07:21.818 INFO:tasks.workunit.client.1.smithi184.stdout:5/140: mknod db/d1f/d32/c34 0 2024-02-28T23:07:21.819 INFO:tasks.workunit.client.0.smithi159.stdout:6/563: fsync d0/d1b/f56 0 2024-02-28T23:07:21.820 INFO:tasks.workunit.client.0.smithi159.stdout:6/564: read - d0/d6d/f95 zero size 2024-02-28T23:07:21.821 INFO:tasks.workunit.client.1.smithi184.stdout:1/219: rename d20/d32/f37 to d20/f49 0 2024-02-28T23:07:21.827 INFO:tasks.workunit.client.0.smithi159.stdout:9/595: rename d4/d3d/d3e/d55/d37/d62/d8f/l94 to d4/d3d/d3e/d55/d9e/db3/lb7 0 2024-02-28T23:07:21.831 INFO:tasks.workunit.client.1.smithi184.stdout:8/158: getdents d1/da/dc/d16/d32 0 2024-02-28T23:07:21.831 INFO:tasks.workunit.client.0.smithi159.stdout:3/524: creat d0/d2b/d55/d75/d6d/d54/f9e x:0 0 0 2024-02-28T23:07:21.832 INFO:tasks.workunit.client.0.smithi159.stdout:3/525: fdatasync d0/d6/d3e/f7f 0 2024-02-28T23:07:21.835 INFO:tasks.workunit.client.0.smithi159.stdout:6/565: truncate d0/d1b/d33/d11/d34/d9d/da2/d52/f69 3896814 0 2024-02-28T23:07:21.835 INFO:tasks.workunit.client.1.smithi184.stdout:8/159: readlink d1/da/dc/d16/d32/l36 0 2024-02-28T23:07:21.837 INFO:tasks.workunit.client.0.smithi159.stdout:6/566: write d0/d1b/d33/d11/d14/f74 [210688,35699] 0 2024-02-28T23:07:21.839 INFO:tasks.workunit.client.1.smithi184.stdout:1/220: dread fb [0,4194304] 0 2024-02-28T23:07:21.839 INFO:tasks.workunit.client.0.smithi159.stdout:9/596: symlink d4/d3d/d3e/d6e/lb8 0 2024-02-28T23:07:21.842 INFO:tasks.workunit.client.0.smithi159.stdout:3/526: creat d0/d2b/d55/d75/d6d/d54/d7c/d79/f9f x:0 0 0 2024-02-28T23:07:21.843 INFO:tasks.workunit.client.0.smithi159.stdout:2/516: creat d9/d23/d2c/d55/fb6 x:0 0 0 2024-02-28T23:07:21.848 INFO:tasks.workunit.client.1.smithi184.stdout:3/145: getdents d1 0 2024-02-28T23:07:21.850 INFO:tasks.workunit.client.1.smithi184.stdout:3/146: read d1/f21 [3188660,17799] 0 2024-02-28T23:07:21.851 INFO:tasks.workunit.client.1.smithi184.stdout:9/158: creat d5/db/d29/f38 x:0 0 0 2024-02-28T23:07:21.851 INFO:tasks.workunit.client.0.smithi159.stdout:3/527: dread - d0/d6/d3e/d2f/f6b zero size 2024-02-28T23:07:21.852 INFO:tasks.workunit.client.1.smithi184.stdout:9/159: stat d5/d17/d2c/c32 0 2024-02-28T23:07:21.855 INFO:tasks.workunit.client.0.smithi159.stdout:6/567: chown d0/d1b/d33/d11/d34/d9d/da2/d52/f69 2979149 1 2024-02-28T23:07:21.855 INFO:tasks.workunit.client.0.smithi159.stdout:2/517: dread d9/d36/d59/f6b [0,4194304] 0 2024-02-28T23:07:21.864 INFO:tasks.workunit.client.1.smithi184.stdout:8/160: mknod d1/c44 0 2024-02-28T23:07:21.871 INFO:tasks.workunit.client.1.smithi184.stdout:8/161: symlink d1/da/d10/l45 0 2024-02-28T23:07:21.877 INFO:tasks.workunit.client.1.smithi184.stdout:9/160: dwrite d5/f7 [0,4194304] 0 2024-02-28T23:07:21.878 INFO:tasks.workunit.client.1.smithi184.stdout:8/162: write d1/da/dc/d16/f25 [65652,60785] 0 2024-02-28T23:07:21.885 INFO:tasks.workunit.client.0.smithi159.stdout:0/697: truncate d0/d5/ff 718272 0 2024-02-28T23:07:21.891 INFO:tasks.workunit.client.0.smithi159.stdout:2/518: dread d9/f11 [0,4194304] 0 2024-02-28T23:07:21.902 INFO:tasks.workunit.client.0.smithi159.stdout:2/519: rmdir d9/d23 39 2024-02-28T23:07:21.904 INFO:tasks.workunit.client.0.smithi159.stdout:9/597: dread d4/d3d/d3e/d55/d37/d62/f74 [0,4194304] 0 2024-02-28T23:07:21.915 INFO:tasks.workunit.client.1.smithi184.stdout:6/139: sync 2024-02-28T23:07:21.915 INFO:tasks.workunit.client.1.smithi184.stdout:0/162: dread d0/df/f15 [0,4194304] 0 2024-02-28T23:07:21.915 INFO:tasks.workunit.client.1.smithi184.stdout:3/147: dwrite d1/d4/d6/d1f/f2b [0,4194304] 0 2024-02-28T23:07:21.917 INFO:tasks.workunit.client.1.smithi184.stdout:8/163: stat d1/da/dc/c12 0 2024-02-28T23:07:21.918 INFO:tasks.workunit.client.1.smithi184.stdout:7/142: mkdir d6/d39 0 2024-02-28T23:07:21.918 INFO:tasks.workunit.client.1.smithi184.stdout:8/164: readlink d1/l9 0 2024-02-28T23:07:21.919 INFO:tasks.workunit.client.1.smithi184.stdout:3/148: stat d1/d4/d6/d1f/l28 0 2024-02-28T23:07:21.921 INFO:tasks.workunit.client.1.smithi184.stdout:6/140: write dc/de/d10/f23 [5042642,124181] 0 2024-02-28T23:07:21.923 INFO:tasks.workunit.client.1.smithi184.stdout:0/163: write d0/d1f/f25 [2009796,40163] 0 2024-02-28T23:07:21.927 INFO:tasks.workunit.client.1.smithi184.stdout:8/165: rmdir d1/da 39 2024-02-28T23:07:21.928 INFO:tasks.workunit.client.1.smithi184.stdout:3/149: stat d1/d4/d6/c10 0 2024-02-28T23:07:21.935 INFO:tasks.workunit.client.1.smithi184.stdout:5/141: dwrite db/d1f/f27 [0,4194304] 0 2024-02-28T23:07:21.936 INFO:tasks.workunit.client.1.smithi184.stdout:2/146: dwrite d10/f1d [0,4194304] 0 2024-02-28T23:07:21.936 INFO:tasks.workunit.client.1.smithi184.stdout:9/161: truncate d5/fc 461390 0 2024-02-28T23:07:21.939 INFO:tasks.workunit.client.1.smithi184.stdout:2/147: write d10/d13/f1a [1026655,24282] 0 2024-02-28T23:07:21.940 INFO:tasks.workunit.client.1.smithi184.stdout:8/166: link d1/da/df/f1f d1/da/dc/d16/d32/f46 0 2024-02-28T23:07:21.943 INFO:tasks.workunit.client.1.smithi184.stdout:5/142: creat db/d12/d1c/d21/f35 x:0 0 0 2024-02-28T23:07:21.944 INFO:tasks.workunit.client.1.smithi184.stdout:8/167: stat d1/da/f3a 0 2024-02-28T23:07:21.948 INFO:tasks.workunit.client.1.smithi184.stdout:2/148: dread d10/f2d [0,4194304] 0 2024-02-28T23:07:21.951 INFO:tasks.workunit.client.1.smithi184.stdout:0/164: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:21.954 INFO:tasks.workunit.client.1.smithi184.stdout:0/165: chown d0/d1d/c24 2169 1 2024-02-28T23:07:21.958 INFO:tasks.workunit.client.1.smithi184.stdout:3/150: dwrite d1/d4/d6/d1f/d26/f2a [0,4194304] 0 2024-02-28T23:07:21.968 INFO:tasks.workunit.client.1.smithi184.stdout:3/151: stat d1/d4/d6/c1a 0 2024-02-28T23:07:21.971 INFO:tasks.workunit.client.1.smithi184.stdout:3/152: chown d1/d4 100513399 1 2024-02-28T23:07:21.981 INFO:tasks.workunit.client.1.smithi184.stdout:3/153: rename d1/l12 to d1/d4/d1c/l2d 0 2024-02-28T23:07:21.981 INFO:tasks.workunit.client.1.smithi184.stdout:9/162: dread d5/f24 [0,4194304] 0 2024-02-28T23:07:21.983 INFO:tasks.workunit.client.1.smithi184.stdout:8/168: dwrite d1/da/df/d20/f26 [0,4194304] 0 2024-02-28T23:07:21.983 INFO:tasks.workunit.client.1.smithi184.stdout:0/166: dwrite d0/d1f/f26 [0,4194304] 0 2024-02-28T23:07:21.986 INFO:tasks.workunit.client.1.smithi184.stdout:9/163: creat d5/db/de/f39 x:0 0 0 2024-02-28T23:07:21.988 INFO:tasks.workunit.client.1.smithi184.stdout:8/169: creat d1/da/d10/d17/f47 x:0 0 0 2024-02-28T23:07:21.990 INFO:tasks.workunit.client.0.smithi159.stdout:7/477: rmdir d5/d16/d40 39 2024-02-28T23:07:21.991 INFO:tasks.workunit.client.0.smithi159.stdout:4/665: creat d9/da/fe6 x:0 0 0 2024-02-28T23:07:21.991 INFO:tasks.workunit.client.0.smithi159.stdout:3/528: write d0/d6/d3e/f5b [1180243,108698] 0 2024-02-28T23:07:21.991 INFO:tasks.workunit.client.0.smithi159.stdout:5/578: creat d8/fc1 x:0 0 0 2024-02-28T23:07:21.993 INFO:tasks.workunit.client.1.smithi184.stdout:0/167: creat d0/f37 x:0 0 0 2024-02-28T23:07:22.008 INFO:tasks.workunit.client.1.smithi184.stdout:7/143: dread d6/f30 [0,4194304] 0 2024-02-28T23:07:22.016 INFO:tasks.workunit.client.0.smithi159.stdout:7/478: dread d5/d16/f1f [0,4194304] 0 2024-02-28T23:07:22.018 INFO:tasks.workunit.client.1.smithi184.stdout:1/221: sync 2024-02-28T23:07:22.018 INFO:tasks.workunit.client.1.smithi184.stdout:4/146: sync 2024-02-28T23:07:22.019 INFO:tasks.workunit.client.1.smithi184.stdout:8/170: dwrite d1/da/df/f28 [0,4194304] 0 2024-02-28T23:07:22.024 INFO:tasks.workunit.client.0.smithi159.stdout:0/698: dread d0/d5/d14/d34/f3c [0,4194304] 0 2024-02-28T23:07:22.027 INFO:tasks.workunit.client.1.smithi184.stdout:9/164: dwrite d5/f9 [4194304,4194304] 0 2024-02-28T23:07:22.027 INFO:tasks.workunit.client.1.smithi184.stdout:2/149: dwrite d10/d13/d15/d24/f22 [0,4194304] 0 2024-02-28T23:07:22.030 INFO:tasks.workunit.client.1.smithi184.stdout:1/222: write f2 [3177866,39176] 0 2024-02-28T23:07:22.031 INFO:tasks.workunit.client.1.smithi184.stdout:4/147: unlink d1/d4/c15 0 2024-02-28T23:07:22.036 INFO:tasks.workunit.client.1.smithi184.stdout:8/171: write d1/da/dc/d16/f1b [1709493,25098] 0 2024-02-28T23:07:22.037 INFO:tasks.workunit.client.1.smithi184.stdout:9/165: truncate d5/db/de/f39 428383 0 2024-02-28T23:07:22.037 INFO:tasks.workunit.client.1.smithi184.stdout:4/148: dread - d1/dc/f23 zero size 2024-02-28T23:07:22.039 INFO:tasks.workunit.client.1.smithi184.stdout:7/144: rmdir d6/d39 0 2024-02-28T23:07:22.039 INFO:tasks.workunit.client.1.smithi184.stdout:4/149: chown d1/d29 954177107 1 2024-02-28T23:07:22.040 INFO:tasks.workunit.client.1.smithi184.stdout:0/168: dwrite d0/df/d13/f14 [0,4194304] 0 2024-02-28T23:07:22.046 INFO:tasks.workunit.client.1.smithi184.stdout:3/154: chown d1/d4/d6/d1f/d24/l25 8778819 1 2024-02-28T23:07:22.046 INFO:tasks.workunit.client.1.smithi184.stdout:6/141: dread dc/de/f1e [0,4194304] 0 2024-02-28T23:07:22.050 INFO:tasks.workunit.client.1.smithi184.stdout:8/172: fdatasync d1/da/dc/d16/f25 0 2024-02-28T23:07:22.050 INFO:tasks.workunit.client.1.smithi184.stdout:1/223: creat d20/d32/d3e/f4a x:0 0 0 2024-02-28T23:07:22.051 INFO:tasks.workunit.client.1.smithi184.stdout:1/224: stat f17 0 2024-02-28T23:07:22.053 INFO:tasks.workunit.client.1.smithi184.stdout:7/145: write d6/d9/da/dc/f1a [111213,101135] 0 2024-02-28T23:07:22.054 INFO:tasks.workunit.client.1.smithi184.stdout:1/225: truncate d20/d32/f44 492386 0 2024-02-28T23:07:22.054 INFO:tasks.workunit.client.1.smithi184.stdout:2/150: unlink d10/d13/d15/l2a 0 2024-02-28T23:07:22.055 INFO:tasks.workunit.client.1.smithi184.stdout:7/146: chown d6/f35 10 1 2024-02-28T23:07:22.057 INFO:tasks.workunit.client.1.smithi184.stdout:6/142: rmdir dc/de/d10 39 2024-02-28T23:07:22.059 INFO:tasks.workunit.client.1.smithi184.stdout:2/151: truncate d10/d13/f2c 165119 0 2024-02-28T23:07:22.061 INFO:tasks.workunit.client.0.smithi159.stdout:9/598: mkdir d4/d3d/d3e/d55/d37/d62/d77/db9 0 2024-02-28T23:07:22.061 INFO:tasks.workunit.client.1.smithi184.stdout:4/150: symlink d1/l2d 0 2024-02-28T23:07:22.062 INFO:tasks.workunit.client.1.smithi184.stdout:1/226: mkdir d20/d32/d4b 0 2024-02-28T23:07:22.064 INFO:tasks.workunit.client.0.smithi159.stdout:3/529: chown d0/l18 296676 1 2024-02-28T23:07:22.064 INFO:tasks.workunit.client.1.smithi184.stdout:7/147: mknod d6/d9/da/dc/c3a 0 2024-02-28T23:07:22.069 INFO:tasks.workunit.client.1.smithi184.stdout:2/152: mknod d10/d13/c31 0 2024-02-28T23:07:22.070 INFO:tasks.workunit.client.1.smithi184.stdout:9/166: dwrite d5/db/de/d10/f2b [0,4194304] 0 2024-02-28T23:07:22.074 INFO:tasks.workunit.client.0.smithi159.stdout:2/520: creat d9/d23/d2c/d55/fb7 x:0 0 0 2024-02-28T23:07:22.080 INFO:tasks.workunit.client.0.smithi159.stdout:3/530: creat d0/d2b/d55/d75/d6d/d54/d6a/fa0 x:0 0 0 2024-02-28T23:07:22.081 INFO:tasks.workunit.client.1.smithi184.stdout:7/148: rmdir d6/d9/d13/d1e/d2f 39 2024-02-28T23:07:22.081 INFO:tasks.workunit.client.1.smithi184.stdout:6/143: symlink dc/de/d10/d16/l32 0 2024-02-28T23:07:22.082 INFO:tasks.workunit.client.0.smithi159.stdout:3/531: chown d0/d6/d3e/d2f/c53 16298996 1 2024-02-28T23:07:22.082 INFO:tasks.workunit.client.1.smithi184.stdout:9/167: dread d5/db/de/d10/f1c [4194304,4194304] 0 2024-02-28T23:07:22.084 INFO:tasks.workunit.client.1.smithi184.stdout:8/173: dread d1/da/dc/d16/f1b [0,4194304] 0 2024-02-28T23:07:22.085 INFO:tasks.workunit.client.0.smithi159.stdout:4/666: creat d9/da/d1c/d23/d2d/de1/fe7 x:0 0 0 2024-02-28T23:07:22.086 INFO:tasks.workunit.client.1.smithi184.stdout:8/174: fdatasync d1/da/df/f22 0 2024-02-28T23:07:22.086 INFO:tasks.workunit.client.1.smithi184.stdout:9/168: truncate d5/db/de/f21 1764331 0 2024-02-28T23:07:22.086 INFO:tasks.workunit.client.1.smithi184.stdout:4/151: mknod d1/dc/df/d27/c2e 0 2024-02-28T23:07:22.088 INFO:tasks.workunit.client.1.smithi184.stdout:2/153: link fe d10/d1f/f32 0 2024-02-28T23:07:22.088 INFO:tasks.workunit.client.1.smithi184.stdout:9/169: write d5/db/de/f39 [759550,75320] 0 2024-02-28T23:07:22.090 INFO:tasks.workunit.client.0.smithi159.stdout:9/599: truncate d4/f5 1567590 0 2024-02-28T23:07:22.091 INFO:tasks.workunit.client.1.smithi184.stdout:9/170: write d5/d17/f28 [4958349,124439] 0 2024-02-28T23:07:22.094 INFO:tasks.workunit.client.0.smithi159.stdout:5/579: rename d8/d19/d23/d35/f62 to d8/d19/d23/d35/fc2 0 2024-02-28T23:07:22.096 INFO:tasks.workunit.client.1.smithi184.stdout:7/149: fsync d6/d9/da/dc/f2b 0 2024-02-28T23:07:22.096 INFO:tasks.workunit.client.0.smithi159.stdout:4/667: fdatasync d9/f8c 0 2024-02-28T23:07:22.099 INFO:tasks.workunit.client.0.smithi159.stdout:7/479: creat d5/d16/d1a/f9a x:0 0 0 2024-02-28T23:07:22.099 INFO:tasks.workunit.client.1.smithi184.stdout:6/144: dwrite dc/de/f20 [0,4194304] 0 2024-02-28T23:07:22.101 INFO:tasks.workunit.client.1.smithi184.stdout:4/152: write d1/dc/fd [610781,6227] 0 2024-02-28T23:07:22.101 INFO:tasks.workunit.client.0.smithi159.stdout:0/699: write d0/d5/d14/d25/f31 [835784,113798] 0 2024-02-28T23:07:22.103 INFO:tasks.workunit.client.1.smithi184.stdout:6/145: write dc/f26 [884598,96492] 0 2024-02-28T23:07:22.104 INFO:tasks.workunit.client.1.smithi184.stdout:2/154: mkdir d10/d33 0 2024-02-28T23:07:22.107 INFO:tasks.workunit.client.1.smithi184.stdout:8/175: dwrite d1/da/df/d20/f26 [0,4194304] 0 2024-02-28T23:07:22.110 INFO:tasks.workunit.client.1.smithi184.stdout:5/143: sync 2024-02-28T23:07:22.118 INFO:tasks.workunit.client.0.smithi159.stdout:2/521: write d9/d50/d54/d84/f6d [188628,125219] 0 2024-02-28T23:07:22.122 INFO:tasks.workunit.client.0.smithi159.stdout:7/480: creat d5/f9b x:0 0 0 2024-02-28T23:07:22.123 INFO:tasks.workunit.client.1.smithi184.stdout:1/227: dwrite fe [0,4194304] 0 2024-02-28T23:07:22.125 INFO:tasks.workunit.client.0.smithi159.stdout:3/532: rename d0/l40 to d0/d2b/d55/d75/d6d/d54/d6a/la1 0 2024-02-28T23:07:22.127 INFO:tasks.workunit.client.1.smithi184.stdout:6/146: mknod dc/de/d10/d16/c33 0 2024-02-28T23:07:22.130 INFO:tasks.workunit.client.0.smithi159.stdout:9/600: write d4/d3d/d3e/d4a/f59 [73819,24813] 0 2024-02-28T23:07:22.130 INFO:tasks.workunit.client.1.smithi184.stdout:8/176: write d1/da/dc/d16/f1b [3250516,50626] 0 2024-02-28T23:07:22.130 INFO:tasks.workunit.client.1.smithi184.stdout:2/155: dwrite d10/f14 [0,4194304] 0 2024-02-28T23:07:22.131 INFO:tasks.workunit.client.1.smithi184.stdout:4/153: symlink d1/l2f 0 2024-02-28T23:07:22.131 INFO:tasks.workunit.client.0.smithi159.stdout:1/570: sync 2024-02-28T23:07:22.132 INFO:tasks.workunit.client.0.smithi159.stdout:8/707: sync 2024-02-28T23:07:22.133 INFO:tasks.workunit.client.1.smithi184.stdout:2/156: write d10/f11 [3969894,77603] 0 2024-02-28T23:07:22.134 INFO:tasks.workunit.client.0.smithi159.stdout:5/580: write d8/d19/d23/d35/d41/f5d [4160451,41552] 0 2024-02-28T23:07:22.136 INFO:tasks.workunit.client.1.smithi184.stdout:1/228: rename d20/d32/l38 to d20/d46/l4c 0 2024-02-28T23:07:22.137 INFO:tasks.workunit.client.0.smithi159.stdout:2/522: rename d9/d50/d54/f94 to d9/d50/d54/fb8 0 2024-02-28T23:07:22.137 INFO:tasks.workunit.client.1.smithi184.stdout:2/157: write d10/d13/d15/f2b [7093,104222] 0 2024-02-28T23:07:22.138 INFO:tasks.workunit.client.0.smithi159.stdout:5/581: fdatasync d8/d19/d23/d35/d41/d77/fad 0 2024-02-28T23:07:22.140 INFO:tasks.workunit.client.1.smithi184.stdout:6/147: creat dc/de/d10/d16/f34 x:0 0 0 2024-02-28T23:07:22.143 INFO:tasks.workunit.client.1.smithi184.stdout:1/229: write d20/d32/f34 [142992,2895] 0 2024-02-28T23:07:22.147 INFO:tasks.workunit.client.1.smithi184.stdout:5/144: creat db/d12/d18/d2e/f36 x:0 0 0 2024-02-28T23:07:22.149 INFO:tasks.workunit.client.0.smithi159.stdout:1/571: mkdir d6/d12/d31/d69/dc0 0 2024-02-28T23:07:22.150 INFO:tasks.workunit.client.1.smithi184.stdout:9/171: dwrite d5/db/f16 [0,4194304] 0 2024-02-28T23:07:22.152 INFO:tasks.workunit.client.1.smithi184.stdout:4/154: mknod d1/c30 0 2024-02-28T23:07:22.152 INFO:tasks.workunit.client.1.smithi184.stdout:9/172: chown d5/f24 19 1 2024-02-28T23:07:22.154 INFO:tasks.workunit.client.0.smithi159.stdout:7/481: symlink d5/d16/d1a/d27/d46/d65/d81/d98/l9c 0 2024-02-28T23:07:22.154 INFO:tasks.workunit.client.1.smithi184.stdout:6/148: creat dc/de/d2a/f35 x:0 0 0 2024-02-28T23:07:22.155 INFO:tasks.workunit.client.1.smithi184.stdout:4/155: write d1/dc/f23 [936331,56169] 0 2024-02-28T23:07:22.156 INFO:tasks.workunit.client.0.smithi159.stdout:0/700: dwrite d0/d5/d38/f89 [0,4194304] 0 2024-02-28T23:07:22.157 INFO:tasks.workunit.client.1.smithi184.stdout:1/230: mkdir d20/d32/d4d 0 2024-02-28T23:07:22.158 INFO:tasks.workunit.client.1.smithi184.stdout:4/156: fdatasync d1/f12 0 2024-02-28T23:07:22.160 INFO:tasks.workunit.client.1.smithi184.stdout:6/149: chown dc/de/d10/d16/f2d 18852 1 2024-02-28T23:07:22.160 INFO:tasks.workunit.client.1.smithi184.stdout:9/173: truncate d5/db/de/d10/d12/f2d 156561 0 2024-02-28T23:07:22.164 INFO:tasks.workunit.client.1.smithi184.stdout:2/158: dwrite d10/d13/d15/f2b [0,4194304] 0 2024-02-28T23:07:22.165 INFO:tasks.workunit.client.1.smithi184.stdout:8/177: symlink d1/da/dc/d16/d32/d42/l48 0 2024-02-28T23:07:22.166 INFO:tasks.workunit.client.1.smithi184.stdout:5/145: creat db/d1f/d32/f37 x:0 0 0 2024-02-28T23:07:22.167 INFO:tasks.workunit.client.1.smithi184.stdout:2/159: readlink d10/d13/d15/l25 0 2024-02-28T23:07:22.174 INFO:tasks.workunit.client.1.smithi184.stdout:2/160: write d10/d13/d15/d24/f22 [5119038,72299] 0 2024-02-28T23:07:22.174 INFO:tasks.workunit.client.1.smithi184.stdout:8/178: dread - d1/da/d10/d17/f47 zero size 2024-02-28T23:07:22.175 INFO:tasks.workunit.client.0.smithi159.stdout:4/668: getdents d9/da/d1c/d23/d7a 0 2024-02-28T23:07:22.176 INFO:tasks.workunit.client.1.smithi184.stdout:9/174: dread d5/db/de/f21 [0,4194304] 0 2024-02-28T23:07:22.176 INFO:tasks.workunit.client.1.smithi184.stdout:5/146: creat db/d12/d18/d2e/f38 x:0 0 0 2024-02-28T23:07:22.178 INFO:tasks.workunit.client.0.smithi159.stdout:2/523: write d9/d23/d2c/f32 [2551372,7680] 0 2024-02-28T23:07:22.181 INFO:tasks.workunit.client.0.smithi159.stdout:7/482: dwrite d5/d56/d50/f80 [0,4194304] 0 2024-02-28T23:07:22.181 INFO:tasks.workunit.client.1.smithi184.stdout:1/231: rename l10 to d20/l4e 0 2024-02-28T23:07:22.182 INFO:tasks.workunit.client.1.smithi184.stdout:1/232: truncate f1c 635315 0 2024-02-28T23:07:22.182 INFO:tasks.workunit.client.0.smithi159.stdout:2/524: fsync d9/d50/d62/fa6 0 2024-02-28T23:07:22.182 INFO:tasks.workunit.client.0.smithi159.stdout:3/533: rmdir d0/d2b/d55/d75/d6d/d8b 0 2024-02-28T23:07:22.183 INFO:tasks.workunit.client.1.smithi184.stdout:2/161: stat l7 0 2024-02-28T23:07:22.183 INFO:tasks.workunit.client.1.smithi184.stdout:0/169: sync 2024-02-28T23:07:22.185 INFO:tasks.workunit.client.1.smithi184.stdout:0/170: fdatasync d0/df/f11 0 2024-02-28T23:07:22.186 INFO:tasks.workunit.client.0.smithi159.stdout:2/525: chown d9/d50/d54/f66 3262 1 2024-02-28T23:07:22.186 INFO:tasks.workunit.client.0.smithi159.stdout:9/601: truncate d4/f11 433475 0 2024-02-28T23:07:22.190 INFO:tasks.workunit.client.1.smithi184.stdout:4/157: write d1/d4/f1f [1582022,30790] 0 2024-02-28T23:07:22.192 INFO:tasks.workunit.client.0.smithi159.stdout:8/708: rename d2/c28 to d2/d11/d52/ce1 0 2024-02-28T23:07:22.194 INFO:tasks.workunit.client.1.smithi184.stdout:2/162: rmdir d10 39 2024-02-28T23:07:22.200 INFO:tasks.workunit.client.0.smithi159.stdout:7/483: mkdir d5/d16/d1a/d27/d46/d65/d81/d83/d9d 0 2024-02-28T23:07:22.201 INFO:tasks.workunit.client.1.smithi184.stdout:1/233: dwrite d20/d32/f48 [0,4194304] 0 2024-02-28T23:07:22.202 INFO:tasks.workunit.client.0.smithi159.stdout:5/582: rename d8/d19/d23/d35/f99 to d8/d19/d23/d35/fc3 0 2024-02-28T23:07:22.203 INFO:tasks.workunit.client.0.smithi159.stdout:7/484: chown d5/d56/d50/f58 784 1 2024-02-28T23:07:22.203 INFO:tasks.workunit.client.1.smithi184.stdout:1/234: truncate d20/f2c 873702 0 2024-02-28T23:07:22.205 INFO:tasks.workunit.client.1.smithi184.stdout:3/155: sync 2024-02-28T23:07:22.205 INFO:tasks.workunit.client.1.smithi184.stdout:7/150: sync 2024-02-28T23:07:22.206 INFO:tasks.workunit.client.0.smithi159.stdout:3/534: symlink d0/d2b/d55/d75/d6d/d54/d6a/la2 0 2024-02-28T23:07:22.210 INFO:tasks.workunit.client.1.smithi184.stdout:4/158: creat d1/dc/df/f31 x:0 0 0 2024-02-28T23:07:22.211 INFO:tasks.workunit.client.1.smithi184.stdout:4/159: chown d1/d8 28975278 1 2024-02-28T23:07:22.212 INFO:tasks.workunit.client.0.smithi159.stdout:1/572: creat d6/fc1 x:0 0 0 2024-02-28T23:07:22.213 INFO:tasks.workunit.client.1.smithi184.stdout:4/160: write d1/d4/f11 [3637944,126318] 0 2024-02-28T23:07:22.215 INFO:tasks.workunit.client.0.smithi159.stdout:4/669: dwrite d9/d42/d54/f80 [0,4194304] 0 2024-02-28T23:07:22.217 INFO:tasks.workunit.client.1.smithi184.stdout:0/171: dread d0/d1f/f25 [0,4194304] 0 2024-02-28T23:07:22.219 INFO:tasks.workunit.client.0.smithi159.stdout:0/701: link d0/d5/d14/d25/fa9 d0/d5/d14/d34/d6c/ffa 0 2024-02-28T23:07:22.224 INFO:tasks.workunit.client.1.smithi184.stdout:9/175: truncate d5/db/de/d10/f2b 540415 0 2024-02-28T23:07:22.226 INFO:tasks.workunit.client.0.smithi159.stdout:2/526: write d9/d23/d2c/d55/f29 [1145519,48664] 0 2024-02-28T23:07:22.228 INFO:tasks.workunit.client.1.smithi184.stdout:8/179: link d1/da/d10/d17/l27 d1/da/d10/d17/l49 0 2024-02-28T23:07:22.229 INFO:tasks.workunit.client.0.smithi159.stdout:5/583: mknod d8/d19/d23/d35/d38/d6d/cc4 0 2024-02-28T23:07:22.230 INFO:tasks.workunit.client.0.smithi159.stdout:7/485: mkdir d5/d16/d1a/d27/d46/d65/d81/d98/d9e 0 2024-02-28T23:07:22.233 INFO:tasks.workunit.client.0.smithi159.stdout:6/568: sync 2024-02-28T23:07:22.233 INFO:tasks.workunit.client.0.smithi159.stdout:2/527: truncate d9/d50/d54/d84/d37/d5c/fa3 812604 0 2024-02-28T23:07:22.234 INFO:tasks.workunit.client.0.smithi159.stdout:1/573: dwrite d6/d1d/d1f/fa8 [4194304,4194304] 0 2024-02-28T23:07:22.234 INFO:tasks.workunit.client.1.smithi184.stdout:3/156: mkdir d1/d4/d6/d2e 0 2024-02-28T23:07:22.237 INFO:tasks.workunit.client.1.smithi184.stdout:8/180: dread d1/da/f31 [0,4194304] 0 2024-02-28T23:07:22.237 INFO:tasks.workunit.client.1.smithi184.stdout:6/150: rename dc/de/d10/d16/f2f to dc/de/f36 0 2024-02-28T23:07:22.244 INFO:tasks.workunit.client.0.smithi159.stdout:9/602: symlink d4/d3d/d3e/d55/d4c/lba 0 2024-02-28T23:07:22.246 INFO:tasks.workunit.client.1.smithi184.stdout:0/172: creat d0/d1f/f38 x:0 0 0 2024-02-28T23:07:22.247 INFO:tasks.workunit.client.1.smithi184.stdout:5/147: getdents db/d12/d18 0 2024-02-28T23:07:22.247 INFO:tasks.workunit.client.0.smithi159.stdout:4/670: mknod d9/d42/d54/d55/da8/ce8 0 2024-02-28T23:07:22.249 INFO:tasks.workunit.client.1.smithi184.stdout:5/148: dread - db/d12/d1c/d21/f35 zero size 2024-02-28T23:07:22.249 INFO:tasks.workunit.client.1.smithi184.stdout:9/176: unlink d5/f1d 0 2024-02-28T23:07:22.250 INFO:tasks.workunit.client.1.smithi184.stdout:1/235: symlink d20/d32/d4d/l4f 0 2024-02-28T23:07:22.251 INFO:tasks.workunit.client.1.smithi184.stdout:5/149: write db/d1f/d32/f37 [45821,128499] 0 2024-02-28T23:07:22.252 INFO:tasks.workunit.client.1.smithi184.stdout:3/157: symlink d1/d4/d5/l2f 0 2024-02-28T23:07:22.253 INFO:tasks.workunit.client.0.smithi159.stdout:7/486: truncate d5/fe 1229336 0 2024-02-28T23:07:22.253 INFO:tasks.workunit.client.1.smithi184.stdout:9/177: dread d5/db/de/d10/d12/f2d [0,4194304] 0 2024-02-28T23:07:22.254 INFO:tasks.workunit.client.1.smithi184.stdout:8/181: symlink d1/da/dc/d18/l4a 0 2024-02-28T23:07:22.254 INFO:tasks.workunit.client.1.smithi184.stdout:1/236: dread d20/d32/f44 [0,4194304] 0 2024-02-28T23:07:22.255 INFO:tasks.workunit.client.1.smithi184.stdout:3/158: chown d1/d4/f14 15 1 2024-02-28T23:07:22.256 INFO:tasks.workunit.client.1.smithi184.stdout:6/151: rename dc/f30 to dc/de/d10/d16/f37 0 2024-02-28T23:07:22.257 INFO:tasks.workunit.client.0.smithi159.stdout:7/487: dread d5/d56/d50/f58 [0,4194304] 0 2024-02-28T23:07:22.258 INFO:tasks.workunit.client.0.smithi159.stdout:1/574: creat d6/d1d/d1f/d3e/d9c/fc2 x:0 0 0 2024-02-28T23:07:22.259 INFO:tasks.workunit.client.0.smithi159.stdout:7/488: chown d5/d16/d1a/f96 0 1 2024-02-28T23:07:22.260 INFO:tasks.workunit.client.0.smithi159.stdout:1/575: chown d6/d1d/f99 45 1 2024-02-28T23:07:22.261 INFO:tasks.workunit.client.0.smithi159.stdout:3/535: rename d0/d2b/d55/d75/l4d to d0/d2b/d55/d6e/la3 0 2024-02-28T23:07:22.261 INFO:tasks.workunit.client.1.smithi184.stdout:4/161: truncate d1/f12 4025069 0 2024-02-28T23:07:22.262 INFO:tasks.workunit.client.0.smithi159.stdout:1/576: chown d6/d12/d1a/f2b 265708 1 2024-02-28T23:07:22.264 INFO:tasks.workunit.client.0.smithi159.stdout:8/709: rmdir d2/d73/dc9 0 2024-02-28T23:07:22.266 INFO:tasks.workunit.client.0.smithi159.stdout:4/671: symlink d9/d42/d54/d55/le9 0 2024-02-28T23:07:22.267 INFO:tasks.workunit.client.1.smithi184.stdout:1/237: dread d20/d32/f48 [0,4194304] 0 2024-02-28T23:07:22.269 INFO:tasks.workunit.client.0.smithi159.stdout:5/584: fsync d8/d19/d23/d35/fc3 0 2024-02-28T23:07:22.272 INFO:tasks.workunit.client.1.smithi184.stdout:6/152: dwrite dc/de/d10/f24 [0,4194304] 0 2024-02-28T23:07:22.272 INFO:tasks.workunit.client.0.smithi159.stdout:5/585: read d8/d19/d23/f91 [1888419,60175] 0 2024-02-28T23:07:22.275 INFO:tasks.workunit.client.0.smithi159.stdout:5/586: chown d8/d19/d23/d2a/f4e 951528907 1 2024-02-28T23:07:22.277 INFO:tasks.workunit.client.0.smithi159.stdout:7/489: unlink d5/d16/d1a/f38 0 2024-02-28T23:07:22.279 INFO:tasks.workunit.client.1.smithi184.stdout:4/162: dwrite d1/dc/fd [4194304,4194304] 0 2024-02-28T23:07:22.282 INFO:tasks.workunit.client.0.smithi159.stdout:3/536: creat d0/d47/fa4 x:0 0 0 2024-02-28T23:07:22.283 INFO:tasks.workunit.client.0.smithi159.stdout:9/603: write d4/f26 [2045474,92458] 0 2024-02-28T23:07:22.283 INFO:tasks.workunit.client.0.smithi159.stdout:2/528: dwrite d9/d50/d62/f68 [4194304,4194304] 0 2024-02-28T23:07:22.286 INFO:tasks.workunit.client.0.smithi159.stdout:1/577: chown d6/d12/ff 117447402 1 2024-02-28T23:07:22.290 INFO:tasks.workunit.client.0.smithi159.stdout:1/578: truncate d6/d1d/d46/d88/f94 1120137 0 2024-02-28T23:07:22.294 INFO:tasks.workunit.client.0.smithi159.stdout:8/710: fdatasync d2/d11/d52/d26/d36/d38/f5d 0 2024-02-28T23:07:22.295 INFO:tasks.workunit.client.1.smithi184.stdout:7/151: rename d6/d9/d13/d14/f2e to d6/d9/d13/d1e/d2f/d34/f3b 0 2024-02-28T23:07:22.295 INFO:tasks.workunit.client.0.smithi159.stdout:8/711: stat d2/d3/l7 0 2024-02-28T23:07:22.297 INFO:tasks.workunit.client.0.smithi159.stdout:4/672: creat d9/da/d1c/dc3/fea x:0 0 0 2024-02-28T23:07:22.297 INFO:tasks.workunit.client.1.smithi184.stdout:7/152: read - d6/d9/d13/f1f zero size 2024-02-28T23:07:22.298 INFO:tasks.workunit.client.0.smithi159.stdout:6/569: truncate d0/d1b/f1a 7150368 0 2024-02-28T23:07:22.303 INFO:tasks.workunit.client.0.smithi159.stdout:0/702: creat d0/d5/d14/ffb x:0 0 0 2024-02-28T23:07:22.304 INFO:tasks.workunit.client.0.smithi159.stdout:6/570: write d0/d1b/d33/d11/d14/d49/f5c [948219,17573] 0 2024-02-28T23:07:22.307 INFO:tasks.workunit.client.1.smithi184.stdout:1/238: creat d20/f50 x:0 0 0 2024-02-28T23:07:22.307 INFO:tasks.workunit.client.1.smithi184.stdout:9/178: dwrite d5/f24 [0,4194304] 0 2024-02-28T23:07:22.312 INFO:tasks.workunit.client.1.smithi184.stdout:4/163: symlink d1/d4/l32 0 2024-02-28T23:07:22.312 INFO:tasks.workunit.client.1.smithi184.stdout:5/150: getdents db/d12/d1c/d21/d2f 0 2024-02-28T23:07:22.313 INFO:tasks.workunit.client.1.smithi184.stdout:3/159: truncate d1/f21 4699461 0 2024-02-28T23:07:22.313 INFO:tasks.workunit.client.1.smithi184.stdout:9/179: write d5/f13 [1645773,31754] 0 2024-02-28T23:07:22.314 INFO:tasks.workunit.client.0.smithi159.stdout:2/529: truncate d9/d50/d54/d84/d37/d5c/f7b 1963560 0 2024-02-28T23:07:22.315 INFO:tasks.workunit.client.1.smithi184.stdout:4/164: write d1/d4/f1f [1798489,8141] 0 2024-02-28T23:07:22.315 INFO:tasks.workunit.client.0.smithi159.stdout:1/579: symlink d6/d12/d33/da7/lc3 0 2024-02-28T23:07:22.321 INFO:tasks.workunit.client.1.smithi184.stdout:2/163: getdents d10/d1f 0 2024-02-28T23:07:22.333 INFO:tasks.workunit.client.1.smithi184.stdout:7/153: truncate d6/d9/da/dc/f2b 2741161 0 2024-02-28T23:07:22.334 INFO:tasks.workunit.client.0.smithi159.stdout:5/587: write d8/d19/d23/d35/d65/f83 [2213535,77208] 0 2024-02-28T23:07:22.335 INFO:tasks.workunit.client.0.smithi159.stdout:5/588: readlink d8/d16/l63 0 2024-02-28T23:07:22.336 INFO:tasks.workunit.client.0.smithi159.stdout:7/490: fsync d5/fe 0 2024-02-28T23:07:22.338 INFO:tasks.workunit.client.1.smithi184.stdout:1/239: mkdir d20/d32/d51 0 2024-02-28T23:07:22.339 INFO:tasks.workunit.client.0.smithi159.stdout:9/604: symlink d4/d3d/d3e/lbb 0 2024-02-28T23:07:22.339 INFO:tasks.workunit.client.0.smithi159.stdout:7/491: chown d5/d16/d1a/d27/d46/d65/f6f 470 1 2024-02-28T23:07:22.347 INFO:tasks.workunit.client.0.smithi159.stdout:6/571: dwrite d0/d1b/d33/d11/d14/f28 [0,4194304] 0 2024-02-28T23:07:22.349 INFO:tasks.workunit.client.0.smithi159.stdout:4/673: rename d9/d20/d81 to d9/da/d1c/d8e/deb 0 2024-02-28T23:07:22.353 INFO:tasks.workunit.client.0.smithi159.stdout:8/712: dwrite d2/d11/d52/d47/f51 [0,4194304] 0 2024-02-28T23:07:22.353 INFO:tasks.workunit.client.0.smithi159.stdout:6/572: dread d0/f2b [0,4194304] 0 2024-02-28T23:07:22.355 INFO:tasks.workunit.client.1.smithi184.stdout:5/151: creat db/d12/f39 x:0 0 0 2024-02-28T23:07:22.357 INFO:tasks.workunit.client.1.smithi184.stdout:9/180: symlink d5/d26/l3a 0 2024-02-28T23:07:22.361 INFO:tasks.workunit.client.0.smithi159.stdout:6/573: dread d0/f9 [0,4194304] 0 2024-02-28T23:07:22.362 INFO:tasks.workunit.client.0.smithi159.stdout:3/537: truncate d0/d6/d3e/f5b 314750 0 2024-02-28T23:07:22.363 INFO:tasks.workunit.client.1.smithi184.stdout:6/153: truncate dc/de/d10/f24 470104 0 2024-02-28T23:07:22.364 INFO:tasks.workunit.client.0.smithi159.stdout:2/530: write d9/d50/faa [2968193,68187] 0 2024-02-28T23:07:22.365 INFO:tasks.workunit.client.1.smithi184.stdout:0/173: sync 2024-02-28T23:07:22.365 INFO:tasks.workunit.client.0.smithi159.stdout:3/538: chown d0/d6/d3e/d2f/c3c 908 1 2024-02-28T23:07:22.367 INFO:tasks.workunit.client.0.smithi159.stdout:3/539: fsync d0/f8f 0 2024-02-28T23:07:22.367 INFO:tasks.workunit.client.1.smithi184.stdout:2/164: creat d10/f34 x:0 0 0 2024-02-28T23:07:22.367 INFO:tasks.workunit.client.1.smithi184.stdout:7/154: creat d6/d9/da/dc/f3c x:0 0 0 2024-02-28T23:07:22.368 INFO:tasks.workunit.client.1.smithi184.stdout:6/154: truncate dc/de/d10/d16/f2d 13859 0 2024-02-28T23:07:22.371 INFO:tasks.workunit.client.0.smithi159.stdout:0/703: rename d0/d5/d38/d76/cd1 to d0/d5/d14/d25/d2c/dab/dc5/cfc 0 2024-02-28T23:07:22.372 INFO:tasks.workunit.client.0.smithi159.stdout:8/713: creat d2/d73/dc2/fe2 x:0 0 0 2024-02-28T23:07:22.373 INFO:tasks.workunit.client.0.smithi159.stdout:8/714: stat d2/d3/c6 0 2024-02-28T23:07:22.373 INFO:tasks.workunit.client.1.smithi184.stdout:1/240: mknod d20/d32/d3e/c52 0 2024-02-28T23:07:22.375 INFO:tasks.workunit.client.1.smithi184.stdout:8/182: getdents d1/da 0 2024-02-28T23:07:22.376 INFO:tasks.workunit.client.0.smithi159.stdout:9/605: write d4/d3d/d3e/d55/d37/d62/d6a/f89 [596978,94882] 0 2024-02-28T23:07:22.377 INFO:tasks.workunit.client.0.smithi159.stdout:6/574: unlink d0/d1b/d33/d11/d34/d9d/da2/d4d/l77 0 2024-02-28T23:07:22.378 INFO:tasks.workunit.client.1.smithi184.stdout:5/152: rmdir db/d12/d1c/d21/d25 39 2024-02-28T23:07:22.380 INFO:tasks.workunit.client.0.smithi159.stdout:2/531: unlink d9/d36/f88 0 2024-02-28T23:07:22.381 INFO:tasks.workunit.client.1.smithi184.stdout:3/160: mknod d1/d4/d6/d1e/c30 0 2024-02-28T23:07:22.382 INFO:tasks.workunit.client.1.smithi184.stdout:3/161: chown d1/d4/d5 1979960359 1 2024-02-28T23:07:22.382 INFO:tasks.workunit.client.0.smithi159.stdout:3/540: truncate d0/d6/d3e/d2f/f6b 281043 0 2024-02-28T23:07:22.385 INFO:tasks.workunit.client.0.smithi159.stdout:5/589: rename d8/d59/f80 to d8/d19/d23/d35/d41/daa/fc5 0 2024-02-28T23:07:22.386 INFO:tasks.workunit.client.1.smithi184.stdout:2/165: fsync d10/f2d 0 2024-02-28T23:07:22.388 INFO:tasks.workunit.client.1.smithi184.stdout:0/174: creat d0/df/d13/d27/f39 x:0 0 0 2024-02-28T23:07:22.389 INFO:tasks.workunit.client.0.smithi159.stdout:4/674: rename d9/f19 to d9/fec 0 2024-02-28T23:07:22.390 INFO:tasks.workunit.client.0.smithi159.stdout:8/715: dwrite d2/d3/fde [0,4194304] 0 2024-02-28T23:07:22.391 INFO:tasks.workunit.client.1.smithi184.stdout:8/183: dwrite d1/da/d10/d17/f47 [0,4194304] 0 2024-02-28T23:07:22.391 INFO:tasks.workunit.client.0.smithi159.stdout:4/675: fdatasync d9/d4c/fb7 0 2024-02-28T23:07:22.393 INFO:tasks.workunit.client.1.smithi184.stdout:8/184: write d1/da/dc/d16/f25 [1110195,55923] 0 2024-02-28T23:07:22.398 INFO:tasks.workunit.client.0.smithi159.stdout:2/532: creat d9/d34/d44/fb9 x:0 0 0 2024-02-28T23:07:22.400 INFO:tasks.workunit.client.0.smithi159.stdout:6/575: dwrite d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/f9b [0,4194304] 0 2024-02-28T23:07:22.403 INFO:tasks.workunit.client.0.smithi159.stdout:2/533: write d9/d50/d54/d84/f97 [160116,108273] 0 2024-02-28T23:07:22.405 INFO:tasks.workunit.client.0.smithi159.stdout:3/541: mkdir d0/d47/d88/da5 0 2024-02-28T23:07:22.407 INFO:tasks.workunit.client.1.smithi184.stdout:4/165: creat d1/f33 x:0 0 0 2024-02-28T23:07:22.409 INFO:tasks.workunit.client.0.smithi159.stdout:2/534: write d9/d50/d54/d84/d37/d5c/f99 [919978,121288] 0 2024-02-28T23:07:22.414 INFO:tasks.workunit.client.0.smithi159.stdout:7/492: rename d5/l7 to d5/d16/d1a/d27/d46/d65/l9f 0 2024-02-28T23:07:22.417 INFO:tasks.workunit.client.1.smithi184.stdout:3/162: creat d1/d4/d1c/f31 x:0 0 0 2024-02-28T23:07:22.424 INFO:tasks.workunit.client.0.smithi159.stdout:5/590: creat d8/d19/d23/d35/d41/fc6 x:0 0 0 2024-02-28T23:07:22.425 INFO:tasks.workunit.client.1.smithi184.stdout:2/166: fsync d10/d1f/f32 0 2024-02-28T23:07:22.426 INFO:tasks.workunit.client.0.smithi159.stdout:9/606: symlink d4/d3d/d3e/d55/d4c/db6/lbc 0 2024-02-28T23:07:22.427 INFO:tasks.workunit.client.1.smithi184.stdout:2/167: write d10/f1d [3404803,44640] 0 2024-02-28T23:07:22.427 INFO:tasks.workunit.client.1.smithi184.stdout:0/175: rmdir d0/df 39 2024-02-28T23:07:22.429 INFO:tasks.workunit.client.1.smithi184.stdout:0/176: chown d0/f17 4496322 1 2024-02-28T23:07:22.430 INFO:tasks.workunit.client.0.smithi159.stdout:4/676: creat d9/d42/dc8/fed x:0 0 0 2024-02-28T23:07:22.433 INFO:tasks.workunit.client.0.smithi159.stdout:6/576: mknod d0/d1b/d5b/cb5 0 2024-02-28T23:07:22.435 INFO:tasks.workunit.client.0.smithi159.stdout:6/577: chown d0/d1b/d5b/cb5 50074864 1 2024-02-28T23:07:22.437 INFO:tasks.workunit.client.0.smithi159.stdout:2/535: mkdir d9/d50/d62/dba 0 2024-02-28T23:07:22.438 INFO:tasks.workunit.client.1.smithi184.stdout:7/155: creat d6/f3d x:0 0 0 2024-02-28T23:07:22.439 INFO:tasks.workunit.client.0.smithi159.stdout:0/704: write d0/d5/d14/d25/d2c/fd4 [45187,29838] 0 2024-02-28T23:07:22.440 INFO:tasks.workunit.client.1.smithi184.stdout:4/166: mkdir d1/dc/df/d27/d34 0 2024-02-28T23:07:22.441 INFO:tasks.workunit.client.1.smithi184.stdout:9/181: dwrite d5/db/de/d10/f2b [0,4194304] 0 2024-02-28T23:07:22.443 INFO:tasks.workunit.client.1.smithi184.stdout:3/163: creat d1/d4/d5/f32 x:0 0 0 2024-02-28T23:07:22.447 INFO:tasks.workunit.client.0.smithi159.stdout:5/591: mknod d8/d19/d23/d35/d41/daa/cc7 0 2024-02-28T23:07:22.448 INFO:tasks.workunit.client.1.smithi184.stdout:3/164: write d1/d4/d5/f32 [594394,107075] 0 2024-02-28T23:07:22.448 INFO:tasks.workunit.client.1.smithi184.stdout:8/185: dwrite d1/da/df/d20/f3e [0,4194304] 0 2024-02-28T23:07:22.449 INFO:tasks.workunit.client.0.smithi159.stdout:5/592: chown d8/d19/d23/d2a 185995837 1 2024-02-28T23:07:22.449 INFO:tasks.workunit.client.0.smithi159.stdout:9/607: chown d4/d52/l97 45700609 1 2024-02-28T23:07:22.454 INFO:tasks.workunit.client.1.smithi184.stdout:0/177: mkdir d0/d1d/d3a 0 2024-02-28T23:07:22.455 INFO:tasks.workunit.client.0.smithi159.stdout:8/716: write d2/d3/d8c/fb4 [992832,580] 0 2024-02-28T23:07:22.457 INFO:tasks.workunit.client.0.smithi159.stdout:8/717: dread - d2/d11/d52/fc6 zero size 2024-02-28T23:07:22.462 INFO:tasks.workunit.client.1.smithi184.stdout:7/156: write f4 [4101941,58344] 0 2024-02-28T23:07:22.464 INFO:tasks.workunit.client.0.smithi159.stdout:7/493: mkdir d5/d16/d1a/da0 0 2024-02-28T23:07:22.465 INFO:tasks.workunit.client.1.smithi184.stdout:4/167: mkdir d1/d8/d35 0 2024-02-28T23:07:22.466 INFO:tasks.workunit.client.0.smithi159.stdout:0/705: fdatasync d0/d5/d14/d25/fb4 0 2024-02-28T23:07:22.467 INFO:tasks.workunit.client.1.smithi184.stdout:9/182: creat d5/db/d29/f3b x:0 0 0 2024-02-28T23:07:22.469 INFO:tasks.workunit.client.1.smithi184.stdout:3/165: creat d1/d4/d6/d1f/f33 x:0 0 0 2024-02-28T23:07:22.470 INFO:tasks.workunit.client.1.smithi184.stdout:3/166: dread - d1/d4/d6/d1f/f33 zero size 2024-02-28T23:07:22.471 INFO:tasks.workunit.client.1.smithi184.stdout:6/155: sync 2024-02-28T23:07:22.471 INFO:tasks.workunit.client.0.smithi159.stdout:9/608: dwrite d4/d3d/d3e/d55/f43 [4194304,4194304] 0 2024-02-28T23:07:22.473 INFO:tasks.workunit.client.1.smithi184.stdout:3/167: chown d1/d4/d6/d1f/d24/l25 4301206 1 2024-02-28T23:07:22.474 INFO:tasks.workunit.client.0.smithi159.stdout:4/677: link d9/da/f9a d9/da/d1c/d8e/ddc/fee 0 2024-02-28T23:07:22.474 INFO:tasks.workunit.client.0.smithi159.stdout:6/578: dread d0/d1b/d33/d11/d34/d9d/da2/d52/db1/f87 [0,4194304] 0 2024-02-28T23:07:22.475 INFO:tasks.workunit.client.0.smithi159.stdout:9/609: dread - d4/d3d/d3e/d55/d37/d62/d77/fa9 zero size 2024-02-28T23:07:22.475 INFO:tasks.workunit.client.1.smithi184.stdout:3/168: rename d1/d4 to d1/d4/d1c/d34 22 2024-02-28T23:07:22.476 INFO:tasks.workunit.client.1.smithi184.stdout:2/168: creat d10/d33/f35 x:0 0 0 2024-02-28T23:07:22.478 INFO:tasks.workunit.client.0.smithi159.stdout:8/718: creat d2/d73/dc2/fe3 x:0 0 0 2024-02-28T23:07:22.478 INFO:tasks.workunit.client.0.smithi159.stdout:4/678: read - d9/d42/d54/d9c/fa6 zero size 2024-02-28T23:07:22.478 INFO:tasks.workunit.client.1.smithi184.stdout:1/241: getdents d20/d32/d4d 0 2024-02-28T23:07:22.482 INFO:tasks.workunit.client.0.smithi159.stdout:3/542: creat d0/d6/fa6 x:0 0 0 2024-02-28T23:07:22.482 INFO:tasks.workunit.client.0.smithi159.stdout:9/610: read d4/d3d/d3e/d55/d37/f79 [13086,89688] 0 2024-02-28T23:07:22.489 INFO:tasks.workunit.client.0.smithi159.stdout:5/593: mkdir d8/d19/d23/d35/d41/d92/dc8 0 2024-02-28T23:07:22.494 INFO:tasks.workunit.client.1.smithi184.stdout:6/156: creat dc/de/d10/f38 x:0 0 0 2024-02-28T23:07:22.494 INFO:tasks.workunit.client.0.smithi159.stdout:0/706: mkdir d0/d5/d14/d25/d2c/dab/dfd 0 2024-02-28T23:07:22.495 INFO:tasks.workunit.client.0.smithi159.stdout:6/579: dread d0/d1b/d33/d11/d34/d9d/da2/d52/db1/f87 [0,4194304] 0 2024-02-28T23:07:22.496 INFO:tasks.workunit.client.1.smithi184.stdout:3/169: rmdir d1 39 2024-02-28T23:07:22.496 INFO:tasks.workunit.client.0.smithi159.stdout:0/707: chown d0/d5/f53 2613469 1 2024-02-28T23:07:22.500 INFO:tasks.workunit.client.1.smithi184.stdout:1/242: rmdir d20/d32/d3e 39 2024-02-28T23:07:22.503 INFO:tasks.workunit.client.1.smithi184.stdout:0/178: creat d0/df/d13/f3b x:0 0 0 2024-02-28T23:07:22.504 INFO:tasks.workunit.client.1.smithi184.stdout:5/153: getdents db/d12/d1c/d21/d25 0 2024-02-28T23:07:22.504 INFO:tasks.workunit.client.1.smithi184.stdout:8/186: dwrite d1/da/f31 [0,4194304] 0 2024-02-28T23:07:22.505 INFO:tasks.workunit.client.1.smithi184.stdout:0/179: write d0/df/f11 [2239978,13818] 0 2024-02-28T23:07:22.505 INFO:tasks.workunit.client.1.smithi184.stdout:2/169: dread d10/f16 [0,4194304] 0 2024-02-28T23:07:22.506 INFO:tasks.workunit.client.0.smithi159.stdout:3/543: rename d0/fe to d0/d2b/d55/d75/d6d/d54/d7c/d79/d9b/fa7 0 2024-02-28T23:07:22.506 INFO:tasks.workunit.client.1.smithi184.stdout:5/154: fsync db/d12/d1c/d21/f2a 0 2024-02-28T23:07:22.507 INFO:tasks.workunit.client.1.smithi184.stdout:0/180: dread - d0/d1d/f35 zero size 2024-02-28T23:07:22.507 INFO:tasks.workunit.client.1.smithi184.stdout:8/187: dread - d1/da/d10/f2f zero size 2024-02-28T23:07:22.508 INFO:tasks.workunit.client.0.smithi159.stdout:7/494: creat d5/d16/d1a/d27/d46/d65/d81/d83/d9d/fa1 x:0 0 0 2024-02-28T23:07:22.509 INFO:tasks.workunit.client.1.smithi184.stdout:2/170: write d10/d13/f2c [706972,120495] 0 2024-02-28T23:07:22.509 INFO:tasks.workunit.client.1.smithi184.stdout:5/155: fsync db/d12/d18/f1a 0 2024-02-28T23:07:22.510 INFO:tasks.workunit.client.0.smithi159.stdout:7/495: chown d5/d16/d1a/d27/d37 1293471 1 2024-02-28T23:07:22.512 INFO:tasks.workunit.client.1.smithi184.stdout:4/168: symlink d1/dc/df/d27/d34/l36 0 2024-02-28T23:07:22.513 INFO:tasks.workunit.client.1.smithi184.stdout:5/156: dread - db/d12/f2c zero size 2024-02-28T23:07:22.514 INFO:tasks.workunit.client.1.smithi184.stdout:2/171: write d10/f14 [3329324,40304] 0 2024-02-28T23:07:22.515 INFO:tasks.workunit.client.0.smithi159.stdout:6/580: dwrite d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/fb4 [0,4194304] 0 2024-02-28T23:07:22.516 INFO:tasks.workunit.client.1.smithi184.stdout:7/157: truncate d6/f8 3713200 0 2024-02-28T23:07:22.517 INFO:tasks.workunit.client.1.smithi184.stdout:5/157: truncate db/d12/f2c 611752 0 2024-02-28T23:07:22.519 INFO:tasks.workunit.client.1.smithi184.stdout:9/183: link d5/f6 d5/d17/f3c 0 2024-02-28T23:07:22.519 INFO:tasks.workunit.client.1.smithi184.stdout:6/157: symlink dc/de/d2a/l39 0 2024-02-28T23:07:22.519 INFO:tasks.workunit.client.0.smithi159.stdout:4/679: mknod d9/da/d1c/cef 0 2024-02-28T23:07:22.520 INFO:tasks.workunit.client.1.smithi184.stdout:5/158: write db/d12/d1c/f2b [518716,70868] 0 2024-02-28T23:07:22.520 INFO:tasks.workunit.client.1.smithi184.stdout:6/158: stat f3 0 2024-02-28T23:07:22.520 INFO:tasks.workunit.client.0.smithi159.stdout:0/708: read - d0/d5/d14/d25/d2c/d4b/fc3 zero size 2024-02-28T23:07:22.522 INFO:tasks.workunit.client.0.smithi159.stdout:9/611: fdatasync d4/f39 0 2024-02-28T23:07:22.523 INFO:tasks.workunit.client.1.smithi184.stdout:5/159: readlink db/d12/d1c/d21/d25/l29 0 2024-02-28T23:07:22.524 INFO:tasks.workunit.client.0.smithi159.stdout:2/536: getdents d9/d50/d54/d84/d37 0 2024-02-28T23:07:22.526 INFO:tasks.workunit.client.0.smithi159.stdout:2/537: chown d9/d50/d54/d84/f9f 61256533 1 2024-02-28T23:07:22.527 INFO:tasks.workunit.client.1.smithi184.stdout:5/160: write db/d12/f39 [970832,19403] 0 2024-02-28T23:07:22.527 INFO:tasks.workunit.client.1.smithi184.stdout:9/184: chown d5/db/de/d10/d12/d2f/l31 6 1 2024-02-28T23:07:22.528 INFO:tasks.workunit.client.1.smithi184.stdout:1/243: write d20/d32/d3e/f3f [861298,117617] 0 2024-02-28T23:07:22.529 INFO:tasks.workunit.client.0.smithi159.stdout:0/709: dread d0/de/d75/de8/fe6 [0,4194304] 0 2024-02-28T23:07:22.531 INFO:tasks.workunit.client.0.smithi159.stdout:2/538: read d9/d50/d54/d84/d37/f39 [5487009,4122] 0 2024-02-28T23:07:22.531 INFO:tasks.workunit.client.0.smithi159.stdout:7/496: truncate d5/d56/d2a/f4d 631054 0 2024-02-28T23:07:22.532 INFO:tasks.workunit.client.0.smithi159.stdout:8/719: truncate d2/d11/d52/f54 1258216 0 2024-02-28T23:07:22.534 INFO:tasks.workunit.client.1.smithi184.stdout:5/161: chown db/d12/d18/d2e/f36 3378 1 2024-02-28T23:07:22.536 INFO:tasks.workunit.client.0.smithi159.stdout:8/720: stat d2/d11/d52/d26/d36/d38/d77/la4 0 2024-02-28T23:07:22.537 INFO:tasks.workunit.client.0.smithi159.stdout:6/581: symlink d0/d1b/d33/d11/d14/lb6 0 2024-02-28T23:07:22.537 INFO:tasks.workunit.client.1.smithi184.stdout:7/158: dwrite f4 [0,4194304] 0 2024-02-28T23:07:22.541 INFO:tasks.workunit.client.1.smithi184.stdout:8/188: creat d1/da/dc/d16/d32/f4b x:0 0 0 2024-02-28T23:07:22.547 INFO:tasks.workunit.client.1.smithi184.stdout:4/169: rmdir d1 39 2024-02-28T23:07:22.550 INFO:tasks.workunit.client.1.smithi184.stdout:5/162: dwrite db/d12/f39 [0,4194304] 0 2024-02-28T23:07:22.552 INFO:tasks.workunit.client.0.smithi159.stdout:0/710: dwrite d0/d5/d14/d34/d6c/fcf [0,4194304] 0 2024-02-28T23:07:22.558 INFO:tasks.workunit.client.1.smithi184.stdout:3/170: creat d1/d4/d1c/f35 x:0 0 0 2024-02-28T23:07:22.561 INFO:tasks.workunit.client.1.smithi184.stdout:6/159: mkdir dc/de/d10/d3a 0 2024-02-28T23:07:22.563 INFO:tasks.workunit.client.0.smithi159.stdout:7/497: symlink d5/d16/d1a/d27/d37/la2 0 2024-02-28T23:07:22.563 INFO:tasks.workunit.client.1.smithi184.stdout:1/244: rmdir d20/d32 39 2024-02-28T23:07:22.567 INFO:tasks.workunit.client.0.smithi159.stdout:9/612: dread d4/d3d/d3e/d55/f1e [0,4194304] 0 2024-02-28T23:07:22.572 INFO:tasks.workunit.client.0.smithi159.stdout:6/582: rename d0/d1b/d33/d11/d34/d9d/da2/d52 to d0/d1b/d33/d11/d34/d9d/da2/db7 0 2024-02-28T23:07:22.574 INFO:tasks.workunit.client.1.smithi184.stdout:9/185: dread d5/db/de/d10/d12/f2d [0,4194304] 0 2024-02-28T23:07:22.576 INFO:tasks.workunit.client.0.smithi159.stdout:6/583: write d0/d1b/f3c [4764756,29995] 0 2024-02-28T23:07:22.590 INFO:tasks.workunit.client.0.smithi159.stdout:4/680: dwrite d9/d42/d54/d9c/fa3 [0,4194304] 0 2024-02-28T23:07:22.599 INFO:tasks.workunit.client.1.smithi184.stdout:8/189: rename d1/da/dc/d18/c35 to d1/da/dc/d16/c4c 0 2024-02-28T23:07:22.602 INFO:tasks.workunit.client.0.smithi159.stdout:0/711: creat d0/d5/d14/d25/d2c/ffe x:0 0 0 2024-02-28T23:07:22.603 INFO:tasks.workunit.client.1.smithi184.stdout:2/172: mknod d10/d1f/d21/c36 0 2024-02-28T23:07:22.605 INFO:tasks.workunit.client.1.smithi184.stdout:2/173: dread - d10/d13/d15/f2e zero size 2024-02-28T23:07:22.605 INFO:tasks.workunit.client.1.smithi184.stdout:5/163: chown db/c30 131928 1 2024-02-28T23:07:22.610 INFO:tasks.workunit.client.1.smithi184.stdout:3/171: mkdir d1/d4/d6/d36 0 2024-02-28T23:07:22.611 INFO:tasks.workunit.client.1.smithi184.stdout:6/160: mknod dc/de/d2a/c3b 0 2024-02-28T23:07:22.612 INFO:tasks.workunit.client.0.smithi159.stdout:8/721: dwrite d2/d3/f1d [0,4194304] 0 2024-02-28T23:07:22.612 INFO:tasks.workunit.client.0.smithi159.stdout:3/544: dwrite d0/f23 [0,4194304] 0 2024-02-28T23:07:22.613 INFO:tasks.workunit.client.1.smithi184.stdout:1/245: fdatasync f19 0 2024-02-28T23:07:22.614 INFO:tasks.workunit.client.1.smithi184.stdout:0/181: link d0/l10 d0/df/d13/l3c 0 2024-02-28T23:07:22.616 INFO:tasks.workunit.client.1.smithi184.stdout:7/159: fsync d6/d9/d13/d1e/d2f/f38 0 2024-02-28T23:07:22.617 INFO:tasks.workunit.client.0.smithi159.stdout:9/613: write d4/f13 [398799,69662] 0 2024-02-28T23:07:22.617 INFO:tasks.workunit.client.0.smithi159.stdout:6/584: mknod d0/d1b/d33/d8c/cb8 0 2024-02-28T23:07:22.619 INFO:tasks.workunit.client.1.smithi184.stdout:7/160: write d6/f30 [5423358,93870] 0 2024-02-28T23:07:22.620 INFO:tasks.workunit.client.1.smithi184.stdout:4/170: unlink d1/c30 0 2024-02-28T23:07:22.623 INFO:tasks.workunit.client.0.smithi159.stdout:6/585: chown d0/d1b/c2d 61384734 1 2024-02-28T23:07:22.625 INFO:tasks.workunit.client.1.smithi184.stdout:9/186: rename d5/db/de/d10/f1c to d5/d17/f3d 0 2024-02-28T23:07:22.625 INFO:tasks.workunit.client.1.smithi184.stdout:8/190: mkdir d1/da/dc/d16/d4d 0 2024-02-28T23:07:22.629 INFO:tasks.workunit.client.1.smithi184.stdout:5/164: creat db/d12/d1c/f3a x:0 0 0 2024-02-28T23:07:22.630 INFO:tasks.workunit.client.0.smithi159.stdout:6/586: dread d0/f2b [0,4194304] 0 2024-02-28T23:07:22.631 INFO:tasks.workunit.client.1.smithi184.stdout:2/174: creat d10/d1f/d21/f37 x:0 0 0 2024-02-28T23:07:22.631 INFO:tasks.workunit.client.1.smithi184.stdout:3/172: chown d1/l16 0 1 2024-02-28T23:07:22.634 INFO:tasks.workunit.client.1.smithi184.stdout:9/187: truncate d5/db/de/d10/f2b 4813001 0 2024-02-28T23:07:22.634 INFO:tasks.workunit.client.0.smithi159.stdout:9/614: read - d4/d3d/d3e/d55/d37/f9b zero size 2024-02-28T23:07:22.636 INFO:tasks.workunit.client.1.smithi184.stdout:9/188: stat d5/db/de/d10/d12/f2d 0 2024-02-28T23:07:22.638 INFO:tasks.workunit.client.1.smithi184.stdout:1/246: dread f19 [0,4194304] 0 2024-02-28T23:07:22.641 INFO:tasks.workunit.client.0.smithi159.stdout:8/722: truncate d2/d3/f3c 4496440 0 2024-02-28T23:07:22.642 INFO:tasks.workunit.client.1.smithi184.stdout:4/171: mkdir d1/d8/d37 0 2024-02-28T23:07:22.644 INFO:tasks.workunit.client.1.smithi184.stdout:4/172: write d1/dc/fd [3993413,57824] 0 2024-02-28T23:07:22.645 INFO:tasks.workunit.client.0.smithi159.stdout:4/681: dread d9/d20/f22 [0,4194304] 0 2024-02-28T23:07:22.648 INFO:tasks.workunit.client.1.smithi184.stdout:0/182: rename d0/d1f/f38 to d0/d1d/f3d 0 2024-02-28T23:07:22.650 INFO:tasks.workunit.client.1.smithi184.stdout:0/183: chown d0/df/d13/l21 65736974 1 2024-02-28T23:07:22.651 INFO:tasks.workunit.client.1.smithi184.stdout:3/173: dwrite d1/d4/d1c/f27 [0,4194304] 0 2024-02-28T23:07:22.658 INFO:tasks.workunit.client.0.smithi159.stdout:3/545: rename d0/f82 to d0/fa8 0 2024-02-28T23:07:22.658 INFO:tasks.workunit.client.0.smithi159.stdout:0/712: dread d0/d5/f3f [0,4194304] 0 2024-02-28T23:07:22.659 INFO:tasks.workunit.client.0.smithi159.stdout:2/539: write d9/d36/d59/fad [761604,59821] 0 2024-02-28T23:07:22.659 INFO:tasks.workunit.client.0.smithi159.stdout:9/615: mknod d4/d3d/d3e/d55/d37/d62/da6/dac/cbd 0 2024-02-28T23:07:22.660 INFO:tasks.workunit.client.0.smithi159.stdout:0/713: write d0/d5/d14/d25/d2c/dab/ff2 [93238,56311] 0 2024-02-28T23:07:22.661 INFO:tasks.workunit.client.1.smithi184.stdout:5/165: unlink l6 0 2024-02-28T23:07:22.661 INFO:tasks.workunit.client.1.smithi184.stdout:4/173: dwrite d1/d4/f1f [0,4194304] 0 2024-02-28T23:07:22.662 INFO:tasks.workunit.client.1.smithi184.stdout:5/166: chown db/d12/d1c/d21/d25 28923976 1 2024-02-28T23:07:22.664 INFO:tasks.workunit.client.1.smithi184.stdout:2/175: mkdir d10/d1f/d38 0 2024-02-28T23:07:22.664 INFO:tasks.workunit.client.1.smithi184.stdout:4/174: truncate d1/d8/f1b 747850 0 2024-02-28T23:07:22.665 INFO:tasks.workunit.client.1.smithi184.stdout:5/167: readlink db/d12/d1c/d21/d25/l29 0 2024-02-28T23:07:22.666 INFO:tasks.workunit.client.1.smithi184.stdout:2/176: truncate d10/d33/f35 690390 0 2024-02-28T23:07:22.666 INFO:tasks.workunit.client.1.smithi184.stdout:4/175: chown d1/d8/l2b 231 1 2024-02-28T23:07:22.669 INFO:tasks.workunit.client.1.smithi184.stdout:5/168: dread db/d1f/d32/f37 [0,4194304] 0 2024-02-28T23:07:22.672 INFO:tasks.workunit.client.1.smithi184.stdout:4/176: dread d1/d8/f1b [0,4194304] 0 2024-02-28T23:07:22.673 INFO:tasks.workunit.client.1.smithi184.stdout:7/161: mkdir d6/d9/d13/d3e 0 2024-02-28T23:07:22.676 INFO:tasks.workunit.client.0.smithi159.stdout:2/540: dwrite d9/d50/d54/d84/f3b [0,4194304] 0 2024-02-28T23:07:22.679 INFO:tasks.workunit.client.0.smithi159.stdout:8/723: creat d2/fe4 x:0 0 0 2024-02-28T23:07:22.681 INFO:tasks.workunit.client.0.smithi159.stdout:0/714: dwrite d0/de/f4a [4194304,4194304] 0 2024-02-28T23:07:22.685 INFO:tasks.workunit.client.0.smithi159.stdout:0/715: readlink d0/l6e 0 2024-02-28T23:07:22.686 INFO:tasks.workunit.client.1.smithi184.stdout:8/191: write d1/da/dc/d16/d32/f46 [3773615,80055] 0 2024-02-28T23:07:22.688 INFO:tasks.workunit.client.1.smithi184.stdout:6/161: truncate dc/f14 1698531 0 2024-02-28T23:07:22.690 INFO:tasks.workunit.client.1.smithi184.stdout:8/192: write d1/da/df/d20/f30 [222719,17673] 0 2024-02-28T23:07:22.691 INFO:tasks.workunit.client.0.smithi159.stdout:3/546: mkdir d0/d6/d3e/da9 0 2024-02-28T23:07:22.691 INFO:tasks.workunit.client.1.smithi184.stdout:0/184: creat d0/df/d13/f3e x:0 0 0 2024-02-28T23:07:22.691 INFO:tasks.workunit.client.1.smithi184.stdout:3/174: creat d1/d4/d6/d1e/f37 x:0 0 0 2024-02-28T23:07:22.694 INFO:tasks.workunit.client.1.smithi184.stdout:8/193: dread - d1/da/df/f22 zero size 2024-02-28T23:07:22.696 INFO:tasks.workunit.client.0.smithi159.stdout:0/716: read d0/d5/d14/d25/d2c/dab/ff2 [71828,88270] 0 2024-02-28T23:07:22.703 INFO:tasks.workunit.client.1.smithi184.stdout:6/162: dread dc/de/d10/f23 [0,4194304] 0 2024-02-28T23:07:22.705 INFO:tasks.workunit.client.0.smithi159.stdout:8/724: fsync d2/d11/d52/d26/fa7 0 2024-02-28T23:07:22.705 INFO:tasks.workunit.client.0.smithi159.stdout:4/682: dwrite d9/d4c/d6c/fa4 [0,4194304] 0 2024-02-28T23:07:22.714 INFO:tasks.workunit.client.1.smithi184.stdout:5/169: symlink db/d12/d18/d2e/l3b 0 2024-02-28T23:07:22.714 INFO:tasks.workunit.client.0.smithi159.stdout:0/717: stat d0/d5/d14/d25/d2c/d4b/f54 0 2024-02-28T23:07:22.716 INFO:tasks.workunit.client.1.smithi184.stdout:4/177: mkdir d1/dc/df/d38 0 2024-02-28T23:07:22.716 INFO:tasks.workunit.client.0.smithi159.stdout:2/541: truncate d9/d23/d2c/f2d 1558656 0 2024-02-28T23:07:22.717 INFO:tasks.workunit.client.1.smithi184.stdout:4/178: fsync d1/dc/df/f31 0 2024-02-28T23:07:22.718 INFO:tasks.workunit.client.1.smithi184.stdout:7/162: rename d6/d9/da/dc/lf to d6/d9/d13/d3e/l3f 0 2024-02-28T23:07:22.723 INFO:tasks.workunit.client.0.smithi159.stdout:9/616: getdents d4/d3d/d3e/d55/d37/d62/d77 0 2024-02-28T23:07:22.724 INFO:tasks.workunit.client.1.smithi184.stdout:3/175: symlink d1/d4/d6/d1e/l38 0 2024-02-28T23:07:22.726 INFO:tasks.workunit.client.0.smithi159.stdout:4/683: symlink d9/da/d1c/d23/d7a/lf0 0 2024-02-28T23:07:22.726 INFO:tasks.workunit.client.0.smithi159.stdout:9/617: dread d4/d3d/d3e/d4a/f59 [0,4194304] 0 2024-02-28T23:07:22.726 INFO:tasks.workunit.client.1.smithi184.stdout:3/176: write d1/d4/d1c/f27 [2631541,126534] 0 2024-02-28T23:07:22.727 INFO:tasks.workunit.client.1.smithi184.stdout:8/194: symlink d1/da/df/l4e 0 2024-02-28T23:07:22.731 INFO:tasks.workunit.client.0.smithi159.stdout:8/725: rename d2/d11/d52/d6e/l88 to d2/d11/d74/ddb/le5 0 2024-02-28T23:07:22.736 INFO:tasks.workunit.client.1.smithi184.stdout:6/163: write f8 [471454,77090] 0 2024-02-28T23:07:22.739 INFO:tasks.workunit.client.1.smithi184.stdout:9/189: truncate d5/d17/f28 4828414 0 2024-02-28T23:07:22.741 INFO:tasks.workunit.client.1.smithi184.stdout:5/170: mkdir db/d12/d18/d2e/d3c 0 2024-02-28T23:07:22.742 INFO:tasks.workunit.client.1.smithi184.stdout:5/171: stat db/d1f/f27 0 2024-02-28T23:07:22.743 INFO:tasks.workunit.client.1.smithi184.stdout:1/247: truncate d20/f3a 4000364 0 2024-02-28T23:07:22.744 INFO:tasks.workunit.client.1.smithi184.stdout:5/172: write db/d12/d1c/f3a [912466,42468] 0 2024-02-28T23:07:22.746 INFO:tasks.workunit.client.1.smithi184.stdout:4/179: creat d1/d8/d19/f39 x:0 0 0 2024-02-28T23:07:22.747 INFO:tasks.workunit.client.1.smithi184.stdout:4/180: stat d1/d8/d19/f39 0 2024-02-28T23:07:22.748 INFO:tasks.workunit.client.1.smithi184.stdout:7/163: rmdir d6/d9/d13/d14 39 2024-02-28T23:07:22.748 INFO:tasks.workunit.client.0.smithi159.stdout:9/618: dread d4/f36 [0,4194304] 0 2024-02-28T23:07:22.751 INFO:tasks.workunit.client.0.smithi159.stdout:3/547: link d0/d2b/d55/d75/d6d/d54/d6a/l97 d0/d6/d3e/d57/laa 0 2024-02-28T23:07:22.752 INFO:tasks.workunit.client.0.smithi159.stdout:8/726: read - d2/d73/dc2/fae zero size 2024-02-28T23:07:22.755 INFO:tasks.workunit.client.0.smithi159.stdout:3/548: write d0/d6/fa6 [849453,67748] 0 2024-02-28T23:07:22.759 INFO:tasks.workunit.client.1.smithi184.stdout:8/195: mknod d1/da/dc/d16/d29/c4f 0 2024-02-28T23:07:22.764 INFO:tasks.workunit.client.1.smithi184.stdout:2/177: creat d10/d13/d15/f39 x:0 0 0 2024-02-28T23:07:22.766 INFO:tasks.workunit.client.0.smithi159.stdout:9/619: mkdir d4/d3d/d3e/d55/d4c/d4e/dbe 0 2024-02-28T23:07:22.770 INFO:tasks.workunit.client.0.smithi159.stdout:8/727: creat d2/d11/d58/fe6 x:0 0 0 2024-02-28T23:07:22.771 INFO:tasks.workunit.client.1.smithi184.stdout:9/190: rename d5/d26/f36 to d5/d26/f3e 0 2024-02-28T23:07:22.774 INFO:tasks.workunit.client.0.smithi159.stdout:2/542: dread d9/d50/d54/d84/d37/f39 [4194304,4194304] 0 2024-02-28T23:07:22.774 INFO:tasks.workunit.client.0.smithi159.stdout:0/718: dwrite d0/d5/d14/d34/d3d/f65 [0,4194304] 0 2024-02-28T23:07:22.775 INFO:tasks.workunit.client.1.smithi184.stdout:1/248: fsync d20/d32/d3e/f3f 0 2024-02-28T23:07:22.776 INFO:tasks.workunit.client.0.smithi159.stdout:4/684: link d9/da/d1c/d8e/deb/ca7 d9/d4c/cf1 0 2024-02-28T23:07:22.781 INFO:tasks.workunit.client.1.smithi184.stdout:6/164: dwrite dc/de/d10/d16/f37 [0,4194304] 0 2024-02-28T23:07:22.782 INFO:tasks.workunit.client.0.smithi159.stdout:9/620: rename d4/d3d/d3e/d55/d37/d62/d6a/f89 to d4/d3d/d3e/dad/fbf 0 2024-02-28T23:07:22.784 INFO:tasks.workunit.client.1.smithi184.stdout:7/164: mkdir d6/d9/d13/d1e/d2f/d34/d40 0 2024-02-28T23:07:22.789 INFO:tasks.workunit.client.0.smithi159.stdout:1/580: sync 2024-02-28T23:07:22.796 INFO:tasks.workunit.client.0.smithi159.stdout:4/685: mkdir d9/d4c/d6c/d98/df2 0 2024-02-28T23:07:22.797 INFO:tasks.workunit.client.0.smithi159.stdout:2/543: dread f6 [0,4194304] 0 2024-02-28T23:07:22.798 INFO:tasks.workunit.client.1.smithi184.stdout:2/178: symlink d10/d13/d15/d24/l3a 0 2024-02-28T23:07:22.799 INFO:tasks.workunit.client.0.smithi159.stdout:0/719: dwrite d0/fd6 [0,4194304] 0 2024-02-28T23:07:22.800 INFO:tasks.workunit.client.1.smithi184.stdout:9/191: mkdir d5/db/de/d10/d12/d2f/d3f 0 2024-02-28T23:07:22.801 INFO:tasks.workunit.client.1.smithi184.stdout:6/165: dwrite dc/de/f20 [4194304,4194304] 0 2024-02-28T23:07:22.802 INFO:tasks.workunit.client.0.smithi159.stdout:2/544: chown d9/d23/d2c/f91 22 1 2024-02-28T23:07:22.807 INFO:tasks.workunit.client.0.smithi159.stdout:8/728: dread d2/d11/d52/d26/d36/f23 [0,4194304] 0 2024-02-28T23:07:22.807 INFO:tasks.workunit.client.0.smithi159.stdout:9/621: rename d4/d3d/d3e/d55/d4c/fa0 to d4/d3d/d3e/d55/d37/d62/d77/fc0 0 2024-02-28T23:07:22.810 INFO:tasks.workunit.client.0.smithi159.stdout:3/549: getdents d0/d2b/d55/d75/d6d/d54/d7c 0 2024-02-28T23:07:22.810 INFO:tasks.workunit.client.1.smithi184.stdout:1/249: creat d20/d32/d4d/f53 x:0 0 0 2024-02-28T23:07:22.812 INFO:tasks.workunit.client.0.smithi159.stdout:8/729: write d2/d11/d52/d26/d36/d38/d77/d9e/fc0 [898961,88119] 0 2024-02-28T23:07:22.812 INFO:tasks.workunit.client.1.smithi184.stdout:2/179: dread d10/d13/f1a [0,4194304] 0 2024-02-28T23:07:22.813 INFO:tasks.workunit.client.0.smithi159.stdout:3/550: write d0/d2b/d55/d75/d6d/d54/f9e [588390,54505] 0 2024-02-28T23:07:22.818 INFO:tasks.workunit.client.1.smithi184.stdout:3/177: write d1/f21 [2316130,35601] 0 2024-02-28T23:07:22.821 INFO:tasks.workunit.client.0.smithi159.stdout:0/720: fdatasync d0/d5/d14/d34/d6c/ffa 0 2024-02-28T23:07:22.822 INFO:tasks.workunit.client.1.smithi184.stdout:3/178: truncate d1/d4/d6/d1e/f37 151356 0 2024-02-28T23:07:22.822 INFO:tasks.workunit.client.0.smithi159.stdout:2/545: symlink d9/d80/lbb 0 2024-02-28T23:07:22.826 INFO:tasks.workunit.client.1.smithi184.stdout:0/185: getdents d0 0 2024-02-28T23:07:22.827 INFO:tasks.workunit.client.0.smithi159.stdout:9/622: rmdir d4/d3d/d3e/d55/d4c/d4e/d6b 39 2024-02-28T23:07:22.828 INFO:tasks.workunit.client.0.smithi159.stdout:1/581: mkdir d6/d1d/d1f/d3e/d9c/db3/dc4 0 2024-02-28T23:07:22.828 INFO:tasks.workunit.client.1.smithi184.stdout:1/250: dwrite f9 [0,4194304] 0 2024-02-28T23:07:22.830 INFO:tasks.workunit.client.0.smithi159.stdout:8/730: fsync d2/d11/d52/d26/fa7 0 2024-02-28T23:07:22.835 INFO:tasks.workunit.client.1.smithi184.stdout:5/173: truncate db/d12/f2c 490066 0 2024-02-28T23:07:22.838 INFO:tasks.workunit.client.0.smithi159.stdout:3/551: creat d0/d2b/d55/d75/d6d/d54/d7c/d79/fab x:0 0 0 2024-02-28T23:07:22.845 INFO:tasks.workunit.client.0.smithi159.stdout:9/623: unlink d4/f26 0 2024-02-28T23:07:22.846 INFO:tasks.workunit.client.0.smithi159.stdout:8/731: dread d2/d73/dc2/fac [0,4194304] 0 2024-02-28T23:07:22.847 INFO:tasks.workunit.client.1.smithi184.stdout:2/180: mknod d10/d1f/c3b 0 2024-02-28T23:07:22.847 INFO:tasks.workunit.client.1.smithi184.stdout:2/181: chown fb 9000172 1 2024-02-28T23:07:22.848 INFO:tasks.workunit.client.1.smithi184.stdout:2/182: stat d10/d1f/l28 0 2024-02-28T23:07:22.849 INFO:tasks.workunit.client.1.smithi184.stdout:4/181: link d1/d8/la d1/dc/df/l3a 0 2024-02-28T23:07:22.853 INFO:tasks.workunit.client.1.smithi184.stdout:7/165: symlink d6/l41 0 2024-02-28T23:07:22.855 INFO:tasks.workunit.client.1.smithi184.stdout:0/186: unlink d0/df/f15 0 2024-02-28T23:07:22.864 INFO:tasks.workunit.client.1.smithi184.stdout:9/192: mkdir d5/d40 0 2024-02-28T23:07:22.864 INFO:tasks.workunit.client.1.smithi184.stdout:6/166: dwrite dc/de/f36 [0,4194304] 0 2024-02-28T23:07:22.867 INFO:tasks.workunit.client.1.smithi184.stdout:2/183: readlink l6 0 2024-02-28T23:07:22.867 INFO:tasks.workunit.client.1.smithi184.stdout:4/182: mkdir d1/dc/df/d3b 0 2024-02-28T23:07:22.868 INFO:tasks.workunit.client.1.smithi184.stdout:3/179: dwrite d1/d4/f14 [0,4194304] 0 2024-02-28T23:07:22.868 INFO:tasks.workunit.client.1.smithi184.stdout:6/167: write dc/de/f20 [4226712,105295] 0 2024-02-28T23:07:22.870 INFO:tasks.workunit.client.1.smithi184.stdout:4/183: dread - d1/d8/d19/f39 zero size 2024-02-28T23:07:22.871 INFO:tasks.workunit.client.1.smithi184.stdout:8/196: link d1/l9 d1/da/d10/l50 0 2024-02-28T23:07:22.871 INFO:tasks.workunit.client.1.smithi184.stdout:3/180: readlink d1/d4/d5/l2f 0 2024-02-28T23:07:22.872 INFO:tasks.workunit.client.1.smithi184.stdout:1/251: symlink d20/d32/d4b/l54 0 2024-02-28T23:07:22.873 INFO:tasks.workunit.client.1.smithi184.stdout:5/174: creat db/d12/d18/d2e/d3c/f3d x:0 0 0 2024-02-28T23:07:22.875 INFO:tasks.workunit.client.1.smithi184.stdout:8/197: chown d1/da/f31 709965244 1 2024-02-28T23:07:22.876 INFO:tasks.workunit.client.1.smithi184.stdout:9/193: symlink d5/db/d29/l41 0 2024-02-28T23:07:22.877 INFO:tasks.workunit.client.1.smithi184.stdout:2/184: symlink d10/d13/l3c 0 2024-02-28T23:07:22.880 INFO:tasks.workunit.client.1.smithi184.stdout:0/187: truncate d0/df/f30 8874224 0 2024-02-28T23:07:22.881 INFO:tasks.workunit.client.1.smithi184.stdout:2/185: write d10/d13/d15/f2e [596235,40460] 0 2024-02-28T23:07:22.882 INFO:tasks.workunit.client.1.smithi184.stdout:6/168: dread dc/de/d10/f24 [0,4194304] 0 2024-02-28T23:07:22.883 INFO:tasks.workunit.client.1.smithi184.stdout:4/184: unlink d1/d8/d19/l28 0 2024-02-28T23:07:22.886 INFO:tasks.workunit.client.1.smithi184.stdout:8/198: unlink d1/f2 0 2024-02-28T23:07:22.889 INFO:tasks.workunit.client.1.smithi184.stdout:0/188: rmdir d0/df/d13/d27/d2b 39 2024-02-28T23:07:22.890 INFO:tasks.workunit.client.1.smithi184.stdout:1/252: dread d20/d32/f44 [0,4194304] 0 2024-02-28T23:07:22.894 INFO:tasks.workunit.client.1.smithi184.stdout:5/175: link db/d12/d1c/f2b db/d1f/d32/f3e 0 2024-02-28T23:07:22.895 INFO:tasks.workunit.client.1.smithi184.stdout:7/166: dread d6/f8 [0,4194304] 0 2024-02-28T23:07:22.895 INFO:tasks.workunit.client.1.smithi184.stdout:8/199: creat d1/da/dc/d18/f51 x:0 0 0 2024-02-28T23:07:22.897 INFO:tasks.workunit.client.1.smithi184.stdout:2/186: getdents d10/d1f/d38 0 2024-02-28T23:07:22.898 INFO:tasks.workunit.client.1.smithi184.stdout:7/167: chown d6/d9/da/l23 231003 1 2024-02-28T23:07:22.898 INFO:tasks.workunit.client.1.smithi184.stdout:4/185: mkdir d1/dc/df/d38/d3c 0 2024-02-28T23:07:22.900 INFO:tasks.workunit.client.1.smithi184.stdout:4/186: dread - d1/d8/d19/f39 zero size 2024-02-28T23:07:22.900 INFO:tasks.workunit.client.1.smithi184.stdout:9/194: creat d5/db/f42 x:0 0 0 2024-02-28T23:07:22.902 INFO:tasks.workunit.client.1.smithi184.stdout:5/176: symlink db/d12/d1c/l3f 0 2024-02-28T23:07:22.903 INFO:tasks.workunit.client.1.smithi184.stdout:4/187: truncate d1/d8/d19/f39 793892 0 2024-02-28T23:07:22.903 INFO:tasks.workunit.client.1.smithi184.stdout:5/177: fdatasync f8 0 2024-02-28T23:07:22.906 INFO:tasks.workunit.client.1.smithi184.stdout:3/181: getdents d1/d4/d6 0 2024-02-28T23:07:22.909 INFO:tasks.workunit.client.1.smithi184.stdout:9/195: rmdir d5/d26 39 2024-02-28T23:07:22.914 INFO:tasks.workunit.client.1.smithi184.stdout:8/200: mknod d1/da/d33/c52 0 2024-02-28T23:07:22.914 INFO:tasks.workunit.client.1.smithi184.stdout:1/253: write f19 [2671272,60009] 0 2024-02-28T23:07:22.915 INFO:tasks.workunit.client.1.smithi184.stdout:3/182: dread d1/d4/f23 [0,4194304] 0 2024-02-28T23:07:22.915 INFO:tasks.workunit.client.1.smithi184.stdout:4/188: mkdir d1/d8/d3d 0 2024-02-28T23:07:22.916 INFO:tasks.workunit.client.1.smithi184.stdout:5/178: mknod db/d1f/c40 0 2024-02-28T23:07:22.917 INFO:tasks.workunit.client.1.smithi184.stdout:1/254: chown f2 191 1 2024-02-28T23:07:22.917 INFO:tasks.workunit.client.1.smithi184.stdout:6/169: getdents dc 0 2024-02-28T23:07:22.918 INFO:tasks.workunit.client.1.smithi184.stdout:7/168: dwrite d6/d9/d13/d1e/f21 [0,4194304] 0 2024-02-28T23:07:22.918 INFO:tasks.workunit.client.1.smithi184.stdout:2/187: link d10/f14 d10/d13/f3d 0 2024-02-28T23:07:22.919 INFO:tasks.workunit.client.1.smithi184.stdout:0/189: link d0/df/d13/l21 d0/df/l3f 0 2024-02-28T23:07:22.919 INFO:tasks.workunit.client.1.smithi184.stdout:4/189: fdatasync d1/d8/d19/f1a 0 2024-02-28T23:07:22.922 INFO:tasks.workunit.client.1.smithi184.stdout:1/255: dread - d20/f50 zero size 2024-02-28T23:07:22.923 INFO:tasks.workunit.client.1.smithi184.stdout:5/179: read db/d12/d18/f20 [2742936,1229] 0 2024-02-28T23:07:22.923 INFO:tasks.workunit.client.1.smithi184.stdout:2/188: dread - d10/f18 zero size 2024-02-28T23:07:22.924 INFO:tasks.workunit.client.1.smithi184.stdout:1/256: fdatasync f1c 0 2024-02-28T23:07:22.927 INFO:tasks.workunit.client.1.smithi184.stdout:1/257: write d20/d32/f34 [840536,50327] 0 2024-02-28T23:07:22.928 INFO:tasks.workunit.client.1.smithi184.stdout:1/258: stat d20 0 2024-02-28T23:07:22.929 INFO:tasks.workunit.client.1.smithi184.stdout:9/196: dread d5/fc [0,4194304] 0 2024-02-28T23:07:22.931 INFO:tasks.workunit.client.0.smithi159.stdout:4/686: dwrite d9/da/d1c/f39 [0,4194304] 0 2024-02-28T23:07:22.931 INFO:tasks.workunit.client.0.smithi159.stdout:2/546: link d9/d50/faa d9/d34/fbc 0 2024-02-28T23:07:22.932 INFO:tasks.workunit.client.1.smithi184.stdout:3/183: symlink d1/d4/d6/d1e/l39 0 2024-02-28T23:07:22.933 INFO:tasks.workunit.client.0.smithi159.stdout:9/624: rmdir d4/d52 39 2024-02-28T23:07:22.934 INFO:tasks.workunit.client.1.smithi184.stdout:5/180: symlink db/l41 0 2024-02-28T23:07:22.936 INFO:tasks.workunit.client.1.smithi184.stdout:5/181: dread - db/d12/d1c/d21/f35 zero size 2024-02-28T23:07:22.937 INFO:tasks.workunit.client.0.smithi159.stdout:2/547: dread - d9/d23/d2c/d55/fb7 zero size 2024-02-28T23:07:22.938 INFO:tasks.workunit.client.1.smithi184.stdout:7/169: unlink d6/d9/da/dc/f1a 0 2024-02-28T23:07:22.938 INFO:tasks.workunit.client.1.smithi184.stdout:5/182: stat db/d1f/f27 0 2024-02-28T23:07:22.940 INFO:tasks.workunit.client.1.smithi184.stdout:8/201: rename d1/da/dc/c12 to d1/c53 0 2024-02-28T23:07:22.940 INFO:tasks.workunit.client.0.smithi159.stdout:0/721: link d0/c1c d0/de/db7/cff 0 2024-02-28T23:07:22.941 INFO:tasks.workunit.client.1.smithi184.stdout:4/190: dwrite d1/dc/df/f14 [0,4194304] 0 2024-02-28T23:07:22.943 INFO:tasks.workunit.client.0.smithi159.stdout:3/552: dwrite d0/d2b/d55/d75/d6d/d54/f9e [0,4194304] 0 2024-02-28T23:07:22.946 INFO:tasks.workunit.client.1.smithi184.stdout:7/170: truncate d6/d9/d13/f1f 379188 0 2024-02-28T23:07:22.947 INFO:tasks.workunit.client.0.smithi159.stdout:8/732: creat d2/d11/d52/d47/db6/dba/fe7 x:0 0 0 2024-02-28T23:07:22.952 INFO:tasks.workunit.client.1.smithi184.stdout:8/202: chown d1/da/dc/d16/d32/f39 0 1 2024-02-28T23:07:22.952 INFO:tasks.workunit.client.1.smithi184.stdout:6/170: unlink dc/de/d10/d16/c27 0 2024-02-28T23:07:22.952 INFO:tasks.workunit.client.1.smithi184.stdout:7/171: chown d6/d9/d13/d1e/d2f 7 1 2024-02-28T23:07:22.952 INFO:tasks.workunit.client.0.smithi159.stdout:4/687: mknod d9/d42/d54/d55/da8/cf3 0 2024-02-28T23:07:22.953 INFO:tasks.workunit.client.1.smithi184.stdout:8/203: stat d1 0 2024-02-28T23:07:22.953 INFO:tasks.workunit.client.0.smithi159.stdout:4/688: chown d9/d42/c5f 1157196 1 2024-02-28T23:07:22.957 INFO:tasks.workunit.client.1.smithi184.stdout:3/184: fsync d1/d4/f23 0 2024-02-28T23:07:22.958 INFO:tasks.workunit.client.1.smithi184.stdout:5/183: creat db/d1f/f42 x:0 0 0 2024-02-28T23:07:22.959 INFO:tasks.workunit.client.1.smithi184.stdout:9/197: dwrite d5/db/f20 [0,4194304] 0 2024-02-28T23:07:22.962 INFO:tasks.workunit.client.0.smithi159.stdout:3/553: chown d0/d2b/d55/d75/d6d/d54/d7c/c87 0 1 2024-02-28T23:07:22.963 INFO:tasks.workunit.client.1.smithi184.stdout:1/259: creat d20/d32/d51/f55 x:0 0 0 2024-02-28T23:07:22.964 INFO:tasks.workunit.client.1.smithi184.stdout:5/184: dread - db/d1f/f42 zero size 2024-02-28T23:07:22.965 INFO:tasks.workunit.client.0.smithi159.stdout:2/548: symlink d9/lbd 0 2024-02-28T23:07:22.965 INFO:tasks.workunit.client.1.smithi184.stdout:0/190: dwrite d0/df/d13/d27/f39 [0,4194304] 0 2024-02-28T23:07:22.967 INFO:tasks.workunit.client.0.smithi159.stdout:8/733: dwrite d2/d11/d52/d26/d36/f55 [0,4194304] 0 2024-02-28T23:07:22.969 INFO:tasks.workunit.client.1.smithi184.stdout:0/191: write d0/d1d/f35 [857751,50048] 0 2024-02-28T23:07:22.970 INFO:tasks.workunit.client.0.smithi159.stdout:4/689: symlink d9/da/d1c/d23/d2d/de1/lf4 0 2024-02-28T23:07:22.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:22 smithi159 ceph-mon[28802]: pgmap v30: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 33 MiB/s rd, 124 MiB/s wr, 287 op/s 2024-02-28T23:07:22.976 INFO:tasks.workunit.client.1.smithi184.stdout:2/189: link d10/d1f/c3b d10/c3e 0 2024-02-28T23:07:22.977 INFO:tasks.workunit.client.1.smithi184.stdout:7/172: unlink d6/d9/d13/d1e/d2f/d34/f3b 0 2024-02-28T23:07:22.979 INFO:tasks.workunit.client.1.smithi184.stdout:2/190: dread - d10/d1f/f2f zero size 2024-02-28T23:07:22.979 INFO:tasks.workunit.client.1.smithi184.stdout:5/185: dread db/d1f/d32/f3e [0,4194304] 0 2024-02-28T23:07:22.981 INFO:tasks.workunit.client.0.smithi159.stdout:2/549: symlink d9/d34/lbe 0 2024-02-28T23:07:22.982 INFO:tasks.workunit.client.1.smithi184.stdout:6/171: dwrite dc/de/d10/f19 [4194304,4194304] 0 2024-02-28T23:07:22.985 INFO:tasks.workunit.client.1.smithi184.stdout:8/204: creat d1/da/dc/d16/d29/f54 x:0 0 0 2024-02-28T23:07:22.986 INFO:tasks.workunit.client.1.smithi184.stdout:9/198: mkdir d5/d17/d43 0 2024-02-28T23:07:22.987 INFO:tasks.workunit.client.1.smithi184.stdout:8/205: dread - d1/da/dc/d16/d29/f54 zero size 2024-02-28T23:07:22.993 INFO:tasks.workunit.client.1.smithi184.stdout:1/260: mknod d20/d46/c56 0 2024-02-28T23:07:22.997 INFO:tasks.workunit.client.0.smithi159.stdout:4/690: mkdir d9/d42/d54/d56/df5 0 2024-02-28T23:07:22.999 INFO:tasks.workunit.client.1.smithi184.stdout:2/191: dwrite d10/d13/d15/d24/f22 [4194304,4194304] 0 2024-02-28T23:07:22.999 INFO:tasks.workunit.client.1.smithi184.stdout:4/191: mknod d1/dc/df/d22/c3e 0 2024-02-28T23:07:23.002 INFO:tasks.workunit.client.0.smithi159.stdout:9/625: mkdir d4/d3d/d3e/d55/d9e/db3/dc1 0 2024-02-28T23:07:23.002 INFO:tasks.workunit.client.1.smithi184.stdout:4/192: chown d1/dc/l20 107 1 2024-02-28T23:07:23.004 INFO:tasks.workunit.client.0.smithi159.stdout:2/550: rename d9/d80/la5 to d9/d34/lbf 0 2024-02-28T23:07:23.009 INFO:tasks.workunit.client.0.smithi159.stdout:0/722: dwrite d0/d5/d14/d34/d3d/f82 [0,4194304] 0 2024-02-28T23:07:23.010 INFO:tasks.workunit.client.1.smithi184.stdout:9/199: dwrite d5/db/f42 [0,4194304] 0 2024-02-28T23:07:23.011 INFO:tasks.workunit.client.1.smithi184.stdout:5/186: rmdir db/d12/d18/d2e 39 2024-02-28T23:07:23.016 INFO:tasks.workunit.client.0.smithi159.stdout:0/723: chown d0/d5/d14/d25/d2c/dab/dc5 986988 1 2024-02-28T23:07:23.016 INFO:tasks.workunit.client.1.smithi184.stdout:5/187: write db/d12/d1c/d21/f35 [224566,125646] 0 2024-02-28T23:07:23.018 INFO:tasks.workunit.client.0.smithi159.stdout:5/594: sync 2024-02-28T23:07:23.019 INFO:tasks.workunit.client.1.smithi184.stdout:6/172: symlink dc/de/d2a/l3c 0 2024-02-28T23:07:23.023 INFO:tasks.workunit.client.1.smithi184.stdout:0/192: fdatasync d0/df/d13/d27/f39 0 2024-02-28T23:07:23.024 INFO:tasks.workunit.client.1.smithi184.stdout:8/206: dread d1/da/df/f1f [0,4194304] 0 2024-02-28T23:07:23.026 INFO:tasks.workunit.client.1.smithi184.stdout:0/193: fdatasync d0/df/d13/f3e 0 2024-02-28T23:07:23.026 INFO:tasks.workunit.client.1.smithi184.stdout:1/261: creat d20/d46/f57 x:0 0 0 2024-02-28T23:07:23.031 INFO:tasks.workunit.client.1.smithi184.stdout:1/262: truncate f9 4287836 0 2024-02-28T23:07:23.034 INFO:tasks.workunit.client.1.smithi184.stdout:1/263: truncate f17 4987565 0 2024-02-28T23:07:23.037 INFO:tasks.workunit.client.1.smithi184.stdout:1/264: write fe [1722134,104614] 0 2024-02-28T23:07:23.038 INFO:tasks.workunit.client.1.smithi184.stdout:7/173: dwrite d6/d9/d13/d14/f2a [0,4194304] 0 2024-02-28T23:07:23.039 INFO:tasks.workunit.client.1.smithi184.stdout:1/265: chown f19 1464871 1 2024-02-28T23:07:23.041 INFO:tasks.workunit.client.1.smithi184.stdout:3/185: rmdir d1/d4/d6/d2e 0 2024-02-28T23:07:23.045 INFO:tasks.workunit.client.1.smithi184.stdout:3/186: truncate d1/d4/d1c/f31 458450 0 2024-02-28T23:07:23.051 INFO:tasks.workunit.client.1.smithi184.stdout:3/187: dread d1/f21 [4194304,4194304] 0 2024-02-28T23:07:23.052 INFO:tasks.workunit.client.1.smithi184.stdout:5/188: creat db/d12/d1c/d21/d2f/f43 x:0 0 0 2024-02-28T23:07:23.052 INFO:tasks.workunit.client.1.smithi184.stdout:3/188: chown d1/d4/fb 2602 1 2024-02-28T23:07:23.055 INFO:tasks.workunit.client.1.smithi184.stdout:7/174: rmdir d6/d9/d13/d1e 39 2024-02-28T23:07:23.056 INFO:tasks.workunit.client.1.smithi184.stdout:7/175: chown d6/d9/d13/d3e 112 1 2024-02-28T23:07:23.059 INFO:tasks.workunit.client.1.smithi184.stdout:1/266: creat d20/d46/f58 x:0 0 0 2024-02-28T23:07:23.068 INFO:tasks.workunit.client.1.smithi184.stdout:5/189: fdatasync db/d12/d18/d2e/d3c/f3d 0 2024-02-28T23:07:23.068 INFO:tasks.workunit.client.1.smithi184.stdout:3/189: dread d1/d4/f14 [0,4194304] 0 2024-02-28T23:07:23.070 INFO:tasks.workunit.client.1.smithi184.stdout:8/207: truncate d1/da/dc/d16/d32/f46 3034180 0 2024-02-28T23:07:23.073 INFO:tasks.workunit.client.1.smithi184.stdout:9/200: getdents d5 0 2024-02-28T23:07:23.073 INFO:tasks.workunit.client.1.smithi184.stdout:8/208: dread - d1/da/f2c zero size 2024-02-28T23:07:23.074 INFO:tasks.workunit.client.1.smithi184.stdout:2/192: dread d10/d1f/f32 [0,4194304] 0 2024-02-28T23:07:23.076 INFO:tasks.workunit.client.1.smithi184.stdout:8/209: chown d1/da/dc/d18 919105381 1 2024-02-28T23:07:23.079 INFO:tasks.workunit.client.1.smithi184.stdout:0/194: getdents d0/df/d13/d27 0 2024-02-28T23:07:23.079 INFO:tasks.workunit.client.1.smithi184.stdout:3/190: stat d1/d4/d5/c13 0 2024-02-28T23:07:23.080 INFO:tasks.workunit.client.0.smithi159.stdout:3/554: creat d0/fac x:0 0 0 2024-02-28T23:07:23.081 INFO:tasks.workunit.client.1.smithi184.stdout:1/267: dwrite d20/d32/d51/f55 [0,4194304] 0 2024-02-28T23:07:23.082 INFO:tasks.workunit.client.0.smithi159.stdout:4/691: symlink d9/da/d1c/d23/d2d/de1/lf6 0 2024-02-28T23:07:23.084 INFO:tasks.workunit.client.1.smithi184.stdout:3/191: fsync d1/d4/d6/d1f/f2b 0 2024-02-28T23:07:23.085 INFO:tasks.workunit.client.1.smithi184.stdout:7/176: link d6/f8 d6/d9/d13/d14/f42 0 2024-02-28T23:07:23.086 INFO:tasks.workunit.client.1.smithi184.stdout:2/193: symlink d10/d13/d15/d24/l3f 0 2024-02-28T23:07:23.089 INFO:tasks.workunit.client.1.smithi184.stdout:8/210: creat d1/da/dc/f55 x:0 0 0 2024-02-28T23:07:23.090 INFO:tasks.workunit.client.0.smithi159.stdout:2/551: rename d9/d50/d54/d84/da2 to d9/d34/d44/dc0 0 2024-02-28T23:07:23.091 INFO:tasks.workunit.client.1.smithi184.stdout:9/201: mknod d5/d17/d43/c44 0 2024-02-28T23:07:23.093 INFO:tasks.workunit.client.0.smithi159.stdout:2/552: truncate d9/d50/d54/f9a 593553 0 2024-02-28T23:07:23.093 INFO:tasks.workunit.client.1.smithi184.stdout:0/195: readlink d0/df/l3f 0 2024-02-28T23:07:23.094 INFO:tasks.workunit.client.1.smithi184.stdout:5/190: dwrite db/d12/f39 [0,4194304] 0 2024-02-28T23:07:23.094 INFO:tasks.workunit.client.0.smithi159.stdout:5/595: creat d8/d19/d23/d35/d65/fc9 x:0 0 0 2024-02-28T23:07:23.097 INFO:tasks.workunit.client.0.smithi159.stdout:2/553: write d9/d50/d54/f66 [220046,14735] 0 2024-02-28T23:07:23.098 INFO:tasks.workunit.client.0.smithi159.stdout:3/555: dread - d0/d2b/d55/d75/d6d/d54/f61 zero size 2024-02-28T23:07:23.099 INFO:tasks.workunit.client.1.smithi184.stdout:6/173: dwrite dc/de/f29 [0,4194304] 0 2024-02-28T23:07:23.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:22 smithi184 ceph-mon[36198]: pgmap v30: 65 pgs: 65 active+clean; 1.4 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 33 MiB/s rd, 124 MiB/s wr, 287 op/s 2024-02-28T23:07:23.102 INFO:tasks.workunit.client.0.smithi159.stdout:3/556: write d0/d2b/d55/d75/d6d/d54/d7c/d79/f9f [592843,57260] 0 2024-02-28T23:07:23.105 INFO:tasks.workunit.client.1.smithi184.stdout:3/192: dread d1/d4/d1c/f31 [0,4194304] 0 2024-02-28T23:07:23.106 INFO:tasks.workunit.client.1.smithi184.stdout:3/193: fdatasync d1/d4/d6/d1f/f33 0 2024-02-28T23:07:23.107 INFO:tasks.workunit.client.0.smithi159.stdout:8/734: getdents d2/d11/d52/d26/d36/d38 0 2024-02-28T23:07:23.110 INFO:tasks.workunit.client.1.smithi184.stdout:7/177: mknod d6/d9/d13/d14/c43 0 2024-02-28T23:07:23.111 INFO:tasks.workunit.client.0.smithi159.stdout:8/735: read d2/d11/f4b [1337644,117781] 0 2024-02-28T23:07:23.115 INFO:tasks.workunit.client.0.smithi159.stdout:5/596: truncate d8/d19/d23/d2a/f4e 1902939 0 2024-02-28T23:07:23.115 INFO:tasks.workunit.client.0.smithi159.stdout:7/498: sync 2024-02-28T23:07:23.115 INFO:tasks.workunit.client.0.smithi159.stdout:6/587: sync 2024-02-28T23:07:23.116 INFO:tasks.workunit.client.0.smithi159.stdout:5/597: chown d8/d19/d23/d35/d38/d8f 313802807 1 2024-02-28T23:07:23.120 INFO:tasks.workunit.client.1.smithi184.stdout:9/202: dwrite d5/db/f16 [0,4194304] 0 2024-02-28T23:07:23.121 INFO:tasks.workunit.client.0.smithi159.stdout:9/626: fdatasync d4/d3d/d3e/d55/f2a 0 2024-02-28T23:07:23.126 INFO:tasks.workunit.client.1.smithi184.stdout:6/174: creat dc/de/d10/f3d x:0 0 0 2024-02-28T23:07:23.127 INFO:tasks.workunit.client.1.smithi184.stdout:3/194: mkdir d1/d4/d6/d1f/d26/d3a 0 2024-02-28T23:07:23.128 INFO:tasks.workunit.client.1.smithi184.stdout:8/211: mknod d1/da/d10/d43/c56 0 2024-02-28T23:07:23.130 INFO:tasks.workunit.client.0.smithi159.stdout:4/692: write d9/d42/d54/d56/fb3 [1458232,39399] 0 2024-02-28T23:07:23.134 INFO:tasks.workunit.client.1.smithi184.stdout:1/268: dread d20/f35 [0,4194304] 0 2024-02-28T23:07:23.137 INFO:tasks.workunit.client.0.smithi159.stdout:6/588: fsync d0/fe 0 2024-02-28T23:07:23.139 INFO:tasks.workunit.client.0.smithi159.stdout:5/598: creat d8/d19/d23/d35/d65/db5/fca x:0 0 0 2024-02-28T23:07:23.140 INFO:tasks.workunit.client.1.smithi184.stdout:0/196: dread d0/df/d13/f29 [0,4194304] 0 2024-02-28T23:07:23.142 INFO:tasks.workunit.client.1.smithi184.stdout:0/197: write d0/f37 [771393,56079] 0 2024-02-28T23:07:23.147 INFO:tasks.workunit.client.0.smithi159.stdout:0/724: link d0/d5/d14/d25/c48 d0/d5/d14/d25/d5c/c100 0 2024-02-28T23:07:23.148 INFO:tasks.workunit.client.1.smithi184.stdout:5/191: dwrite db/d1f/d32/f37 [0,4194304] 0 2024-02-28T23:07:23.148 INFO:tasks.workunit.client.1.smithi184.stdout:3/195: mknod d1/d4/d5/c3b 0 2024-02-28T23:07:23.150 INFO:tasks.workunit.client.1.smithi184.stdout:8/212: creat d1/da/dc/d18/f57 x:0 0 0 2024-02-28T23:07:23.151 INFO:tasks.workunit.client.0.smithi159.stdout:4/693: mkdir d9/da/d1c/d8e/ddc/dc9/df7 0 2024-02-28T23:07:23.152 INFO:tasks.workunit.client.0.smithi159.stdout:4/694: dread - d9/f8c zero size 2024-02-28T23:07:23.153 INFO:tasks.workunit.client.1.smithi184.stdout:1/269: chown d20/d46/l4c 7420793 1 2024-02-28T23:07:23.156 INFO:tasks.workunit.client.1.smithi184.stdout:7/178: rename d6/d9/da/dc/f20 to d6/d9/d13/d1e/d2f/f44 0 2024-02-28T23:07:23.156 INFO:tasks.workunit.client.0.smithi159.stdout:2/554: dwrite d9/d23/f6a [0,4194304] 0 2024-02-28T23:07:23.157 INFO:tasks.workunit.client.0.smithi159.stdout:3/557: creat d0/d3f/fad x:0 0 0 2024-02-28T23:07:23.159 INFO:tasks.workunit.client.1.smithi184.stdout:9/203: creat d5/db/de/d10/d12/d2f/d3f/f45 x:0 0 0 2024-02-28T23:07:23.160 INFO:tasks.workunit.client.1.smithi184.stdout:4/193: sync 2024-02-28T23:07:23.161 INFO:tasks.workunit.client.0.smithi159.stdout:8/736: truncate d2/ff 1943738 0 2024-02-28T23:07:23.161 INFO:tasks.workunit.client.1.smithi184.stdout:4/194: chown d1/lb 173337019 1 2024-02-28T23:07:23.162 INFO:tasks.workunit.client.1.smithi184.stdout:4/195: dread - d1/dc/df/f31 zero size 2024-02-28T23:07:23.170 INFO:tasks.workunit.client.1.smithi184.stdout:5/192: mkdir db/d44 0 2024-02-28T23:07:23.171 INFO:tasks.workunit.client.0.smithi159.stdout:0/725: rmdir d0/d5/d38/d63 39 2024-02-28T23:07:23.172 INFO:tasks.workunit.client.1.smithi184.stdout:3/196: mknod d1/d4/d1c/c3c 0 2024-02-28T23:07:23.174 INFO:tasks.workunit.client.0.smithi159.stdout:0/726: chown d0/d5/d14/d78/f8c 524776724 1 2024-02-28T23:07:23.174 INFO:tasks.workunit.client.1.smithi184.stdout:3/197: chown d1/d4/d5/f32 0 1 2024-02-28T23:07:23.175 INFO:tasks.workunit.client.0.smithi159.stdout:2/555: dread d9/d34/fbc [0,4194304] 0 2024-02-28T23:07:23.176 INFO:tasks.workunit.client.1.smithi184.stdout:8/213: mkdir d1/da/d10/d43/d58 0 2024-02-28T23:07:23.176 INFO:tasks.workunit.client.1.smithi184.stdout:4/196: dwrite d1/d8/d19/f39 [0,4194304] 0 2024-02-28T23:07:23.177 INFO:tasks.workunit.client.1.smithi184.stdout:4/197: readlink d1/l2d 0 2024-02-28T23:07:23.178 INFO:tasks.workunit.client.0.smithi159.stdout:2/556: chown d9/l75 28022107 1 2024-02-28T23:07:23.179 INFO:tasks.workunit.client.1.smithi184.stdout:7/179: mkdir d6/d9/d13/d14/d45 0 2024-02-28T23:07:23.181 INFO:tasks.workunit.client.0.smithi159.stdout:6/589: dwrite d0/d1b/d33/d11/d34/d9d/da2/db7/db1/f87 [4194304,4194304] 0 2024-02-28T23:07:23.181 INFO:tasks.workunit.client.1.smithi184.stdout:9/204: unlink d5/db/de/d10/d12/c15 0 2024-02-28T23:07:23.182 INFO:tasks.workunit.client.1.smithi184.stdout:9/205: chown c2 4786811 1 2024-02-28T23:07:23.184 INFO:tasks.workunit.client.1.smithi184.stdout:9/206: chown d5/db/de/d10/l22 55 1 2024-02-28T23:07:23.186 INFO:tasks.workunit.client.0.smithi159.stdout:9/627: rename d4/d3d/d3e/d55/d37/d62/f80 to d4/d3d/d3e/d55/d37/d62/da6/fc2 0 2024-02-28T23:07:23.196 INFO:tasks.workunit.client.0.smithi159.stdout:3/558: mknod d0/cae 0 2024-02-28T23:07:23.197 INFO:tasks.workunit.client.1.smithi184.stdout:6/175: truncate dc/de/f20 7748841 0 2024-02-28T23:07:23.197 INFO:tasks.workunit.client.1.smithi184.stdout:5/193: rmdir db/d12/d18/d2e 39 2024-02-28T23:07:23.197 INFO:tasks.workunit.client.1.smithi184.stdout:4/198: dwrite d1/dc/df/f14 [0,4194304] 0 2024-02-28T23:07:23.199 INFO:tasks.workunit.client.1.smithi184.stdout:2/194: link d10/c3e d10/d13/d15/c40 0 2024-02-28T23:07:23.203 INFO:tasks.workunit.client.1.smithi184.stdout:8/214: creat d1/da/d33/f59 x:0 0 0 2024-02-28T23:07:23.206 INFO:tasks.workunit.client.0.smithi159.stdout:2/557: creat d9/d34/d44/dc0/fc1 x:0 0 0 2024-02-28T23:07:23.210 INFO:tasks.workunit.client.1.smithi184.stdout:3/198: rename d1/d4/d5/f32 to d1/d4/d6/d1f/d26/d3a/f3d 0 2024-02-28T23:07:23.213 INFO:tasks.workunit.client.1.smithi184.stdout:9/207: symlink d5/d17/d43/l46 0 2024-02-28T23:07:23.215 INFO:tasks.workunit.client.0.smithi159.stdout:4/695: rename d9/d42/d54/d56/f70 to d9/d42/d54/d9c/ff8 0 2024-02-28T23:07:23.216 INFO:tasks.workunit.client.1.smithi184.stdout:0/198: truncate d0/d1f/f25 2606940 0 2024-02-28T23:07:23.216 INFO:tasks.workunit.client.1.smithi184.stdout:6/176: mknod dc/de/d2a/c3e 0 2024-02-28T23:07:23.218 INFO:tasks.workunit.client.1.smithi184.stdout:9/208: write d5/db/de/f39 [503766,106395] 0 2024-02-28T23:07:23.220 INFO:tasks.workunit.client.0.smithi159.stdout:9/628: write d4/d3d/d3e/d55/f43 [6299364,40724] 0 2024-02-28T23:07:23.220 INFO:tasks.workunit.client.0.smithi159.stdout:6/590: dread d0/d1b/f29 [0,4194304] 0 2024-02-28T23:07:23.221 INFO:tasks.workunit.client.1.smithi184.stdout:5/194: unlink db/d12/d1c/d21/f35 0 2024-02-28T23:07:23.223 INFO:tasks.workunit.client.0.smithi159.stdout:8/737: write d2/d11/d52/d47/d65/d68/f8d [1841361,107296] 0 2024-02-28T23:07:23.223 INFO:tasks.workunit.client.1.smithi184.stdout:2/195: fsync d10/f14 0 2024-02-28T23:07:23.225 INFO:tasks.workunit.client.1.smithi184.stdout:0/199: dread d0/d1d/f35 [0,4194304] 0 2024-02-28T23:07:23.231 INFO:tasks.workunit.client.0.smithi159.stdout:2/558: dread d9/d50/d62/f68 [0,4194304] 0 2024-02-28T23:07:23.232 INFO:tasks.workunit.client.0.smithi159.stdout:5/599: getdents d8/d19/d23/d35/d41/daa 0 2024-02-28T23:07:23.234 INFO:tasks.workunit.client.1.smithi184.stdout:4/199: rename d1/d4/l32 to d1/d8/l3f 0 2024-02-28T23:07:23.236 INFO:tasks.workunit.client.0.smithi159.stdout:2/559: truncate d9/d50/d54/d84/d37/d5c/fa3 949201 0 2024-02-28T23:07:23.237 INFO:tasks.workunit.client.1.smithi184.stdout:5/195: dwrite db/d1f/d32/f37 [4194304,4194304] 0 2024-02-28T23:07:23.238 INFO:tasks.workunit.client.1.smithi184.stdout:3/199: creat d1/d4/d6/d1f/d24/f3e x:0 0 0 2024-02-28T23:07:23.239 INFO:tasks.workunit.client.0.smithi159.stdout:2/560: truncate d9/d23/d2c/d55/f2a 4459834 0 2024-02-28T23:07:23.240 INFO:tasks.workunit.client.1.smithi184.stdout:3/200: write d1/d4/d6/d1f/d26/f2a [3130483,93434] 0 2024-02-28T23:07:23.240 INFO:tasks.workunit.client.1.smithi184.stdout:3/201: chown d1 1898646 1 2024-02-28T23:07:23.242 INFO:tasks.workunit.client.1.smithi184.stdout:3/202: stat d1/d4/d5/l2f 0 2024-02-28T23:07:23.243 INFO:tasks.workunit.client.0.smithi159.stdout:0/727: truncate d0/de/d75/d5f/f72 54993 0 2024-02-28T23:07:23.243 INFO:tasks.workunit.client.0.smithi159.stdout:6/591: readlink d0/d1b/l45 0 2024-02-28T23:07:23.244 INFO:tasks.workunit.client.0.smithi159.stdout:6/592: chown d0/d1b/d33/f3d 1965728961 1 2024-02-28T23:07:23.244 INFO:tasks.workunit.client.0.smithi159.stdout:9/629: creat d4/d3d/d3e/d55/d9e/fc3 x:0 0 0 2024-02-28T23:07:23.245 INFO:tasks.workunit.client.0.smithi159.stdout:6/593: chown d0/d1b/d33/d11/f67 117190188 1 2024-02-28T23:07:23.248 INFO:tasks.workunit.client.1.smithi184.stdout:9/209: mkdir d5/d47 0 2024-02-28T23:07:23.252 INFO:tasks.workunit.client.1.smithi184.stdout:8/215: creat d1/da/dc/d16/d4d/f5a x:0 0 0 2024-02-28T23:07:23.252 INFO:tasks.workunit.client.0.smithi159.stdout:5/600: creat d8/d19/d23/d35/d65/fcb x:0 0 0 2024-02-28T23:07:23.253 INFO:tasks.workunit.client.1.smithi184.stdout:2/196: creat d10/d1f/f41 x:0 0 0 2024-02-28T23:07:23.254 INFO:tasks.workunit.client.1.smithi184.stdout:2/197: chown l6 10993 1 2024-02-28T23:07:23.254 INFO:tasks.workunit.client.0.smithi159.stdout:2/561: creat d9/d50/d62/fc2 x:0 0 0 2024-02-28T23:07:23.258 INFO:tasks.workunit.client.1.smithi184.stdout:7/180: creat d6/f46 x:0 0 0 2024-02-28T23:07:23.258 INFO:tasks.workunit.client.0.smithi159.stdout:4/696: write d9/d42/d54/f57 [1223454,21794] 0 2024-02-28T23:07:23.258 INFO:tasks.workunit.client.0.smithi159.stdout:3/559: link d0/d6/d34/l7d d0/d2b/d55/d75/d6d/d54/d7c/laf 0 2024-02-28T23:07:23.265 INFO:tasks.workunit.client.1.smithi184.stdout:6/177: write dc/f14 [506187,44705] 0 2024-02-28T23:07:23.265 INFO:tasks.workunit.client.1.smithi184.stdout:4/200: dread d1/d8/d19/f1a [0,4194304] 0 2024-02-28T23:07:23.265 INFO:tasks.workunit.client.1.smithi184.stdout:5/196: symlink db/d12/d1c/d21/d2f/l45 0 2024-02-28T23:07:23.266 INFO:tasks.workunit.client.0.smithi159.stdout:5/601: chown d8/d19/d23/f61 9743626 1 2024-02-28T23:07:23.269 INFO:tasks.workunit.client.0.smithi159.stdout:2/562: mkdir d9/d36/dc3 0 2024-02-28T23:07:23.271 INFO:tasks.workunit.client.1.smithi184.stdout:1/270: sync 2024-02-28T23:07:23.272 INFO:tasks.workunit.client.0.smithi159.stdout:9/630: creat d4/d3d/d3e/d55/d9e/db3/dc1/fc4 x:0 0 0 2024-02-28T23:07:23.274 INFO:tasks.workunit.client.1.smithi184.stdout:8/216: dwrite d1/da/f31 [0,4194304] 0 2024-02-28T23:07:23.275 INFO:tasks.workunit.client.1.smithi184.stdout:1/271: fdatasync d20/d32/d51/f55 0 2024-02-28T23:07:23.275 INFO:tasks.workunit.client.0.smithi159.stdout:0/728: write d0/d5/d14/d25/d2c/d4b/fc3 [949266,789] 0 2024-02-28T23:07:23.275 INFO:tasks.workunit.client.0.smithi159.stdout:8/738: dwrite d2/d3/f1f [0,4194304] 0 2024-02-28T23:07:23.276 INFO:tasks.workunit.client.0.smithi159.stdout:4/697: write d9/da/d1c/f1d [1003135,110040] 0 2024-02-28T23:07:23.278 INFO:tasks.workunit.client.1.smithi184.stdout:8/217: dread - d1/da/f3a zero size 2024-02-28T23:07:23.279 INFO:tasks.workunit.client.0.smithi159.stdout:3/560: creat d0/d2b/d55/d75/d6d/fb0 x:0 0 0 2024-02-28T23:07:23.280 INFO:tasks.workunit.client.0.smithi159.stdout:8/739: write d2/d3/f2a [1480916,48618] 0 2024-02-28T23:07:23.282 INFO:tasks.workunit.client.0.smithi159.stdout:4/698: readlink d9/d42/d54/d55/le9 0 2024-02-28T23:07:23.282 INFO:tasks.workunit.client.1.smithi184.stdout:7/181: dwrite d6/f3d [0,4194304] 0 2024-02-28T23:07:23.285 INFO:tasks.workunit.client.1.smithi184.stdout:2/198: mkdir d10/d1f/d42 0 2024-02-28T23:07:23.286 INFO:tasks.workunit.client.0.smithi159.stdout:3/561: write d0/d6/f32 [4832479,113781] 0 2024-02-28T23:07:23.287 INFO:tasks.workunit.client.0.smithi159.stdout:9/631: mkdir d4/d3d/d3e/d4a/dc5 0 2024-02-28T23:07:23.289 INFO:tasks.workunit.client.1.smithi184.stdout:4/201: unlink d1/dc/df/l3a 0 2024-02-28T23:07:23.290 INFO:tasks.workunit.client.1.smithi184.stdout:2/199: read d10/d13/d15/f2b [1668754,33578] 0 2024-02-28T23:07:23.295 INFO:tasks.workunit.client.1.smithi184.stdout:3/203: getdents d1/d4/d6/d36 0 2024-02-28T23:07:23.295 INFO:tasks.workunit.client.1.smithi184.stdout:5/197: symlink db/d12/d1c/d21/d25/l46 0 2024-02-28T23:07:23.295 INFO:tasks.workunit.client.1.smithi184.stdout:6/178: dread dc/de/f36 [0,4194304] 0 2024-02-28T23:07:23.295 INFO:tasks.workunit.client.1.smithi184.stdout:0/200: dread d0/df/f30 [0,4194304] 0 2024-02-28T23:07:23.302 INFO:tasks.workunit.client.0.smithi159.stdout:8/740: mkdir d2/d11/d52/d47/d65/d68/de8 0 2024-02-28T23:07:23.303 INFO:tasks.workunit.client.1.smithi184.stdout:0/201: truncate d0/df/d13/d27/f2c 438768 0 2024-02-28T23:07:23.303 INFO:tasks.workunit.client.1.smithi184.stdout:8/218: rmdir d1 39 2024-02-28T23:07:23.304 INFO:tasks.workunit.client.1.smithi184.stdout:1/272: rename d20/d46/f58 to d20/d32/d4d/f59 0 2024-02-28T23:07:23.305 INFO:tasks.workunit.client.1.smithi184.stdout:1/273: fsync f19 0 2024-02-28T23:07:23.305 INFO:tasks.workunit.client.1.smithi184.stdout:0/202: dread - d0/df/d13/f3e zero size 2024-02-28T23:07:23.306 INFO:tasks.workunit.client.1.smithi184.stdout:1/274: readlink d20/l45 0 2024-02-28T23:07:23.308 INFO:tasks.workunit.client.0.smithi159.stdout:0/729: mkdir d0/de/de7/d101 0 2024-02-28T23:07:23.310 INFO:tasks.workunit.client.0.smithi159.stdout:6/594: dread d0/d1b/d33/d11/d34/f35 [4194304,4194304] 0 2024-02-28T23:07:23.312 INFO:tasks.workunit.client.0.smithi159.stdout:3/562: dwrite d0/d2b/d55/d75/d6d/d54/d7c/f64 [0,4194304] 0 2024-02-28T23:07:23.314 INFO:tasks.workunit.client.1.smithi184.stdout:9/210: write d5/d26/f3e [5046430,33148] 0 2024-02-28T23:07:23.315 INFO:tasks.workunit.client.0.smithi159.stdout:6/595: stat d0/d1b/d33/d11/d34/f6a 0 2024-02-28T23:07:23.316 INFO:tasks.workunit.client.0.smithi159.stdout:4/699: creat d9/da/dc5/ff9 x:0 0 0 2024-02-28T23:07:23.323 INFO:tasks.workunit.client.0.smithi159.stdout:0/730: fdatasync d0/d5/d14/d25/d2c/d4b/f54 0 2024-02-28T23:07:23.326 INFO:tasks.workunit.client.0.smithi159.stdout:5/602: getdents d8 0 2024-02-28T23:07:23.326 INFO:tasks.workunit.client.0.smithi159.stdout:0/731: readlink d0/d5/d14/d34/d3d/l79 0 2024-02-28T23:07:23.327 INFO:tasks.workunit.client.1.smithi184.stdout:7/182: dread f0 [0,4194304] 0 2024-02-28T23:07:23.327 INFO:tasks.workunit.client.1.smithi184.stdout:6/179: rmdir dc/de/d10 39 2024-02-28T23:07:23.328 INFO:tasks.workunit.client.0.smithi159.stdout:5/603: chown d8/d19/d23/d35/d38/fa7 1 1 2024-02-28T23:07:23.332 INFO:tasks.workunit.client.1.smithi184.stdout:8/219: write d1/da/dc/d16/d29/f2a [2654934,68929] 0 2024-02-28T23:07:23.332 INFO:tasks.workunit.client.0.smithi159.stdout:4/700: mknod d9/d42/d54/d9c/cfa 0 2024-02-28T23:07:23.333 INFO:tasks.workunit.client.0.smithi159.stdout:2/563: dread d9/d36/f7e [0,4194304] 0 2024-02-28T23:07:23.336 INFO:tasks.workunit.client.0.smithi159.stdout:5/604: read d8/d19/d23/d35/d65/f83 [3656562,51755] 0 2024-02-28T23:07:23.336 INFO:tasks.workunit.client.0.smithi159.stdout:2/564: write d9/d50/d54/f8e [642564,96052] 0 2024-02-28T23:07:23.337 INFO:tasks.workunit.client.1.smithi184.stdout:8/220: dread d1/da/d10/d17/f13 [0,4194304] 0 2024-02-28T23:07:23.341 INFO:tasks.workunit.client.0.smithi159.stdout:8/741: link d2/d73/dc2/fe2 d2/d11/d52/d26/d36/d38/d77/d9e/dc1/dc4/fe9 0 2024-02-28T23:07:23.342 INFO:tasks.workunit.client.0.smithi159.stdout:1/582: sync 2024-02-28T23:07:23.342 INFO:tasks.workunit.client.0.smithi159.stdout:8/742: readlink d2/d3/l7 0 2024-02-28T23:07:23.343 INFO:tasks.workunit.client.1.smithi184.stdout:1/275: mknod d20/d32/d4b/c5a 0 2024-02-28T23:07:23.343 INFO:tasks.workunit.client.0.smithi159.stdout:1/583: dread - d6/d1d/d1f/d3e/f73 zero size 2024-02-28T23:07:23.344 INFO:tasks.workunit.client.0.smithi159.stdout:9/632: link d4/d3d/d3e/d55/d37/f6c d4/d3d/d3e/d55/d4c/db6/fc6 0 2024-02-28T23:07:23.345 INFO:tasks.workunit.client.0.smithi159.stdout:6/596: write d0/d1b/d33/d11/d34/d9d/da2/d4d/f58 [197938,43127] 0 2024-02-28T23:07:23.348 INFO:tasks.workunit.client.1.smithi184.stdout:0/203: write d0/d1d/f35 [1459399,56249] 0 2024-02-28T23:07:23.349 INFO:tasks.workunit.client.1.smithi184.stdout:2/200: link d10/f16 d10/f43 0 2024-02-28T23:07:23.350 INFO:tasks.workunit.client.1.smithi184.stdout:4/202: symlink d1/d8/d35/l40 0 2024-02-28T23:07:23.351 INFO:tasks.workunit.client.0.smithi159.stdout:4/701: creat d9/da/d1c/d23/d2d/ffb x:0 0 0 2024-02-28T23:07:23.354 INFO:tasks.workunit.client.1.smithi184.stdout:5/198: truncate f8 2638132 0 2024-02-28T23:07:23.356 INFO:tasks.workunit.client.0.smithi159.stdout:5/605: truncate d8/d19/d23/d2a/f8c 295538 0 2024-02-28T23:07:23.356 INFO:tasks.workunit.client.1.smithi184.stdout:5/199: chown db/d44 76 1 2024-02-28T23:07:23.356 INFO:tasks.workunit.client.1.smithi184.stdout:8/221: dwrite d1/da/dc/d18/f57 [0,4194304] 0 2024-02-28T23:07:23.356 INFO:tasks.workunit.client.1.smithi184.stdout:5/200: readlink db/d12/l15 0 2024-02-28T23:07:23.357 INFO:tasks.workunit.client.1.smithi184.stdout:7/183: rename d6/d9/d13/d1e/d2f/d34/d40 to d6/d9/d13/d1e/d2f/d34/d47 0 2024-02-28T23:07:23.358 INFO:tasks.workunit.client.0.smithi159.stdout:8/743: symlink d2/d11/d74/lea 0 2024-02-28T23:07:23.359 INFO:tasks.workunit.client.1.smithi184.stdout:7/184: chown d6/d9/da/dc/c3a 31 1 2024-02-28T23:07:23.362 INFO:tasks.workunit.client.0.smithi159.stdout:0/732: getdents d0/d5/d14/d34/d3d/df5 0 2024-02-28T23:07:23.365 INFO:tasks.workunit.client.1.smithi184.stdout:0/204: symlink d0/d1d/l40 0 2024-02-28T23:07:23.365 INFO:tasks.workunit.client.0.smithi159.stdout:3/563: truncate d0/d6/d3e/d57/f6c 370929 0 2024-02-28T23:07:23.369 INFO:tasks.workunit.client.1.smithi184.stdout:2/201: mknod d10/d13/c44 0 2024-02-28T23:07:23.372 INFO:tasks.workunit.client.1.smithi184.stdout:2/202: write d10/d13/d15/d24/f22 [5531670,121184] 0 2024-02-28T23:07:23.372 INFO:tasks.workunit.client.1.smithi184.stdout:8/222: dwrite d1/da/df/d20/f3e [0,4194304] 0 2024-02-28T23:07:23.373 INFO:tasks.workunit.client.1.smithi184.stdout:4/203: mkdir d1/dc/df/d41 0 2024-02-28T23:07:23.374 INFO:tasks.workunit.client.1.smithi184.stdout:2/203: read d10/f16 [340994,38606] 0 2024-02-28T23:07:23.376 INFO:tasks.workunit.client.1.smithi184.stdout:6/180: symlink dc/de/d10/d16/l3f 0 2024-02-28T23:07:23.376 INFO:tasks.workunit.client.0.smithi159.stdout:5/606: read d8/d19/d23/f91 [220601,103824] 0 2024-02-28T23:07:23.378 INFO:tasks.workunit.client.1.smithi184.stdout:1/276: dread ff [0,4194304] 0 2024-02-28T23:07:23.378 INFO:tasks.workunit.client.0.smithi159.stdout:2/565: dwrite d9/d50/d62/f65 [0,4194304] 0 2024-02-28T23:07:23.382 INFO:tasks.workunit.client.1.smithi184.stdout:5/201: creat db/d12/f47 x:0 0 0 2024-02-28T23:07:23.387 INFO:tasks.workunit.client.0.smithi159.stdout:1/584: symlink d6/d12/d33/lc5 0 2024-02-28T23:07:23.391 INFO:tasks.workunit.client.0.smithi159.stdout:9/633: mkdir d4/d3d/d3e/d55/d37/d62/d77/db9/dc7 0 2024-02-28T23:07:23.396 INFO:tasks.workunit.client.1.smithi184.stdout:9/211: rename d5/f9 to d5/d17/d43/f48 0 2024-02-28T23:07:23.398 INFO:tasks.workunit.client.0.smithi159.stdout:6/597: link d0/d1b/d33/d3f/d44/fa0 d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/fb9 0 2024-02-28T23:07:23.400 INFO:tasks.workunit.client.0.smithi159.stdout:8/744: write d2/d11/f85 [328135,51656] 0 2024-02-28T23:07:23.400 INFO:tasks.workunit.client.1.smithi184.stdout:0/205: creat d0/df/f41 x:0 0 0 2024-02-28T23:07:23.401 INFO:tasks.workunit.client.1.smithi184.stdout:3/204: link d1/d4/d1c/l2d d1/d4/d1c/l3f 0 2024-02-28T23:07:23.402 INFO:tasks.workunit.client.1.smithi184.stdout:3/205: stat d1/d4/d6/ce 0 2024-02-28T23:07:23.404 INFO:tasks.workunit.client.0.smithi159.stdout:5/607: rename d8/d59/f84 to d8/fcc 0 2024-02-28T23:07:23.407 INFO:tasks.workunit.client.0.smithi159.stdout:0/733: symlink d0/de/d75/l102 0 2024-02-28T23:07:23.410 INFO:tasks.workunit.client.1.smithi184.stdout:7/185: write d6/d9/da/f37 [1998931,38374] 0 2024-02-28T23:07:23.411 INFO:tasks.workunit.client.1.smithi184.stdout:6/181: dread dc/fd [0,4194304] 0 2024-02-28T23:07:23.412 INFO:tasks.workunit.client.1.smithi184.stdout:8/223: creat d1/da/f5b x:0 0 0 2024-02-28T23:07:23.412 INFO:tasks.workunit.client.0.smithi159.stdout:0/734: dread d0/d5/d14/d34/d6c/ffa [0,4194304] 0 2024-02-28T23:07:23.413 INFO:tasks.workunit.client.0.smithi159.stdout:0/735: stat d0/d5/d14/d25/la3 0 2024-02-28T23:07:23.416 INFO:tasks.workunit.client.0.smithi159.stdout:3/564: creat d0/d6/d3e/d2f/d78/fb1 x:0 0 0 2024-02-28T23:07:23.417 INFO:tasks.workunit.client.0.smithi159.stdout:3/565: dread - d0/d3f/fad zero size 2024-02-28T23:07:23.421 INFO:tasks.workunit.client.0.smithi159.stdout:6/598: creat d0/d1b/d5b/fba x:0 0 0 2024-02-28T23:07:23.421 INFO:tasks.workunit.client.0.smithi159.stdout:1/585: dread d6/d12/d31/d69/f5e [4194304,4194304] 0 2024-02-28T23:07:23.424 INFO:tasks.workunit.client.0.smithi159.stdout:4/702: creat d9/ffc x:0 0 0 2024-02-28T23:07:23.431 INFO:tasks.workunit.client.1.smithi184.stdout:4/204: creat d1/d8/d35/f42 x:0 0 0 2024-02-28T23:07:23.431 INFO:tasks.workunit.client.1.smithi184.stdout:7/186: write d6/d9/d13/d1e/f21 [357472,126840] 0 2024-02-28T23:07:23.431 INFO:tasks.workunit.client.0.smithi159.stdout:0/736: truncate d0/de/d75/de8/fe6 228348 0 2024-02-28T23:07:23.431 INFO:tasks.workunit.client.1.smithi184.stdout:1/277: symlink d20/d32/d3e/l5b 0 2024-02-28T23:07:23.432 INFO:tasks.workunit.client.0.smithi159.stdout:9/634: write d4/d3d/d3e/d55/d4c/db6/fc6 [1580826,66735] 0 2024-02-28T23:07:23.432 INFO:tasks.workunit.client.1.smithi184.stdout:2/204: rename d10/d13/c31 to d10/d1f/d38/c45 0 2024-02-28T23:07:23.432 INFO:tasks.workunit.client.1.smithi184.stdout:9/212: mknod d5/d17/d2c/c49 0 2024-02-28T23:07:23.433 INFO:tasks.workunit.client.1.smithi184.stdout:0/206: mkdir d0/d1d/d42 0 2024-02-28T23:07:23.434 INFO:tasks.workunit.client.1.smithi184.stdout:3/206: mkdir d1/d4/d5/d40 0 2024-02-28T23:07:23.434 INFO:tasks.workunit.client.0.smithi159.stdout:3/566: rmdir d0/d2b/d55/d75/d6d/d54/d6a 39 2024-02-28T23:07:23.436 INFO:tasks.workunit.client.0.smithi159.stdout:3/567: chown d0/d6/d3e 28009 1 2024-02-28T23:07:23.438 INFO:tasks.workunit.client.1.smithi184.stdout:3/207: write d1/d4/d6/d1e/f37 [271444,36942] 0 2024-02-28T23:07:23.440 INFO:tasks.workunit.client.0.smithi159.stdout:8/745: truncate d2/d3/f3c 279035 0 2024-02-28T23:07:23.441 INFO:tasks.workunit.client.1.smithi184.stdout:3/208: write d1/d4/d6/d1f/d24/f3e [842727,3402] 0 2024-02-28T23:07:23.450 INFO:tasks.workunit.client.0.smithi159.stdout:1/586: mkdir d6/d1d/d1f/d3e/d9c/db3/dc4/dc6 0 2024-02-28T23:07:23.451 INFO:tasks.workunit.client.1.smithi184.stdout:4/205: dread d1/dc/df/f14 [0,4194304] 0 2024-02-28T23:07:23.453 INFO:tasks.workunit.client.1.smithi184.stdout:0/207: dwrite d0/d1f/f28 [0,4194304] 0 2024-02-28T23:07:23.454 INFO:tasks.workunit.client.1.smithi184.stdout:7/187: dwrite d6/d9/da/dc/f1b [0,4194304] 0 2024-02-28T23:07:23.455 INFO:tasks.workunit.client.1.smithi184.stdout:4/206: read d1/f10 [3420641,48886] 0 2024-02-28T23:07:23.455 INFO:tasks.workunit.client.0.smithi159.stdout:4/703: dread d9/da/d1c/d23/f24 [4194304,4194304] 0 2024-02-28T23:07:23.456 INFO:tasks.workunit.client.0.smithi159.stdout:3/568: dwrite d0/d6/fa6 [0,4194304] 0 2024-02-28T23:07:23.458 INFO:tasks.workunit.client.1.smithi184.stdout:7/188: write d6/d9/d13/d14/f2a [4885614,86163] 0 2024-02-28T23:07:23.459 INFO:tasks.workunit.client.1.smithi184.stdout:9/213: rename d5/d17/d2c to d5/d47/d4a 0 2024-02-28T23:07:23.462 INFO:tasks.workunit.client.0.smithi159.stdout:8/746: symlink d2/d11/d52/d47/d65/d68/leb 0 2024-02-28T23:07:23.463 INFO:tasks.workunit.client.1.smithi184.stdout:8/224: write d1/da/dc/d16/d4d/f5a [147055,83330] 0 2024-02-28T23:07:23.465 INFO:tasks.workunit.client.0.smithi159.stdout:6/599: link d0/d1b/d33/d8c/cb8 d0/d1b/d5b/cbb 0 2024-02-28T23:07:23.471 INFO:tasks.workunit.client.0.smithi159.stdout:9/635: dread d4/f3c [0,4194304] 0 2024-02-28T23:07:23.471 INFO:tasks.workunit.client.0.smithi159.stdout:4/704: readlink d9/d42/d95/l9f 0 2024-02-28T23:07:23.472 INFO:tasks.workunit.client.0.smithi159.stdout:3/569: creat d0/d2b/d55/d75/d6d/d54/d7c/d79/d9b/fb2 x:0 0 0 2024-02-28T23:07:23.472 INFO:tasks.workunit.client.1.smithi184.stdout:6/182: dwrite f3 [0,4194304] 0 2024-02-28T23:07:23.479 INFO:tasks.workunit.client.0.smithi159.stdout:3/570: chown d0/d6/d3e/c8c 161828837 1 2024-02-28T23:07:23.479 INFO:tasks.workunit.client.1.smithi184.stdout:4/207: mkdir d1/d4/d43 0 2024-02-28T23:07:23.479 INFO:tasks.workunit.client.1.smithi184.stdout:4/208: chown d1 330 1 2024-02-28T23:07:23.486 INFO:tasks.workunit.client.0.smithi159.stdout:0/737: read d0/de/d75/de8/fe6 [198704,70982] 0 2024-02-28T23:07:23.489 INFO:tasks.workunit.client.0.smithi159.stdout:6/600: creat d0/d1b/d33/d11/d34/d9d/da2/db7/db1/fbc x:0 0 0 2024-02-28T23:07:23.492 INFO:tasks.workunit.client.0.smithi159.stdout:3/571: mknod d0/d47/cb3 0 2024-02-28T23:07:23.493 INFO:tasks.workunit.client.1.smithi184.stdout:9/214: fdatasync d5/d17/f3c 0 2024-02-28T23:07:23.495 INFO:tasks.workunit.client.1.smithi184.stdout:8/225: readlink d1/da/d10/d17/l49 0 2024-02-28T23:07:23.496 INFO:tasks.workunit.client.1.smithi184.stdout:1/278: rename d20/c2a to d20/c5c 0 2024-02-28T23:07:23.496 INFO:tasks.workunit.client.0.smithi159.stdout:3/572: fdatasync d0/d2b/d55/d75/d6d/f66 0 2024-02-28T23:07:23.497 INFO:tasks.workunit.client.1.smithi184.stdout:8/226: fsync d1/da/dc/d16/f1b 0 2024-02-28T23:07:23.498 INFO:tasks.workunit.client.0.smithi159.stdout:1/587: dwrite d6/d12/d33/d3c/f4b [0,4194304] 0 2024-02-28T23:07:23.499 INFO:tasks.workunit.client.0.smithi159.stdout:0/738: rmdir d0/d5/d14/d25 39 2024-02-28T23:07:23.500 INFO:tasks.workunit.client.0.smithi159.stdout:9/636: getdents d4/d3d/d3e/d55/d37/d62/db0 0 2024-02-28T23:07:23.503 INFO:tasks.workunit.client.0.smithi159.stdout:8/747: rmdir d2/d11/d52/d47/d65/d68/de8 0 2024-02-28T23:07:23.503 INFO:tasks.workunit.client.0.smithi159.stdout:1/588: fsync d6/d12/f70 0 2024-02-28T23:07:23.504 INFO:tasks.workunit.client.1.smithi184.stdout:3/209: rename d1/d4/d6/d1f/c22 to d1/d4/c41 0 2024-02-28T23:07:23.506 INFO:tasks.workunit.client.1.smithi184.stdout:3/210: write d1/d4/d6/d1f/d26/f29 [3180157,38048] 0 2024-02-28T23:07:23.507 INFO:tasks.workunit.client.1.smithi184.stdout:3/211: chown d1/d4/d6/c10 192 1 2024-02-28T23:07:23.509 INFO:tasks.workunit.client.1.smithi184.stdout:3/212: chown d1/d4/f23 15618389 1 2024-02-28T23:07:23.510 INFO:tasks.workunit.client.0.smithi159.stdout:3/573: unlink d0/d6/d3e/f1d 0 2024-02-28T23:07:23.511 INFO:tasks.workunit.client.1.smithi184.stdout:2/205: getdents d10/d13/d15/d24 0 2024-02-28T23:07:23.513 INFO:tasks.workunit.client.0.smithi159.stdout:6/601: dwrite d0/d1b/d33/d3f/d44/d7a/f8e [0,4194304] 0 2024-02-28T23:07:23.516 INFO:tasks.workunit.client.0.smithi159.stdout:3/574: dread - d0/d6/d3e/d2f/d78/fb1 zero size 2024-02-28T23:07:23.517 INFO:tasks.workunit.client.0.smithi159.stdout:0/739: mkdir d0/de/d75/db8/d103 0 2024-02-28T23:07:23.519 INFO:tasks.workunit.client.1.smithi184.stdout:1/279: rename c1f to d20/d32/d51/c5d 0 2024-02-28T23:07:23.527 INFO:tasks.workunit.client.0.smithi159.stdout:4/705: write d9/d20/f89 [549577,42360] 0 2024-02-28T23:07:23.530 INFO:tasks.workunit.client.0.smithi159.stdout:1/589: dwrite d6/d12/d31/d5a/fa2 [0,4194304] 0 2024-02-28T23:07:23.533 INFO:tasks.workunit.client.0.smithi159.stdout:3/575: rename d0/d6/l37 to d0/d2b/d55/d75/d6d/d54/d63/lb4 0 2024-02-28T23:07:23.534 INFO:tasks.workunit.client.0.smithi159.stdout:6/602: mknod d0/cbd 0 2024-02-28T23:07:23.536 INFO:tasks.workunit.client.1.smithi184.stdout:8/227: chown d1/da/df/f1f 12155543 1 2024-02-28T23:07:23.538 INFO:tasks.workunit.client.1.smithi184.stdout:7/189: write d6/d9/da/f10 [3467093,67729] 0 2024-02-28T23:07:23.539 INFO:tasks.workunit.client.0.smithi159.stdout:0/740: mknod d0/d5/d38/d63/dad/c104 0 2024-02-28T23:07:23.541 INFO:tasks.workunit.client.1.smithi184.stdout:6/183: link dc/de/d10/f38 dc/de/f40 0 2024-02-28T23:07:23.543 INFO:tasks.workunit.client.0.smithi159.stdout:4/706: symlink d9/d4c/lfd 0 2024-02-28T23:07:23.543 INFO:tasks.workunit.client.1.smithi184.stdout:6/184: chown dc/f26 8329 1 2024-02-28T23:07:23.544 INFO:tasks.workunit.client.1.smithi184.stdout:0/208: getdents d0/df 0 2024-02-28T23:07:23.544 INFO:tasks.workunit.client.1.smithi184.stdout:5/202: sync 2024-02-28T23:07:23.544 INFO:tasks.workunit.client.0.smithi159.stdout:1/590: truncate d6/d12/f1b 1787414 0 2024-02-28T23:07:23.545 INFO:tasks.workunit.client.1.smithi184.stdout:5/203: chown db/d12/d1c 10601 1 2024-02-28T23:07:23.547 INFO:tasks.workunit.client.1.smithi184.stdout:1/280: rmdir d20/d32/d4d 39 2024-02-28T23:07:23.548 INFO:tasks.workunit.client.1.smithi184.stdout:5/204: write db/d12/d1c/d21/f2a [1541067,15210] 0 2024-02-28T23:07:23.549 INFO:tasks.workunit.client.0.smithi159.stdout:3/576: fdatasync d0/f4c 0 2024-02-28T23:07:23.550 INFO:tasks.workunit.client.1.smithi184.stdout:5/205: chown db/d12/d1c/d21 392369 1 2024-02-28T23:07:23.551 INFO:tasks.workunit.client.0.smithi159.stdout:7/499: sync 2024-02-28T23:07:23.552 INFO:tasks.workunit.client.0.smithi159.stdout:6/603: symlink d0/d1b/d33/d3f/lbe 0 2024-02-28T23:07:23.554 INFO:tasks.workunit.client.0.smithi159.stdout:7/500: write d5/d10/f36 [2366555,6363] 0 2024-02-28T23:07:23.555 INFO:tasks.workunit.client.1.smithi184.stdout:3/213: write d1/d4/d1c/f31 [1226722,86129] 0 2024-02-28T23:07:23.560 INFO:tasks.workunit.client.1.smithi184.stdout:8/228: rename d1/da/df/f22 to d1/da/dc/d16/f5c 0 2024-02-28T23:07:23.565 INFO:tasks.workunit.client.0.smithi159.stdout:4/707: dread d9/d4c/f5a [0,4194304] 0 2024-02-28T23:07:23.565 INFO:tasks.workunit.client.0.smithi159.stdout:8/748: dread d2/d11/d52/d26/d36/d38/f5d [0,4194304] 0 2024-02-28T23:07:23.567 INFO:tasks.workunit.client.1.smithi184.stdout:1/281: creat d20/d32/d51/f5e x:0 0 0 2024-02-28T23:07:23.569 INFO:tasks.workunit.client.0.smithi159.stdout:1/591: dwrite d6/d1d/d1f/d3e/f44 [0,4194304] 0 2024-02-28T23:07:23.570 INFO:tasks.workunit.client.0.smithi159.stdout:1/592: readlink d6/d1d/l8f 0 2024-02-28T23:07:23.571 INFO:tasks.workunit.client.0.smithi159.stdout:7/501: rmdir d5/d56 39 2024-02-28T23:07:23.572 INFO:tasks.workunit.client.1.smithi184.stdout:2/206: link l2 d10/d13/l46 0 2024-02-28T23:07:23.576 INFO:tasks.workunit.client.0.smithi159.stdout:0/741: mknod d0/d5/d14/d25/d2c/c105 0 2024-02-28T23:07:23.577 INFO:tasks.workunit.client.1.smithi184.stdout:3/214: unlink d1/d4/d6/d1f/c20 0 2024-02-28T23:07:23.577 INFO:tasks.workunit.client.0.smithi159.stdout:9/637: dread d4/d3d/d3e/d55/d4c/d4e/f63 [4194304,4194304] 0 2024-02-28T23:07:23.579 INFO:tasks.workunit.client.1.smithi184.stdout:0/209: dread d0/d1f/f25 [0,4194304] 0 2024-02-28T23:07:23.579 INFO:tasks.workunit.client.0.smithi159.stdout:0/742: dread d0/d5/d14/d34/d6c/ffa [0,4194304] 0 2024-02-28T23:07:23.582 INFO:tasks.workunit.client.0.smithi159.stdout:4/708: creat d9/da/d1c/d23/d2d/ffe x:0 0 0 2024-02-28T23:07:23.725 INFO:tasks.workunit.client.0.smithi159.stdout:1/593: unlink d6/d12/d1a/c3b 0 2024-02-28T23:07:23.725 INFO:tasks.workunit.client.0.smithi159.stdout:7/502: mknod d5/d16/d1a/d27/d3e/ca3 0 2024-02-28T23:07:23.725 INFO:tasks.workunit.client.0.smithi159.stdout:9/638: chown d4/l93 122033 1 2024-02-28T23:07:23.725 INFO:tasks.workunit.client.0.smithi159.stdout:3/577: creat d0/d3f/fb5 x:0 0 0 2024-02-28T23:07:23.725 INFO:tasks.workunit.client.0.smithi159.stdout:0/743: creat d0/d5/d14/d25/f106 x:0 0 0 2024-02-28T23:07:23.725 INFO:tasks.workunit.client.0.smithi159.stdout:3/578: write d0/d2b/d55/d75/d6d/f3d [6295597,126574] 0 2024-02-28T23:07:23.725 INFO:tasks.workunit.client.0.smithi159.stdout:6/604: write d0/d1b/f1a [5601376,49745] 0 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:9/639: chown d4/c10 868684095 1 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:9/640: read d4/d3d/d3e/d55/d37/f54 [130133,52350] 0 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:1/594: write d6/d12/d33/d48/f4a [3341382,41675] 0 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:4/709: creat d9/d42/d54/d9c/dd7/fff x:0 0 0 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:6/605: mkdir d0/d1b/d33/d11/d34/d9d/da2/dbf 0 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:7/503: creat d5/d16/d1a/d27/d46/d65/d81/d98/d9e/fa4 x:0 0 0 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:1/595: readlink d6/d12/d33/l7e 0 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:8/749: getdents d2/d11/d52/d47/db6 0 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:0/744: dread d0/d5/d14/d78/f87 [0,4194304] 0 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:1/596: chown d6/d12/d33/d48/f98 1536 1 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:6/606: rmdir d0/d1b/d33 39 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:1/597: readlink d6/d1d/d1f/d3e/d6a/l86 0 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:1/598: chown d6/d12/d1a 16954180 1 2024-02-28T23:07:23.726 INFO:tasks.workunit.client.0.smithi159.stdout:3/579: dread d0/d6/f83 [0,4194304] 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:4/710: fsync d9/d20/fbf 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:4/711: write d9/da/dc5/ff9 [749355,113725] 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:0/745: symlink d0/de/d75/db8/l107 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:8/750: rename d2/d11/d52/d47/d65/lbd to d2/d11/d52/d26/d36/d38/d77/dc5/lec 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:8/751: readlink d2/d11/d52/l24 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:6/607: dread d0/d1b/d33/d11/d34/d9d/da2/db7/db1/f87 [0,4194304] 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:4/712: creat d9/d42/d95/f100 x:0 0 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:9/641: link d4/c35 d4/d3d/d3e/cc8 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:4/713: write d9/d42/fab [912018,118713] 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:7/504: dwrite d5/d56/d2a/f4d [0,4194304] 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:1/599: rename d6/d12/f1b to d6/d1d/fc7 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:8/752: dwrite d2/d11/d52/d26/d36/f23 [0,4194304] 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:4/714: truncate d9/f18 431572 0 2024-02-28T23:07:23.727 INFO:tasks.workunit.client.0.smithi159.stdout:1/600: chown d6/f9 11819 1 2024-02-28T23:07:23.728 INFO:tasks.workunit.client.0.smithi159.stdout:3/580: rename d0/d2b/d55/d75/f93 to d0/d2b/d55/d6e/fb6 0 2024-02-28T23:07:23.728 INFO:tasks.workunit.client.0.smithi159.stdout:7/505: truncate d5/f3d 753062 0 2024-02-28T23:07:23.728 INFO:tasks.workunit.client.0.smithi159.stdout:6/608: dread d0/d1b/d33/d11/f19 [0,4194304] 0 2024-02-28T23:07:23.728 INFO:tasks.workunit.client.0.smithi159.stdout:9/642: getdents d4/d3d/d3e/d55/d37/d62/d77/db9/dc7 0 2024-02-28T23:07:23.728 INFO:tasks.workunit.client.0.smithi159.stdout:8/753: symlink d2/d11/d52/d26/d36/d38/d77/d9e/dc1/led 0 2024-02-28T23:07:23.728 INFO:tasks.workunit.client.0.smithi159.stdout:2/566: sync 2024-02-28T23:07:23.728 INFO:tasks.workunit.client.0.smithi159.stdout:5/608: sync 2024-02-28T23:07:23.729 INFO:tasks.workunit.client.1.smithi184.stdout:6/185: mknod dc/de/c41 0 2024-02-28T23:07:23.729 INFO:tasks.workunit.client.1.smithi184.stdout:3/215: dread d1/d4/d6/d1f/d24/f3e [0,4194304] 0 2024-02-28T23:07:23.729 INFO:tasks.workunit.client.1.smithi184.stdout:1/282: stat d20/c43 0 2024-02-28T23:07:23.729 INFO:tasks.workunit.client.1.smithi184.stdout:5/206: rename db/c28 to db/d12/d18/d2e/c48 0 2024-02-28T23:07:23.729 INFO:tasks.workunit.client.1.smithi184.stdout:3/216: dread d1/d4/d6/d1f/d24/f3e [0,4194304] 0 2024-02-28T23:07:23.729 INFO:tasks.workunit.client.1.smithi184.stdout:2/207: unlink d10/d1f/l26 0 2024-02-28T23:07:23.729 INFO:tasks.workunit.client.1.smithi184.stdout:7/190: creat d6/f48 x:0 0 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:0/210: creat d0/d1f/f43 x:0 0 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:1/283: rename d20/l26 to d20/d32/d3e/l5f 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:4/209: sync 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:5/207: creat db/d12/d18/d2e/d3c/f49 x:0 0 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:7/191: mkdir d6/d9/da/dc/d49 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:8/229: truncate d1/da/d10/d17/f47 4125240 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:3/217: unlink d1/lf 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:0/211: rename d0/df/d13/f2f to d0/df/d13/d27/d2b/f44 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:6/186: truncate dc/f14 737724 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:0/212: truncate d0/df/f41 837012 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:6/187: write dc/de/d10/d16/f2d [661519,20967] 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:7/192: dwrite d6/d9/da/dc/f12 [4194304,4194304] 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:8/230: mknod d1/da/dc/d18/c5d 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:3/218: creat d1/d4/f42 x:0 0 0 2024-02-28T23:07:23.730 INFO:tasks.workunit.client.1.smithi184.stdout:8/231: fsync d1/da/df/d20/f30 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:3/219: write d1/d4/d6/d1f/d26/f2a [4278998,126537] 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:8/232: truncate d1/da/d10/d17/f41 953393 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:9/215: sync 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:0/213: dwrite d0/df/d13/f3e [0,4194304] 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:1/284: link f9 d20/d32/d51/f60 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:1/285: write d20/d32/d3e/f3f [1870077,130814] 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:4/210: mkdir d1/d8/d3d/d44 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:1/286: chown d20/d32/d4b 6053 1 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:4/211: fsync d1/d4/f1f 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:6/188: mkdir dc/d42 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:4/212: dread d1/dc/df/f14 [0,4194304] 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:8/233: creat d1/da/d10/d43/f5e x:0 0 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:8/234: readlink d1/da/dc/d16/d32/l36 0 2024-02-28T23:07:23.731 INFO:tasks.workunit.client.1.smithi184.stdout:1/287: mkdir d20/d32/d3e/d61 0 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:2/208: getdents d10/d13 0 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:2/209: chown fa 248 1 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:7/193: symlink d6/d9/d13/d14/d45/l4a 0 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:4/213: chown d1/d8/l3f 233252 1 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:3/220: truncate d1/d4/d6/d1f/f2b 3884879 0 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:3/221: chown d1/d4/d5 15512026 1 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:8/235: dread d1/da/dc/d16/d29/f2a [0,4194304] 0 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:0/214: creat d0/df/d13/d27/d31/f45 x:0 0 0 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:0/215: chown d0/d1d 11839 1 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:0/216: chown d0/df/d13/d27/l36 460913721 1 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:5/208: getdents db/d12/d18/d2e/d3c 0 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:0/217: dwrite d0/d1f/f26 [4194304,4194304] 0 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:2/210: creat d10/d13/f47 x:0 0 0 2024-02-28T23:07:23.732 INFO:tasks.workunit.client.1.smithi184.stdout:6/189: read dc/de/f15 [766954,80865] 0 2024-02-28T23:07:23.733 INFO:tasks.workunit.client.1.smithi184.stdout:7/194: creat d6/d9/d13/d3e/f4b x:0 0 0 2024-02-28T23:07:23.733 INFO:tasks.workunit.client.1.smithi184.stdout:6/190: write dc/de/d10/f1b [5322695,23678] 0 2024-02-28T23:07:23.733 INFO:tasks.workunit.client.1.smithi184.stdout:6/191: fsync dc/de/f29 0 2024-02-28T23:07:23.734 INFO:tasks.workunit.client.0.smithi159.stdout:2/567: write d9/f33 [4289152,53481] 0 2024-02-28T23:07:23.734 INFO:tasks.workunit.client.0.smithi159.stdout:3/581: mknod d0/d47/cb7 0 2024-02-28T23:07:23.734 INFO:tasks.workunit.client.0.smithi159.stdout:1/601: read d6/d12/f18 [2160508,78331] 0 2024-02-28T23:07:23.734 INFO:tasks.workunit.client.0.smithi159.stdout:3/582: read - d0/d3f/fb5 zero size 2024-02-28T23:07:23.734 INFO:tasks.workunit.client.0.smithi159.stdout:7/506: dwrite d5/d56/d50/f8c [0,4194304] 0 2024-02-28T23:07:23.735 INFO:tasks.workunit.client.0.smithi159.stdout:6/609: rename d0/fe to d0/d1b/d33/d3f/d44/fc0 0 2024-02-28T23:07:23.743 INFO:tasks.workunit.client.1.smithi184.stdout:1/288: mknod d20/d32/d4d/c62 0 2024-02-28T23:07:23.748 INFO:tasks.workunit.client.0.smithi159.stdout:1/602: rmdir d6/d12/d33/d72 39 2024-02-28T23:07:23.749 INFO:tasks.workunit.client.1.smithi184.stdout:0/218: mknod d0/df/c46 0 2024-02-28T23:07:23.750 INFO:tasks.workunit.client.1.smithi184.stdout:0/219: write d0/df/f41 [1354505,85715] 0 2024-02-28T23:07:23.751 INFO:tasks.workunit.client.1.smithi184.stdout:2/211: creat d10/d1f/f48 x:0 0 0 2024-02-28T23:07:23.753 INFO:tasks.workunit.client.1.smithi184.stdout:4/214: write d1/dc/fd [6132833,85966] 0 2024-02-28T23:07:23.755 INFO:tasks.workunit.client.0.smithi159.stdout:1/603: dread d6/d12/d1a/d92/fa6 [0,4194304] 0 2024-02-28T23:07:23.757 INFO:tasks.workunit.client.0.smithi159.stdout:4/715: dwrite d9/da/d1c/d23/d2d/fac [0,4194304] 0 2024-02-28T23:07:23.758 INFO:tasks.workunit.client.0.smithi159.stdout:7/507: creat d5/d16/d1a/d24/d64/fa5 x:0 0 0 2024-02-28T23:07:23.770 INFO:tasks.workunit.client.0.smithi159.stdout:9/643: dwrite d4/f32 [0,4194304] 0 2024-02-28T23:07:23.771 INFO:tasks.workunit.client.0.smithi159.stdout:2/568: creat d9/d50/d62/dba/fc4 x:0 0 0 2024-02-28T23:07:23.777 INFO:tasks.workunit.client.1.smithi184.stdout:5/209: rename db/d12/d18/d2e/c48 to db/d12/d18/d2e/d3c/c4a 0 2024-02-28T23:07:23.778 INFO:tasks.workunit.client.0.smithi159.stdout:7/508: dwrite d5/d56/d50/f8c [0,4194304] 0 2024-02-28T23:07:23.780 INFO:tasks.workunit.client.1.smithi184.stdout:1/289: creat d20/d32/d3e/f63 x:0 0 0 2024-02-28T23:07:23.785 INFO:tasks.workunit.client.0.smithi159.stdout:3/583: truncate d0/d6/fa6 1941128 0 2024-02-28T23:07:23.790 INFO:tasks.workunit.client.0.smithi159.stdout:4/716: rmdir d9/da 39 2024-02-28T23:07:23.791 INFO:tasks.workunit.client.1.smithi184.stdout:9/216: link d5/db/de/d10/d12/c25 d5/c4b 0 2024-02-28T23:07:23.791 INFO:tasks.workunit.client.0.smithi159.stdout:6/610: dwrite d0/d1b/d33/d11/d34/d9d/da2/db7/db1/f87 [4194304,4194304] 0 2024-02-28T23:07:23.797 INFO:tasks.workunit.client.1.smithi184.stdout:5/210: rmdir db/d12/d1c 39 2024-02-28T23:07:23.797 INFO:tasks.workunit.client.0.smithi159.stdout:2/569: symlink d9/d50/d54/d84/d37/d5c/lc5 0 2024-02-28T23:07:23.801 INFO:tasks.workunit.client.1.smithi184.stdout:7/195: rename l2 to d6/d9/l4c 0 2024-02-28T23:07:23.802 INFO:tasks.workunit.client.0.smithi159.stdout:5/609: write d8/d16/f72 [1557476,97647] 0 2024-02-28T23:07:23.807 INFO:tasks.workunit.client.0.smithi159.stdout:1/604: write d6/d1d/d46/f4c [2647022,39611] 0 2024-02-28T23:07:23.810 INFO:tasks.workunit.client.1.smithi184.stdout:6/192: truncate dc/de/f29 2465571 0 2024-02-28T23:07:23.810 INFO:tasks.workunit.client.0.smithi159.stdout:1/605: write d6/d12/d1a/fa3 [2173239,119190] 0 2024-02-28T23:07:23.811 INFO:tasks.workunit.client.0.smithi159.stdout:3/584: mknod d0/d6/d3e/d2f/d78/cb8 0 2024-02-28T23:07:23.812 INFO:tasks.workunit.client.1.smithi184.stdout:6/193: chown dc/de/d10/d16/l3f 486256 1 2024-02-28T23:07:23.813 INFO:tasks.workunit.client.0.smithi159.stdout:1/606: chown d6/d12/d31 0 1 2024-02-28T23:07:23.813 INFO:tasks.workunit.client.0.smithi159.stdout:4/717: stat d9/da/d1c/d23/d2d/de1 0 2024-02-28T23:07:23.815 INFO:tasks.workunit.client.0.smithi159.stdout:2/570: mknod d9/d50/d54/cc6 0 2024-02-28T23:07:23.817 INFO:tasks.workunit.client.0.smithi159.stdout:9/644: rename d4/d3d/d3e/d55/c22 to d4/d3d/d3e/d55/d4c/d4e/dbe/cc9 0 2024-02-28T23:07:23.819 INFO:tasks.workunit.client.0.smithi159.stdout:2/571: readlink d9/d50/d54/d84/d37/d5c/la1 0 2024-02-28T23:07:23.820 INFO:tasks.workunit.client.1.smithi184.stdout:2/212: dwrite d10/f2d [0,4194304] 0 2024-02-28T23:07:23.821 INFO:tasks.workunit.client.0.smithi159.stdout:7/509: mknod d5/ca6 0 2024-02-28T23:07:23.821 INFO:tasks.workunit.client.0.smithi159.stdout:9/645: write d4/f32 [2069134,36868] 0 2024-02-28T23:07:23.822 INFO:tasks.workunit.client.1.smithi184.stdout:4/215: truncate d1/d4/f11 4860291 0 2024-02-28T23:07:23.825 INFO:tasks.workunit.client.1.smithi184.stdout:4/216: write d1/f33 [970223,21837] 0 2024-02-28T23:07:23.828 INFO:tasks.workunit.client.1.smithi184.stdout:4/217: chown d1/d8/l2b 27 1 2024-02-28T23:07:23.831 INFO:tasks.workunit.client.0.smithi159.stdout:6/611: rename d0/d1b/d33/d11/d34/f6a to d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/fc1 0 2024-02-28T23:07:23.835 INFO:tasks.workunit.client.0.smithi159.stdout:4/718: dwrite d9/d42/dc8/fd1 [0,4194304] 0 2024-02-28T23:07:23.835 INFO:tasks.workunit.client.0.smithi159.stdout:2/572: mknod d9/d34/cc7 0 2024-02-28T23:07:23.836 INFO:tasks.workunit.client.1.smithi184.stdout:6/194: dwrite dc/de/d10/f3d [0,4194304] 0 2024-02-28T23:07:23.837 INFO:tasks.workunit.client.1.smithi184.stdout:7/196: link d6/d9/d13/d14/l32 d6/d9/da/l4d 0 2024-02-28T23:07:23.839 INFO:tasks.workunit.client.0.smithi159.stdout:2/573: stat d9/f11 0 2024-02-28T23:07:23.839 INFO:tasks.workunit.client.0.smithi159.stdout:4/719: fsync d9/d42/d54/d9c/fba 0 2024-02-28T23:07:23.844 INFO:tasks.workunit.client.0.smithi159.stdout:2/574: truncate d9/d23/d2c/d55/d13/d4f/f9d 525383 0 2024-02-28T23:07:23.845 INFO:tasks.workunit.client.0.smithi159.stdout:2/575: chown d9/d23/d2c/f67 30055366 1 2024-02-28T23:07:23.845 INFO:tasks.workunit.client.1.smithi184.stdout:5/211: dread db/d1f/f27 [0,4194304] 0 2024-02-28T23:07:23.849 INFO:tasks.workunit.client.1.smithi184.stdout:1/290: write d20/f3a [705654,2449] 0 2024-02-28T23:07:23.851 INFO:tasks.workunit.client.1.smithi184.stdout:1/291: write d20/d32/f34 [1565681,72609] 0 2024-02-28T23:07:23.855 INFO:tasks.workunit.client.0.smithi159.stdout:7/510: rmdir d5 39 2024-02-28T23:07:23.857 INFO:tasks.workunit.client.1.smithi184.stdout:3/222: sync 2024-02-28T23:07:23.857 INFO:tasks.workunit.client.1.smithi184.stdout:8/236: sync 2024-02-28T23:07:23.863 INFO:tasks.workunit.client.1.smithi184.stdout:2/213: symlink d10/d13/d15/l49 0 2024-02-28T23:07:23.863 INFO:tasks.workunit.client.1.smithi184.stdout:8/237: write d1/da/dc/d16/f1b [612887,18814] 0 2024-02-28T23:07:23.864 INFO:tasks.workunit.client.1.smithi184.stdout:7/197: unlink d6/d9/da/c11 0 2024-02-28T23:07:23.868 INFO:tasks.workunit.client.1.smithi184.stdout:9/217: dwrite d5/d17/f28 [0,4194304] 0 2024-02-28T23:07:23.872 INFO:tasks.workunit.client.1.smithi184.stdout:6/195: rename dc/de/d10/f28 to dc/de/d10/f43 0 2024-02-28T23:07:23.872 INFO:tasks.workunit.client.1.smithi184.stdout:5/212: creat db/d1f/d32/f4b x:0 0 0 2024-02-28T23:07:23.873 INFO:tasks.workunit.client.1.smithi184.stdout:5/213: readlink db/d12/d18/d2e/l3b 0 2024-02-28T23:07:23.874 INFO:tasks.workunit.client.0.smithi159.stdout:2/576: mkdir d9/d34/d44/dc8 0 2024-02-28T23:07:23.875 INFO:tasks.workunit.client.1.smithi184.stdout:5/214: write db/d1f/d32/f4b [509044,25533] 0 2024-02-28T23:07:23.877 INFO:tasks.workunit.client.1.smithi184.stdout:5/215: write db/d1f/f42 [78604,94748] 0 2024-02-28T23:07:23.877 INFO:tasks.workunit.client.0.smithi159.stdout:9/646: symlink d4/d52/d7d/lca 0 2024-02-28T23:07:23.878 INFO:tasks.workunit.client.1.smithi184.stdout:3/223: unlink d1/d4/d1c/f35 0 2024-02-28T23:07:23.881 INFO:tasks.workunit.client.1.smithi184.stdout:5/216: truncate db/d12/d18/d2e/f38 625714 0 2024-02-28T23:07:23.888 INFO:tasks.workunit.client.0.smithi159.stdout:5/610: dread d8/ff [0,4194304] 0 2024-02-28T23:07:23.888 INFO:tasks.workunit.client.0.smithi159.stdout:6/612: write d0/d1b/d33/d11/f67 [1245467,25056] 0 2024-02-28T23:07:23.890 INFO:tasks.workunit.client.1.smithi184.stdout:7/198: rmdir d6/d9/da 39 2024-02-28T23:07:23.893 INFO:tasks.workunit.client.1.smithi184.stdout:9/218: write d5/d17/f3d [1696529,101433] 0 2024-02-28T23:07:23.895 INFO:tasks.workunit.client.0.smithi159.stdout:9/647: readlink d4/l48 0 2024-02-28T23:07:23.895 INFO:tasks.workunit.client.1.smithi184.stdout:9/219: write d5/d26/f3e [3723970,130324] 0 2024-02-28T23:07:23.896 INFO:tasks.workunit.client.0.smithi159.stdout:9/648: stat d4/d76/fa8 0 2024-02-28T23:07:23.897 INFO:tasks.workunit.client.1.smithi184.stdout:9/220: dread - d5/db/de/d10/f2a zero size 2024-02-28T23:07:23.899 INFO:tasks.workunit.client.0.smithi159.stdout:7/511: symlink d5/d56/d2a/la7 0 2024-02-28T23:07:23.899 INFO:tasks.workunit.client.1.smithi184.stdout:9/221: chown d5/d17/d43/f48 305 1 2024-02-28T23:07:23.899 INFO:tasks.workunit.client.1.smithi184.stdout:8/238: dwrite d1/da/f31 [0,4194304] 0 2024-02-28T23:07:23.900 INFO:tasks.workunit.client.1.smithi184.stdout:4/218: link d1/l18 d1/d8/l45 0 2024-02-28T23:07:23.901 INFO:tasks.workunit.client.0.smithi159.stdout:7/512: rename d5/d16/d1a/d27 to d5/d16/d1a/d27/d3e/da8 22 2024-02-28T23:07:23.902 INFO:tasks.workunit.client.0.smithi159.stdout:3/585: getdents d0/d2b/d4f 0 2024-02-28T23:07:23.905 INFO:tasks.workunit.client.0.smithi159.stdout:5/611: write d8/d19/d23/d35/d41/f5d [551318,61991] 0 2024-02-28T23:07:23.907 INFO:tasks.workunit.client.1.smithi184.stdout:6/196: dread dc/de/f20 [4194304,4194304] 0 2024-02-28T23:07:23.913 INFO:tasks.workunit.client.0.smithi159.stdout:6/613: symlink d0/d1b/d33/d11/d34/d9d/da2/db7/db1/lc2 0 2024-02-28T23:07:23.919 INFO:tasks.workunit.client.0.smithi159.stdout:2/577: link d9/d23/d2c/d55/f95 d9/d34/d44/dc8/fc9 0 2024-02-28T23:07:23.919 INFO:tasks.workunit.client.1.smithi184.stdout:3/224: write d1/f21 [323422,126275] 0 2024-02-28T23:07:23.921 INFO:tasks.workunit.client.0.smithi159.stdout:3/586: dwrite d0/d3f/fad [0,4194304] 0 2024-02-28T23:07:23.923 INFO:tasks.workunit.client.0.smithi159.stdout:7/513: rmdir d5/d16/d1a/d27/d75 39 2024-02-28T23:07:23.924 INFO:tasks.workunit.client.1.smithi184.stdout:2/214: truncate f8 1938610 0 2024-02-28T23:07:23.930 INFO:tasks.workunit.client.0.smithi159.stdout:5/612: rmdir d8/d19/d23/d35/d65 39 2024-02-28T23:07:23.930 INFO:tasks.workunit.client.0.smithi159.stdout:4/720: getdents d9/d4c/d6c/d98 0 2024-02-28T23:07:23.931 INFO:tasks.workunit.client.1.smithi184.stdout:0/220: sync 2024-02-28T23:07:23.933 INFO:tasks.workunit.client.1.smithi184.stdout:8/239: symlink d1/da/dc/d18/l5f 0 2024-02-28T23:07:23.938 INFO:tasks.workunit.client.0.smithi159.stdout:9/649: mkdir d4/d3d/d3e/d55/d37/d62/d77/db9/dc7/dcb 0 2024-02-28T23:07:23.943 INFO:tasks.workunit.client.1.smithi184.stdout:9/222: dwrite d5/f7 [0,4194304] 0 2024-02-28T23:07:23.943 INFO:tasks.workunit.client.1.smithi184.stdout:4/219: dread d1/d8/f1b [0,4194304] 0 2024-02-28T23:07:23.945 INFO:tasks.workunit.client.0.smithi159.stdout:7/514: dwrite d5/d16/d1a/f70 [0,4194304] 0 2024-02-28T23:07:23.946 INFO:tasks.workunit.client.0.smithi159.stdout:3/587: dread - d0/d2b/d55/d75/d6d/d54/d6a/fa0 zero size 2024-02-28T23:07:23.947 INFO:tasks.workunit.client.1.smithi184.stdout:3/225: dread d1/d4/fb [0,4194304] 0 2024-02-28T23:07:23.948 INFO:tasks.workunit.client.0.smithi159.stdout:4/721: creat d9/da/d1c/dad/f101 x:0 0 0 2024-02-28T23:07:23.955 INFO:tasks.workunit.client.0.smithi159.stdout:9/650: creat d4/d3d/d3e/d55/d4c/d4e/dbe/fcc x:0 0 0 2024-02-28T23:07:23.957 INFO:tasks.workunit.client.0.smithi159.stdout:7/515: mkdir d5/d16/d1a/d27/d46/d65/da9 0 2024-02-28T23:07:23.959 INFO:tasks.workunit.client.1.smithi184.stdout:0/221: mkdir d0/d47 0 2024-02-28T23:07:23.959 INFO:tasks.workunit.client.1.smithi184.stdout:5/217: write f8 [1465510,1307] 0 2024-02-28T23:07:23.959 INFO:tasks.workunit.client.1.smithi184.stdout:6/197: write dc/de/f15 [1228399,28751] 0 2024-02-28T23:07:23.961 INFO:tasks.workunit.client.1.smithi184.stdout:8/240: mknod d1/da/dc/d16/c60 0 2024-02-28T23:07:23.961 INFO:tasks.workunit.client.1.smithi184.stdout:7/199: creat d6/d9/f4e x:0 0 0 2024-02-28T23:07:23.962 INFO:tasks.workunit.client.0.smithi159.stdout:4/722: creat d9/d42/db1/f102 x:0 0 0 2024-02-28T23:07:23.964 INFO:tasks.workunit.client.0.smithi159.stdout:5/613: rename d8/c25 to d8/d19/d23/d35/d41/d92/ccd 0 2024-02-28T23:07:23.965 INFO:tasks.workunit.client.1.smithi184.stdout:2/215: unlink d10/d1f/d38/c45 0 2024-02-28T23:07:23.966 INFO:tasks.workunit.client.0.smithi159.stdout:3/588: dread d0/d2b/d55/d75/d6d/d54/f9e [0,4194304] 0 2024-02-28T23:07:23.966 INFO:tasks.workunit.client.1.smithi184.stdout:8/241: fdatasync d1/da/dc/d18/f57 0 2024-02-28T23:07:23.966 INFO:tasks.workunit.client.1.smithi184.stdout:5/218: write db/d1f/d32/f33 [469294,115942] 0 2024-02-28T23:07:23.966 INFO:tasks.workunit.client.1.smithi184.stdout:1/292: sync 2024-02-28T23:07:23.968 INFO:tasks.workunit.client.1.smithi184.stdout:4/220: mknod d1/d8/d37/c46 0 2024-02-28T23:07:23.970 INFO:tasks.workunit.client.0.smithi159.stdout:4/723: mkdir d9/d4c/d6c/d98/d103 0 2024-02-28T23:07:23.971 INFO:tasks.workunit.client.1.smithi184.stdout:0/222: dread d0/df/d13/d27/f2c [0,4194304] 0 2024-02-28T23:07:23.971 INFO:tasks.workunit.client.1.smithi184.stdout:9/223: dwrite d5/db/d29/f3b [0,4194304] 0 2024-02-28T23:07:23.973 INFO:tasks.workunit.client.0.smithi159.stdout:6/614: getdents d0/d1b/d33/d11/d34/d9d/da2/d96 0 2024-02-28T23:07:23.974 INFO:tasks.workunit.client.0.smithi159.stdout:7/516: rename d5/d16/d1a/d27/d46/d65/d81/d98/d9e to d5/d56/d50/daa 0 2024-02-28T23:07:23.977 INFO:tasks.workunit.client.0.smithi159.stdout:2/578: getdents d9/d50/d54/d84/d37/d5c 0 2024-02-28T23:07:23.978 INFO:tasks.workunit.client.1.smithi184.stdout:1/293: creat d20/d32/d3e/f64 x:0 0 0 2024-02-28T23:07:23.979 INFO:tasks.workunit.client.1.smithi184.stdout:6/198: rename dc/de/d10/l1f to dc/de/d10/d3a/l44 0 2024-02-28T23:07:23.981 INFO:tasks.workunit.client.0.smithi159.stdout:9/651: truncate d4/f5 2047193 0 2024-02-28T23:07:23.983 INFO:tasks.workunit.client.0.smithi159.stdout:2/579: write d9/d50/d54/d84/d37/d5c/fa3 [473338,12790] 0 2024-02-28T23:07:23.983 INFO:tasks.workunit.client.0.smithi159.stdout:4/724: symlink d9/d42/d54/d9c/dd7/l104 0 2024-02-28T23:07:23.986 INFO:tasks.workunit.client.0.smithi159.stdout:5/614: rename d8/d59/f6b to d8/d19/d23/d35/d41/fce 0 2024-02-28T23:07:23.987 INFO:tasks.workunit.client.0.smithi159.stdout:2/580: write d9/d23/da9/fb5 [147124,84982] 0 2024-02-28T23:07:23.987 INFO:tasks.workunit.client.0.smithi159.stdout:4/725: readlink d9/da/d1c/d23/d2d/l76 0 2024-02-28T23:07:23.987 INFO:tasks.workunit.client.0.smithi159.stdout:3/589: dwrite d0/d6/d3e/f4a [8388608,4194304] 0 2024-02-28T23:07:23.988 INFO:tasks.workunit.client.1.smithi184.stdout:9/224: mknod d5/d17/c4c 0 2024-02-28T23:07:23.989 INFO:tasks.workunit.client.1.smithi184.stdout:3/226: dread d1/d4/d6/d1f/f2c [0,4194304] 0 2024-02-28T23:07:23.990 INFO:tasks.workunit.client.0.smithi159.stdout:7/517: rmdir d5/d16/d1a/d24 39 2024-02-28T23:07:23.991 INFO:tasks.workunit.client.1.smithi184.stdout:9/225: chown d5/db/f1f 1720 1 2024-02-28T23:07:23.992 INFO:tasks.workunit.client.1.smithi184.stdout:3/227: chown d1/d4/f42 1672343302 1 2024-02-28T23:07:24.003 INFO:tasks.workunit.client.1.smithi184.stdout:1/294: fsync d20/f25 0 2024-02-28T23:07:24.006 INFO:tasks.workunit.client.1.smithi184.stdout:7/200: creat d6/d9/da/dc/d49/f4f x:0 0 0 2024-02-28T23:07:24.008 INFO:tasks.workunit.client.1.smithi184.stdout:0/223: dread d0/fc [0,4194304] 0 2024-02-28T23:07:24.010 INFO:tasks.workunit.client.1.smithi184.stdout:7/201: read d6/d9/d13/d1e/d2f/f44 [2685286,105449] 0 2024-02-28T23:07:24.012 INFO:tasks.workunit.client.0.smithi159.stdout:3/590: rmdir d0/d2b/d55/d75/d6d/d54/d6a 39 2024-02-28T23:07:24.014 INFO:tasks.workunit.client.1.smithi184.stdout:8/242: rename d1/da/dc/f15 to d1/da/dc/d16/d32/d42/f61 0 2024-02-28T23:07:24.018 INFO:tasks.workunit.client.0.smithi159.stdout:7/518: chown d5/d16/d40/l4f 782055 1 2024-02-28T23:07:24.024 INFO:tasks.workunit.client.0.smithi159.stdout:5/615: rename d8/d19/d23/d35/d38/d8f/da5/d90/f94 to d8/d19/d23/d35/d38/d8f/da5/fcf 0 2024-02-28T23:07:24.026 INFO:tasks.workunit.client.1.smithi184.stdout:3/228: mkdir d1/d4/d6/d1f/d43 0 2024-02-28T23:07:24.029 INFO:tasks.workunit.client.0.smithi159.stdout:5/616: chown d8/d19/d23/d35/d38 433620 1 2024-02-28T23:07:24.030 INFO:tasks.workunit.client.0.smithi159.stdout:6/615: write d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/fb9 [616739,69439] 0 2024-02-28T23:07:24.030 INFO:tasks.workunit.client.1.smithi184.stdout:9/226: creat d5/db/de/d10/d12/f4d x:0 0 0 2024-02-28T23:07:24.036 INFO:tasks.workunit.client.1.smithi184.stdout:4/221: dwrite d1/dc/fd [0,4194304] 0 2024-02-28T23:07:24.036 INFO:tasks.workunit.client.0.smithi159.stdout:6/616: stat d0/d1b/d33/d11/d34/d9d/da2/f61 0 2024-02-28T23:07:24.036 INFO:tasks.workunit.client.1.smithi184.stdout:0/224: symlink d0/df/d13/d27/d31/l48 0 2024-02-28T23:07:24.038 INFO:tasks.workunit.client.1.smithi184.stdout:6/199: symlink dc/de/l45 0 2024-02-28T23:07:24.040 INFO:tasks.workunit.client.1.smithi184.stdout:7/202: mkdir d6/d9/da/dc/d49/d50 0 2024-02-28T23:07:24.042 INFO:tasks.workunit.client.1.smithi184.stdout:1/295: dread d20/f25 [0,4194304] 0 2024-02-28T23:07:24.042 INFO:tasks.workunit.client.1.smithi184.stdout:7/203: truncate f3 4927185 0 2024-02-28T23:07:24.042 INFO:tasks.workunit.client.1.smithi184.stdout:1/296: dread - d20/f27 zero size 2024-02-28T23:07:24.043 INFO:tasks.workunit.client.1.smithi184.stdout:2/216: rename d10/d13/d15/l20 to d10/d13/d15/l4a 0 2024-02-28T23:07:24.043 INFO:tasks.workunit.client.1.smithi184.stdout:7/204: chown d6/d9/da/dc/f2b 8138 1 2024-02-28T23:07:24.044 INFO:tasks.workunit.client.1.smithi184.stdout:2/217: chown d10/f18 37004 1 2024-02-28T23:07:24.046 INFO:tasks.workunit.client.0.smithi159.stdout:9/652: dwrite d4/d3d/d3e/d4a/f56 [4194304,4194304] 0 2024-02-28T23:07:24.046 INFO:tasks.workunit.client.1.smithi184.stdout:1/297: read - d20/f47 zero size 2024-02-28T23:07:24.049 INFO:tasks.workunit.client.1.smithi184.stdout:4/222: creat d1/d8/d35/f47 x:0 0 0 2024-02-28T23:07:24.050 INFO:tasks.workunit.client.0.smithi159.stdout:4/726: dread d9/d4c/f8f [0,4194304] 0 2024-02-28T23:07:24.050 INFO:tasks.workunit.client.1.smithi184.stdout:8/243: symlink d1/da/d33/l62 0 2024-02-28T23:07:24.050 INFO:tasks.workunit.client.1.smithi184.stdout:3/229: write d1/d4/d6/d1f/f2c [533780,73528] 0 2024-02-28T23:07:24.053 INFO:tasks.workunit.client.1.smithi184.stdout:2/218: unlink d10/d33/f35 0 2024-02-28T23:07:24.055 INFO:tasks.workunit.client.0.smithi159.stdout:4/727: truncate d9/d42/d54/d9c/fba 5179173 0 2024-02-28T23:07:24.055 INFO:tasks.workunit.client.1.smithi184.stdout:1/298: rmdir d20/d32/d4d 39 2024-02-28T23:07:24.055 INFO:tasks.workunit.client.1.smithi184.stdout:4/223: write d1/d8/d35/f47 [590191,109421] 0 2024-02-28T23:07:24.061 INFO:tasks.workunit.client.1.smithi184.stdout:0/225: dwrite d0/df/d13/f3b [0,4194304] 0 2024-02-28T23:07:24.061 INFO:tasks.workunit.client.1.smithi184.stdout:3/230: symlink d1/d4/d6/d1e/l44 0 2024-02-28T23:07:24.063 INFO:tasks.workunit.client.0.smithi159.stdout:0/746: sync 2024-02-28T23:07:24.065 INFO:tasks.workunit.client.1.smithi184.stdout:8/244: mkdir d1/da/d10/d17/d63 0 2024-02-28T23:07:24.065 INFO:tasks.workunit.client.1.smithi184.stdout:0/226: stat d0/df/l3f 0 2024-02-28T23:07:24.066 INFO:tasks.workunit.client.1.smithi184.stdout:2/219: symlink d10/d13/d15/d24/l4b 0 2024-02-28T23:07:24.068 INFO:tasks.workunit.client.1.smithi184.stdout:6/200: dwrite dc/de/d10/d16/f37 [0,4194304] 0 2024-02-28T23:07:24.068 INFO:tasks.workunit.client.1.smithi184.stdout:7/205: dwrite d6/f16 [0,4194304] 0 2024-02-28T23:07:24.070 INFO:tasks.workunit.client.1.smithi184.stdout:4/224: getdents d1/d8/d3d/d44 0 2024-02-28T23:07:24.072 INFO:tasks.workunit.client.1.smithi184.stdout:0/227: creat d0/df/d13/f49 x:0 0 0 2024-02-28T23:07:24.072 INFO:tasks.workunit.client.1.smithi184.stdout:4/225: read d1/dc/df/f14 [2761319,102068] 0 2024-02-28T23:07:24.074 INFO:tasks.workunit.client.1.smithi184.stdout:4/226: write d1/dc/df/f16 [2172405,82839] 0 2024-02-28T23:07:24.075 INFO:tasks.workunit.client.1.smithi184.stdout:3/231: rename d1/d4/d6/d36 to d1/d4/d6/d1f/d45 0 2024-02-28T23:07:24.079 INFO:tasks.workunit.client.1.smithi184.stdout:2/220: unlink d10/d13/d15/d24/l3a 0 2024-02-28T23:07:24.084 INFO:tasks.workunit.client.1.smithi184.stdout:5/219: sync 2024-02-28T23:07:24.084 INFO:tasks.workunit.client.1.smithi184.stdout:8/245: creat d1/da/dc/d18/f64 x:0 0 0 2024-02-28T23:07:24.085 INFO:tasks.workunit.client.1.smithi184.stdout:5/220: fsync db/d1f/d32/f37 0 2024-02-28T23:07:24.086 INFO:tasks.workunit.client.1.smithi184.stdout:7/206: mknod d6/d9/d13/d1e/d2f/d33/c51 0 2024-02-28T23:07:24.091 INFO:tasks.workunit.client.0.smithi159.stdout:7/519: rename d5/f7a to d5/d16/d1a/d27/d3e/fab 0 2024-02-28T23:07:24.093 INFO:tasks.workunit.client.1.smithi184.stdout:0/228: mknod d0/df/d13/d27/c4a 0 2024-02-28T23:07:24.095 INFO:tasks.workunit.client.0.smithi159.stdout:5/617: creat d8/d19/d23/d35/d41/d77/fd0 x:0 0 0 2024-02-28T23:07:24.097 INFO:tasks.workunit.client.0.smithi159.stdout:6/617: mknod d0/d1b/d33/d3f/d44/cc3 0 2024-02-28T23:07:24.100 INFO:tasks.workunit.client.1.smithi184.stdout:4/227: symlink d1/d4/l48 0 2024-02-28T23:07:24.100 INFO:tasks.workunit.client.1.smithi184.stdout:7/207: dwrite d6/d9/d13/d1e/f21 [0,4194304] 0 2024-02-28T23:07:24.104 INFO:tasks.workunit.client.1.smithi184.stdout:2/221: write d10/d13/d15/f2b [1318388,59216] 0 2024-02-28T23:07:24.107 INFO:tasks.workunit.client.1.smithi184.stdout:5/221: unlink db/d1f/c26 0 2024-02-28T23:07:24.108 INFO:tasks.workunit.client.1.smithi184.stdout:2/222: chown d10/d13/d15/d24/f22 778 1 2024-02-28T23:07:24.111 INFO:tasks.workunit.client.1.smithi184.stdout:5/222: dread - db/d12/d18/d2e/d3c/f3d zero size 2024-02-28T23:07:24.111 INFO:tasks.workunit.client.1.smithi184.stdout:2/223: truncate d10/d1f/f48 863436 0 2024-02-28T23:07:24.115 INFO:tasks.workunit.client.0.smithi159.stdout:7/520: write d5/d16/d1a/d24/d64/f79 [55507,97326] 0 2024-02-28T23:07:24.115 INFO:tasks.workunit.client.1.smithi184.stdout:0/229: dwrite d0/df/d13/f1a [4194304,4194304] 0 2024-02-28T23:07:24.115 INFO:tasks.workunit.client.0.smithi159.stdout:6/618: stat d0/d1b/d33/d3f/d44/fc0 0 2024-02-28T23:07:24.116 INFO:tasks.workunit.client.1.smithi184.stdout:2/224: chown d10/f43 302971 1 2024-02-28T23:07:24.116 INFO:tasks.workunit.client.1.smithi184.stdout:5/223: write db/d12/d18/d2e/f36 [565149,77573] 0 2024-02-28T23:07:24.116 INFO:tasks.workunit.client.0.smithi159.stdout:5/618: truncate d8/d19/d23/f91 611270 0 2024-02-28T23:07:24.118 INFO:tasks.workunit.client.0.smithi159.stdout:9/653: mkdir d4/d3d/d3e/d4a/dc5/dcd 0 2024-02-28T23:07:24.120 INFO:tasks.workunit.client.1.smithi184.stdout:0/230: stat d0/df/d13/f18 0 2024-02-28T23:07:24.123 INFO:tasks.workunit.client.1.smithi184.stdout:4/228: dread d1/dc/fd [0,4194304] 0 2024-02-28T23:07:24.123 INFO:tasks.workunit.client.0.smithi159.stdout:2/581: write d9/d36/f5a [863382,57732] 0 2024-02-28T23:07:24.123 INFO:tasks.workunit.client.0.smithi159.stdout:2/582: stat d9/l96 0 2024-02-28T23:07:24.125 INFO:tasks.workunit.client.0.smithi159.stdout:0/747: symlink d0/d5/d14/l108 0 2024-02-28T23:07:24.125 INFO:tasks.workunit.client.1.smithi184.stdout:7/208: dwrite d6/d9/da/f10 [0,4194304] 0 2024-02-28T23:07:24.125 INFO:tasks.workunit.client.1.smithi184.stdout:4/229: fsync d1/dc/df/f16 0 2024-02-28T23:07:24.128 INFO:tasks.workunit.client.0.smithi159.stdout:3/591: creat d0/d2b/fb9 x:0 0 0 2024-02-28T23:07:24.130 INFO:tasks.workunit.client.1.smithi184.stdout:7/209: truncate d6/d9/d13/d1e/f22 741860 0 2024-02-28T23:07:24.130 INFO:tasks.workunit.client.0.smithi159.stdout:0/748: truncate d0/d5/d14/d34/d6c/f9b 1226055 0 2024-02-28T23:07:24.133 INFO:tasks.workunit.client.0.smithi159.stdout:0/749: truncate d0/d5/d14/ffb 682434 0 2024-02-28T23:07:24.136 INFO:tasks.workunit.client.0.smithi159.stdout:7/521: fdatasync d5/d16/d1a/d27/d3e/f48 0 2024-02-28T23:07:24.136 INFO:tasks.workunit.client.0.smithi159.stdout:0/750: chown d0/d5/d38/ff6 0 1 2024-02-28T23:07:24.136 INFO:tasks.workunit.client.0.smithi159.stdout:8/754: sync 2024-02-28T23:07:24.136 INFO:tasks.workunit.client.0.smithi159.stdout:1/607: sync 2024-02-28T23:07:24.141 INFO:tasks.workunit.client.1.smithi184.stdout:0/231: rename d0/fb to d0/d1f/f4b 0 2024-02-28T23:07:24.142 INFO:tasks.workunit.client.1.smithi184.stdout:6/201: truncate dc/de/d10/d16/f37 635861 0 2024-02-28T23:07:24.148 INFO:tasks.workunit.client.1.smithi184.stdout:3/232: getdents d1/d4/d6/d1f/d24 0 2024-02-28T23:07:24.156 INFO:tasks.workunit.client.1.smithi184.stdout:9/227: sync 2024-02-28T23:07:24.157 INFO:tasks.workunit.client.1.smithi184.stdout:6/202: dread dc/de/d10/f24 [0,4194304] 0 2024-02-28T23:07:24.161 INFO:tasks.workunit.client.1.smithi184.stdout:7/210: mknod d6/d9/d13/c52 0 2024-02-28T23:07:24.162 INFO:tasks.workunit.client.1.smithi184.stdout:7/211: dread - d6/f48 zero size 2024-02-28T23:07:24.163 INFO:tasks.workunit.client.1.smithi184.stdout:3/233: dwrite d1/d4/d6/d1f/f2c [0,4194304] 0 2024-02-28T23:07:24.165 INFO:tasks.workunit.client.1.smithi184.stdout:0/232: readlink d0/df/d13/d27/l36 0 2024-02-28T23:07:24.165 INFO:tasks.workunit.client.1.smithi184.stdout:2/225: dread d10/d13/f3d [0,4194304] 0 2024-02-28T23:07:24.166 INFO:tasks.workunit.client.0.smithi159.stdout:4/728: getdents d9/d42/d54/d55/da8 0 2024-02-28T23:07:24.167 INFO:tasks.workunit.client.0.smithi159.stdout:9/654: rename d4/d3d/d3e/d55/d4c/db6/fc6 to d4/d3d/d3e/d55/d4c/d4e/d6b/fce 0 2024-02-28T23:07:24.168 INFO:tasks.workunit.client.0.smithi159.stdout:7/522: dread d5/d16/d1a/f3c [0,4194304] 0 2024-02-28T23:07:24.168 INFO:tasks.workunit.client.1.smithi184.stdout:0/233: write d0/df/d13/f3b [2159460,55955] 0 2024-02-28T23:07:24.168 INFO:tasks.workunit.client.1.smithi184.stdout:7/212: rename d6 to d6/d9/d13/d1e/d2f/d34/d47/d53 22 2024-02-28T23:07:24.169 INFO:tasks.workunit.client.0.smithi159.stdout:6/619: dread d0/fb [0,4194304] 0 2024-02-28T23:07:24.173 INFO:tasks.workunit.client.1.smithi184.stdout:9/228: unlink d5/db/de/f39 0 2024-02-28T23:07:24.175 INFO:tasks.workunit.client.1.smithi184.stdout:9/229: write d5/db/de/d10/d12/f27 [837940,29229] 0 2024-02-28T23:07:24.175 INFO:tasks.workunit.client.0.smithi159.stdout:2/583: dwrite d9/d23/d2c/f82 [4194304,4194304] 0 2024-02-28T23:07:24.176 INFO:tasks.workunit.client.1.smithi184.stdout:5/224: getdents db/d12/d18/d2e/d3c 0 2024-02-28T23:07:24.177 INFO:tasks.workunit.client.0.smithi159.stdout:2/584: stat d9/d36/d59 0 2024-02-28T23:07:24.178 INFO:tasks.workunit.client.0.smithi159.stdout:0/751: write d0/d5/d14/d25/d2c/d4b/f54 [1878913,54230] 0 2024-02-28T23:07:24.178 INFO:tasks.workunit.client.1.smithi184.stdout:2/226: dread d10/d13/d15/f2b [0,4194304] 0 2024-02-28T23:07:24.178 INFO:tasks.workunit.client.1.smithi184.stdout:4/230: getdents d1/dc 0 2024-02-28T23:07:24.178 INFO:tasks.workunit.client.1.smithi184.stdout:2/227: readlink d10/d1f/l28 0 2024-02-28T23:07:24.179 INFO:tasks.workunit.client.1.smithi184.stdout:4/231: stat d1/dc/f23 0 2024-02-28T23:07:24.182 INFO:tasks.workunit.client.1.smithi184.stdout:6/203: mknod dc/de/c46 0 2024-02-28T23:07:24.182 INFO:tasks.workunit.client.1.smithi184.stdout:1/299: sync 2024-02-28T23:07:24.183 INFO:tasks.workunit.client.1.smithi184.stdout:0/234: mkdir d0/d1d/d4c 0 2024-02-28T23:07:24.184 INFO:tasks.workunit.client.1.smithi184.stdout:6/204: chown dc/de/d10/f1b 1 1 2024-02-28T23:07:24.185 INFO:tasks.workunit.client.1.smithi184.stdout:6/205: chown dc/de/d10/c31 4065859 1 2024-02-28T23:07:24.187 INFO:tasks.workunit.client.1.smithi184.stdout:5/225: fsync db/d12/d1c/d21/d2f/f43 0 2024-02-28T23:07:24.189 INFO:tasks.workunit.client.1.smithi184.stdout:9/230: rename d5/d26/f3e to d5/db/d29/f4e 0 2024-02-28T23:07:24.194 INFO:tasks.workunit.client.0.smithi159.stdout:9/655: dwrite d4/f13 [4194304,4194304] 0 2024-02-28T23:07:24.195 INFO:tasks.workunit.client.0.smithi159.stdout:1/608: fsync d6/d12/d1a/d92/f9d 0 2024-02-28T23:07:24.196 INFO:tasks.workunit.client.1.smithi184.stdout:2/228: creat d10/d1f/f4c x:0 0 0 2024-02-28T23:07:24.199 INFO:tasks.workunit.client.0.smithi159.stdout:0/752: fsync d0/de/d46/fa7 0 2024-02-28T23:07:24.200 INFO:tasks.workunit.client.1.smithi184.stdout:4/232: mkdir d1/d8/d37/d49 0 2024-02-28T23:07:24.202 INFO:tasks.workunit.client.0.smithi159.stdout:2/585: creat d9/d50/d54/d84/d37/fca x:0 0 0 2024-02-28T23:07:24.203 INFO:tasks.workunit.client.1.smithi184.stdout:0/235: chown d0/df/d13/d27/f39 141 1 2024-02-28T23:07:24.204 INFO:tasks.workunit.client.1.smithi184.stdout:0/236: stat d0/d1f/f26 0 2024-02-28T23:07:24.205 INFO:tasks.workunit.client.1.smithi184.stdout:6/206: symlink dc/de/d10/d3a/l47 0 2024-02-28T23:07:24.205 INFO:tasks.workunit.client.0.smithi159.stdout:2/586: readlink d9/d36/l73 0 2024-02-28T23:07:24.207 INFO:tasks.workunit.client.0.smithi159.stdout:7/523: mkdir d5/d16/d1a/d27/d75/dac 0 2024-02-28T23:07:24.208 INFO:tasks.workunit.client.0.smithi159.stdout:8/755: dread d2/d11/d74/fd0 [0,4194304] 0 2024-02-28T23:07:24.208 INFO:tasks.workunit.client.0.smithi159.stdout:6/620: mkdir d0/d1b/dc4 0 2024-02-28T23:07:24.213 INFO:tasks.workunit.client.1.smithi184.stdout:5/226: rename db/d12/d18/d2e/f38 to db/d44/f4c 0 2024-02-28T23:07:24.215 INFO:tasks.workunit.client.0.smithi159.stdout:9/656: mknod d4/d3d/d3e/d55/d9e/db3/ccf 0 2024-02-28T23:07:24.216 INFO:tasks.workunit.client.1.smithi184.stdout:5/227: read db/d12/d18/d2e/f36 [238117,23816] 0 2024-02-28T23:07:24.217 INFO:tasks.workunit.client.1.smithi184.stdout:3/234: dread d1/d4/d1c/f27 [0,4194304] 0 2024-02-28T23:07:24.219 INFO:tasks.workunit.client.1.smithi184.stdout:5/228: chown db/d12/d1c/c31 1369415148 1 2024-02-28T23:07:24.221 INFO:tasks.workunit.client.1.smithi184.stdout:9/231: truncate d5/fc 1044891 0 2024-02-28T23:07:24.223 INFO:tasks.workunit.client.0.smithi159.stdout:5/619: getdents d8/d19/d23/d35/d65/da3 0 2024-02-28T23:07:24.226 INFO:tasks.workunit.client.1.smithi184.stdout:7/213: truncate d6/f8 3786032 0 2024-02-28T23:07:24.227 INFO:tasks.workunit.client.0.smithi159.stdout:3/592: link d0/d6/d3e/d2f/f6b d0/d2b/fba 0 2024-02-28T23:07:24.227 INFO:tasks.workunit.client.1.smithi184.stdout:7/214: dread - d6/f35 zero size 2024-02-28T23:07:24.231 INFO:tasks.workunit.client.0.smithi159.stdout:4/729: dwrite d9/d42/d54/d9c/fa6 [0,4194304] 0 2024-02-28T23:07:24.235 INFO:tasks.workunit.client.1.smithi184.stdout:4/233: truncate d1/dc/df/f16 1220257 0 2024-02-28T23:07:24.239 INFO:tasks.workunit.client.0.smithi159.stdout:4/730: truncate d9/d42/d95/f100 244736 0 2024-02-28T23:07:24.240 INFO:tasks.workunit.client.0.smithi159.stdout:6/621: unlink d0/d1b/d33/d11/d34/f3e 0 2024-02-28T23:07:24.241 INFO:tasks.workunit.client.1.smithi184.stdout:7/215: dwrite f3 [0,4194304] 0 2024-02-28T23:07:24.243 INFO:tasks.workunit.client.0.smithi159.stdout:1/609: dread d6/d1d/d1f/fa8 [0,4194304] 0 2024-02-28T23:07:24.244 INFO:tasks.workunit.client.1.smithi184.stdout:0/237: dread d0/fe [0,4194304] 0 2024-02-28T23:07:24.251 INFO:tasks.workunit.client.0.smithi159.stdout:9/657: symlink d4/d3d/d3e/d55/d37/d62/d77/db9/ld0 0 2024-02-28T23:07:24.253 INFO:tasks.workunit.client.1.smithi184.stdout:9/232: write d5/db/d29/f35 [777071,10483] 0 2024-02-28T23:07:24.259 INFO:tasks.workunit.client.0.smithi159.stdout:9/658: stat d4/d3d/d3e/dad/fbf 0 2024-02-28T23:07:24.260 INFO:tasks.workunit.client.0.smithi159.stdout:4/731: mknod d9/d42/dc8/c105 0 2024-02-28T23:07:24.264 INFO:tasks.workunit.client.0.smithi159.stdout:1/610: mkdir d6/d12/d1a/d92/dc8 0 2024-02-28T23:07:24.273 INFO:tasks.workunit.client.0.smithi159.stdout:2/587: creat d9/fcb x:0 0 0 2024-02-28T23:07:24.274 INFO:tasks.workunit.client.0.smithi159.stdout:7/524: creat d5/d16/d1a/fad x:0 0 0 2024-02-28T23:07:24.278 INFO:tasks.workunit.client.0.smithi159.stdout:4/732: rename d9/d42/dc8/fed to d9/da/d1c/d8e/deb/f106 0 2024-02-28T23:07:24.278 INFO:tasks.workunit.client.1.smithi184.stdout:8/246: sync 2024-02-28T23:07:24.278 INFO:tasks.workunit.client.0.smithi159.stdout:9/659: dwrite d4/d3d/d3e/d55/d4c/d4e/dbe/fcc [0,4194304] 0 2024-02-28T23:07:24.279 INFO:tasks.workunit.client.0.smithi159.stdout:1/611: mkdir d6/d12/d1a/d92/dc9 0 2024-02-28T23:07:24.280 INFO:tasks.workunit.client.1.smithi184.stdout:4/234: unlink d1/d8/f1b 0 2024-02-28T23:07:24.280 INFO:tasks.workunit.client.0.smithi159.stdout:5/620: creat d8/db4/fd1 x:0 0 0 2024-02-28T23:07:24.281 INFO:tasks.workunit.client.1.smithi184.stdout:3/235: dread d1/f21 [0,4194304] 0 2024-02-28T23:07:24.281 INFO:tasks.workunit.client.1.smithi184.stdout:5/229: mkdir db/d12/d1c/d21/d4d 0 2024-02-28T23:07:24.283 INFO:tasks.workunit.client.0.smithi159.stdout:9/660: read d4/d76/fa8 [2125336,2859] 0 2024-02-28T23:07:24.283 INFO:tasks.workunit.client.0.smithi159.stdout:5/621: stat d8/d19/d23/d35/d38/d6d/f74 0 2024-02-28T23:07:24.283 INFO:tasks.workunit.client.1.smithi184.stdout:9/233: chown c1 0 1 2024-02-28T23:07:24.285 INFO:tasks.workunit.client.0.smithi159.stdout:0/753: getdents d0/d5/d14/d25 0 2024-02-28T23:07:24.286 INFO:tasks.workunit.client.0.smithi159.stdout:8/756: write d2/d11/d52/d26/d36/d38/f39 [476370,3236] 0 2024-02-28T23:07:24.286 INFO:tasks.workunit.client.1.smithi184.stdout:7/216: symlink d6/d9/d13/l54 0 2024-02-28T23:07:24.287 INFO:tasks.workunit.client.0.smithi159.stdout:0/754: chown d0/d5/d14/d25/d5c/l8e 0 1 2024-02-28T23:07:24.287 INFO:tasks.workunit.client.1.smithi184.stdout:9/234: rename d5/d17 to d5/d17/d4f 22 2024-02-28T23:07:24.289 INFO:tasks.workunit.client.0.smithi159.stdout:3/593: creat d0/d6/d3e/fbb x:0 0 0 2024-02-28T23:07:24.291 INFO:tasks.workunit.client.1.smithi184.stdout:7/217: fdatasync f3 0 2024-02-28T23:07:24.291 INFO:tasks.workunit.client.0.smithi159.stdout:3/594: chown d0/d6/d34/c9c 3912 1 2024-02-28T23:07:24.292 INFO:tasks.workunit.client.0.smithi159.stdout:3/595: fsync d0/d47/fa4 0 2024-02-28T23:07:24.293 INFO:tasks.workunit.client.0.smithi159.stdout:3/596: chown d0/d3f/fb5 1811 1 2024-02-28T23:07:24.296 INFO:tasks.workunit.client.0.smithi159.stdout:7/525: creat d5/d56/d50/daa/fae x:0 0 0 2024-02-28T23:07:24.296 INFO:tasks.workunit.client.1.smithi184.stdout:4/235: creat d1/d8/f4a x:0 0 0 2024-02-28T23:07:24.296 INFO:tasks.workunit.client.1.smithi184.stdout:0/238: dwrite d0/d1f/f26 [4194304,4194304] 0 2024-02-28T23:07:24.297 INFO:tasks.workunit.client.0.smithi159.stdout:2/588: rename d9/d34 to d9/d50/dcc 0 2024-02-28T23:07:24.299 INFO:tasks.workunit.client.1.smithi184.stdout:3/236: creat d1/d4/d6/f46 x:0 0 0 2024-02-28T23:07:24.300 INFO:tasks.workunit.client.0.smithi159.stdout:9/661: dread d4/f13 [4194304,4194304] 0 2024-02-28T23:07:24.306 INFO:tasks.workunit.client.0.smithi159.stdout:5/622: mkdir d8/d19/d23/d35/d65/da3/dd2 0 2024-02-28T23:07:24.307 INFO:tasks.workunit.client.1.smithi184.stdout:9/235: dwrite d5/db/f16 [0,4194304] 0 2024-02-28T23:07:24.309 INFO:tasks.workunit.client.0.smithi159.stdout:8/757: rmdir d2/d11/d52/d47 39 2024-02-28T23:07:24.312 INFO:tasks.workunit.client.1.smithi184.stdout:9/236: dread d5/db/de/d10/d12/f2d [0,4194304] 0 2024-02-28T23:07:24.313 INFO:tasks.workunit.client.1.smithi184.stdout:5/230: rename db/d12/d18/d2e/d3c/f3d to db/d12/d1c/d21/d2f/f4e 0 2024-02-28T23:07:24.315 INFO:tasks.workunit.client.1.smithi184.stdout:9/237: write d5/db/de/d10/d12/f4d [917123,84078] 0 2024-02-28T23:07:24.315 INFO:tasks.workunit.client.0.smithi159.stdout:0/755: mknod d0/d5/d14/d34/d3d/c109 0 2024-02-28T23:07:24.317 INFO:tasks.workunit.client.0.smithi159.stdout:7/526: unlink d5/d56/d50/d5b/c90 0 2024-02-28T23:07:24.318 INFO:tasks.workunit.client.1.smithi184.stdout:7/218: dread d6/d9/d13/d1e/d2f/f38 [0,4194304] 0 2024-02-28T23:07:24.318 INFO:tasks.workunit.client.0.smithi159.stdout:7/527: dread - d5/f9b zero size 2024-02-28T23:07:24.322 INFO:tasks.workunit.client.0.smithi159.stdout:3/597: rename d0/f8f to d0/d47/fbc 0 2024-02-28T23:07:24.325 INFO:tasks.workunit.client.0.smithi159.stdout:2/589: mknod d9/d50/d54/d84/d37/d5c/ccd 0 2024-02-28T23:07:24.329 INFO:tasks.workunit.client.1.smithi184.stdout:9/238: dwrite d5/db/de/d10/f2a [0,4194304] 0 2024-02-28T23:07:24.330 INFO:tasks.workunit.client.0.smithi159.stdout:1/612: mkdir d6/d12/d31/d69/dc0/dca 0 2024-02-28T23:07:24.332 INFO:tasks.workunit.client.1.smithi184.stdout:5/231: mknod db/d12/d18/d2e/c4f 0 2024-02-28T23:07:24.332 INFO:tasks.workunit.client.1.smithi184.stdout:5/232: readlink db/d12/l15 0 2024-02-28T23:07:24.333 INFO:tasks.workunit.client.0.smithi159.stdout:5/623: rmdir d8/d19/d23/d35/d65/db5 39 2024-02-28T23:07:24.334 INFO:tasks.workunit.client.1.smithi184.stdout:4/236: truncate d1/f12 4691557 0 2024-02-28T23:07:24.334 INFO:tasks.workunit.client.1.smithi184.stdout:5/233: chown db/d12/d1c/c31 1467759 1 2024-02-28T23:07:24.335 INFO:tasks.workunit.client.1.smithi184.stdout:0/239: fdatasync d0/d1f/f4b 0 2024-02-28T23:07:24.335 INFO:tasks.workunit.client.0.smithi159.stdout:4/733: dwrite d9/d4c/d6c/f68 [0,4194304] 0 2024-02-28T23:07:24.336 INFO:tasks.workunit.client.0.smithi159.stdout:1/613: write d6/d12/d33/faf [1867395,49311] 0 2024-02-28T23:07:24.336 INFO:tasks.workunit.client.0.smithi159.stdout:5/624: fsync d8/d19/d23/f5c 0 2024-02-28T23:07:24.337 INFO:tasks.workunit.client.1.smithi184.stdout:0/240: chown d0/f6 30096312 1 2024-02-28T23:07:24.340 INFO:tasks.workunit.client.0.smithi159.stdout:0/756: symlink d0/de/d75/de8/l10a 0 2024-02-28T23:07:24.345 INFO:tasks.workunit.client.0.smithi159.stdout:4/734: readlink d9/da/d1c/d23/d7a/lf0 0 2024-02-28T23:07:24.345 INFO:tasks.workunit.client.0.smithi159.stdout:7/528: mkdir d5/d16/d1a/d27/d37/daf 0 2024-02-28T23:07:24.345 INFO:tasks.workunit.client.1.smithi184.stdout:8/247: rmdir d1/da/d10/d43/d58 0 2024-02-28T23:07:24.346 INFO:tasks.workunit.client.0.smithi159.stdout:4/735: chown d9/d42/fab 24562732 1 2024-02-28T23:07:24.349 INFO:tasks.workunit.client.0.smithi159.stdout:0/757: readlink d0/d5/d14/d25/d2c/dab/dc5/ldf 0 2024-02-28T23:07:24.349 INFO:tasks.workunit.client.0.smithi159.stdout:4/736: read - d9/da/d1c/d23/d2d/ffb zero size 2024-02-28T23:07:24.349 INFO:tasks.workunit.client.0.smithi159.stdout:7/529: truncate d5/d56/d50/f8c 5217098 0 2024-02-28T23:07:24.350 INFO:tasks.workunit.client.0.smithi159.stdout:8/758: dread d2/d3/f2a [0,4194304] 0 2024-02-28T23:07:24.351 INFO:tasks.workunit.client.1.smithi184.stdout:9/239: rename d5/db/d29 to d5/d26/d50 0 2024-02-28T23:07:24.354 INFO:tasks.workunit.client.1.smithi184.stdout:9/240: readlink d5/db/de/d10/d12/d2f/l31 0 2024-02-28T23:07:24.354 INFO:tasks.workunit.client.0.smithi159.stdout:8/759: readlink d2/d11/d35/l8a 0 2024-02-28T23:07:24.356 INFO:tasks.workunit.client.0.smithi159.stdout:2/590: mkdir d9/d50/d62/dce 0 2024-02-28T23:07:24.359 INFO:tasks.workunit.client.1.smithi184.stdout:1/300: sync 2024-02-28T23:07:24.360 INFO:tasks.workunit.client.1.smithi184.stdout:1/301: dread - d20/f49 zero size 2024-02-28T23:07:24.360 INFO:tasks.workunit.client.1.smithi184.stdout:4/237: rmdir d1/dc/df/d22 39 2024-02-28T23:07:24.365 INFO:tasks.workunit.client.1.smithi184.stdout:0/241: creat d0/d1d/f4d x:0 0 0 2024-02-28T23:07:24.366 INFO:tasks.workunit.client.1.smithi184.stdout:3/237: write d1/d4/d6/d1f/f2b [3438275,87238] 0 2024-02-28T23:07:24.368 INFO:tasks.workunit.client.0.smithi159.stdout:5/625: symlink d8/d19/d23/d35/d41/ld3 0 2024-02-28T23:07:24.369 INFO:tasks.workunit.client.1.smithi184.stdout:5/234: mkdir db/d12/d50 0 2024-02-28T23:07:24.370 INFO:tasks.workunit.client.1.smithi184.stdout:3/238: read d1/d4/d6/d1f/d26/f2a [2555493,5918] 0 2024-02-28T23:07:24.372 INFO:tasks.workunit.client.1.smithi184.stdout:3/239: chown d1/d4/d5 703 1 2024-02-28T23:07:24.374 INFO:tasks.workunit.client.0.smithi159.stdout:7/530: rename d5/d56/c5e to d5/d16/d1a/da0/cb0 0 2024-02-28T23:07:24.377 INFO:tasks.workunit.client.0.smithi159.stdout:8/760: unlink d2/d11/d52/d26/d36/d38/d77/la4 0 2024-02-28T23:07:24.379 INFO:tasks.workunit.client.0.smithi159.stdout:1/614: symlink d6/d12/d1a/d92/dc9/lcb 0 2024-02-28T23:07:24.380 INFO:tasks.workunit.client.0.smithi159.stdout:3/598: getdents d0/d6/d3e/d2f 0 2024-02-28T23:07:24.381 INFO:tasks.workunit.client.1.smithi184.stdout:7/219: write d6/f8 [3388394,127929] 0 2024-02-28T23:07:24.383 INFO:tasks.workunit.client.1.smithi184.stdout:9/241: link d5/d17/f28 d5/db/de/d10/d12/d2f/f51 0 2024-02-28T23:07:24.383 INFO:tasks.workunit.client.0.smithi159.stdout:3/599: chown d0/d2b/d55/d75/d6d/d54/d7c/c9a 509062244 1 2024-02-28T23:07:24.385 INFO:tasks.workunit.client.1.smithi184.stdout:2/229: sync 2024-02-28T23:07:24.385 INFO:tasks.workunit.client.1.smithi184.stdout:6/207: sync 2024-02-28T23:07:24.386 INFO:tasks.workunit.client.0.smithi159.stdout:9/662: getdents d4/d3d/d3e/d55/d4c/d4e/d6b 0 2024-02-28T23:07:24.386 INFO:tasks.workunit.client.1.smithi184.stdout:1/302: write d20/d32/d51/f60 [125623,113753] 0 2024-02-28T23:07:24.389 INFO:tasks.workunit.client.1.smithi184.stdout:4/238: symlink d1/dc/df/d38/d3c/l4b 0 2024-02-28T23:07:24.389 INFO:tasks.workunit.client.1.smithi184.stdout:2/230: dread d10/d13/d15/f19 [0,4194304] 0 2024-02-28T23:07:24.390 INFO:tasks.workunit.client.1.smithi184.stdout:7/220: dread d6/d9/da/dc/f2b [0,4194304] 0 2024-02-28T23:07:24.391 INFO:tasks.workunit.client.1.smithi184.stdout:7/221: chown d6/d9/da/dc 30 1 2024-02-28T23:07:24.393 INFO:tasks.workunit.client.1.smithi184.stdout:0/242: fsync d0/df/d13/d27/d2b/f44 0 2024-02-28T23:07:24.394 INFO:tasks.workunit.client.0.smithi159.stdout:4/737: write d9/d20/f5e [473101,21415] 0 2024-02-28T23:07:24.396 INFO:tasks.workunit.client.0.smithi159.stdout:0/758: dwrite d0/d5/d14/d78/fcc [0,4194304] 0 2024-02-28T23:07:24.397 INFO:tasks.workunit.client.1.smithi184.stdout:3/240: write d1/d4/f23 [111981,38763] 0 2024-02-28T23:07:24.400 INFO:tasks.workunit.client.1.smithi184.stdout:3/241: write d1/d4/d6/d1f/f2b [1499108,95144] 0 2024-02-28T23:07:24.401 INFO:tasks.workunit.client.1.smithi184.stdout:9/242: creat d5/db/de/d10/d12/d2f/f52 x:0 0 0 2024-02-28T23:07:24.402 INFO:tasks.workunit.client.1.smithi184.stdout:3/242: chown d1/d4/d6/c1a 534036261 1 2024-02-28T23:07:24.403 INFO:tasks.workunit.client.1.smithi184.stdout:9/243: write d5/db/de/d10/d12/d2f/f52 [605737,60994] 0 2024-02-28T23:07:24.404 INFO:tasks.workunit.client.0.smithi159.stdout:9/663: creat d4/d3d/d3e/d55/d4c/d4e/dbe/fd1 x:0 0 0 2024-02-28T23:07:24.404 INFO:tasks.workunit.client.1.smithi184.stdout:5/235: truncate db/d12/f39 3254995 0 2024-02-28T23:07:24.406 INFO:tasks.workunit.client.0.smithi159.stdout:7/531: mknod d5/d16/cb1 0 2024-02-28T23:07:24.406 INFO:tasks.workunit.client.1.smithi184.stdout:5/236: write db/d1f/d32/f33 [1206371,59939] 0 2024-02-28T23:07:24.408 INFO:tasks.workunit.client.1.smithi184.stdout:2/231: mkdir d10/d1f/d21/d4d 0 2024-02-28T23:07:24.410 INFO:tasks.workunit.client.1.smithi184.stdout:2/232: chown d10/d1f/f32 163617 1 2024-02-28T23:07:24.411 INFO:tasks.workunit.client.1.smithi184.stdout:7/222: creat d6/d9/d13/d1e/d2f/d34/d47/f55 x:0 0 0 2024-02-28T23:07:24.413 INFO:tasks.workunit.client.1.smithi184.stdout:3/243: dread d1/f21 [0,4194304] 0 2024-02-28T23:07:24.414 INFO:tasks.workunit.client.1.smithi184.stdout:0/243: write d0/df/d13/d27/d31/f45 [650960,83874] 0 2024-02-28T23:07:24.414 INFO:tasks.workunit.client.0.smithi159.stdout:1/615: dread d6/d12/f2a [0,4194304] 0 2024-02-28T23:07:24.415 INFO:tasks.workunit.client.1.smithi184.stdout:8/248: getdents d1/da/dc/d16/d32 0 2024-02-28T23:07:24.415 INFO:tasks.workunit.client.0.smithi159.stdout:3/600: symlink d0/d6/d3e/da9/lbd 0 2024-02-28T23:07:24.416 INFO:tasks.workunit.client.1.smithi184.stdout:7/223: dread f3 [4194304,4194304] 0 2024-02-28T23:07:24.419 INFO:tasks.workunit.client.1.smithi184.stdout:7/224: read - d6/d9/d13/d1e/d2f/d34/d47/f55 zero size 2024-02-28T23:07:24.421 INFO:tasks.workunit.client.1.smithi184.stdout:9/244: creat d5/d26/d50/f53 x:0 0 0 2024-02-28T23:07:24.423 INFO:tasks.workunit.client.0.smithi159.stdout:5/626: getdents d8/d19/d23/d35/d41 0 2024-02-28T23:07:24.426 INFO:tasks.workunit.client.1.smithi184.stdout:9/245: truncate d5/db/de/d10/d12/d2f/f52 1702130 0 2024-02-28T23:07:24.431 INFO:tasks.workunit.client.1.smithi184.stdout:8/249: dwrite d1/da/d10/f2d [0,4194304] 0 2024-02-28T23:07:24.432 INFO:tasks.workunit.client.1.smithi184.stdout:2/233: symlink d10/d33/l4e 0 2024-02-28T23:07:24.435 INFO:tasks.workunit.client.1.smithi184.stdout:0/244: fdatasync d0/fe 0 2024-02-28T23:07:24.435 INFO:tasks.workunit.client.1.smithi184.stdout:6/208: creat dc/f48 x:0 0 0 2024-02-28T23:07:24.437 INFO:tasks.workunit.client.0.smithi159.stdout:9/664: dwrite d4/d3d/f5d [0,4194304] 0 2024-02-28T23:07:24.440 INFO:tasks.workunit.client.1.smithi184.stdout:9/246: creat d5/db/de/d10/d12/f54 x:0 0 0 2024-02-28T23:07:24.442 INFO:tasks.workunit.client.1.smithi184.stdout:9/247: fdatasync d5/d26/d50/f53 0 2024-02-28T23:07:24.444 INFO:tasks.workunit.client.0.smithi159.stdout:5/627: creat d8/d19/d23/d35/d38/d8f/da5/fd4 x:0 0 0 2024-02-28T23:07:24.444 INFO:tasks.workunit.client.1.smithi184.stdout:9/248: dread - d5/db/de/d10/d12/f54 zero size 2024-02-28T23:07:24.445 INFO:tasks.workunit.client.0.smithi159.stdout:4/738: getdents d9/d42/dc8 0 2024-02-28T23:07:24.445 INFO:tasks.workunit.client.0.smithi159.stdout:3/601: dread d0/d6/d3e/d2f/f6b [0,4194304] 0 2024-02-28T23:07:24.447 INFO:tasks.workunit.client.1.smithi184.stdout:8/250: creat d1/da/dc/d18/f65 x:0 0 0 2024-02-28T23:07:24.450 INFO:tasks.workunit.client.0.smithi159.stdout:8/761: dwrite d2/d11/f12 [0,4194304] 0 2024-02-28T23:07:24.451 INFO:tasks.workunit.client.1.smithi184.stdout:8/251: stat d1/da/d10/d17/c7 0 2024-02-28T23:07:24.453 INFO:tasks.workunit.client.1.smithi184.stdout:2/234: mkdir d10/d1f/d42/d4f 0 2024-02-28T23:07:24.455 INFO:tasks.workunit.client.0.smithi159.stdout:3/602: truncate d0/fac 334649 0 2024-02-28T23:07:24.456 INFO:tasks.workunit.client.1.smithi184.stdout:6/209: symlink dc/de/l49 0 2024-02-28T23:07:24.456 INFO:tasks.workunit.client.1.smithi184.stdout:0/245: dwrite d0/df/d13/d27/f39 [0,4194304] 0 2024-02-28T23:07:24.457 INFO:tasks.workunit.client.0.smithi159.stdout:7/532: dwrite d5/d16/f1f [0,4194304] 0 2024-02-28T23:07:24.457 INFO:tasks.workunit.client.1.smithi184.stdout:0/246: readlink d0/d1d/l2a 0 2024-02-28T23:07:24.459 INFO:tasks.workunit.client.1.smithi184.stdout:6/210: write dc/f48 [652383,104294] 0 2024-02-28T23:07:24.462 INFO:tasks.workunit.client.0.smithi159.stdout:0/759: dwrite d0/d5/d14/d25/d5c/f67 [0,4194304] 0 2024-02-28T23:07:24.462 INFO:tasks.workunit.client.1.smithi184.stdout:7/225: dread d6/d9/d13/d1e/d2f/f44 [0,4194304] 0 2024-02-28T23:07:24.466 INFO:tasks.workunit.client.0.smithi159.stdout:7/533: chown d5/d16/d1a/d27/d46/d65/d81 9 1 2024-02-28T23:07:24.469 INFO:tasks.workunit.client.1.smithi184.stdout:9/249: link d5/db/de/d10/f2a d5/d26/f55 0 2024-02-28T23:07:24.472 INFO:tasks.workunit.client.0.smithi159.stdout:0/760: chown d0/de/c17 3275421 1 2024-02-28T23:07:24.477 INFO:tasks.workunit.client.0.smithi159.stdout:3/603: creat d0/d2b/d55/d75/d6d/d54/d7c/d79/d9b/fbe x:0 0 0 2024-02-28T23:07:24.477 INFO:tasks.workunit.client.0.smithi159.stdout:4/739: creat d9/d42/f107 x:0 0 0 2024-02-28T23:07:24.477 INFO:tasks.workunit.client.0.smithi159.stdout:1/616: dread d6/d12/d1a/fa3 [0,4194304] 0 2024-02-28T23:07:24.478 INFO:tasks.workunit.client.0.smithi159.stdout:3/604: readlink d0/d6/d3e/lb 0 2024-02-28T23:07:24.482 INFO:tasks.workunit.client.0.smithi159.stdout:0/761: creat d0/de/f10b x:0 0 0 2024-02-28T23:07:24.482 INFO:tasks.workunit.client.0.smithi159.stdout:3/605: dread - d0/d2b/d55/d6e/fb6 zero size 2024-02-28T23:07:24.482 INFO:tasks.workunit.client.0.smithi159.stdout:1/617: chown d6/d1d/d46/d88/db4 965 1 2024-02-28T23:07:24.482 INFO:tasks.workunit.client.0.smithi159.stdout:7/534: creat d5/d16/d1a/d24/fb2 x:0 0 0 2024-02-28T23:07:24.484 INFO:tasks.workunit.client.0.smithi159.stdout:9/665: getdents d4/d3d/d3e/d55/d37 0 2024-02-28T23:07:24.486 INFO:tasks.workunit.client.0.smithi159.stdout:4/740: creat d9/d42/db1/f108 x:0 0 0 2024-02-28T23:07:24.494 INFO:tasks.workunit.client.0.smithi159.stdout:7/535: mknod d5/d56/d50/daa/cb3 0 2024-02-28T23:07:24.495 INFO:tasks.workunit.client.0.smithi159.stdout:3/606: fsync d0/d2b/d55/d75/d6d/d54/f5a 0 2024-02-28T23:07:24.499 INFO:tasks.workunit.client.0.smithi159.stdout:1/618: rename d6/d1d/d1f/d3e/d6a to d6/d1d/d1f/db8/dcc 0 2024-02-28T23:07:24.504 INFO:tasks.workunit.client.1.smithi184.stdout:6/211: rmdir dc/de/d2a 39 2024-02-28T23:07:24.504 INFO:tasks.workunit.client.1.smithi184.stdout:9/250: truncate d5/d26/d50/f38 715645 0 2024-02-28T23:07:24.506 INFO:tasks.workunit.client.1.smithi184.stdout:7/226: creat d6/d9/d13/d1e/d2f/d34/d47/f56 x:0 0 0 2024-02-28T23:07:24.508 INFO:tasks.workunit.client.1.smithi184.stdout:6/212: stat dc/de/d10/f1b 0 2024-02-28T23:07:24.510 INFO:tasks.workunit.client.0.smithi159.stdout:8/762: truncate d2/d11/d52/d26/d36/d38/d77/d9e/fc0 169116 0 2024-02-28T23:07:24.510 INFO:tasks.workunit.client.0.smithi159.stdout:5/628: dwrite d8/d19/d23/d35/d38/d6d/f74 [0,4194304] 0 2024-02-28T23:07:24.511 INFO:tasks.workunit.client.1.smithi184.stdout:3/244: dread d1/d4/d6/d1f/d26/f29 [0,4194304] 0 2024-02-28T23:07:24.511 INFO:tasks.workunit.client.0.smithi159.stdout:7/536: mkdir d5/d16/d1a/d24/d64/db4 0 2024-02-28T23:07:24.512 INFO:tasks.workunit.client.1.smithi184.stdout:2/235: rmdir d10/d1f/d42/d4f 0 2024-02-28T23:07:24.513 INFO:tasks.workunit.client.0.smithi159.stdout:0/762: dwrite d0/de/f68 [0,4194304] 0 2024-02-28T23:07:24.516 INFO:tasks.workunit.client.0.smithi159.stdout:1/619: unlink d6/d12/d31/d69/l6e 0 2024-02-28T23:07:24.518 INFO:tasks.workunit.client.0.smithi159.stdout:7/537: read - d5/d16/d1a/d27/d46/f99 zero size 2024-02-28T23:07:24.519 INFO:tasks.workunit.client.0.smithi159.stdout:3/607: dread d0/f4c [0,4194304] 0 2024-02-28T23:07:24.520 INFO:tasks.workunit.client.1.smithi184.stdout:3/245: dread d1/d4/fb [0,4194304] 0 2024-02-28T23:07:24.526 INFO:tasks.workunit.client.1.smithi184.stdout:0/247: dread d0/df/d13/f14 [0,4194304] 0 2024-02-28T23:07:24.527 INFO:tasks.workunit.client.0.smithi159.stdout:4/741: dwrite d9/da/d1c/d8e/deb/f106 [0,4194304] 0 2024-02-28T23:07:24.533 INFO:tasks.workunit.client.1.smithi184.stdout:6/213: write dc/de/f36 [1122940,63499] 0 2024-02-28T23:07:24.533 INFO:tasks.workunit.client.1.smithi184.stdout:6/214: chown dc/de/f20 1658188 1 2024-02-28T23:07:24.533 INFO:tasks.workunit.client.1.smithi184.stdout:6/215: stat dc/f48 0 2024-02-28T23:07:24.534 INFO:tasks.workunit.client.0.smithi159.stdout:9/666: dwrite d4/f3c [0,4194304] 0 2024-02-28T23:07:24.534 INFO:tasks.workunit.client.0.smithi159.stdout:0/763: creat d0/d5/d14/d25/d2c/dab/f10c x:0 0 0 2024-02-28T23:07:24.534 INFO:tasks.workunit.client.1.smithi184.stdout:2/236: creat d10/d1f/d21/d4d/f50 x:0 0 0 2024-02-28T23:07:24.536 INFO:tasks.workunit.client.1.smithi184.stdout:6/216: dread dc/de/d10/d16/f37 [0,4194304] 0 2024-02-28T23:07:24.536 INFO:tasks.workunit.client.1.smithi184.stdout:2/237: fdatasync d10/d13/d15/d24/f22 0 2024-02-28T23:07:24.538 INFO:tasks.workunit.client.1.smithi184.stdout:0/248: creat d0/df/d13/d27/d2b/f4e x:0 0 0 2024-02-28T23:07:24.540 INFO:tasks.workunit.client.0.smithi159.stdout:0/764: write d0/d5/d14/d25/d2c/fd4 [1670522,113753] 0 2024-02-28T23:07:24.543 INFO:tasks.workunit.client.1.smithi184.stdout:7/227: creat d6/d9/d13/f57 x:0 0 0 2024-02-28T23:07:24.546 INFO:tasks.workunit.client.0.smithi159.stdout:7/538: mknod d5/d56/d2a/cb5 0 2024-02-28T23:07:24.553 INFO:tasks.workunit.client.0.smithi159.stdout:7/539: write d5/d16/d1a/d27/d46/d65/d81/d83/d9d/fa1 [584061,58387] 0 2024-02-28T23:07:24.562 INFO:tasks.workunit.client.1.smithi184.stdout:7/228: dwrite d6/f3d [0,4194304] 0 2024-02-28T23:07:24.564 INFO:tasks.workunit.client.1.smithi184.stdout:9/251: dread d5/d17/d43/f48 [0,4194304] 0 2024-02-28T23:07:24.564 INFO:tasks.workunit.client.0.smithi159.stdout:0/765: read - d0/d5/d14/d78/da8/fb1 zero size 2024-02-28T23:07:24.566 INFO:tasks.workunit.client.1.smithi184.stdout:0/249: chown d0/df/d13/d27/c34 4654252 1 2024-02-28T23:07:24.566 INFO:tasks.workunit.client.1.smithi184.stdout:9/252: write d5/d26/d50/f35 [371816,124871] 0 2024-02-28T23:07:24.568 INFO:tasks.workunit.client.0.smithi159.stdout:3/608: mknod d0/d2b/cbf 0 2024-02-28T23:07:24.568 INFO:tasks.workunit.client.0.smithi159.stdout:1/620: dwrite d6/f9 [0,4194304] 0 2024-02-28T23:07:24.570 INFO:tasks.workunit.client.1.smithi184.stdout:3/246: rmdir d1/d4/d6/d1f/d43 0 2024-02-28T23:07:24.574 INFO:tasks.workunit.client.0.smithi159.stdout:1/621: fsync d6/d12/d31/fae 0 2024-02-28T23:07:24.577 INFO:tasks.workunit.client.0.smithi159.stdout:8/763: getdents d2/d11/d52/d26/d36/d38/d77/d9e 0 2024-02-28T23:07:24.579 INFO:tasks.workunit.client.0.smithi159.stdout:3/609: creat d0/d47/d88/fc0 x:0 0 0 2024-02-28T23:07:24.582 INFO:tasks.workunit.client.1.smithi184.stdout:5/237: dread db/d12/f39 [0,4194304] 0 2024-02-28T23:07:24.585 INFO:tasks.workunit.client.1.smithi184.stdout:3/247: mknod d1/d4/d6/d1f/d24/c47 0 2024-02-28T23:07:24.586 INFO:tasks.workunit.client.1.smithi184.stdout:3/248: dread - d1/d4/f42 zero size 2024-02-28T23:07:24.587 INFO:tasks.workunit.client.1.smithi184.stdout:3/249: fdatasync d1/d4/d6/d1e/f37 0 2024-02-28T23:07:24.588 INFO:tasks.workunit.client.0.smithi159.stdout:5/629: dwrite d8/fa2 [0,4194304] 0 2024-02-28T23:07:24.591 INFO:tasks.workunit.client.1.smithi184.stdout:5/238: mknod db/d1f/c51 0 2024-02-28T23:07:24.593 INFO:tasks.workunit.client.0.smithi159.stdout:7/540: dwrite d5/d16/d1a/d27/d46/f8d [0,4194304] 0 2024-02-28T23:07:24.594 INFO:tasks.workunit.client.0.smithi159.stdout:8/764: creat d2/d11/d52/d26/d36/d38/d77/d9e/dc1/fee x:0 0 0 2024-02-28T23:07:24.596 INFO:tasks.workunit.client.0.smithi159.stdout:0/766: dwrite d0/d5/d14/d25/d2c/d4b/ff9 [0,4194304] 0 2024-02-28T23:07:24.601 INFO:tasks.workunit.client.0.smithi159.stdout:7/541: write d5/d10/d60/f94 [448378,10583] 0 2024-02-28T23:07:24.602 INFO:tasks.workunit.client.1.smithi184.stdout:2/238: getdents d10/d13/d15 0 2024-02-28T23:07:24.604 INFO:tasks.workunit.client.0.smithi159.stdout:7/542: chown d5 54 1 2024-02-28T23:07:24.604 INFO:tasks.workunit.client.0.smithi159.stdout:3/610: mknod d0/d3f/cc1 0 2024-02-28T23:07:24.607 INFO:tasks.workunit.client.0.smithi159.stdout:0/767: truncate d0/d5/d14/d25/d2c/dab/dc5/ff7 104544 0 2024-02-28T23:07:24.609 INFO:tasks.workunit.client.1.smithi184.stdout:4/239: sync 2024-02-28T23:07:24.609 INFO:tasks.workunit.client.1.smithi184.stdout:1/303: sync 2024-02-28T23:07:24.611 INFO:tasks.workunit.client.0.smithi159.stdout:7/543: write d5/d16/d1a/f70 [1723943,91066] 0 2024-02-28T23:07:24.613 INFO:tasks.workunit.client.1.smithi184.stdout:3/250: rename d1/l16 to d1/d4/l48 0 2024-02-28T23:07:24.615 INFO:tasks.workunit.client.1.smithi184.stdout:7/229: truncate d6/d9/d13/d1e/d2f/f44 353763 0 2024-02-28T23:07:24.616 INFO:tasks.workunit.client.1.smithi184.stdout:3/251: truncate d1/d4/f42 623913 0 2024-02-28T23:07:24.616 INFO:tasks.workunit.client.1.smithi184.stdout:0/250: truncate d0/df/d13/f29 2428569 0 2024-02-28T23:07:24.616 INFO:tasks.workunit.client.1.smithi184.stdout:9/253: dwrite d5/db/de/d10/d12/d2f/f51 [0,4194304] 0 2024-02-28T23:07:24.618 INFO:tasks.workunit.client.1.smithi184.stdout:7/230: chown d6/d9/da/dc/f27 2966530 1 2024-02-28T23:07:24.622 INFO:tasks.workunit.client.0.smithi159.stdout:8/765: symlink d2/d11/d52/d6e/lef 0 2024-02-28T23:07:24.622 INFO:tasks.workunit.client.1.smithi184.stdout:5/239: rmdir db/d1f 39 2024-02-28T23:07:24.625 INFO:tasks.workunit.client.0.smithi159.stdout:5/630: truncate d8/d19/d23/d35/d41/daa/fc5 2057310 0 2024-02-28T23:07:24.626 INFO:tasks.workunit.client.1.smithi184.stdout:2/239: creat d10/f51 x:0 0 0 2024-02-28T23:07:24.629 INFO:tasks.workunit.client.1.smithi184.stdout:4/240: creat d1/d8/d37/f4c x:0 0 0 2024-02-28T23:07:24.630 INFO:tasks.workunit.client.1.smithi184.stdout:3/252: rmdir d1/d4/d6/d1f/d26 39 2024-02-28T23:07:24.631 INFO:tasks.workunit.client.0.smithi159.stdout:4/742: dread d9/da/d1c/d8e/ddc/fca [0,4194304] 0 2024-02-28T23:07:24.631 INFO:tasks.workunit.client.0.smithi159.stdout:8/766: dread d2/d3/f1d [4194304,4194304] 0 2024-02-28T23:07:24.631 INFO:tasks.workunit.client.0.smithi159.stdout:1/622: link d6/d1d/c43 d6/d1d/d1f/db8/dcc/ccd 0 2024-02-28T23:07:24.632 INFO:tasks.workunit.client.1.smithi184.stdout:4/241: truncate d1/dc/df/f31 874558 0 2024-02-28T23:07:24.633 INFO:tasks.workunit.client.1.smithi184.stdout:0/251: dread d0/df/d13/f3e [0,4194304] 0 2024-02-28T23:07:24.634 INFO:tasks.workunit.client.1.smithi184.stdout:3/253: read d1/d4/d6/d1e/f37 [142218,11052] 0 2024-02-28T23:07:24.635 INFO:tasks.workunit.client.1.smithi184.stdout:7/231: creat d6/d9/d13/d1e/d2f/d34/d47/f58 x:0 0 0 2024-02-28T23:07:24.636 INFO:tasks.workunit.client.1.smithi184.stdout:3/254: write d1/d4/d1c/f31 [2015583,82929] 0 2024-02-28T23:07:24.636 INFO:tasks.workunit.client.0.smithi159.stdout:5/631: read - d8/fcc zero size 2024-02-28T23:07:24.638 INFO:tasks.workunit.client.1.smithi184.stdout:1/304: symlink d20/l65 0 2024-02-28T23:07:24.639 INFO:tasks.workunit.client.1.smithi184.stdout:1/305: write f19 [6825816,58689] 0 2024-02-28T23:07:24.640 INFO:tasks.workunit.client.0.smithi159.stdout:5/632: chown d8/d19/d23/d35/d41/daa/d79/fa4 1196449364 1 2024-02-28T23:07:24.641 INFO:tasks.workunit.client.1.smithi184.stdout:9/254: symlink d5/db/l56 0 2024-02-28T23:07:24.652 INFO:tasks.workunit.client.0.smithi159.stdout:0/768: write d0/d5/d38/f91 [908315,2782] 0 2024-02-28T23:07:24.654 INFO:tasks.workunit.client.1.smithi184.stdout:5/240: symlink db/l52 0 2024-02-28T23:07:24.655 INFO:tasks.workunit.client.1.smithi184.stdout:5/241: chown db/d44 6586 1 2024-02-28T23:07:24.657 INFO:tasks.workunit.client.1.smithi184.stdout:5/242: read db/d12/d1c/f3a [317662,98126] 0 2024-02-28T23:07:24.658 INFO:tasks.workunit.client.0.smithi159.stdout:5/633: creat d8/d19/d23/d35/d38/d8f/da5/d90/fd5 x:0 0 0 2024-02-28T23:07:24.659 INFO:tasks.workunit.client.1.smithi184.stdout:3/255: write d1/f21 [5464622,4958] 0 2024-02-28T23:07:24.660 INFO:tasks.workunit.client.0.smithi159.stdout:1/623: mknod d6/d12/d33/d72/cce 0 2024-02-28T23:07:24.662 INFO:tasks.workunit.client.1.smithi184.stdout:2/240: link d10/f11 d10/d1f/d21/d4d/f52 0 2024-02-28T23:07:24.665 INFO:tasks.workunit.client.0.smithi159.stdout:4/743: dread d9/d4c/d6c/fa4 [0,4194304] 0 2024-02-28T23:07:24.666 INFO:tasks.workunit.client.1.smithi184.stdout:0/252: symlink d0/d1d/d4c/l4f 0 2024-02-28T23:07:24.667 INFO:tasks.workunit.client.1.smithi184.stdout:6/217: sync 2024-02-28T23:07:24.667 INFO:tasks.workunit.client.1.smithi184.stdout:8/252: sync 2024-02-28T23:07:24.668 INFO:tasks.workunit.client.0.smithi159.stdout:0/769: fsync d0/de/f9c 0 2024-02-28T23:07:24.669 INFO:tasks.workunit.client.0.smithi159.stdout:8/767: dwrite d2/d11/d52/d47/d65/d68/fdc [0,4194304] 0 2024-02-28T23:07:24.669 INFO:tasks.workunit.client.0.smithi159.stdout:3/611: getdents d0/d6/d3e/da9 0 2024-02-28T23:07:24.671 INFO:tasks.workunit.client.0.smithi159.stdout:0/770: chown d0/d5/d14/d25/d5c 796463 1 2024-02-28T23:07:24.675 INFO:tasks.workunit.client.0.smithi159.stdout:8/768: chown d2/d11/d52/d26/d36/c4e 1393340 1 2024-02-28T23:07:24.677 INFO:tasks.workunit.client.0.smithi159.stdout:7/544: getdents d5/d16/d1a/d27/d46/d65/d81 0 2024-02-28T23:07:24.678 INFO:tasks.workunit.client.1.smithi184.stdout:3/256: write d1/d4/f14 [2365891,109119] 0 2024-02-28T23:07:24.680 INFO:tasks.workunit.client.1.smithi184.stdout:3/257: read d1/d4/d6/d1f/d24/f3e [295717,79828] 0 2024-02-28T23:07:24.682 INFO:tasks.workunit.client.0.smithi159.stdout:4/744: creat d9/da/d1c/d8e/f109 x:0 0 0 2024-02-28T23:07:24.682 INFO:tasks.workunit.client.1.smithi184.stdout:3/258: write d1/d4/f23 [436199,5695] 0 2024-02-28T23:07:24.685 INFO:tasks.workunit.client.1.smithi184.stdout:4/242: truncate d1/d8/d19/f39 758662 0 2024-02-28T23:07:24.686 INFO:tasks.workunit.client.0.smithi159.stdout:4/745: write d9/d20/f89 [1207651,113620] 0 2024-02-28T23:07:24.686 INFO:tasks.workunit.client.0.smithi159.stdout:3/612: mkdir d0/d47/dc2 0 2024-02-28T23:07:24.689 INFO:tasks.workunit.client.0.smithi159.stdout:3/613: chown d0/d47/l50 1727579 1 2024-02-28T23:07:24.689 INFO:tasks.workunit.client.0.smithi159.stdout:1/624: dread d6/d1d/fc7 [0,4194304] 0 2024-02-28T23:07:24.690 INFO:tasks.workunit.client.0.smithi159.stdout:0/771: creat d0/d5/d14/d25/d2c/dab/f10d x:0 0 0 2024-02-28T23:07:24.691 INFO:tasks.workunit.client.1.smithi184.stdout:1/306: mknod d20/d32/c66 0 2024-02-28T23:07:24.691 INFO:tasks.workunit.client.0.smithi159.stdout:4/746: write d9/d20/d87/fb8 [5157919,67569] 0 2024-02-28T23:07:24.693 INFO:tasks.workunit.client.0.smithi159.stdout:3/614: write d0/d3f/fb5 [25737,28209] 0 2024-02-28T23:07:24.695 INFO:tasks.workunit.client.0.smithi159.stdout:4/747: read d9/d4c/d6c/fa4 [3848013,120793] 0 2024-02-28T23:07:24.695 INFO:tasks.workunit.client.1.smithi184.stdout:9/255: rename d5/d40 to d5/d17/d57 0 2024-02-28T23:07:24.696 INFO:tasks.workunit.client.1.smithi184.stdout:2/241: write d10/f16 [2619267,8706] 0 2024-02-28T23:07:24.696 INFO:tasks.workunit.client.0.smithi159.stdout:8/769: truncate d2/d73/dc2/fac 1003955 0 2024-02-28T23:07:24.697 INFO:tasks.workunit.client.1.smithi184.stdout:2/242: write d10/f51 [410785,82949] 0 2024-02-28T23:07:24.698 INFO:tasks.workunit.client.1.smithi184.stdout:7/232: creat d6/f59 x:0 0 0 2024-02-28T23:07:24.698 INFO:tasks.workunit.client.0.smithi159.stdout:7/545: mknod d5/d16/d1a/d27/d3e/cb6 0 2024-02-28T23:07:24.700 INFO:tasks.workunit.client.1.smithi184.stdout:7/233: dread - d6/d9/da/dc/f3c zero size 2024-02-28T23:07:24.703 INFO:tasks.workunit.client.1.smithi184.stdout:0/253: mknod d0/df/d13/d27/d2b/c50 0 2024-02-28T23:07:24.703 INFO:tasks.workunit.client.0.smithi159.stdout:0/772: chown d0/d5/d38/d76/c95 1020038 1 2024-02-28T23:07:24.704 INFO:tasks.workunit.client.1.smithi184.stdout:5/243: mknod db/d12/d1c/d21/c53 0 2024-02-28T23:07:24.704 INFO:tasks.workunit.client.0.smithi159.stdout:5/634: link d8/d19/d23/d35/d65/da3/laf d8/d19/d23/d35/d41/d92/ld6 0 2024-02-28T23:07:24.705 INFO:tasks.workunit.client.0.smithi159.stdout:5/635: chown d8/d19/d23/d2a 0 1 2024-02-28T23:07:24.706 INFO:tasks.workunit.client.0.smithi159.stdout:1/625: rename d6/d12/d31/l90 to d6/d12/d1a/d92/dc9/lcf 0 2024-02-28T23:07:24.706 INFO:tasks.workunit.client.0.smithi159.stdout:3/615: rmdir d0/d6/d3e/da9 39 2024-02-28T23:07:24.707 INFO:tasks.workunit.client.1.smithi184.stdout:1/307: dwrite d20/d32/d3e/f3f [0,4194304] 0 2024-02-28T23:07:24.708 INFO:tasks.workunit.client.0.smithi159.stdout:4/748: creat d9/d4c/d6c/f10a x:0 0 0 2024-02-28T23:07:24.708 INFO:tasks.workunit.client.0.smithi159.stdout:5/636: stat d8/d19/d23/d35/d41/d77/fad 0 2024-02-28T23:07:24.709 INFO:tasks.workunit.client.0.smithi159.stdout:4/749: dread - d9/d4c/d6c/f10a zero size 2024-02-28T23:07:24.714 INFO:tasks.workunit.client.1.smithi184.stdout:9/256: dwrite d5/db/de/d10/f2b [0,4194304] 0 2024-02-28T23:07:24.718 INFO:tasks.workunit.client.0.smithi159.stdout:7/546: rename d5/d16/d1a/d24/d64/f7d to d5/d16/d1a/d27/d46/d65/fb7 0 2024-02-28T23:07:24.721 INFO:tasks.workunit.client.0.smithi159.stdout:7/547: read - d5/d16/d1a/fad zero size 2024-02-28T23:07:24.721 INFO:tasks.workunit.client.0.smithi159.stdout:1/626: fdatasync d6/d12/d1a/fa3 0 2024-02-28T23:07:24.726 INFO:tasks.workunit.client.0.smithi159.stdout:8/770: creat d2/d11/d52/d26/d36/d38/d77/d79/dd7/ff0 x:0 0 0 2024-02-28T23:07:24.728 INFO:tasks.workunit.client.0.smithi159.stdout:4/750: creat d9/d42/d54/d55/da8/f10b x:0 0 0 2024-02-28T23:07:24.729 INFO:tasks.workunit.client.0.smithi159.stdout:4/751: chown d9/d42/d54 5793 1 2024-02-28T23:07:24.731 INFO:tasks.workunit.client.1.smithi184.stdout:2/243: mkdir d10/d1f/d38/d53 0 2024-02-28T23:07:24.732 INFO:tasks.workunit.client.1.smithi184.stdout:6/218: truncate dc/de/f29 3490650 0 2024-02-28T23:07:24.735 INFO:tasks.workunit.client.1.smithi184.stdout:6/219: write dc/de/d10/f43 [1457111,124467] 0 2024-02-28T23:07:24.735 INFO:tasks.workunit.client.1.smithi184.stdout:6/220: readlink dc/de/l49 0 2024-02-28T23:07:24.736 INFO:tasks.workunit.client.1.smithi184.stdout:5/244: fdatasync db/d12/f1d 0 2024-02-28T23:07:24.737 INFO:tasks.workunit.client.0.smithi159.stdout:3/616: rmdir d0/d6/d3e/da9 39 2024-02-28T23:07:24.741 INFO:tasks.workunit.client.0.smithi159.stdout:8/771: rmdir d2/d11 39 2024-02-28T23:07:24.742 INFO:tasks.workunit.client.1.smithi184.stdout:9/257: mkdir d5/db/de/d58 0 2024-02-28T23:07:24.744 INFO:tasks.workunit.client.0.smithi159.stdout:0/773: dwrite d0/d5/d14/d34/d3d/fa4 [0,4194304] 0 2024-02-28T23:07:24.744 INFO:tasks.workunit.client.1.smithi184.stdout:9/258: write d5/f7 [5187393,86375] 0 2024-02-28T23:07:24.745 INFO:tasks.workunit.client.0.smithi159.stdout:1/627: dwrite d6/d1d/d46/d88/fa9 [0,4194304] 0 2024-02-28T23:07:24.746 INFO:tasks.workunit.client.1.smithi184.stdout:2/244: mkdir d10/d1f/d38/d54 0 2024-02-28T23:07:24.747 INFO:tasks.workunit.client.0.smithi159.stdout:7/548: mkdir d5/d56/db8 0 2024-02-28T23:07:24.747 INFO:tasks.workunit.client.1.smithi184.stdout:2/245: chown d10/d1f/c23 10 1 2024-02-28T23:07:24.750 INFO:tasks.workunit.client.1.smithi184.stdout:2/246: truncate d10/d13/d15/f2e 1561267 0 2024-02-28T23:07:24.750 INFO:tasks.workunit.client.0.smithi159.stdout:3/617: mkdir d0/d2b/d4f/dc3 0 2024-02-28T23:07:24.750 INFO:tasks.workunit.client.1.smithi184.stdout:2/247: chown d10/d13 145180 1 2024-02-28T23:07:24.753 INFO:tasks.workunit.client.0.smithi159.stdout:3/618: chown d0/d6/d3e/c8c 8585126 1 2024-02-28T23:07:24.758 INFO:tasks.workunit.client.1.smithi184.stdout:8/253: truncate d1/da/dc/d16/f1b 2782230 0 2024-02-28T23:07:24.760 INFO:tasks.workunit.client.1.smithi184.stdout:2/248: dread d10/f2d [0,4194304] 0 2024-02-28T23:07:24.760 INFO:tasks.workunit.client.1.smithi184.stdout:6/221: chown dc/de/d2a/l39 9 1 2024-02-28T23:07:24.762 INFO:tasks.workunit.client.1.smithi184.stdout:6/222: write f8 [163183,46048] 0 2024-02-28T23:07:24.769 INFO:tasks.workunit.client.1.smithi184.stdout:4/243: rename d1/d8/c2a to d1/c4d 0 2024-02-28T23:07:24.770 INFO:tasks.workunit.client.1.smithi184.stdout:7/234: rename d6 to d6/d9/d13/d14/d45/d5a 22 2024-02-28T23:07:24.771 INFO:tasks.workunit.client.0.smithi159.stdout:7/549: fdatasync d5/d56/d2a/f45 0 2024-02-28T23:07:24.772 INFO:tasks.workunit.client.0.smithi159.stdout:1/628: read d6/d1d/d46/f82 [518005,91214] 0 2024-02-28T23:07:24.772 INFO:tasks.workunit.client.0.smithi159.stdout:3/619: truncate d0/d2b/f26 224011 0 2024-02-28T23:07:24.773 INFO:tasks.workunit.client.0.smithi159.stdout:0/774: dread d0/d5/d38/f90 [0,4194304] 0 2024-02-28T23:07:24.773 INFO:tasks.workunit.client.1.smithi184.stdout:5/245: dwrite db/d12/f1d [0,4194304] 0 2024-02-28T23:07:24.774 INFO:tasks.workunit.client.1.smithi184.stdout:7/235: read - d6/d9/da/dc/f27 zero size 2024-02-28T23:07:24.774 INFO:tasks.workunit.client.1.smithi184.stdout:1/308: dwrite d20/f25 [4194304,4194304] 0 2024-02-28T23:07:24.775 INFO:tasks.workunit.client.1.smithi184.stdout:7/236: fdatasync d6/f3d 0 2024-02-28T23:07:24.775 INFO:tasks.workunit.client.0.smithi159.stdout:5/637: dwrite d8/d19/d23/f4a [0,4194304] 0 2024-02-28T23:07:24.776 INFO:tasks.workunit.client.0.smithi159.stdout:0/775: chown d0/d5/c2d 1604 1 2024-02-28T23:07:24.777 INFO:tasks.workunit.client.1.smithi184.stdout:1/309: write fa [2405200,15947] 0 2024-02-28T23:07:24.777 INFO:tasks.workunit.client.1.smithi184.stdout:0/254: sync 2024-02-28T23:07:24.780 INFO:tasks.workunit.client.1.smithi184.stdout:7/237: write d6/d9/da/dc/f27 [337552,6645] 0 2024-02-28T23:07:24.782 INFO:tasks.workunit.client.1.smithi184.stdout:4/244: dread d1/dc/f23 [0,4194304] 0 2024-02-28T23:07:24.784 INFO:tasks.workunit.client.1.smithi184.stdout:2/249: mkdir d10/d55 0 2024-02-28T23:07:24.784 INFO:tasks.workunit.client.0.smithi159.stdout:9/667: sync 2024-02-28T23:07:24.785 INFO:tasks.workunit.client.0.smithi159.stdout:6/622: sync 2024-02-28T23:07:24.785 INFO:tasks.workunit.client.0.smithi159.stdout:2/591: sync 2024-02-28T23:07:24.787 INFO:tasks.workunit.client.0.smithi159.stdout:1/629: rename d6/d1d/d1f/d3e/f73 to d6/d1d/d46/d88/fd0 0 2024-02-28T23:07:24.788 INFO:tasks.workunit.client.0.smithi159.stdout:0/776: write d0/d5/d38/d63/fbd [1628130,41314] 0 2024-02-28T23:07:24.793 INFO:tasks.workunit.client.0.smithi159.stdout:2/592: readlink d9/d36/d59/l6e 0 2024-02-28T23:07:24.797 INFO:tasks.workunit.client.1.smithi184.stdout:9/259: rename d5/db/de/d58 to d5/d47/d59 0 2024-02-28T23:07:24.801 INFO:tasks.workunit.client.1.smithi184.stdout:1/310: dwrite f9 [4194304,4194304] 0 2024-02-28T23:07:24.803 INFO:tasks.workunit.client.0.smithi159.stdout:9/668: rmdir d4/d3d/d3e/dad 39 2024-02-28T23:07:24.803 INFO:tasks.workunit.client.0.smithi159.stdout:7/550: dread d5/d16/d1a/d27/d46/f66 [0,4194304] 0 2024-02-28T23:07:24.803 INFO:tasks.workunit.client.1.smithi184.stdout:5/246: unlink db/d12/l15 0 2024-02-28T23:07:24.806 INFO:tasks.workunit.client.1.smithi184.stdout:2/250: dwrite d10/d13/d15/d24/f22 [4194304,4194304] 0 2024-02-28T23:07:24.807 INFO:tasks.workunit.client.0.smithi159.stdout:2/593: truncate d9/d23/da9/fb4 326854 0 2024-02-28T23:07:24.808 INFO:tasks.workunit.client.0.smithi159.stdout:4/752: dwrite d9/f18 [0,4194304] 0 2024-02-28T23:07:24.808 INFO:tasks.workunit.client.1.smithi184.stdout:0/255: mkdir d0/df/d13/d27/d31/d51 0 2024-02-28T23:07:24.809 INFO:tasks.workunit.client.0.smithi159.stdout:8/772: dwrite d2/d3/f13 [8388608,4194304] 0 2024-02-28T23:07:24.813 INFO:tasks.workunit.client.1.smithi184.stdout:3/259: getdents d1/d4/d6/d1f/d26 0 2024-02-28T23:07:24.813 INFO:tasks.workunit.client.0.smithi159.stdout:5/638: mkdir d8/d19/d23/d35/d65/da3/dd2/dd7 0 2024-02-28T23:07:24.817 INFO:tasks.workunit.client.1.smithi184.stdout:7/238: mkdir d6/d9/d13/d1e/d2f/d33/d5b 0 2024-02-28T23:07:24.819 INFO:tasks.workunit.client.1.smithi184.stdout:7/239: stat d6/d9/da/dc/f2b 0 2024-02-28T23:07:24.820 INFO:tasks.workunit.client.1.smithi184.stdout:4/245: symlink d1/d8/d37/l4e 0 2024-02-28T23:07:24.822 INFO:tasks.workunit.client.1.smithi184.stdout:4/246: write d1/f33 [1568475,121782] 0 2024-02-28T23:07:24.822 INFO:tasks.workunit.client.0.smithi159.stdout:0/777: symlink d0/d5/d14/d25/d2c/dab/dc5/l10e 0 2024-02-28T23:07:24.822 INFO:tasks.workunit.client.0.smithi159.stdout:5/639: write d8/d59/fbe [539699,14012] 0 2024-02-28T23:07:24.824 INFO:tasks.workunit.client.1.smithi184.stdout:4/247: chown d1/d8/d37/f4c 54966 1 2024-02-28T23:07:24.826 INFO:tasks.workunit.client.0.smithi159.stdout:3/620: dwrite d0/d2b/d55/d75/d6d/d54/d63/f81 [4194304,4194304] 0 2024-02-28T23:07:24.828 INFO:tasks.workunit.client.0.smithi159.stdout:1/630: rename d6/d12/d33/d3c/c67 to d6/d1d/d1f/d3e/d63/cd1 0 2024-02-28T23:07:24.833 INFO:tasks.workunit.client.0.smithi159.stdout:6/623: write d0/d1b/d33/d11/d34/f35 [6713860,130114] 0 2024-02-28T23:07:24.839 INFO:tasks.workunit.client.1.smithi184.stdout:8/254: fsync d1/da/dc/d16/f1b 0 2024-02-28T23:07:24.839 INFO:tasks.workunit.client.1.smithi184.stdout:2/251: truncate d10/d13/f1a 1459428 0 2024-02-28T23:07:24.841 INFO:tasks.workunit.client.1.smithi184.stdout:0/256: fsync d0/df/d13/f18 0 2024-02-28T23:07:24.841 INFO:tasks.workunit.client.0.smithi159.stdout:5/640: read - d8/d19/d23/d35/d41/fc6 zero size 2024-02-28T23:07:24.842 INFO:tasks.workunit.client.1.smithi184.stdout:9/260: dwrite d5/d17/d43/f48 [8388608,4194304] 0 2024-02-28T23:07:24.842 INFO:tasks.workunit.client.1.smithi184.stdout:6/223: truncate dc/de/f1e 790578 0 2024-02-28T23:07:24.845 INFO:tasks.workunit.client.1.smithi184.stdout:6/224: read - dc/de/d10/f21 zero size 2024-02-28T23:07:24.845 INFO:tasks.workunit.client.0.smithi159.stdout:8/773: dread d2/d11/d52/f32 [0,4194304] 0 2024-02-28T23:07:24.848 INFO:tasks.workunit.client.0.smithi159.stdout:9/669: creat d4/d3d/fd2 x:0 0 0 2024-02-28T23:07:24.849 INFO:tasks.workunit.client.1.smithi184.stdout:7/240: rmdir d6/d9/da 39 2024-02-28T23:07:24.852 INFO:tasks.workunit.client.0.smithi159.stdout:7/551: dwrite d5/d56/d50/f80 [0,4194304] 0 2024-02-28T23:07:24.853 INFO:tasks.workunit.client.1.smithi184.stdout:5/247: dwrite db/d12/f39 [0,4194304] 0 2024-02-28T23:07:24.854 INFO:tasks.workunit.client.1.smithi184.stdout:0/257: creat d0/d1f/f52 x:0 0 0 2024-02-28T23:07:24.855 INFO:tasks.workunit.client.0.smithi159.stdout:2/594: read d9/d50/d54/d84/d37/d5c/fa3 [95175,69986] 0 2024-02-28T23:07:24.855 INFO:tasks.workunit.client.0.smithi159.stdout:8/774: readlink d2/d11/d52/d26/d36/l37 0 2024-02-28T23:07:24.855 INFO:tasks.workunit.client.0.smithi159.stdout:1/631: truncate d6/d12/d16/f24 3148705 0 2024-02-28T23:07:24.856 INFO:tasks.workunit.client.1.smithi184.stdout:2/252: dwrite d10/d1f/d21/d4d/f50 [0,4194304] 0 2024-02-28T23:07:24.857 INFO:tasks.workunit.client.1.smithi184.stdout:8/255: symlink d1/da/dc/d16/d32/d42/l66 0 2024-02-28T23:07:24.858 INFO:tasks.workunit.client.1.smithi184.stdout:2/253: chown d10/d13/d15/f19 12927620 1 2024-02-28T23:07:24.861 INFO:tasks.workunit.client.0.smithi159.stdout:5/641: creat d8/d19/d23/d35/d41/daa/fd8 x:0 0 0 2024-02-28T23:07:24.864 INFO:tasks.workunit.client.1.smithi184.stdout:6/225: rmdir dc/de/d10/d16 39 2024-02-28T23:07:24.864 INFO:tasks.workunit.client.0.smithi159.stdout:0/778: creat d0/de/d75/db8/d103/f10f x:0 0 0 2024-02-28T23:07:24.867 INFO:tasks.workunit.client.0.smithi159.stdout:6/624: mkdir d0/d1b/dc5 0 2024-02-28T23:07:24.870 INFO:tasks.workunit.client.1.smithi184.stdout:7/241: chown d6/d9/da/l29 190997 1 2024-02-28T23:07:24.880 INFO:tasks.workunit.client.1.smithi184.stdout:1/311: rename d20/l2e to d20/d32/l67 0 2024-02-28T23:07:24.887 INFO:tasks.workunit.client.0.smithi159.stdout:7/552: symlink d5/d56/d50/daa/lb9 0 2024-02-28T23:07:24.889 INFO:tasks.workunit.client.0.smithi159.stdout:4/753: truncate d9/da/d1c/d23/f24 4834473 0 2024-02-28T23:07:24.899 INFO:tasks.workunit.client.0.smithi159.stdout:1/632: creat d6/d1d/d1f/d3e/d9c/db3/fd2 x:0 0 0 2024-02-28T23:07:24.901 INFO:tasks.workunit.client.1.smithi184.stdout:5/248: dread db/d1f/f42 [0,4194304] 0 2024-02-28T23:07:24.902 INFO:tasks.workunit.client.0.smithi159.stdout:9/670: dread d4/d3d/d3e/d4a/f56 [0,4194304] 0 2024-02-28T23:07:24.908 INFO:tasks.workunit.client.1.smithi184.stdout:0/258: creat d0/df/d13/f53 x:0 0 0 2024-02-28T23:07:24.908 INFO:tasks.workunit.client.1.smithi184.stdout:0/259: stat d0/fc 0 2024-02-28T23:07:24.908 INFO:tasks.workunit.client.0.smithi159.stdout:8/775: mkdir d2/d11/d52/d26/d36/d38/d77/d9e/df1 0 2024-02-28T23:07:24.910 INFO:tasks.workunit.client.1.smithi184.stdout:9/261: link d5/d26/d50/f53 d5/d17/f5a 0 2024-02-28T23:07:24.914 INFO:tasks.workunit.client.0.smithi159.stdout:7/553: dwrite d5/d56/d50/d5b/f6b [4194304,4194304] 0 2024-02-28T23:07:24.914 INFO:tasks.workunit.client.0.smithi159.stdout:6/625: mknod d0/d1b/d5b/cc6 0 2024-02-28T23:07:24.916 INFO:tasks.workunit.client.1.smithi184.stdout:8/256: unlink d1/da/dc/d16/f1b 0 2024-02-28T23:07:24.919 INFO:tasks.workunit.client.1.smithi184.stdout:2/254: creat d10/d13/d15/d24/f56 x:0 0 0 2024-02-28T23:07:24.920 INFO:tasks.workunit.client.1.smithi184.stdout:3/260: link d1/d4/d6/d1f/l28 d1/d4/d6/d1f/d26/l49 0 2024-02-28T23:07:24.921 INFO:tasks.workunit.client.0.smithi159.stdout:0/779: mknod d0/d5/d14/d25/d5c/c110 0 2024-02-28T23:07:24.922 INFO:tasks.workunit.client.1.smithi184.stdout:7/242: symlink d6/d9/d13/d1e/d2f/l5c 0 2024-02-28T23:07:24.924 INFO:tasks.workunit.client.0.smithi159.stdout:4/754: rmdir d9/d42/d54/d55/da8 39 2024-02-28T23:07:24.927 INFO:tasks.workunit.client.0.smithi159.stdout:4/755: write d9/d4c/d6c/f68 [3240581,68376] 0 2024-02-28T23:07:24.928 INFO:tasks.workunit.client.1.smithi184.stdout:4/248: rename d1/dc/fd to d1/d8/d37/d49/f4f 0 2024-02-28T23:07:24.931 INFO:tasks.workunit.client.1.smithi184.stdout:1/312: unlink d20/d32/d3e/c40 0 2024-02-28T23:07:24.931 INFO:tasks.workunit.client.0.smithi159.stdout:5/642: truncate d8/d19/d23/f91 1594052 0 2024-02-28T23:07:24.943 INFO:tasks.workunit.client.1.smithi184.stdout:5/249: creat db/d1f/d32/f54 x:0 0 0 2024-02-28T23:07:24.945 INFO:tasks.workunit.client.1.smithi184.stdout:0/260: symlink d0/df/d13/l54 0 2024-02-28T23:07:24.945 INFO:tasks.workunit.client.0.smithi159.stdout:8/776: mknod d2/d11/d52/d26/d36/d38/d77/d79/cf2 0 2024-02-28T23:07:24.946 INFO:tasks.workunit.client.1.smithi184.stdout:5/250: chown db/d12/d1c/c31 3739 1 2024-02-28T23:07:24.947 INFO:tasks.workunit.client.1.smithi184.stdout:9/262: creat d5/d17/d43/f5b x:0 0 0 2024-02-28T23:07:24.948 INFO:tasks.workunit.client.0.smithi159.stdout:7/554: fsync d5/d56/d2a/f69 0 2024-02-28T23:07:24.949 INFO:tasks.workunit.client.1.smithi184.stdout:0/261: truncate d0/d1f/f43 767290 0 2024-02-28T23:07:24.950 INFO:tasks.workunit.client.1.smithi184.stdout:8/257: dread - d1/da/f2c zero size 2024-02-28T23:07:24.950 INFO:tasks.workunit.client.0.smithi159.stdout:3/621: getdents d0/d2b/d55/d75/d6d/d54/d7c/d79/d9b 0 2024-02-28T23:07:24.951 INFO:tasks.workunit.client.1.smithi184.stdout:5/251: write db/d12/d1c/d21/f2a [650839,93778] 0 2024-02-28T23:07:24.951 INFO:tasks.workunit.client.1.smithi184.stdout:0/262: chown d0/d47 8820 1 2024-02-28T23:07:24.953 INFO:tasks.workunit.client.1.smithi184.stdout:8/258: chown d1/da/dc/d18 1068239010 1 2024-02-28T23:07:24.954 INFO:tasks.workunit.client.1.smithi184.stdout:4/249: dread d1/d8/d19/f1a [0,4194304] 0 2024-02-28T23:07:24.955 INFO:tasks.workunit.client.1.smithi184.stdout:4/250: chown d1/d4/d43 0 1 2024-02-28T23:07:24.955 INFO:tasks.workunit.client.1.smithi184.stdout:8/259: chown d1/da/dc/d16/d4d/f5a 201 1 2024-02-28T23:07:24.955 INFO:tasks.workunit.client.0.smithi159.stdout:0/780: mknod d0/d5/d38/d76/c111 0 2024-02-28T23:07:24.955 INFO:tasks.workunit.client.1.smithi184.stdout:6/226: mknod dc/de/d10/c4a 0 2024-02-28T23:07:24.958 INFO:tasks.workunit.client.1.smithi184.stdout:6/227: read f3 [1098360,59548] 0 2024-02-28T23:07:24.958 INFO:tasks.workunit.client.1.smithi184.stdout:3/261: mknod d1/d4/d6/d1e/c4a 0 2024-02-28T23:07:24.962 INFO:tasks.workunit.client.0.smithi159.stdout:4/756: symlink d9/d42/d54/d9c/l10c 0 2024-02-28T23:07:24.962 INFO:tasks.workunit.client.1.smithi184.stdout:9/263: dread d5/db/de/d10/d12/d2f/f51 [0,4194304] 0 2024-02-28T23:07:24.962 INFO:tasks.workunit.client.0.smithi159.stdout:2/595: creat d9/d23/d2c/d55/fcf x:0 0 0 2024-02-28T23:07:24.964 INFO:tasks.workunit.client.0.smithi159.stdout:4/757: read - d9/d4c/d6c/d98/fe2 zero size 2024-02-28T23:07:24.964 INFO:tasks.workunit.client.0.smithi159.stdout:5/643: creat d8/d59/fd9 x:0 0 0 2024-02-28T23:07:24.965 INFO:tasks.workunit.client.1.smithi184.stdout:1/313: mknod d20/d46/c68 0 2024-02-28T23:07:24.976 INFO:tasks.workunit.client.1.smithi184.stdout:2/255: fdatasync f8 0 2024-02-28T23:07:24.977 INFO:tasks.workunit.client.0.smithi159.stdout:6/626: mknod d0/cc7 0 2024-02-28T23:07:24.981 INFO:tasks.workunit.client.1.smithi184.stdout:0/263: mkdir d0/df/d13/d27/d31/d55 0 2024-02-28T23:07:24.983 INFO:tasks.workunit.client.0.smithi159.stdout:1/633: truncate d6/d12/d1a/f53 1318515 0 2024-02-28T23:07:24.988 INFO:tasks.workunit.client.0.smithi159.stdout:3/622: mknod d0/d2b/d55/d75/d6d/d54/d7c/d79/d9b/cc4 0 2024-02-28T23:07:24.989 INFO:tasks.workunit.client.1.smithi184.stdout:5/252: write db/d12/d1c/f2b [1876069,93448] 0 2024-02-28T23:07:24.989 INFO:tasks.workunit.client.0.smithi159.stdout:3/623: chown d0/d3f/fad 5787467 1 2024-02-28T23:07:24.998 INFO:tasks.workunit.client.0.smithi159.stdout:8/777: dwrite d2/d3/f46 [0,4194304] 0 2024-02-28T23:07:25.003 INFO:tasks.workunit.client.1.smithi184.stdout:9/264: chown d5/fc 125833208 1 2024-02-28T23:07:25.008 INFO:tasks.workunit.client.0.smithi159.stdout:2/596: creat d9/d50/d54/d84/d37/d5c/fd0 x:0 0 0 2024-02-28T23:07:25.008 INFO:tasks.workunit.client.1.smithi184.stdout:7/243: truncate d6/d9/da/dc/f12 4470724 0 2024-02-28T23:07:25.008 INFO:tasks.workunit.client.1.smithi184.stdout:1/314: creat d20/d46/f69 x:0 0 0 2024-02-28T23:07:25.009 INFO:tasks.workunit.client.1.smithi184.stdout:1/315: chown f2 15977350 1 2024-02-28T23:07:25.011 INFO:tasks.workunit.client.0.smithi159.stdout:4/758: mkdir d9/da/d1c/d23/d7a/d10d 0 2024-02-28T23:07:25.012 INFO:tasks.workunit.client.0.smithi159.stdout:5/644: symlink d8/d19/d23/d35/d65/da3/dd2/lda 0 2024-02-28T23:07:25.013 INFO:tasks.workunit.client.1.smithi184.stdout:2/256: creat d10/d1f/f57 x:0 0 0 2024-02-28T23:07:25.017 INFO:tasks.workunit.client.1.smithi184.stdout:0/264: rmdir d0/df 39 2024-02-28T23:07:25.018 INFO:tasks.workunit.client.0.smithi159.stdout:1/634: rename d6/d1d/d1f/d3e to d6/d1d/d46/d88/dd3 0 2024-02-28T23:07:25.018 INFO:tasks.workunit.client.0.smithi159.stdout:2/597: write d9/d50/d54/d84/d37/d5c/fd0 [809664,90413] 0 2024-02-28T23:07:25.018 INFO:tasks.workunit.client.0.smithi159.stdout:7/555: dwrite d5/f1e [0,4194304] 0 2024-02-28T23:07:25.020 INFO:tasks.workunit.client.0.smithi159.stdout:1/635: chown d6/d12/d33/faf 130891 1 2024-02-28T23:07:25.023 INFO:tasks.workunit.client.0.smithi159.stdout:7/556: write d5/d16/d1a/d27/d3e/f7c [1553507,78788] 0 2024-02-28T23:07:25.025 INFO:tasks.workunit.client.1.smithi184.stdout:5/253: creat db/d12/d1c/d21/d2f/f55 x:0 0 0 2024-02-28T23:07:25.028 INFO:tasks.workunit.client.0.smithi159.stdout:0/781: mknod d0/d5/d14/c112 0 2024-02-28T23:07:25.032 INFO:tasks.workunit.client.1.smithi184.stdout:3/262: symlink d1/d4/d5/d40/l4b 0 2024-02-28T23:07:25.032 INFO:tasks.workunit.client.0.smithi159.stdout:7/557: dread d5/d56/d50/f58 [0,4194304] 0 2024-02-28T23:07:25.035 INFO:tasks.workunit.client.0.smithi159.stdout:7/558: fdatasync d5/d56/d50/d5b/f7b 0 2024-02-28T23:07:25.037 INFO:tasks.workunit.client.1.smithi184.stdout:2/257: dwrite d10/d1f/f4c [0,4194304] 0 2024-02-28T23:07:25.042 INFO:tasks.workunit.client.0.smithi159.stdout:2/598: dwrite d9/d50/d54/f8e [0,4194304] 0 2024-02-28T23:07:25.044 INFO:tasks.workunit.client.0.smithi159.stdout:3/624: dwrite d0/d6/d34/f62 [4194304,4194304] 0 2024-02-28T23:07:25.050 INFO:tasks.workunit.client.1.smithi184.stdout:3/263: symlink d1/d4/d6/l4c 0 2024-02-28T23:07:25.054 INFO:tasks.workunit.client.1.smithi184.stdout:9/265: mkdir d5/db/d5c 0 2024-02-28T23:07:25.054 INFO:tasks.workunit.client.1.smithi184.stdout:2/258: creat d10/d13/f58 x:0 0 0 2024-02-28T23:07:25.057 INFO:tasks.workunit.client.1.smithi184.stdout:9/266: write d5/d26/d50/f35 [287251,57592] 0 2024-02-28T23:07:25.057 INFO:tasks.workunit.client.1.smithi184.stdout:6/228: getdents dc/de 0 2024-02-28T23:07:25.062 INFO:tasks.workunit.client.1.smithi184.stdout:9/267: chown d5/d17/c4c 0 1 2024-02-28T23:07:25.065 INFO:tasks.workunit.client.1.smithi184.stdout:3/264: creat d1/d4/d6/d1f/d26/d3a/f4d x:0 0 0 2024-02-28T23:07:25.069 INFO:tasks.workunit.client.1.smithi184.stdout:7/244: getdents d6/d9/d13/d3e 0 2024-02-28T23:07:25.076 INFO:tasks.workunit.client.1.smithi184.stdout:1/316: getdents d20/d32/d4b 0 2024-02-28T23:07:25.077 INFO:tasks.workunit.client.1.smithi184.stdout:3/265: symlink d1/d4/l4e 0 2024-02-28T23:07:25.079 INFO:tasks.workunit.client.1.smithi184.stdout:8/260: sync 2024-02-28T23:07:25.079 INFO:tasks.workunit.client.1.smithi184.stdout:4/251: sync 2024-02-28T23:07:25.083 INFO:tasks.workunit.client.1.smithi184.stdout:3/266: write d1/d4/d6/d1f/d26/d3a/f3d [650930,101500] 0 2024-02-28T23:07:25.083 INFO:tasks.workunit.client.1.smithi184.stdout:0/265: link d0/df/d13/f29 d0/d1d/d3a/f56 0 2024-02-28T23:07:25.084 INFO:tasks.workunit.client.1.smithi184.stdout:3/267: fsync d1/d4/d1c/f31 0 2024-02-28T23:07:25.085 INFO:tasks.workunit.client.1.smithi184.stdout:7/245: mknod d6/d9/d13/d1e/c5d 0 2024-02-28T23:07:25.087 INFO:tasks.workunit.client.1.smithi184.stdout:8/261: fsync d1/da/dc/d16/d32/f46 0 2024-02-28T23:07:25.088 INFO:tasks.workunit.client.1.smithi184.stdout:4/252: mknod d1/dc/df/d38/d3c/c50 0 2024-02-28T23:07:25.092 INFO:tasks.workunit.client.1.smithi184.stdout:5/254: dwrite db/d12/d1c/f3a [0,4194304] 0 2024-02-28T23:07:25.095 INFO:tasks.workunit.client.1.smithi184.stdout:3/268: creat d1/d4/d1c/f4f x:0 0 0 2024-02-28T23:07:25.097 INFO:tasks.workunit.client.1.smithi184.stdout:3/269: chown d1/d4/d6/f46 7463323 1 2024-02-28T23:07:25.101 INFO:tasks.workunit.client.1.smithi184.stdout:6/229: rename dc/f14 to dc/de/d10/f4b 0 2024-02-28T23:07:25.104 INFO:tasks.workunit.client.1.smithi184.stdout:6/230: write f8 [4190523,110224] 0 2024-02-28T23:07:25.111 INFO:tasks.workunit.client.1.smithi184.stdout:0/266: creat d0/f57 x:0 0 0 2024-02-28T23:07:25.111 INFO:tasks.workunit.client.1.smithi184.stdout:4/253: dwrite d1/d8/d37/f4c [0,4194304] 0 2024-02-28T23:07:25.112 INFO:tasks.workunit.client.0.smithi159.stdout:9/671: getdents d4/d3d/d3e/d55/d4c 0 2024-02-28T23:07:25.113 INFO:tasks.workunit.client.1.smithi184.stdout:9/268: rename d5/db/de/d10/l22 to d5/d26/l5d 0 2024-02-28T23:07:25.116 INFO:tasks.workunit.client.1.smithi184.stdout:5/255: unlink db/d12/f2c 0 2024-02-28T23:07:25.116 INFO:tasks.workunit.client.0.smithi159.stdout:6/627: truncate d0/d1b/f1f 5034571 0 2024-02-28T23:07:25.117 INFO:tasks.workunit.client.1.smithi184.stdout:2/259: dwrite d10/d13/d15/f2b [0,4194304] 0 2024-02-28T23:07:25.118 INFO:tasks.workunit.client.1.smithi184.stdout:3/270: dread d1/d4/d1c/f27 [0,4194304] 0 2024-02-28T23:07:25.122 INFO:tasks.workunit.client.0.smithi159.stdout:1/636: rmdir d6/d12/d1a/d92 39 2024-02-28T23:07:25.124 INFO:tasks.workunit.client.0.smithi159.stdout:1/637: dread - d6/d1d/d46/d88/dd3/d9c/fc2 zero size 2024-02-28T23:07:25.127 INFO:tasks.workunit.client.0.smithi159.stdout:0/782: chown d0/de/d75/c49 40 1 2024-02-28T23:07:25.127 INFO:tasks.workunit.client.1.smithi184.stdout:5/256: dread db/d44/f4c [0,4194304] 0 2024-02-28T23:07:25.130 INFO:tasks.workunit.client.1.smithi184.stdout:5/257: dread - db/d12/d18/d2e/d3c/f49 zero size 2024-02-28T23:07:25.132 INFO:tasks.workunit.client.1.smithi184.stdout:9/269: mkdir d5/db/d5c/d5e 0 2024-02-28T23:07:25.133 INFO:tasks.workunit.client.0.smithi159.stdout:2/599: creat d9/d50/d62/dba/fd1 x:0 0 0 2024-02-28T23:07:25.134 INFO:tasks.workunit.client.1.smithi184.stdout:5/258: write db/d1f/d32/f54 [838945,130667] 0 2024-02-28T23:07:25.137 INFO:tasks.workunit.client.1.smithi184.stdout:2/260: dwrite d10/f1d [0,4194304] 0 2024-02-28T23:07:25.137 INFO:tasks.workunit.client.1.smithi184.stdout:4/254: mkdir d1/dc/df/d22/d51 0 2024-02-28T23:07:25.137 INFO:tasks.workunit.client.0.smithi159.stdout:8/778: truncate d2/d11/d52/d26/d36/d38/d77/d9e/fc0 46359 0 2024-02-28T23:07:25.138 INFO:tasks.workunit.client.1.smithi184.stdout:7/246: truncate f4 2358504 0 2024-02-28T23:07:25.138 INFO:tasks.workunit.client.0.smithi159.stdout:4/759: mknod d9/d42/d54/d56/df5/c10e 0 2024-02-28T23:07:25.139 INFO:tasks.workunit.client.0.smithi159.stdout:8/779: write d2/d11/d52/d26/d36/f55 [4161196,1833] 0 2024-02-28T23:07:25.140 INFO:tasks.workunit.client.1.smithi184.stdout:7/247: fdatasync d6/d9/da/f17 0 2024-02-28T23:07:25.142 INFO:tasks.workunit.client.0.smithi159.stdout:8/780: chown d2/d11/d52/d47/d65/c9d 28208303 1 2024-02-28T23:07:25.142 INFO:tasks.workunit.client.0.smithi159.stdout:8/781: stat d2/d11/d52/c63 0 2024-02-28T23:07:25.144 INFO:tasks.workunit.client.1.smithi184.stdout:1/317: rename c1e to d20/c6a 0 2024-02-28T23:07:25.144 INFO:tasks.workunit.client.0.smithi159.stdout:5/645: truncate d8/d19/d23/d35/d65/fbd 898095 0 2024-02-28T23:07:25.148 INFO:tasks.workunit.client.0.smithi159.stdout:6/628: mkdir d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dc8 0 2024-02-28T23:07:25.150 INFO:tasks.workunit.client.0.smithi159.stdout:6/629: chown d0/d1b/d33/d11/f19 43154 1 2024-02-28T23:07:25.152 INFO:tasks.workunit.client.0.smithi159.stdout:1/638: rename d6/d1d/d46/d88/dd3/l40 to d6/d12/d31/d69/dc0/ld4 0 2024-02-28T23:07:25.155 INFO:tasks.workunit.client.0.smithi159.stdout:7/559: unlink d5/d56/d50/l52 0 2024-02-28T23:07:25.158 INFO:tasks.workunit.client.1.smithi184.stdout:0/267: dwrite d0/df/d13/f29 [0,4194304] 0 2024-02-28T23:07:25.163 INFO:tasks.workunit.client.1.smithi184.stdout:8/262: rename d1/da/dc/c23 to d1/da/dc/d16/d32/c67 0 2024-02-28T23:07:25.164 INFO:tasks.workunit.client.1.smithi184.stdout:8/263: dread - d1/da/dc/d18/f51 zero size 2024-02-28T23:07:25.164 INFO:tasks.workunit.client.1.smithi184.stdout:4/255: getdents d1/dc/df/d41 0 2024-02-28T23:07:25.169 INFO:tasks.workunit.client.1.smithi184.stdout:1/318: symlink d20/l6b 0 2024-02-28T23:07:25.171 INFO:tasks.workunit.client.0.smithi159.stdout:5/646: dread - d8/d19/d23/d35/d38/fa7 zero size 2024-02-28T23:07:25.171 INFO:tasks.workunit.client.1.smithi184.stdout:1/319: fdatasync d20/d32/d51/f60 0 2024-02-28T23:07:25.171 INFO:tasks.workunit.client.1.smithi184.stdout:0/268: write d0/df/d13/f14 [4095117,69288] 0 2024-02-28T23:07:25.174 INFO:tasks.workunit.client.1.smithi184.stdout:4/256: symlink d1/dc/df/d27/d34/l52 0 2024-02-28T23:07:25.177 INFO:tasks.workunit.client.1.smithi184.stdout:7/248: creat d6/d9/f5e x:0 0 0 2024-02-28T23:07:25.182 INFO:tasks.workunit.client.1.smithi184.stdout:1/320: chown d20/c41 112223630 1 2024-02-28T23:07:25.185 INFO:tasks.workunit.client.0.smithi159.stdout:9/672: rmdir d4/d3d/d3e/d55/d37/d62/d77/da1 0 2024-02-28T23:07:25.188 INFO:tasks.workunit.client.0.smithi159.stdout:8/782: fdatasync d2/d11/d52/d26/d36/d38/d77/d9e/fc0 0 2024-02-28T23:07:25.189 INFO:tasks.workunit.client.1.smithi184.stdout:0/269: write d0/d1d/f3d [6635,96522] 0 2024-02-28T23:07:25.191 INFO:tasks.workunit.client.1.smithi184.stdout:0/270: chown d0/df/d13/d27/d2b/c50 2071670340 1 2024-02-28T23:07:25.192 INFO:tasks.workunit.client.0.smithi159.stdout:2/600: write d9/d23/d2c/d55/f5b [589070,43349] 0 2024-02-28T23:07:25.193 INFO:tasks.workunit.client.1.smithi184.stdout:4/257: write d1/d8/d37/d49/f4f [1714396,55500] 0 2024-02-28T23:07:25.193 INFO:tasks.workunit.client.0.smithi159.stdout:6/630: mknod d0/cc9 0 2024-02-28T23:07:25.194 INFO:tasks.workunit.client.0.smithi159.stdout:3/625: write d0/d6/d3e/d2f/f56 [297932,83077] 0 2024-02-28T23:07:25.195 INFO:tasks.workunit.client.1.smithi184.stdout:7/249: fsync d6/d9/da/dc/f2b 0 2024-02-28T23:07:25.196 INFO:tasks.workunit.client.0.smithi159.stdout:2/601: fsync d9/d50/dcc/d44/dc0/fc1 0 2024-02-28T23:07:25.197 INFO:tasks.workunit.client.1.smithi184.stdout:2/261: truncate d10/f2d 1095227 0 2024-02-28T23:07:25.198 INFO:tasks.workunit.client.1.smithi184.stdout:1/321: creat d20/d46/f6c x:0 0 0 2024-02-28T23:07:25.201 INFO:tasks.workunit.client.1.smithi184.stdout:3/271: sync 2024-02-28T23:07:25.204 INFO:tasks.workunit.client.1.smithi184.stdout:3/272: write d1/d4/d1c/f31 [1038528,116920] 0 2024-02-28T23:07:25.204 INFO:tasks.workunit.client.0.smithi159.stdout:4/760: dwrite d9/da/d1c/d23/f4d [4194304,4194304] 0 2024-02-28T23:07:25.206 INFO:tasks.workunit.client.0.smithi159.stdout:4/761: chown d9/d42/ld2 91 1 2024-02-28T23:07:25.207 INFO:tasks.workunit.client.1.smithi184.stdout:0/271: dwrite d0/df/d13/d27/d31/f45 [0,4194304] 0 2024-02-28T23:07:25.207 INFO:tasks.workunit.client.1.smithi184.stdout:6/231: rename dc/f26 to dc/de/d10/f4c 0 2024-02-28T23:07:25.208 INFO:tasks.workunit.client.1.smithi184.stdout:4/258: dread d1/d4/f11 [0,4194304] 0 2024-02-28T23:07:25.208 INFO:tasks.workunit.client.0.smithi159.stdout:4/762: fdatasync d9/d42/d54/d56/fb3 0 2024-02-28T23:07:25.209 INFO:tasks.workunit.client.1.smithi184.stdout:8/264: write d1/da/dc/d16/d32/d42/f61 [585846,98421] 0 2024-02-28T23:07:25.209 INFO:tasks.workunit.client.1.smithi184.stdout:0/272: fsync d0/f37 0 2024-02-28T23:07:25.211 INFO:tasks.workunit.client.1.smithi184.stdout:2/262: unlink d10/d13/d15/d24/l3f 0 2024-02-28T23:07:25.211 INFO:tasks.workunit.client.1.smithi184.stdout:8/265: fdatasync d1/da/d10/d17/f41 0 2024-02-28T23:07:25.213 INFO:tasks.workunit.client.1.smithi184.stdout:0/273: read d0/df/d13/f1a [2846293,82080] 0 2024-02-28T23:07:25.217 INFO:tasks.workunit.client.0.smithi159.stdout:5/647: unlink d8/f21 0 2024-02-28T23:07:25.218 INFO:tasks.workunit.client.0.smithi159.stdout:0/783: getdents d0/d5/d14/d25/d2c/d4b 0 2024-02-28T23:07:25.220 INFO:tasks.workunit.client.1.smithi184.stdout:8/266: dread - d1/da/dc/d16/d29/f54 zero size 2024-02-28T23:07:25.221 INFO:tasks.workunit.client.0.smithi159.stdout:3/626: creat d0/d47/fc5 x:0 0 0 2024-02-28T23:07:25.222 INFO:tasks.workunit.client.1.smithi184.stdout:5/259: rename db/d1f/f27 to db/d12/d1c/d21/d4d/f56 0 2024-02-28T23:07:25.223 INFO:tasks.workunit.client.0.smithi159.stdout:6/631: creat d0/d1b/d33/d11/d34/d9d/da2/fca x:0 0 0 2024-02-28T23:07:25.226 INFO:tasks.workunit.client.1.smithi184.stdout:4/259: write d1/d8/d37/d49/f4f [275487,42849] 0 2024-02-28T23:07:25.227 INFO:tasks.workunit.client.0.smithi159.stdout:7/560: rmdir d5/d56/db8 0 2024-02-28T23:07:25.227 INFO:tasks.workunit.client.1.smithi184.stdout:6/232: write dc/de/d10/d16/f34 [96260,98826] 0 2024-02-28T23:07:25.228 INFO:tasks.workunit.client.1.smithi184.stdout:6/233: chown c9 354363328 1 2024-02-28T23:07:25.229 INFO:tasks.workunit.client.0.smithi159.stdout:7/561: chown d5/d56/d50/f53 32579 1 2024-02-28T23:07:25.229 INFO:tasks.workunit.client.1.smithi184.stdout:4/260: write d1/dc/df/f31 [1091791,14986] 0 2024-02-28T23:07:25.230 INFO:tasks.workunit.client.0.smithi159.stdout:7/562: readlink d5/d56/d2a/l2c 0 2024-02-28T23:07:25.237 INFO:tasks.workunit.client.1.smithi184.stdout:8/267: unlink d1/l3 0 2024-02-28T23:07:25.238 INFO:tasks.workunit.client.0.smithi159.stdout:5/648: chown d8/c12 1389234 1 2024-02-28T23:07:25.238 INFO:tasks.workunit.client.0.smithi159.stdout:2/602: dread d9/d23/d2c/f4a [0,4194304] 0 2024-02-28T23:07:25.240 INFO:tasks.workunit.client.1.smithi184.stdout:5/260: dwrite db/d12/d1c/f3a [0,4194304] 0 2024-02-28T23:07:25.240 INFO:tasks.workunit.client.1.smithi184.stdout:3/273: rename d1/d4/d6/d1e/f37 to d1/d4/d6/d1f/d45/f50 0 2024-02-28T23:07:25.249 INFO:tasks.workunit.client.0.smithi159.stdout:1/639: getdents d6/d1d/d46/d88/dd3/d63 0 2024-02-28T23:07:25.250 INFO:tasks.workunit.client.0.smithi159.stdout:5/649: dread d8/fa2 [0,4194304] 0 2024-02-28T23:07:25.251 INFO:tasks.workunit.client.1.smithi184.stdout:4/261: creat d1/dc/df/d38/f53 x:0 0 0 2024-02-28T23:07:25.252 INFO:tasks.workunit.client.0.smithi159.stdout:1/640: chown d6/d12/d31/d69/l61 1549373 1 2024-02-28T23:07:25.253 INFO:tasks.workunit.client.1.smithi184.stdout:4/262: fsync d1/d8/d35/f47 0 2024-02-28T23:07:25.253 INFO:tasks.workunit.client.1.smithi184.stdout:1/322: link l7 d20/d32/d51/l6d 0 2024-02-28T23:07:25.256 INFO:tasks.workunit.client.0.smithi159.stdout:4/763: rename d9/d4c/cf1 to d9/da/d1c/d23/d2d/c10f 0 2024-02-28T23:07:25.257 INFO:tasks.workunit.client.0.smithi159.stdout:8/783: dwrite d2/d11/d35/fcc [0,4194304] 0 2024-02-28T23:07:25.259 INFO:tasks.workunit.client.0.smithi159.stdout:8/784: chown d2/d11/f1b 45 1 2024-02-28T23:07:25.260 INFO:tasks.workunit.client.1.smithi184.stdout:0/274: mkdir d0/df/d13/d27/d58 0 2024-02-28T23:07:25.260 INFO:tasks.workunit.client.1.smithi184.stdout:9/270: sync 2024-02-28T23:07:25.261 INFO:tasks.workunit.client.1.smithi184.stdout:9/271: chown d5/db/d5c/d5e 8 1 2024-02-28T23:07:25.264 INFO:tasks.workunit.client.0.smithi159.stdout:2/603: creat d9/d36/fd2 x:0 0 0 2024-02-28T23:07:25.265 INFO:tasks.workunit.client.1.smithi184.stdout:5/261: fdatasync db/d44/f4c 0 2024-02-28T23:07:25.266 INFO:tasks.workunit.client.1.smithi184.stdout:5/262: chown db/d1f/d32/f33 11684 1 2024-02-28T23:07:25.267 INFO:tasks.workunit.client.1.smithi184.stdout:2/263: rename d10/d1f/d21/f37 to d10/d1f/d38/d54/f59 0 2024-02-28T23:07:25.267 INFO:tasks.workunit.client.1.smithi184.stdout:5/263: chown db/d1f/d32/f33 39 1 2024-02-28T23:07:25.270 INFO:tasks.workunit.client.1.smithi184.stdout:3/274: creat d1/d4/d6/f51 x:0 0 0 2024-02-28T23:07:25.274 INFO:tasks.workunit.client.0.smithi159.stdout:7/563: symlink d5/d16/d1a/d27/d95/lba 0 2024-02-28T23:07:25.275 INFO:tasks.workunit.client.0.smithi159.stdout:6/632: write d0/f2b [2115399,58198] 0 2024-02-28T23:07:25.279 INFO:tasks.workunit.client.0.smithi159.stdout:6/633: readlink d0/d1b/d33/l79 0 2024-02-28T23:07:25.279 INFO:tasks.workunit.client.0.smithi159.stdout:9/673: dwrite d4/fe [4194304,4194304] 0 2024-02-28T23:07:25.281 INFO:tasks.workunit.client.1.smithi184.stdout:4/263: symlink d1/d8/d19/l54 0 2024-02-28T23:07:25.287 INFO:tasks.workunit.client.1.smithi184.stdout:1/323: dwrite ff [0,4194304] 0 2024-02-28T23:07:25.289 INFO:tasks.workunit.client.1.smithi184.stdout:1/324: dread - d20/d32/d51/f5e zero size 2024-02-28T23:07:25.296 INFO:tasks.workunit.client.0.smithi159.stdout:9/674: write d4/d76/fa8 [1179166,77378] 0 2024-02-28T23:07:25.296 INFO:tasks.workunit.client.0.smithi159.stdout:3/627: rename d0/d2b/d55/d75/d6d/fb0 to d0/d6/d3e/d2f/d78/fc6 0 2024-02-28T23:07:25.296 INFO:tasks.workunit.client.1.smithi184.stdout:7/250: sync 2024-02-28T23:07:25.297 INFO:tasks.workunit.client.1.smithi184.stdout:9/272: fdatasync d5/db/f1f 0 2024-02-28T23:07:25.297 INFO:tasks.workunit.client.1.smithi184.stdout:8/268: creat d1/da/d10/d17/d63/f68 x:0 0 0 2024-02-28T23:07:25.297 INFO:tasks.workunit.client.1.smithi184.stdout:2/264: truncate d10/f14 4929151 0 2024-02-28T23:07:25.297 INFO:tasks.workunit.client.1.smithi184.stdout:9/273: fsync d5/db/de/d10/f18 0 2024-02-28T23:07:25.299 INFO:tasks.workunit.client.1.smithi184.stdout:7/251: write d6/d9/d13/d1e/d2f/d34/d47/f55 [640956,55180] 0 2024-02-28T23:07:25.299 INFO:tasks.workunit.client.0.smithi159.stdout:0/784: creat d0/d5/d14/f113 x:0 0 0 2024-02-28T23:07:25.299 INFO:tasks.workunit.client.0.smithi159.stdout:1/641: mknod d6/d12/d33/cd5 0 2024-02-28T23:07:25.301 INFO:tasks.workunit.client.1.smithi184.stdout:8/269: read d1/da/dc/d16/d32/f46 [469335,6212] 0 2024-02-28T23:07:25.302 INFO:tasks.workunit.client.0.smithi159.stdout:3/628: dread - d0/d2b/d55/d6e/fb6 zero size 2024-02-28T23:07:25.302 INFO:tasks.workunit.client.1.smithi184.stdout:4/264: dread d1/dc/f23 [0,4194304] 0 2024-02-28T23:07:25.303 INFO:tasks.workunit.client.0.smithi159.stdout:7/564: dwrite d5/f1e [4194304,4194304] 0 2024-02-28T23:07:25.304 INFO:tasks.workunit.client.1.smithi184.stdout:4/265: write d1/d8/f4a [310006,77406] 0 2024-02-28T23:07:25.304 INFO:tasks.workunit.client.0.smithi159.stdout:5/650: creat d8/d19/d23/fdb x:0 0 0 2024-02-28T23:07:25.305 INFO:tasks.workunit.client.0.smithi159.stdout:1/642: stat d6/d1d/d46/d88/dd3/d9c/db3 0 2024-02-28T23:07:25.305 INFO:tasks.workunit.client.0.smithi159.stdout:0/785: mkdir d0/d5/d14/d34/d6c/daf/d114 0 2024-02-28T23:07:25.306 INFO:tasks.workunit.client.1.smithi184.stdout:4/266: read d1/d8/d37/f4c [4165382,45259] 0 2024-02-28T23:07:25.307 INFO:tasks.workunit.client.0.smithi159.stdout:3/629: write d0/d47/fbc [6088765,38971] 0 2024-02-28T23:07:25.311 INFO:tasks.workunit.client.0.smithi159.stdout:6/634: link d0/d1b/f3c d0/d1b/fcb 0 2024-02-28T23:07:25.311 INFO:tasks.workunit.client.1.smithi184.stdout:0/275: creat d0/df/d13/d27/d31/d51/f59 x:0 0 0 2024-02-28T23:07:25.313 INFO:tasks.workunit.client.0.smithi159.stdout:3/630: chown d0/d2b/d55/d75/d6d/d54/d7c/d79/f9f 127288 1 2024-02-28T23:07:25.316 INFO:tasks.workunit.client.0.smithi159.stdout:7/565: unlink d5/d16/d1a/d27/d3e/f7c 0 2024-02-28T23:07:25.316 INFO:tasks.workunit.client.1.smithi184.stdout:2/265: symlink d10/d13/d15/d24/l5a 0 2024-02-28T23:07:25.319 INFO:tasks.workunit.client.0.smithi159.stdout:7/566: truncate d5/d16/d1a/d27/d46/d65/fb7 831062 0 2024-02-28T23:07:25.321 INFO:tasks.workunit.client.1.smithi184.stdout:3/275: link d1/d4/d6/d1f/d26/f29 d1/d4/d1c/f52 0 2024-02-28T23:07:25.322 INFO:tasks.workunit.client.0.smithi159.stdout:0/786: readlink d0/de/d75/l51 0 2024-02-28T23:07:25.324 INFO:tasks.workunit.client.0.smithi159.stdout:1/643: mknod d6/d1d/d46/d88/dd3/d9c/db3/dc4/cd6 0 2024-02-28T23:07:25.330 INFO:tasks.workunit.client.1.smithi184.stdout:6/234: truncate dc/de/d10/f4c 606043 0 2024-02-28T23:07:25.330 INFO:tasks.workunit.client.1.smithi184.stdout:7/252: mknod d6/d9/da/c5f 0 2024-02-28T23:07:25.331 INFO:tasks.workunit.client.1.smithi184.stdout:7/253: stat d6/d9/da/dc/d49/f4f 0 2024-02-28T23:07:25.333 INFO:tasks.workunit.client.0.smithi159.stdout:8/785: dread d2/f75 [0,4194304] 0 2024-02-28T23:07:25.333 INFO:tasks.workunit.client.0.smithi159.stdout:4/764: write d9/da/f47 [3385735,43073] 0 2024-02-28T23:07:25.334 INFO:tasks.workunit.client.1.smithi184.stdout:7/254: truncate d6/d9/d13/f28 1085069 0 2024-02-28T23:07:25.335 INFO:tasks.workunit.client.1.smithi184.stdout:1/325: creat d20/d32/d4d/f6e x:0 0 0 2024-02-28T23:07:25.336 INFO:tasks.workunit.client.1.smithi184.stdout:1/326: dread - d20/f49 zero size 2024-02-28T23:07:25.337 INFO:tasks.workunit.client.0.smithi159.stdout:3/631: creat d0/d6/d3e/d2f/d78/fc7 x:0 0 0 2024-02-28T23:07:25.338 INFO:tasks.workunit.client.1.smithi184.stdout:8/270: creat d1/da/d10/d17/d63/f69 x:0 0 0 2024-02-28T23:07:25.339 INFO:tasks.workunit.client.0.smithi159.stdout:3/632: dread - d0/d2b/fb9 zero size 2024-02-28T23:07:25.340 INFO:tasks.workunit.client.0.smithi159.stdout:6/635: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:25.346 INFO:tasks.workunit.client.1.smithi184.stdout:4/267: mknod d1/dc/df/d27/d34/c55 0 2024-02-28T23:07:25.347 INFO:tasks.workunit.client.0.smithi159.stdout:7/567: symlink d5/d16/d1a/d27/d75/lbb 0 2024-02-28T23:07:25.347 INFO:tasks.workunit.client.0.smithi159.stdout:9/675: truncate d4/f3c 3909240 0 2024-02-28T23:07:25.347 INFO:tasks.workunit.client.1.smithi184.stdout:4/268: chown d1 1357 1 2024-02-28T23:07:25.350 INFO:tasks.workunit.client.1.smithi184.stdout:0/276: mkdir d0/df/d13/d5a 0 2024-02-28T23:07:25.352 INFO:tasks.workunit.client.1.smithi184.stdout:7/255: dwrite d6/d9/f4e [0,4194304] 0 2024-02-28T23:07:25.352 INFO:tasks.workunit.client.1.smithi184.stdout:4/269: read d1/dc/df/f31 [774529,33205] 0 2024-02-28T23:07:25.354 INFO:tasks.workunit.client.0.smithi159.stdout:5/651: write d8/d16/f1a [2010162,3370] 0 2024-02-28T23:07:25.355 INFO:tasks.workunit.client.1.smithi184.stdout:2/266: creat d10/d13/d15/f5b x:0 0 0 2024-02-28T23:07:25.355 INFO:tasks.workunit.client.1.smithi184.stdout:8/271: dwrite d1/da/dc/d16/f25 [0,4194304] 0 2024-02-28T23:07:25.358 INFO:tasks.workunit.client.0.smithi159.stdout:4/765: dread d9/d42/f60 [0,4194304] 0 2024-02-28T23:07:25.359 INFO:tasks.workunit.client.1.smithi184.stdout:2/267: stat d10/d33/l4e 0 2024-02-28T23:07:25.360 INFO:tasks.workunit.client.1.smithi184.stdout:2/268: truncate d10/f18 759117 0 2024-02-28T23:07:25.360 INFO:tasks.workunit.client.0.smithi159.stdout:4/766: write d9/d42/db1/fb4 [649571,46248] 0 2024-02-28T23:07:25.368 INFO:tasks.workunit.client.1.smithi184.stdout:6/235: rmdir dc/de/d2a 39 2024-02-28T23:07:25.369 INFO:tasks.workunit.client.1.smithi184.stdout:9/274: rename d5/d26/l5d to d5/d17/d43/l5f 0 2024-02-28T23:07:25.370 INFO:tasks.workunit.client.1.smithi184.stdout:1/327: unlink fe 0 2024-02-28T23:07:25.374 INFO:tasks.workunit.client.0.smithi159.stdout:7/568: rename d5/d16/d1a/d27/d3e/ca3 to d5/d16/d1a/d27/d95/cbc 0 2024-02-28T23:07:25.378 INFO:tasks.workunit.client.0.smithi159.stdout:1/644: write d6/d1d/fc7 [1350855,39372] 0 2024-02-28T23:07:25.378 INFO:tasks.workunit.client.0.smithi159.stdout:3/633: creat d0/d47/dc2/fc8 x:0 0 0 2024-02-28T23:07:25.384 INFO:tasks.workunit.client.0.smithi159.stdout:6/636: dread d0/d1b/f3c [0,4194304] 0 2024-02-28T23:07:25.384 INFO:tasks.workunit.client.0.smithi159.stdout:0/787: dwrite d0/de/d75/d5f/f6b [0,4194304] 0 2024-02-28T23:07:25.386 INFO:tasks.workunit.client.0.smithi159.stdout:4/767: mknod d9/d42/dc8/c110 0 2024-02-28T23:07:25.386 INFO:tasks.workunit.client.0.smithi159.stdout:8/786: dread d2/d11/d52/d26/f4c [0,4194304] 0 2024-02-28T23:07:25.387 INFO:tasks.workunit.client.0.smithi159.stdout:0/788: write d0/d5/d38/ff6 [709793,110733] 0 2024-02-28T23:07:25.390 INFO:tasks.workunit.client.0.smithi159.stdout:0/789: stat d0/d5/d14/d34/d3d/c109 0 2024-02-28T23:07:25.391 INFO:tasks.workunit.client.1.smithi184.stdout:5/264: getdents db/d12/d18 0 2024-02-28T23:07:25.392 INFO:tasks.workunit.client.1.smithi184.stdout:5/265: stat db/d1f/c51 0 2024-02-28T23:07:25.393 INFO:tasks.workunit.client.1.smithi184.stdout:5/266: chown db/d12 0 1 2024-02-28T23:07:25.395 INFO:tasks.workunit.client.0.smithi159.stdout:3/634: creat d0/d47/dc2/fc9 x:0 0 0 2024-02-28T23:07:25.396 INFO:tasks.workunit.client.1.smithi184.stdout:5/267: read - db/d12/d1c/d21/d2f/f4e zero size 2024-02-28T23:07:25.398 INFO:tasks.workunit.client.1.smithi184.stdout:5/268: truncate db/d12/f47 111454 0 2024-02-28T23:07:25.398 INFO:tasks.workunit.client.1.smithi184.stdout:4/270: mkdir d1/d8/d19/d56 0 2024-02-28T23:07:25.400 INFO:tasks.workunit.client.1.smithi184.stdout:7/256: symlink d6/d9/d13/d3e/l60 0 2024-02-28T23:07:25.402 INFO:tasks.workunit.client.1.smithi184.stdout:8/272: mknod d1/da/dc/c6a 0 2024-02-28T23:07:25.403 INFO:tasks.workunit.client.0.smithi159.stdout:9/676: write d4/f25 [204053,41586] 0 2024-02-28T23:07:25.404 INFO:tasks.workunit.client.1.smithi184.stdout:8/273: chown d1/da/df/c3d 7 1 2024-02-28T23:07:25.405 INFO:tasks.workunit.client.1.smithi184.stdout:3/276: link d1/d4/d6/d1f/f2b d1/d4/d6/f53 0 2024-02-28T23:07:25.406 INFO:tasks.workunit.client.1.smithi184.stdout:3/277: readlink d1/d4/d6/d1e/l44 0 2024-02-28T23:07:25.406 INFO:tasks.workunit.client.1.smithi184.stdout:2/269: creat d10/d1f/d38/f5c x:0 0 0 2024-02-28T23:07:25.410 INFO:tasks.workunit.client.1.smithi184.stdout:4/271: dread d1/d8/d37/d49/f4f [0,4194304] 0 2024-02-28T23:07:25.410 INFO:tasks.workunit.client.1.smithi184.stdout:6/236: read dc/fd [6666362,111331] 0 2024-02-28T23:07:25.411 INFO:tasks.workunit.client.1.smithi184.stdout:9/275: creat d5/d17/d43/f60 x:0 0 0 2024-02-28T23:07:25.412 INFO:tasks.workunit.client.0.smithi159.stdout:8/787: creat d2/d11/d52/d26/d36/d38/ff3 x:0 0 0 2024-02-28T23:07:25.413 INFO:tasks.workunit.client.0.smithi159.stdout:7/569: dwrite d5/d16/f5f [0,4194304] 0 2024-02-28T23:07:25.413 INFO:tasks.workunit.client.1.smithi184.stdout:1/328: mkdir d20/d46/d6f 0 2024-02-28T23:07:25.414 INFO:tasks.workunit.client.1.smithi184.stdout:9/276: chown d5/db/de/d10/d12/f54 194327 1 2024-02-28T23:07:25.415 INFO:tasks.workunit.client.1.smithi184.stdout:1/329: write d20/f25 [7144421,6119] 0 2024-02-28T23:07:25.416 INFO:tasks.workunit.client.0.smithi159.stdout:3/635: rmdir d0/d47/d88 39 2024-02-28T23:07:25.416 INFO:tasks.workunit.client.1.smithi184.stdout:0/277: dwrite d0/df/d13/f1a [4194304,4194304] 0 2024-02-28T23:07:25.418 INFO:tasks.workunit.client.0.smithi159.stdout:3/636: dread - d0/d2b/d55/d6e/fb6 zero size 2024-02-28T23:07:25.419 INFO:tasks.workunit.client.1.smithi184.stdout:0/278: fdatasync d0/d1d/f3d 0 2024-02-28T23:07:25.420 INFO:tasks.workunit.client.1.smithi184.stdout:0/279: fsync d0/d1d/f4d 0 2024-02-28T23:07:25.420 INFO:tasks.workunit.client.1.smithi184.stdout:5/269: unlink l9 0 2024-02-28T23:07:25.428 INFO:tasks.workunit.client.0.smithi159.stdout:4/768: symlink d9/da/d1c/l111 0 2024-02-28T23:07:25.433 INFO:tasks.workunit.client.1.smithi184.stdout:2/270: mknod d10/d33/c5d 0 2024-02-28T23:07:25.433 INFO:tasks.workunit.client.1.smithi184.stdout:3/278: write d1/d4/d1c/f27 [361056,2029] 0 2024-02-28T23:07:25.435 INFO:tasks.workunit.client.0.smithi159.stdout:7/570: stat d5/f3d 0 2024-02-28T23:07:25.436 INFO:tasks.workunit.client.1.smithi184.stdout:4/272: mkdir d1/dc/df/d38/d57 0 2024-02-28T23:07:25.441 INFO:tasks.workunit.client.1.smithi184.stdout:9/277: symlink d5/db/de/d10/d12/d2f/l61 0 2024-02-28T23:07:25.445 INFO:tasks.workunit.client.0.smithi159.stdout:3/637: write d0/d6/d34/f41 [1751740,54483] 0 2024-02-28T23:07:25.447 INFO:tasks.workunit.client.0.smithi159.stdout:3/638: fsync d0/fac 0 2024-02-28T23:07:25.447 INFO:tasks.workunit.client.1.smithi184.stdout:5/270: mknod db/d12/d18/d2e/c57 0 2024-02-28T23:07:25.448 INFO:tasks.workunit.client.0.smithi159.stdout:4/769: symlink d9/da/d1c/d23/d2d/d59/l112 0 2024-02-28T23:07:25.451 INFO:tasks.workunit.client.1.smithi184.stdout:0/280: write d0/df/d13/f3e [2144079,45831] 0 2024-02-28T23:07:25.451 INFO:tasks.workunit.client.0.smithi159.stdout:6/637: rmdir d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dc8 0 2024-02-28T23:07:25.452 INFO:tasks.workunit.client.1.smithi184.stdout:0/281: fdatasync d0/df/d13/f29 0 2024-02-28T23:07:25.452 INFO:tasks.workunit.client.0.smithi159.stdout:9/677: truncate d4/d76/fa8 195598 0 2024-02-28T23:07:25.455 INFO:tasks.workunit.client.1.smithi184.stdout:7/257: creat d6/d9/da/dc/d49/d50/f61 x:0 0 0 2024-02-28T23:07:25.456 INFO:tasks.workunit.client.0.smithi159.stdout:7/571: unlink d5/d56/d50/d5b/f7b 0 2024-02-28T23:07:25.457 INFO:tasks.workunit.client.0.smithi159.stdout:7/572: stat d5/d16/d40/l4f 0 2024-02-28T23:07:25.458 INFO:tasks.workunit.client.1.smithi184.stdout:8/274: mkdir d1/da/d10/d6b 0 2024-02-28T23:07:25.459 INFO:tasks.workunit.client.1.smithi184.stdout:8/275: write d1/da/dc/d16/d32/d42/f61 [1870693,102373] 0 2024-02-28T23:07:25.462 INFO:tasks.workunit.client.1.smithi184.stdout:8/276: fdatasync d1/da/d10/d17/d63/f69 0 2024-02-28T23:07:25.462 INFO:tasks.workunit.client.1.smithi184.stdout:2/271: rmdir d10 39 2024-02-28T23:07:25.466 INFO:tasks.workunit.client.0.smithi159.stdout:1/645: link d6/d12/d33/c5c d6/d1d/d46/d88/dd3/d9c/db3/dc4/dc6/cd7 0 2024-02-28T23:07:25.467 INFO:tasks.workunit.client.1.smithi184.stdout:0/282: dwrite d0/df/d13/f29 [0,4194304] 0 2024-02-28T23:07:25.469 INFO:tasks.workunit.client.1.smithi184.stdout:3/279: creat d1/d4/d6/d1f/d45/f54 x:0 0 0 2024-02-28T23:07:25.472 INFO:tasks.workunit.client.0.smithi159.stdout:8/788: dwrite d2/d73/dc2/fac [0,4194304] 0 2024-02-28T23:07:25.474 INFO:tasks.workunit.client.0.smithi159.stdout:4/770: stat d9/d20/c51 0 2024-02-28T23:07:25.476 INFO:tasks.workunit.client.0.smithi159.stdout:4/771: stat d9/d42/d54/d55/ce5 0 2024-02-28T23:07:25.482 INFO:tasks.workunit.client.1.smithi184.stdout:6/237: dwrite dc/de/d2a/f2b [0,4194304] 0 2024-02-28T23:07:25.483 INFO:tasks.workunit.client.0.smithi159.stdout:9/678: mknod d4/d76/cd3 0 2024-02-28T23:07:25.484 INFO:tasks.workunit.client.1.smithi184.stdout:5/271: unlink db/l52 0 2024-02-28T23:07:25.485 INFO:tasks.workunit.client.0.smithi159.stdout:7/573: mknod d5/d16/d1a/d27/d46/d65/cbd 0 2024-02-28T23:07:25.486 INFO:tasks.workunit.client.0.smithi159.stdout:0/790: link d0/de/l20 d0/d5/d38/d63/dad/l115 0 2024-02-28T23:07:25.492 INFO:tasks.workunit.client.1.smithi184.stdout:2/272: write d10/d1f/d38/f5c [69930,119329] 0 2024-02-28T23:07:25.492 INFO:tasks.workunit.client.1.smithi184.stdout:8/277: rmdir d1 39 2024-02-28T23:07:25.493 INFO:tasks.workunit.client.1.smithi184.stdout:4/273: dwrite d1/dc/df/f14 [0,4194304] 0 2024-02-28T23:07:25.496 INFO:tasks.workunit.client.1.smithi184.stdout:0/283: unlink d0/df/d13/d27/d2b/f4e 0 2024-02-28T23:07:25.496 INFO:tasks.workunit.client.1.smithi184.stdout:4/274: chown d1/dc/df/d22/d51 0 1 2024-02-28T23:07:25.498 INFO:tasks.workunit.client.0.smithi159.stdout:4/772: mknod d9/d4c/d6c/d98/c113 0 2024-02-28T23:07:25.500 INFO:tasks.workunit.client.1.smithi184.stdout:4/275: write d1/d8/d35/f47 [874968,5328] 0 2024-02-28T23:07:25.500 INFO:tasks.workunit.client.1.smithi184.stdout:9/278: symlink d5/db/l62 0 2024-02-28T23:07:25.500 INFO:tasks.workunit.client.0.smithi159.stdout:3/639: link d0/d2b/d55/d75/d6d/f2d d0/d2b/d55/d75/d6d/fca 0 2024-02-28T23:07:25.504 INFO:tasks.workunit.client.0.smithi159.stdout:6/638: creat d0/d1b/dc4/fcc x:0 0 0 2024-02-28T23:07:25.505 INFO:tasks.workunit.client.1.smithi184.stdout:1/330: rmdir d20/d46/d6f 0 2024-02-28T23:07:25.506 INFO:tasks.workunit.client.0.smithi159.stdout:8/789: truncate d2/d11/d52/d26/f5a 4718939 0 2024-02-28T23:07:25.509 INFO:tasks.workunit.client.0.smithi159.stdout:9/679: creat d4/d3d/d3e/d6e/fd4 x:0 0 0 2024-02-28T23:07:25.512 INFO:tasks.workunit.client.0.smithi159.stdout:6/639: truncate d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/fb4 4257536 0 2024-02-28T23:07:25.515 INFO:tasks.workunit.client.0.smithi159.stdout:0/791: symlink d0/d5/d38/d63/l116 0 2024-02-28T23:07:25.519 INFO:tasks.workunit.client.0.smithi159.stdout:0/792: chown d0/d5/d14/d78/da8/fb1 57 1 2024-02-28T23:07:25.519 INFO:tasks.workunit.client.0.smithi159.stdout:8/790: rename d2/d73/faf to d2/d3/ff4 0 2024-02-28T23:07:25.521 INFO:tasks.workunit.client.0.smithi159.stdout:4/773: dwrite d9/da/d1c/d23/f4d [4194304,4194304] 0 2024-02-28T23:07:25.521 INFO:tasks.workunit.client.1.smithi184.stdout:0/284: mkdir d0/df/d13/d27/d31/d5b 0 2024-02-28T23:07:25.521 INFO:tasks.workunit.client.0.smithi159.stdout:8/791: write d2/fd [4925720,36631] 0 2024-02-28T23:07:25.523 INFO:tasks.workunit.client.0.smithi159.stdout:7/574: mkdir d5/d16/d1a/d27/d75/dac/dbe 0 2024-02-28T23:07:25.524 INFO:tasks.workunit.client.1.smithi184.stdout:0/285: truncate d0/f37 1716380 0 2024-02-28T23:07:25.524 INFO:tasks.workunit.client.0.smithi159.stdout:1/646: mkdir d6/d12/d1a/d92/d97/dd8 0 2024-02-28T23:07:25.525 INFO:tasks.workunit.client.1.smithi184.stdout:4/276: dread d1/d8/d35/f47 [0,4194304] 0 2024-02-28T23:07:25.526 INFO:tasks.workunit.client.1.smithi184.stdout:7/258: dwrite d6/d9/da/dc/f2b [0,4194304] 0 2024-02-28T23:07:25.528 INFO:tasks.workunit.client.1.smithi184.stdout:6/238: dwrite f3 [0,4194304] 0 2024-02-28T23:07:25.529 INFO:tasks.workunit.client.0.smithi159.stdout:1/647: chown d6/d1d/d46/d88/dd3/d9c/db3/dc4/dc6 58131964 1 2024-02-28T23:07:25.532 INFO:tasks.workunit.client.1.smithi184.stdout:1/331: symlink d20/d46/l70 0 2024-02-28T23:07:25.533 INFO:tasks.workunit.client.1.smithi184.stdout:2/273: stat d10/d13/d15/d24/f22 0 2024-02-28T23:07:25.535 INFO:tasks.workunit.client.0.smithi159.stdout:6/640: creat d0/d1b/d33/d3f/fcd x:0 0 0 2024-02-28T23:07:25.536 INFO:tasks.workunit.client.0.smithi159.stdout:9/680: dwrite d4/d3d/d3e/d55/d9e/db3/dc1/fc4 [0,4194304] 0 2024-02-28T23:07:25.538 INFO:tasks.workunit.client.0.smithi159.stdout:0/793: mkdir d0/de/de7/d117 0 2024-02-28T23:07:25.548 INFO:tasks.workunit.client.0.smithi159.stdout:4/774: fdatasync d9/d42/f60 0 2024-02-28T23:07:25.550 INFO:tasks.workunit.client.0.smithi159.stdout:3/640: creat d0/d47/fcb x:0 0 0 2024-02-28T23:07:25.552 INFO:tasks.workunit.client.1.smithi184.stdout:8/278: truncate d1/da/df/f1f 749005 0 2024-02-28T23:07:25.554 INFO:tasks.workunit.client.0.smithi159.stdout:8/792: truncate d2/d11/d52/d26/fa7 1765673 0 2024-02-28T23:07:25.557 INFO:tasks.workunit.client.1.smithi184.stdout:5/272: dwrite db/d12/d18/d2e/f36 [0,4194304] 0 2024-02-28T23:07:25.558 INFO:tasks.workunit.client.0.smithi159.stdout:7/575: mknod d5/d16/d1a/d27/d46/d65/d81/d83/cbf 0 2024-02-28T23:07:25.560 INFO:tasks.workunit.client.1.smithi184.stdout:0/286: creat d0/df/d13/d27/d2b/f5c x:0 0 0 2024-02-28T23:07:25.560 INFO:tasks.workunit.client.1.smithi184.stdout:0/287: write d0/d1f/f43 [684287,65359] 0 2024-02-28T23:07:25.560 INFO:tasks.workunit.client.1.smithi184.stdout:5/273: write db/d12/d1c/d21/d2f/f55 [745722,56928] 0 2024-02-28T23:07:25.560 INFO:tasks.workunit.client.0.smithi159.stdout:1/648: dwrite d6/d12/d1a/d92/f9d [0,4194304] 0 2024-02-28T23:07:25.561 INFO:tasks.workunit.client.1.smithi184.stdout:7/259: creat d6/d9/d13/d1e/d2f/f62 x:0 0 0 2024-02-28T23:07:25.562 INFO:tasks.workunit.client.0.smithi159.stdout:6/641: mknod d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/cce 0 2024-02-28T23:07:25.564 INFO:tasks.workunit.client.1.smithi184.stdout:7/260: chown d6/d9/d13/d1e/d2f/d33/d5b 79 1 2024-02-28T23:07:25.569 INFO:tasks.workunit.client.1.smithi184.stdout:1/332: creat d20/d32/d51/f71 x:0 0 0 2024-02-28T23:07:25.569 INFO:tasks.workunit.client.1.smithi184.stdout:2/274: readlink d10/d13/d15/l49 0 2024-02-28T23:07:25.570 INFO:tasks.workunit.client.1.smithi184.stdout:1/333: chown d20/l65 27517394 1 2024-02-28T23:07:25.571 INFO:tasks.workunit.client.1.smithi184.stdout:1/334: write d20/d32/d51/f55 [2508741,8679] 0 2024-02-28T23:07:25.572 INFO:tasks.workunit.client.1.smithi184.stdout:3/280: getdents d1/d4/d5/d40 0 2024-02-28T23:07:25.575 INFO:tasks.workunit.client.1.smithi184.stdout:9/279: link d5/c4b d5/db/de/c63 0 2024-02-28T23:07:25.577 INFO:tasks.workunit.client.1.smithi184.stdout:9/280: dread - d5/db/de/d10/f30 zero size 2024-02-28T23:07:25.581 INFO:tasks.workunit.client.0.smithi159.stdout:8/793: symlink d2/d3/d8c/lf5 0 2024-02-28T23:07:25.584 INFO:tasks.workunit.client.0.smithi159.stdout:6/642: fsync d0/d1b/f3c 0 2024-02-28T23:07:25.585 INFO:tasks.workunit.client.0.smithi159.stdout:7/576: dwrite d5/d16/d1a/d27/d46/d65/d81/d83/f8a [0,4194304] 0 2024-02-28T23:07:25.590 INFO:tasks.workunit.client.1.smithi184.stdout:0/288: symlink d0/d1d/l5d 0 2024-02-28T23:07:25.591 INFO:tasks.workunit.client.0.smithi159.stdout:6/643: truncate d0/d1b/dc4/fcc 710655 0 2024-02-28T23:07:25.592 INFO:tasks.workunit.client.1.smithi184.stdout:5/274: mknod db/d12/d1c/d21/d2f/c58 0 2024-02-28T23:07:25.593 INFO:tasks.workunit.client.0.smithi159.stdout:3/641: write d0/d2b/d55/d75/d6d/d54/d7c/d79/d9b/fa7 [2964221,87601] 0 2024-02-28T23:07:25.597 INFO:tasks.workunit.client.1.smithi184.stdout:5/275: chown db/d12/d1c/d21/c53 1682 1 2024-02-28T23:07:25.599 INFO:tasks.workunit.client.1.smithi184.stdout:7/261: rmdir d6/d9/d13/d3e 39 2024-02-28T23:07:25.601 INFO:tasks.workunit.client.1.smithi184.stdout:2/275: readlink l3 0 2024-02-28T23:07:25.603 INFO:tasks.workunit.client.0.smithi159.stdout:9/681: dread d4/f30 [0,4194304] 0 2024-02-28T23:07:25.606 INFO:tasks.workunit.client.1.smithi184.stdout:3/281: fdatasync d1/d4/d6/d1f/d26/f29 0 2024-02-28T23:07:25.606 INFO:tasks.workunit.client.1.smithi184.stdout:6/239: dread dc/de/d10/f43 [0,4194304] 0 2024-02-28T23:07:25.608 INFO:tasks.workunit.client.1.smithi184.stdout:3/282: dread - d1/d4/d6/d1f/f33 zero size 2024-02-28T23:07:25.609 INFO:tasks.workunit.client.1.smithi184.stdout:9/281: mkdir d5/db/de/d64 0 2024-02-28T23:07:25.611 INFO:tasks.workunit.client.1.smithi184.stdout:9/282: dread - d5/db/de/d10/d12/f54 zero size 2024-02-28T23:07:25.612 INFO:tasks.workunit.client.1.smithi184.stdout:4/277: link d1/l2d d1/d8/d3d/d44/l58 0 2024-02-28T23:07:25.614 INFO:tasks.workunit.client.1.smithi184.stdout:9/283: write d5/db/de/d10/f18 [612945,92997] 0 2024-02-28T23:07:25.614 INFO:tasks.workunit.client.0.smithi159.stdout:1/649: truncate d6/f9 1347195 0 2024-02-28T23:07:25.616 INFO:tasks.workunit.client.1.smithi184.stdout:0/289: mknod d0/d1d/c5e 0 2024-02-28T23:07:25.618 INFO:tasks.workunit.client.1.smithi184.stdout:9/284: write d5/db/de/d10/f18 [186320,10356] 0 2024-02-28T23:07:25.618 INFO:tasks.workunit.client.1.smithi184.stdout:0/290: fsync d0/df/f41 0 2024-02-28T23:07:25.618 INFO:tasks.workunit.client.1.smithi184.stdout:2/276: dwrite d10/f1d [0,4194304] 0 2024-02-28T23:07:25.619 INFO:tasks.workunit.client.0.smithi159.stdout:0/794: rename d0/d5/d14/d25/d2c/lda to d0/d5/d14/d34/l118 0 2024-02-28T23:07:25.621 INFO:tasks.workunit.client.1.smithi184.stdout:7/262: mknod d6/d9/da/dc/d49/d50/c63 0 2024-02-28T23:07:25.623 INFO:tasks.workunit.client.0.smithi159.stdout:1/650: creat d6/d12/d16/db6/fd9 x:0 0 0 2024-02-28T23:07:25.623 INFO:tasks.workunit.client.1.smithi184.stdout:7/263: fsync d6/d9/da/dc/d49/f4f 0 2024-02-28T23:07:25.624 INFO:tasks.workunit.client.0.smithi159.stdout:9/682: truncate d4/d3d/d3e/d55/d37/d62/da6/fc2 191173 0 2024-02-28T23:07:25.626 INFO:tasks.workunit.client.0.smithi159.stdout:8/794: rename d2/d11/d52/d6e/da9 to d2/d11/d52/d26/d36/d38/d77/dc5/df6 0 2024-02-28T23:07:25.628 INFO:tasks.workunit.client.1.smithi184.stdout:1/335: dread d20/d32/d51/f55 [0,4194304] 0 2024-02-28T23:07:25.628 INFO:tasks.workunit.client.1.smithi184.stdout:6/240: readlink dc/de/l1a 0 2024-02-28T23:07:25.630 INFO:tasks.workunit.client.0.smithi159.stdout:0/795: creat d0/d5/d38/d63/dd8/f119 x:0 0 0 2024-02-28T23:07:25.631 INFO:tasks.workunit.client.1.smithi184.stdout:8/279: rename d1/da/dc/d18/l21 to d1/da/l6c 0 2024-02-28T23:07:25.631 INFO:tasks.workunit.client.0.smithi159.stdout:7/577: dwrite d5/d16/d1a/d24/f59 [0,4194304] 0 2024-02-28T23:07:25.632 INFO:tasks.workunit.client.1.smithi184.stdout:4/278: rmdir d1/dc 39 2024-02-28T23:07:25.634 INFO:tasks.workunit.client.0.smithi159.stdout:3/642: dwrite d0/d6/d3e/d2f/d78/fc6 [0,4194304] 0 2024-02-28T23:07:25.639 INFO:tasks.workunit.client.0.smithi159.stdout:8/795: mkdir d2/d11/d52/d26/d36/d38/d77/d9e/dc1/df7 0 2024-02-28T23:07:25.641 INFO:tasks.workunit.client.0.smithi159.stdout:8/796: chown d2/c72 24560 1 2024-02-28T23:07:25.646 INFO:tasks.workunit.client.1.smithi184.stdout:7/264: rmdir d6/d9/da/dc/d49/d50 39 2024-02-28T23:07:25.648 INFO:tasks.workunit.client.0.smithi159.stdout:0/796: unlink d0/d5/d14/d25/d5c/c7b 0 2024-02-28T23:07:25.650 INFO:tasks.workunit.client.0.smithi159.stdout:0/797: chown d0/de/de7/d117 13621 1 2024-02-28T23:07:25.651 INFO:tasks.workunit.client.0.smithi159.stdout:7/578: rename d5/d56/d2a/l2c to d5/d16/d1a/d27/d75/dac/dbe/lc0 0 2024-02-28T23:07:25.652 INFO:tasks.workunit.client.0.smithi159.stdout:0/798: chown d0/d5/d14/d34/d6c/d94/cac 3533698 1 2024-02-28T23:07:25.652 INFO:tasks.workunit.client.1.smithi184.stdout:7/265: dread - d6/d9/d13/f57 zero size 2024-02-28T23:07:25.653 INFO:tasks.workunit.client.1.smithi184.stdout:5/276: rename db/d1f/c51 to db/d12/d1c/d21/d2f/c59 0 2024-02-28T23:07:25.654 INFO:tasks.workunit.client.1.smithi184.stdout:7/266: write d6/f19 [318156,595] 0 2024-02-28T23:07:25.656 INFO:tasks.workunit.client.0.smithi159.stdout:6/644: write d0/d1b/d33/d11/d14/f21 [2693905,50606] 0 2024-02-28T23:07:25.658 INFO:tasks.workunit.client.1.smithi184.stdout:7/267: truncate d6/d9/d13/d1e/d2f/d33/f36 346490 0 2024-02-28T23:07:25.658 INFO:tasks.workunit.client.0.smithi159.stdout:8/797: unlink d2/d11/d52/d47/d65/d68/leb 0 2024-02-28T23:07:25.660 INFO:tasks.workunit.client.1.smithi184.stdout:0/291: symlink d0/df/d13/d27/d31/d5b/l5f 0 2024-02-28T23:07:25.661 INFO:tasks.workunit.client.1.smithi184.stdout:7/268: write d6/d9/d13/f57 [22059,86581] 0 2024-02-28T23:07:25.664 INFO:tasks.workunit.client.1.smithi184.stdout:7/269: write d6/d9/da/dc/f1b [2981961,4097] 0 2024-02-28T23:07:25.665 INFO:tasks.workunit.client.1.smithi184.stdout:8/280: symlink d1/da/df/l6d 0 2024-02-28T23:07:25.666 INFO:tasks.workunit.client.0.smithi159.stdout:9/683: getdents d4/d52/d7d 0 2024-02-28T23:07:25.668 INFO:tasks.workunit.client.1.smithi184.stdout:3/283: rename d1/d4/d6/c10 to d1/d4/d5/c55 0 2024-02-28T23:07:25.669 INFO:tasks.workunit.client.0.smithi159.stdout:6/645: dread - d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88/fa8 zero size 2024-02-28T23:07:25.669 INFO:tasks.workunit.client.1.smithi184.stdout:5/277: dread db/d12/d1c/f3a [0,4194304] 0 2024-02-28T23:07:25.670 INFO:tasks.workunit.client.1.smithi184.stdout:3/284: fdatasync d1/d4/f42 0 2024-02-28T23:07:25.671 INFO:tasks.workunit.client.0.smithi159.stdout:6/646: readlink d0/d1b/d33/d11/l40 0 2024-02-28T23:07:25.672 INFO:tasks.workunit.client.0.smithi159.stdout:8/798: creat d2/d11/d74/ddb/ff8 x:0 0 0 2024-02-28T23:07:25.673 INFO:tasks.workunit.client.0.smithi159.stdout:1/651: dread d6/d12/d33/d3c/f4b [0,4194304] 0 2024-02-28T23:07:25.677 INFO:tasks.workunit.client.0.smithi159.stdout:8/799: write d2/d11/d52/d26/d36/d38/d77/d79/dd7/ff0 [245212,39818] 0 2024-02-28T23:07:25.678 INFO:tasks.workunit.client.0.smithi159.stdout:0/799: symlink d0/l11a 0 2024-02-28T23:07:25.679 INFO:tasks.workunit.client.1.smithi184.stdout:1/336: creat d20/f72 x:0 0 0 2024-02-28T23:07:25.682 INFO:tasks.workunit.client.0.smithi159.stdout:9/684: write d4/d3d/d3e/d55/d4c/d4e/d6b/fce [1060003,6442] 0 2024-02-28T23:07:25.685 INFO:tasks.workunit.client.0.smithi159.stdout:6/647: mkdir d0/d1b/d33/d11/d34/d9d/da2/dcf 0 2024-02-28T23:07:25.687 INFO:tasks.workunit.client.1.smithi184.stdout:2/277: rename d10/d13 to d10/d1f/d21/d5e 0 2024-02-28T23:07:25.689 INFO:tasks.workunit.client.1.smithi184.stdout:4/279: dread d1/f12 [0,4194304] 0 2024-02-28T23:07:25.690 INFO:tasks.workunit.client.1.smithi184.stdout:7/270: dwrite d6/d9/da/dc/f3c [0,4194304] 0 2024-02-28T23:07:25.693 INFO:tasks.workunit.client.0.smithi159.stdout:8/800: creat d2/d11/d52/d26/d36/d38/ff9 x:0 0 0 2024-02-28T23:07:25.695 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:25 smithi184 ceph-mon[36198]: pgmap v31: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 55 MiB/s rd, 193 MiB/s wr, 438 op/s 2024-02-28T23:07:25.695 INFO:tasks.workunit.client.0.smithi159.stdout:0/800: mknod d0/d5/d14/d34/d3d/c11b 0 2024-02-28T23:07:25.695 INFO:tasks.workunit.client.0.smithi159.stdout:8/801: truncate d2/f15 2005508 0 2024-02-28T23:07:25.696 INFO:tasks.workunit.client.1.smithi184.stdout:2/278: fdatasync d10/d1f/f41 0 2024-02-28T23:07:25.697 INFO:tasks.workunit.client.0.smithi159.stdout:0/801: dread - d0/d5/d38/d76/d96/fe0 zero size 2024-02-28T23:07:25.698 INFO:tasks.workunit.client.1.smithi184.stdout:7/271: read - d6/f35 zero size 2024-02-28T23:07:25.699 INFO:tasks.workunit.client.1.smithi184.stdout:0/292: dread d0/f17 [0,4194304] 0 2024-02-28T23:07:25.704 INFO:tasks.workunit.client.1.smithi184.stdout:6/241: dwrite dc/de/d10/f4b [0,4194304] 0 2024-02-28T23:07:25.706 INFO:tasks.workunit.client.0.smithi159.stdout:1/652: dread d6/d1d/d46/d88/dd3/f44 [4194304,4194304] 0 2024-02-28T23:07:25.706 INFO:tasks.workunit.client.1.smithi184.stdout:3/285: dread d1/d4/d6/d1f/f2b [0,4194304] 0 2024-02-28T23:07:25.711 INFO:tasks.workunit.client.1.smithi184.stdout:1/337: unlink d20/f22 0 2024-02-28T23:07:25.712 INFO:tasks.workunit.client.0.smithi159.stdout:1/653: dread d6/d12/d33/d3c/f6c [0,4194304] 0 2024-02-28T23:07:25.713 INFO:tasks.workunit.client.1.smithi184.stdout:1/338: readlink d20/d32/d4d/l4f 0 2024-02-28T23:07:25.713 INFO:tasks.workunit.client.1.smithi184.stdout:1/339: fsync ff 0 2024-02-28T23:07:25.715 INFO:tasks.workunit.client.0.smithi159.stdout:0/802: mknod d0/de/de7/c11c 0 2024-02-28T23:07:25.718 INFO:tasks.workunit.client.0.smithi159.stdout:8/802: creat d2/d11/d52/d26/d36/d38/d77/d9e/dc1/dc4/ffa x:0 0 0 2024-02-28T23:07:25.719 INFO:tasks.workunit.client.0.smithi159.stdout:6/648: creat d0/d1b/d33/d11/d14/d49/fd0 x:0 0 0 2024-02-28T23:07:25.725 INFO:tasks.workunit.client.0.smithi159.stdout:8/803: dread - d2/d11/d52/d47/db6/dba/fe7 zero size 2024-02-28T23:07:25.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:25 smithi159 ceph-mon[28802]: pgmap v31: 65 pgs: 65 active+clean; 1.9 GiB data, 5.8 GiB used, 531 GiB / 536 GiB avail; 55 MiB/s rd, 193 MiB/s wr, 438 op/s 2024-02-28T23:07:25.726 INFO:tasks.workunit.client.0.smithi159.stdout:9/685: rmdir d4/d3d/d3e/d4a/dc5/dcd 0 2024-02-28T23:07:25.727 INFO:tasks.workunit.client.1.smithi184.stdout:5/278: unlink db/d12/d1c/d21/d2f/c59 0 2024-02-28T23:07:25.730 INFO:tasks.workunit.client.0.smithi159.stdout:6/649: symlink d0/d1b/d33/d8c/ld1 0 2024-02-28T23:07:25.735 INFO:tasks.workunit.client.0.smithi159.stdout:8/804: mkdir d2/d11/d52/d26/d36/d38/dfb 0 2024-02-28T23:07:25.737 INFO:tasks.workunit.client.1.smithi184.stdout:2/279: dread fe [0,4194304] 0 2024-02-28T23:07:25.738 INFO:tasks.workunit.client.1.smithi184.stdout:6/242: mkdir dc/de/d10/d3a/d4d 0 2024-02-28T23:07:25.740 INFO:tasks.workunit.client.0.smithi159.stdout:0/803: dread d0/d5/d38/f91 [0,4194304] 0 2024-02-28T23:07:25.742 INFO:tasks.workunit.client.0.smithi159.stdout:1/654: creat d6/d1d/fda x:0 0 0 2024-02-28T23:07:25.742 INFO:tasks.workunit.client.0.smithi159.stdout:0/804: rename d0/de to d0/de/de7/d101/d11d 22 2024-02-28T23:07:25.745 INFO:tasks.workunit.client.1.smithi184.stdout:8/281: rename d1/da/d33/c52 to d1/da/dc/d16/d29/c6e 0 2024-02-28T23:07:25.747 INFO:tasks.workunit.client.1.smithi184.stdout:0/293: write d0/f6 [5339275,117731] 0 2024-02-28T23:07:25.748 INFO:tasks.workunit.client.0.smithi159.stdout:9/686: link d4/d3d/d3e/d55/d4c/d4e/dbe/fd1 d4/d3d/d3e/d55/d37/d62/d77/db9/dc7/fd5 0 2024-02-28T23:07:25.750 INFO:tasks.workunit.client.1.smithi184.stdout:4/280: truncate d1/dc/df/f31 132228 0 2024-02-28T23:07:25.750 INFO:tasks.workunit.client.1.smithi184.stdout:0/294: chown d0/df/d13/d27/d31/d5b/l5f 109358306 1 2024-02-28T23:07:25.751 INFO:tasks.workunit.client.0.smithi159.stdout:0/805: symlink d0/de/d75/d5f/l11e 0 2024-02-28T23:07:25.753 INFO:tasks.workunit.client.0.smithi159.stdout:8/805: link d2/d11/d52/d26/d36/d38/f5d d2/d73/ffc 0 2024-02-28T23:07:25.755 INFO:tasks.workunit.client.1.smithi184.stdout:7/272: dread d6/d9/da/dc/f12 [0,4194304] 0 2024-02-28T23:07:25.755 INFO:tasks.workunit.client.0.smithi159.stdout:1/655: mkdir d6/d1d/d46/d88/db4/ddb 0 2024-02-28T23:07:25.756 INFO:tasks.workunit.client.1.smithi184.stdout:4/281: dread d1/d8/d35/f47 [0,4194304] 0 2024-02-28T23:07:25.756 INFO:tasks.workunit.client.0.smithi159.stdout:9/687: write d4/d3d/d3e/d4a/f56 [8622029,7042] 0 2024-02-28T23:07:25.757 INFO:tasks.workunit.client.1.smithi184.stdout:4/282: chown d1/d8/d37/l4e 13643 1 2024-02-28T23:07:25.757 INFO:tasks.workunit.client.0.smithi159.stdout:0/806: mkdir d0/de/d75/d5f/d11f 0 2024-02-28T23:07:25.759 INFO:tasks.workunit.client.1.smithi184.stdout:1/340: mknod d20/c73 0 2024-02-28T23:07:25.759 INFO:tasks.workunit.client.0.smithi159.stdout:6/650: dread d0/d1b/d33/d11/d14/f21 [0,4194304] 0 2024-02-28T23:07:25.760 INFO:tasks.workunit.client.0.smithi159.stdout:8/806: creat d2/d11/d52/d47/d65/ffd x:0 0 0 2024-02-28T23:07:25.761 INFO:tasks.workunit.client.0.smithi159.stdout:1/656: mkdir d6/d1d/d46/d88/dd3/d9c/db3/dc4/ddc 0 2024-02-28T23:07:25.763 INFO:tasks.workunit.client.1.smithi184.stdout:6/243: fsync dc/de/d10/f4c 0 2024-02-28T23:07:25.763 INFO:tasks.workunit.client.0.smithi159.stdout:8/807: chown d2/d11/d35/d5f/f6a 154950 1 2024-02-28T23:07:25.764 INFO:tasks.workunit.client.1.smithi184.stdout:2/280: truncate d10/d1f/d21/d5e/f3d 1692970 0 2024-02-28T23:07:25.766 INFO:tasks.workunit.client.1.smithi184.stdout:4/283: dread d1/d8/d37/f4c [0,4194304] 0 2024-02-28T23:07:25.767 INFO:tasks.workunit.client.0.smithi159.stdout:6/651: chown d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/laf 919 1 2024-02-28T23:07:25.769 INFO:tasks.workunit.client.1.smithi184.stdout:4/284: dread d1/dc/f23 [0,4194304] 0 2024-02-28T23:07:25.773 INFO:tasks.workunit.client.0.smithi159.stdout:9/688: getdents d4/d3d/d3e/d55/d4c/d4e 0 2024-02-28T23:07:25.775 INFO:tasks.workunit.client.1.smithi184.stdout:0/295: creat d0/d1d/d3a/f60 x:0 0 0 2024-02-28T23:07:25.777 INFO:tasks.workunit.client.0.smithi159.stdout:0/807: dwrite d0/d5/d38/d63/dd8/f119 [0,4194304] 0 2024-02-28T23:07:25.779 INFO:tasks.workunit.client.0.smithi159.stdout:0/808: fdatasync d0/d5/d14/d34/d6c/fcf 0 2024-02-28T23:07:25.781 INFO:tasks.workunit.client.1.smithi184.stdout:6/244: readlink dc/de/d10/d3a/l44 0 2024-02-28T23:07:25.784 INFO:tasks.workunit.client.0.smithi159.stdout:9/689: mkdir d4/d3d/d3e/d55/d4c/db6/dd6 0 2024-02-28T23:07:25.785 INFO:tasks.workunit.client.1.smithi184.stdout:2/281: mkdir d10/d1f/d21/d5e/d15/d24/d5f 0 2024-02-28T23:07:25.785 INFO:tasks.workunit.client.1.smithi184.stdout:0/296: dread d0/df/d13/f14 [0,4194304] 0 2024-02-28T23:07:25.788 INFO:tasks.workunit.client.1.smithi184.stdout:7/273: rename d6/d9/d13/d3e/f4b to d6/d9/d13/d3e/f64 0 2024-02-28T23:07:25.789 INFO:tasks.workunit.client.1.smithi184.stdout:0/297: read d0/df/d13/f3b [75856,87634] 0 2024-02-28T23:07:25.790 INFO:tasks.workunit.client.1.smithi184.stdout:0/298: chown d0/df/d13/f1a 864312 1 2024-02-28T23:07:25.794 INFO:tasks.workunit.client.1.smithi184.stdout:6/245: dread dc/de/d10/f43 [0,4194304] 0 2024-02-28T23:07:25.796 INFO:tasks.workunit.client.1.smithi184.stdout:8/282: write d1/da/f1a [771894,29013] 0 2024-02-28T23:07:25.797 INFO:tasks.workunit.client.0.smithi159.stdout:0/809: dwrite d0/d5/d14/d34/d3d/f65 [0,4194304] 0 2024-02-28T23:07:25.801 INFO:tasks.workunit.client.0.smithi159.stdout:1/657: rename d6/d1d/d46/d88/fa9 to d6/d1d/d46/d88/dd3/fdd 0 2024-02-28T23:07:25.801 INFO:tasks.workunit.client.0.smithi159.stdout:9/690: mkdir d4/d3d/d3e/d55/d9e/db3/dd7 0 2024-02-28T23:07:25.801 INFO:tasks.workunit.client.1.smithi184.stdout:5/279: getdents db/d44 0 2024-02-28T23:07:25.804 INFO:tasks.workunit.client.1.smithi184.stdout:5/280: truncate db/d12/d1c/f2b 2817827 0 2024-02-28T23:07:25.805 INFO:tasks.workunit.client.1.smithi184.stdout:1/341: dwrite d20/f24 [0,4194304] 0 2024-02-28T23:07:25.813 INFO:tasks.workunit.client.0.smithi159.stdout:8/808: rename d2/d11/d52/d47/d65 to d2/d11/d35/d5f/dfe 0 2024-02-28T23:07:25.814 INFO:tasks.workunit.client.1.smithi184.stdout:7/274: mkdir d6/d9/d13/d1e/d2f/d34/d65 0 2024-02-28T23:07:25.816 INFO:tasks.workunit.client.0.smithi159.stdout:1/658: mknod d6/d12/d31/cde 0 2024-02-28T23:07:25.818 INFO:tasks.workunit.client.1.smithi184.stdout:0/299: creat d0/df/f61 x:0 0 0 2024-02-28T23:07:25.818 INFO:tasks.workunit.client.0.smithi159.stdout:0/810: write d0/d5/d14/d25/f77 [2350579,125561] 0 2024-02-28T23:07:25.820 INFO:tasks.workunit.client.1.smithi184.stdout:9/285: sync 2024-02-28T23:07:25.820 INFO:tasks.workunit.client.1.smithi184.stdout:0/300: write d0/d1f/f26 [2774795,29038] 0 2024-02-28T23:07:25.823 INFO:tasks.workunit.client.1.smithi184.stdout:9/286: chown d5/db/de/d10/d12/d2f/l31 1355113 1 2024-02-28T23:07:25.824 INFO:tasks.workunit.client.0.smithi159.stdout:6/652: rename d0/d1b/d33/d11/d14 to d0/d1b/d33/d11/d34/d9d/da2/d96/dd2 0 2024-02-28T23:07:25.825 INFO:tasks.workunit.client.1.smithi184.stdout:9/287: write d5/d17/f3d [2800375,80090] 0 2024-02-28T23:07:25.826 INFO:tasks.workunit.client.1.smithi184.stdout:9/288: dread - d5/d17/d43/f5b zero size 2024-02-28T23:07:25.828 INFO:tasks.workunit.client.0.smithi159.stdout:1/659: unlink d6/d12/d31/la5 0 2024-02-28T23:07:25.830 INFO:tasks.workunit.client.1.smithi184.stdout:9/289: read d5/db/de/d10/f2a [2058024,43608] 0 2024-02-28T23:07:25.834 INFO:tasks.workunit.client.0.smithi159.stdout:0/811: dread d0/de/d75/d5f/f72 [0,4194304] 0 2024-02-28T23:07:25.836 INFO:tasks.workunit.client.0.smithi159.stdout:0/812: read - d0/d5/d14/d25/f106 zero size 2024-02-28T23:07:25.836 INFO:tasks.workunit.client.1.smithi184.stdout:5/281: chown db/d12/d18/d2e/d3c/c4a 27217918 1 2024-02-28T23:07:25.836 INFO:tasks.workunit.client.0.smithi159.stdout:6/653: creat d0/d1b/d33/d11/d34/d9d/da2/fd3 x:0 0 0 2024-02-28T23:07:25.840 INFO:tasks.workunit.client.1.smithi184.stdout:8/283: dwrite d1/da/f31 [4194304,4194304] 0 2024-02-28T23:07:25.841 INFO:tasks.workunit.client.0.smithi159.stdout:8/809: truncate d2/d11/d35/d5f/f92 69212 0 2024-02-28T23:07:25.843 INFO:tasks.workunit.client.1.smithi184.stdout:2/282: mkdir d10/d1f/d21/d5e/d15/d60 0 2024-02-28T23:07:25.844 INFO:tasks.workunit.client.1.smithi184.stdout:2/283: dread - d10/f34 zero size 2024-02-28T23:07:25.844 INFO:tasks.workunit.client.0.smithi159.stdout:8/810: chown d2/d11/d52/d26/c2e 1 1 2024-02-28T23:07:25.845 INFO:tasks.workunit.client.0.smithi159.stdout:9/691: dwrite d4/f11 [0,4194304] 0 2024-02-28T23:07:25.847 INFO:tasks.workunit.client.0.smithi159.stdout:0/813: creat d0/d5/d38/d63/dad/f120 x:0 0 0 2024-02-28T23:07:25.847 INFO:tasks.workunit.client.0.smithi159.stdout:1/660: creat d6/d12/d1a/d92/d97/dd8/fdf x:0 0 0 2024-02-28T23:07:25.852 INFO:tasks.workunit.client.1.smithi184.stdout:4/285: creat d1/dc/df/f59 x:0 0 0 2024-02-28T23:07:25.853 INFO:tasks.workunit.client.1.smithi184.stdout:4/286: chown d1/dc/df/d41 1 1 2024-02-28T23:07:25.856 INFO:tasks.workunit.client.1.smithi184.stdout:1/342: symlink d20/d32/l74 0 2024-02-28T23:07:25.857 INFO:tasks.workunit.client.0.smithi159.stdout:9/692: fdatasync d4/d3d/d3e/d55/f46 0 2024-02-28T23:07:25.860 INFO:tasks.workunit.client.1.smithi184.stdout:5/282: creat db/d12/d1c/d21/d2f/f5a x:0 0 0 2024-02-28T23:07:25.861 INFO:tasks.workunit.client.0.smithi159.stdout:8/811: creat d2/d11/d52/d26/d36/d38/d77/d9e/fff x:0 0 0 2024-02-28T23:07:25.861 INFO:tasks.workunit.client.0.smithi159.stdout:0/814: mkdir d0/de/d75/db8/d103/d121 0 2024-02-28T23:07:25.865 INFO:tasks.workunit.client.1.smithi184.stdout:3/286: sync 2024-02-28T23:07:25.866 INFO:tasks.workunit.client.0.smithi159.stdout:1/661: fsync d6/d12/d33/d48/f98 0 2024-02-28T23:07:25.867 INFO:tasks.workunit.client.1.smithi184.stdout:3/287: write d1/d4/d1c/f4f [29500,15538] 0 2024-02-28T23:07:25.868 INFO:tasks.workunit.client.1.smithi184.stdout:2/284: symlink d10/d1f/d21/l61 0 2024-02-28T23:07:25.868 INFO:tasks.workunit.client.0.smithi159.stdout:6/654: write d0/d6d/f6e [1942959,65186] 0 2024-02-28T23:07:25.869 INFO:tasks.workunit.client.0.smithi159.stdout:9/693: fsync d4/f13 0 2024-02-28T23:07:25.870 INFO:tasks.workunit.client.1.smithi184.stdout:0/301: symlink d0/d47/l62 0 2024-02-28T23:07:25.872 INFO:tasks.workunit.client.0.smithi159.stdout:0/815: symlink d0/de/de7/l122 0 2024-02-28T23:07:25.874 INFO:tasks.workunit.client.0.smithi159.stdout:9/694: chown d4/d3d/d3e/d55/d37/d62/d77/db9/dc7/fd5 53129642 1 2024-02-28T23:07:25.874 INFO:tasks.workunit.client.1.smithi184.stdout:6/246: rename dc/de/d10/d3a/l47 to dc/l4e 0 2024-02-28T23:07:25.877 INFO:tasks.workunit.client.1.smithi184.stdout:9/290: mkdir d5/db/d65 0 2024-02-28T23:07:25.879 INFO:tasks.workunit.client.1.smithi184.stdout:9/291: readlink d5/db/de/d10/d12/d2f/l61 0 2024-02-28T23:07:25.879 INFO:tasks.workunit.client.0.smithi159.stdout:1/662: dread - d6/d1d/d1f/f8c zero size 2024-02-28T23:07:25.879 INFO:tasks.workunit.client.1.smithi184.stdout:4/287: creat d1/d8/f5a x:0 0 0 2024-02-28T23:07:25.880 INFO:tasks.workunit.client.0.smithi159.stdout:6/655: dread d0/d1b/d33/d3f/d44/fa0 [0,4194304] 0 2024-02-28T23:07:25.882 INFO:tasks.workunit.client.1.smithi184.stdout:1/343: creat d20/d46/f75 x:0 0 0 2024-02-28T23:07:25.883 INFO:tasks.workunit.client.0.smithi159.stdout:8/812: dwrite d2/d11/d52/d26/d36/d38/ff9 [0,4194304] 0 2024-02-28T23:07:25.883 INFO:tasks.workunit.client.0.smithi159.stdout:6/656: readlink d0/d1b/d33/d8c/l66 0 2024-02-28T23:07:25.883 INFO:tasks.workunit.client.1.smithi184.stdout:4/288: dread d1/dc/f23 [0,4194304] 0 2024-02-28T23:07:25.885 INFO:tasks.workunit.client.0.smithi159.stdout:8/813: chown d2/d3/f20 1 1 2024-02-28T23:07:25.885 INFO:tasks.workunit.client.1.smithi184.stdout:5/283: creat db/d1f/f5b x:0 0 0 2024-02-28T23:07:25.889 INFO:tasks.workunit.client.0.smithi159.stdout:6/657: chown d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/fa3 122 1 2024-02-28T23:07:25.889 INFO:tasks.workunit.client.0.smithi159.stdout:8/814: stat d2/d11/d52/d26/d36/l37 0 2024-02-28T23:07:25.889 INFO:tasks.workunit.client.1.smithi184.stdout:7/275: creat d6/d9/da/dc/d49/f66 x:0 0 0 2024-02-28T23:07:25.890 INFO:tasks.workunit.client.0.smithi159.stdout:1/663: rename d6/d1d/d46/fbd to d6/d12/d16/fe0 0 2024-02-28T23:07:25.892 INFO:tasks.workunit.client.1.smithi184.stdout:9/292: dread d5/d17/f3d [4194304,4194304] 0 2024-02-28T23:07:25.892 INFO:tasks.workunit.client.1.smithi184.stdout:3/288: mknod d1/d4/d5/c56 0 2024-02-28T23:07:25.894 INFO:tasks.workunit.client.1.smithi184.stdout:3/289: chown d1/d4/d6/d1e/l39 5830 1 2024-02-28T23:07:25.896 INFO:tasks.workunit.client.1.smithi184.stdout:3/290: dread - d1/d4/d6/f46 zero size 2024-02-28T23:07:25.897 INFO:tasks.workunit.client.1.smithi184.stdout:6/247: rmdir dc/de/d10/d16 39 2024-02-28T23:07:25.900 INFO:tasks.workunit.client.0.smithi159.stdout:6/658: rmdir d0/d1b/d33/d3f/d44/d8b 39 2024-02-28T23:07:25.904 INFO:tasks.workunit.client.0.smithi159.stdout:9/695: rmdir d4/d3d/d3e/d55/d37/d62/d77/db9/dc7/dcb 0 2024-02-28T23:07:25.906 INFO:tasks.workunit.client.1.smithi184.stdout:4/289: truncate d1/dc/f23 496124 0 2024-02-28T23:07:25.907 INFO:tasks.workunit.client.0.smithi159.stdout:6/659: mknod d0/d1b/d33/d11/d34/d9d/cd4 0 2024-02-28T23:07:25.907 INFO:tasks.workunit.client.1.smithi184.stdout:4/290: write d1/dc/df/f14 [4868076,10379] 0 2024-02-28T23:07:25.910 INFO:tasks.workunit.client.0.smithi159.stdout:9/696: creat d4/d3d/d3e/d55/d37/d62/d8f/fd8 x:0 0 0 2024-02-28T23:07:25.911 INFO:tasks.workunit.client.0.smithi159.stdout:6/660: symlink d0/d1b/d33/d8c/ld5 0 2024-02-28T23:07:25.914 INFO:tasks.workunit.client.0.smithi159.stdout:1/664: creat d6/d12/d1a/fe1 x:0 0 0 2024-02-28T23:07:25.916 INFO:tasks.workunit.client.0.smithi159.stdout:1/665: chown d6/d1d/d1f/f8c 0 1 2024-02-28T23:07:25.917 INFO:tasks.workunit.client.1.smithi184.stdout:8/284: write d1/da/d10/d17/f47 [2903802,23742] 0 2024-02-28T23:07:25.920 INFO:tasks.workunit.client.0.smithi159.stdout:9/697: creat d4/d3d/d3e/d55/d4c/d4e/d6b/db5/fd9 x:0 0 0 2024-02-28T23:07:25.922 INFO:tasks.workunit.client.1.smithi184.stdout:3/291: creat d1/d4/f57 x:0 0 0 2024-02-28T23:07:25.923 INFO:tasks.workunit.client.1.smithi184.stdout:3/292: readlink d1/d4/d6/d1e/l39 0 2024-02-28T23:07:25.924 INFO:tasks.workunit.client.0.smithi159.stdout:1/666: rename d6/d12/d31/d69/l7b to d6/d1d/d46/d88/dd3/d9c/le2 0 2024-02-28T23:07:25.925 INFO:tasks.workunit.client.1.smithi184.stdout:9/293: write d5/db/de/d10/d12/d2f/f51 [4895776,7163] 0 2024-02-28T23:07:25.931 INFO:tasks.workunit.client.1.smithi184.stdout:5/284: rename l3 to db/d12/d1c/d21/d4d/l5c 0 2024-02-28T23:07:25.931 INFO:tasks.workunit.client.0.smithi159.stdout:9/698: creat d4/d3d/d3e/d55/d4c/db6/dd6/fda x:0 0 0 2024-02-28T23:07:25.932 INFO:tasks.workunit.client.0.smithi159.stdout:9/699: fdatasync d4/d3d/d3e/d55/d37/f3b 0 2024-02-28T23:07:25.936 INFO:tasks.workunit.client.0.smithi159.stdout:6/661: dread d0/d1b/d33/d3f/f73 [0,4194304] 0 2024-02-28T23:07:25.936 INFO:tasks.workunit.client.0.smithi159.stdout:1/667: getdents d6/d1d/d46 0 2024-02-28T23:07:25.936 INFO:tasks.workunit.client.1.smithi184.stdout:2/285: link d10/d1f/d21/d5e/d15/d24/l5a d10/d33/l62 0 2024-02-28T23:07:25.937 INFO:tasks.workunit.client.0.smithi159.stdout:9/700: creat d4/d3d/d3e/d55/d4c/d4e/d6b/db5/fdb x:0 0 0 2024-02-28T23:07:25.938 INFO:tasks.workunit.client.1.smithi184.stdout:0/302: rmdir d0/d1d/d42 0 2024-02-28T23:07:25.939 INFO:tasks.workunit.client.0.smithi159.stdout:6/662: chown d0/d1b/d33/d11/d34/d9d/da2/c9a 8674246 1 2024-02-28T23:07:25.940 INFO:tasks.workunit.client.1.smithi184.stdout:0/303: write d0/f57 [794477,28539] 0 2024-02-28T23:07:25.940 INFO:tasks.workunit.client.0.smithi159.stdout:9/701: rmdir d4/d3d/d3e/d55/d4c/d4e 39 2024-02-28T23:07:25.941 INFO:tasks.workunit.client.0.smithi159.stdout:6/663: chown d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88 4905 1 2024-02-28T23:07:25.942 INFO:tasks.workunit.client.1.smithi184.stdout:3/293: symlink d1/d4/l58 0 2024-02-28T23:07:25.943 INFO:tasks.workunit.client.1.smithi184.stdout:0/304: read d0/df/f30 [4936861,98155] 0 2024-02-28T23:07:25.945 INFO:tasks.workunit.client.0.smithi159.stdout:6/664: read - d0/d1b/d33/d11/d34/d9d/da2/fd3 zero size 2024-02-28T23:07:25.945 INFO:tasks.workunit.client.1.smithi184.stdout:1/344: creat d20/f76 x:0 0 0 2024-02-28T23:07:25.947 INFO:tasks.workunit.client.1.smithi184.stdout:9/294: fsync d5/fc 0 2024-02-28T23:07:25.948 INFO:tasks.workunit.client.0.smithi159.stdout:9/702: creat d4/d3d/d3e/d55/d37/d62/d8f/fdc x:0 0 0 2024-02-28T23:07:25.949 INFO:tasks.workunit.client.1.smithi184.stdout:4/291: mkdir d1/dc/df/d5b 0 2024-02-28T23:07:25.952 INFO:tasks.workunit.client.1.smithi184.stdout:5/285: rename db/d1f/d32 to db/d12/d18/d2e/d3c/d5d 0 2024-02-28T23:07:25.954 INFO:tasks.workunit.client.0.smithi159.stdout:9/703: creat d4/d76/fdd x:0 0 0 2024-02-28T23:07:25.954 INFO:tasks.workunit.client.1.smithi184.stdout:7/276: truncate d6/d9/d13/f1f 225319 0 2024-02-28T23:07:25.960 INFO:tasks.workunit.client.0.smithi159.stdout:6/665: rename d0/d1b/f9e to d0/d1b/d33/d11/fd6 0 2024-02-28T23:07:25.962 INFO:tasks.workunit.client.1.smithi184.stdout:0/305: dwrite d0/df/d13/d27/f39 [4194304,4194304] 0 2024-02-28T23:07:25.969 INFO:tasks.workunit.client.0.smithi159.stdout:9/704: rename d4/f3c to d4/d3d/d3e/d55/d37/d62/da6/fde 0 2024-02-28T23:07:25.969 INFO:tasks.workunit.client.1.smithi184.stdout:4/292: dwrite d1/d8/d19/f1a [0,4194304] 0 2024-02-28T23:07:25.971 INFO:tasks.workunit.client.0.smithi159.stdout:1/668: dwrite d6/d12/d1a/f53 [0,4194304] 0 2024-02-28T23:07:25.972 INFO:tasks.workunit.client.1.smithi184.stdout:9/295: creat d5/db/de/d10/d12/d2f/d3f/f66 x:0 0 0 2024-02-28T23:07:25.972 INFO:tasks.workunit.client.1.smithi184.stdout:8/285: truncate d1/da/d10/f2d 2573805 0 2024-02-28T23:07:25.973 INFO:tasks.workunit.client.1.smithi184.stdout:8/286: stat d1/l37 0 2024-02-28T23:07:25.978 INFO:tasks.workunit.client.1.smithi184.stdout:3/294: write d1/d4/d1c/f52 [4812075,31208] 0 2024-02-28T23:07:25.978 INFO:tasks.workunit.client.1.smithi184.stdout:2/286: mkdir d10/d1f/d21/d5e/d15/d24/d5f/d63 0 2024-02-28T23:07:25.981 INFO:tasks.workunit.client.1.smithi184.stdout:0/306: fdatasync d0/df/d13/f3b 0 2024-02-28T23:07:25.982 INFO:tasks.workunit.client.1.smithi184.stdout:1/345: symlink d20/d32/l77 0 2024-02-28T23:07:25.983 INFO:tasks.workunit.client.0.smithi159.stdout:1/669: dread - d6/d1d/f99 zero size 2024-02-28T23:07:25.984 INFO:tasks.workunit.client.1.smithi184.stdout:9/296: creat d5/d47/f67 x:0 0 0 2024-02-28T23:07:25.985 INFO:tasks.workunit.client.1.smithi184.stdout:8/287: creat d1/da/dc/d16/d32/d42/f6f x:0 0 0 2024-02-28T23:07:25.986 INFO:tasks.workunit.client.0.smithi159.stdout:1/670: read - d6/d12/fba zero size 2024-02-28T23:07:25.986 INFO:tasks.workunit.client.1.smithi184.stdout:0/307: read d0/df/f41 [186561,14951] 0 2024-02-28T23:07:25.987 INFO:tasks.workunit.client.1.smithi184.stdout:2/287: unlink d10/c12 0 2024-02-28T23:07:25.989 INFO:tasks.workunit.client.1.smithi184.stdout:2/288: fdatasync d10/d1f/f48 0 2024-02-28T23:07:25.990 INFO:tasks.workunit.client.0.smithi159.stdout:6/666: write d0/d6d/fa1 [134753,38745] 0 2024-02-28T23:07:25.990 INFO:tasks.workunit.client.0.smithi159.stdout:1/671: truncate d6/d12/d31/fae 685360 0 2024-02-28T23:07:25.991 INFO:tasks.workunit.client.1.smithi184.stdout:2/289: chown d10/d1f/d21/d5e/d15/l49 15036749 1 2024-02-28T23:07:25.992 INFO:tasks.workunit.client.1.smithi184.stdout:3/295: mkdir d1/d4/d6/d1f/d26/d3a/d59 0 2024-02-28T23:07:25.992 INFO:tasks.workunit.client.1.smithi184.stdout:3/296: fsync d1/d4/f14 0 2024-02-28T23:07:25.992 INFO:tasks.workunit.client.1.smithi184.stdout:4/293: mkdir d1/dc/df/d3b/d5c 0 2024-02-28T23:07:25.996 INFO:tasks.workunit.client.0.smithi159.stdout:1/672: mkdir d6/d12/d16/de3 0 2024-02-28T23:07:25.998 INFO:tasks.workunit.client.1.smithi184.stdout:3/297: dread d1/d4/f42 [0,4194304] 0 2024-02-28T23:07:25.999 INFO:tasks.workunit.client.0.smithi159.stdout:6/667: mknod d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88/cd7 0 2024-02-28T23:07:26.000 INFO:tasks.workunit.client.1.smithi184.stdout:3/298: write d1/d4/d6/f46 [291502,120895] 0 2024-02-28T23:07:26.001 INFO:tasks.workunit.client.1.smithi184.stdout:5/286: creat db/d12/d1c/d21/f5e x:0 0 0 2024-02-28T23:07:26.001 INFO:tasks.workunit.client.1.smithi184.stdout:3/299: chown d1 0 1 2024-02-28T23:07:26.003 INFO:tasks.workunit.client.1.smithi184.stdout:3/300: write d1/d4/f23 [2014472,57922] 0 2024-02-28T23:07:26.007 INFO:tasks.workunit.client.1.smithi184.stdout:3/301: dread - d1/d4/d6/d1f/f33 zero size 2024-02-28T23:07:26.007 INFO:tasks.workunit.client.1.smithi184.stdout:8/288: mknod d1/da/df/d20/c70 0 2024-02-28T23:07:26.010 INFO:tasks.workunit.client.1.smithi184.stdout:3/302: write d1/d4/d6/f51 [278909,27880] 0 2024-02-28T23:07:26.011 INFO:tasks.workunit.client.1.smithi184.stdout:4/294: dwrite d1/d8/d19/f1a [0,4194304] 0 2024-02-28T23:07:26.013 INFO:tasks.workunit.client.0.smithi159.stdout:1/673: rename d6/ca to d6/d1d/d1f/db8/ce4 0 2024-02-28T23:07:26.014 INFO:tasks.workunit.client.0.smithi159.stdout:6/668: symlink d0/d1b/ld8 0 2024-02-28T23:07:26.015 INFO:tasks.workunit.client.1.smithi184.stdout:8/289: truncate d1/da/dc/d16/d32/f4b 309792 0 2024-02-28T23:07:26.016 INFO:tasks.workunit.client.1.smithi184.stdout:2/290: symlink d10/d1f/d38/d54/l64 0 2024-02-28T23:07:26.016 INFO:tasks.workunit.client.0.smithi159.stdout:9/705: dwrite d4/d3d/d3e/d55/f46 [0,4194304] 0 2024-02-28T23:07:26.017 INFO:tasks.workunit.client.1.smithi184.stdout:2/291: chown d10/d1f/d21/c36 98487304 1 2024-02-28T23:07:26.018 INFO:tasks.workunit.client.0.smithi159.stdout:9/706: stat d4/d3d/d3e/f72 0 2024-02-28T23:07:26.022 INFO:tasks.workunit.client.1.smithi184.stdout:9/297: write d5/d26/f55 [622268,77739] 0 2024-02-28T23:07:26.026 INFO:tasks.workunit.client.1.smithi184.stdout:9/298: chown d5/d26/f55 9 1 2024-02-28T23:07:26.026 INFO:tasks.workunit.client.1.smithi184.stdout:1/346: link d20/d32/d3e/f4a d20/d32/d4b/f78 0 2024-02-28T23:07:26.028 INFO:tasks.workunit.client.1.smithi184.stdout:9/299: write d5/d26/d50/f3b [2953996,114764] 0 2024-02-28T23:07:26.035 INFO:tasks.workunit.client.1.smithi184.stdout:8/290: dwrite d1/da/d10/d17/d63/f68 [0,4194304] 0 2024-02-28T23:07:26.037 INFO:tasks.workunit.client.1.smithi184.stdout:3/303: creat d1/d4/f5a x:0 0 0 2024-02-28T23:07:26.039 INFO:tasks.workunit.client.1.smithi184.stdout:4/295: fsync d1/f10 0 2024-02-28T23:07:26.042 INFO:tasks.workunit.client.1.smithi184.stdout:8/291: write d1/da/df/d20/f30 [595035,35638] 0 2024-02-28T23:07:26.042 INFO:tasks.workunit.client.1.smithi184.stdout:3/304: chown d1/d4/d6/d1f 212 1 2024-02-28T23:07:26.042 INFO:tasks.workunit.client.1.smithi184.stdout:2/292: fdatasync d10/d1f/d21/d5e/d15/f39 0 2024-02-28T23:07:26.043 INFO:tasks.workunit.client.1.smithi184.stdout:0/308: dwrite d0/df/d13/f3b [0,4194304] 0 2024-02-28T23:07:26.046 INFO:tasks.workunit.client.1.smithi184.stdout:0/309: fdatasync d0/df/f61 0 2024-02-28T23:07:26.046 INFO:tasks.workunit.client.1.smithi184.stdout:9/300: mkdir d5/d47/d68 0 2024-02-28T23:07:26.048 INFO:tasks.workunit.client.1.smithi184.stdout:5/287: dread db/d12/d18/d2e/d3c/d5d/f37 [4194304,4194304] 0 2024-02-28T23:07:26.050 INFO:tasks.workunit.client.1.smithi184.stdout:0/310: chown d0/df/d13/f1a 1873891 1 2024-02-28T23:07:26.053 INFO:tasks.workunit.client.1.smithi184.stdout:1/347: dwrite d20/f2b [0,4194304] 0 2024-02-28T23:07:26.054 INFO:tasks.workunit.client.1.smithi184.stdout:3/305: mknod d1/d4/d1c/c5b 0 2024-02-28T23:07:26.055 INFO:tasks.workunit.client.1.smithi184.stdout:6/248: sync 2024-02-28T23:07:26.056 INFO:tasks.workunit.client.1.smithi184.stdout:5/288: write db/d12/d18/d2e/d3c/d5d/f33 [385000,42185] 0 2024-02-28T23:07:26.058 INFO:tasks.workunit.client.1.smithi184.stdout:8/292: creat d1/da/dc/d16/d29/f71 x:0 0 0 2024-02-28T23:07:26.060 INFO:tasks.workunit.client.1.smithi184.stdout:4/296: symlink d1/d29/l5d 0 2024-02-28T23:07:26.065 INFO:tasks.workunit.client.1.smithi184.stdout:0/311: creat d0/df/f63 x:0 0 0 2024-02-28T23:07:26.065 INFO:tasks.workunit.client.1.smithi184.stdout:2/293: dwrite fb [0,4194304] 0 2024-02-28T23:07:26.067 INFO:tasks.workunit.client.1.smithi184.stdout:9/301: dwrite d5/d26/f55 [0,4194304] 0 2024-02-28T23:07:26.069 INFO:tasks.workunit.client.1.smithi184.stdout:5/289: rename db to db/d12/d5f 22 2024-02-28T23:07:26.074 INFO:tasks.workunit.client.1.smithi184.stdout:5/290: chown db/d12/d1c/c31 50044461 1 2024-02-28T23:07:26.077 INFO:tasks.workunit.client.1.smithi184.stdout:3/306: mknod d1/d4/d6/d1f/d26/d3a/c5c 0 2024-02-28T23:07:26.079 INFO:tasks.workunit.client.1.smithi184.stdout:8/293: creat d1/da/dc/d16/d29/f72 x:0 0 0 2024-02-28T23:07:26.080 INFO:tasks.workunit.client.1.smithi184.stdout:3/307: fsync d1/d4/d6/d1f/d26/d3a/f4d 0 2024-02-28T23:07:26.081 INFO:tasks.workunit.client.1.smithi184.stdout:3/308: read - d1/d4/f57 zero size 2024-02-28T23:07:26.082 INFO:tasks.workunit.client.1.smithi184.stdout:8/294: write d1/da/d10/d17/d63/f69 [430032,112568] 0 2024-02-28T23:07:26.083 INFO:tasks.workunit.client.1.smithi184.stdout:3/309: chown d1/d4/d1c/c3c 49670730 1 2024-02-28T23:07:26.084 INFO:tasks.workunit.client.1.smithi184.stdout:0/312: creat d0/df/d13/f64 x:0 0 0 2024-02-28T23:07:26.087 INFO:tasks.workunit.client.1.smithi184.stdout:2/294: mkdir d10/d1f/d42/d65 0 2024-02-28T23:07:26.089 INFO:tasks.workunit.client.1.smithi184.stdout:2/295: chown d10/d1f/d21/d5e/d15/d24/d5f 9823 1 2024-02-28T23:07:26.090 INFO:tasks.workunit.client.1.smithi184.stdout:2/296: stat d10/d1f/l28 0 2024-02-28T23:07:26.092 INFO:tasks.workunit.client.1.smithi184.stdout:1/348: rename d20/d32/d4d/f59 to d20/d32/d3e/d61/f79 0 2024-02-28T23:07:26.096 INFO:tasks.workunit.client.0.smithi159.stdout:6/669: mkdir d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dac/dd9 0 2024-02-28T23:07:26.097 INFO:tasks.workunit.client.1.smithi184.stdout:4/297: creat d1/dc/df/d41/f5e x:0 0 0 2024-02-28T23:07:26.099 INFO:tasks.workunit.client.1.smithi184.stdout:3/310: mkdir d1/d4/d6/d1f/d24/d5d 0 2024-02-28T23:07:26.100 INFO:tasks.workunit.client.1.smithi184.stdout:9/302: getdents d5/d47/d68 0 2024-02-28T23:07:26.100 INFO:tasks.workunit.client.0.smithi159.stdout:6/670: truncate d0/d1b/d5b/fba 542885 0 2024-02-28T23:07:26.101 INFO:tasks.workunit.client.1.smithi184.stdout:9/303: dread - d5/d17/d43/f60 zero size 2024-02-28T23:07:26.101 INFO:tasks.workunit.client.1.smithi184.stdout:1/349: creat d20/d32/d3e/f7a x:0 0 0 2024-02-28T23:07:26.101 INFO:tasks.workunit.client.1.smithi184.stdout:5/291: mknod db/d12/d50/c60 0 2024-02-28T23:07:26.102 INFO:tasks.workunit.client.1.smithi184.stdout:6/249: creat dc/f4f x:0 0 0 2024-02-28T23:07:26.103 INFO:tasks.workunit.client.1.smithi184.stdout:9/304: stat d5/db/f16 0 2024-02-28T23:07:26.103 INFO:tasks.workunit.client.1.smithi184.stdout:7/277: sync 2024-02-28T23:07:26.103 INFO:tasks.workunit.client.1.smithi184.stdout:2/297: mkdir d10/d1f/d21/d5e/d15/d60/d66 0 2024-02-28T23:07:26.104 INFO:tasks.workunit.client.1.smithi184.stdout:6/250: chown dc/d42 251 1 2024-02-28T23:07:26.105 INFO:tasks.workunit.client.1.smithi184.stdout:8/295: getdents d1/da/df/d20 0 2024-02-28T23:07:26.106 INFO:tasks.workunit.client.1.smithi184.stdout:1/350: dread f1c [0,4194304] 0 2024-02-28T23:07:26.106 INFO:tasks.workunit.client.1.smithi184.stdout:4/298: creat d1/dc/df/f5f x:0 0 0 2024-02-28T23:07:26.106 INFO:tasks.workunit.client.1.smithi184.stdout:5/292: chown db/d12/d18/d2e/d3c/d5d/f3e 163 1 2024-02-28T23:07:26.108 INFO:tasks.workunit.client.0.smithi159.stdout:6/671: truncate d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/fb9 1641766 0 2024-02-28T23:07:26.111 INFO:tasks.workunit.client.1.smithi184.stdout:9/305: rmdir d5/db/de 39 2024-02-28T23:07:26.111 INFO:tasks.workunit.client.0.smithi159.stdout:6/672: read d0/d6d/fa1 [108956,113558] 0 2024-02-28T23:07:26.111 INFO:tasks.workunit.client.1.smithi184.stdout:3/311: getdents d1/d4/d6/d1f/d45 0 2024-02-28T23:07:26.112 INFO:tasks.workunit.client.1.smithi184.stdout:9/306: chown d5/d17/f3c 1 1 2024-02-28T23:07:26.115 INFO:tasks.workunit.client.0.smithi159.stdout:6/673: mknod d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/cda 0 2024-02-28T23:07:26.116 INFO:tasks.workunit.client.1.smithi184.stdout:9/307: readlink d5/d17/d43/l5f 0 2024-02-28T23:07:26.116 INFO:tasks.workunit.client.1.smithi184.stdout:6/251: getdents dc/d42 0 2024-02-28T23:07:26.117 INFO:tasks.workunit.client.1.smithi184.stdout:1/351: dread d20/d32/f34 [0,4194304] 0 2024-02-28T23:07:26.118 INFO:tasks.workunit.client.1.smithi184.stdout:3/312: creat d1/d4/d6/d1f/d24/f5e x:0 0 0 2024-02-28T23:07:26.118 INFO:tasks.workunit.client.1.smithi184.stdout:7/278: creat d6/f67 x:0 0 0 2024-02-28T23:07:26.118 INFO:tasks.workunit.client.1.smithi184.stdout:9/308: write d5/d26/d50/f38 [1188141,107732] 0 2024-02-28T23:07:26.119 INFO:tasks.workunit.client.1.smithi184.stdout:1/352: readlink d20/d46/l70 0 2024-02-28T23:07:26.119 INFO:tasks.workunit.client.1.smithi184.stdout:5/293: creat db/f61 x:0 0 0 2024-02-28T23:07:26.121 INFO:tasks.workunit.client.1.smithi184.stdout:3/313: dread d1/d4/d1c/f4f [0,4194304] 0 2024-02-28T23:07:26.124 INFO:tasks.workunit.client.1.smithi184.stdout:7/279: mkdir d6/d68 0 2024-02-28T23:07:26.126 INFO:tasks.workunit.client.1.smithi184.stdout:5/294: rmdir db/d12/d1c/d21 39 2024-02-28T23:07:26.126 INFO:tasks.workunit.client.1.smithi184.stdout:9/309: write d5/db/de/f23 [369983,109697] 0 2024-02-28T23:07:26.127 INFO:tasks.workunit.client.1.smithi184.stdout:3/314: dread d1/d4/f42 [0,4194304] 0 2024-02-28T23:07:26.128 INFO:tasks.workunit.client.1.smithi184.stdout:1/353: creat d20/d32/f7b x:0 0 0 2024-02-28T23:07:26.132 INFO:tasks.workunit.client.1.smithi184.stdout:3/315: mknod d1/d4/d6/d1f/d26/d3a/d59/c5f 0 2024-02-28T23:07:26.132 INFO:tasks.workunit.client.1.smithi184.stdout:7/280: chown d6/d9/d13/d14/l32 10 1 2024-02-28T23:07:26.135 INFO:tasks.workunit.client.1.smithi184.stdout:7/281: chown d6/f59 52298 1 2024-02-28T23:07:26.139 INFO:tasks.workunit.client.1.smithi184.stdout:3/316: link d1/d4/f57 d1/d4/d6/d1f/f60 0 2024-02-28T23:07:26.141 INFO:tasks.workunit.client.1.smithi184.stdout:3/317: chown d1/d4/d1c/f31 0 1 2024-02-28T23:07:26.142 INFO:tasks.workunit.client.1.smithi184.stdout:9/310: dread d5/d17/f3d [4194304,4194304] 0 2024-02-28T23:07:26.143 INFO:tasks.workunit.client.1.smithi184.stdout:5/295: dwrite db/d12/f39 [4194304,4194304] 0 2024-02-28T23:07:26.145 INFO:tasks.workunit.client.1.smithi184.stdout:1/354: dwrite f17 [0,4194304] 0 2024-02-28T23:07:26.149 INFO:tasks.workunit.client.1.smithi184.stdout:1/355: read d20/d32/d51/f60 [5438662,95142] 0 2024-02-28T23:07:26.154 INFO:tasks.workunit.client.1.smithi184.stdout:7/282: dwrite d6/d9/da/dc/f1b [0,4194304] 0 2024-02-28T23:07:26.154 INFO:tasks.workunit.client.1.smithi184.stdout:9/311: rename d5/db/f16 to d5/db/de/d64/f69 0 2024-02-28T23:07:26.155 INFO:tasks.workunit.client.1.smithi184.stdout:5/296: rename db to db/d12/d50/d62 22 2024-02-28T23:07:26.158 INFO:tasks.workunit.client.1.smithi184.stdout:1/356: creat d20/d32/d3e/f7c x:0 0 0 2024-02-28T23:07:26.160 INFO:tasks.workunit.client.1.smithi184.stdout:5/297: chown db/d1f/c24 979326 1 2024-02-28T23:07:26.162 INFO:tasks.workunit.client.1.smithi184.stdout:9/312: write d5/db/de/d64/f69 [4833573,60404] 0 2024-02-28T23:07:26.163 INFO:tasks.workunit.client.1.smithi184.stdout:5/298: write db/d12/d18/f1a [2179074,91928] 0 2024-02-28T23:07:26.165 INFO:tasks.workunit.client.1.smithi184.stdout:1/357: truncate d20/f72 260167 0 2024-02-28T23:07:26.165 INFO:tasks.workunit.client.1.smithi184.stdout:9/313: dread - d5/d17/f5a zero size 2024-02-28T23:07:26.165 INFO:tasks.workunit.client.1.smithi184.stdout:3/318: dwrite d1/d4/f42 [0,4194304] 0 2024-02-28T23:07:26.169 INFO:tasks.workunit.client.1.smithi184.stdout:9/314: chown d5/d26/d50/f4e 987012 1 2024-02-28T23:07:26.170 INFO:tasks.workunit.client.1.smithi184.stdout:5/299: rename db/d12/d50/c60 to db/d1f/c63 0 2024-02-28T23:07:26.170 INFO:tasks.workunit.client.1.smithi184.stdout:3/319: dread - d1/d4/f57 zero size 2024-02-28T23:07:26.172 INFO:tasks.workunit.client.1.smithi184.stdout:5/300: write db/d12/f39 [4103271,3395] 0 2024-02-28T23:07:26.173 INFO:tasks.workunit.client.1.smithi184.stdout:9/315: write d5/db/de/d10/f2a [1429042,68426] 0 2024-02-28T23:07:26.174 INFO:tasks.workunit.client.1.smithi184.stdout:3/320: mkdir d1/d4/d1c/d61 0 2024-02-28T23:07:26.178 INFO:tasks.workunit.client.1.smithi184.stdout:5/301: getdents db/d44 0 2024-02-28T23:07:26.184 INFO:tasks.workunit.client.1.smithi184.stdout:5/302: symlink db/d12/d1c/d21/d4d/l64 0 2024-02-28T23:07:26.184 INFO:tasks.workunit.client.1.smithi184.stdout:1/358: dread ff [0,4194304] 0 2024-02-28T23:07:26.186 INFO:tasks.workunit.client.1.smithi184.stdout:1/359: rmdir d20/d32/d51 39 2024-02-28T23:07:26.187 INFO:tasks.workunit.client.1.smithi184.stdout:1/360: chown d20/f24 58081 1 2024-02-28T23:07:26.191 INFO:tasks.workunit.client.1.smithi184.stdout:1/361: link fb d20/d32/d4d/f7d 0 2024-02-28T23:07:26.195 INFO:tasks.workunit.client.1.smithi184.stdout:8/296: sync 2024-02-28T23:07:26.196 INFO:tasks.workunit.client.1.smithi184.stdout:5/303: dwrite db/d12/d1c/d21/d2f/f43 [0,4194304] 0 2024-02-28T23:07:26.196 INFO:tasks.workunit.client.1.smithi184.stdout:8/297: chown d1/da/df/d20/f26 979 1 2024-02-28T23:07:26.200 INFO:tasks.workunit.client.1.smithi184.stdout:5/304: mknod db/d12/d18/d2e/d3c/c65 0 2024-02-28T23:07:26.204 INFO:tasks.workunit.client.1.smithi184.stdout:8/298: link d1/da/f3a d1/da/dc/f73 0 2024-02-28T23:07:26.204 INFO:tasks.workunit.client.1.smithi184.stdout:5/305: mkdir db/d12/d18/d2e/d3c/d5d/d66 0 2024-02-28T23:07:26.205 INFO:tasks.workunit.client.1.smithi184.stdout:8/299: rmdir d1/da/df 39 2024-02-28T23:07:26.206 INFO:tasks.workunit.client.1.smithi184.stdout:5/306: chown db/d12/d18/d2e/d3c/c65 37 1 2024-02-28T23:07:26.206 INFO:tasks.workunit.client.1.smithi184.stdout:8/300: read - d1/da/dc/d16/f5c zero size 2024-02-28T23:07:26.207 INFO:tasks.workunit.client.1.smithi184.stdout:5/307: write db/d12/f1d [2555916,48323] 0 2024-02-28T23:07:26.209 INFO:tasks.workunit.client.1.smithi184.stdout:8/301: write d1/da/dc/d18/f64 [937622,77953] 0 2024-02-28T23:07:26.210 INFO:tasks.workunit.client.1.smithi184.stdout:5/308: dread - db/d12/d1c/d21/d2f/f4e zero size 2024-02-28T23:07:26.211 INFO:tasks.workunit.client.1.smithi184.stdout:5/309: read - db/d12/d1c/d21/f5e zero size 2024-02-28T23:07:26.212 INFO:tasks.workunit.client.1.smithi184.stdout:8/302: symlink d1/da/dc/d16/l74 0 2024-02-28T23:07:26.214 INFO:tasks.workunit.client.1.smithi184.stdout:8/303: write d1/da/dc/d16/d29/f72 [363479,94236] 0 2024-02-28T23:07:26.217 INFO:tasks.workunit.client.1.smithi184.stdout:8/304: write d1/da/dc/d16/d32/d42/f61 [1296075,127334] 0 2024-02-28T23:07:26.218 INFO:tasks.workunit.client.1.smithi184.stdout:5/310: truncate db/d12/d18/d2e/d3c/d5d/f37 1337737 0 2024-02-28T23:07:26.235 INFO:tasks.workunit.client.1.smithi184.stdout:8/305: dread d1/da/dc/d18/f57 [0,4194304] 0 2024-02-28T23:07:26.237 INFO:tasks.workunit.client.1.smithi184.stdout:8/306: chown d1/da/d10/d43 342941782 1 2024-02-28T23:07:26.239 INFO:tasks.workunit.client.1.smithi184.stdout:8/307: symlink d1/da/dc/d18/l75 0 2024-02-28T23:07:26.241 INFO:tasks.workunit.client.1.smithi184.stdout:8/308: fsync d1/da/dc/d16/d4d/f5a 0 2024-02-28T23:07:26.254 INFO:tasks.workunit.client.1.smithi184.stdout:7/283: read d6/f19 [73575,62058] 0 2024-02-28T23:07:26.254 INFO:tasks.workunit.client.1.smithi184.stdout:7/284: readlink d6/l25 0 2024-02-28T23:07:26.255 INFO:tasks.workunit.client.1.smithi184.stdout:8/309: dwrite d1/da/dc/d16/d32/d42/f61 [0,4194304] 0 2024-02-28T23:07:26.263 INFO:tasks.workunit.client.1.smithi184.stdout:7/285: link d6/d9/da/f31 d6/d9/d13/d1e/d2f/d34/f69 0 2024-02-28T23:07:26.264 INFO:tasks.workunit.client.1.smithi184.stdout:7/286: write f3 [5515247,121994] 0 2024-02-28T23:07:26.271 INFO:tasks.workunit.client.1.smithi184.stdout:7/287: mknod d6/d9/da/dc/d49/d50/c6a 0 2024-02-28T23:07:26.285 INFO:tasks.workunit.client.1.smithi184.stdout:7/288: dwrite d6/d9/d13/d1e/f21 [0,4194304] 0 2024-02-28T23:07:26.296 INFO:tasks.workunit.client.1.smithi184.stdout:4/299: getdents d1/dc/df/d41 0 2024-02-28T23:07:26.301 INFO:tasks.workunit.client.0.smithi159.stdout:1/674: dwrite d6/d12/fe [0,4194304] 0 2024-02-28T23:07:26.301 INFO:tasks.workunit.client.1.smithi184.stdout:7/289: dwrite d6/d9/d13/f28 [0,4194304] 0 2024-02-28T23:07:26.304 INFO:tasks.workunit.client.1.smithi184.stdout:7/290: write d6/d9/d13/d1e/f21 [2278024,113208] 0 2024-02-28T23:07:26.305 INFO:tasks.workunit.client.1.smithi184.stdout:2/298: write d10/f14 [707977,120825] 0 2024-02-28T23:07:26.307 INFO:tasks.workunit.client.1.smithi184.stdout:2/299: dread - d10/d1f/d38/d54/f59 zero size 2024-02-28T23:07:26.309 INFO:tasks.workunit.client.1.smithi184.stdout:7/291: chown d6/d9/d13/f1f 4171 1 2024-02-28T23:07:26.313 INFO:tasks.workunit.client.0.smithi159.stdout:1/675: unlink d6/d1d/d46/d88/dd3/fdd 0 2024-02-28T23:07:26.318 INFO:tasks.workunit.client.0.smithi159.stdout:1/676: fsync d6/d12/d33/d3c/f55 0 2024-02-28T23:07:26.319 INFO:tasks.workunit.client.1.smithi184.stdout:0/313: dread d0/f6 [0,4194304] 0 2024-02-28T23:07:26.320 INFO:tasks.workunit.client.0.smithi159.stdout:1/677: dread - d6/d1d/d1f/f8c zero size 2024-02-28T23:07:26.322 INFO:tasks.workunit.client.1.smithi184.stdout:0/314: fdatasync d0/df/d13/f53 0 2024-02-28T23:07:26.323 INFO:tasks.workunit.client.0.smithi159.stdout:6/674: dwrite d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/fc1 [0,4194304] 0 2024-02-28T23:07:26.324 INFO:tasks.workunit.client.1.smithi184.stdout:9/316: rename d5/db/de/d64 to d5/db/de/d10/d6a 0 2024-02-28T23:07:26.324 INFO:tasks.workunit.client.1.smithi184.stdout:6/252: dwrite dc/de/f40 [0,4194304] 0 2024-02-28T23:07:26.326 INFO:tasks.workunit.client.1.smithi184.stdout:0/315: chown d0/df/d13/f3e 112 1 2024-02-28T23:07:26.332 INFO:tasks.workunit.client.1.smithi184.stdout:3/321: rename d1/d4/d6/d1f/d24/d5d to d1/d4/d1c/d62 0 2024-02-28T23:07:26.335 INFO:tasks.workunit.client.0.smithi159.stdout:6/675: fsync d0/d1b/d33/d11/fa7 0 2024-02-28T23:07:26.336 INFO:tasks.workunit.client.1.smithi184.stdout:9/317: symlink d5/d26/l6b 0 2024-02-28T23:07:26.338 INFO:tasks.workunit.client.0.smithi159.stdout:6/676: chown d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88 15 1 2024-02-28T23:07:26.343 INFO:tasks.workunit.client.1.smithi184.stdout:1/362: rename d20/d32/d4d/c62 to d20/d46/c7e 0 2024-02-28T23:07:26.346 INFO:tasks.workunit.client.1.smithi184.stdout:6/253: dwrite dc/de/d10/f4b [0,4194304] 0 2024-02-28T23:07:26.348 INFO:tasks.workunit.client.1.smithi184.stdout:3/322: unlink d1/d4/d5/c55 0 2024-02-28T23:07:26.350 INFO:tasks.workunit.client.1.smithi184.stdout:6/254: write dc/de/d10/f1b [1357587,25200] 0 2024-02-28T23:07:26.351 INFO:tasks.workunit.client.1.smithi184.stdout:5/311: rename db/c17 to db/d12/d18/d2e/d3c/d5d/c67 0 2024-02-28T23:07:26.352 INFO:tasks.workunit.client.1.smithi184.stdout:1/363: mknod d20/d32/d4d/c7f 0 2024-02-28T23:07:26.353 INFO:tasks.workunit.client.1.smithi184.stdout:1/364: stat c1 0 2024-02-28T23:07:26.355 INFO:tasks.workunit.client.1.smithi184.stdout:1/365: chown d20/d32/d4d 8141 1 2024-02-28T23:07:26.357 INFO:tasks.workunit.client.1.smithi184.stdout:2/300: rename d10/d1f/d42 to d10/d1f/d21/d4d/d67 0 2024-02-28T23:07:26.357 INFO:tasks.workunit.client.0.smithi159.stdout:6/677: read d0/d1b/d33/d11/d34/d9d/da2/db7/f27 [386406,101213] 0 2024-02-28T23:07:26.361 INFO:tasks.workunit.client.1.smithi184.stdout:8/310: truncate d1/da/dc/d16/d32/d42/f61 3964181 0 2024-02-28T23:07:26.362 INFO:tasks.workunit.client.1.smithi184.stdout:5/312: chown db/cf 1016 1 2024-02-28T23:07:26.365 INFO:tasks.workunit.client.1.smithi184.stdout:1/366: mknod d20/c80 0 2024-02-28T23:07:26.366 INFO:tasks.workunit.client.0.smithi159.stdout:6/678: rename d0/cad to d0/d1b/d33/d3f/d44/d8b/cdb 0 2024-02-28T23:07:26.367 INFO:tasks.workunit.client.0.smithi159.stdout:2/604: sync 2024-02-28T23:07:26.367 INFO:tasks.workunit.client.1.smithi184.stdout:5/313: write db/d12/d1c/d21/d2f/f5a [141285,73756] 0 2024-02-28T23:07:26.367 INFO:tasks.workunit.client.1.smithi184.stdout:1/367: stat d20/d32/d3e 0 2024-02-28T23:07:26.368 INFO:tasks.workunit.client.0.smithi159.stdout:2/605: dread - d9/d23/d2c/d55/fcf zero size 2024-02-28T23:07:26.369 INFO:tasks.workunit.client.1.smithi184.stdout:2/301: rename d10/d33/c5d to d10/d1f/d21/d4d/d67/c68 0 2024-02-28T23:07:26.372 INFO:tasks.workunit.client.1.smithi184.stdout:3/323: getdents d1/d4/d6/d1f/d26 0 2024-02-28T23:07:26.372 INFO:tasks.workunit.client.1.smithi184.stdout:8/311: mknod d1/c76 0 2024-02-28T23:07:26.373 INFO:tasks.workunit.client.0.smithi159.stdout:6/679: creat d0/d1b/d33/d11/d34/d9d/da2/d4e/fdc x:0 0 0 2024-02-28T23:07:26.373 INFO:tasks.workunit.client.1.smithi184.stdout:4/300: dwrite d1/dc/f23 [0,4194304] 0 2024-02-28T23:07:26.374 INFO:tasks.workunit.client.1.smithi184.stdout:8/312: chown d1/l4 0 1 2024-02-28T23:07:26.376 INFO:tasks.workunit.client.0.smithi159.stdout:2/606: creat d9/d50/d54/d8d/fd3 x:0 0 0 2024-02-28T23:07:26.378 INFO:tasks.workunit.client.0.smithi159.stdout:1/678: write d6/f9 [131315,13780] 0 2024-02-28T23:07:26.379 INFO:tasks.workunit.client.0.smithi159.stdout:1/679: chown d6/d1d/fda 0 1 2024-02-28T23:07:26.381 INFO:tasks.workunit.client.0.smithi159.stdout:2/607: unlink d9/d36/d59/f6b 0 2024-02-28T23:07:26.386 INFO:tasks.workunit.client.0.smithi159.stdout:2/608: fsync f6 0 2024-02-28T23:07:26.386 INFO:tasks.workunit.client.1.smithi184.stdout:4/301: rename d1/d8/d37/d49/f4f to d1/d8/d37/f60 0 2024-02-28T23:07:26.387 INFO:tasks.workunit.client.1.smithi184.stdout:4/302: stat d1/d8/d19 0 2024-02-28T23:07:26.387 INFO:tasks.workunit.client.1.smithi184.stdout:3/324: truncate d1/d4/d6/d1f/d24/f3e 1689904 0 2024-02-28T23:07:26.387 INFO:tasks.workunit.client.0.smithi159.stdout:2/609: fdatasync d9/d50/dcc/d44/dc0/fc1 0 2024-02-28T23:07:26.388 INFO:tasks.workunit.client.1.smithi184.stdout:8/313: mkdir d1/da/dc/d16/d32/d42/d77 0 2024-02-28T23:07:26.389 INFO:tasks.workunit.client.0.smithi159.stdout:1/680: rename d6/d12/d31/d69/l61 to d6/d1d/d46/d88/dd3/d9c/le5 0 2024-02-28T23:07:26.390 INFO:tasks.workunit.client.1.smithi184.stdout:4/303: fdatasync d1/d8/f4a 0 2024-02-28T23:07:26.391 INFO:tasks.workunit.client.1.smithi184.stdout:2/302: link d10/f43 d10/d1f/d38/d54/f69 0 2024-02-28T23:07:26.392 INFO:tasks.workunit.client.0.smithi159.stdout:6/680: getdents d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dac 0 2024-02-28T23:07:26.394 INFO:tasks.workunit.client.0.smithi159.stdout:1/681: symlink d6/d12/d1a/d92/dc9/le6 0 2024-02-28T23:07:26.394 INFO:tasks.workunit.client.1.smithi184.stdout:1/368: dwrite d20/d32/d3e/f7c [0,4194304] 0 2024-02-28T23:07:26.396 INFO:tasks.workunit.client.0.smithi159.stdout:2/610: read d9/f25 [3164744,83458] 0 2024-02-28T23:07:26.398 INFO:tasks.workunit.client.0.smithi159.stdout:2/611: stat d9/d23/d2c/d55/d13/la0 0 2024-02-28T23:07:26.398 INFO:tasks.workunit.client.1.smithi184.stdout:3/325: chown d1/d4/d6/d1f/d26/d3a/d59/c5f 4325 1 2024-02-28T23:07:26.399 INFO:tasks.workunit.client.1.smithi184.stdout:8/314: symlink d1/da/d10/d17/l78 0 2024-02-28T23:07:26.400 INFO:tasks.workunit.client.1.smithi184.stdout:1/369: write d20/f25 [273327,87122] 0 2024-02-28T23:07:26.401 INFO:tasks.workunit.client.1.smithi184.stdout:5/314: rmdir db/d12 39 2024-02-28T23:07:26.404 INFO:tasks.workunit.client.0.smithi159.stdout:6/681: unlink d0/d1b/d33/d11/d34/d9d/da2/d4d/c6b 0 2024-02-28T23:07:26.406 INFO:tasks.workunit.client.1.smithi184.stdout:2/303: mkdir d10/d1f/d21/d6a 0 2024-02-28T23:07:26.407 INFO:tasks.workunit.client.1.smithi184.stdout:6/255: dread dc/fd [4194304,4194304] 0 2024-02-28T23:07:26.407 INFO:tasks.workunit.client.1.smithi184.stdout:1/370: write f19 [7425665,10741] 0 2024-02-28T23:07:26.410 INFO:tasks.workunit.client.1.smithi184.stdout:9/318: dwrite d5/fc [0,4194304] 0 2024-02-28T23:07:26.414 INFO:tasks.workunit.client.1.smithi184.stdout:1/371: chown d20/d32/d4b/c5a 1953 1 2024-02-28T23:07:26.417 INFO:tasks.workunit.client.1.smithi184.stdout:3/326: creat d1/d4/f63 x:0 0 0 2024-02-28T23:07:26.424 INFO:tasks.workunit.client.1.smithi184.stdout:5/315: unlink db/d1f/c24 0 2024-02-28T23:07:26.424 INFO:tasks.workunit.client.1.smithi184.stdout:4/304: dwrite d1/f33 [0,4194304] 0 2024-02-28T23:07:26.424 INFO:tasks.workunit.client.1.smithi184.stdout:6/256: fsync dc/de/d10/f24 0 2024-02-28T23:07:26.425 INFO:tasks.workunit.client.0.smithi159.stdout:6/682: dwrite d0/d1b/d33/d3f/fcd [0,4194304] 0 2024-02-28T23:07:26.425 INFO:tasks.workunit.client.0.smithi159.stdout:7/579: sync 2024-02-28T23:07:26.425 INFO:tasks.workunit.client.0.smithi159.stdout:0/816: sync 2024-02-28T23:07:26.425 INFO:tasks.workunit.client.0.smithi159.stdout:8/815: sync 2024-02-28T23:07:26.425 INFO:tasks.workunit.client.0.smithi159.stdout:3/643: sync 2024-02-28T23:07:26.426 INFO:tasks.workunit.client.0.smithi159.stdout:5/652: sync 2024-02-28T23:07:26.426 INFO:tasks.workunit.client.0.smithi159.stdout:4/775: sync 2024-02-28T23:07:26.426 INFO:tasks.workunit.client.0.smithi159.stdout:9/707: sync 2024-02-28T23:07:26.428 INFO:tasks.workunit.client.1.smithi184.stdout:3/327: unlink d1/d4/d6/d1e/c30 0 2024-02-28T23:07:26.433 INFO:tasks.workunit.client.0.smithi159.stdout:4/776: chown d9/d42/d54/d9c/cfa 1531410 1 2024-02-28T23:07:26.434 INFO:tasks.workunit.client.0.smithi159.stdout:5/653: chown d8/d19/d23/d35/d65/fbd 197751756 1 2024-02-28T23:07:26.442 INFO:tasks.workunit.client.1.smithi184.stdout:1/372: dwrite d20/d32/d4d/f53 [0,4194304] 0 2024-02-28T23:07:26.442 INFO:tasks.workunit.client.1.smithi184.stdout:9/319: dread d5/d17/f3d [8388608,4194304] 0 2024-02-28T23:07:26.447 INFO:tasks.workunit.client.0.smithi159.stdout:7/580: mknod d5/d16/d1a/d27/d75/cc1 0 2024-02-28T23:07:26.449 INFO:tasks.workunit.client.1.smithi184.stdout:8/315: rename d1/da/dc/f55 to d1/da/f79 0 2024-02-28T23:07:26.450 INFO:tasks.workunit.client.0.smithi159.stdout:1/682: dwrite d6/d12/d31/f56 [0,4194304] 0 2024-02-28T23:07:26.455 INFO:tasks.workunit.client.1.smithi184.stdout:4/305: symlink d1/dc/df/d38/d3c/l61 0 2024-02-28T23:07:26.456 INFO:tasks.workunit.client.0.smithi159.stdout:7/581: fsync d5/d56/d2a/f45 0 2024-02-28T23:07:26.457 INFO:tasks.workunit.client.0.smithi159.stdout:0/817: dread d0/d5/d38/d63/f7c [0,4194304] 0 2024-02-28T23:07:26.460 INFO:tasks.workunit.client.0.smithi159.stdout:1/683: chown d6/d1d/d1f/db8/dcc 256595 1 2024-02-28T23:07:26.460 INFO:tasks.workunit.client.0.smithi159.stdout:0/818: chown d0/de/d46 1182954571 1 2024-02-28T23:07:26.460 INFO:tasks.workunit.client.0.smithi159.stdout:7/582: write d5/d56/f2f [2219643,124121] 0 2024-02-28T23:07:26.461 INFO:tasks.workunit.client.1.smithi184.stdout:6/257: truncate dc/de/d10/f23 1199244 0 2024-02-28T23:07:26.462 INFO:tasks.workunit.client.1.smithi184.stdout:9/320: dwrite d5/d26/f55 [4194304,4194304] 0 2024-02-28T23:07:26.467 INFO:tasks.workunit.client.0.smithi159.stdout:1/684: stat d6/d1d/d46/c49 0 2024-02-28T23:07:26.468 INFO:tasks.workunit.client.0.smithi159.stdout:8/816: fsync d2/d11/d52/d26/f5a 0 2024-02-28T23:07:26.469 INFO:tasks.workunit.client.0.smithi159.stdout:5/654: mkdir d8/d19/d23/d35/d38/d8f/da5/ddc 0 2024-02-28T23:07:26.472 INFO:tasks.workunit.client.1.smithi184.stdout:3/328: rename d1/d4/d6/d1f/f33 to d1/d4/d5/d40/f64 0 2024-02-28T23:07:26.473 INFO:tasks.workunit.client.0.smithi159.stdout:0/819: read d0/d5/f3f [3831123,60653] 0 2024-02-28T23:07:26.473 INFO:tasks.workunit.client.0.smithi159.stdout:2/612: dwrite d9/d50/d54/d84/d37/f8c [0,4194304] 0 2024-02-28T23:07:26.477 INFO:tasks.workunit.client.1.smithi184.stdout:8/316: rmdir d1/da/dc/d16/d4d 39 2024-02-28T23:07:26.480 INFO:tasks.workunit.client.0.smithi159.stdout:9/708: truncate d4/d3d/d3e/d55/d4c/d4e/d6b/fce 4337723 0 2024-02-28T23:07:26.483 INFO:tasks.workunit.client.0.smithi159.stdout:7/583: unlink d5/d16/d1a/d24/fb2 0 2024-02-28T23:07:26.487 INFO:tasks.workunit.client.1.smithi184.stdout:1/373: rename d20/f27 to d20/d32/d4d/f81 0 2024-02-28T23:07:26.491 INFO:tasks.workunit.client.0.smithi159.stdout:3/644: dread d0/d2b/d55/d75/d6d/f66 [0,4194304] 0 2024-02-28T23:07:26.491 INFO:tasks.workunit.client.0.smithi159.stdout:7/584: chown d5/d16/d1a/d27/d75/l7e 3 1 2024-02-28T23:07:26.491 INFO:tasks.workunit.client.0.smithi159.stdout:6/683: dwrite d0/d1b/d33/d11/d34/d9d/da2/f61 [0,4194304] 0 2024-02-28T23:07:26.492 INFO:tasks.workunit.client.1.smithi184.stdout:1/374: dread d20/f72 [0,4194304] 0 2024-02-28T23:07:26.493 INFO:tasks.workunit.client.0.smithi159.stdout:7/585: chown d5/f18 20 1 2024-02-28T23:07:26.495 INFO:tasks.workunit.client.0.smithi159.stdout:5/655: mknod d8/d19/d23/d35/d41/daa/d88/cdd 0 2024-02-28T23:07:26.495 INFO:tasks.workunit.client.1.smithi184.stdout:7/292: sync 2024-02-28T23:07:26.495 INFO:tasks.workunit.client.1.smithi184.stdout:5/316: dread db/d12/d18/f20 [0,4194304] 0 2024-02-28T23:07:26.496 INFO:tasks.workunit.client.1.smithi184.stdout:7/293: write d6/d9/d13/d14/f42 [1210621,13756] 0 2024-02-28T23:07:26.501 INFO:tasks.workunit.client.1.smithi184.stdout:3/329: rmdir d1/d4/d6 39 2024-02-28T23:07:26.504 INFO:tasks.workunit.client.1.smithi184.stdout:6/258: fdatasync dc/de/f20 0 2024-02-28T23:07:26.508 INFO:tasks.workunit.client.1.smithi184.stdout:0/316: sync 2024-02-28T23:07:26.509 INFO:tasks.workunit.client.1.smithi184.stdout:0/317: write d0/f37 [234443,78361] 0 2024-02-28T23:07:26.514 INFO:tasks.workunit.client.1.smithi184.stdout:9/321: creat d5/db/d65/f6c x:0 0 0 2024-02-28T23:07:26.516 INFO:tasks.workunit.client.0.smithi159.stdout:7/586: dwrite d5/d16/d1a/d24/d64/f79 [4194304,4194304] 0 2024-02-28T23:07:26.516 INFO:tasks.workunit.client.1.smithi184.stdout:9/322: read d5/f7 [2256796,79695] 0 2024-02-28T23:07:26.518 INFO:tasks.workunit.client.1.smithi184.stdout:4/306: write d1/f10 [527930,26960] 0 2024-02-28T23:07:26.520 INFO:tasks.workunit.client.0.smithi159.stdout:2/613: creat d9/d50/d54/d8d/fd4 x:0 0 0 2024-02-28T23:07:26.520 INFO:tasks.workunit.client.1.smithi184.stdout:1/375: mkdir d20/d32/d3e/d82 0 2024-02-28T23:07:26.521 INFO:tasks.workunit.client.0.smithi159.stdout:7/587: write d5/d56/d50/f80 [177609,67027] 0 2024-02-28T23:07:26.525 INFO:tasks.workunit.client.0.smithi159.stdout:0/820: rename d0/de/d75/d5f/f72 to d0/de/d75/de8/f123 0 2024-02-28T23:07:26.526 INFO:tasks.workunit.client.1.smithi184.stdout:5/317: mknod db/d44/c68 0 2024-02-28T23:07:26.526 INFO:tasks.workunit.client.0.smithi159.stdout:0/821: readlink d0/d5/d14/d25/d2c/d4b/l4d 0 2024-02-28T23:07:26.527 INFO:tasks.workunit.client.0.smithi159.stdout:8/817: symlink d2/d11/d52/d26/d36/d38/d77/dc5/df6/l100 0 2024-02-28T23:07:26.527 INFO:tasks.workunit.client.0.smithi159.stdout:0/822: stat d0/de/lc0 0 2024-02-28T23:07:26.530 INFO:tasks.workunit.client.0.smithi159.stdout:7/588: dread d5/d16/d1a/d27/d46/f66 [0,4194304] 0 2024-02-28T23:07:26.533 INFO:tasks.workunit.client.0.smithi159.stdout:3/645: unlink d0/d2b/d55/d75/d6d/d54/d7c/d79/f9f 0 2024-02-28T23:07:26.534 INFO:tasks.workunit.client.1.smithi184.stdout:4/307: dwrite d1/f33 [0,4194304] 0 2024-02-28T23:07:26.538 INFO:tasks.workunit.client.1.smithi184.stdout:8/317: mknod d1/da/dc/d16/d4d/c7a 0 2024-02-28T23:07:26.538 INFO:tasks.workunit.client.0.smithi159.stdout:3/646: fdatasync d0/fac 0 2024-02-28T23:07:26.538 INFO:tasks.workunit.client.0.smithi159.stdout:4/777: link d9/da/d1c/d8e/deb/ca7 d9/d42/d54/c114 0 2024-02-28T23:07:26.539 INFO:tasks.workunit.client.0.smithi159.stdout:1/685: dread d6/d12/d31/d5a/fa2 [0,4194304] 0 2024-02-28T23:07:26.539 INFO:tasks.workunit.client.1.smithi184.stdout:8/318: dread - d1/da/dc/f73 zero size 2024-02-28T23:07:26.541 INFO:tasks.workunit.client.0.smithi159.stdout:2/614: rename d9/fb3 to d9/d50/dcc/fd5 0 2024-02-28T23:07:26.542 INFO:tasks.workunit.client.0.smithi159.stdout:1/686: stat d6/d12/d33/d3c/c4d 0 2024-02-28T23:07:26.544 INFO:tasks.workunit.client.1.smithi184.stdout:9/323: creat d5/db/de/f6d x:0 0 0 2024-02-28T23:07:26.546 INFO:tasks.workunit.client.1.smithi184.stdout:9/324: write d5/db/d65/f6c [578042,73961] 0 2024-02-28T23:07:26.548 INFO:tasks.workunit.client.0.smithi159.stdout:0/823: fdatasync d0/d5/d14/d25/d2c/dab/ff2 0 2024-02-28T23:07:26.548 INFO:tasks.workunit.client.0.smithi159.stdout:8/818: creat d2/d11/d35/d9c/da0/f101 x:0 0 0 2024-02-28T23:07:26.551 INFO:tasks.workunit.client.0.smithi159.stdout:5/656: mknod d8/d19/d23/cde 0 2024-02-28T23:07:26.553 INFO:tasks.workunit.client.1.smithi184.stdout:7/294: creat d6/d9/d13/d1e/d2f/d33/d5b/f6b x:0 0 0 2024-02-28T23:07:26.554 INFO:tasks.workunit.client.1.smithi184.stdout:7/295: write d6/f67 [641996,7472] 0 2024-02-28T23:07:26.555 INFO:tasks.workunit.client.0.smithi159.stdout:9/709: dwrite d4/d3d/d3e/dad/fbf [0,4194304] 0 2024-02-28T23:07:26.560 INFO:tasks.workunit.client.1.smithi184.stdout:9/325: dwrite d5/db/f20 [0,4194304] 0 2024-02-28T23:07:26.563 INFO:tasks.workunit.client.1.smithi184.stdout:0/318: dread d0/df/d13/d27/f39 [0,4194304] 0 2024-02-28T23:07:26.567 INFO:tasks.workunit.client.0.smithi159.stdout:4/778: rename d9/da to d9/d20/d87/d115 0 2024-02-28T23:07:26.568 INFO:tasks.workunit.client.1.smithi184.stdout:6/259: mknod dc/d42/c50 0 2024-02-28T23:07:26.570 INFO:tasks.workunit.client.0.smithi159.stdout:1/687: rmdir d6/d12/d33 39 2024-02-28T23:07:26.578 INFO:tasks.workunit.client.1.smithi184.stdout:2/304: sync 2024-02-28T23:07:26.579 INFO:tasks.workunit.client.1.smithi184.stdout:2/305: chown d10/d1f/f57 446638 1 2024-02-28T23:07:26.580 INFO:tasks.workunit.client.1.smithi184.stdout:2/306: chown d10/d1f/f57 236630310 1 2024-02-28T23:07:26.581 INFO:tasks.workunit.client.1.smithi184.stdout:2/307: readlink d10/d1f/d21/d5e/l3c 0 2024-02-28T23:07:26.582 INFO:tasks.workunit.client.1.smithi184.stdout:2/308: chown d10/d1f/f4c 409299 1 2024-02-28T23:07:26.583 INFO:tasks.workunit.client.1.smithi184.stdout:8/319: mknod d1/da/d10/d43/c7b 0 2024-02-28T23:07:26.585 INFO:tasks.workunit.client.0.smithi159.stdout:6/684: dwrite d0/d1b/d33/f18 [0,4194304] 0 2024-02-28T23:07:26.586 INFO:tasks.workunit.client.0.smithi159.stdout:0/824: mkdir d0/de/d75/db8/d103/d124 0 2024-02-28T23:07:26.593 INFO:tasks.workunit.client.1.smithi184.stdout:1/376: symlink d20/l83 0 2024-02-28T23:07:26.593 INFO:tasks.workunit.client.0.smithi159.stdout:6/685: dread d0/d1b/d5b/fba [0,4194304] 0 2024-02-28T23:07:26.593 INFO:tasks.workunit.client.1.smithi184.stdout:1/377: stat f2 0 2024-02-28T23:07:26.594 INFO:tasks.workunit.client.1.smithi184.stdout:1/378: truncate f1c 650222 0 2024-02-28T23:07:26.596 INFO:tasks.workunit.client.0.smithi159.stdout:6/686: read - d0/d1b/d33/d11/fa7 zero size 2024-02-28T23:07:26.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:26 smithi184 ceph-mon[36198]: pgmap v32: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 176 MiB/s wr, 345 op/s 2024-02-28T23:07:26.601 INFO:tasks.workunit.client.0.smithi159.stdout:2/615: symlink d9/d36/dc3/ld6 0 2024-02-28T23:07:26.602 INFO:tasks.workunit.client.0.smithi159.stdout:2/616: readlink d9/d36/d59/l63 0 2024-02-28T23:07:26.604 INFO:tasks.workunit.client.0.smithi159.stdout:9/710: stat d4/d3d/d3e/d55/d37/d62/l70 0 2024-02-28T23:07:26.605 INFO:tasks.workunit.client.1.smithi184.stdout:7/296: mkdir d6/d9/d13/d1e/d2f/d33/d5b/d6c 0 2024-02-28T23:07:26.606 INFO:tasks.workunit.client.0.smithi159.stdout:9/711: chown d4/f11 15953673 1 2024-02-28T23:07:26.606 INFO:tasks.workunit.client.0.smithi159.stdout:8/819: dread d2/d11/d35/d5f/dfe/d68/fdc [0,4194304] 0 2024-02-28T23:07:26.607 INFO:tasks.workunit.client.0.smithi159.stdout:4/779: creat d9/d20/d87/d115/d1c/d23/d7a/f116 x:0 0 0 2024-02-28T23:07:26.609 INFO:tasks.workunit.client.0.smithi159.stdout:5/657: dread d8/d19/d23/d35/fc3 [0,4194304] 0 2024-02-28T23:07:26.609 INFO:tasks.workunit.client.0.smithi159.stdout:4/780: chown d9/d4c/f5a 1 1 2024-02-28T23:07:26.611 INFO:tasks.workunit.client.0.smithi159.stdout:1/688: mknod d6/d1d/d1f/db8/ce7 0 2024-02-28T23:07:26.617 INFO:tasks.workunit.client.0.smithi159.stdout:7/589: dwrite d5/d16/d1a/d27/d3e/f76 [0,4194304] 0 2024-02-28T23:07:26.623 INFO:tasks.workunit.client.0.smithi159.stdout:6/687: mkdir d0/d1b/dc4/ddd 0 2024-02-28T23:07:26.624 INFO:tasks.workunit.client.1.smithi184.stdout:3/330: rename d1/d4/d6/d1f/d45 to d1/d4/d65 0 2024-02-28T23:07:26.628 INFO:tasks.workunit.client.1.smithi184.stdout:7/297: creat d6/d9/da/dc/d49/d50/f6d x:0 0 0 2024-02-28T23:07:26.628 INFO:tasks.workunit.client.1.smithi184.stdout:3/331: write d1/d4/d6/f46 [575836,11741] 0 2024-02-28T23:07:26.629 INFO:tasks.workunit.client.1.smithi184.stdout:9/326: symlink d5/l6e 0 2024-02-28T23:07:26.629 INFO:tasks.workunit.client.0.smithi159.stdout:9/712: symlink d4/d52/d7d/ldf 0 2024-02-28T23:07:26.631 INFO:tasks.workunit.client.0.smithi159.stdout:4/781: dwrite d9/d20/d87/d115/d1c/f39 [0,4194304] 0 2024-02-28T23:07:26.633 INFO:tasks.workunit.client.1.smithi184.stdout:6/260: symlink dc/de/l51 0 2024-02-28T23:07:26.643 INFO:tasks.workunit.client.1.smithi184.stdout:2/309: unlink d10/d1f/d21/d5e/d15/f19 0 2024-02-28T23:07:26.644 INFO:tasks.workunit.client.0.smithi159.stdout:0/825: getdents d0/de/de7/d101 0 2024-02-28T23:07:26.646 INFO:tasks.workunit.client.1.smithi184.stdout:8/320: mkdir d1/da/df/d20/d7c 0 2024-02-28T23:07:26.647 INFO:tasks.workunit.client.1.smithi184.stdout:8/321: stat d1/da/dc/d16/l74 0 2024-02-28T23:07:26.649 INFO:tasks.workunit.client.0.smithi159.stdout:0/826: read - d0/d5/d14/d25/f85 zero size 2024-02-28T23:07:26.649 INFO:tasks.workunit.client.0.smithi159.stdout:1/689: creat d6/d1d/d46/d88/dd3/d9c/db3/dc4/fe8 x:0 0 0 2024-02-28T23:07:26.652 INFO:tasks.workunit.client.1.smithi184.stdout:1/379: symlink d20/d32/l84 0 2024-02-28T23:07:26.654 INFO:tasks.workunit.client.0.smithi159.stdout:2/617: dwrite d9/d50/d54/d84/f9f [0,4194304] 0 2024-02-28T23:07:26.654 INFO:tasks.workunit.client.0.smithi159.stdout:7/590: symlink d5/d16/d1a/d27/d75/dac/dbe/lc2 0 2024-02-28T23:07:26.654 INFO:tasks.workunit.client.1.smithi184.stdout:5/318: getdents db 0 2024-02-28T23:07:26.658 INFO:tasks.workunit.client.1.smithi184.stdout:5/319: dread - db/d12/d1c/d21/d2f/f4e zero size 2024-02-28T23:07:26.659 INFO:tasks.workunit.client.0.smithi159.stdout:6/688: creat d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/fde x:0 0 0 2024-02-28T23:07:26.663 INFO:tasks.workunit.client.1.smithi184.stdout:0/319: creat d0/f65 x:0 0 0 2024-02-28T23:07:26.664 INFO:tasks.workunit.client.1.smithi184.stdout:3/332: mkdir d1/d4/d1c/d62/d66 0 2024-02-28T23:07:26.665 INFO:tasks.workunit.client.1.smithi184.stdout:8/322: dwrite d1/da/dc/d16/d4d/f5a [0,4194304] 0 2024-02-28T23:07:26.667 INFO:tasks.workunit.client.1.smithi184.stdout:6/261: rename dc/de/l51 to dc/d42/l52 0 2024-02-28T23:07:26.668 INFO:tasks.workunit.client.1.smithi184.stdout:4/308: link d1/d8/l3f d1/dc/df/l62 0 2024-02-28T23:07:26.669 INFO:tasks.workunit.client.0.smithi159.stdout:1/690: mkdir d6/d12/d16/de9 0 2024-02-28T23:07:26.671 INFO:tasks.workunit.client.0.smithi159.stdout:3/647: link d0/d6/d3e/d57/laa d0/lcc 0 2024-02-28T23:07:26.671 INFO:tasks.workunit.client.0.smithi159.stdout:5/658: dread d8/d19/d23/d35/d38/f3e [0,4194304] 0 2024-02-28T23:07:26.672 INFO:tasks.workunit.client.0.smithi159.stdout:6/689: dread d0/d1b/d33/d3f/d44/d7a/fa9 [0,4194304] 0 2024-02-28T23:07:26.673 INFO:tasks.workunit.client.0.smithi159.stdout:7/591: mknod d5/d10/cc3 0 2024-02-28T23:07:26.675 INFO:tasks.workunit.client.1.smithi184.stdout:4/309: dread d1/d8/d35/f47 [0,4194304] 0 2024-02-28T23:07:26.675 INFO:tasks.workunit.client.0.smithi159.stdout:2/618: symlink d9/d36/d59/ld7 0 2024-02-28T23:07:26.675 INFO:tasks.workunit.client.1.smithi184.stdout:5/320: creat db/d12/d1c/d21/d25/f69 x:0 0 0 2024-02-28T23:07:26.676 INFO:tasks.workunit.client.1.smithi184.stdout:9/327: creat d5/d47/d68/f6f x:0 0 0 2024-02-28T23:07:26.677 INFO:tasks.workunit.client.1.smithi184.stdout:4/310: stat d1/dc/df/d38/d3c 0 2024-02-28T23:07:26.678 INFO:tasks.workunit.client.1.smithi184.stdout:5/321: read db/d44/f4c [507836,70601] 0 2024-02-28T23:07:26.679 INFO:tasks.workunit.client.1.smithi184.stdout:9/328: chown d5/db/de/d10/d12/d2f/f51 1 1 2024-02-28T23:07:26.683 INFO:tasks.workunit.client.0.smithi159.stdout:4/782: dread d9/d4c/d6c/d98/fb6 [0,4194304] 0 2024-02-28T23:07:26.686 INFO:tasks.workunit.client.0.smithi159.stdout:0/827: mkdir d0/de/de7/d101/d125 0 2024-02-28T23:07:26.686 INFO:tasks.workunit.client.1.smithi184.stdout:8/323: read d1/da/dc/d16/d32/f46 [197917,116316] 0 2024-02-28T23:07:26.690 INFO:tasks.workunit.client.0.smithi159.stdout:2/619: dread d9/d23/d2c/f2d [0,4194304] 0 2024-02-28T23:07:26.690 INFO:tasks.workunit.client.0.smithi159.stdout:3/648: write d0/d47/d88/f99 [403160,70875] 0 2024-02-28T23:07:26.691 INFO:tasks.workunit.client.1.smithi184.stdout:2/310: truncate d10/f2d 760319 0 2024-02-28T23:07:26.692 INFO:tasks.workunit.client.1.smithi184.stdout:1/380: mkdir d20/d32/d3e/d82/d85 0 2024-02-28T23:07:26.700 INFO:tasks.workunit.client.0.smithi159.stdout:9/713: dwrite d4/d3d/d3e/f73 [0,4194304] 0 2024-02-28T23:07:26.704 INFO:tasks.workunit.client.0.smithi159.stdout:9/714: dread - d4/d3d/d3e/d55/d37/d62/d8f/fdc zero size 2024-02-28T23:07:26.710 INFO:tasks.workunit.client.0.smithi159.stdout:3/649: dwrite d0/d6/d3e/d2f/d78/fc6 [0,4194304] 0 2024-02-28T23:07:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:26 smithi159 ceph-mon[28802]: pgmap v32: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 49 MiB/s rd, 176 MiB/s wr, 345 op/s 2024-02-28T23:07:26.732 INFO:tasks.workunit.client.0.smithi159.stdout:1/691: symlink d6/d1d/d46/d88/dd3/d9c/db3/dc4/lea 0 2024-02-28T23:07:26.753 INFO:tasks.workunit.client.0.smithi159.stdout:1/692: dwrite d6/f9 [0,4194304] 0 2024-02-28T23:07:26.770 INFO:tasks.workunit.client.1.smithi184.stdout:6/262: stat dc/de/l45 0 2024-02-28T23:07:26.772 INFO:tasks.workunit.client.0.smithi159.stdout:6/690: unlink d0/fa 0 2024-02-28T23:07:26.777 INFO:tasks.workunit.client.1.smithi184.stdout:4/311: symlink d1/dc/df/d41/l63 0 2024-02-28T23:07:26.783 INFO:tasks.workunit.client.1.smithi184.stdout:3/333: write d1/d4/d1c/f4f [279925,53768] 0 2024-02-28T23:07:26.783 INFO:tasks.workunit.client.0.smithi159.stdout:8/820: getdents d2/d11/d52/d6e 0 2024-02-28T23:07:26.785 INFO:tasks.workunit.client.1.smithi184.stdout:0/320: link d0/d1f/f28 d0/df/d13/d27/d2b/f66 0 2024-02-28T23:07:26.786 INFO:tasks.workunit.client.1.smithi184.stdout:3/334: read d1/d4/d6/d1f/d26/f29 [1289887,46775] 0 2024-02-28T23:07:26.789 INFO:tasks.workunit.client.1.smithi184.stdout:8/324: truncate d1/da/dc/d16/d32/f46 1009037 0 2024-02-28T23:07:26.791 INFO:tasks.workunit.client.0.smithi159.stdout:4/783: creat d9/d20/d87/d115/d1c/d8e/ddc/dc9/f117 x:0 0 0 2024-02-28T23:07:26.792 INFO:tasks.workunit.client.1.smithi184.stdout:2/311: rmdir d10/d1f/d21/d5e 39 2024-02-28T23:07:26.798 INFO:tasks.workunit.client.0.smithi159.stdout:2/620: creat d9/d50/d54/d8d/fd8 x:0 0 0 2024-02-28T23:07:26.800 INFO:tasks.workunit.client.0.smithi159.stdout:8/821: dwrite d2/d3/f46 [0,4194304] 0 2024-02-28T23:07:26.802 INFO:tasks.workunit.client.0.smithi159.stdout:9/715: mknod d4/d3d/d3e/d55/d4c/d4e/ce0 0 2024-02-28T23:07:26.806 INFO:tasks.workunit.client.0.smithi159.stdout:3/650: unlink d0/d6/d3e/d57/f58 0 2024-02-28T23:07:26.815 INFO:tasks.workunit.client.0.smithi159.stdout:1/693: unlink d6/d12/d1a/d92/d97/dd8/fdf 0 2024-02-28T23:07:26.818 INFO:tasks.workunit.client.1.smithi184.stdout:6/263: truncate dc/de/d10/f4c 1549391 0 2024-02-28T23:07:26.820 INFO:tasks.workunit.client.0.smithi159.stdout:5/659: mknod d8/d19/d23/d35/d65/cdf 0 2024-02-28T23:07:26.821 INFO:tasks.workunit.client.1.smithi184.stdout:7/298: link d6/d9/l4c d6/d9/d13/d3e/l6e 0 2024-02-28T23:07:26.823 INFO:tasks.workunit.client.1.smithi184.stdout:7/299: write d6/d9/f4e [4195526,111796] 0 2024-02-28T23:07:26.829 INFO:tasks.workunit.client.1.smithi184.stdout:5/322: creat db/d12/d18/d2e/d3c/d5d/d66/f6a x:0 0 0 2024-02-28T23:07:26.829 INFO:tasks.workunit.client.1.smithi184.stdout:5/323: chown db/d12 21 1 2024-02-28T23:07:26.831 INFO:tasks.workunit.client.1.smithi184.stdout:5/324: write db/d12/d1c/d21/f5e [587295,54056] 0 2024-02-28T23:07:26.833 INFO:tasks.workunit.client.1.smithi184.stdout:0/321: dread - d0/df/d13/f18 zero size 2024-02-28T23:07:26.833 INFO:tasks.workunit.client.1.smithi184.stdout:5/325: stat db/d12/d18/d2e/d3c/d5d/d66 0 2024-02-28T23:07:26.835 INFO:tasks.workunit.client.1.smithi184.stdout:3/335: fsync d1/d4/f57 0 2024-02-28T23:07:26.835 INFO:tasks.workunit.client.1.smithi184.stdout:0/322: write d0/df/d13/f3b [4889481,105563] 0 2024-02-28T23:07:26.836 INFO:tasks.workunit.client.0.smithi159.stdout:8/822: rmdir d2/d11/d35 39 2024-02-28T23:07:26.837 INFO:tasks.workunit.client.0.smithi159.stdout:9/716: chown d4/l16 4 1 2024-02-28T23:07:26.839 INFO:tasks.workunit.client.1.smithi184.stdout:5/326: truncate db/d12/d18/d2e/d3c/d5d/f33 2163392 0 2024-02-28T23:07:26.841 INFO:tasks.workunit.client.0.smithi159.stdout:9/717: read - d4/d3d/fd2 zero size 2024-02-28T23:07:26.845 INFO:tasks.workunit.client.1.smithi184.stdout:1/381: mkdir d20/d32/d3e/d82/d85/d86 0 2024-02-28T23:07:26.846 INFO:tasks.workunit.client.0.smithi159.stdout:6/691: creat d0/d1b/dc5/fdf x:0 0 0 2024-02-28T23:07:26.846 INFO:tasks.workunit.client.1.smithi184.stdout:3/336: dread d1/d4/d6/f53 [0,4194304] 0 2024-02-28T23:07:26.848 INFO:tasks.workunit.client.1.smithi184.stdout:3/337: chown d1/d4/d5/l2f 11242073 1 2024-02-28T23:07:26.849 INFO:tasks.workunit.client.0.smithi159.stdout:1/694: creat d6/d12/d31/d69/dc0/feb x:0 0 0 2024-02-28T23:07:26.852 INFO:tasks.workunit.client.0.smithi159.stdout:5/660: mknod d8/d19/d23/d35/d65/da3/ce0 0 2024-02-28T23:07:26.855 INFO:tasks.workunit.client.0.smithi159.stdout:4/784: creat d9/d4c/d6c/d98/df2/f118 x:0 0 0 2024-02-28T23:07:26.856 INFO:tasks.workunit.client.1.smithi184.stdout:3/338: dread d1/d4/d6/d1f/d26/d3a/f3d [0,4194304] 0 2024-02-28T23:07:26.857 INFO:tasks.workunit.client.1.smithi184.stdout:4/312: creat d1/dc/df/d22/d51/f64 x:0 0 0 2024-02-28T23:07:26.859 INFO:tasks.workunit.client.0.smithi159.stdout:3/651: creat d0/d6/d3e/da9/fcd x:0 0 0 2024-02-28T23:07:26.860 INFO:tasks.workunit.client.0.smithi159.stdout:3/652: fsync d0/d47/fa4 0 2024-02-28T23:07:26.866 INFO:tasks.workunit.client.1.smithi184.stdout:8/325: getdents d1/da/d10/d6b 0 2024-02-28T23:07:26.869 INFO:tasks.workunit.client.1.smithi184.stdout:0/323: truncate d0/df/f30 3461826 0 2024-02-28T23:07:26.869 INFO:tasks.workunit.client.1.smithi184.stdout:3/339: dwrite d1/f21 [0,4194304] 0 2024-02-28T23:07:26.871 INFO:tasks.workunit.client.1.smithi184.stdout:0/324: readlink d0/df/d13/d27/d31/d5b/l5f 0 2024-02-28T23:07:26.872 INFO:tasks.workunit.client.0.smithi159.stdout:5/661: mkdir d8/d59/de1 0 2024-02-28T23:07:26.872 INFO:tasks.workunit.client.1.smithi184.stdout:5/327: stat db/d12/c14 0 2024-02-28T23:07:26.874 INFO:tasks.workunit.client.0.smithi159.stdout:4/785: dread - d9/d20/d87/fd4 zero size 2024-02-28T23:07:26.882 INFO:tasks.workunit.client.0.smithi159.stdout:8/823: mkdir d2/d11/d52/d26/d36/d38/d77/d9e/dc1/df7/d102 0 2024-02-28T23:07:26.885 INFO:tasks.workunit.client.0.smithi159.stdout:8/824: chown d2/d11/d74/fd0 916 1 2024-02-28T23:07:26.887 INFO:tasks.workunit.client.0.smithi159.stdout:3/653: mknod d0/d2b/d55/d75/d6d/d54/d7c/d79/d9b/cce 0 2024-02-28T23:07:26.890 INFO:tasks.workunit.client.1.smithi184.stdout:1/382: symlink d20/d32/d3e/l87 0 2024-02-28T23:07:26.891 INFO:tasks.workunit.client.0.smithi159.stdout:3/654: chown d0/d2b/l38 0 1 2024-02-28T23:07:26.891 INFO:tasks.workunit.client.0.smithi159.stdout:5/662: dread d8/d19/f78 [0,4194304] 0 2024-02-28T23:07:26.891 INFO:tasks.workunit.client.0.smithi159.stdout:8/825: dread - d2/d11/d52/d26/d36/d38/d77/d9e/dc1/dc4/fe9 zero size 2024-02-28T23:07:26.892 INFO:tasks.workunit.client.0.smithi159.stdout:1/695: dwrite d6/fb [0,4194304] 0 2024-02-28T23:07:26.900 INFO:tasks.workunit.client.1.smithi184.stdout:7/300: mknod d6/c6f 0 2024-02-28T23:07:26.902 INFO:tasks.workunit.client.0.smithi159.stdout:4/786: truncate d9/d20/d87/d115/d1c/d23/f63 3793717 0 2024-02-28T23:07:26.904 INFO:tasks.workunit.client.0.smithi159.stdout:4/787: stat d9/d20/d87/d115/l7c 0 2024-02-28T23:07:26.904 INFO:tasks.workunit.client.1.smithi184.stdout:1/383: dwrite f17 [0,4194304] 0 2024-02-28T23:07:26.907 INFO:tasks.workunit.client.1.smithi184.stdout:1/384: chown d20/c41 7 1 2024-02-28T23:07:26.909 INFO:tasks.workunit.client.1.smithi184.stdout:4/313: creat d1/dc/df/d38/d3c/f65 x:0 0 0 2024-02-28T23:07:26.912 INFO:tasks.workunit.client.1.smithi184.stdout:8/326: write d1/da/dc/d16/f5c [962185,76618] 0 2024-02-28T23:07:26.912 INFO:tasks.workunit.client.1.smithi184.stdout:4/314: write d1/f33 [2104950,6569] 0 2024-02-28T23:07:26.913 INFO:tasks.workunit.client.1.smithi184.stdout:4/315: chown d1/d29 26065 1 2024-02-28T23:07:26.914 INFO:tasks.workunit.client.1.smithi184.stdout:3/340: mkdir d1/d4/d6/d1f/d26/d3a/d59/d67 0 2024-02-28T23:07:26.919 INFO:tasks.workunit.client.1.smithi184.stdout:5/328: mkdir db/d12/d50/d6b 0 2024-02-28T23:07:26.919 INFO:tasks.workunit.client.0.smithi159.stdout:8/826: fdatasync d2/d11/d35/d5f/dfe/d68/fb1 0 2024-02-28T23:07:26.920 INFO:tasks.workunit.client.1.smithi184.stdout:7/301: dwrite d6/d9/da/dc/f1b [0,4194304] 0 2024-02-28T23:07:26.920 INFO:tasks.workunit.client.1.smithi184.stdout:5/329: write db/d12/f47 [712556,50939] 0 2024-02-28T23:07:26.922 INFO:tasks.workunit.client.0.smithi159.stdout:8/827: fsync d2/d11/d52/d26/d36/f23 0 2024-02-28T23:07:26.925 INFO:tasks.workunit.client.0.smithi159.stdout:1/696: creat d6/d12/d1a/d92/fec x:0 0 0 2024-02-28T23:07:26.926 INFO:tasks.workunit.client.0.smithi159.stdout:8/828: dread - d2/d11/d52/d26/d36/d38/ff3 zero size 2024-02-28T23:07:26.926 INFO:tasks.workunit.client.0.smithi159.stdout:8/829: chown d2/d3 1 1 2024-02-28T23:07:26.935 INFO:tasks.workunit.client.0.smithi159.stdout:6/692: getdents d0/d1b/d33/d8c 0 2024-02-28T23:07:26.939 INFO:tasks.workunit.client.1.smithi184.stdout:8/327: rmdir d1 39 2024-02-28T23:07:26.944 INFO:tasks.workunit.client.0.smithi159.stdout:5/663: unlink d8/d19/d23/f6c 0 2024-02-28T23:07:26.953 INFO:tasks.workunit.client.0.smithi159.stdout:6/693: dwrite d0/d1b/d33/d11/d34/d9d/da2/fca [0,4194304] 0 2024-02-28T23:07:26.955 INFO:tasks.workunit.client.1.smithi184.stdout:8/328: dread - d1/da/dc/d16/d32/d42/f6f zero size 2024-02-28T23:07:26.955 INFO:tasks.workunit.client.0.smithi159.stdout:3/655: creat d0/d3f/fcf x:0 0 0 2024-02-28T23:07:26.956 INFO:tasks.workunit.client.1.smithi184.stdout:8/329: fdatasync d1/da/dc/d18/f51 0 2024-02-28T23:07:26.957 INFO:tasks.workunit.client.1.smithi184.stdout:8/330: stat d1/da/df/d20/f30 0 2024-02-28T23:07:26.960 INFO:tasks.workunit.client.0.smithi159.stdout:3/656: truncate d0/d3f/fcf 1006251 0 2024-02-28T23:07:26.961 INFO:tasks.workunit.client.0.smithi159.stdout:5/664: dread d8/d19/f78 [0,4194304] 0 2024-02-28T23:07:26.961 INFO:tasks.workunit.client.1.smithi184.stdout:4/316: link d1/dc/f23 d1/d8/d3d/d44/f66 0 2024-02-28T23:07:26.963 INFO:tasks.workunit.client.0.smithi159.stdout:1/697: mknod d6/d12/d33/d3c/ced 0 2024-02-28T23:07:26.964 INFO:tasks.workunit.client.1.smithi184.stdout:7/302: mknod d6/d9/d13/d1e/d2f/d33/d5b/d6c/c70 0 2024-02-28T23:07:26.970 INFO:tasks.workunit.client.0.smithi159.stdout:1/698: read d6/d12/d33/d3c/f55 [2903380,1030] 0 2024-02-28T23:07:26.973 INFO:tasks.workunit.client.1.smithi184.stdout:8/331: mkdir d1/da/dc/d16/d29/d7d 0 2024-02-28T23:07:26.975 INFO:tasks.workunit.client.0.smithi159.stdout:4/788: rename d9/d42/d54/c8b to d9/d20/d87/d115/c119 0 2024-02-28T23:07:26.979 INFO:tasks.workunit.client.0.smithi159.stdout:0/828: write d0/de/ff4 [139520,74846] 0 2024-02-28T23:07:26.983 INFO:tasks.workunit.client.0.smithi159.stdout:1/699: mkdir d6/d1d/d1f/db8/dee 0 2024-02-28T23:07:26.985 INFO:tasks.workunit.client.0.smithi159.stdout:8/830: creat d2/d11/d52/f103 x:0 0 0 2024-02-28T23:07:26.986 INFO:tasks.workunit.client.0.smithi159.stdout:1/700: write d6/d12/d16/db6/fd9 [174723,122646] 0 2024-02-28T23:07:26.990 INFO:tasks.workunit.client.0.smithi159.stdout:3/657: creat d0/d2b/d55/d75/d6d/d54/d6a/fd0 x:0 0 0 2024-02-28T23:07:26.992 INFO:tasks.workunit.client.0.smithi159.stdout:4/789: truncate d9/d20/d87/d115/d1c/d23/f2f 1373833 0 2024-02-28T23:07:26.996 INFO:tasks.workunit.client.1.smithi184.stdout:8/332: link d1/da/dc/d16/d29/c4f d1/da/df/d20/c7e 0 2024-02-28T23:07:26.999 INFO:tasks.workunit.client.1.smithi184.stdout:4/317: getdents d1/d29 0 2024-02-28T23:07:27.001 INFO:tasks.workunit.client.0.smithi159.stdout:1/701: rmdir d6/d12/d1a/d92/d97 39 2024-02-28T23:07:27.005 INFO:tasks.workunit.client.0.smithi159.stdout:3/658: mknod d0/d2b/d55/cd1 0 2024-02-28T23:07:27.008 INFO:tasks.workunit.client.0.smithi159.stdout:5/665: link d8/d19/d23/d35/f5e d8/d19/d23/d35/d65/da3/dd2/fe2 0 2024-02-28T23:07:27.014 INFO:tasks.workunit.client.1.smithi184.stdout:4/318: dwrite d1/dc/df/f14 [0,4194304] 0 2024-02-28T23:07:27.017 INFO:tasks.workunit.client.0.smithi159.stdout:1/702: creat d6/d1d/d46/d88/fef x:0 0 0 2024-02-28T23:07:27.018 INFO:tasks.workunit.client.0.smithi159.stdout:5/666: fsync d8/d19/d23/d35/d65/fac 0 2024-02-28T23:07:27.020 INFO:tasks.workunit.client.1.smithi184.stdout:8/333: rmdir d1/da/d10 39 2024-02-28T23:07:27.022 INFO:tasks.workunit.client.1.smithi184.stdout:8/334: fsync d1/da/dc/d18/f64 0 2024-02-28T23:07:27.031 INFO:tasks.workunit.client.1.smithi184.stdout:4/319: dread d1/f12 [0,4194304] 0 2024-02-28T23:07:27.039 INFO:tasks.workunit.client.0.smithi159.stdout:2/621: dwrite d9/f11 [0,4194304] 0 2024-02-28T23:07:27.058 INFO:tasks.workunit.client.1.smithi184.stdout:3/341: creat d1/d4/d6/d1f/f68 x:0 0 0 2024-02-28T23:07:27.065 INFO:tasks.workunit.client.1.smithi184.stdout:3/342: unlink d1/d4/d5/c13 0 2024-02-28T23:07:27.067 INFO:tasks.workunit.client.0.smithi159.stdout:1/703: chown d6/d1d/d1f/db8/ce4 323 1 2024-02-28T23:07:27.067 INFO:tasks.workunit.client.0.smithi159.stdout:5/667: creat d8/d19/d23/d35/d41/d92/fe3 x:0 0 0 2024-02-28T23:07:27.067 INFO:tasks.workunit.client.1.smithi184.stdout:3/343: truncate d1/d4/d6/f51 509167 0 2024-02-28T23:07:27.067 INFO:tasks.workunit.client.1.smithi184.stdout:2/312: truncate d10/f18 715044 0 2024-02-28T23:07:27.068 INFO:tasks.workunit.client.0.smithi159.stdout:1/704: chown d6/d12/d1a/d92/dc9/lcb 397458 1 2024-02-28T23:07:27.072 INFO:tasks.workunit.client.0.smithi159.stdout:5/668: creat d8/d19/d23/d35/d41/daa/d79/fe4 x:0 0 0 2024-02-28T23:07:27.075 INFO:tasks.workunit.client.0.smithi159.stdout:7/592: rmdir d5/d16/d1a/d27 39 2024-02-28T23:07:27.075 INFO:tasks.workunit.client.0.smithi159.stdout:5/669: read - d8/d19/d23/d35/d41/daa/f89 zero size 2024-02-28T23:07:27.082 INFO:tasks.workunit.client.0.smithi159.stdout:6/694: rename d0/d1b/d33/d11/d34/d9d/da2/db7/f69 to d0/d1b/d33/d3f/fe0 0 2024-02-28T23:07:27.085 INFO:tasks.workunit.client.0.smithi159.stdout:8/831: rename d2/ff to d2/d11/d52/d6e/f104 0 2024-02-28T23:07:27.087 INFO:tasks.workunit.client.0.smithi159.stdout:6/695: creat d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/fe1 x:0 0 0 2024-02-28T23:07:27.090 INFO:tasks.workunit.client.0.smithi159.stdout:4/790: rename d9/d20/d87/d115/d1c/dc3/fea to d9/d42/d54/d55/da8/f11a 0 2024-02-28T23:07:27.091 INFO:tasks.workunit.client.0.smithi159.stdout:8/832: truncate d2/d11/fb3 51005 0 2024-02-28T23:07:27.091 INFO:tasks.workunit.client.1.smithi184.stdout:5/330: sync 2024-02-28T23:07:27.094 INFO:tasks.workunit.client.1.smithi184.stdout:5/331: chown db/d12/d18/d2e/d3c/d5d/f3e 4 1 2024-02-28T23:07:27.097 INFO:tasks.workunit.client.0.smithi159.stdout:2/622: rename d9/d50/l58 to d9/d23/d2c/d55/d13/ld9 0 2024-02-28T23:07:27.098 INFO:tasks.workunit.client.1.smithi184.stdout:0/325: link d0/d1d/f3d d0/df/f67 0 2024-02-28T23:07:27.101 INFO:tasks.workunit.client.0.smithi159.stdout:6/696: dread d0/d1b/d33/d3f/fcd [0,4194304] 0 2024-02-28T23:07:27.102 INFO:tasks.workunit.client.0.smithi159.stdout:4/791: fsync d9/d42/db1/fd0 0 2024-02-28T23:07:27.106 INFO:tasks.workunit.client.1.smithi184.stdout:0/326: creat d0/df/d13/d27/d2b/f68 x:0 0 0 2024-02-28T23:07:27.107 INFO:tasks.workunit.client.0.smithi159.stdout:8/833: chown d2/d11/d35/d5f/f92 3 1 2024-02-28T23:07:27.108 INFO:tasks.workunit.client.1.smithi184.stdout:9/329: mknod d5/db/c70 0 2024-02-28T23:07:27.112 INFO:tasks.workunit.client.1.smithi184.stdout:1/385: write d20/f72 [757253,89552] 0 2024-02-28T23:07:27.113 INFO:tasks.workunit.client.0.smithi159.stdout:5/670: rename d8/d19/d23/f76 to d8/d19/d23/d35/d41/d77/fe5 0 2024-02-28T23:07:27.115 INFO:tasks.workunit.client.1.smithi184.stdout:0/327: creat d0/d1d/d4c/f69 x:0 0 0 2024-02-28T23:07:27.115 INFO:tasks.workunit.client.0.smithi159.stdout:2/623: dwrite d9/d23/d2c/f32 [0,4194304] 0 2024-02-28T23:07:27.116 INFO:tasks.workunit.client.1.smithi184.stdout:5/332: link db/d12/d1c/c31 db/d1f/c6c 0 2024-02-28T23:07:27.118 INFO:tasks.workunit.client.1.smithi184.stdout:0/328: chown d0/df/c23 1 1 2024-02-28T23:07:27.120 INFO:tasks.workunit.client.0.smithi159.stdout:2/624: dread - d9/d50/d54/d84/d37/fca zero size 2024-02-28T23:07:27.122 INFO:tasks.workunit.client.0.smithi159.stdout:6/697: dwrite d0/d1b/d33/d11/d34/d9d/da2/db7/f7f [0,4194304] 0 2024-02-28T23:07:27.123 INFO:tasks.workunit.client.1.smithi184.stdout:1/386: unlink d20/f2b 0 2024-02-28T23:07:27.125 INFO:tasks.workunit.client.1.smithi184.stdout:6/264: mkdir dc/d53 0 2024-02-28T23:07:27.130 INFO:tasks.workunit.client.1.smithi184.stdout:0/329: symlink d0/d1d/d3a/l6a 0 2024-02-28T23:07:27.132 INFO:tasks.workunit.client.0.smithi159.stdout:2/625: mkdir d9/d50/dcc/d44/dc0/dda 0 2024-02-28T23:07:27.135 INFO:tasks.workunit.client.1.smithi184.stdout:8/335: rename d1/da/df/l6d to d1/da/dc/d16/l7f 0 2024-02-28T23:07:27.136 INFO:tasks.workunit.client.1.smithi184.stdout:9/330: dwrite d5/d17/f28 [0,4194304] 0 2024-02-28T23:07:27.139 INFO:tasks.workunit.client.1.smithi184.stdout:4/320: sync 2024-02-28T23:07:27.146 INFO:tasks.workunit.client.0.smithi159.stdout:6/698: symlink d0/d1b/d33/d3f/d44/d8b/le2 0 2024-02-28T23:07:27.149 INFO:tasks.workunit.client.1.smithi184.stdout:6/265: mknod dc/de/d2a/c54 0 2024-02-28T23:07:27.151 INFO:tasks.workunit.client.1.smithi184.stdout:7/303: write d6/d9/da/dc/f12 [1940160,103748] 0 2024-02-28T23:07:27.151 INFO:tasks.workunit.client.1.smithi184.stdout:5/333: dwrite db/d12/d1c/d21/d4d/f56 [0,4194304] 0 2024-02-28T23:07:27.152 INFO:tasks.workunit.client.0.smithi159.stdout:5/671: read - d8/d19/d23/d2a/f32 zero size 2024-02-28T23:07:27.154 INFO:tasks.workunit.client.0.smithi159.stdout:6/699: read d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/fc1 [1131040,79936] 0 2024-02-28T23:07:27.154 INFO:tasks.workunit.client.1.smithi184.stdout:0/330: creat d0/d1d/d4c/f6b x:0 0 0 2024-02-28T23:07:27.160 INFO:tasks.workunit.client.1.smithi184.stdout:2/313: rename d10/d1f/d21/d5e/d15/f5b to d10/d1f/d21/d5e/d15/d60/d66/f6b 0 2024-02-28T23:07:27.160 INFO:tasks.workunit.client.0.smithi159.stdout:5/672: write d8/db4/fd1 [210892,114625] 0 2024-02-28T23:07:27.160 INFO:tasks.workunit.client.0.smithi159.stdout:2/626: creat d9/d36/dc3/fdb x:0 0 0 2024-02-28T23:07:27.160 INFO:tasks.workunit.client.0.smithi159.stdout:6/700: chown d0/d1b/d33/d11/d34/d9d/da2/db7/db1/f87 1876 1 2024-02-28T23:07:27.161 INFO:tasks.workunit.client.1.smithi184.stdout:9/331: read d5/db/d65/f6c [534820,37786] 0 2024-02-28T23:07:27.161 INFO:tasks.workunit.client.1.smithi184.stdout:8/336: mkdir d1/da/dc/d16/d32/d80 0 2024-02-28T23:07:27.166 INFO:tasks.workunit.client.1.smithi184.stdout:4/321: dwrite d1/d8/d35/f42 [0,4194304] 0 2024-02-28T23:07:27.173 INFO:tasks.workunit.client.0.smithi159.stdout:4/792: rename d9/d20/d87/d115/d1c/d8e/deb/ca7 to d9/d20/d87/d115/d1c/c11b 0 2024-02-28T23:07:27.173 INFO:tasks.workunit.client.0.smithi159.stdout:8/834: dread d2/d11/d52/d26/d36/f64 [0,4194304] 0 2024-02-28T23:07:27.174 INFO:tasks.workunit.client.0.smithi159.stdout:5/673: rmdir d8/d19 39 2024-02-28T23:07:27.175 INFO:tasks.workunit.client.0.smithi159.stdout:0/829: write d0/d5/d14/f4f [477698,108997] 0 2024-02-28T23:07:27.175 INFO:tasks.workunit.client.1.smithi184.stdout:7/304: dwrite d6/d9/f4e [0,4194304] 0 2024-02-28T23:07:27.176 INFO:tasks.workunit.client.0.smithi159.stdout:2/627: creat d9/d50/d54/d8d/fdc x:0 0 0 2024-02-28T23:07:27.177 INFO:tasks.workunit.client.0.smithi159.stdout:0/830: chown d0/d5/d38/fde 7960 1 2024-02-28T23:07:27.177 INFO:tasks.workunit.client.1.smithi184.stdout:7/305: dread - d6/d9/da/dc/d49/f4f zero size 2024-02-28T23:07:27.184 INFO:tasks.workunit.client.0.smithi159.stdout:0/831: write d0/d5/d14/d25/d2c/dab/dc5/ff7 [210884,63111] 0 2024-02-28T23:07:27.187 INFO:tasks.workunit.client.0.smithi159.stdout:5/674: creat d8/db4/fe6 x:0 0 0 2024-02-28T23:07:27.188 INFO:tasks.workunit.client.1.smithi184.stdout:0/331: creat d0/df/d13/d27/d31/d5b/f6c x:0 0 0 2024-02-28T23:07:27.190 INFO:tasks.workunit.client.1.smithi184.stdout:9/332: chown d5/c4b 4 1 2024-02-28T23:07:27.190 INFO:tasks.workunit.client.0.smithi159.stdout:2/628: creat d9/d50/d62/fdd x:0 0 0 2024-02-28T23:07:27.192 INFO:tasks.workunit.client.0.smithi159.stdout:4/793: creat d9/d42/d54/d9c/dd7/f11c x:0 0 0 2024-02-28T23:07:27.193 INFO:tasks.workunit.client.0.smithi159.stdout:6/701: dwrite d0/d1b/f3c [4194304,4194304] 0 2024-02-28T23:07:27.197 INFO:tasks.workunit.client.0.smithi159.stdout:4/794: readlink d9/d20/d87/d115/d1c/d23/l44 0 2024-02-28T23:07:27.200 INFO:tasks.workunit.client.0.smithi159.stdout:4/795: fdatasync d9/d42/d95/f100 0 2024-02-28T23:07:27.215 INFO:tasks.workunit.client.0.smithi159.stdout:2/629: symlink d9/d23/d2c/d55/d13/lde 0 2024-02-28T23:07:27.218 INFO:tasks.workunit.client.1.smithi184.stdout:4/322: write d1/d8/d37/f4c [4493801,59817] 0 2024-02-28T23:07:27.220 INFO:tasks.workunit.client.1.smithi184.stdout:4/323: chown d1/dc/df/f14 281202553 1 2024-02-28T23:07:27.220 INFO:tasks.workunit.client.1.smithi184.stdout:2/314: dread d10/d1f/d38/d54/f69 [0,4194304] 0 2024-02-28T23:07:27.221 INFO:tasks.workunit.client.1.smithi184.stdout:2/315: stat d10/d1f/d21/d5e/f47 0 2024-02-28T23:07:27.223 INFO:tasks.workunit.client.0.smithi159.stdout:8/835: dwrite d2/d3/f20 [0,4194304] 0 2024-02-28T23:07:27.224 INFO:tasks.workunit.client.1.smithi184.stdout:6/266: rename dc/de/d10/d16/c33 to dc/d53/c55 0 2024-02-28T23:07:27.228 INFO:tasks.workunit.client.1.smithi184.stdout:6/267: truncate dc/de/d10/d16/f2d 712931 0 2024-02-28T23:07:27.230 INFO:tasks.workunit.client.1.smithi184.stdout:6/268: write dc/de/f40 [3921999,71603] 0 2024-02-28T23:07:27.238 INFO:tasks.workunit.client.1.smithi184.stdout:0/332: creat d0/d1d/f6d x:0 0 0 2024-02-28T23:07:27.240 INFO:tasks.workunit.client.1.smithi184.stdout:8/337: symlink d1/da/dc/d16/d32/d42/d77/l81 0 2024-02-28T23:07:27.240 INFO:tasks.workunit.client.1.smithi184.stdout:4/324: dwrite d1/d8/d19/f1a [0,4194304] 0 2024-02-28T23:07:27.248 INFO:tasks.workunit.client.0.smithi159.stdout:6/702: mknod d0/ce3 0 2024-02-28T23:07:27.256 INFO:tasks.workunit.client.1.smithi184.stdout:8/338: dwrite d1/da/f31 [4194304,4194304] 0 2024-02-28T23:07:27.257 INFO:tasks.workunit.client.0.smithi159.stdout:8/836: symlink d2/d11/d52/d26/d36/d38/d77/d9e/dc1/l105 0 2024-02-28T23:07:27.258 INFO:tasks.workunit.client.1.smithi184.stdout:9/333: sync 2024-02-28T23:07:27.259 INFO:tasks.workunit.client.0.smithi159.stdout:8/837: readlink d2/d11/d74/lea 0 2024-02-28T23:07:27.262 INFO:tasks.workunit.client.1.smithi184.stdout:9/334: truncate d5/db/de/d10/d12/f4d 1166144 0 2024-02-28T23:07:27.265 INFO:tasks.workunit.client.0.smithi159.stdout:4/796: rename d9/d20/d87/d115/d1c/d23/d2d/c10f to d9/d20/d87/d115/d1c/d8e/ddc/dc9/c11d 0 2024-02-28T23:07:27.266 INFO:tasks.workunit.client.0.smithi159.stdout:0/832: creat d0/f126 x:0 0 0 2024-02-28T23:07:27.267 INFO:tasks.workunit.client.0.smithi159.stdout:2/630: dread d9/d23/d2c/d55/d13/f40 [0,4194304] 0 2024-02-28T23:07:27.268 INFO:tasks.workunit.client.1.smithi184.stdout:7/306: rename d6/d9/d13/d1e/c5d to d6/d68/c71 0 2024-02-28T23:07:27.269 INFO:tasks.workunit.client.1.smithi184.stdout:7/307: dread - d6/f46 zero size 2024-02-28T23:07:27.278 INFO:tasks.workunit.client.1.smithi184.stdout:3/344: write d1/d4/d6/d1f/d26/f2a [584372,103161] 0 2024-02-28T23:07:27.281 INFO:tasks.workunit.client.0.smithi159.stdout:3/659: dwrite d0/d6/d3e/f5b [0,4194304] 0 2024-02-28T23:07:27.286 INFO:tasks.workunit.client.1.smithi184.stdout:6/269: dread dc/de/d10/f19 [4194304,4194304] 0 2024-02-28T23:07:27.296 INFO:tasks.workunit.client.0.smithi159.stdout:1/705: dwrite d6/d12/d31/d69/f77 [0,4194304] 0 2024-02-28T23:07:27.299 INFO:tasks.workunit.client.0.smithi159.stdout:7/593: dwrite d5/f18 [0,4194304] 0 2024-02-28T23:07:27.300 INFO:tasks.workunit.client.0.smithi159.stdout:1/706: readlink d6/d1d/d46/l89 0 2024-02-28T23:07:27.301 INFO:tasks.workunit.client.1.smithi184.stdout:0/333: creat d0/df/d13/d27/d31/d5b/f6e x:0 0 0 2024-02-28T23:07:27.311 INFO:tasks.workunit.client.0.smithi159.stdout:0/833: rename d0/de/d75/l102 to d0/de/d75/db8/d103/d121/l127 0 2024-02-28T23:07:27.312 INFO:tasks.workunit.client.1.smithi184.stdout:4/325: mkdir d1/d8/d19/d67 0 2024-02-28T23:07:27.316 INFO:tasks.workunit.client.1.smithi184.stdout:1/387: link fb d20/f88 0 2024-02-28T23:07:27.320 INFO:tasks.workunit.client.0.smithi159.stdout:2/631: dread d9/f33 [0,4194304] 0 2024-02-28T23:07:27.322 INFO:tasks.workunit.client.1.smithi184.stdout:8/339: mkdir d1/da/dc/d16/d4d/d82 0 2024-02-28T23:07:27.324 INFO:tasks.workunit.client.0.smithi159.stdout:2/632: write d9/d50/d54/d8d/fdc [583700,96186] 0 2024-02-28T23:07:27.327 INFO:tasks.workunit.client.0.smithi159.stdout:8/838: truncate d2/d11/d35/d5f/dfe/d68/fb1 6075941 0 2024-02-28T23:07:27.328 INFO:tasks.workunit.client.1.smithi184.stdout:9/335: mknod d5/d17/d43/c71 0 2024-02-28T23:07:27.331 INFO:tasks.workunit.client.1.smithi184.stdout:4/326: dwrite d1/dc/df/d38/f53 [0,4194304] 0 2024-02-28T23:07:27.338 INFO:tasks.workunit.client.1.smithi184.stdout:7/308: unlink d6/d9/da/dc/f2b 0 2024-02-28T23:07:27.339 INFO:tasks.workunit.client.1.smithi184.stdout:7/309: chown d6/d9/da/dc/d49/d50 25456559 1 2024-02-28T23:07:27.340 INFO:tasks.workunit.client.0.smithi159.stdout:7/594: mknod d5/d56/d50/d5b/cc4 0 2024-02-28T23:07:27.345 INFO:tasks.workunit.client.1.smithi184.stdout:3/345: unlink d1/d4/d1c/f4f 0 2024-02-28T23:07:27.348 INFO:tasks.workunit.client.1.smithi184.stdout:5/334: link db/c30 db/d12/d1c/d21/c6d 0 2024-02-28T23:07:27.349 INFO:tasks.workunit.client.1.smithi184.stdout:5/335: dread - db/f61 zero size 2024-02-28T23:07:27.351 INFO:tasks.workunit.client.1.smithi184.stdout:0/334: creat d0/d1d/d4c/f6f x:0 0 0 2024-02-28T23:07:27.354 INFO:tasks.workunit.client.1.smithi184.stdout:1/388: creat d20/d46/f89 x:0 0 0 2024-02-28T23:07:27.356 INFO:tasks.workunit.client.1.smithi184.stdout:8/340: rmdir d1/da 39 2024-02-28T23:07:27.357 INFO:tasks.workunit.client.1.smithi184.stdout:7/310: dwrite d6/d9/d13/d1e/d2f/d34/d47/f56 [0,4194304] 0 2024-02-28T23:07:27.370 INFO:tasks.workunit.client.1.smithi184.stdout:4/327: stat d1/c4d 0 2024-02-28T23:07:27.372 INFO:tasks.workunit.client.1.smithi184.stdout:4/328: write d1/d8/d37/f4c [3922740,4974] 0 2024-02-28T23:07:27.374 INFO:tasks.workunit.client.0.smithi159.stdout:2/633: creat d9/d50/dcc/d44/dc0/dda/fdf x:0 0 0 2024-02-28T23:07:27.377 INFO:tasks.workunit.client.1.smithi184.stdout:4/329: read d1/d4/f1f [3933013,90497] 0 2024-02-28T23:07:27.377 INFO:tasks.workunit.client.1.smithi184.stdout:3/346: mknod d1/d4/d6/d1f/d26/c69 0 2024-02-28T23:07:27.379 INFO:tasks.workunit.client.0.smithi159.stdout:7/595: rmdir d5/d16/d1a/d27/d46/d65 39 2024-02-28T23:07:27.380 INFO:tasks.workunit.client.1.smithi184.stdout:6/270: mkdir dc/de/d56 0 2024-02-28T23:07:27.383 INFO:tasks.workunit.client.1.smithi184.stdout:6/271: write dc/de/d10/f4b [1365034,61826] 0 2024-02-28T23:07:27.385 INFO:tasks.workunit.client.0.smithi159.stdout:5/675: dwrite d8/d19/f78 [0,4194304] 0 2024-02-28T23:07:27.387 INFO:tasks.workunit.client.1.smithi184.stdout:9/336: dread d5/f24 [0,4194304] 0 2024-02-28T23:07:27.387 INFO:tasks.workunit.client.0.smithi159.stdout:2/634: dread d9/d36/d59/fad [0,4194304] 0 2024-02-28T23:07:27.388 INFO:tasks.workunit.client.0.smithi159.stdout:9/718: sync 2024-02-28T23:07:27.389 INFO:tasks.workunit.client.0.smithi159.stdout:3/660: rename d0/d2b/d55/d75/d6d/d54 to d0/d3f/dd2 0 2024-02-28T23:07:27.392 INFO:tasks.workunit.client.0.smithi159.stdout:3/661: dread d0/d2b/fba [0,4194304] 0 2024-02-28T23:07:27.400 INFO:tasks.workunit.client.0.smithi159.stdout:6/703: write d0/d1b/f81 [526857,79938] 0 2024-02-28T23:07:27.402 INFO:tasks.workunit.client.0.smithi159.stdout:7/596: mknod d5/d56/d2a/cc5 0 2024-02-28T23:07:27.403 INFO:tasks.workunit.client.1.smithi184.stdout:7/311: creat d6/d9/d13/d1e/d2f/d33/f72 x:0 0 0 2024-02-28T23:07:27.405 INFO:tasks.workunit.client.0.smithi159.stdout:1/707: getdents d6/d12/d31/d5a 0 2024-02-28T23:07:27.413 INFO:tasks.workunit.client.1.smithi184.stdout:4/330: write d1/d8/d35/f47 [1343751,85693] 0 2024-02-28T23:07:27.415 INFO:tasks.workunit.client.1.smithi184.stdout:3/347: mkdir d1/d4/d6/d1f/d26/d3a/d59/d6a 0 2024-02-28T23:07:27.418 INFO:tasks.workunit.client.0.smithi159.stdout:3/662: mknod d0/d47/d88/cd3 0 2024-02-28T23:07:27.419 INFO:tasks.workunit.client.0.smithi159.stdout:3/663: chown d0/d47/cb7 11918627 1 2024-02-28T23:07:27.421 INFO:tasks.workunit.client.1.smithi184.stdout:6/272: stat dc/c2e 0 2024-02-28T23:07:27.423 INFO:tasks.workunit.client.1.smithi184.stdout:0/335: sync 2024-02-28T23:07:27.426 INFO:tasks.workunit.client.1.smithi184.stdout:0/336: dread - d0/f65 zero size 2024-02-28T23:07:27.426 INFO:tasks.workunit.client.1.smithi184.stdout:1/389: symlink d20/d32/d51/l8a 0 2024-02-28T23:07:27.429 INFO:tasks.workunit.client.1.smithi184.stdout:0/337: read d0/d1f/f4b [2444375,75300] 0 2024-02-28T23:07:27.430 INFO:tasks.workunit.client.0.smithi159.stdout:1/708: rmdir d6/d1d/d46/d88/dd3/d9c 39 2024-02-28T23:07:27.431 INFO:tasks.workunit.client.1.smithi184.stdout:1/390: dread d20/d32/f44 [0,4194304] 0 2024-02-28T23:07:27.432 INFO:tasks.workunit.client.1.smithi184.stdout:4/331: dwrite d1/dc/df/f5f [0,4194304] 0 2024-02-28T23:07:27.432 INFO:tasks.workunit.client.0.smithi159.stdout:1/709: chown d6/d1d/d46/d88/f94 269627779 1 2024-02-28T23:07:27.433 INFO:tasks.workunit.client.1.smithi184.stdout:2/316: truncate d10/d1f/d21/d5e/d15/f2e 1192763 0 2024-02-28T23:07:27.434 INFO:tasks.workunit.client.1.smithi184.stdout:2/317: write d10/f1d [2507046,86159] 0 2024-02-28T23:07:27.436 INFO:tasks.workunit.client.1.smithi184.stdout:4/332: truncate d1/dc/df/d38/f53 4706630 0 2024-02-28T23:07:27.437 INFO:tasks.workunit.client.1.smithi184.stdout:4/333: stat d1/f12 0 2024-02-28T23:07:27.437 INFO:tasks.workunit.client.0.smithi159.stdout:8/839: rename d2/d73/c8b to d2/d11/d52/d47/c106 0 2024-02-28T23:07:27.439 INFO:tasks.workunit.client.1.smithi184.stdout:4/334: dread - d1/dc/df/d38/d3c/f65 zero size 2024-02-28T23:07:27.442 INFO:tasks.workunit.client.0.smithi159.stdout:0/834: dwrite d0/d5/d14/d25/d2c/dab/fd0 [0,4194304] 0 2024-02-28T23:07:27.446 INFO:tasks.workunit.client.1.smithi184.stdout:7/312: dread d6/d9/d13/d1e/d2f/f44 [0,4194304] 0 2024-02-28T23:07:27.447 INFO:tasks.workunit.client.1.smithi184.stdout:6/273: symlink dc/de/d2a/l57 0 2024-02-28T23:07:27.449 INFO:tasks.workunit.client.1.smithi184.stdout:6/274: chown dc/de 17273177 1 2024-02-28T23:07:27.450 INFO:tasks.workunit.client.1.smithi184.stdout:9/337: symlink d5/db/l72 0 2024-02-28T23:07:27.450 INFO:tasks.workunit.client.0.smithi159.stdout:4/797: truncate d9/d20/d87/d115/d1c/d23/f63 3693780 0 2024-02-28T23:07:27.451 INFO:tasks.workunit.client.1.smithi184.stdout:3/348: read d1/d4/d1c/f52 [3203288,26421] 0 2024-02-28T23:07:27.453 INFO:tasks.workunit.client.1.smithi184.stdout:8/341: dwrite d1/da/dc/d16/d32/d42/f61 [0,4194304] 0 2024-02-28T23:07:27.453 INFO:tasks.workunit.client.1.smithi184.stdout:4/335: dread d1/dc/f23 [0,4194304] 0 2024-02-28T23:07:27.456 INFO:tasks.workunit.client.1.smithi184.stdout:8/342: chown d1/da/dc/d16/d4d/f5a 238222 1 2024-02-28T23:07:27.456 INFO:tasks.workunit.client.0.smithi159.stdout:9/719: creat d4/d3d/fe1 x:0 0 0 2024-02-28T23:07:27.459 INFO:tasks.workunit.client.1.smithi184.stdout:1/391: rmdir d20/d46 39 2024-02-28T23:07:27.468 INFO:tasks.workunit.client.0.smithi159.stdout:5/676: dwrite d8/d16/f6a [4194304,4194304] 0 2024-02-28T23:07:27.468 INFO:tasks.workunit.client.0.smithi159.stdout:7/597: write d5/d16/f19 [1101178,19096] 0 2024-02-28T23:07:27.469 INFO:tasks.workunit.client.0.smithi159.stdout:8/840: creat d2/d3/d8c/f107 x:0 0 0 2024-02-28T23:07:27.470 INFO:tasks.workunit.client.1.smithi184.stdout:9/338: dwrite d5/d26/f55 [0,4194304] 0 2024-02-28T23:07:27.471 INFO:tasks.workunit.client.1.smithi184.stdout:5/336: truncate db/d12/d1c/d21/f5e 10817 0 2024-02-28T23:07:27.474 INFO:tasks.workunit.client.0.smithi159.stdout:2/635: dwrite d9/d23/d2c/f4a [0,4194304] 0 2024-02-28T23:07:27.476 INFO:tasks.workunit.client.0.smithi159.stdout:1/710: read d6/d1d/d1f/db8/dcc/f6f [478264,124558] 0 2024-02-28T23:07:27.482 INFO:tasks.workunit.client.1.smithi184.stdout:5/337: dread db/d12/d1c/d21/d2f/f5a [0,4194304] 0 2024-02-28T23:07:27.485 INFO:tasks.workunit.client.1.smithi184.stdout:5/338: fdatasync db/d12/d1c/d21/d2f/f55 0 2024-02-28T23:07:27.486 INFO:tasks.workunit.client.0.smithi159.stdout:3/664: mknod d0/d6/d3e/cd4 0 2024-02-28T23:07:27.486 INFO:tasks.workunit.client.0.smithi159.stdout:0/835: fdatasync d0/de/d46/f61 0 2024-02-28T23:07:27.501 INFO:tasks.workunit.client.1.smithi184.stdout:3/349: creat d1/d4/d1c/f6b x:0 0 0 2024-02-28T23:07:27.510 INFO:tasks.workunit.client.1.smithi184.stdout:1/392: mkdir d20/d32/d3e/d61/d8b 0 2024-02-28T23:07:27.515 INFO:tasks.workunit.client.1.smithi184.stdout:0/338: creat d0/df/d13/d5a/f70 x:0 0 0 2024-02-28T23:07:27.516 INFO:tasks.workunit.client.0.smithi159.stdout:5/677: dread d8/d19/f54 [0,4194304] 0 2024-02-28T23:07:27.517 INFO:tasks.workunit.client.0.smithi159.stdout:7/598: dread d5/d16/d1a/d27/d46/d65/d81/d83/d9d/fa1 [0,4194304] 0 2024-02-28T23:07:27.518 INFO:tasks.workunit.client.0.smithi159.stdout:2/636: creat d9/d50/d54/d84/fe0 x:0 0 0 2024-02-28T23:07:27.518 INFO:tasks.workunit.client.1.smithi184.stdout:7/313: write d6/d9/da/f31 [878969,24214] 0 2024-02-28T23:07:27.521 INFO:tasks.workunit.client.0.smithi159.stdout:7/599: dread - d5/d16/d1a/d27/d46/f99 zero size 2024-02-28T23:07:27.525 INFO:tasks.workunit.client.0.smithi159.stdout:7/600: chown d5/d16/d1a/f3c 9 1 2024-02-28T23:07:27.525 INFO:tasks.workunit.client.0.smithi159.stdout:3/665: fsync d0/d3f/f8d 0 2024-02-28T23:07:27.526 INFO:tasks.workunit.client.0.smithi159.stdout:3/666: chown d0/d3f/dd2/d7c/d79 129825255 1 2024-02-28T23:07:27.527 INFO:tasks.workunit.client.0.smithi159.stdout:0/836: symlink d0/d5/d14/d25/d2c/dab/dc5/l128 0 2024-02-28T23:07:27.530 INFO:tasks.workunit.client.0.smithi159.stdout:6/704: getdents d0/d1b/d33/d11/d34/d9d/da2/d96 0 2024-02-28T23:07:27.530 INFO:tasks.workunit.client.0.smithi159.stdout:0/837: chown d0/de/d75/db8/d103/d121 7047 1 2024-02-28T23:07:27.532 INFO:tasks.workunit.client.0.smithi159.stdout:1/711: dread d6/d1d/d46/f82 [0,4194304] 0 2024-02-28T23:07:27.532 INFO:tasks.workunit.client.1.smithi184.stdout:5/339: creat db/d12/d18/d2e/d3c/d5d/d66/f6e x:0 0 0 2024-02-28T23:07:27.533 INFO:tasks.workunit.client.1.smithi184.stdout:6/275: getdents dc/de/d10/d3a/d4d 0 2024-02-28T23:07:27.543 INFO:tasks.workunit.client.1.smithi184.stdout:3/350: rename d1/d4/f63 to d1/d4/d6/d1e/f6c 0 2024-02-28T23:07:27.546 INFO:tasks.workunit.client.1.smithi184.stdout:2/318: dwrite d10/d1f/d21/d5e/f1a [0,4194304] 0 2024-02-28T23:07:27.546 INFO:tasks.workunit.client.1.smithi184.stdout:9/339: mkdir d5/d73 0 2024-02-28T23:07:27.548 INFO:tasks.workunit.client.0.smithi159.stdout:5/678: symlink d8/d19/d23/d35/d38/d8f/da5/d90/le7 0 2024-02-28T23:07:27.550 INFO:tasks.workunit.client.0.smithi159.stdout:0/838: dread d0/d5/d14/d78/f8c [0,4194304] 0 2024-02-28T23:07:27.551 INFO:tasks.workunit.client.1.smithi184.stdout:0/339: write d0/df/d13/d27/f39 [3910889,74745] 0 2024-02-28T23:07:27.552 INFO:tasks.workunit.client.1.smithi184.stdout:8/343: dwrite d1/da/df/f1f [0,4194304] 0 2024-02-28T23:07:27.559 INFO:tasks.workunit.client.0.smithi159.stdout:9/720: dwrite d4/d3d/d3e/d55/d37/d62/da6/fde [0,4194304] 0 2024-02-28T23:07:27.559 INFO:tasks.workunit.client.0.smithi159.stdout:4/798: rename d9/d20/d87/d115/d1c/d23/d2d/de1/lf4 to d9/d42/d54/l11e 0 2024-02-28T23:07:27.571 INFO:tasks.workunit.client.0.smithi159.stdout:5/679: mkdir d8/db4/de8 0 2024-02-28T23:07:27.573 INFO:tasks.workunit.client.1.smithi184.stdout:1/393: sync 2024-02-28T23:07:27.574 INFO:tasks.workunit.client.1.smithi184.stdout:4/336: link d1/d29/l5d d1/dc/df/d22/d51/l68 0 2024-02-28T23:07:27.576 INFO:tasks.workunit.client.0.smithi159.stdout:0/839: creat d0/d5/d38/d63/dad/f129 x:0 0 0 2024-02-28T23:07:27.577 INFO:tasks.workunit.client.1.smithi184.stdout:2/319: creat d10/d1f/d21/d5e/f6c x:0 0 0 2024-02-28T23:07:27.578 INFO:tasks.workunit.client.1.smithi184.stdout:2/320: stat d10/d1f 0 2024-02-28T23:07:27.578 INFO:tasks.workunit.client.0.smithi159.stdout:1/712: creat d6/d12/d1a/d92/dc8/ff0 x:0 0 0 2024-02-28T23:07:27.581 INFO:tasks.workunit.client.0.smithi159.stdout:8/841: rename d2/d11/c70 to d2/d11/d52/d47/c108 0 2024-02-28T23:07:27.587 INFO:tasks.workunit.client.0.smithi159.stdout:7/601: dwrite d5/d16/d1a/d27/d3e/f48 [0,4194304] 0 2024-02-28T23:07:27.587 INFO:tasks.workunit.client.0.smithi159.stdout:9/721: fdatasync d4/d3d/d3e/d55/d37/d62/f74 0 2024-02-28T23:07:27.587 INFO:tasks.workunit.client.1.smithi184.stdout:0/340: mkdir d0/d47/d71 0 2024-02-28T23:07:27.588 INFO:tasks.workunit.client.1.smithi184.stdout:0/341: chown d0/df/d13/d27/d2b/f68 25099445 1 2024-02-28T23:07:27.590 INFO:tasks.workunit.client.1.smithi184.stdout:0/342: write d0/f37 [521883,48006] 0 2024-02-28T23:07:27.592 INFO:tasks.workunit.client.0.smithi159.stdout:2/637: truncate d9/d50/d54/f8e 3332257 0 2024-02-28T23:07:27.596 INFO:tasks.workunit.client.1.smithi184.stdout:6/276: creat dc/de/d10/d3a/d4d/f58 x:0 0 0 2024-02-28T23:07:27.597 INFO:tasks.workunit.client.0.smithi159.stdout:5/680: fdatasync d8/d19/f3c 0 2024-02-28T23:07:27.597 INFO:tasks.workunit.client.1.smithi184.stdout:7/314: dwrite d6/d9/d13/d1e/d2f/d34/f69 [0,4194304] 0 2024-02-28T23:07:27.601 INFO:tasks.workunit.client.0.smithi159.stdout:3/667: creat d0/d2b/fd5 x:0 0 0 2024-02-28T23:07:27.602 INFO:tasks.workunit.client.1.smithi184.stdout:9/340: write d5/d26/d50/f53 [34994,60567] 0 2024-02-28T23:07:27.605 INFO:tasks.workunit.client.1.smithi184.stdout:1/394: fdatasync d20/f35 0 2024-02-28T23:07:27.605 INFO:tasks.workunit.client.1.smithi184.stdout:9/341: write d5/db/de/d10/d12/d2f/f52 [1782729,48176] 0 2024-02-28T23:07:27.608 INFO:tasks.workunit.client.0.smithi159.stdout:1/713: unlink d6/d12/d1a/f3d 0 2024-02-28T23:07:27.608 INFO:tasks.workunit.client.0.smithi159.stdout:9/722: dread d4/d3d/d3e/d55/f2a [0,4194304] 0 2024-02-28T23:07:27.612 INFO:tasks.workunit.client.1.smithi184.stdout:3/351: creat d1/d4/d6/d1f/d26/d3a/d59/d67/f6d x:0 0 0 2024-02-28T23:07:27.618 INFO:tasks.workunit.client.0.smithi159.stdout:0/840: rename d0/f126 to d0/d5/d38/d76/f12a 0 2024-02-28T23:07:27.618 INFO:tasks.workunit.client.1.smithi184.stdout:1/395: dwrite d20/f24 [0,4194304] 0 2024-02-28T23:07:27.621 INFO:tasks.workunit.client.1.smithi184.stdout:1/396: fdatasync d20/d32/d3e/f63 0 2024-02-28T23:07:27.621 INFO:tasks.workunit.client.1.smithi184.stdout:1/397: fdatasync f17 0 2024-02-28T23:07:27.623 INFO:tasks.workunit.client.1.smithi184.stdout:4/337: symlink d1/dc/df/d41/l69 0 2024-02-28T23:07:27.625 INFO:tasks.workunit.client.1.smithi184.stdout:4/338: chown d1/d8/d35/f47 50857174 1 2024-02-28T23:07:27.625 INFO:tasks.workunit.client.0.smithi159.stdout:8/842: stat d2/d11/d52/d47/c108 0 2024-02-28T23:07:27.626 INFO:tasks.workunit.client.1.smithi184.stdout:4/339: chown d1/d4/c24 37974 1 2024-02-28T23:07:27.627 INFO:tasks.workunit.client.1.smithi184.stdout:2/321: fdatasync d10/d1f/f32 0 2024-02-28T23:07:27.628 INFO:tasks.workunit.client.1.smithi184.stdout:5/340: truncate db/d12/d18/f1a 1318024 0 2024-02-28T23:07:27.629 INFO:tasks.workunit.client.1.smithi184.stdout:2/322: rename d10 to d10/d1f/d21/d4d/d6d 22 2024-02-28T23:07:27.631 INFO:tasks.workunit.client.0.smithi159.stdout:4/799: dwrite d9/d20/d87/d115/d1c/d8e/ddc/fcc [0,4194304] 0 2024-02-28T23:07:27.631 INFO:tasks.workunit.client.0.smithi159.stdout:7/602: unlink f3 0 2024-02-28T23:07:27.635 INFO:tasks.workunit.client.0.smithi159.stdout:7/603: chown d5/d56/d50/f80 117569121 1 2024-02-28T23:07:27.645 INFO:tasks.workunit.client.1.smithi184.stdout:8/344: mknod d1/da/dc/d16/d29/d7d/c83 0 2024-02-28T23:07:27.645 INFO:tasks.workunit.client.0.smithi159.stdout:3/668: truncate d0/d3f/dd2/d7c/d79/f98 1194014 0 2024-02-28T23:07:27.647 INFO:tasks.workunit.client.1.smithi184.stdout:7/315: symlink d6/d9/d13/d1e/d2f/d34/d47/l73 0 2024-02-28T23:07:27.652 INFO:tasks.workunit.client.0.smithi159.stdout:9/723: creat d4/d3d/d3e/d55/d9e/db3/fe2 x:0 0 0 2024-02-28T23:07:27.657 INFO:tasks.workunit.client.1.smithi184.stdout:0/343: sync 2024-02-28T23:07:27.657 INFO:tasks.workunit.client.1.smithi184.stdout:9/342: creat d5/db/de/f74 x:0 0 0 2024-02-28T23:07:27.658 INFO:tasks.workunit.client.1.smithi184.stdout:3/352: fdatasync d1/d4/d65/f50 0 2024-02-28T23:07:27.661 INFO:tasks.workunit.client.1.smithi184.stdout:6/277: dread dc/de/d10/f23 [0,4194304] 0 2024-02-28T23:07:27.661 INFO:tasks.workunit.client.0.smithi159.stdout:5/681: rename d8/ff to d8/d59/fe9 0 2024-02-28T23:07:27.666 INFO:tasks.workunit.client.0.smithi159.stdout:5/682: dread d8/db4/fd1 [0,4194304] 0 2024-02-28T23:07:27.679 INFO:tasks.workunit.client.0.smithi159.stdout:2/638: creat d9/d50/dcc/d44/dc8/fe1 x:0 0 0 2024-02-28T23:07:27.684 INFO:tasks.workunit.client.0.smithi159.stdout:0/841: write d0/d5/d14/d25/f84 [822614,28032] 0 2024-02-28T23:07:27.690 INFO:tasks.workunit.client.1.smithi184.stdout:9/343: creat d5/d47/d68/f75 x:0 0 0 2024-02-28T23:07:27.690 INFO:tasks.workunit.client.1.smithi184.stdout:0/344: creat d0/df/d13/d27/d2b/f72 x:0 0 0 2024-02-28T23:07:27.692 INFO:tasks.workunit.client.0.smithi159.stdout:3/669: symlink d0/d2b/d55/d75/ld6 0 2024-02-28T23:07:27.696 INFO:tasks.workunit.client.0.smithi159.stdout:3/670: fsync d0/fac 0 2024-02-28T23:07:27.703 INFO:tasks.workunit.client.0.smithi159.stdout:4/800: dwrite d9/d42/fc6 [0,4194304] 0 2024-02-28T23:07:27.711 INFO:tasks.workunit.client.1.smithi184.stdout:4/340: symlink d1/dc/df/d3b/d5c/l6a 0 2024-02-28T23:07:27.713 INFO:tasks.workunit.client.0.smithi159.stdout:8/843: dread d2/d3/f14 [0,4194304] 0 2024-02-28T23:07:27.719 INFO:tasks.workunit.client.1.smithi184.stdout:5/341: symlink db/d12/d1c/d21/l6f 0 2024-02-28T23:07:27.725 INFO:tasks.workunit.client.1.smithi184.stdout:5/342: write db/d12/d18/d2e/d3c/d5d/f4b [1337460,72341] 0 2024-02-28T23:07:27.730 INFO:tasks.workunit.client.1.smithi184.stdout:3/353: write d1/d4/d6/d1f/f60 [518560,97414] 0 2024-02-28T23:07:27.732 INFO:tasks.workunit.client.0.smithi159.stdout:9/724: write d4/d3d/f5b [1664721,8145] 0 2024-02-28T23:07:27.747 INFO:tasks.workunit.client.1.smithi184.stdout:1/398: dwrite d20/f88 [0,4194304] 0 2024-02-28T23:07:27.748 INFO:tasks.workunit.client.1.smithi184.stdout:2/323: truncate d10/d1f/d21/d5e/f2c 823238 0 2024-02-28T23:07:27.751 INFO:tasks.workunit.client.1.smithi184.stdout:9/344: mknod d5/d26/c76 0 2024-02-28T23:07:27.755 INFO:tasks.workunit.client.0.smithi159.stdout:3/671: symlink d0/d3f/dd2/d6a/ld7 0 2024-02-28T23:07:27.755 INFO:tasks.workunit.client.1.smithi184.stdout:0/345: creat d0/df/d13/d27/d31/d51/f73 x:0 0 0 2024-02-28T23:07:27.756 INFO:tasks.workunit.client.1.smithi184.stdout:2/324: truncate d10/d1f/d21/d5e/d15/d24/f22 8731770 0 2024-02-28T23:07:27.760 INFO:tasks.workunit.client.1.smithi184.stdout:2/325: readlink d10/d1f/d21/d5e/d15/d24/l30 0 2024-02-28T23:07:27.762 INFO:tasks.workunit.client.0.smithi159.stdout:8/844: mkdir d2/d11/d35/d5f/d109 0 2024-02-28T23:07:27.770 INFO:tasks.workunit.client.0.smithi159.stdout:5/683: creat d8/d19/d23/d35/d65/db5/fea x:0 0 0 2024-02-28T23:07:27.772 INFO:tasks.workunit.client.0.smithi159.stdout:0/842: creat d0/de/de7/d117/f12b x:0 0 0 2024-02-28T23:07:27.776 INFO:tasks.workunit.client.0.smithi159.stdout:1/714: link d6/d1d/d46/c49 d6/d1d/d46/d88/dd3/d9c/cf1 0 2024-02-28T23:07:27.777 INFO:tasks.workunit.client.0.smithi159.stdout:1/715: stat d6/d12/d1a/f53 0 2024-02-28T23:07:27.778 INFO:tasks.workunit.client.0.smithi159.stdout:1/716: readlink d6/d12/d16/l2d 0 2024-02-28T23:07:27.779 INFO:tasks.workunit.client.0.smithi159.stdout:7/604: rename d5/d16/d1a/d24/l78 to d5/d16/d1a/lc6 0 2024-02-28T23:07:27.783 INFO:tasks.workunit.client.1.smithi184.stdout:6/278: dwrite dc/de/f29 [4194304,4194304] 0 2024-02-28T23:07:27.784 INFO:tasks.workunit.client.1.smithi184.stdout:4/341: symlink d1/dc/df/d27/l6b 0 2024-02-28T23:07:27.786 INFO:tasks.workunit.client.0.smithi159.stdout:9/725: unlink d4/l28 0 2024-02-28T23:07:27.789 INFO:tasks.workunit.client.0.smithi159.stdout:3/672: rename d0/d6/d3e/cd4 to d0/d6/d34/cd8 0 2024-02-28T23:07:27.791 INFO:tasks.workunit.client.0.smithi159.stdout:3/673: write d0/d47/d88/fc0 [327779,74095] 0 2024-02-28T23:07:27.794 INFO:tasks.workunit.client.0.smithi159.stdout:7/605: unlink d5/d56/d50/f58 0 2024-02-28T23:07:27.798 INFO:tasks.workunit.client.1.smithi184.stdout:1/399: mkdir d20/d32/d3e/d82/d85/d8c 0 2024-02-28T23:07:27.800 INFO:tasks.workunit.client.0.smithi159.stdout:1/717: mkdir d6/d1d/d46/d88/dd3/d9c/df2 0 2024-02-28T23:07:27.800 INFO:tasks.workunit.client.1.smithi184.stdout:9/345: creat d5/d47/f77 x:0 0 0 2024-02-28T23:07:27.801 INFO:tasks.workunit.client.0.smithi159.stdout:2/639: getdents d9/d80 0 2024-02-28T23:07:27.801 INFO:tasks.workunit.client.0.smithi159.stdout:1/718: stat d6/d1d 0 2024-02-28T23:07:27.801 INFO:tasks.workunit.client.1.smithi184.stdout:4/342: dread d1/dc/df/d38/f53 [0,4194304] 0 2024-02-28T23:07:27.804 INFO:tasks.workunit.client.1.smithi184.stdout:9/346: write d5/db/de/d10/f2a [4976031,124597] 0 2024-02-28T23:07:27.804 INFO:tasks.workunit.client.0.smithi159.stdout:1/719: stat d6/d12/d33/d48/l8a 0 2024-02-28T23:07:27.805 INFO:tasks.workunit.client.0.smithi159.stdout:9/726: dwrite d4/d3d/d3e/d55/f46 [0,4194304] 0 2024-02-28T23:07:27.807 INFO:tasks.workunit.client.0.smithi159.stdout:4/801: rename d9/d4c/d6c/ccd to d9/d42/d54/d56/c11f 0 2024-02-28T23:07:27.810 INFO:tasks.workunit.client.0.smithi159.stdout:4/802: chown d9/d42/d95/f100 309 1 2024-02-28T23:07:27.813 INFO:tasks.workunit.client.0.smithi159.stdout:7/606: creat d5/d16/d1a/d27/d75/fc7 x:0 0 0 2024-02-28T23:07:27.814 INFO:tasks.workunit.client.0.smithi159.stdout:3/674: dwrite d0/d6/d34/f62 [0,4194304] 0 2024-02-28T23:07:27.819 INFO:tasks.workunit.client.0.smithi159.stdout:3/675: read - d0/d3f/dd2/d6a/fa0 zero size 2024-02-28T23:07:27.820 INFO:tasks.workunit.client.0.smithi159.stdout:0/843: creat d0/d5/d14/f12c x:0 0 0 2024-02-28T23:07:27.821 INFO:tasks.workunit.client.0.smithi159.stdout:0/844: chown d0/de/db7 3 1 2024-02-28T23:07:27.822 INFO:tasks.workunit.client.1.smithi184.stdout:3/354: mkdir d1/d4/d6/d1f/d26/d3a/d59/d6a/d6e 0 2024-02-28T23:07:27.824 INFO:tasks.workunit.client.0.smithi159.stdout:2/640: creat d9/d50/d62/fe2 x:0 0 0 2024-02-28T23:07:27.824 INFO:tasks.workunit.client.0.smithi159.stdout:5/684: write d8/f8b [2601151,54068] 0 2024-02-28T23:07:27.827 INFO:tasks.workunit.client.1.smithi184.stdout:8/345: rename d1/da/dc/d16/d29/c3b to d1/c84 0 2024-02-28T23:07:27.829 INFO:tasks.workunit.client.1.smithi184.stdout:0/346: mknod d0/df/d13/d27/d58/c74 0 2024-02-28T23:07:27.832 INFO:tasks.workunit.client.0.smithi159.stdout:1/720: read d6/d12/d1a/f2b [2226832,100918] 0 2024-02-28T23:07:27.835 INFO:tasks.workunit.client.0.smithi159.stdout:8/845: rename d2/d11/d52/d6e/lef to d2/d11/d52/d26/d36/d38/d77/d9e/dc1/df7/d102/l10a 0 2024-02-28T23:07:27.838 INFO:tasks.workunit.client.1.smithi184.stdout:6/279: link dc/de/d10/f38 dc/d42/f59 0 2024-02-28T23:07:27.838 INFO:tasks.workunit.client.0.smithi159.stdout:1/721: write d6/d12/d31/fae [634935,107098] 0 2024-02-28T23:07:27.845 INFO:tasks.workunit.client.1.smithi184.stdout:0/347: creat d0/d1d/d4c/f75 x:0 0 0 2024-02-28T23:07:27.847 INFO:tasks.workunit.client.1.smithi184.stdout:0/348: chown d0/df/d13/f3e 1 1 2024-02-28T23:07:27.847 INFO:tasks.workunit.client.1.smithi184.stdout:8/346: creat d1/da/dc/d16/d32/d42/d77/f85 x:0 0 0 2024-02-28T23:07:27.848 INFO:tasks.workunit.client.0.smithi159.stdout:4/803: symlink d9/d20/d87/d115/d1c/d23/d7a/d10d/l120 0 2024-02-28T23:07:27.848 INFO:tasks.workunit.client.0.smithi159.stdout:5/685: truncate d8/d19/f54 1051585 0 2024-02-28T23:07:27.848 INFO:tasks.workunit.client.0.smithi159.stdout:7/607: mkdir d5/d16/d1a/d24/d64/db4/dc8 0 2024-02-28T23:07:27.849 INFO:tasks.workunit.client.0.smithi159.stdout:2/641: dwrite d9/d50/d54/d84/f9f [0,4194304] 0 2024-02-28T23:07:27.850 INFO:tasks.workunit.client.0.smithi159.stdout:3/676: link d0/d3f/fad d0/d3f/dd2/d7c/d79/fd9 0 2024-02-28T23:07:27.850 INFO:tasks.workunit.client.1.smithi184.stdout:5/343: sync 2024-02-28T23:07:27.852 INFO:tasks.workunit.client.0.smithi159.stdout:7/608: chown d5/d16/d1a/d27/d75/dac/dbe/lc2 110 1 2024-02-28T23:07:27.853 INFO:tasks.workunit.client.0.smithi159.stdout:2/642: truncate d9/d50/d54/d8d/fd4 117085 0 2024-02-28T23:07:27.853 INFO:tasks.workunit.client.0.smithi159.stdout:3/677: dread d0/fac [0,4194304] 0 2024-02-28T23:07:27.868 INFO:tasks.workunit.client.1.smithi184.stdout:5/344: dwrite db/d12/d18/d2e/d3c/d5d/f3e [0,4194304] 0 2024-02-28T23:07:27.915 INFO:tasks.workunit.client.0.smithi159.stdout:3/678: write d0/d47/fbc [1929633,3610] 0 2024-02-28T23:07:27.916 INFO:tasks.workunit.client.1.smithi184.stdout:2/326: creat d10/d1f/d21/f6e x:0 0 0 2024-02-28T23:07:27.923 INFO:tasks.workunit.client.0.smithi159.stdout:8/846: creat d2/d11/d52/d47/f10b x:0 0 0 2024-02-28T23:07:27.923 INFO:tasks.workunit.client.1.smithi184.stdout:9/347: sync 2024-02-28T23:07:27.925 INFO:tasks.workunit.client.0.smithi159.stdout:7/609: dread d5/d16/d1a/d27/d3e/f48 [0,4194304] 0 2024-02-28T23:07:27.928 INFO:tasks.workunit.client.0.smithi159.stdout:7/610: readlink d5/d16/d1a/d27/d46/d65/d81/d98/l9c 0 2024-02-28T23:07:27.933 INFO:tasks.workunit.client.1.smithi184.stdout:1/400: truncate d20/d32/d3e/f7c 1344176 0 2024-02-28T23:07:27.935 INFO:tasks.workunit.client.1.smithi184.stdout:3/355: creat d1/d4/d1c/d62/d66/f6f x:0 0 0 2024-02-28T23:07:27.940 INFO:tasks.workunit.client.0.smithi159.stdout:4/804: creat d9/d20/d87/d115/d1c/d8e/deb/f121 x:0 0 0 2024-02-28T23:07:27.943 INFO:tasks.workunit.client.0.smithi159.stdout:4/805: dread - d9/d20/fe3 zero size 2024-02-28T23:07:27.944 INFO:tasks.workunit.client.0.smithi159.stdout:0/845: dwrite d0/de/d46/fdc [0,4194304] 0 2024-02-28T23:07:27.946 INFO:tasks.workunit.client.0.smithi159.stdout:9/727: dwrite d4/d3d/d3e/d55/d37/d62/da6/fc2 [0,4194304] 0 2024-02-28T23:07:27.951 INFO:tasks.workunit.client.0.smithi159.stdout:4/806: fsync d9/d20/d87/d115/d1c/f1d 0 2024-02-28T23:07:27.957 INFO:tasks.workunit.client.0.smithi159.stdout:4/807: dread - d9/d20/d87/d115/d1c/d23/d2d/de1/fe7 zero size 2024-02-28T23:07:27.957 INFO:tasks.workunit.client.0.smithi159.stdout:8/847: mknod d2/d11/d52/d26/d36/d38/d77/d79/dd7/c10c 0 2024-02-28T23:07:27.957 INFO:tasks.workunit.client.1.smithi184.stdout:0/349: sync 2024-02-28T23:07:27.958 INFO:tasks.workunit.client.0.smithi159.stdout:7/611: dread d5/f18 [0,4194304] 0 2024-02-28T23:07:27.964 INFO:tasks.workunit.client.1.smithi184.stdout:4/343: truncate d1/d8/d37/f60 3388662 0 2024-02-28T23:07:27.966 INFO:tasks.workunit.client.0.smithi159.stdout:7/612: fdatasync d5/d16/d1a/d24/d64/fa5 0 2024-02-28T23:07:27.978 INFO:tasks.workunit.client.1.smithi184.stdout:3/356: dwrite d1/d4/d1c/f27 [0,4194304] 0 2024-02-28T23:07:27.984 INFO:tasks.workunit.client.1.smithi184.stdout:3/357: read d1/d4/d6/d1f/f2b [39852,118851] 0 2024-02-28T23:07:27.988 INFO:tasks.workunit.client.1.smithi184.stdout:9/348: link d5/d26/d50/f53 d5/d26/f78 0 2024-02-28T23:07:27.995 INFO:tasks.workunit.client.0.smithi159.stdout:1/722: write d6/d12/f14 [657298,51641] 0 2024-02-28T23:07:27.995 INFO:tasks.workunit.client.1.smithi184.stdout:6/280: creat dc/de/f5a x:0 0 0 2024-02-28T23:07:27.996 INFO:tasks.workunit.client.0.smithi159.stdout:0/846: mknod d0/d5/d14/d78/da8/c12d 0 2024-02-28T23:07:27.997 INFO:tasks.workunit.client.1.smithi184.stdout:3/358: dread d1/d4/d6/f53 [0,4194304] 0 2024-02-28T23:07:28.001 INFO:tasks.workunit.client.0.smithi159.stdout:0/847: stat d0/d5/d38/d63/l116 0 2024-02-28T23:07:28.004 INFO:tasks.workunit.client.0.smithi159.stdout:9/728: mkdir d4/d3d/d3e/d91/de3 0 2024-02-28T23:07:28.009 INFO:tasks.workunit.client.1.smithi184.stdout:7/316: rename d6/d9/l4c to d6/d9/d13/l74 0 2024-02-28T23:07:28.010 INFO:tasks.workunit.client.0.smithi159.stdout:8/848: dread d2/d11/d52/d47/f51 [0,4194304] 0 2024-02-28T23:07:28.010 INFO:tasks.workunit.client.0.smithi159.stdout:0/848: write d0/d5/d14/d34/d6c/fcf [3195052,108914] 0 2024-02-28T23:07:28.010 INFO:tasks.workunit.client.1.smithi184.stdout:7/317: chown d6/d9/da/dc/c3a 197447 1 2024-02-28T23:07:28.014 INFO:tasks.workunit.client.0.smithi159.stdout:9/729: readlink d4/d52/d7d/lca 0 2024-02-28T23:07:28.020 INFO:tasks.workunit.client.1.smithi184.stdout:2/327: write d10/d1f/d21/d5e/d15/f2e [448560,57079] 0 2024-02-28T23:07:28.022 INFO:tasks.workunit.client.1.smithi184.stdout:1/401: mknod d20/d32/d3e/d61/d8b/c8d 0 2024-02-28T23:07:28.022 INFO:tasks.workunit.client.0.smithi159.stdout:9/730: fdatasync d4/fe 0 2024-02-28T23:07:28.024 INFO:tasks.workunit.client.1.smithi184.stdout:1/402: read d20/f88 [2834152,78613] 0 2024-02-28T23:07:28.024 INFO:tasks.workunit.client.0.smithi159.stdout:0/849: chown d0/de/d75/db8/fbf 828 1 2024-02-28T23:07:28.025 INFO:tasks.workunit.client.0.smithi159.stdout:3/679: truncate d0/f23 602393 0 2024-02-28T23:07:28.027 INFO:tasks.workunit.client.1.smithi184.stdout:4/344: read d1/dc/df/f16 [316564,89197] 0 2024-02-28T23:07:28.027 INFO:tasks.workunit.client.1.smithi184.stdout:8/347: creat d1/f86 x:0 0 0 2024-02-28T23:07:28.029 INFO:tasks.workunit.client.1.smithi184.stdout:4/345: readlink d1/dc/df/d3b/d5c/l6a 0 2024-02-28T23:07:28.031 INFO:tasks.workunit.client.0.smithi159.stdout:8/849: read d2/d3/f13 [2331991,19350] 0 2024-02-28T23:07:28.033 INFO:tasks.workunit.client.0.smithi159.stdout:1/723: dwrite d6/fc1 [0,4194304] 0 2024-02-28T23:07:28.039 INFO:tasks.workunit.client.1.smithi184.stdout:6/281: readlink dc/d42/l52 0 2024-02-28T23:07:28.041 INFO:tasks.workunit.client.0.smithi159.stdout:5/686: link d8/f14 d8/d19/d23/d35/d38/d8f/feb 0 2024-02-28T23:07:28.042 INFO:tasks.workunit.client.1.smithi184.stdout:6/282: chown dc/de/f40 212767 1 2024-02-28T23:07:28.044 INFO:tasks.workunit.client.0.smithi159.stdout:1/724: truncate d6/d12/d31/d69/dc0/feb 387823 0 2024-02-28T23:07:28.044 INFO:tasks.workunit.client.0.smithi159.stdout:4/808: dread d9/d20/d87/d115/d1c/d8e/ddc/fc4 [0,4194304] 0 2024-02-28T23:07:28.048 INFO:tasks.workunit.client.1.smithi184.stdout:3/359: mknod d1/d4/d6/d1f/d26/d3a/c70 0 2024-02-28T23:07:28.056 INFO:tasks.workunit.client.1.smithi184.stdout:7/318: rename f3 to d6/d68/f75 0 2024-02-28T23:07:28.066 INFO:tasks.workunit.client.1.smithi184.stdout:1/403: creat d20/d32/d3e/d61/d8b/f8e x:0 0 0 2024-02-28T23:07:28.068 INFO:tasks.workunit.client.1.smithi184.stdout:2/328: dread d10/f2d [0,4194304] 0 2024-02-28T23:07:28.070 INFO:tasks.workunit.client.1.smithi184.stdout:5/345: getdents db/d12/d18/d2e/d3c/d5d/d66 0 2024-02-28T23:07:28.073 INFO:tasks.workunit.client.1.smithi184.stdout:4/346: unlink d1/dc/df/d38/d3c/c50 0 2024-02-28T23:07:28.089 INFO:tasks.workunit.client.1.smithi184.stdout:3/360: mknod d1/d4/d5/c71 0 2024-02-28T23:07:28.091 INFO:tasks.workunit.client.1.smithi184.stdout:0/350: creat d0/df/d13/d27/f76 x:0 0 0 2024-02-28T23:07:28.099 INFO:tasks.workunit.client.0.smithi159.stdout:6/705: sync 2024-02-28T23:07:28.101 INFO:tasks.workunit.client.1.smithi184.stdout:1/404: creat d20/d32/d3e/d61/d8b/f8f x:0 0 0 2024-02-28T23:07:28.104 INFO:tasks.workunit.client.1.smithi184.stdout:5/346: symlink db/l70 0 2024-02-28T23:07:28.105 INFO:tasks.workunit.client.1.smithi184.stdout:4/347: fsync d1/dc/df/d38/f53 0 2024-02-28T23:07:28.109 INFO:tasks.workunit.client.1.smithi184.stdout:4/348: dread - d1/dc/df/d38/d3c/f65 zero size 2024-02-28T23:07:28.111 INFO:tasks.workunit.client.1.smithi184.stdout:0/351: dwrite d0/df/d13/f29 [0,4194304] 0 2024-02-28T23:07:28.113 INFO:tasks.workunit.client.1.smithi184.stdout:3/361: rename d1/d4/d65 to d1/d4/d6/d1e/d72 0 2024-02-28T23:07:28.113 INFO:tasks.workunit.client.1.smithi184.stdout:4/349: read d1/dc/df/f14 [4473306,2271] 0 2024-02-28T23:07:28.116 INFO:tasks.workunit.client.1.smithi184.stdout:3/362: read d1/d4/d6/d1f/d26/f2a [1078097,12753] 0 2024-02-28T23:07:28.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.117+0000 7fc946400700 1 -- 172.21.15.159:0/2935159644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9401082d0 msgr2=0x7fc940108750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:28.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.117+0000 7fc946400700 1 --2- 172.21.15.159:0/2935159644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9401082d0 0x7fc940108750 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009910 tx=0x7fc92c009c20 comp rx=0 tx=0).stop 2024-02-28T23:07:28.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.118+0000 7fc946400700 1 -- 172.21.15.159:0/2935159644 shutdown_connections 2024-02-28T23:07:28.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.118+0000 7fc946400700 1 --2- 172.21.15.159:0/2935159644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9401082d0 0x7fc940108750 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:28.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.118+0000 7fc946400700 1 --2- 172.21.15.159:0/2935159644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc940072a30 0x7fc940107d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:28.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.118+0000 7fc946400700 1 -- 172.21.15.159:0/2935159644 >> 172.21.15.159:0/2935159644 conn(0x7fc94006d9f0 msgr2=0x7fc94006fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:07:28.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.118+0000 7fc946400700 1 -- 172.21.15.159:0/2935159644 shutdown_connections 2024-02-28T23:07:28.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.119+0000 7fc946400700 1 -- 172.21.15.159:0/2935159644 wait complete. 2024-02-28T23:07:28.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.121+0000 7fc946400700 1 Processor -- start 2024-02-28T23:07:28.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.122+0000 7fc946400700 1 -- start start 2024-02-28T23:07:28.120 INFO:tasks.workunit.client.1.smithi184.stdout:0/352: dread d0/df/f67 [0,4194304] 0 2024-02-28T23:07:28.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.123+0000 7fc946400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc940072a30 0x7fc940117c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:28.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.123+0000 7fc946400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401082d0 0x7fc940118150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:28.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.123+0000 7fc946400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc940118770 con 0x7fc940072a30 2024-02-28T23:07:28.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.123+0000 7fc946400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9401188b0 con 0x7fc9401082d0 2024-02-28T23:07:28.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.124+0000 7fc93ea00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401082d0 0x7fc940118150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:28.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.124+0000 7fc93f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc940072a30 0x7fc940117c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:28.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.124+0000 7fc93ea00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401082d0 0x7fc940118150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:55606/0 (socket says 172.21.15.159:55606) 2024-02-28T23:07:28.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.124+0000 7fc93ea00700 1 -- 172.21.15.159:0/2790149017 learned_addr learned my addr 172.21.15.159:0/2790149017 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:07:28.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.124+0000 7fc93ea00700 1 -- 172.21.15.159:0/2790149017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc940072a30 msgr2=0x7fc940117c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:28.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.125+0000 7fc93ea00700 1 --2- 172.21.15.159:0/2790149017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc940072a30 0x7fc940117c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:28.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.125+0000 7fc93ea00700 1 -- 172.21.15.159:0/2790149017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c0095f0 con 0x7fc9401082d0 2024-02-28T23:07:28.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.125+0000 7fc93f400700 1 --2- 172.21.15.159:0/2790149017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc940072a30 0x7fc940117c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:07:28.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.126+0000 7fc93ea00700 1 --2- 172.21.15.159:0/2790149017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401082d0 0x7fc940118150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc92c006010 tx=0x7fc92c00be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:07:28.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.128+0000 7fc937e00700 1 -- 172.21.15.159:0/2790149017 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc92c01d070 con 0x7fc9401082d0 2024-02-28T23:07:28.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.128+0000 7fc946400700 1 -- 172.21.15.159:0/2790149017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94011b2f0 con 0x7fc9401082d0 2024-02-28T23:07:28.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.128+0000 7fc946400700 1 -- 172.21.15.159:0/2790149017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94011b7e0 con 0x7fc9401082d0 2024-02-28T23:07:28.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.129+0000 7fc937e00700 1 -- 172.21.15.159:0/2790149017 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc92c00f460 con 0x7fc9401082d0 2024-02-28T23:07:28.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.129+0000 7fc937e00700 1 -- 172.21.15.159:0/2790149017 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc92c017630 con 0x7fc9401082d0 2024-02-28T23:07:28.133 INFO:tasks.workunit.client.1.smithi184.stdout:2/329: sync 2024-02-28T23:07:28.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.134+0000 7fc937e00700 1 -- 172.21.15.159:0/2790149017 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 25) v1 ==== 90929+0+0 (secure 0 0 0) 0x7fc92c017790 con 0x7fc9401082d0 2024-02-28T23:07:28.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.134+0000 7fc935600700 1 -- 172.21.15.159:0/2790149017 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9180052f0 con 0x7fc9401082d0 2024-02-28T23:07:28.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.135+0000 7fc937e00700 1 --2- 172.21.15.159:0/2790149017 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc92406ce40 0x7fc92406f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:28.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.136+0000 7fc937e00700 1 -- 172.21.15.159:0/2790149017 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc92c08ebb0 con 0x7fc9401082d0 2024-02-28T23:07:28.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.136+0000 7fc93f400700 1 --2- 172.21.15.159:0/2790149017 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc92406ce40 0x7fc92406f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:28.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.137+0000 7fc93f400700 1 --2- 172.21.15.159:0/2790149017 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc92406ce40 0x7fc92406f300 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc930005fd0 tx=0x7fc930005ee0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:07:28.136 INFO:tasks.workunit.client.1.smithi184.stdout:9/349: dwrite d5/fa [0,4194304] 0 2024-02-28T23:07:28.137 INFO:tasks.workunit.client.1.smithi184.stdout:4/350: dwrite d1/dc/df/f5f [0,4194304] 0 2024-02-28T23:07:28.138 INFO:tasks.workunit.client.0.smithi159.stdout:3/680: symlink d0/d2b/d55/lda 0 2024-02-28T23:07:28.141 INFO:tasks.workunit.client.1.smithi184.stdout:3/363: dwrite d1/d4/f57 [0,4194304] 0 2024-02-28T23:07:28.143 INFO:tasks.workunit.client.0.smithi159.stdout:3/681: truncate d0/d3f/dd2/d6a/fa0 197467 0 2024-02-28T23:07:28.144 INFO:tasks.workunit.client.1.smithi184.stdout:7/319: creat d6/d9/f76 x:0 0 0 2024-02-28T23:07:28.145 INFO:tasks.workunit.client.1.smithi184.stdout:9/350: write d5/d47/d68/f6f [53528,110763] 0 2024-02-28T23:07:28.146 INFO:tasks.workunit.client.0.smithi159.stdout:0/850: chown d0/d5/d14/d25/db5 2018 1 2024-02-28T23:07:28.148 INFO:tasks.workunit.client.1.smithi184.stdout:9/351: chown d5/db/de/f21 54422745 1 2024-02-28T23:07:28.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.149+0000 7fc937e00700 1 -- 172.21.15.159:0/2790149017 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fc92c05c310 con 0x7fc9401082d0 2024-02-28T23:07:28.151 INFO:tasks.workunit.client.0.smithi159.stdout:0/851: write d0/d5/d38/d63/dad/f129 [869013,57779] 0 2024-02-28T23:07:28.152 INFO:tasks.workunit.client.1.smithi184.stdout:1/405: rename d20/d32/d51 to d20/d46/d90 0 2024-02-28T23:07:28.153 INFO:tasks.workunit.client.1.smithi184.stdout:1/406: readlink d20/d46/l70 0 2024-02-28T23:07:28.154 INFO:tasks.workunit.client.1.smithi184.stdout:8/348: truncate d1/da/dc/d16/d4d/f5a 202212 0 2024-02-28T23:07:28.156 INFO:tasks.workunit.client.1.smithi184.stdout:6/283: write dc/de/f1e [994197,92424] 0 2024-02-28T23:07:28.163 INFO:tasks.workunit.client.0.smithi159.stdout:7/613: mknod d5/d16/d1a/d27/cc9 0 2024-02-28T23:07:28.166 INFO:tasks.workunit.client.0.smithi159.stdout:7/614: write d5/d56/d50/d5b/f6b [7141753,121920] 0 2024-02-28T23:07:28.169 INFO:tasks.workunit.client.1.smithi184.stdout:6/284: dwrite f8 [0,4194304] 0 2024-02-28T23:07:28.182 INFO:tasks.workunit.client.0.smithi159.stdout:5/687: mknod d8/d19/d23/d35/d38/d8f/da5/d90/cec 0 2024-02-28T23:07:28.190 INFO:tasks.workunit.client.0.smithi159.stdout:1/725: mkdir d6/d12/d31/d69/dc0/df3 0 2024-02-28T23:07:28.200 INFO:tasks.workunit.client.1.smithi184.stdout:2/330: mkdir d10/d1f/d21/d5e/d15/d60/d6f 0 2024-02-28T23:07:28.206 INFO:tasks.workunit.client.0.smithi159.stdout:3/682: dread d0/d6/f13 [0,4194304] 0 2024-02-28T23:07:28.208 INFO:tasks.workunit.client.1.smithi184.stdout:3/364: creat d1/d4/d6/d1f/d26/d3a/d59/f73 x:0 0 0 2024-02-28T23:07:28.210 INFO:tasks.workunit.client.1.smithi184.stdout:3/365: chown d1/d4/d5/c19 3525457 1 2024-02-28T23:07:28.211 INFO:tasks.workunit.client.0.smithi159.stdout:4/809: write d9/d4c/fb7 [2289542,127724] 0 2024-02-28T23:07:28.211 INFO:tasks.workunit.client.0.smithi159.stdout:8/850: fsync d2/d3/f30 0 2024-02-28T23:07:28.214 INFO:tasks.workunit.client.0.smithi159.stdout:2/643: sync 2024-02-28T23:07:28.218 INFO:tasks.workunit.client.0.smithi159.stdout:4/810: write d9/d4c/fb7 [2387302,89722] 0 2024-02-28T23:07:28.218 INFO:tasks.workunit.client.0.smithi159.stdout:0/852: mkdir d0/d5/d14/d25/d2c/d4b/d12e 0 2024-02-28T23:07:28.219 INFO:tasks.workunit.client.1.smithi184.stdout:5/347: write db/d12/d18/d2e/d3c/d5d/d66/f6a [810372,131065] 0 2024-02-28T23:07:28.222 INFO:tasks.workunit.client.0.smithi159.stdout:0/853: stat d0/l5a 0 2024-02-28T23:07:28.226 INFO:tasks.workunit.client.1.smithi184.stdout:0/353: symlink d0/df/d13/d27/l77 0 2024-02-28T23:07:28.232 INFO:tasks.workunit.client.0.smithi159.stdout:0/854: write d0/d5/d14/d25/d2c/dab/f10c [317319,43016] 0 2024-02-28T23:07:28.236 INFO:tasks.workunit.client.1.smithi184.stdout:7/320: dread f5 [0,4194304] 0 2024-02-28T23:07:28.238 INFO:tasks.workunit.client.0.smithi159.stdout:5/688: mkdir d8/d19/d23/d35/d41/d77/ded 0 2024-02-28T23:07:28.241 INFO:tasks.workunit.client.1.smithi184.stdout:4/351: mkdir d1/dc/df/d5b/d6c 0 2024-02-28T23:07:28.241 INFO:tasks.workunit.client.0.smithi159.stdout:6/706: dwrite d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/f9b [0,4194304] 0 2024-02-28T23:07:28.241 INFO:tasks.workunit.client.0.smithi159.stdout:3/683: dwrite d0/d47/fcb [0,4194304] 0 2024-02-28T23:07:28.245 INFO:tasks.workunit.client.0.smithi159.stdout:6/707: chown d0/d1b/d33/d11/d34/d9d/da2 4214428 1 2024-02-28T23:07:28.247 INFO:tasks.workunit.client.0.smithi159.stdout:9/731: rename d4/d3d/d3e/d91 to d4/de4 0 2024-02-28T23:07:28.250 INFO:tasks.workunit.client.1.smithi184.stdout:1/407: sync 2024-02-28T23:07:28.254 INFO:tasks.workunit.client.0.smithi159.stdout:6/708: write d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/fd0 [392991,118320] 0 2024-02-28T23:07:28.259 INFO:tasks.workunit.client.1.smithi184.stdout:3/366: rmdir d1/d4/d6/d1f/d26/d3a/d59/d6a 39 2024-02-28T23:07:28.261 INFO:tasks.workunit.client.1.smithi184.stdout:8/349: unlink d1/da/dc/d16/d32/c67 0 2024-02-28T23:07:28.265 INFO:tasks.workunit.client.0.smithi159.stdout:2/644: symlink d9/d36/dc3/le3 0 2024-02-28T23:07:28.265 INFO:tasks.workunit.client.1.smithi184.stdout:5/348: rename db/d12/d1c/d21/d2f/f43 to db/d12/d1c/d21/d2f/f71 0 2024-02-28T23:07:28.266 INFO:tasks.workunit.client.0.smithi159.stdout:7/615: dwrite d5/d16/d1a/d27/d46/f61 [0,4194304] 0 2024-02-28T23:07:28.269 INFO:tasks.workunit.client.0.smithi159.stdout:7/616: write d5/f9b [617089,22120] 0 2024-02-28T23:07:28.274 INFO:tasks.workunit.client.1.smithi184.stdout:0/354: mknod d0/d47/c78 0 2024-02-28T23:07:28.288 INFO:tasks.workunit.client.0.smithi159.stdout:1/726: mkdir d6/d12/d16/de3/df4 0 2024-02-28T23:07:28.290 INFO:tasks.workunit.client.0.smithi159.stdout:8/851: write d2/fe4 [852413,31042] 0 2024-02-28T23:07:28.298 INFO:tasks.workunit.client.1.smithi184.stdout:2/331: creat d10/d55/f70 x:0 0 0 2024-02-28T23:07:28.300 INFO:tasks.workunit.client.0.smithi159.stdout:3/684: symlink d0/d3f/dd2/d7c/d79/ldb 0 2024-02-28T23:07:28.302 INFO:tasks.workunit.client.1.smithi184.stdout:9/352: creat d5/db/f79 x:0 0 0 2024-02-28T23:07:28.305 INFO:tasks.workunit.client.0.smithi159.stdout:6/709: symlink d0/d1b/dc5/le4 0 2024-02-28T23:07:28.307 INFO:tasks.workunit.client.1.smithi184.stdout:8/350: creat d1/da/dc/d16/d4d/f87 x:0 0 0 2024-02-28T23:07:28.308 INFO:tasks.workunit.client.1.smithi184.stdout:8/351: chown d1/da/dc 21572217 1 2024-02-28T23:07:28.310 INFO:tasks.workunit.client.1.smithi184.stdout:5/349: mkdir db/d12/d18/d2e/d3c/d72 0 2024-02-28T23:07:28.311 INFO:tasks.workunit.client.1.smithi184.stdout:8/352: rename d1/da/dc/d16 to d1/da/dc/d16/d32/d88 22 2024-02-28T23:07:28.311 INFO:tasks.workunit.client.1.smithi184.stdout:7/321: dread d6/f30 [0,4194304] 0 2024-02-28T23:07:28.317 INFO:tasks.workunit.client.1.smithi184.stdout:3/367: dread d1/d4/d1c/f52 [0,4194304] 0 2024-02-28T23:07:28.319 INFO:tasks.workunit.client.0.smithi159.stdout:2/645: creat d9/d50/dcc/d44/fe4 x:0 0 0 2024-02-28T23:07:28.320 INFO:tasks.workunit.client.0.smithi159.stdout:7/617: rename d5/d16/d1a/d27/d3e/c73 to d5/d16/d1a/d27/d37/daf/cca 0 2024-02-28T23:07:28.323 INFO:tasks.workunit.client.0.smithi159.stdout:7/618: rename d5/d56 to d5/d56/d50/daa/dcb 22 2024-02-28T23:07:28.324 INFO:tasks.workunit.client.1.smithi184.stdout:2/332: unlink fe 0 2024-02-28T23:07:28.324 INFO:tasks.workunit.client.1.smithi184.stdout:9/353: truncate d5/db/de/f21 2288770 0 2024-02-28T23:07:28.324 INFO:tasks.workunit.client.0.smithi159.stdout:1/727: dread d6/d1d/d46/d88/dd3/f44 [4194304,4194304] 0 2024-02-28T23:07:28.325 INFO:tasks.workunit.client.0.smithi159.stdout:7/619: stat d5/d16/d1a/d27/d3e/c71 0 2024-02-28T23:07:28.327 INFO:tasks.workunit.client.1.smithi184.stdout:9/354: chown d5/db/de/d10/d12 6236206 1 2024-02-28T23:07:28.327 INFO:tasks.workunit.client.0.smithi159.stdout:5/689: fsync d8/d19/d23/d2a/f5a 0 2024-02-28T23:07:28.328 INFO:tasks.workunit.client.0.smithi159.stdout:1/728: chown d6/d12/d31/d5a/fa2 329 1 2024-02-28T23:07:28.331 INFO:tasks.workunit.client.1.smithi184.stdout:5/350: dwrite db/d12/d18/d2e/d3c/d5d/d66/f6e [0,4194304] 0 2024-02-28T23:07:28.332 INFO:tasks.workunit.client.1.smithi184.stdout:0/355: mknod d0/df/d13/d27/d31/d55/c79 0 2024-02-28T23:07:28.334 INFO:tasks.workunit.client.1.smithi184.stdout:4/352: write d1/dc/df/f31 [890362,116527] 0 2024-02-28T23:07:28.335 INFO:tasks.workunit.client.1.smithi184.stdout:5/351: dread - db/d12/d1c/d21/d2f/f4e zero size 2024-02-28T23:07:28.344 INFO:tasks.workunit.client.1.smithi184.stdout:6/285: getdents dc/de 0 2024-02-28T23:07:28.345 INFO:tasks.workunit.client.1.smithi184.stdout:3/368: dread d1/d4/f42 [0,4194304] 0 2024-02-28T23:07:28.346 INFO:tasks.workunit.client.1.smithi184.stdout:6/286: readlink dc/de/d10/d16/l32 0 2024-02-28T23:07:28.346 INFO:tasks.workunit.client.1.smithi184.stdout:1/408: dread fa [0,4194304] 0 2024-02-28T23:07:28.346 INFO:tasks.workunit.client.0.smithi159.stdout:6/710: creat d0/d1b/d33/d8c/fe5 x:0 0 0 2024-02-28T23:07:28.347 INFO:tasks.workunit.client.1.smithi184.stdout:1/409: stat d20/f88 0 2024-02-28T23:07:28.350 INFO:tasks.workunit.client.1.smithi184.stdout:1/410: stat d20/d32/d3e/f7a 0 2024-02-28T23:07:28.350 INFO:tasks.workunit.client.1.smithi184.stdout:7/322: write d6/d9/d13/f1f [80963,113465] 0 2024-02-28T23:07:28.351 INFO:tasks.workunit.client.1.smithi184.stdout:1/411: chown d20/d46/f69 2104298048 1 2024-02-28T23:07:28.356 INFO:tasks.workunit.client.0.smithi159.stdout:8/852: dwrite d2/f6d [0,4194304] 0 2024-02-28T23:07:28.356 INFO:tasks.workunit.client.1.smithi184.stdout:2/333: dread d10/d1f/f4c [0,4194304] 0 2024-02-28T23:07:28.361 INFO:tasks.workunit.client.0.smithi159.stdout:2/646: unlink d9/d50/d54/cc6 0 2024-02-28T23:07:28.363 INFO:tasks.workunit.client.0.smithi159.stdout:2/647: write d9/f11 [987368,102684] 0 2024-02-28T23:07:28.369 INFO:tasks.workunit.client.1.smithi184.stdout:9/355: rename d5/d26/d50/f4e to d5/db/de/d10/f7a 0 2024-02-28T23:07:28.369 INFO:tasks.workunit.client.0.smithi159.stdout:7/620: truncate d5/d10/f11 3367318 0 2024-02-28T23:07:28.373 INFO:tasks.workunit.client.1.smithi184.stdout:5/352: mknod db/d12/d1c/d21/d2f/c73 0 2024-02-28T23:07:28.375 INFO:tasks.workunit.client.0.smithi159.stdout:5/690: dread - d8/d19/d23/d35/d41/daa/d79/fa4 zero size 2024-02-28T23:07:28.375 INFO:tasks.workunit.client.1.smithi184.stdout:5/353: chown db/d12/l2d 263344180 1 2024-02-28T23:07:28.381 INFO:tasks.workunit.client.0.smithi159.stdout:3/685: symlink d0/d47/ldc 0 2024-02-28T23:07:28.388 INFO:tasks.workunit.client.0.smithi159.stdout:1/729: write d6/d1d/d46/d88/dd3/d63/f74 [560009,6188] 0 2024-02-28T23:07:28.390 INFO:tasks.workunit.client.1.smithi184.stdout:3/369: write d1/d4/d6/d1e/f6c [723255,75027] 0 2024-02-28T23:07:28.392 INFO:tasks.workunit.client.0.smithi159.stdout:6/711: symlink d0/d1b/d33/d3f/d44/d7a/le6 0 2024-02-28T23:07:28.393 INFO:tasks.workunit.client.1.smithi184.stdout:0/356: dread d0/df/f30 [0,4194304] 0 2024-02-28T23:07:28.394 INFO:tasks.workunit.client.1.smithi184.stdout:0/357: readlink d0/d1d/l5d 0 2024-02-28T23:07:28.398 INFO:tasks.workunit.client.0.smithi159.stdout:4/811: getdents d9/d20/d87/d115/d1c/dad 0 2024-02-28T23:07:28.401 INFO:tasks.workunit.client.1.smithi184.stdout:4/353: sync 2024-02-28T23:07:28.401 INFO:tasks.workunit.client.0.smithi159.stdout:8/853: readlink d2/d11/d52/d26/d36/d38/d77/dc5/lec 0 2024-02-28T23:07:28.404 INFO:tasks.workunit.client.1.smithi184.stdout:7/323: fsync d6/d9/d13/d1e/d2f/d33/f36 0 2024-02-28T23:07:28.405 INFO:tasks.workunit.client.0.smithi159.stdout:0/855: link d0/de/l32 d0/de/d75/db8/l12f 0 2024-02-28T23:07:28.406 INFO:tasks.workunit.client.1.smithi184.stdout:1/412: chown d20/d32/l67 2 1 2024-02-28T23:07:28.408 INFO:tasks.workunit.client.0.smithi159.stdout:2/648: fdatasync d9/d23/d2c/f91 0 2024-02-28T23:07:28.410 INFO:tasks.workunit.client.1.smithi184.stdout:8/353: creat d1/da/f89 x:0 0 0 2024-02-28T23:07:28.412 INFO:tasks.workunit.client.1.smithi184.stdout:9/356: creat d5/db/de/d10/d12/d2f/f7b x:0 0 0 2024-02-28T23:07:28.417 INFO:tasks.workunit.client.0.smithi159.stdout:3/686: readlink d0/l24 0 2024-02-28T23:07:28.418 INFO:tasks.workunit.client.0.smithi159.stdout:9/732: link d4/d76/la5 d4/d3d/d3e/le5 0 2024-02-28T23:07:28.423 INFO:tasks.workunit.client.0.smithi159.stdout:6/712: fdatasync d0/d1b/d33/d11/f19 0 2024-02-28T23:07:28.425 INFO:tasks.workunit.client.0.smithi159.stdout:1/730: write d6/d12/d16/f42 [415390,92922] 0 2024-02-28T23:07:28.428 INFO:tasks.workunit.client.1.smithi184.stdout:1/413: mkdir d20/d32/d3e/d91 0 2024-02-28T23:07:28.429 INFO:tasks.workunit.client.1.smithi184.stdout:9/357: dwrite d5/d17/d43/f5b [0,4194304] 0 2024-02-28T23:07:28.430 INFO:tasks.workunit.client.0.smithi159.stdout:6/713: readlink d0/d1b/d33/d11/d34/d9d/da2/db7/la6 0 2024-02-28T23:07:28.430 INFO:tasks.workunit.client.0.smithi159.stdout:7/621: dwrite d5/fb [0,4194304] 0 2024-02-28T23:07:28.431 INFO:tasks.workunit.client.1.smithi184.stdout:3/370: dwrite d1/d4/fb [0,4194304] 0 2024-02-28T23:07:28.433 INFO:tasks.workunit.client.1.smithi184.stdout:3/371: write d1/d4/d6/f51 [672642,118674] 0 2024-02-28T23:07:28.433 INFO:tasks.workunit.client.0.smithi159.stdout:8/854: mknod d2/d11/d52/d26/d36/d38/c10d 0 2024-02-28T23:07:28.436 INFO:tasks.workunit.client.1.smithi184.stdout:8/354: mkdir d1/da/dc/d16/d4d/d8a 0 2024-02-28T23:07:28.447 INFO:tasks.workunit.client.0.smithi159.stdout:2/649: creat d9/d80/fe5 x:0 0 0 2024-02-28T23:07:28.450 INFO:tasks.workunit.client.0.smithi159.stdout:0/856: dread d0/de/d46/f61 [0,4194304] 0 2024-02-28T23:07:28.456 INFO:tasks.workunit.client.0.smithi159.stdout:4/812: dwrite d9/d42/d54/d55/da8/fdf [0,4194304] 0 2024-02-28T23:07:28.456 INFO:tasks.workunit.client.0.smithi159.stdout:0/857: chown d0/d5/d14/f4f 219110 1 2024-02-28T23:07:28.479 INFO:tasks.workunit.client.1.smithi184.stdout:4/354: fdatasync d1/f10 0 2024-02-28T23:07:28.480 INFO:tasks.workunit.client.1.smithi184.stdout:5/354: truncate db/d12/d18/d2e/f36 2854458 0 2024-02-28T23:07:28.483 INFO:tasks.workunit.client.0.smithi159.stdout:9/733: rename d4/d3d/fd2 to d4/d3d/d3e/d55/d37/d62/d6a/fe6 0 2024-02-28T23:07:28.484 INFO:tasks.workunit.client.1.smithi184.stdout:0/358: truncate d0/f17 3051274 0 2024-02-28T23:07:28.484 INFO:tasks.workunit.client.1.smithi184.stdout:0/359: fdatasync d0/df/f41 0 2024-02-28T23:07:28.489 INFO:tasks.workunit.client.0.smithi159.stdout:3/687: dread d0/d6/fa6 [0,4194304] 0 2024-02-28T23:07:28.495 INFO:tasks.workunit.client.1.smithi184.stdout:9/358: unlink d5/db/lf 0 2024-02-28T23:07:28.498 INFO:tasks.workunit.client.0.smithi159.stdout:5/691: dwrite d8/d19/d23/d2a/f4e [0,4194304] 0 2024-02-28T23:07:28.499 INFO:tasks.workunit.client.1.smithi184.stdout:5/355: dwrite db/d12/d1c/d21/d25/f69 [0,4194304] 0 2024-02-28T23:07:28.504 INFO:tasks.workunit.client.1.smithi184.stdout:4/355: dread d1/d4/f1f [0,4194304] 0 2024-02-28T23:07:28.507 INFO:tasks.workunit.client.1.smithi184.stdout:5/356: write db/d12/d1c/d21/d4d/f56 [80342,114680] 0 2024-02-28T23:07:28.511 INFO:tasks.workunit.client.1.smithi184.stdout:8/355: creat d1/da/dc/d16/d4d/f8b x:0 0 0 2024-02-28T23:07:28.514 INFO:tasks.workunit.client.1.smithi184.stdout:8/356: read - d1/da/dc/d16/d29/f71 zero size 2024-02-28T23:07:28.520 INFO:tasks.workunit.client.0.smithi159.stdout:6/714: dwrite d0/d1b/d33/f3d [0,4194304] 0 2024-02-28T23:07:28.520 INFO:tasks.workunit.client.1.smithi184.stdout:6/287: getdents dc/de/d10/d3a 0 2024-02-28T23:07:28.524 INFO:tasks.workunit.client.1.smithi184.stdout:6/288: truncate dc/de/f29 8964113 0 2024-02-28T23:07:28.525 INFO:tasks.workunit.client.1.smithi184.stdout:4/356: dwrite d1/f33 [0,4194304] 0 2024-02-28T23:07:28.530 INFO:tasks.workunit.client.0.smithi159.stdout:4/813: unlink d9/d20/d87/d115/d1c/c31 0 2024-02-28T23:07:28.534 INFO:tasks.workunit.client.1.smithi184.stdout:0/360: unlink d0/d1d/d4c/f75 0 2024-02-28T23:07:28.534 INFO:tasks.workunit.client.1.smithi184.stdout:2/334: getdents d10/d55 0 2024-02-28T23:07:28.538 INFO:tasks.workunit.client.1.smithi184.stdout:3/372: write d1/d4/d6/d1f/d26/f29 [3409711,70040] 0 2024-02-28T23:07:28.541 INFO:tasks.workunit.client.1.smithi184.stdout:9/359: mkdir d5/d47/d68/d7c 0 2024-02-28T23:07:28.542 INFO:tasks.workunit.client.0.smithi159.stdout:8/855: dwrite d2/d11/d52/d26/f31 [0,4194304] 0 2024-02-28T23:07:28.543 INFO:tasks.workunit.client.1.smithi184.stdout:9/360: write d5/d47/d68/f6f [7802,113493] 0 2024-02-28T23:07:28.545 INFO:tasks.workunit.client.0.smithi159.stdout:9/734: rename d4/f30 to d4/de4/de3/fe7 0 2024-02-28T23:07:28.546 INFO:tasks.workunit.client.0.smithi159.stdout:6/715: dwrite d0/d1b/d33/d11/d34/d9d/da2/f61 [0,4194304] 0 2024-02-28T23:07:28.551 INFO:tasks.workunit.client.0.smithi159.stdout:6/716: fsync d0/d1b/f1a 0 2024-02-28T23:07:28.553 INFO:tasks.workunit.client.1.smithi184.stdout:3/373: dwrite d1/d4/d6/f51 [0,4194304] 0 2024-02-28T23:07:28.554 INFO:tasks.workunit.client.0.smithi159.stdout:1/731: truncate d6/d12/d33/f3a 174086 0 2024-02-28T23:07:28.562 INFO:tasks.workunit.client.1.smithi184.stdout:7/324: link d6/d9/d13/d1e/d2f/f44 d6/d9/da/dc/f77 0 2024-02-28T23:07:28.564 INFO:tasks.workunit.client.1.smithi184.stdout:7/325: dread - d6/d9/da/dc/d49/f4f zero size 2024-02-28T23:07:28.569 INFO:tasks.workunit.client.1.smithi184.stdout:8/357: fsync d1/da/d10/d43/f5e 0 2024-02-28T23:07:28.571 INFO:tasks.workunit.client.0.smithi159.stdout:7/622: creat d5/d56/d50/d88/fcc x:0 0 0 2024-02-28T23:07:28.573 INFO:tasks.workunit.client.0.smithi159.stdout:2/650: dwrite d9/d36/f5a [0,4194304] 0 2024-02-28T23:07:28.574 INFO:tasks.workunit.client.0.smithi159.stdout:1/732: dread d6/d12/d16/db6/fd9 [0,4194304] 0 2024-02-28T23:07:28.574 INFO:tasks.workunit.client.0.smithi159.stdout:0/858: write d0/d5/fe2 [1278731,7655] 0 2024-02-28T23:07:28.584 INFO:tasks.workunit.client.0.smithi159.stdout:1/733: read - d6/d12/f70 zero size 2024-02-28T23:07:28.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.585+0000 7fc935600700 1 -- 172.21.15.159:0/2790149017 --> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc918000bc0 con 0x7fc92406ce40 2024-02-28T23:07:28.585 INFO:tasks.workunit.client.1.smithi184.stdout:6/289: mknod dc/de/c5b 0 2024-02-28T23:07:28.586 INFO:tasks.workunit.client.1.smithi184.stdout:4/357: mkdir d1/d8/d37/d6d 0 2024-02-28T23:07:28.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.587+0000 7fc937e00700 1 -- 172.21.15.159:0/2790149017 <== mgr.24357 v2:172.21.15.184:6828/2879526003 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fc918000bc0 con 0x7fc92406ce40 2024-02-28T23:07:28.587 INFO:tasks.workunit.client.1.smithi184.stdout:4/358: dread - d1/dc/df/d41/f5e zero size 2024-02-28T23:07:28.589 INFO:tasks.workunit.client.1.smithi184.stdout:4/359: write d1/d4/f1f [261901,24960] 0 2024-02-28T23:07:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.592+0000 7fc935600700 1 -- 172.21.15.159:0/2790149017 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc92406ce40 msgr2=0x7fc92406f300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.592+0000 7fc935600700 1 --2- 172.21.15.159:0/2790149017 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc92406ce40 0x7fc92406f300 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc930005fd0 tx=0x7fc930005ee0 comp rx=0 tx=0).stop 2024-02-28T23:07:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.592+0000 7fc935600700 1 -- 172.21.15.159:0/2790149017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401082d0 msgr2=0x7fc940118150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.592+0000 7fc935600700 1 --2- 172.21.15.159:0/2790149017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401082d0 0x7fc940118150 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc92c006010 tx=0x7fc92c00be20 comp rx=0 tx=0).stop 2024-02-28T23:07:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.592+0000 7fc935600700 1 -- 172.21.15.159:0/2790149017 shutdown_connections 2024-02-28T23:07:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.592+0000 7fc935600700 1 --2- 172.21.15.159:0/2790149017 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc92406ce40 0x7fc92406f300 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.592+0000 7fc935600700 1 --2- 172.21.15.159:0/2790149017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc940072a30 0x7fc940117c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.592+0000 7fc935600700 1 --2- 172.21.15.159:0/2790149017 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9401082d0 0x7fc940118150 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.592+0000 7fc935600700 1 -- 172.21.15.159:0/2790149017 >> 172.21.15.159:0/2790149017 conn(0x7fc94006d9f0 msgr2=0x7fc94010d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:07:28.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.593+0000 7fc935600700 1 -- 172.21.15.159:0/2790149017 shutdown_connections 2024-02-28T23:07:28.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.593+0000 7fc935600700 1 -- 172.21.15.159:0/2790149017 wait complete. 2024-02-28T23:07:28.596 INFO:tasks.workunit.client.0.smithi159.stdout:0/859: dread d0/d5/d14/d25/d2c/dab/f10c [0,4194304] 0 2024-02-28T23:07:28.606 INFO:tasks.workunit.client.0.smithi159.stdout:4/814: dread d9/f4e [4194304,4194304] 0 2024-02-28T23:07:28.606 INFO:tasks.workunit.client.0.smithi159.stdout:8/856: dread d2/d73/dc2/fac [0,4194304] 0 2024-02-28T23:07:28.609 INFO:tasks.workunit.client.1.smithi184.stdout:5/357: sync 2024-02-28T23:07:28.618 INFO:tasks.workunit.client.1.smithi184.stdout:4/360: dread d1/dc/df/f16 [0,4194304] 0 2024-02-28T23:07:28.619 INFO:tasks.workunit.client.1.smithi184.stdout:9/361: mkdir d5/db/de/d10/d12/d2f/d7d 0 2024-02-28T23:07:28.625 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:07:28.627 INFO:tasks.workunit.client.0.smithi159.stdout:6/717: symlink d0/d1b/d33/d11/d34/d9d/da2/db7/db1/le7 0 2024-02-28T23:07:28.630 INFO:tasks.workunit.client.1.smithi184.stdout:8/358: creat d1/da/d33/f8c x:0 0 0 2024-02-28T23:07:28.632 INFO:tasks.workunit.client.1.smithi184.stdout:0/361: dwrite d0/d1d/f3d [0,4194304] 0 2024-02-28T23:07:28.632 INFO:tasks.workunit.client.0.smithi159.stdout:3/688: dread d0/d2b/d55/f8a [0,4194304] 0 2024-02-28T23:07:28.635 INFO:tasks.workunit.client.0.smithi159.stdout:3/689: write d0/d6/d3e/d2f/d78/fb1 [108676,62473] 0 2024-02-28T23:07:28.636 INFO:tasks.workunit.client.1.smithi184.stdout:2/335: chown d10/d1f/d21/d5e/c44 6562 1 2024-02-28T23:07:28.636 INFO:tasks.workunit.client.0.smithi159.stdout:3/690: readlink d0/d6/lf 0 2024-02-28T23:07:28.639 INFO:tasks.workunit.client.1.smithi184.stdout:2/336: write d10/d1f/d21/d5e/f1a [3588483,5112] 0 2024-02-28T23:07:28.641 INFO:tasks.workunit.client.1.smithi184.stdout:2/337: dread - d10/d1f/d21/d5e/f58 zero size 2024-02-28T23:07:28.647 INFO:tasks.workunit.client.0.smithi159.stdout:5/692: symlink d8/d19/d23/d2a/lee 0 2024-02-28T23:07:28.648 INFO:tasks.workunit.client.1.smithi184.stdout:1/414: getdents d20/d32/d3e 0 2024-02-28T23:07:28.648 INFO:tasks.workunit.client.1.smithi184.stdout:1/415: stat d20/c2f 0 2024-02-28T23:07:28.656 INFO:tasks.workunit.client.0.smithi159.stdout:2/651: mkdir d9/d23/de6 0 2024-02-28T23:07:28.658 INFO:tasks.workunit.client.1.smithi184.stdout:5/358: creat db/d12/d18/d2e/d3c/d5d/d66/f74 x:0 0 0 2024-02-28T23:07:28.661 INFO:tasks.workunit.client.1.smithi184.stdout:5/359: fdatasync db/d12/d1c/d21/d4d/f56 0 2024-02-28T23:07:28.661 INFO:tasks.workunit.client.0.smithi159.stdout:1/734: mknod d6/d12/d33/d3c/cf5 0 2024-02-28T23:07:28.663 INFO:tasks.workunit.client.1.smithi184.stdout:9/362: rename d5/db/de/d10/f18 to d5/db/de/d10/f7e 0 2024-02-28T23:07:28.666 INFO:tasks.workunit.client.1.smithi184.stdout:9/363: chown d5/db/de/d10/f7e 64841 1 2024-02-28T23:07:28.667 INFO:tasks.workunit.client.1.smithi184.stdout:3/374: mkdir d1/d4/d6/d1f/d26/d3a/d59/d6a/d74 0 2024-02-28T23:07:28.671 INFO:tasks.workunit.client.1.smithi184.stdout:3/375: chown d1/d4/d6/d1e/f6c 796968 1 2024-02-28T23:07:28.671 INFO:tasks.workunit.client.0.smithi159.stdout:7/623: dwrite d5/d16/f30 [0,4194304] 0 2024-02-28T23:07:28.673 INFO:tasks.workunit.client.1.smithi184.stdout:3/376: fdatasync d1/d4/d1c/f52 0 2024-02-28T23:07:28.678 INFO:tasks.workunit.client.1.smithi184.stdout:0/362: creat d0/df/f7a x:0 0 0 2024-02-28T23:07:28.680 INFO:tasks.workunit.client.1.smithi184.stdout:3/377: truncate d1/d4/d6/d1f/d26/d3a/f4d 873017 0 2024-02-28T23:07:28.680 INFO:tasks.workunit.client.0.smithi159.stdout:6/718: dread d0/d6d/fa1 [0,4194304] 0 2024-02-28T23:07:28.683 INFO:tasks.workunit.client.1.smithi184.stdout:2/338: mkdir d10/d1f/d21/d4d/d71 0 2024-02-28T23:07:28.684 INFO:tasks.workunit.client.1.smithi184.stdout:6/290: dread dc/de/d10/d16/f2d [0,4194304] 0 2024-02-28T23:07:28.685 INFO:tasks.workunit.client.1.smithi184.stdout:2/339: dread - d10/f34 zero size 2024-02-28T23:07:28.685 INFO:tasks.workunit.client.0.smithi159.stdout:2/652: rename d9/d50/dcc/c49 to d9/d50/dcc/d44/dc0/ce7 0 2024-02-28T23:07:28.689 INFO:tasks.workunit.client.1.smithi184.stdout:7/326: truncate d6/d9/da/dc/f12 4066660 0 2024-02-28T23:07:28.693 INFO:tasks.workunit.client.0.smithi159.stdout:9/735: write d4/f5 [2951520,91156] 0 2024-02-28T23:07:28.697 INFO:tasks.workunit.client.0.smithi159.stdout:9/736: write d4/d3d/d3e/dad/fbf [1019141,126684] 0 2024-02-28T23:07:28.700 INFO:tasks.workunit.client.0.smithi159.stdout:2/653: dread d9/f16 [0,4194304] 0 2024-02-28T23:07:28.700 INFO:tasks.workunit.client.1.smithi184.stdout:6/291: dwrite dc/de/d10/f3d [0,4194304] 0 2024-02-28T23:07:28.707 INFO:tasks.workunit.client.1.smithi184.stdout:1/416: write f2 [434601,103423] 0 2024-02-28T23:07:28.708 INFO:tasks.workunit.client.0.smithi159.stdout:8/857: getdents d2/d11/d52/d26/d36/d38/dfb 0 2024-02-28T23:07:28.708 INFO:tasks.workunit.client.1.smithi184.stdout:1/417: write f19 [3243704,120963] 0 2024-02-28T23:07:28.717 INFO:tasks.workunit.client.0.smithi159.stdout:5/693: fsync d8/d19/d23/f49 0 2024-02-28T23:07:28.720 INFO:tasks.workunit.client.1.smithi184.stdout:0/363: stat d0/df/d13/d27/l33 0 2024-02-28T23:07:28.722 INFO:tasks.workunit.client.1.smithi184.stdout:0/364: write d0/d1d/d4c/f6b [656043,87482] 0 2024-02-28T23:07:28.724 INFO:tasks.workunit.client.0.smithi159.stdout:7/624: write d5/d16/d1a/f9a [961974,83912] 0 2024-02-28T23:07:28.727 INFO:tasks.workunit.client.1.smithi184.stdout:3/378: rename d1/d4/d5/c71 to d1/d4/d6/d1f/d24/c75 0 2024-02-28T23:07:28.730 INFO:tasks.workunit.client.0.smithi159.stdout:1/735: mkdir d6/d12/d1a/df6 0 2024-02-28T23:07:28.732 INFO:tasks.workunit.client.1.smithi184.stdout:2/340: creat d10/d1f/d21/d4d/f72 x:0 0 0 2024-02-28T23:07:28.734 INFO:tasks.workunit.client.1.smithi184.stdout:2/341: chown d10/d1f/d21/d5e/d15/d24/l30 3631 1 2024-02-28T23:07:28.736 INFO:tasks.workunit.client.0.smithi159.stdout:7/625: dread d5/f18 [0,4194304] 0 2024-02-28T23:07:28.737 INFO:tasks.workunit.client.0.smithi159.stdout:0/860: link d0/d5/d14/d25/d2c/d4b/l88 d0/de/d75/d5f/l130 0 2024-02-28T23:07:28.740 INFO:tasks.workunit.client.1.smithi184.stdout:7/327: write d6/d9/d13/d3e/f64 [140708,86667] 0 2024-02-28T23:07:28.742 INFO:tasks.workunit.client.0.smithi159.stdout:2/654: mknod d9/d50/dcc/d44/ce8 0 2024-02-28T23:07:28.744 INFO:tasks.workunit.client.0.smithi159.stdout:4/815: creat d9/d20/d87/d115/d1c/d23/f122 x:0 0 0 2024-02-28T23:07:28.747 INFO:tasks.workunit.client.0.smithi159.stdout:8/858: unlink d2/d11/d52/d26/d36/d38/d77/dc5/lec 0 2024-02-28T23:07:28.750 INFO:tasks.workunit.client.0.smithi159.stdout:8/859: write d2/d3/f2a [1925173,84623] 0 2024-02-28T23:07:28.751 INFO:tasks.workunit.client.0.smithi159.stdout:5/694: rename d8/d19/d23/d35/d41/d77/ded to d8/d19/d23/d35/d65/da3/dd2/def 0 2024-02-28T23:07:28.753 INFO:tasks.workunit.client.0.smithi159.stdout:7/626: dread - d5/d16/d1a/f96 zero size 2024-02-28T23:07:28.754 INFO:tasks.workunit.client.0.smithi159.stdout:5/695: readlink d8/d19/l1b 0 2024-02-28T23:07:28.754 INFO:tasks.workunit.client.0.smithi159.stdout:4/816: dread d9/d20/d87/d115/dc5/ff9 [0,4194304] 0 2024-02-28T23:07:28.758 INFO:tasks.workunit.client.0.smithi159.stdout:2/655: creat d9/d50/d54/fe9 x:0 0 0 2024-02-28T23:07:28.763 INFO:tasks.workunit.client.1.smithi184.stdout:6/292: dwrite dc/de/f1e [0,4194304] 0 2024-02-28T23:07:28.763 INFO:tasks.workunit.client.0.smithi159.stdout:8/860: mkdir d2/d11/d52/d26/d36/d38/d77/d9e/dc1/d10e 0 2024-02-28T23:07:28.765 INFO:tasks.workunit.client.1.smithi184.stdout:8/359: creat d1/da/d10/f8d x:0 0 0 2024-02-28T23:07:28.767 INFO:tasks.workunit.client.1.smithi184.stdout:1/418: unlink d20/d32/f7b 0 2024-02-28T23:07:28.769 INFO:tasks.workunit.client.1.smithi184.stdout:0/365: fdatasync d0/fc 0 2024-02-28T23:07:28.771 INFO:tasks.workunit.client.0.smithi159.stdout:5/696: fsync d8/d19/d23/f61 0 2024-02-28T23:07:28.771 INFO:tasks.workunit.client.1.smithi184.stdout:8/360: truncate d1/da/d10/d43/f5e 167382 0 2024-02-28T23:07:28.773 INFO:tasks.workunit.client.1.smithi184.stdout:0/366: stat d0/df/d13/d27/d31/d51/f73 0 2024-02-28T23:07:28.773 INFO:tasks.workunit.client.0.smithi159.stdout:4/817: dread - d9/d20/d87/d115/d1c/d23/d7a/fd8 zero size 2024-02-28T23:07:28.774 INFO:tasks.workunit.client.1.smithi184.stdout:3/379: mkdir d1/d4/d6/d1f/d24/d76 0 2024-02-28T23:07:28.775 INFO:tasks.workunit.client.1.smithi184.stdout:2/342: mknod d10/d55/c73 0 2024-02-28T23:07:28.775 INFO:tasks.workunit.client.0.smithi159.stdout:2/656: creat d9/d50/d54/d84/d37/d5c/fea x:0 0 0 2024-02-28T23:07:28.775 INFO:tasks.workunit.client.1.smithi184.stdout:4/361: getdents d1/d4 0 2024-02-28T23:07:28.776 INFO:tasks.workunit.client.1.smithi184.stdout:9/364: creat d5/db/f7f x:0 0 0 2024-02-28T23:07:28.777 INFO:tasks.workunit.client.0.smithi159.stdout:6/719: getdents d0/d1b 0 2024-02-28T23:07:28.779 INFO:tasks.workunit.client.0.smithi159.stdout:8/861: write d2/d11/d35/d5f/dfe/d68/fdc [3537682,4122] 0 2024-02-28T23:07:28.780 INFO:tasks.workunit.client.1.smithi184.stdout:1/419: creat d20/d46/d90/f92 x:0 0 0 2024-02-28T23:07:28.781 INFO:tasks.workunit.client.1.smithi184.stdout:8/361: chown d1/da/d10/c1e 10 1 2024-02-28T23:07:28.783 INFO:tasks.workunit.client.1.smithi184.stdout:8/362: write d1/f86 [220996,37554] 0 2024-02-28T23:07:28.793 INFO:tasks.workunit.client.1.smithi184.stdout:0/367: mkdir d0/df/d13/d27/d31/d5b/d7b 0 2024-02-28T23:07:28.799 INFO:tasks.workunit.client.0.smithi159.stdout:2/657: creat d9/d50/dcc/d44/dc0/feb x:0 0 0 2024-02-28T23:07:28.800 INFO:tasks.workunit.client.1.smithi184.stdout:3/380: creat d1/d4/d6/d1f/d26/d3a/d59/d6a/f77 x:0 0 0 2024-02-28T23:07:28.800 INFO:tasks.workunit.client.0.smithi159.stdout:6/720: mknod d0/d1b/d33/d11/d34/d9d/ce8 0 2024-02-28T23:07:28.802 INFO:tasks.workunit.client.0.smithi159.stdout:5/697: rename d8/d19/d23/d35/d41/daa/d79/la0 to d8/d19/d23/d35/d38/d8f/da5/ddc/lf0 0 2024-02-28T23:07:28.805 INFO:tasks.workunit.client.0.smithi159.stdout:4/818: getdents d9/d4c/d6c/d98/d103 0 2024-02-28T23:07:28.811 INFO:tasks.workunit.client.1.smithi184.stdout:8/363: symlink d1/da/d10/d17/l8e 0 2024-02-28T23:07:28.814 INFO:tasks.workunit.client.1.smithi184.stdout:5/360: link db/d12/d18/d2e/f36 db/d12/d1c/d21/f75 0 2024-02-28T23:07:28.817 INFO:tasks.workunit.client.0.smithi159.stdout:6/721: dread d0/d1b/fcb [4194304,4194304] 0 2024-02-28T23:07:28.818 INFO:tasks.workunit.client.1.smithi184.stdout:0/368: fdatasync d0/df/d13/f14 0 2024-02-28T23:07:28.821 INFO:tasks.workunit.client.0.smithi159.stdout:8/862: rename d2/d11/d74/fd0 to d2/d11/d52/d47/db6/dba/f10f 0 2024-02-28T23:07:28.824 INFO:tasks.workunit.client.1.smithi184.stdout:7/328: getdents d6/d9/d13/d1e/d2f/d33/d5b/d6c 0 2024-02-28T23:07:28.825 INFO:tasks.workunit.client.0.smithi159.stdout:0/861: dwrite d0/d5/ff [0,4194304] 0 2024-02-28T23:07:28.836 INFO:tasks.workunit.client.0.smithi159.stdout:9/737: dwrite d4/d3d/d3e/d55/d4c/d4e/f9c [0,4194304] 0 2024-02-28T23:07:28.836 INFO:tasks.workunit.client.1.smithi184.stdout:1/420: mknod d20/c93 0 2024-02-28T23:07:28.838 INFO:tasks.workunit.client.1.smithi184.stdout:1/421: dread - d20/f47 zero size 2024-02-28T23:07:28.838 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:28 smithi159 ceph-mon[28802]: pgmap v33: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 45 MiB/s rd, 162 MiB/s wr, 312 op/s 2024-02-28T23:07:28.839 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:28 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:07:28.840 INFO:tasks.workunit.client.1.smithi184.stdout:1/422: fdatasync d20/d32/d3e/f7a 0 2024-02-28T23:07:28.842 INFO:tasks.workunit.client.1.smithi184.stdout:6/293: write dc/de/f20 [1752543,36388] 0 2024-02-28T23:07:28.844 INFO:tasks.workunit.client.1.smithi184.stdout:6/294: fdatasync f8 0 2024-02-28T23:07:28.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.847+0000 7ff0bca00700 1 -- 172.21.15.159:0/1061065611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b8101da0 msgr2=0x7ff0b8104230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:28.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.847+0000 7ff0bca00700 1 --2- 172.21.15.159:0/1061065611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b8101da0 0x7ff0b8104230 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4009910 tx=0x7ff0a4009c20 comp rx=0 tx=0).stop 2024-02-28T23:07:28.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.849+0000 7ff0bca00700 1 -- 172.21.15.159:0/1061065611 shutdown_connections 2024-02-28T23:07:28.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.849+0000 7ff0bca00700 1 --2- 172.21.15.159:0/1061065611 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b8101da0 0x7ff0b8104230 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:28.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.849+0000 7ff0bca00700 1 --2- 172.21.15.159:0/1061065611 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b80ff430 0x7ff0b8101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:28.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.849+0000 7ff0bca00700 1 -- 172.21.15.159:0/1061065611 >> 172.21.15.159:0/1061065611 conn(0x7ff0b80fb030 msgr2=0x7ff0b80fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:07:28.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.849+0000 7ff0bca00700 1 -- 172.21.15.159:0/1061065611 shutdown_connections 2024-02-28T23:07:28.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.849+0000 7ff0bca00700 1 -- 172.21.15.159:0/1061065611 wait complete. 2024-02-28T23:07:28.848 INFO:tasks.workunit.client.0.smithi159.stdout:4/819: rename d9/d20/d87/d115/d1c/d23/d2d/ffb to d9/d20/d87/d115/d1c/d23/d2d/d59/f123 0 2024-02-28T23:07:28.849 INFO:tasks.workunit.client.1.smithi184.stdout:6/295: chown dc/c2e 218818289 1 2024-02-28T23:07:28.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.851+0000 7ff0bca00700 1 Processor -- start 2024-02-28T23:07:28.849 INFO:tasks.workunit.client.0.smithi159.stdout:4/820: readlink d9/d20/d87/d115/d1c/l111 0 2024-02-28T23:07:28.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.852+0000 7ff0bca00700 1 -- start start 2024-02-28T23:07:28.861 INFO:tasks.workunit.client.1.smithi184.stdout:6/296: write dc/de/d10/f4b [1502809,123727] 0 2024-02-28T23:07:28.861 INFO:tasks.workunit.client.1.smithi184.stdout:1/423: dwrite d20/f3a [4194304,4194304] 0 2024-02-28T23:07:28.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.853+0000 7ff0bca00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b80ff430 0x7ff0b8071d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:28.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.853+0000 7ff0bca00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b8101da0 0x7ff0b8072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:28.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.853+0000 7ff0bca00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b80728b0 con 0x7ff0b8101da0 2024-02-28T23:07:28.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.853+0000 7ff0bca00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b81aa7c0 con 0x7ff0b80ff430 2024-02-28T23:07:28.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.853+0000 7ff0b5400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b8101da0 0x7ff0b8072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.853+0000 7ff0b5400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b8101da0 0x7ff0b8072290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51464/0 (socket says 172.21.15.159:51464) 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.853+0000 7ff0b5400700 1 -- 172.21.15.159:0/1198438144 learned_addr learned my addr 172.21.15.159:0/1198438144 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.853+0000 7ff0b5e00700 1 --2- 172.21.15.159:0/1198438144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b80ff430 0x7ff0b8071d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.854+0000 7ff0b5400700 1 -- 172.21.15.159:0/1198438144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b80ff430 msgr2=0x7ff0b8071d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.854+0000 7ff0b5400700 1 --2- 172.21.15.159:0/1198438144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b80ff430 0x7ff0b8071d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.854+0000 7ff0b5400700 1 -- 172.21.15.159:0/1198438144 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0a40095f0 con 0x7ff0b8101da0 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.854+0000 7ff0b5400700 1 --2- 172.21.15.159:0/1198438144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b8101da0 0x7ff0b8072290 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4000c00 tx=0x7ff0a400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.855+0000 7ff0aea00700 1 -- 172.21.15.159:0/1198438144 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a401d070 con 0x7ff0b8101da0 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.855+0000 7ff0aea00700 1 -- 172.21.15.159:0/1198438144 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff0a4022470 con 0x7ff0b8101da0 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.855+0000 7ff0aea00700 1 -- 172.21.15.159:0/1198438144 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0a400f690 con 0x7ff0b8101da0 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.855+0000 7ff0bca00700 1 -- 172.21.15.159:0/1198438144 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b81aa900 con 0x7ff0b8101da0 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.855+0000 7ff0bca00700 1 -- 172.21.15.159:0/1198438144 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b81aadf0 con 0x7ff0b8101da0 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.858+0000 7ff0bca00700 1 -- 172.21.15.159:0/1198438144 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b806bf50 con 0x7ff0b8101da0 2024-02-28T23:07:28.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.859+0000 7ff0aea00700 1 -- 172.21.15.159:0/1198438144 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) v1 ==== 90929+0+0 (secure 0 0 0) 0x7ff0a400f7f0 con 0x7ff0b8101da0 2024-02-28T23:07:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.860+0000 7ff0aea00700 1 --2- 172.21.15.159:0/1198438144 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7ff09c06ce80 0x7ff09c06f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.860+0000 7ff0aea00700 1 -- 172.21.15.159:0/1198438144 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7ff0a408dcf0 con 0x7ff0b8101da0 2024-02-28T23:07:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.861+0000 7ff0b5e00700 1 --2- 172.21.15.159:0/1198438144 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7ff09c06ce80 0x7ff09c06f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:28.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.862+0000 7ff0b5e00700 1 --2- 172.21.15.159:0/1198438144 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7ff09c06ce80 0x7ff09c06f340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0b81a6730 tx=0x7ff0a8009190 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:07:28.864 INFO:tasks.workunit.client.0.smithi159.stdout:5/698: truncate d8/d19/d23/d35/d41/fb1 1233544 0 2024-02-28T23:07:28.866 INFO:tasks.workunit.client.1.smithi184.stdout:9/365: truncate d5/db/de/d10/f2a 6455178 0 2024-02-28T23:07:28.868 INFO:tasks.workunit.client.0.smithi159.stdout:0/862: mknod d0/d5/d14/d25/c131 0 2024-02-28T23:07:28.869 INFO:tasks.workunit.client.1.smithi184.stdout:8/364: write d1/da/dc/d18/f19 [3702330,104065] 0 2024-02-28T23:07:28.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:28.871+0000 7ff0aea00700 1 -- 172.21.15.159:0/1198438144 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7ff0a4058a60 con 0x7ff0b8101da0 2024-02-28T23:07:28.872 INFO:tasks.workunit.client.0.smithi159.stdout:9/738: mknod d4/d3d/d3e/d55/d4c/db6/ce8 0 2024-02-28T23:07:28.873 INFO:tasks.workunit.client.1.smithi184.stdout:7/329: rename d6/c6f to d6/d68/c78 0 2024-02-28T23:07:28.873 INFO:tasks.workunit.client.1.smithi184.stdout:8/365: chown d1/da/dc/d16/d32/d42/f61 6366714 1 2024-02-28T23:07:28.874 INFO:tasks.workunit.client.1.smithi184.stdout:8/366: chown d1/da/f89 21085942 1 2024-02-28T23:07:28.876 INFO:tasks.workunit.client.1.smithi184.stdout:7/330: read - d6/d9/d13/d1e/d2f/d33/d5b/f6b zero size 2024-02-28T23:07:28.877 INFO:tasks.workunit.client.0.smithi159.stdout:2/658: getdents d9/d50/dcc/d44/dc8 0 2024-02-28T23:07:28.878 INFO:tasks.workunit.client.0.smithi159.stdout:6/722: dwrite d0/d1b/d33/f43 [0,4194304] 0 2024-02-28T23:07:28.879 INFO:tasks.workunit.client.0.smithi159.stdout:4/821: creat d9/d42/d54/d56/df5/f124 x:0 0 0 2024-02-28T23:07:28.879 INFO:tasks.workunit.client.0.smithi159.stdout:0/863: rename d0/d5/d14/d34/f81 to d0/d5/d14/d25/d5c/f132 0 2024-02-28T23:07:28.893 INFO:tasks.workunit.client.1.smithi184.stdout:3/381: truncate d1/d4/d6/d1f/f2c 4032821 0 2024-02-28T23:07:28.894 INFO:tasks.workunit.client.0.smithi159.stdout:5/699: creat d8/d19/d23/d35/d41/d92/dc8/ff1 x:0 0 0 2024-02-28T23:07:28.894 INFO:tasks.workunit.client.0.smithi159.stdout:5/700: readlink l5 0 2024-02-28T23:07:28.896 INFO:tasks.workunit.client.1.smithi184.stdout:1/424: truncate f1d 1049438 0 2024-02-28T23:07:28.904 INFO:tasks.workunit.client.1.smithi184.stdout:0/369: mkdir d0/d7c 0 2024-02-28T23:07:28.907 INFO:tasks.workunit.client.0.smithi159.stdout:8/863: dread d2/d3/ff4 [0,4194304] 0 2024-02-28T23:07:28.907 INFO:tasks.workunit.client.0.smithi159.stdout:6/723: rmdir d0/d1b/d33/d11/d34/d9d/da2/d4e 39 2024-02-28T23:07:28.909 INFO:tasks.workunit.client.1.smithi184.stdout:4/362: getdents d1/dc/df/d5b 0 2024-02-28T23:07:28.911 INFO:tasks.workunit.client.0.smithi159.stdout:0/864: dwrite d0/de/ff4 [0,4194304] 0 2024-02-28T23:07:28.914 INFO:tasks.workunit.client.0.smithi159.stdout:5/701: stat d8/c9 0 2024-02-28T23:07:28.921 INFO:tasks.workunit.client.0.smithi159.stdout:4/822: write d9/d4c/fae [797659,83070] 0 2024-02-28T23:07:28.922 INFO:tasks.workunit.client.1.smithi184.stdout:7/331: readlink d6/d9/d13/d1e/d2f/l5c 0 2024-02-28T23:07:28.922 INFO:tasks.workunit.client.1.smithi184.stdout:6/297: mkdir dc/de/d2a/d5c 0 2024-02-28T23:07:28.924 INFO:tasks.workunit.client.1.smithi184.stdout:3/382: creat d1/d4/d6/d1f/d26/f78 x:0 0 0 2024-02-28T23:07:28.929 INFO:tasks.workunit.client.1.smithi184.stdout:1/425: symlink d20/d46/d90/l94 0 2024-02-28T23:07:28.930 INFO:tasks.workunit.client.0.smithi159.stdout:6/724: chown d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/l97 348 1 2024-02-28T23:07:28.931 INFO:tasks.workunit.client.0.smithi159.stdout:8/864: mkdir d2/d11/d52/d26/d36/d38/d77/d110 0 2024-02-28T23:07:28.933 INFO:tasks.workunit.client.0.smithi159.stdout:5/702: symlink d8/d19/d23/d35/d41/daa/d79/lf2 0 2024-02-28T23:07:28.935 INFO:tasks.workunit.client.1.smithi184.stdout:2/343: sync 2024-02-28T23:07:28.938 INFO:tasks.workunit.client.1.smithi184.stdout:9/366: rename d5/c8 to d5/d26/c80 0 2024-02-28T23:07:28.938 INFO:tasks.workunit.client.1.smithi184.stdout:8/367: symlink d1/da/d10/d6b/l8f 0 2024-02-28T23:07:28.938 INFO:tasks.workunit.client.0.smithi159.stdout:8/865: chown d2/d11/d52/d26/d36/d38/d77/d9e/dc1/led 6079698 1 2024-02-28T23:07:28.938 INFO:tasks.workunit.client.0.smithi159.stdout:9/739: getdents d4/d3d/d3e/d4a/dc5 0 2024-02-28T23:07:28.938 INFO:tasks.workunit.client.0.smithi159.stdout:2/659: dwrite d9/d23/f7f [0,4194304] 0 2024-02-28T23:07:28.939 INFO:tasks.workunit.client.0.smithi159.stdout:4/823: dread - d9/fbe zero size 2024-02-28T23:07:28.940 INFO:tasks.workunit.client.1.smithi184.stdout:6/298: dwrite f8 [4194304,4194304] 0 2024-02-28T23:07:28.941 INFO:tasks.workunit.client.1.smithi184.stdout:7/332: unlink d6/d9/d13/d1e/d2f/d33/f72 0 2024-02-28T23:07:28.941 INFO:tasks.workunit.client.1.smithi184.stdout:3/383: dread d1/d4/f23 [0,4194304] 0 2024-02-28T23:07:28.942 INFO:tasks.workunit.client.1.smithi184.stdout:3/384: fdatasync d1/d4/f57 0 2024-02-28T23:07:28.943 INFO:tasks.workunit.client.0.smithi159.stdout:0/865: mkdir d0/d5/d14/d34/d133 0 2024-02-28T23:07:28.945 INFO:tasks.workunit.client.0.smithi159.stdout:6/725: symlink d0/d6d/le9 0 2024-02-28T23:07:28.945 INFO:tasks.workunit.client.0.smithi159.stdout:8/866: chown d2/d11/d52/d26/d36/d38/d77/d9e/cbe 110478 1 2024-02-28T23:07:28.945 INFO:tasks.workunit.client.1.smithi184.stdout:3/385: chown d1/d4/d6/d1f/d26/d3a/d59/d6a/d6e 9 1 2024-02-28T23:07:28.945 INFO:tasks.workunit.client.0.smithi159.stdout:5/703: mkdir d8/d19/d23/d35/d38/d8f/da5/df3 0 2024-02-28T23:07:28.946 INFO:tasks.workunit.client.0.smithi159.stdout:9/740: dread - d4/d3d/d3e/d55/d37/d62/d6a/fe6 zero size 2024-02-28T23:07:28.948 INFO:tasks.workunit.client.1.smithi184.stdout:3/386: stat d1/d4/d6/d1f/d24 0 2024-02-28T23:07:28.949 INFO:tasks.workunit.client.0.smithi159.stdout:2/660: symlink d9/d50/dcc/d44/dc0/dda/lec 0 2024-02-28T23:07:28.951 INFO:tasks.workunit.client.1.smithi184.stdout:4/363: symlink d1/dc/df/d5b/d6c/l6e 0 2024-02-28T23:07:28.951 INFO:tasks.workunit.client.0.smithi159.stdout:6/726: dread - d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/fde zero size 2024-02-28T23:07:28.952 INFO:tasks.workunit.client.1.smithi184.stdout:2/344: dwrite d10/f14 [0,4194304] 0 2024-02-28T23:07:28.954 INFO:tasks.workunit.client.0.smithi159.stdout:0/866: symlink d0/d5/d14/d78/l134 0 2024-02-28T23:07:28.957 INFO:tasks.workunit.client.0.smithi159.stdout:0/867: chown d0/d5/d38/d76/f12a 9 1 2024-02-28T23:07:28.963 INFO:tasks.workunit.client.1.smithi184.stdout:0/370: rename d0/l20 to d0/d47/l7d 0 2024-02-28T23:07:28.967 INFO:tasks.workunit.client.0.smithi159.stdout:4/824: mkdir d9/d20/d87/d115/d1c/d125 0 2024-02-28T23:07:28.969 INFO:tasks.workunit.client.0.smithi159.stdout:9/741: chown d4/f5f 66 1 2024-02-28T23:07:28.974 INFO:tasks.workunit.client.1.smithi184.stdout:7/333: fdatasync f0 0 2024-02-28T23:07:28.976 INFO:tasks.workunit.client.0.smithi159.stdout:2/661: fdatasync d9/d50/dcc/d44/dc8/fc9 0 2024-02-28T23:07:28.977 INFO:tasks.workunit.client.1.smithi184.stdout:7/334: write d6/d9/d13/d3e/f64 [723847,51787] 0 2024-02-28T23:07:28.985 INFO:tasks.workunit.client.0.smithi159.stdout:4/825: symlink d9/d20/d87/d115/d1c/d8e/ddc/l126 0 2024-02-28T23:07:28.986 INFO:tasks.workunit.client.1.smithi184.stdout:5/361: getdents db/d1f 0 2024-02-28T23:07:28.987 INFO:tasks.workunit.client.0.smithi159.stdout:9/742: chown d4/d3d/d3e/d55/l1c 113 1 2024-02-28T23:07:28.992 INFO:tasks.workunit.client.1.smithi184.stdout:3/387: rmdir d1/d4/d6/d1f/d26/d3a/d59/d67 39 2024-02-28T23:07:28.995 INFO:tasks.workunit.client.1.smithi184.stdout:3/388: chown d1/d4/d1c/f27 150 1 2024-02-28T23:07:28.996 INFO:tasks.workunit.client.1.smithi184.stdout:2/345: stat d10/d1f/f41 0 2024-02-28T23:07:28.998 INFO:tasks.workunit.client.1.smithi184.stdout:3/389: write d1/d4/f57 [4884815,128662] 0 2024-02-28T23:07:28.998 INFO:tasks.workunit.client.0.smithi159.stdout:8/867: dread d2/d11/d52/d26/d36/d38/f39 [0,4194304] 0 2024-02-28T23:07:28.999 INFO:tasks.workunit.client.1.smithi184.stdout:9/367: rename d5/d17/c37 to d5/db/d5c/d5e/c81 0 2024-02-28T23:07:29.004 INFO:tasks.workunit.client.0.smithi159.stdout:6/727: rename d0/d6d/le9 to d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/lea 0 2024-02-28T23:07:29.004 INFO:tasks.workunit.client.0.smithi159.stdout:0/868: dread d0/de/d75/db8/fed [0,4194304] 0 2024-02-28T23:07:29.004 INFO:tasks.workunit.client.1.smithi184.stdout:1/426: truncate f2 3977019 0 2024-02-28T23:07:29.005 INFO:tasks.workunit.client.1.smithi184.stdout:5/362: dwrite db/d12/d1c/d21/d2f/f55 [0,4194304] 0 2024-02-28T23:07:29.005 INFO:tasks.workunit.client.1.smithi184.stdout:1/427: readlink d20/d32/d3e/l5b 0 2024-02-28T23:07:29.005 INFO:tasks.workunit.client.0.smithi159.stdout:5/704: dwrite d8/d19/d23/d35/d38/d8f/da5/fbf [0,4194304] 0 2024-02-28T23:07:29.006 INFO:tasks.workunit.client.0.smithi159.stdout:4/826: truncate d9/d4c/d6c/fbb 1096430 0 2024-02-28T23:07:29.007 INFO:tasks.workunit.client.1.smithi184.stdout:0/371: symlink d0/df/d13/d27/d31/l7e 0 2024-02-28T23:07:29.007 INFO:tasks.workunit.client.1.smithi184.stdout:4/364: write d1/d4/f11 [3344894,60197] 0 2024-02-28T23:07:29.008 INFO:tasks.workunit.client.0.smithi159.stdout:4/827: chown d9/f3c 2206 1 2024-02-28T23:07:29.009 INFO:tasks.workunit.client.1.smithi184.stdout:0/372: dread - d0/df/f61 zero size 2024-02-28T23:07:29.010 INFO:tasks.workunit.client.0.smithi159.stdout:2/662: rename d9/d50/d54/d84/d37/c3d to d9/d50/d62/ced 0 2024-02-28T23:07:29.010 INFO:tasks.workunit.client.0.smithi159.stdout:0/869: write d0/d5/d14/d34/d6c/fcf [42939,11873] 0 2024-02-28T23:07:29.016 INFO:tasks.workunit.client.0.smithi159.stdout:4/828: chown d9/d20/d87/d115/d1c/d8e/fce 535 1 2024-02-28T23:07:29.024 INFO:tasks.workunit.client.1.smithi184.stdout:7/335: creat d6/d9/d13/d1e/d2f/d33/d5b/d6c/f79 x:0 0 0 2024-02-28T23:07:29.027 INFO:tasks.workunit.client.1.smithi184.stdout:7/336: chown d6/d9/d13/d1e/d2f/d34/d47/f58 436081 1 2024-02-28T23:07:29.028 INFO:tasks.workunit.client.0.smithi159.stdout:8/868: mknod d2/d11/d52/d26/d36/d38/d77/d9e/dc1/df7/d102/c111 0 2024-02-28T23:07:29.029 INFO:tasks.workunit.client.1.smithi184.stdout:8/368: write d1/da/dc/d16/d4d/f5a [391207,104792] 0 2024-02-28T23:07:29.039 INFO:tasks.workunit.client.0.smithi159.stdout:2/663: dwrite d9/d50/d54/d84/f9f [4194304,4194304] 0 2024-02-28T23:07:29.045 INFO:tasks.workunit.client.0.smithi159.stdout:6/728: write d0/d1b/d33/d11/f7c [54667,119789] 0 2024-02-28T23:07:29.047 INFO:tasks.workunit.client.1.smithi184.stdout:8/369: dwrite d1/da/f1a [0,4194304] 0 2024-02-28T23:07:29.049 INFO:tasks.workunit.client.1.smithi184.stdout:6/299: rename c9 to dc/de/d10/d16/c5d 0 2024-02-28T23:07:29.051 INFO:tasks.workunit.client.1.smithi184.stdout:8/370: dread - d1/da/dc/d16/d32/d42/d77/f85 zero size 2024-02-28T23:07:29.052 INFO:tasks.workunit.client.1.smithi184.stdout:9/368: dread d5/fc [0,4194304] 0 2024-02-28T23:07:29.056 INFO:tasks.workunit.client.0.smithi159.stdout:5/705: write d8/db4/fd1 [891162,17985] 0 2024-02-28T23:07:29.056 INFO:tasks.workunit.client.1.smithi184.stdout:5/363: chown db/d1f/c6c 61600 1 2024-02-28T23:07:29.057 INFO:tasks.workunit.client.1.smithi184.stdout:5/364: readlink db/d12/l2d 0 2024-02-28T23:07:29.059 INFO:tasks.workunit.client.1.smithi184.stdout:5/365: fsync db/d1f/f5b 0 2024-02-28T23:07:29.061 INFO:tasks.workunit.client.1.smithi184.stdout:5/366: write db/d12/d18/d2e/d3c/d5d/d66/f6e [2570802,11439] 0 2024-02-28T23:07:29.064 INFO:tasks.workunit.client.1.smithi184.stdout:5/367: write db/d12/d18/d2e/d3c/d5d/d66/f6e [1361786,50997] 0 2024-02-28T23:07:29.071 INFO:tasks.workunit.client.0.smithi159.stdout:4/829: dread d9/d20/d87/d115/f12 [0,4194304] 0 2024-02-28T23:07:29.074 INFO:tasks.workunit.client.1.smithi184.stdout:3/390: truncate d1/d4/d6/d1f/d26/f29 2672277 0 2024-02-28T23:07:29.076 INFO:tasks.workunit.client.1.smithi184.stdout:4/365: write d1/dc/df/f14 [3217915,64935] 0 2024-02-28T23:07:29.077 INFO:tasks.workunit.client.1.smithi184.stdout:8/371: creat d1/da/dc/d16/d32/d42/d77/f90 x:0 0 0 2024-02-28T23:07:29.080 INFO:tasks.workunit.client.0.smithi159.stdout:3/691: sync 2024-02-28T23:07:29.083 INFO:tasks.workunit.client.0.smithi159.stdout:3/692: write d0/d47/dc2/fc9 [417661,12341] 0 2024-02-28T23:07:29.084 INFO:tasks.workunit.client.1.smithi184.stdout:2/346: getdents d10/d1f/d38/d53 0 2024-02-28T23:07:29.086 INFO:tasks.workunit.client.1.smithi184.stdout:2/347: chown d10/d1f/d21/d5e/f58 64502 1 2024-02-28T23:07:29.091 INFO:tasks.workunit.client.1.smithi184.stdout:9/369: getdents d5/d17/d57 0 2024-02-28T23:07:29.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:28 smithi184 ceph-mon[36198]: pgmap v33: 65 pgs: 65 active+clean; 2.0 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 45 MiB/s rd, 162 MiB/s wr, 312 op/s 2024-02-28T23:07:29.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:28 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:07:29.100 INFO:tasks.workunit.client.1.smithi184.stdout:2/348: mknod d10/d1f/d21/d5e/c74 0 2024-02-28T23:07:29.101 INFO:tasks.workunit.client.1.smithi184.stdout:7/337: dwrite d6/d9/da/dc/f12 [0,4194304] 0 2024-02-28T23:07:29.104 INFO:tasks.workunit.client.1.smithi184.stdout:1/428: rename d20/d46/d90/l94 to d20/d32/l95 0 2024-02-28T23:07:29.106 INFO:tasks.workunit.client.1.smithi184.stdout:1/429: dread - d20/d32/d3e/d61/d8b/f8f zero size 2024-02-28T23:07:29.109 INFO:tasks.workunit.client.1.smithi184.stdout:1/430: stat d20/d32/d3e/d82/d85/d8c 0 2024-02-28T23:07:29.109 INFO:tasks.workunit.client.1.smithi184.stdout:7/338: dread d6/f30 [0,4194304] 0 2024-02-28T23:07:29.111 INFO:tasks.workunit.client.1.smithi184.stdout:9/370: read d5/f7 [2653485,38489] 0 2024-02-28T23:07:29.113 INFO:tasks.workunit.client.1.smithi184.stdout:7/339: truncate d6/d9/da/dc/f27 713897 0 2024-02-28T23:07:29.114 INFO:tasks.workunit.client.1.smithi184.stdout:2/349: symlink d10/d1f/d21/d4d/d67/l75 0 2024-02-28T23:07:29.118 INFO:tasks.workunit.client.1.smithi184.stdout:8/372: dread d1/da/df/d20/f3e [0,4194304] 0 2024-02-28T23:07:29.119 INFO:tasks.workunit.client.1.smithi184.stdout:5/368: creat db/f76 x:0 0 0 2024-02-28T23:07:29.119 INFO:tasks.workunit.client.1.smithi184.stdout:0/373: sync 2024-02-28T23:07:29.121 INFO:tasks.workunit.client.1.smithi184.stdout:4/366: link d1/c4d d1/dc/df/d27/c6f 0 2024-02-28T23:07:29.122 INFO:tasks.workunit.client.1.smithi184.stdout:4/367: chown d1/dc/df/d38 6983 1 2024-02-28T23:07:29.123 INFO:tasks.workunit.client.1.smithi184.stdout:4/368: readlink d1/d8/l45 0 2024-02-28T23:07:29.127 INFO:tasks.workunit.client.1.smithi184.stdout:7/340: creat d6/d68/f7a x:0 0 0 2024-02-28T23:07:29.130 INFO:tasks.workunit.client.1.smithi184.stdout:2/350: creat d10/d1f/d38/d54/f76 x:0 0 0 2024-02-28T23:07:29.133 INFO:tasks.workunit.client.1.smithi184.stdout:6/300: rename dc/de/l45 to dc/de/d2a/l5e 0 2024-02-28T23:07:29.140 INFO:tasks.workunit.client.1.smithi184.stdout:3/391: getdents d1/d4/d6/d1f/d24 0 2024-02-28T23:07:29.141 INFO:tasks.workunit.client.1.smithi184.stdout:1/431: creat d20/d32/d3e/d82/d85/d86/f96 x:0 0 0 2024-02-28T23:07:29.146 INFO:tasks.workunit.client.0.smithi159.stdout:8/869: symlink d2/d11/d52/d26/d36/d38/d77/d9e/dc1/l112 0 2024-02-28T23:07:29.148 INFO:tasks.workunit.client.1.smithi184.stdout:2/351: creat d10/f77 x:0 0 0 2024-02-28T23:07:29.149 INFO:tasks.workunit.client.0.smithi159.stdout:8/870: dread - d2/d11/d52/d47/db6/dba/fe7 zero size 2024-02-28T23:07:29.150 INFO:tasks.workunit.client.1.smithi184.stdout:0/374: rename d0/df/d13/d27/d2b/f72 to d0/d7c/f7f 0 2024-02-28T23:07:29.150 INFO:tasks.workunit.client.1.smithi184.stdout:2/352: write d10/f1d [303560,73188] 0 2024-02-28T23:07:29.150 INFO:tasks.workunit.client.1.smithi184.stdout:7/341: dread d6/d9/d13/f28 [0,4194304] 0 2024-02-28T23:07:29.151 INFO:tasks.workunit.client.0.smithi159.stdout:8/871: chown d2/d11/d52/d26/d36/d38/d77/dc5/cd2 4 1 2024-02-28T23:07:29.153 INFO:tasks.workunit.client.1.smithi184.stdout:6/301: unlink dc/de/d10/d16/f34 0 2024-02-28T23:07:29.153 INFO:tasks.workunit.client.1.smithi184.stdout:2/353: write d10/d1f/d21/d4d/f50 [824827,42640] 0 2024-02-28T23:07:29.155 INFO:tasks.workunit.client.1.smithi184.stdout:2/354: write fa [4306486,1086] 0 2024-02-28T23:07:29.156 INFO:tasks.workunit.client.0.smithi159.stdout:9/743: link d4/l40 d4/d3d/d3e/d55/d4c/db6/le9 0 2024-02-28T23:07:29.157 INFO:tasks.workunit.client.1.smithi184.stdout:2/355: write d10/d1f/d38/f5c [371268,119762] 0 2024-02-28T23:07:29.159 INFO:tasks.workunit.client.1.smithi184.stdout:3/392: mkdir d1/d4/d1c/d62/d79 0 2024-02-28T23:07:29.159 INFO:tasks.workunit.client.0.smithi159.stdout:9/744: chown d4/d3d/d3e/d55/d37/d62/d77/db9/dc7 15 1 2024-02-28T23:07:29.161 INFO:tasks.workunit.client.1.smithi184.stdout:3/393: write d1/d4/d1c/f31 [2924463,77703] 0 2024-02-28T23:07:29.164 INFO:tasks.workunit.client.0.smithi159.stdout:6/729: rename d0/d1b/d33/d11/d34/d9d/da2/db7/f7f to d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dac/dd9/feb 0 2024-02-28T23:07:29.167 INFO:tasks.workunit.client.0.smithi159.stdout:4/830: mknod d9/d42/d54/d55/da8/c127 0 2024-02-28T23:07:29.174 INFO:tasks.workunit.client.0.smithi159.stdout:8/872: read d2/d11/d52/d26/d36/d38/d77/f9f [283350,105602] 0 2024-02-28T23:07:29.180 INFO:tasks.workunit.client.1.smithi184.stdout:8/373: write d1/da/f5b [599597,19394] 0 2024-02-28T23:07:29.182 INFO:tasks.workunit.client.0.smithi159.stdout:6/730: dwrite d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/fe1 [0,4194304] 0 2024-02-28T23:07:29.182 INFO:tasks.workunit.client.0.smithi159.stdout:9/745: mkdir d4/d3d/d3e/d55/d37/d62/da6/dac/dea 0 2024-02-28T23:07:29.184 INFO:tasks.workunit.client.1.smithi184.stdout:7/342: creat d6/d9/d13/d14/f7b x:0 0 0 2024-02-28T23:07:29.189 INFO:tasks.workunit.client.0.smithi159.stdout:5/706: rename d8/d19/d23/d35/d38/d8f to d8/d19/d23/d35/d65/da3/df4 0 2024-02-28T23:07:29.194 INFO:tasks.workunit.client.0.smithi159.stdout:2/664: creat d9/d23/d2c/d55/fee x:0 0 0 2024-02-28T23:07:29.195 INFO:tasks.workunit.client.1.smithi184.stdout:6/302: fdatasync dc/de/d10/d16/f37 0 2024-02-28T23:07:29.198 INFO:tasks.workunit.client.0.smithi159.stdout:0/870: getdents d0/d5/d14/d25/d2c/d4b 0 2024-02-28T23:07:29.199 INFO:tasks.workunit.client.0.smithi159.stdout:0/871: truncate d0/de/d46/fdc 4377979 0 2024-02-28T23:07:29.204 INFO:tasks.workunit.client.1.smithi184.stdout:1/432: symlink d20/l97 0 2024-02-28T23:07:29.207 INFO:tasks.workunit.client.0.smithi159.stdout:1/736: sync 2024-02-28T23:07:29.207 INFO:tasks.workunit.client.0.smithi159.stdout:7/627: sync 2024-02-28T23:07:29.207 INFO:tasks.workunit.client.0.smithi159.stdout:8/873: rename d2/d11/d52/f32 to d2/d11/d35/d5f/f113 0 2024-02-28T23:07:29.211 INFO:tasks.workunit.client.0.smithi159.stdout:6/731: fsync d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88/fa8 0 2024-02-28T23:07:29.215 INFO:tasks.workunit.client.1.smithi184.stdout:9/371: getdents d5/d47 0 2024-02-28T23:07:29.217 INFO:tasks.workunit.client.0.smithi159.stdout:3/693: dwrite d0/d2b/d55/d75/d6d/fca [0,4194304] 0 2024-02-28T23:07:29.218 INFO:tasks.workunit.client.1.smithi184.stdout:0/375: mknod d0/d47/d71/c80 0 2024-02-28T23:07:29.219 INFO:tasks.workunit.client.0.smithi159.stdout:2/665: fdatasync d9/d36/f3f 0 2024-02-28T23:07:29.219 INFO:tasks.workunit.client.0.smithi159.stdout:5/707: chown d8/d19/d23/d35/d41/d92/ld6 158999609 1 2024-02-28T23:07:29.221 INFO:tasks.workunit.client.1.smithi184.stdout:0/376: dread - d0/df/f63 zero size 2024-02-28T23:07:29.222 INFO:tasks.workunit.client.1.smithi184.stdout:7/343: unlink d6/f30 0 2024-02-28T23:07:29.224 INFO:tasks.workunit.client.1.smithi184.stdout:7/344: write d6/f48 [575541,85983] 0 2024-02-28T23:07:29.225 INFO:tasks.workunit.client.0.smithi159.stdout:0/872: dwrite d0/d5/d14/d25/f84 [0,4194304] 0 2024-02-28T23:07:29.225 INFO:tasks.workunit.client.0.smithi159.stdout:7/628: mkdir d5/d16/d1a/d27/d37/dcd 0 2024-02-28T23:07:29.227 INFO:tasks.workunit.client.0.smithi159.stdout:9/746: dwrite d4/d52/f57 [0,4194304] 0 2024-02-28T23:07:29.227 INFO:tasks.workunit.client.1.smithi184.stdout:5/369: creat db/d12/f77 x:0 0 0 2024-02-28T23:07:29.229 INFO:tasks.workunit.client.1.smithi184.stdout:6/303: readlink dc/l4e 0 2024-02-28T23:07:29.230 INFO:tasks.workunit.client.1.smithi184.stdout:2/356: truncate d10/d1f/d21/d5e/f2c 80425 0 2024-02-28T23:07:29.233 INFO:tasks.workunit.client.1.smithi184.stdout:1/433: unlink ff 0 2024-02-28T23:07:29.234 INFO:tasks.workunit.client.1.smithi184.stdout:4/369: link d1/d8/l45 d1/l70 0 2024-02-28T23:07:29.236 INFO:tasks.workunit.client.0.smithi159.stdout:4/831: creat d9/d42/d54/d55/f128 x:0 0 0 2024-02-28T23:07:29.238 INFO:tasks.workunit.client.1.smithi184.stdout:8/374: mknod d1/da/c91 0 2024-02-28T23:07:29.240 INFO:tasks.workunit.client.0.smithi159.stdout:5/708: mkdir d8/d19/d23/d35/d41/daa/df5 0 2024-02-28T23:07:29.247 INFO:tasks.workunit.client.0.smithi159.stdout:0/873: rename d0/d5/d38/d63/dad/f120 to d0/d5/d38/d76/f135 0 2024-02-28T23:07:29.248 INFO:tasks.workunit.client.1.smithi184.stdout:6/304: rename dc/de/d2a/l39 to dc/d53/l5f 0 2024-02-28T23:07:29.250 INFO:tasks.workunit.client.0.smithi159.stdout:9/747: fsync d4/d3d/d3e/d55/f1e 0 2024-02-28T23:07:29.251 INFO:tasks.workunit.client.1.smithi184.stdout:3/394: link d1/d4/d6/d1f/d26/d3a/f3d d1/d4/d6/d1e/d72/f7a 0 2024-02-28T23:07:29.256 INFO:tasks.workunit.client.0.smithi159.stdout:2/666: dwrite d9/fcb [0,4194304] 0 2024-02-28T23:07:29.258 INFO:tasks.workunit.client.1.smithi184.stdout:8/375: mkdir d1/da/dc/d16/d29/d92 0 2024-02-28T23:07:29.258 INFO:tasks.workunit.client.1.smithi184.stdout:1/434: unlink d20/l4e 0 2024-02-28T23:07:29.260 INFO:tasks.workunit.client.1.smithi184.stdout:2/357: dread d10/d1f/d21/d5e/f3d [0,4194304] 0 2024-02-28T23:07:29.262 INFO:tasks.workunit.client.1.smithi184.stdout:8/376: write d1/da/dc/d16/d29/f72 [28395,33423] 0 2024-02-28T23:07:29.266 INFO:tasks.workunit.client.0.smithi159.stdout:2/667: truncate d9/d50/d54/d84/fe0 743887 0 2024-02-28T23:07:29.266 INFO:tasks.workunit.client.0.smithi159.stdout:7/629: rename d5/d16/d1a/d27/d37/daf to d5/d16/d40/dce 0 2024-02-28T23:07:29.268 INFO:tasks.workunit.client.1.smithi184.stdout:4/370: creat d1/dc/df/d38/d57/f71 x:0 0 0 2024-02-28T23:07:29.269 INFO:tasks.workunit.client.0.smithi159.stdout:7/630: chown d5/d56/d50/d5b/c82 81 1 2024-02-28T23:07:29.270 INFO:tasks.workunit.client.0.smithi159.stdout:0/874: creat d0/de/d75/db8/f136 x:0 0 0 2024-02-28T23:07:29.272 INFO:tasks.workunit.client.0.smithi159.stdout:7/631: chown d5/d16/d1a/d27/d37 1726811 1 2024-02-28T23:07:29.273 INFO:tasks.workunit.client.0.smithi159.stdout:0/875: write d0/de/f68 [134356,85093] 0 2024-02-28T23:07:29.274 INFO:tasks.workunit.client.0.smithi159.stdout:1/737: dread d6/d12/d33/d3c/f55 [0,4194304] 0 2024-02-28T23:07:29.276 INFO:tasks.workunit.client.1.smithi184.stdout:0/377: dread d0/fe [0,4194304] 0 2024-02-28T23:07:29.277 INFO:tasks.workunit.client.0.smithi159.stdout:9/748: mknod d4/d3d/d3e/d55/d37/d62/da6/ceb 0 2024-02-28T23:07:29.282 INFO:tasks.workunit.client.0.smithi159.stdout:2/668: creat d9/d50/d54/fef x:0 0 0 2024-02-28T23:07:29.283 INFO:tasks.workunit.client.0.smithi159.stdout:6/732: write d0/d1b/d33/d3f/d44/fa0 [393791,74161] 0 2024-02-28T23:07:29.285 INFO:tasks.workunit.client.1.smithi184.stdout:2/358: mknod d10/d1f/d21/d4d/d67/c78 0 2024-02-28T23:07:29.285 INFO:tasks.workunit.client.1.smithi184.stdout:9/372: dwrite d5/f7 [0,4194304] 0 2024-02-28T23:07:29.287 INFO:tasks.workunit.client.0.smithi159.stdout:2/669: chown d9/d50/dcc/d44/dc8/fe1 691 1 2024-02-28T23:07:29.287 INFO:tasks.workunit.client.0.smithi159.stdout:8/874: dwrite d2/f5c [0,4194304] 0 2024-02-28T23:07:29.292 INFO:tasks.workunit.client.0.smithi159.stdout:2/670: chown d9/d23/d2c/l85 105948 1 2024-02-28T23:07:29.292 INFO:tasks.workunit.client.0.smithi159.stdout:3/694: write d0/d3f/dd2/d7c/d79/f89 [197933,115094] 0 2024-02-28T23:07:29.295 INFO:tasks.workunit.client.0.smithi159.stdout:7/632: symlink d5/d56/d50/d5b/lcf 0 2024-02-28T23:07:29.300 INFO:tasks.workunit.client.0.smithi159.stdout:0/876: creat d0/d5/d14/d34/d6c/daf/f137 x:0 0 0 2024-02-28T23:07:29.301 INFO:tasks.workunit.client.1.smithi184.stdout:4/371: creat d1/dc/df/d22/d51/f72 x:0 0 0 2024-02-28T23:07:29.303 INFO:tasks.workunit.client.1.smithi184.stdout:5/370: getdents db/d12/d1c 0 2024-02-28T23:07:29.305 INFO:tasks.workunit.client.1.smithi184.stdout:4/372: fdatasync d1/d4/f11 0 2024-02-28T23:07:29.306 INFO:tasks.workunit.client.1.smithi184.stdout:5/371: stat db/d12/d18/d2e/d3c/d5d/c67 0 2024-02-28T23:07:29.307 INFO:tasks.workunit.client.1.smithi184.stdout:3/395: symlink d1/d4/d6/d1f/d26/d3a/d59/d6a/d6e/l7b 0 2024-02-28T23:07:29.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.311+0000 7ff0bca00700 1 -- 172.21.15.159:0/1198438144 --> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0b80611d0 con 0x7ff09c06ce80 2024-02-28T23:07:29.310 INFO:tasks.workunit.client.1.smithi184.stdout:0/378: mkdir d0/df/d13/d27/d31/d5b/d81 0 2024-02-28T23:07:29.311 INFO:tasks.workunit.client.1.smithi184.stdout:7/345: dwrite f4 [0,4194304] 0 2024-02-28T23:07:29.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.314+0000 7ff0aea00700 1 -- 172.21.15.159:0/1198438144 <== mgr.24357 v2:172.21.15.184:6828/2879526003 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7ff0b80611d0 con 0x7ff09c06ce80 2024-02-28T23:07:29.314 INFO:tasks.workunit.client.0.smithi159.stdout:5/709: dwrite d8/d19/d23/d35/d65/da3/df4/da5/d90/fb7 [0,4194304] 0 2024-02-28T23:07:29.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.318+0000 7ff0bca00700 1 -- 172.21.15.159:0/1198438144 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7ff09c06ce80 msgr2=0x7ff09c06f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:29.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.318+0000 7ff0bca00700 1 --2- 172.21.15.159:0/1198438144 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7ff09c06ce80 0x7ff09c06f340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0b81a6730 tx=0x7ff0a8009190 comp rx=0 tx=0).stop 2024-02-28T23:07:29.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.318+0000 7ff0bca00700 1 -- 172.21.15.159:0/1198438144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b8101da0 msgr2=0x7ff0b8072290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:29.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.318+0000 7ff0bca00700 1 --2- 172.21.15.159:0/1198438144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b8101da0 0x7ff0b8072290 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff0a4000c00 tx=0x7ff0a400bd70 comp rx=0 tx=0).stop 2024-02-28T23:07:29.319 INFO:tasks.workunit.client.0.smithi159.stdout:4/832: getdents d9/d42 0 2024-02-28T23:07:29.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.320+0000 7ff0bca00700 1 -- 172.21.15.159:0/1198438144 shutdown_connections 2024-02-28T23:07:29.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.320+0000 7ff0bca00700 1 --2- 172.21.15.159:0/1198438144 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7ff09c06ce80 0x7ff09c06f340 secure :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ff0b81a6730 tx=0x7ff0a8009190 comp rx=0 tx=0).stop 2024-02-28T23:07:29.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.320+0000 7ff0bca00700 1 --2- 172.21.15.159:0/1198438144 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b80ff430 0x7ff0b8071d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:29.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.320+0000 7ff0bca00700 1 --2- 172.21.15.159:0/1198438144 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b8101da0 0x7ff0b8072290 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:29.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.320+0000 7ff0bca00700 1 -- 172.21.15.159:0/1198438144 >> 172.21.15.159:0/1198438144 conn(0x7ff0b80fb030 msgr2=0x7ff0b80fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:07:29.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.322+0000 7ff0bca00700 1 -- 172.21.15.159:0/1198438144 shutdown_connections 2024-02-28T23:07:29.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.322+0000 7ff0bca00700 1 -- 172.21.15.159:0/1198438144 wait complete. 2024-02-28T23:07:29.325 INFO:tasks.workunit.client.1.smithi184.stdout:4/373: dwrite d1/dc/df/f31 [0,4194304] 0 2024-02-28T23:07:29.327 INFO:tasks.workunit.client.0.smithi159.stdout:6/733: creat d0/d1b/d33/d3f/d44/d8b/fec x:0 0 0 2024-02-28T23:07:29.328 INFO:tasks.workunit.client.1.smithi184.stdout:5/372: dread db/d12/d18/d2e/d3c/d5d/f4b [0,4194304] 0 2024-02-28T23:07:29.328 INFO:tasks.workunit.client.1.smithi184.stdout:2/359: dread - d10/d1f/f57 zero size 2024-02-28T23:07:29.330 INFO:tasks.workunit.client.1.smithi184.stdout:4/374: write d1/dc/df/d22/d51/f64 [172976,26380] 0 2024-02-28T23:07:29.331 INFO:tasks.workunit.client.1.smithi184.stdout:5/373: stat db/d12/d18/d2e/d3c/d5d/f4b 0 2024-02-28T23:07:29.332 INFO:tasks.workunit.client.1.smithi184.stdout:5/374: fdatasync f8 0 2024-02-28T23:07:29.334 INFO:tasks.workunit.client.1.smithi184.stdout:5/375: write db/d12/f77 [1001825,35768] 0 2024-02-28T23:07:29.338 INFO:tasks.workunit.client.0.smithi159.stdout:8/875: rename d2/f6d to d2/d11/d52/d6e/f114 0 2024-02-28T23:07:29.338 INFO:tasks.workunit.client.0.smithi159.stdout:9/749: dwrite d4/d3d/d3e/d55/d4c/d4e/d6b/fce [0,4194304] 0 2024-02-28T23:07:29.344 INFO:tasks.workunit.client.0.smithi159.stdout:2/671: read - d9/d50/d62/fc2 zero size 2024-02-28T23:07:29.347 INFO:tasks.workunit.client.1.smithi184.stdout:9/373: dread d5/db/de/f21 [0,4194304] 0 2024-02-28T23:07:29.351 INFO:tasks.workunit.client.0.smithi159.stdout:8/876: write d2/d11/d52/d26/f31 [499494,23319] 0 2024-02-28T23:07:29.351 INFO:tasks.workunit.client.1.smithi184.stdout:9/374: dread - d5/db/f1f zero size 2024-02-28T23:07:29.353 INFO:tasks.workunit.client.1.smithi184.stdout:6/305: rename dc/de/d10/d3a/d4d to dc/d60 0 2024-02-28T23:07:29.357 INFO:tasks.workunit.client.0.smithi159.stdout:3/695: dread d0/d3f/dd2/d63/f81 [0,4194304] 0 2024-02-28T23:07:29.362 INFO:tasks.workunit.client.0.smithi159.stdout:7/633: read - d5/d56/d50/daa/fa4 zero size 2024-02-28T23:07:29.370 INFO:tasks.workunit.client.0.smithi159.stdout:7/634: dread d5/d16/d1a/f3c [0,4194304] 0 2024-02-28T23:07:29.374 INFO:tasks.workunit.client.0.smithi159.stdout:7/635: chown d5/d16/d1a/d27/d46/d65/d81/d98 11132 1 2024-02-28T23:07:29.377 INFO:tasks.workunit.client.1.smithi184.stdout:7/346: readlink d6/d9/d13/d3e/l6e 0 2024-02-28T23:07:29.389 INFO:tasks.workunit.client.0.smithi159.stdout:0/877: rename d0/d5/d38/d63/f69 to d0/d5/d14/d25/d5c/f138 0 2024-02-28T23:07:29.392 INFO:tasks.workunit.client.0.smithi159.stdout:9/750: chown d4/d3d/d3e/d55/d4c/d4e/dbe/fd1 3 1 2024-02-28T23:07:29.394 INFO:tasks.workunit.client.1.smithi184.stdout:9/375: creat d5/d47/d4a/f82 x:0 0 0 2024-02-28T23:07:29.399 INFO:tasks.workunit.client.1.smithi184.stdout:0/379: rename d0/df/d13/d27/l33 to d0/df/d13/d27/d31/d5b/d7b/l82 0 2024-02-28T23:07:29.401 INFO:tasks.workunit.client.0.smithi159.stdout:3/696: mkdir d0/d3f/dd2/d6a/ddd 0 2024-02-28T23:07:29.403 INFO:tasks.workunit.client.0.smithi159.stdout:3/697: chown d0/d2b/l2a 14 1 2024-02-28T23:07:29.409 INFO:tasks.workunit.client.1.smithi184.stdout:6/306: write dc/de/d10/f23 [4381774,93366] 0 2024-02-28T23:07:29.411 INFO:tasks.workunit.client.1.smithi184.stdout:6/307: fsync dc/de/d10/d16/f37 0 2024-02-28T23:07:29.412 INFO:tasks.workunit.client.1.smithi184.stdout:7/347: creat d6/d9/d13/d14/f7c x:0 0 0 2024-02-28T23:07:29.412 INFO:tasks.workunit.client.0.smithi159.stdout:5/710: fdatasync d8/d19/d23/d2a/f9f 0 2024-02-28T23:07:29.413 INFO:tasks.workunit.client.1.smithi184.stdout:6/308: write dc/de/d2a/f2b [3710534,89142] 0 2024-02-28T23:07:29.416 INFO:tasks.workunit.client.0.smithi159.stdout:8/877: dwrite d2/d11/d52/d26/d36/d38/d77/d9e/dc1/dc4/fe9 [0,4194304] 0 2024-02-28T23:07:29.419 INFO:tasks.workunit.client.0.smithi159.stdout:5/711: chown d8/d19/d23/d35/d41/l5f 26311 1 2024-02-28T23:07:29.420 INFO:tasks.workunit.client.0.smithi159.stdout:0/878: dread d0/d5/d38/f91 [0,4194304] 0 2024-02-28T23:07:29.420 INFO:tasks.workunit.client.1.smithi184.stdout:1/435: getdents d20/d32/d3e/d82/d85/d86 0 2024-02-28T23:07:29.420 INFO:tasks.workunit.client.1.smithi184.stdout:2/360: mknod d10/d1f/d21/d4d/d67/d65/c79 0 2024-02-28T23:07:29.428 INFO:tasks.workunit.client.0.smithi159.stdout:7/636: rename d5/f18 to d5/d56/d50/d88/fd0 0 2024-02-28T23:07:29.428 INFO:tasks.workunit.client.1.smithi184.stdout:5/376: creat db/d1f/f78 x:0 0 0 2024-02-28T23:07:29.435 INFO:tasks.workunit.client.1.smithi184.stdout:8/377: link d1/da/d10/d43/c7b d1/da/d10/c93 0 2024-02-28T23:07:29.436 INFO:tasks.workunit.client.1.smithi184.stdout:9/376: rmdir d5/d26 39 2024-02-28T23:07:29.437 INFO:tasks.workunit.client.1.smithi184.stdout:2/361: dwrite d10/d1f/d38/d54/f76 [0,4194304] 0 2024-02-28T23:07:29.439 INFO:tasks.workunit.client.0.smithi159.stdout:1/738: getdents d6/d1d/d46/d88/dd3 0 2024-02-28T23:07:29.440 INFO:tasks.workunit.client.1.smithi184.stdout:4/375: rename d1/dc/df/d41 to d1/d4/d43/d73 0 2024-02-28T23:07:29.440 INFO:tasks.workunit.client.1.smithi184.stdout:2/362: truncate d10/d1f/d21/f6e 868465 0 2024-02-28T23:07:29.441 INFO:tasks.workunit.client.1.smithi184.stdout:0/380: symlink d0/df/d13/d27/d31/d55/l83 0 2024-02-28T23:07:29.443 INFO:tasks.workunit.client.1.smithi184.stdout:3/396: creat d1/d4/f7c x:0 0 0 2024-02-28T23:07:29.446 INFO:tasks.workunit.client.0.smithi159.stdout:6/734: creat d0/d1b/d33/d11/d34/d9d/da2/fed x:0 0 0 2024-02-28T23:07:29.449 INFO:tasks.workunit.client.1.smithi184.stdout:6/309: mkdir dc/d53/d61 0 2024-02-28T23:07:29.449 INFO:tasks.workunit.client.0.smithi159.stdout:7/637: dwrite d5/d16/d1a/d27/d46/d65/d81/d83/f8a [0,4194304] 0 2024-02-28T23:07:29.455 INFO:tasks.workunit.client.0.smithi159.stdout:5/712: creat d8/d19/d23/d35/d65/da3/df4/da5/ddc/ff6 x:0 0 0 2024-02-28T23:07:29.456 INFO:tasks.workunit.client.1.smithi184.stdout:7/348: rmdir d6/d9/da/dc/d49/d50 39 2024-02-28T23:07:29.456 INFO:tasks.workunit.client.0.smithi159.stdout:4/833: dwrite d9/d20/d87/d115/d1c/d23/f63 [0,4194304] 0 2024-02-28T23:07:29.460 INFO:tasks.workunit.client.0.smithi159.stdout:4/834: readlink d9/d20/l4a 0 2024-02-28T23:07:29.463 INFO:tasks.workunit.client.1.smithi184.stdout:5/377: creat db/d12/d18/d2e/f79 x:0 0 0 2024-02-28T23:07:29.469 INFO:tasks.workunit.client.1.smithi184.stdout:5/378: dread - db/d12/d18/d2e/f79 zero size 2024-02-28T23:07:29.471 INFO:tasks.workunit.client.0.smithi159.stdout:7/638: dwrite d5/d16/d1a/d24/d64/f79 [4194304,4194304] 0 2024-02-28T23:07:29.472 INFO:tasks.workunit.client.1.smithi184.stdout:9/377: mknod d5/d17/c83 0 2024-02-28T23:07:29.474 INFO:tasks.workunit.client.0.smithi159.stdout:2/672: link d9/d36/laf d9/d36/d59/lf0 0 2024-02-28T23:07:29.478 INFO:tasks.workunit.client.0.smithi159.stdout:2/673: chown d9/d50/d54/d84/d37/f8c 176382 1 2024-02-28T23:07:29.482 INFO:tasks.workunit.client.0.smithi159.stdout:2/674: write d9/d50/d54/d84/d37/d5c/f7b [510303,88703] 0 2024-02-28T23:07:29.482 INFO:tasks.workunit.client.1.smithi184.stdout:8/378: symlink d1/da/d10/d6b/l94 0 2024-02-28T23:07:29.485 INFO:tasks.workunit.client.1.smithi184.stdout:2/363: rmdir d10/d1f/d21/d5e/d15/d24 39 2024-02-28T23:07:29.489 INFO:tasks.workunit.client.0.smithi159.stdout:1/739: creat d6/d12/d33/da7/ff7 x:0 0 0 2024-02-28T23:07:29.493 INFO:tasks.workunit.client.1.smithi184.stdout:0/381: rmdir d0/df 39 2024-02-28T23:07:29.496 INFO:tasks.workunit.client.0.smithi159.stdout:6/735: creat d0/d1b/d33/d11/d34/d9d/fee x:0 0 0 2024-02-28T23:07:29.497 INFO:tasks.workunit.client.1.smithi184.stdout:4/376: truncate d1/dc/df/f16 1226066 0 2024-02-28T23:07:29.502 INFO:tasks.workunit.client.0.smithi159.stdout:8/878: mknod d2/d11/d52/d26/d36/d38/d77/d9e/df1/c115 0 2024-02-28T23:07:29.506 INFO:tasks.workunit.client.1.smithi184.stdout:7/349: rename d6/d9/d13/d1e/d2f/d33/d5b to d6/d9/da/dc/d7d 0 2024-02-28T23:07:29.507 INFO:tasks.workunit.client.1.smithi184.stdout:7/350: chown d6/d9/d13/f28 595324246 1 2024-02-28T23:07:29.509 INFO:tasks.workunit.client.1.smithi184.stdout:5/379: creat db/d12/d1c/d21/d2f/f7a x:0 0 0 2024-02-28T23:07:29.510 INFO:tasks.workunit.client.0.smithi159.stdout:3/698: write d0/d6/d3e/d57/f6c [1124739,90350] 0 2024-02-28T23:07:29.518 INFO:tasks.workunit.client.0.smithi159.stdout:4/835: creat d9/d20/d87/d115/d1c/d23/d2d/d59/f129 x:0 0 0 2024-02-28T23:07:29.520 INFO:tasks.workunit.client.0.smithi159.stdout:7/639: dread - d5/d10/f85 zero size 2024-02-28T23:07:29.523 INFO:tasks.workunit.client.1.smithi184.stdout:2/364: dread fa [0,4194304] 0 2024-02-28T23:07:29.524 INFO:tasks.workunit.client.1.smithi184.stdout:4/377: creat d1/d8/d3d/f74 x:0 0 0 2024-02-28T23:07:29.524 INFO:tasks.workunit.client.1.smithi184.stdout:5/380: dwrite db/d1f/f78 [0,4194304] 0 2024-02-28T23:07:29.525 INFO:tasks.workunit.client.0.smithi159.stdout:7/640: write d5/d56/d2a/f45 [551077,83035] 0 2024-02-28T23:07:29.527 INFO:tasks.workunit.client.0.smithi159.stdout:6/736: unlink d0/d1b/d33/d11/d34/d9d/ce8 0 2024-02-28T23:07:29.528 INFO:tasks.workunit.client.0.smithi159.stdout:9/751: rename d4/d3d/l5a to d4/d3d/d3e/d55/lec 0 2024-02-28T23:07:29.532 INFO:tasks.workunit.client.0.smithi159.stdout:9/752: chown d4/d52/f57 485 1 2024-02-28T23:07:29.534 INFO:tasks.workunit.client.1.smithi184.stdout:1/436: symlink d20/d46/l98 0 2024-02-28T23:07:29.535 INFO:tasks.workunit.client.1.smithi184.stdout:7/351: mkdir d6/d9/d13/d3e/d7e 0 2024-02-28T23:07:29.536 INFO:tasks.workunit.client.1.smithi184.stdout:8/379: write d1/da/d10/f2f [451892,73666] 0 2024-02-28T23:07:29.536 INFO:tasks.workunit.client.0.smithi159.stdout:9/753: stat d4/fe 0 2024-02-28T23:07:29.538 INFO:tasks.workunit.client.0.smithi159.stdout:0/879: link d0/d5/d14/d25/d2c/d4b/l88 d0/d5/d38/d63/dd8/l139 0 2024-02-28T23:07:29.539 INFO:tasks.workunit.client.1.smithi184.stdout:3/397: truncate d1/f21 2110478 0 2024-02-28T23:07:29.544 INFO:tasks.workunit.client.1.smithi184.stdout:0/382: dwrite d0/df/d13/d27/d2b/f68 [0,4194304] 0 2024-02-28T23:07:29.545 INFO:tasks.workunit.client.0.smithi159.stdout:1/740: creat d6/d1d/d46/d88/dd3/d9c/db3/dc4/dc6/ff8 x:0 0 0 2024-02-28T23:07:29.548 INFO:tasks.workunit.client.0.smithi159.stdout:8/879: write d2/d11/d52/d26/f4c [1245406,62297] 0 2024-02-28T23:07:29.548 INFO:tasks.workunit.client.0.smithi159.stdout:7/641: dread d5/fb [0,4194304] 0 2024-02-28T23:07:29.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.555+0000 7fc17aa00700 1 -- 172.21.15.159:0/3753954122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc174101db0 msgr2=0x7fc174102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:29.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.555+0000 7fc17aa00700 1 --2- 172.21.15.159:0/3753954122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc174101db0 0x7fc174102210 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009910 tx=0x7fc15c009c20 comp rx=0 tx=0).stop 2024-02-28T23:07:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.556+0000 7fc17aa00700 1 -- 172.21.15.159:0/3753954122 shutdown_connections 2024-02-28T23:07:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.556+0000 7fc17aa00700 1 --2- 172.21.15.159:0/3753954122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc174101db0 0x7fc174102210 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.556+0000 7fc17aa00700 1 --2- 172.21.15.159:0/3753954122 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc174100bb0 0x7fc174100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.556+0000 7fc17aa00700 1 -- 172.21.15.159:0/3753954122 >> 172.21.15.159:0/3753954122 conn(0x7fc1740fc110 msgr2=0x7fc1740fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:07:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.556+0000 7fc17aa00700 1 -- 172.21.15.159:0/3753954122 shutdown_connections 2024-02-28T23:07:29.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.556+0000 7fc17aa00700 1 -- 172.21.15.159:0/3753954122 wait complete. 2024-02-28T23:07:29.556 INFO:tasks.workunit.client.1.smithi184.stdout:5/381: unlink db/f76 0 2024-02-28T23:07:29.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.557+0000 7fc17aa00700 1 Processor -- start 2024-02-28T23:07:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.557+0000 7fc17aa00700 1 -- start start 2024-02-28T23:07:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.558+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc174100bb0 0x7fc1741963e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.558+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc174101db0 0x7fc174196920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.558+0000 7fc17aa00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc174196f40 con 0x7fc174101db0 2024-02-28T23:07:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.558+0000 7fc17aa00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc174197080 con 0x7fc174100bb0 2024-02-28T23:07:29.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.558+0000 7fc173e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc174100bb0 0x7fc1741963e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.558+0000 7fc173e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc174100bb0 0x7fc1741963e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:55650/0 (socket says 172.21.15.159:55650) 2024-02-28T23:07:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.558+0000 7fc16b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc174101db0 0x7fc174196920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.558+0000 7fc173e00700 1 -- 172.21.15.159:0/3275134267 learned_addr learned my addr 172.21.15.159:0/3275134267 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:07:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.559+0000 7fc16b400700 1 -- 172.21.15.159:0/3275134267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc174100bb0 msgr2=0x7fc1741963e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.559+0000 7fc16b400700 1 --2- 172.21.15.159:0/3275134267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc174100bb0 0x7fc1741963e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.559+0000 7fc16b400700 1 -- 172.21.15.159:0/3275134267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc15c0095f0 con 0x7fc174101db0 2024-02-28T23:07:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.559+0000 7fc16b400700 1 --2- 172.21.15.159:0/3275134267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc174101db0 0x7fc174196920 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0098e0 tx=0x7fc15c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:07:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.560+0000 7fc171600700 1 -- 172.21.15.159:0/3275134267 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc15c01c550 con 0x7fc174101db0 2024-02-28T23:07:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.560+0000 7fc171600700 1 -- 172.21.15.159:0/3275134267 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fc15c01c6b0 con 0x7fc174101db0 2024-02-28T23:07:29.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.560+0000 7fc171600700 1 -- 172.21.15.159:0/3275134267 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc15c0038b0 con 0x7fc174101db0 2024-02-28T23:07:29.560 INFO:tasks.workunit.client.0.smithi159.stdout:6/737: mknod d0/d1b/d33/d11/d34/d9d/cef 0 2024-02-28T23:07:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.561+0000 7fc17aa00700 1 -- 172.21.15.159:0/3275134267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc174072fc0 con 0x7fc174101db0 2024-02-28T23:07:29.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.561+0000 7fc17aa00700 1 -- 172.21.15.159:0/3275134267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc174073530 con 0x7fc174101db0 2024-02-28T23:07:29.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.562+0000 7fc17aa00700 1 -- 172.21.15.159:0/3275134267 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1741097b0 con 0x7fc174101db0 2024-02-28T23:07:29.561 INFO:tasks.workunit.client.1.smithi184.stdout:6/310: sync 2024-02-28T23:07:29.562 INFO:tasks.workunit.client.1.smithi184.stdout:6/311: fsync dc/de/d10/f1b 0 2024-02-28T23:07:29.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.563+0000 7fc171600700 1 -- 172.21.15.159:0/3275134267 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) v1 ==== 90929+0+0 (secure 0 0 0) 0x7fc15c01cac0 con 0x7fc174101db0 2024-02-28T23:07:29.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.565+0000 7fc171600700 1 --2- 172.21.15.159:0/3275134267 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc15407de90 0x7fc154080350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:29.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.565+0000 7fc171600700 1 -- 172.21.15.159:0/3275134267 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7fc15c08daa0 con 0x7fc174101db0 2024-02-28T23:07:29.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.566+0000 7fc173e00700 1 --2- 172.21.15.159:0/3275134267 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc15407de90 0x7fc154080350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:29.565 INFO:tasks.workunit.client.0.smithi159.stdout:6/738: write d0/f9 [2913685,24208] 0 2024-02-28T23:07:29.565 INFO:tasks.workunit.client.1.smithi184.stdout:2/365: mknod d10/d1f/d21/d5e/d15/d60/d66/c7a 0 2024-02-28T23:07:29.567 INFO:tasks.workunit.client.1.smithi184.stdout:4/378: truncate d1/dc/df/d38/f53 5181817 0 2024-02-28T23:07:29.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.567+0000 7fc173e00700 1 --2- 172.21.15.159:0/3275134267 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc15407de90 0x7fc154080350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1640099b0 tx=0x7fc164008040 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:07:29.568 INFO:tasks.workunit.client.1.smithi184.stdout:4/379: dread - d1/d8/d3d/f74 zero size 2024-02-28T23:07:29.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.571+0000 7fc171600700 1 -- 172.21.15.159:0/3275134267 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fc15c05b2d0 con 0x7fc174101db0 2024-02-28T23:07:29.570 INFO:tasks.workunit.client.0.smithi159.stdout:5/713: dwrite d8/d19/d23/d35/d41/d77/fe5 [0,4194304] 0 2024-02-28T23:07:29.570 INFO:tasks.workunit.client.0.smithi159.stdout:0/880: creat d0/d5/d38/d63/f13a x:0 0 0 2024-02-28T23:07:29.577 INFO:tasks.workunit.client.1.smithi184.stdout:6/312: dwrite dc/de/d10/f4b [0,4194304] 0 2024-02-28T23:07:29.579 INFO:tasks.workunit.client.1.smithi184.stdout:8/380: truncate d1/da/df/d20/f3e 3203098 0 2024-02-28T23:07:29.579 INFO:tasks.workunit.client.1.smithi184.stdout:0/383: truncate d0/d1d/f35 1892315 0 2024-02-28T23:07:29.585 INFO:tasks.workunit.client.0.smithi159.stdout:9/754: write d4/d3d/d3e/d55/f1e [4125397,30523] 0 2024-02-28T23:07:29.587 INFO:tasks.workunit.client.0.smithi159.stdout:5/714: mknod d8/d19/d23/d35/d65/da3/df4/da5/d90/cf7 0 2024-02-28T23:07:29.589 INFO:tasks.workunit.client.1.smithi184.stdout:2/366: rmdir d10/d1f/d21/d4d/d67/d65 39 2024-02-28T23:07:29.589 INFO:tasks.workunit.client.0.smithi159.stdout:9/755: write d4/d3d/d3e/d4a/f56 [9055944,7589] 0 2024-02-28T23:07:29.590 INFO:tasks.workunit.client.0.smithi159.stdout:3/699: link d0/d6/d3e/d57/l5f d0/d3f/dd2/d6a/ddd/lde 0 2024-02-28T23:07:29.590 INFO:tasks.workunit.client.0.smithi159.stdout:6/739: dread d0/d1b/d33/d11/d34/d9d/da2/f61 [0,4194304] 0 2024-02-28T23:07:29.590 INFO:tasks.workunit.client.0.smithi159.stdout:2/675: rename d9/d50/d54/d84/d37/f39 to d9/ff1 0 2024-02-28T23:07:29.593 INFO:tasks.workunit.client.1.smithi184.stdout:4/380: creat d1/d8/d37/f75 x:0 0 0 2024-02-28T23:07:29.593 INFO:tasks.workunit.client.1.smithi184.stdout:1/437: rmdir d20/d32/d4b 39 2024-02-28T23:07:29.597 INFO:tasks.workunit.client.1.smithi184.stdout:3/398: dwrite d1/d4/d6/f53 [4194304,4194304] 0 2024-02-28T23:07:29.598 INFO:tasks.workunit.client.0.smithi159.stdout:8/880: dread d2/d11/d52/d26/d36/f23 [0,4194304] 0 2024-02-28T23:07:29.599 INFO:tasks.workunit.client.1.smithi184.stdout:7/352: mknod d6/c7f 0 2024-02-28T23:07:29.601 INFO:tasks.workunit.client.0.smithi159.stdout:1/741: dread d6/d12/d16/f1c [0,4194304] 0 2024-02-28T23:07:29.605 INFO:tasks.workunit.client.1.smithi184.stdout:2/367: dwrite d10/d1f/f41 [0,4194304] 0 2024-02-28T23:07:29.606 INFO:tasks.workunit.client.1.smithi184.stdout:6/313: mkdir dc/d60/d62 0 2024-02-28T23:07:29.609 INFO:tasks.workunit.client.0.smithi159.stdout:6/740: mknod d0/d6d/cf0 0 2024-02-28T23:07:29.613 INFO:tasks.workunit.client.0.smithi159.stdout:0/881: dwrite d0/de/de7/d117/f12b [0,4194304] 0 2024-02-28T23:07:29.620 INFO:tasks.workunit.client.0.smithi159.stdout:4/836: rename d9/d20/d87/d115/d1c/d23/d7a/d10d/l120 to d9/d20/d87/d115/d1c/d23/d2d/l12a 0 2024-02-28T23:07:29.621 INFO:tasks.workunit.client.0.smithi159.stdout:2/676: mkdir d9/d50/d54/d84/df2 0 2024-02-28T23:07:29.621 INFO:tasks.workunit.client.1.smithi184.stdout:0/384: mkdir d0/d1d/d3a/d84 0 2024-02-28T23:07:29.621 INFO:tasks.workunit.client.1.smithi184.stdout:0/385: truncate d0/df/d13/f53 731225 0 2024-02-28T23:07:29.622 INFO:tasks.workunit.client.0.smithi159.stdout:4/837: stat d9/d42/d54/d55/ce5 0 2024-02-28T23:07:29.626 INFO:tasks.workunit.client.0.smithi159.stdout:4/838: dread - d9/d20/d87/d115/d1c/d23/f122 zero size 2024-02-28T23:07:29.626 INFO:tasks.workunit.client.0.smithi159.stdout:0/882: dread - d0/d5/d38/d76/d96/fe0 zero size 2024-02-28T23:07:29.630 INFO:tasks.workunit.client.0.smithi159.stdout:4/839: fsync d9/d42/fc6 0 2024-02-28T23:07:29.633 INFO:tasks.workunit.client.0.smithi159.stdout:1/742: mkdir d6/d1d/d46/df9 0 2024-02-28T23:07:29.634 INFO:tasks.workunit.client.1.smithi184.stdout:9/378: getdents d5/d26 0 2024-02-28T23:07:29.635 INFO:tasks.workunit.client.0.smithi159.stdout:7/642: getdents d5/d56/d2a 0 2024-02-28T23:07:29.636 INFO:tasks.workunit.client.1.smithi184.stdout:7/353: readlink d6/d9/d13/d14/l24 0 2024-02-28T23:07:29.636 INFO:tasks.workunit.client.1.smithi184.stdout:9/379: chown d5/fc 729209892 1 2024-02-28T23:07:29.636 INFO:tasks.workunit.client.0.smithi159.stdout:5/715: truncate d8/f17 4966830 0 2024-02-28T23:07:29.638 INFO:tasks.workunit.client.0.smithi159.stdout:9/756: rename d4/d3d/d3e/d55/d37/f6c to d4/d3d/d3e/d55/d37/d62/d8f/fed 0 2024-02-28T23:07:29.640 INFO:tasks.workunit.client.1.smithi184.stdout:0/386: dwrite d0/f37 [0,4194304] 0 2024-02-28T23:07:29.641 INFO:tasks.workunit.client.0.smithi159.stdout:2/677: chown d9/lb2 3384048 1 2024-02-28T23:07:29.644 INFO:tasks.workunit.client.1.smithi184.stdout:6/314: rmdir dc/d60 39 2024-02-28T23:07:29.646 INFO:tasks.workunit.client.0.smithi159.stdout:0/883: creat d0/d5/d14/d25/d2c/d4b/f13b x:0 0 0 2024-02-28T23:07:29.647 INFO:tasks.workunit.client.0.smithi159.stdout:1/743: mknod d6/d1d/d1f/db8/dcc/cfa 0 2024-02-28T23:07:29.650 INFO:tasks.workunit.client.0.smithi159.stdout:0/884: chown d0/de/d75/d5f/d97 773587502 1 2024-02-28T23:07:29.654 INFO:tasks.workunit.client.1.smithi184.stdout:1/438: dwrite d20/d32/f34 [0,4194304] 0 2024-02-28T23:07:29.656 INFO:tasks.workunit.client.0.smithi159.stdout:7/643: mknod d5/d16/d1a/d27/d37/dcd/cd1 0 2024-02-28T23:07:29.658 INFO:tasks.workunit.client.0.smithi159.stdout:6/741: dwrite d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/fd0 [0,4194304] 0 2024-02-28T23:07:29.660 INFO:tasks.workunit.client.1.smithi184.stdout:0/387: dwrite d0/df/d13/d27/d2b/f44 [0,4194304] 0 2024-02-28T23:07:29.660 INFO:tasks.workunit.client.0.smithi159.stdout:6/742: stat d0/d1b/d5b/cbb 0 2024-02-28T23:07:29.664 INFO:tasks.workunit.client.0.smithi159.stdout:8/881: write d2/d3/d8c/fb4 [1918408,106857] 0 2024-02-28T23:07:29.668 INFO:tasks.workunit.client.0.smithi159.stdout:1/744: mkdir d6/d12/d1a/d92/dc9/dfb 0 2024-02-28T23:07:29.668 INFO:tasks.workunit.client.1.smithi184.stdout:3/399: creat d1/d4/d6/d1f/d26/d3a/d59/f7d x:0 0 0 2024-02-28T23:07:29.669 INFO:tasks.workunit.client.1.smithi184.stdout:5/382: write db/d12/d1c/d21/f75 [1278372,45267] 0 2024-02-28T23:07:29.669 INFO:tasks.workunit.client.1.smithi184.stdout:9/380: link d5/db/de/d10/d12/d2f/f52 d5/db/d5c/f84 0 2024-02-28T23:07:29.674 INFO:tasks.workunit.client.0.smithi159.stdout:0/885: creat d0/d5/d14/d34/d6c/d94/f13c x:0 0 0 2024-02-28T23:07:29.674 INFO:tasks.workunit.client.1.smithi184.stdout:9/381: chown d5/db/de/d10/d12/f2d 693024613 1 2024-02-28T23:07:29.678 INFO:tasks.workunit.client.1.smithi184.stdout:6/315: symlink dc/de/d10/l63 0 2024-02-28T23:07:29.682 INFO:tasks.workunit.client.0.smithi159.stdout:3/700: dwrite d0/d2b/d55/d75/d6d/f3d [4194304,4194304] 0 2024-02-28T23:07:29.688 INFO:tasks.workunit.client.0.smithi159.stdout:5/716: mkdir d8/d19/d23/d35/d38/d6d/df8 0 2024-02-28T23:07:29.692 INFO:tasks.workunit.client.1.smithi184.stdout:2/368: symlink d10/d1f/d21/d5e/d15/d24/d5f/d63/l7b 0 2024-02-28T23:07:29.693 INFO:tasks.workunit.client.1.smithi184.stdout:3/400: dwrite d1/d4/d6/f53 [0,4194304] 0 2024-02-28T23:07:29.694 INFO:tasks.workunit.client.0.smithi159.stdout:7/644: mknod d5/d16/d40/dce/cd2 0 2024-02-28T23:07:29.696 INFO:tasks.workunit.client.1.smithi184.stdout:4/381: getdents d1/d4/d43/d73 0 2024-02-28T23:07:29.696 INFO:tasks.workunit.client.0.smithi159.stdout:7/645: dread - d5/d10/f85 zero size 2024-02-28T23:07:29.697 INFO:tasks.workunit.client.0.smithi159.stdout:4/840: dwrite d9/d20/f84 [0,4194304] 0 2024-02-28T23:07:29.699 INFO:tasks.workunit.client.1.smithi184.stdout:8/381: dread d1/da/df/d20/f3e [0,4194304] 0 2024-02-28T23:07:29.701 INFO:tasks.workunit.client.0.smithi159.stdout:7/646: read d5/d16/d1a/d27/d46/f61 [1524420,99813] 0 2024-02-28T23:07:29.706 INFO:tasks.workunit.client.0.smithi159.stdout:4/841: fsync d9/d42/d54/d56/df5/f124 0 2024-02-28T23:07:29.707 INFO:tasks.workunit.client.0.smithi159.stdout:6/743: fdatasync d0/d1b/d33/d11/fa7 0 2024-02-28T23:07:29.707 INFO:tasks.workunit.client.0.smithi159.stdout:1/745: dread - d6/d12/fbe zero size 2024-02-28T23:07:29.711 INFO:tasks.workunit.client.0.smithi159.stdout:8/882: symlink d2/d11/d52/d26/d36/d38/d77/d9e/df1/l116 0 2024-02-28T23:07:29.712 INFO:tasks.workunit.client.0.smithi159.stdout:7/647: fdatasync d5/d16/d1a/d27/d46/d65/d81/d83/f8a 0 2024-02-28T23:07:29.715 INFO:tasks.workunit.client.1.smithi184.stdout:1/439: creat d20/d32/d4b/f99 x:0 0 0 2024-02-28T23:07:29.715 INFO:tasks.workunit.client.0.smithi159.stdout:9/757: rename d4/d52/d7d to d4/d3d/d3e/d55/d4c/dee 0 2024-02-28T23:07:29.716 INFO:tasks.workunit.client.1.smithi184.stdout:0/388: dread d0/df/d13/f3e [0,4194304] 0 2024-02-28T23:07:29.717 INFO:tasks.workunit.client.1.smithi184.stdout:3/401: mknod d1/d4/d5/d40/c7e 0 2024-02-28T23:07:29.717 INFO:tasks.workunit.client.0.smithi159.stdout:2/678: dwrite d9/d23/d2c/d55/fb6 [0,4194304] 0 2024-02-28T23:07:29.719 INFO:tasks.workunit.client.1.smithi184.stdout:0/389: fsync d0/df/d13/f3b 0 2024-02-28T23:07:29.722 INFO:tasks.workunit.client.1.smithi184.stdout:0/390: readlink d0/d1d/d4c/l4f 0 2024-02-28T23:07:29.723 INFO:tasks.workunit.client.0.smithi159.stdout:3/701: unlink d0/d6/d3e/l44 0 2024-02-28T23:07:29.724 INFO:tasks.workunit.client.1.smithi184.stdout:4/382: chown l0 444537 1 2024-02-28T23:07:29.726 INFO:tasks.workunit.client.1.smithi184.stdout:2/369: creat d10/d1f/d21/d5e/d15/d60/d66/f7c x:0 0 0 2024-02-28T23:07:29.728 INFO:tasks.workunit.client.1.smithi184.stdout:8/382: dwrite d1/da/d33/f8c [0,4194304] 0 2024-02-28T23:07:29.731 INFO:tasks.workunit.client.0.smithi159.stdout:4/842: fsync d9/f4e 0 2024-02-28T23:07:29.733 INFO:tasks.workunit.client.0.smithi159.stdout:2/679: dread d9/d50/d54/d8d/fdc [0,4194304] 0 2024-02-28T23:07:29.734 INFO:tasks.workunit.client.0.smithi159.stdout:4/843: stat d9/d20/d87/d115/d1c/d23/f63 0 2024-02-28T23:07:29.736 INFO:tasks.workunit.client.1.smithi184.stdout:7/354: sync 2024-02-28T23:07:29.738 INFO:tasks.workunit.client.1.smithi184.stdout:7/355: chown d6/d9/d13/l54 47175951 1 2024-02-28T23:07:29.748 INFO:tasks.workunit.client.0.smithi159.stdout:9/758: unlink d4/d3d/d3e/d4a/l83 0 2024-02-28T23:07:29.749 INFO:tasks.workunit.client.1.smithi184.stdout:9/382: dwrite d5/d26/f78 [0,4194304] 0 2024-02-28T23:07:29.751 INFO:tasks.workunit.client.1.smithi184.stdout:9/383: read d5/db/de/d10/d12/f4d [927939,22344] 0 2024-02-28T23:07:29.755 INFO:tasks.workunit.client.0.smithi159.stdout:8/883: truncate d2/d11/d52/d26/d36/d38/d77/dc5/fd9 745489 0 2024-02-28T23:07:29.760 INFO:tasks.workunit.client.0.smithi159.stdout:0/886: dwrite d0/d5/d14/d25/d2c/dab/f10c [0,4194304] 0 2024-02-28T23:07:29.760 INFO:tasks.workunit.client.0.smithi159.stdout:8/884: chown d2/d11/d35/d5f/dfe/c9d 3 1 2024-02-28T23:07:29.766 INFO:tasks.workunit.client.0.smithi159.stdout:3/702: dread - d0/d3f/dd2/d7c/d79/d9b/fb2 zero size 2024-02-28T23:07:29.767 INFO:tasks.workunit.client.1.smithi184.stdout:1/440: stat d20/d46/c7e 0 2024-02-28T23:07:29.775 INFO:tasks.workunit.client.0.smithi159.stdout:1/746: dread d6/d12/f15 [0,4194304] 0 2024-02-28T23:07:29.775 INFO:tasks.workunit.client.1.smithi184.stdout:0/391: stat d0/df/d13/d27/d31/d5b/d7b/l82 0 2024-02-28T23:07:29.777 INFO:tasks.workunit.client.0.smithi159.stdout:9/759: fsync d4/d3d/d3e/d55/d37/f9b 0 2024-02-28T23:07:29.778 INFO:tasks.workunit.client.0.smithi159.stdout:2/680: dwrite d9/d50/dcc/d44/dc0/fc1 [0,4194304] 0 2024-02-28T23:07:29.781 INFO:tasks.workunit.client.1.smithi184.stdout:2/370: rename d10/d1f/d21/f6e to d10/d33/f7d 0 2024-02-28T23:07:29.782 INFO:tasks.workunit.client.0.smithi159.stdout:6/744: dwrite d0/d1b/d33/d3f/d44/fc0 [0,4194304] 0 2024-02-28T23:07:29.783 INFO:tasks.workunit.client.1.smithi184.stdout:8/383: symlink d1/da/dc/d18/l95 0 2024-02-28T23:07:29.785 INFO:tasks.workunit.client.1.smithi184.stdout:1/441: dwrite d20/d46/f75 [0,4194304] 0 2024-02-28T23:07:29.786 INFO:tasks.workunit.client.1.smithi184.stdout:8/384: chown d1/da/dc/d16/d29/f54 1817 1 2024-02-28T23:07:29.787 INFO:tasks.workunit.client.1.smithi184.stdout:7/356: unlink d6/d9/da/dc/d49/f4f 0 2024-02-28T23:07:29.793 INFO:tasks.workunit.client.0.smithi159.stdout:0/887: fdatasync d0/d5/d14/d25/d2c/dab/f10c 0 2024-02-28T23:07:29.800 INFO:tasks.workunit.client.0.smithi159.stdout:3/703: mkdir d0/d6/d3e/d2f/ddf 0 2024-02-28T23:07:29.803 INFO:tasks.workunit.client.1.smithi184.stdout:6/316: getdents dc/d60/d62 0 2024-02-28T23:07:29.809 INFO:tasks.workunit.client.0.smithi159.stdout:8/885: creat d2/d11/d52/d26/d36/d38/d77/d9e/dc1/df7/d102/f117 x:0 0 0 2024-02-28T23:07:29.811 INFO:tasks.workunit.client.1.smithi184.stdout:4/383: unlink d1/c4d 0 2024-02-28T23:07:29.812 INFO:tasks.workunit.client.1.smithi184.stdout:4/384: truncate d1/d8/f4a 1127494 0 2024-02-28T23:07:29.815 INFO:tasks.workunit.client.1.smithi184.stdout:5/383: getdents db/d12/d18/d2e 0 2024-02-28T23:07:29.819 INFO:tasks.workunit.client.0.smithi159.stdout:2/681: rmdir d9/d50/dcc/d44/dc0 39 2024-02-28T23:07:29.821 INFO:tasks.workunit.client.0.smithi159.stdout:9/760: unlink d4/c10 0 2024-02-28T23:07:29.825 INFO:tasks.workunit.client.0.smithi159.stdout:5/717: link d8/f9b d8/d19/d23/d35/d65/db5/ff9 0 2024-02-28T23:07:29.827 INFO:tasks.workunit.client.1.smithi184.stdout:0/392: rename d0/df/d13/d27/d31/d5b/d81 to d0/df/d13/d27/d31/d51/d85 0 2024-02-28T23:07:29.828 INFO:tasks.workunit.client.0.smithi159.stdout:2/682: dread d9/d50/d54/d84/d37/d5c/f7b [0,4194304] 0 2024-02-28T23:07:29.832 INFO:tasks.workunit.client.0.smithi159.stdout:7/648: getdents d5/d56/d50/daa 0 2024-02-28T23:07:29.835 INFO:tasks.workunit.client.1.smithi184.stdout:8/385: unlink d1/l9 0 2024-02-28T23:07:29.836 INFO:tasks.workunit.client.0.smithi159.stdout:8/886: creat d2/d11/d52/d26/d36/d38/d77/f118 x:0 0 0 2024-02-28T23:07:29.836 INFO:tasks.workunit.client.1.smithi184.stdout:2/371: dwrite fa [0,4194304] 0 2024-02-28T23:07:29.837 INFO:tasks.workunit.client.1.smithi184.stdout:7/357: mkdir d6/d9/d13/d1e/d2f/d33/d80 0 2024-02-28T23:07:29.838 INFO:tasks.workunit.client.1.smithi184.stdout:3/402: write d1/d4/d6/d1f/d26/d3a/f3d [151172,98861] 0 2024-02-28T23:07:29.839 INFO:tasks.workunit.client.0.smithi159.stdout:3/704: dread d0/f35 [0,4194304] 0 2024-02-28T23:07:29.841 INFO:tasks.workunit.client.0.smithi159.stdout:3/705: read d0/d2b/d55/d75/d6d/f2d [1373259,13646] 0 2024-02-28T23:07:29.842 INFO:tasks.workunit.client.1.smithi184.stdout:9/384: link d5/d47/d4a/f82 d5/d73/f85 0 2024-02-28T23:07:29.842 INFO:tasks.workunit.client.1.smithi184.stdout:3/403: write d1/d4/d6/d1f/f68 [892712,30591] 0 2024-02-28T23:07:29.847 INFO:tasks.workunit.client.1.smithi184.stdout:6/317: creat dc/d53/f64 x:0 0 0 2024-02-28T23:07:29.849 INFO:tasks.workunit.client.1.smithi184.stdout:6/318: write dc/de/d10/f3d [1259542,7934] 0 2024-02-28T23:07:29.851 INFO:tasks.workunit.client.0.smithi159.stdout:9/761: unlink d4/d3d/d3e/d55/d37/f54 0 2024-02-28T23:07:29.853 INFO:tasks.workunit.client.0.smithi159.stdout:2/683: mknod d9/d50/d54/d84/d37/cf3 0 2024-02-28T23:07:29.857 INFO:tasks.workunit.client.1.smithi184.stdout:8/386: write d1/da/f79 [214932,81032] 0 2024-02-28T23:07:29.858 INFO:tasks.workunit.client.0.smithi159.stdout:4/844: link d9/d20/d87/d115/d1c/d23/d2d/l12a d9/d20/d87/d115/d1c/d23/d2d/de1/l12b 0 2024-02-28T23:07:29.860 INFO:tasks.workunit.client.0.smithi159.stdout:8/887: dread d2/d3/fa6 [0,4194304] 0 2024-02-28T23:07:29.861 INFO:tasks.workunit.client.1.smithi184.stdout:7/358: rmdir d6/d9/d13/d1e/d2f/d34/d47 39 2024-02-28T23:07:29.861 INFO:tasks.workunit.client.0.smithi159.stdout:6/745: dwrite d0/d1b/d33/d3f/f73 [4194304,4194304] 0 2024-02-28T23:07:29.863 INFO:tasks.workunit.client.0.smithi159.stdout:8/888: chown d2/d11/d52/d26/d36/d38/f5d 407550 1 2024-02-28T23:07:29.863 INFO:tasks.workunit.client.0.smithi159.stdout:3/706: unlink d0/d6/fa6 0 2024-02-28T23:07:29.865 INFO:tasks.workunit.client.0.smithi159.stdout:1/747: truncate d6/d1d/d46/d88/f94 1653404 0 2024-02-28T23:07:29.867 INFO:tasks.workunit.client.1.smithi184.stdout:9/385: unlink d5/db/de/d10/d6a/f69 0 2024-02-28T23:07:29.869 INFO:tasks.workunit.client.1.smithi184.stdout:1/442: dwrite d20/f49 [0,4194304] 0 2024-02-28T23:07:29.872 INFO:tasks.workunit.client.0.smithi159.stdout:7/649: mknod d5/cd3 0 2024-02-28T23:07:29.874 INFO:tasks.workunit.client.0.smithi159.stdout:5/718: rename d8/d19/d23/d35/d65/f83 to d8/db4/ffa 0 2024-02-28T23:07:29.879 INFO:tasks.workunit.client.1.smithi184.stdout:6/319: creat dc/de/d2a/f65 x:0 0 0 2024-02-28T23:07:29.882 INFO:tasks.workunit.client.0.smithi159.stdout:2/684: creat d9/d50/d54/d84/d37/d5c/ff4 x:0 0 0 2024-02-28T23:07:29.888 INFO:tasks.workunit.client.0.smithi159.stdout:4/845: unlink d9/d4c/d6c/d98/la1 0 2024-02-28T23:07:29.889 INFO:tasks.workunit.client.1.smithi184.stdout:0/393: creat d0/d1d/d3a/d84/f86 x:0 0 0 2024-02-28T23:07:29.890 INFO:tasks.workunit.client.0.smithi159.stdout:4/846: write d9/d4c/fae [672392,105177] 0 2024-02-28T23:07:29.890 INFO:tasks.workunit.client.1.smithi184.stdout:2/372: symlink d10/d1f/d21/d5e/d15/d60/d6f/l7e 0 2024-02-28T23:07:29.892 INFO:tasks.workunit.client.1.smithi184.stdout:7/359: creat d6/d9/da/dc/d7d/d6c/f81 x:0 0 0 2024-02-28T23:07:29.894 INFO:tasks.workunit.client.0.smithi159.stdout:6/746: symlink d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88/lf1 0 2024-02-28T23:07:29.898 INFO:tasks.workunit.client.1.smithi184.stdout:4/385: truncate d1/d8/d35/f42 602868 0 2024-02-28T23:07:29.898 INFO:tasks.workunit.client.0.smithi159.stdout:5/719: rmdir d8/d19/d23/d35/d65/da3/df4 39 2024-02-28T23:07:29.904 INFO:tasks.workunit.client.0.smithi159.stdout:2/685: creat d9/d23/da9/ff5 x:0 0 0 2024-02-28T23:07:29.907 INFO:tasks.workunit.client.0.smithi159.stdout:3/707: dwrite d0/d2b/d55/d6e/fb6 [0,4194304] 0 2024-02-28T23:07:29.912 INFO:tasks.workunit.client.1.smithi184.stdout:6/320: unlink dc/fd 0 2024-02-28T23:07:29.914 INFO:tasks.workunit.client.1.smithi184.stdout:6/321: readlink dc/de/d10/d3a/l44 0 2024-02-28T23:07:29.915 INFO:tasks.workunit.client.1.smithi184.stdout:5/384: creat db/f7b x:0 0 0 2024-02-28T23:07:29.918 INFO:tasks.workunit.client.0.smithi159.stdout:1/748: symlink d6/d1d/d46/d88/dd3/d9c/db3/dc4/ddc/lfc 0 2024-02-28T23:07:29.920 INFO:tasks.workunit.client.0.smithi159.stdout:1/749: write d6/d12/d31/f56 [1286489,111072] 0 2024-02-28T23:07:29.924 INFO:tasks.workunit.client.1.smithi184.stdout:4/386: mknod d1/d8/d35/c76 0 2024-02-28T23:07:29.925 INFO:tasks.workunit.client.0.smithi159.stdout:6/747: symlink d0/d1b/d33/d11/d34/d9d/da2/db7/lf2 0 2024-02-28T23:07:29.925 INFO:tasks.workunit.client.1.smithi184.stdout:9/386: symlink d5/d47/d68/d7c/l86 0 2024-02-28T23:07:29.928 INFO:tasks.workunit.client.0.smithi159.stdout:5/720: read f6 [1602968,19861] 0 2024-02-28T23:07:29.928 INFO:tasks.workunit.client.1.smithi184.stdout:9/387: dread - d5/db/de/f74 zero size 2024-02-28T23:07:29.931 INFO:tasks.workunit.client.0.smithi159.stdout:1/750: mknod d6/d1d/d46/d88/dd3/d9c/db3/dc4/dc6/cfd 0 2024-02-28T23:07:29.932 INFO:tasks.workunit.client.1.smithi184.stdout:1/443: dwrite d20/d32/d3e/f4a [0,4194304] 0 2024-02-28T23:07:29.933 INFO:tasks.workunit.client.1.smithi184.stdout:7/360: getdents d6/d9/d13/d1e/d2f/d34/d65 0 2024-02-28T23:07:29.933 INFO:tasks.workunit.client.0.smithi159.stdout:4/847: dread d9/d4c/d6c/fbb [0,4194304] 0 2024-02-28T23:07:29.934 INFO:tasks.workunit.client.0.smithi159.stdout:9/762: getdents d4/d3d/d3e/d55/d4c/dee 0 2024-02-28T23:07:29.937 INFO:tasks.workunit.client.0.smithi159.stdout:6/748: fsync d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/f60 0 2024-02-28T23:07:29.939 INFO:tasks.workunit.client.1.smithi184.stdout:2/373: write d10/f16 [496633,92801] 0 2024-02-28T23:07:29.942 INFO:tasks.workunit.client.1.smithi184.stdout:3/404: getdents d1/d4/d6/d1f/d26/d3a/d59 0 2024-02-28T23:07:29.944 INFO:tasks.workunit.client.1.smithi184.stdout:3/405: chown d1/d4/d5/d40/l4b 18121263 1 2024-02-28T23:07:29.946 INFO:tasks.workunit.client.1.smithi184.stdout:6/322: mkdir dc/de/d2a/d5c/d66 0 2024-02-28T23:07:29.946 INFO:tasks.workunit.client.1.smithi184.stdout:3/406: stat d1/d4/d1c/d62/d66/f6f 0 2024-02-28T23:07:29.946 INFO:tasks.workunit.client.0.smithi159.stdout:9/763: mkdir d4/d3d/d3e/d55/d37/def 0 2024-02-28T23:07:29.947 INFO:tasks.workunit.client.1.smithi184.stdout:3/407: readlink d1/d4/d6/l4c 0 2024-02-28T23:07:29.947 INFO:tasks.workunit.client.0.smithi159.stdout:3/708: write d0/d6/f13 [2376902,45205] 0 2024-02-28T23:07:29.948 INFO:tasks.workunit.client.1.smithi184.stdout:9/388: creat d5/d47/d59/f87 x:0 0 0 2024-02-28T23:07:29.950 INFO:tasks.workunit.client.1.smithi184.stdout:3/408: fsync d1/d4/d6/d1f/d26/d3a/d59/d67/f6d 0 2024-02-28T23:07:29.951 INFO:tasks.workunit.client.1.smithi184.stdout:1/444: mkdir d20/d32/d3e/d9a 0 2024-02-28T23:07:29.951 INFO:tasks.workunit.client.0.smithi159.stdout:3/709: dread d0/d3f/fb5 [0,4194304] 0 2024-02-28T23:07:29.953 INFO:tasks.workunit.client.1.smithi184.stdout:7/361: rmdir d6/d9/d13/d14 39 2024-02-28T23:07:29.956 INFO:tasks.workunit.client.0.smithi159.stdout:5/721: mknod d8/d19/d23/d35/d38/d6d/df8/cfb 0 2024-02-28T23:07:29.957 INFO:tasks.workunit.client.1.smithi184.stdout:5/385: creat db/f7c x:0 0 0 2024-02-28T23:07:29.958 INFO:tasks.workunit.client.1.smithi184.stdout:5/386: fdatasync db/d12/d1c/d21/d2f/f55 0 2024-02-28T23:07:29.959 INFO:tasks.workunit.client.1.smithi184.stdout:6/323: symlink dc/d60/l67 0 2024-02-28T23:07:29.962 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:29 smithi159 ceph-mon[28802]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:07:29.963 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:29 smithi159 ceph-mon[28802]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:07:29.963 INFO:tasks.workunit.client.1.smithi184.stdout:9/389: creat d5/d47/f88 x:0 0 0 2024-02-28T23:07:29.964 INFO:tasks.workunit.client.1.smithi184.stdout:2/374: write d10/f51 [360038,42703] 0 2024-02-28T23:07:29.969 INFO:tasks.workunit.client.0.smithi159.stdout:2/686: dwrite d9/d50/d54/d84/d37/f53 [0,4194304] 0 2024-02-28T23:07:29.971 INFO:tasks.workunit.client.0.smithi159.stdout:4/848: link d9/d4c/d6c/d98/c113 d9/d42/c12c 0 2024-02-28T23:07:29.972 INFO:tasks.workunit.client.1.smithi184.stdout:6/324: symlink dc/d60/l68 0 2024-02-28T23:07:29.973 INFO:tasks.workunit.client.0.smithi159.stdout:9/764: dwrite d4/f25 [0,4194304] 0 2024-02-28T23:07:29.977 INFO:tasks.workunit.client.1.smithi184.stdout:8/387: sync 2024-02-28T23:07:29.977 INFO:tasks.workunit.client.1.smithi184.stdout:9/390: mknod d5/d47/d4a/c89 0 2024-02-28T23:07:29.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:29.978+0000 7fc17aa00700 1 -- 172.21.15.159:0/3275134267 --> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc174106700 con 0x7fc15407de90 2024-02-28T23:07:29.978 INFO:tasks.workunit.client.0.smithi159.stdout:9/765: chown d4/d3d/f5d 3988984 1 2024-02-28T23:07:29.979 INFO:tasks.workunit.client.0.smithi159.stdout:6/749: dwrite d0/d1b/f3c [0,4194304] 0 2024-02-28T23:07:29.980 INFO:tasks.workunit.client.0.smithi159.stdout:9/766: readlink d4/d3d/d3e/d55/d4c/lba 0 2024-02-28T23:07:29.981 INFO:tasks.workunit.client.0.smithi159.stdout:6/750: chown d0/f2b 139 1 2024-02-28T23:07:29.984 INFO:tasks.workunit.client.1.smithi184.stdout:3/409: mknod d1/c7f 0 2024-02-28T23:07:29.985 INFO:tasks.workunit.client.1.smithi184.stdout:3/410: stat d1/d4/d1c/f27 0 2024-02-28T23:07:29.987 INFO:tasks.workunit.client.0.smithi159.stdout:2/687: unlink d9/d23/d2c/f82 0 2024-02-28T23:07:29.990 INFO:tasks.workunit.client.0.smithi159.stdout:1/751: link d6/d12/d33/lc5 d6/d12/d1a/d92/dc8/lfe 0 2024-02-28T23:07:29.996 INFO:tasks.workunit.client.1.smithi184.stdout:7/362: mknod d6/d9/d13/d1e/c82 0 2024-02-28T23:07:29.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.000+0000 7fc171600700 1 -- 172.21.15.159:0/3275134267 <== mgr.24357 v2:172.21.15.184:6828/2879526003 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fc174106700 con 0x7fc15407de90 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (9m) 46s ago 11m 14.0M - 0.25.0 c8568f914cd2 2b2966e86e70 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (11m) 46s ago 11m 7822k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (10m) 49s ago 10m 7490k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (11m) 46s ago 11m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (10m) 49s ago 10m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (9m) 46s ago 10m 74.8M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (3m) 46s ago 3m 137M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (4m) 46s ago 4m 75.4M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (3m) 49s ago 3m 13.4M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (3m) 49s ago 3m 13.3M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:07:29.999 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:9283,8765,8443 running (13m) 46s ago 13m 325M - 18.2.1 5be31c24972a f518a1599079 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (82s) 49s ago 9m 486M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1399495d8706 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (13m) 46s ago 13m 49.0M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (9m) 49s ago 9m 38.4M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (11m) 46s ago 11m 8094k - 1.5.0 0da6a335fe13 009475616a7b 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (9m) 49s ago 9m 8216k - 1.5.0 0da6a335fe13 a45ab4136b88 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (8m) 46s ago 8m 97.8M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (8m) 46s ago 8m 110M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (7m) 46s ago 7m 90.6M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (6m) 49s ago 6m 112M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (6m) 49s ago 6m 107M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (5m) 49s ago 5m 104M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:07:30.000 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 starting - - - - 2024-02-28T23:07:30.001 INFO:tasks.workunit.client.1.smithi184.stdout:6/325: symlink dc/d42/l69 0 2024-02-28T23:07:30.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.004+0000 7fc17aa00700 1 -- 172.21.15.159:0/3275134267 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc15407de90 msgr2=0x7fc154080350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:30.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.004+0000 7fc17aa00700 1 --2- 172.21.15.159:0/3275134267 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc15407de90 0x7fc154080350 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1640099b0 tx=0x7fc164008040 comp rx=0 tx=0).stop 2024-02-28T23:07:30.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.004+0000 7fc17aa00700 1 -- 172.21.15.159:0/3275134267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc174101db0 msgr2=0x7fc174196920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:30.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.004+0000 7fc17aa00700 1 --2- 172.21.15.159:0/3275134267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc174101db0 0x7fc174196920 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0098e0 tx=0x7fc15c00be20 comp rx=0 tx=0).stop 2024-02-28T23:07:30.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.004+0000 7fc17aa00700 1 -- 172.21.15.159:0/3275134267 shutdown_connections 2024-02-28T23:07:30.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.004+0000 7fc17aa00700 1 --2- 172.21.15.159:0/3275134267 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7fc15407de90 0x7fc154080350 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc1640099b0 tx=0x7fc164008040 comp rx=0 tx=0).stop 2024-02-28T23:07:30.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.004+0000 7fc17aa00700 1 --2- 172.21.15.159:0/3275134267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc174100bb0 0x7fc1741963e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:30.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.004+0000 7fc17aa00700 1 --2- 172.21.15.159:0/3275134267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc174101db0 0x7fc174196920 secure :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fc15c0098e0 tx=0x7fc15c00be20 comp rx=0 tx=0).stop 2024-02-28T23:07:30.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.004+0000 7fc17aa00700 1 -- 172.21.15.159:0/3275134267 >> 172.21.15.159:0/3275134267 conn(0x7fc1740fc110 msgr2=0x7fc174104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:07:30.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.005+0000 7fc17aa00700 1 -- 172.21.15.159:0/3275134267 shutdown_connections 2024-02-28T23:07:30.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.005+0000 7fc17aa00700 1 -- 172.21.15.159:0/3275134267 wait complete. 2024-02-28T23:07:30.004 INFO:tasks.workunit.client.1.smithi184.stdout:1/445: dwrite f16 [0,4194304] 0 2024-02-28T23:07:30.011 INFO:tasks.workunit.client.1.smithi184.stdout:8/388: rename d1/da/dc/d18/l34 to d1/da/dc/d16/d4d/d82/l96 0 2024-02-28T23:07:30.015 INFO:tasks.workunit.client.0.smithi159.stdout:9/767: stat d4/d3d/d3e/d55/d4c/d4e/l67 0 2024-02-28T23:07:30.015 INFO:tasks.workunit.client.0.smithi159.stdout:5/722: dwrite d8/d19/d23/d35/d41/daa/f89 [0,4194304] 0 2024-02-28T23:07:30.017 INFO:tasks.workunit.client.1.smithi184.stdout:3/411: rmdir d1/d4/d6/d1f/d26 39 2024-02-28T23:07:30.022 INFO:tasks.workunit.client.1.smithi184.stdout:2/375: dwrite d10/f11 [0,4194304] 0 2024-02-28T23:07:30.023 INFO:tasks.workunit.client.0.smithi159.stdout:2/688: rmdir d9/d23/d2c 39 2024-02-28T23:07:30.023 INFO:tasks.workunit.client.0.smithi159.stdout:4/849: unlink d9/d20/d87/d115/d1c/la0 0 2024-02-28T23:07:30.027 INFO:tasks.workunit.client.1.smithi184.stdout:6/326: dread dc/de/d10/d16/f2d [0,4194304] 0 2024-02-28T23:07:30.030 INFO:tasks.workunit.client.1.smithi184.stdout:7/363: rename d6/f19 to d6/d9/d13/d1e/d2f/d34/d65/f83 0 2024-02-28T23:07:30.031 INFO:tasks.workunit.client.1.smithi184.stdout:6/327: dread - dc/f4f zero size 2024-02-28T23:07:30.034 INFO:tasks.workunit.client.1.smithi184.stdout:7/364: write d6/d9/da/dc/d7d/d6c/f81 [345490,17107] 0 2024-02-28T23:07:30.036 INFO:tasks.workunit.client.0.smithi159.stdout:9/768: fsync d4/d3d/d3e/d55/d37/f3b 0 2024-02-28T23:07:30.039 INFO:tasks.workunit.client.0.smithi159.stdout:1/752: symlink d6/d12/d1a/d92/dc9/dfb/lff 0 2024-02-28T23:07:30.043 INFO:tasks.workunit.client.0.smithi159.stdout:6/751: dwrite d0/f8 [4194304,4194304] 0 2024-02-28T23:07:30.045 INFO:tasks.workunit.client.0.smithi159.stdout:1/753: chown d6/d12/d31/d5a/fa2 657 1 2024-02-28T23:07:30.051 INFO:tasks.workunit.client.1.smithi184.stdout:1/446: mknod d20/c9b 0 2024-02-28T23:07:30.062 INFO:tasks.workunit.client.1.smithi184.stdout:9/391: link d5/db/de/d10/d12/c25 d5/db/de/d10/d12/d2f/d3f/c8a 0 2024-02-28T23:07:30.064 INFO:tasks.workunit.client.1.smithi184.stdout:3/412: fsync d1/d4/d6/d1f/d26/f2a 0 2024-02-28T23:07:30.068 INFO:tasks.workunit.client.1.smithi184.stdout:2/376: dwrite ff [0,4194304] 0 2024-02-28T23:07:30.068 INFO:tasks.workunit.client.1.smithi184.stdout:8/389: creat d1/da/dc/d16/f97 x:0 0 0 2024-02-28T23:07:30.070 INFO:tasks.workunit.client.1.smithi184.stdout:1/447: dwrite d20/d32/d3e/f4a [0,4194304] 0 2024-02-28T23:07:30.071 INFO:tasks.workunit.client.1.smithi184.stdout:8/390: chown d1/da/dc/d18/f64 79064487 1 2024-02-28T23:07:30.077 INFO:tasks.workunit.client.1.smithi184.stdout:7/365: creat d6/d9/d13/d14/d45/f84 x:0 0 0 2024-02-28T23:07:30.077 INFO:tasks.workunit.client.1.smithi184.stdout:0/394: sync 2024-02-28T23:07:30.079 INFO:tasks.workunit.client.1.smithi184.stdout:0/395: fsync d0/df/f7a 0 2024-02-28T23:07:30.081 INFO:tasks.workunit.client.1.smithi184.stdout:9/392: rmdir d5/db/d5c/d5e 39 2024-02-28T23:07:30.085 INFO:tasks.workunit.client.1.smithi184.stdout:7/366: creat d6/d68/f85 x:0 0 0 2024-02-28T23:07:30.087 INFO:tasks.workunit.client.1.smithi184.stdout:6/328: write dc/de/f15 [1210078,8780] 0 2024-02-28T23:07:30.088 INFO:tasks.workunit.client.1.smithi184.stdout:7/367: chown d6/d9/da/l4d 16775299 1 2024-02-28T23:07:30.090 INFO:tasks.workunit.client.1.smithi184.stdout:2/377: mknod d10/d1f/c7f 0 2024-02-28T23:07:30.091 INFO:tasks.workunit.client.1.smithi184.stdout:1/448: dwrite f17 [0,4194304] 0 2024-02-28T23:07:30.093 INFO:tasks.workunit.client.1.smithi184.stdout:2/378: write d10/f34 [196096,8750] 0 2024-02-28T23:07:30.099 INFO:tasks.workunit.client.1.smithi184.stdout:2/379: chown d10/d1f/d21/d5e/d15/d60/d66/c7a 3478057 1 2024-02-28T23:07:30.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:29 smithi184 ceph-mon[36198]: from='client.24411 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:07:30.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:29 smithi184 ceph-mon[36198]: from='client.14664 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:07:30.100 INFO:tasks.workunit.client.1.smithi184.stdout:1/449: dread - d20/d46/f57 zero size 2024-02-28T23:07:30.104 INFO:tasks.workunit.client.1.smithi184.stdout:7/368: symlink d6/d9/d13/d1e/d2f/d34/l86 0 2024-02-28T23:07:30.106 INFO:tasks.workunit.client.1.smithi184.stdout:2/380: write d10/d1f/d21/d5e/f58 [873042,76659] 0 2024-02-28T23:07:30.106 INFO:tasks.workunit.client.1.smithi184.stdout:1/450: write d20/d32/d4b/f78 [5032382,9700] 0 2024-02-28T23:07:30.106 INFO:tasks.workunit.client.1.smithi184.stdout:0/396: getdents d0/d1d/d3a 0 2024-02-28T23:07:30.113 INFO:tasks.workunit.client.1.smithi184.stdout:8/391: dwrite d1/da/d10/d43/f5e [0,4194304] 0 2024-02-28T23:07:30.115 INFO:tasks.workunit.client.1.smithi184.stdout:8/392: fdatasync d1/da/dc/d18/f64 0 2024-02-28T23:07:30.118 INFO:tasks.workunit.client.1.smithi184.stdout:5/387: sync 2024-02-28T23:07:30.118 INFO:tasks.workunit.client.1.smithi184.stdout:4/387: sync 2024-02-28T23:07:30.121 INFO:tasks.workunit.client.1.smithi184.stdout:4/388: fdatasync d1/d4/f11 0 2024-02-28T23:07:30.125 INFO:tasks.workunit.client.1.smithi184.stdout:6/329: dread f3 [0,4194304] 0 2024-02-28T23:07:30.130 INFO:tasks.workunit.client.1.smithi184.stdout:1/451: dwrite d20/d32/d3e/d82/d85/d86/f96 [0,4194304] 0 2024-02-28T23:07:30.136 INFO:tasks.workunit.client.1.smithi184.stdout:0/397: unlink d0/df/d13/f3e 0 2024-02-28T23:07:30.139 INFO:tasks.workunit.client.1.smithi184.stdout:2/381: rename d10/d1f/d21/d5e/d15/d24/l4b to d10/l80 0 2024-02-28T23:07:30.140 INFO:tasks.workunit.client.1.smithi184.stdout:3/413: write d1/d4/d6/d1f/d26/f29 [3636568,56293] 0 2024-02-28T23:07:30.141 INFO:tasks.workunit.client.1.smithi184.stdout:7/369: dread d6/d9/d13/d14/f2a [0,4194304] 0 2024-02-28T23:07:30.144 INFO:tasks.workunit.client.1.smithi184.stdout:9/393: write d5/db/de/d10/d12/f27 [1491291,32308] 0 2024-02-28T23:07:30.144 INFO:tasks.workunit.client.1.smithi184.stdout:2/382: chown d10/d1f/d38/d54/l64 1460606705 1 2024-02-28T23:07:30.146 INFO:tasks.workunit.client.1.smithi184.stdout:9/394: chown d5/db/de 27854664 1 2024-02-28T23:07:30.146 INFO:tasks.workunit.client.1.smithi184.stdout:3/414: read d1/d4/f57 [3407861,71239] 0 2024-02-28T23:07:30.149 INFO:tasks.workunit.client.1.smithi184.stdout:1/452: chown d20/f35 501 1 2024-02-28T23:07:30.150 INFO:tasks.workunit.client.1.smithi184.stdout:8/393: getdents d1/da/dc/d16/d29/d92 0 2024-02-28T23:07:30.150 INFO:tasks.workunit.client.1.smithi184.stdout:1/453: readlink d20/d46/l70 0 2024-02-28T23:07:30.153 INFO:tasks.workunit.client.1.smithi184.stdout:0/398: creat d0/df/d13/d27/d58/f87 x:0 0 0 2024-02-28T23:07:30.154 INFO:tasks.workunit.client.1.smithi184.stdout:0/399: fdatasync d0/d1f/f26 0 2024-02-28T23:07:30.156 INFO:tasks.workunit.client.1.smithi184.stdout:5/388: symlink db/l7d 0 2024-02-28T23:07:30.159 INFO:tasks.workunit.client.1.smithi184.stdout:4/389: mkdir d1/d8/d3d/d44/d77 0 2024-02-28T23:07:30.161 INFO:tasks.workunit.client.0.smithi159.stdout:5/723: unlink d8/d19/d23/d2a/lb9 0 2024-02-28T23:07:30.162 INFO:tasks.workunit.client.1.smithi184.stdout:0/400: dread d0/d1f/f43 [0,4194304] 0 2024-02-28T23:07:30.163 INFO:tasks.workunit.client.1.smithi184.stdout:6/330: dread dc/de/d10/f38 [0,4194304] 0 2024-02-28T23:07:30.165 INFO:tasks.workunit.client.1.smithi184.stdout:7/370: rename d6/d9/da/f17 to d6/d9/d13/d1e/d2f/d33/d80/f87 0 2024-02-28T23:07:30.167 INFO:tasks.workunit.client.1.smithi184.stdout:9/395: truncate d5/db/d65/f6c 786548 0 2024-02-28T23:07:30.170 INFO:tasks.workunit.client.1.smithi184.stdout:8/394: creat d1/da/dc/d16/d32/f98 x:0 0 0 2024-02-28T23:07:30.172 INFO:tasks.workunit.client.1.smithi184.stdout:0/401: write d0/df/d13/d27/d2b/f68 [2021461,128294] 0 2024-02-28T23:07:30.172 INFO:tasks.workunit.client.1.smithi184.stdout:3/415: dwrite d1/d4/d6/d1f/d26/d3a/f4d [0,4194304] 0 2024-02-28T23:07:30.174 INFO:tasks.workunit.client.1.smithi184.stdout:1/454: dwrite d20/d46/d90/f60 [0,4194304] 0 2024-02-28T23:07:30.177 INFO:tasks.workunit.client.0.smithi159.stdout:5/724: symlink d8/d19/d23/d35/d38/d6d/df8/lfc 0 2024-02-28T23:07:30.181 INFO:tasks.workunit.client.1.smithi184.stdout:8/395: write d1/da/dc/d16/f5c [984438,100205] 0 2024-02-28T23:07:30.184 INFO:tasks.workunit.client.1.smithi184.stdout:8/396: write d1/f86 [949774,23492] 0 2024-02-28T23:07:30.184 INFO:tasks.workunit.client.0.smithi159.stdout:9/769: symlink d4/d3d/d3e/d55/d37/d62/da6/dac/dea/lf0 0 2024-02-28T23:07:30.186 INFO:tasks.workunit.client.1.smithi184.stdout:2/383: dwrite d10/d1f/d38/d54/f59 [0,4194304] 0 2024-02-28T23:07:30.188 INFO:tasks.workunit.client.1.smithi184.stdout:6/331: rmdir dc/d60 39 2024-02-28T23:07:30.188 INFO:tasks.workunit.client.1.smithi184.stdout:4/390: dwrite d1/d4/f11 [0,4194304] 0 2024-02-28T23:07:30.196 INFO:tasks.workunit.client.1.smithi184.stdout:2/384: truncate d10/d1f/d21/d5e/d15/d60/d66/f7c 480043 0 2024-02-28T23:07:30.200 INFO:tasks.workunit.client.0.smithi159.stdout:5/725: read d8/d19/d23/d35/d41/daa/fc5 [1554661,37770] 0 2024-02-28T23:07:30.200 INFO:tasks.workunit.client.1.smithi184.stdout:9/396: unlink d5/d26/l6b 0 2024-02-28T23:07:30.205 INFO:tasks.workunit.client.1.smithi184.stdout:9/397: write d5/db/de/f6d [171288,117867] 0 2024-02-28T23:07:30.211 INFO:tasks.workunit.client.0.smithi159.stdout:5/726: rmdir d8/d19/d23/d35/d41/d92 39 2024-02-28T23:07:30.212 INFO:tasks.workunit.client.0.smithi159.stdout:4/850: dread d9/d42/d54/f57 [0,4194304] 0 2024-02-28T23:07:30.216 INFO:tasks.workunit.client.1.smithi184.stdout:1/455: mkdir d20/d32/d3e/d61/d8b/d9c 0 2024-02-28T23:07:30.216 INFO:tasks.workunit.client.0.smithi159.stdout:4/851: truncate d9/d42/d54/d55/f128 244407 0 2024-02-28T23:07:30.217 INFO:tasks.workunit.client.1.smithi184.stdout:1/456: readlink d20/d32/d3e/l87 0 2024-02-28T23:07:30.217 INFO:tasks.workunit.client.1.smithi184.stdout:0/402: mknod d0/df/d13/d5a/c88 0 2024-02-28T23:07:30.218 INFO:tasks.workunit.client.1.smithi184.stdout:0/403: dread - d0/d1d/f4d zero size 2024-02-28T23:07:30.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.220+0000 7f7557c00700 1 -- 172.21.15.159:0/3909909516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7550073790 msgr2=0x7f7550073c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:30.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.220+0000 7f7557c00700 1 --2- 172.21.15.159:0/3909909516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7550073790 0x7f7550073c10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f753c009910 tx=0x7f753c009c20 comp rx=0 tx=0).stop 2024-02-28T23:07:30.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.221+0000 7f7557c00700 1 -- 172.21.15.159:0/3909909516 shutdown_connections 2024-02-28T23:07:30.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.221+0000 7f7557c00700 1 --2- 172.21.15.159:0/3909909516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7550073790 0x7f7550073c10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:30.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.221+0000 7f7557c00700 1 --2- 172.21.15.159:0/3909909516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7550074d60 0x7f75500731c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:30.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.221+0000 7f7557c00700 1 -- 172.21.15.159:0/3909909516 >> 172.21.15.159:0/3909909516 conn(0x7f75500fc140 msgr2=0x7f75500fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:07:30.220 INFO:tasks.workunit.client.0.smithi159.stdout:5/727: rename d8/d59/de1 to d8/d19/d23/d35/d41/d77/dfd 0 2024-02-28T23:07:30.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.222+0000 7f7557c00700 1 -- 172.21.15.159:0/3909909516 shutdown_connections 2024-02-28T23:07:30.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.222+0000 7f7557c00700 1 -- 172.21.15.159:0/3909909516 wait complete. 2024-02-28T23:07:30.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.223+0000 7f7557c00700 1 Processor -- start 2024-02-28T23:07:30.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.223+0000 7f7557c00700 1 -- start start 2024-02-28T23:07:30.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.224+0000 7f7557c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7550073790 0x7f7550198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:30.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.224+0000 7f7557c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7550074d60 0x7f7550198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:30.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.224+0000 7f7557c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75501990c0 con 0x7f7550073790 2024-02-28T23:07:30.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.224+0000 7f7557c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7550199200 con 0x7f7550074d60 2024-02-28T23:07:30.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.224+0000 7f7555200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7550073790 0x7f7550198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:30.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.224+0000 7f754fe00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7550074d60 0x7f7550198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:30.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.224+0000 7f754fe00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7550074d60 0x7f7550198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:55668/0 (socket says 172.21.15.159:55668) 2024-02-28T23:07:30.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.224+0000 7f754fe00700 1 -- 172.21.15.159:0/3319502591 learned_addr learned my addr 172.21.15.159:0/3319502591 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:07:30.224 INFO:tasks.workunit.client.0.smithi159.stdout:6/752: write d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/f28 [3344073,95270] 0 2024-02-28T23:07:30.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.225+0000 7f754fe00700 1 -- 172.21.15.159:0/3319502591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7550073790 msgr2=0x7f7550198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:30.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.225+0000 7f754fe00700 1 --2- 172.21.15.159:0/3319502591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7550073790 0x7f7550198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:30.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.225+0000 7f754fe00700 1 -- 172.21.15.159:0/3319502591 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f753c0095f0 con 0x7f7550074d60 2024-02-28T23:07:30.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.225+0000 7f7555200700 1 --2- 172.21.15.159:0/3319502591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7550073790 0x7f7550198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T23:07:30.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.225+0000 7f754fe00700 1 --2- 172.21.15.159:0/3319502591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7550074d60 0x7f7550198aa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f753c005b40 tx=0x7f753c00bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:07:30.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.226+0000 7f754d600700 1 -- 172.21.15.159:0/3319502591 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f753c01d070 con 0x7f7550074d60 2024-02-28T23:07:30.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.226+0000 7f754d600700 1 -- 172.21.15.159:0/3319502591 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f753c00f460 con 0x7f7550074d60 2024-02-28T23:07:30.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.226+0000 7f754d600700 1 -- 172.21.15.159:0/3319502591 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f753c021620 con 0x7f7550074d60 2024-02-28T23:07:30.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.226+0000 7f7557c00700 1 -- 172.21.15.159:0/3319502591 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755019dc50 con 0x7f7550074d60 2024-02-28T23:07:30.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.226+0000 7f7557c00700 1 -- 172.21.15.159:0/3319502591 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f755019e140 con 0x7f7550074d60 2024-02-28T23:07:30.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.229+0000 7f7557c00700 1 -- 172.21.15.159:0/3319502591 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f755010b910 con 0x7f7550074d60 2024-02-28T23:07:30.227 INFO:tasks.workunit.client.0.smithi159.stdout:6/753: chown d0/d1b/d33/d3f/c4f 1672480524 1 2024-02-28T23:07:30.232 INFO:tasks.workunit.client.1.smithi184.stdout:2/385: readlink d10/d1f/d21/d5e/d15/l4a 0 2024-02-28T23:07:30.233 INFO:tasks.workunit.client.0.smithi159.stdout:4/852: fsync d9/d20/d87/d115/d1c/d23/f37 0 2024-02-28T23:07:30.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.231+0000 7f754d600700 1 -- 172.21.15.159:0/3319502591 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 25) v1 ==== 90929+0+0 (secure 0 0 0) 0x7f753c02b440 con 0x7f7550074d60 2024-02-28T23:07:30.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.235+0000 7f754d600700 1 --2- 172.21.15.159:0/3319502591 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f753806cf40 0x7f753806f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:30.234 INFO:tasks.workunit.client.1.smithi184.stdout:3/416: symlink d1/d4/l80 0 2024-02-28T23:07:30.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.235+0000 7f754d600700 1 -- 172.21.15.159:0/3319502591 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f753c08dc90 con 0x7f7550074d60 2024-02-28T23:07:30.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.236+0000 7f7555200700 1 --2- 172.21.15.159:0/3319502591 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f753806cf40 0x7f753806f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:30.235 INFO:tasks.workunit.client.0.smithi159.stdout:1/754: dwrite d6/d1d/d46/f5f [0,4194304] 0 2024-02-28T23:07:30.235 INFO:tasks.workunit.client.1.smithi184.stdout:2/386: write d10/d1f/d21/d5e/d15/f39 [1042428,14011] 0 2024-02-28T23:07:30.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.237+0000 7f7555200700 1 --2- 172.21.15.159:0/3319502591 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f753806cf40 0x7f753806f400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7544010420 tx=0x7f75440073d0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:07:30.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.241+0000 7f754d600700 1 -- 172.21.15.159:0/3319502591 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f753c05b430 con 0x7f7550074d60 2024-02-28T23:07:30.241 INFO:tasks.workunit.client.0.smithi159.stdout:6/754: dread d0/d6d/fa1 [0,4194304] 0 2024-02-28T23:07:30.241 INFO:tasks.workunit.client.1.smithi184.stdout:1/457: creat d20/d32/d3e/f9d x:0 0 0 2024-02-28T23:07:30.243 INFO:tasks.workunit.client.1.smithi184.stdout:5/389: truncate db/d12/d18/d2e/d3c/d5d/f3e 67166 0 2024-02-28T23:07:30.243 INFO:tasks.workunit.client.1.smithi184.stdout:1/458: dread - d20/d32/d3e/d61/d8b/f8f zero size 2024-02-28T23:07:30.244 INFO:tasks.workunit.client.0.smithi159.stdout:6/755: stat d0/d1b/dc5/le4 0 2024-02-28T23:07:30.244 INFO:tasks.workunit.client.1.smithi184.stdout:0/404: mknod d0/df/d13/d27/d31/c89 0 2024-02-28T23:07:30.254 INFO:tasks.workunit.client.0.smithi159.stdout:9/770: dread d4/d3d/d3e/d55/f43 [4194304,4194304] 0 2024-02-28T23:07:30.258 INFO:tasks.workunit.client.1.smithi184.stdout:3/417: dread d1/d4/d1c/f31 [0,4194304] 0 2024-02-28T23:07:30.258 INFO:tasks.workunit.client.1.smithi184.stdout:8/397: dread d1/da/d10/d17/d63/f68 [0,4194304] 0 2024-02-28T23:07:30.270 INFO:tasks.workunit.client.1.smithi184.stdout:3/418: dwrite d1/d4/d6/d1e/d72/f50 [0,4194304] 0 2024-02-28T23:07:30.287 INFO:tasks.workunit.client.0.smithi159.stdout:5/728: dwrite d8/d19/d23/f5c [0,4194304] 0 2024-02-28T23:07:30.288 INFO:tasks.workunit.client.1.smithi184.stdout:4/391: sync 2024-02-28T23:07:30.290 INFO:tasks.workunit.client.1.smithi184.stdout:4/392: write d1/d8/d35/f47 [1648198,80665] 0 2024-02-28T23:07:30.293 INFO:tasks.workunit.client.1.smithi184.stdout:4/393: write d1/d8/f5a [616317,7701] 0 2024-02-28T23:07:30.295 INFO:tasks.workunit.client.0.smithi159.stdout:1/755: rename d6/d12/d1a/d92/dc9/le6 to d6/d1d/d46/d88/dd3/d63/l100 0 2024-02-28T23:07:30.298 INFO:tasks.workunit.client.1.smithi184.stdout:7/371: creat d6/d9/da/dc/d49/f88 x:0 0 0 2024-02-28T23:07:30.302 INFO:tasks.workunit.client.1.smithi184.stdout:1/459: mknod d20/d32/d3e/d61/c9e 0 2024-02-28T23:07:30.304 INFO:tasks.workunit.client.1.smithi184.stdout:0/405: mkdir d0/d7c/d8a 0 2024-02-28T23:07:30.307 INFO:tasks.workunit.client.0.smithi159.stdout:1/756: rename d6/d12/d16/db6 to d6/d1d/d46/d88/db4/ddb/d101 0 2024-02-28T23:07:30.308 INFO:tasks.workunit.client.0.smithi159.stdout:4/853: dwrite d9/d20/d87/d115/d1c/d23/d2d/f83 [0,4194304] 0 2024-02-28T23:07:30.311 INFO:tasks.workunit.client.1.smithi184.stdout:8/398: fsync d1/da/dc/d18/f38 0 2024-02-28T23:07:30.318 INFO:tasks.workunit.client.1.smithi184.stdout:5/390: dwrite db/d12/d1c/d21/d2f/f71 [0,4194304] 0 2024-02-28T23:07:30.318 INFO:tasks.workunit.client.1.smithi184.stdout:6/332: symlink dc/de/d56/l6a 0 2024-02-28T23:07:30.319 INFO:tasks.workunit.client.0.smithi159.stdout:6/756: truncate d0/d1b/f29 1607873 0 2024-02-28T23:07:30.321 INFO:tasks.workunit.client.0.smithi159.stdout:1/757: fsync d6/d12/ff 0 2024-02-28T23:07:30.321 INFO:tasks.workunit.client.1.smithi184.stdout:6/333: fsync dc/de/f1e 0 2024-02-28T23:07:30.321 INFO:tasks.workunit.client.1.smithi184.stdout:5/391: dread - db/f7c zero size 2024-02-28T23:07:30.324 INFO:tasks.workunit.client.0.smithi159.stdout:5/729: dwrite d8/d16/f33 [0,4194304] 0 2024-02-28T23:07:30.325 INFO:tasks.workunit.client.1.smithi184.stdout:0/406: dwrite d0/fc [4194304,4194304] 0 2024-02-28T23:07:30.327 INFO:tasks.workunit.client.1.smithi184.stdout:4/394: symlink d1/dc/df/d38/l78 0 2024-02-28T23:07:30.336 INFO:tasks.workunit.client.1.smithi184.stdout:2/387: rename d10/d1f/l28 to d10/l81 0 2024-02-28T23:07:30.339 INFO:tasks.workunit.client.1.smithi184.stdout:8/399: dread d1/da/f5b [0,4194304] 0 2024-02-28T23:07:30.341 INFO:tasks.workunit.client.1.smithi184.stdout:6/334: unlink dc/de/d10/l1c 0 2024-02-28T23:07:30.342 INFO:tasks.workunit.client.1.smithi184.stdout:9/398: getdents d5/db/de/d10/d12/d2f/d3f 0 2024-02-28T23:07:30.342 INFO:tasks.workunit.client.1.smithi184.stdout:5/392: rename db/l70 to db/d12/d18/l7e 0 2024-02-28T23:07:30.346 INFO:tasks.workunit.client.1.smithi184.stdout:2/388: rename d10/d1f/d21/d5e/d15/d24/f22 to d10/d1f/d21/d5e/d15/d24/d5f/d63/f82 0 2024-02-28T23:07:30.346 INFO:tasks.workunit.client.1.smithi184.stdout:0/407: creat d0/df/d13/d27/f8b x:0 0 0 2024-02-28T23:07:30.347 INFO:tasks.workunit.client.1.smithi184.stdout:2/389: dread - d10/d55/f70 zero size 2024-02-28T23:07:30.349 INFO:tasks.workunit.client.1.smithi184.stdout:1/460: getdents d20/d46 0 2024-02-28T23:07:30.351 INFO:tasks.workunit.client.1.smithi184.stdout:0/408: write d0/df/d13/d27/f8b [729285,58522] 0 2024-02-28T23:07:30.353 INFO:tasks.workunit.client.1.smithi184.stdout:8/400: creat d1/f99 x:0 0 0 2024-02-28T23:07:30.354 INFO:tasks.workunit.client.1.smithi184.stdout:2/390: creat d10/d1f/d38/d54/f83 x:0 0 0 2024-02-28T23:07:30.355 INFO:tasks.workunit.client.1.smithi184.stdout:5/393: read db/d12/d18/d2e/d3c/d5d/f37 [533880,14277] 0 2024-02-28T23:07:30.359 INFO:tasks.workunit.client.1.smithi184.stdout:2/391: chown d10/f34 0 1 2024-02-28T23:07:30.360 INFO:tasks.workunit.client.1.smithi184.stdout:2/392: chown d10/d33 1655 1 2024-02-28T23:07:30.361 INFO:tasks.workunit.client.1.smithi184.stdout:5/394: write db/d12/f77 [1676652,91268] 0 2024-02-28T23:07:30.361 INFO:tasks.workunit.client.1.smithi184.stdout:1/461: truncate d20/f2d 237907 0 2024-02-28T23:07:30.362 INFO:tasks.workunit.client.1.smithi184.stdout:3/419: dread d1/d4/f57 [0,4194304] 0 2024-02-28T23:07:30.362 INFO:tasks.workunit.client.1.smithi184.stdout:0/409: rename d0/d1d/d3a/d84/f86 to d0/df/d13/d27/d31/d51/f8c 0 2024-02-28T23:07:30.362 INFO:tasks.workunit.client.1.smithi184.stdout:8/401: write d1/da/dc/d18/f38 [674895,11951] 0 2024-02-28T23:07:30.365 INFO:tasks.workunit.client.1.smithi184.stdout:2/393: write d10/d1f/f57 [453226,41461] 0 2024-02-28T23:07:30.366 INFO:tasks.workunit.client.1.smithi184.stdout:5/395: chown db/c11 0 1 2024-02-28T23:07:30.366 INFO:tasks.workunit.client.1.smithi184.stdout:1/462: mknod d20/d46/c9f 0 2024-02-28T23:07:30.368 INFO:tasks.workunit.client.1.smithi184.stdout:8/402: fsync d1/da/d33/f59 0 2024-02-28T23:07:30.368 INFO:tasks.workunit.client.1.smithi184.stdout:2/394: read d10/d1f/d38/d54/f59 [3381318,46812] 0 2024-02-28T23:07:30.370 INFO:tasks.workunit.client.1.smithi184.stdout:0/410: creat d0/df/d13/d27/d31/d51/f8d x:0 0 0 2024-02-28T23:07:30.372 INFO:tasks.workunit.client.1.smithi184.stdout:1/463: write d20/d32/d4d/f53 [685281,126243] 0 2024-02-28T23:07:30.372 INFO:tasks.workunit.client.1.smithi184.stdout:2/395: chown d10/d33/f7d 0 1 2024-02-28T23:07:30.374 INFO:tasks.workunit.client.1.smithi184.stdout:8/403: write d1/da/d10/d17/f47 [5144638,126819] 0 2024-02-28T23:07:30.374 INFO:tasks.workunit.client.1.smithi184.stdout:0/411: stat d0/df/d13/d27/d31/d51/f59 0 2024-02-28T23:07:30.377 INFO:tasks.workunit.client.1.smithi184.stdout:5/396: creat db/f7f x:0 0 0 2024-02-28T23:07:30.378 INFO:tasks.workunit.client.1.smithi184.stdout:1/464: dread - d20/d32/d4b/f99 zero size 2024-02-28T23:07:30.379 INFO:tasks.workunit.client.1.smithi184.stdout:2/396: fsync d10/d1f/d21/d5e/d15/d60/d66/f7c 0 2024-02-28T23:07:30.379 INFO:tasks.workunit.client.1.smithi184.stdout:6/335: truncate dc/de/f40 2037895 0 2024-02-28T23:07:30.384 INFO:tasks.workunit.client.1.smithi184.stdout:8/404: symlink d1/da/dc/d16/d29/l9a 0 2024-02-28T23:07:30.386 INFO:tasks.workunit.client.1.smithi184.stdout:1/465: mkdir d20/d46/d90/da0 0 2024-02-28T23:07:30.388 INFO:tasks.workunit.client.1.smithi184.stdout:5/397: mkdir db/d12/d1c/d80 0 2024-02-28T23:07:30.388 INFO:tasks.workunit.client.1.smithi184.stdout:3/420: dwrite d1/d4/d6/d1e/d72/f50 [4194304,4194304] 0 2024-02-28T23:07:30.389 INFO:tasks.workunit.client.1.smithi184.stdout:0/412: mkdir d0/df/d13/d27/d31/d5b/d8e 0 2024-02-28T23:07:30.392 INFO:tasks.workunit.client.1.smithi184.stdout:8/405: creat d1/da/dc/d16/d32/d42/f9b x:0 0 0 2024-02-28T23:07:30.395 INFO:tasks.workunit.client.1.smithi184.stdout:9/399: dwrite d5/f13 [0,4194304] 0 2024-02-28T23:07:30.396 INFO:tasks.workunit.client.1.smithi184.stdout:1/466: creat d20/d32/d4b/fa1 x:0 0 0 2024-02-28T23:07:30.400 INFO:tasks.workunit.client.1.smithi184.stdout:3/421: creat d1/d4/d6/f81 x:0 0 0 2024-02-28T23:07:30.400 INFO:tasks.workunit.client.1.smithi184.stdout:9/400: fsync d5/d17/f28 0 2024-02-28T23:07:30.400 INFO:tasks.workunit.client.1.smithi184.stdout:5/398: symlink db/d12/d18/d2e/d3c/l81 0 2024-02-28T23:07:30.407 INFO:tasks.workunit.client.1.smithi184.stdout:1/467: write d20/d32/d3e/f63 [224830,23558] 0 2024-02-28T23:07:30.411 INFO:tasks.workunit.client.1.smithi184.stdout:0/413: write d0/df/d13/d27/d31/d51/f8c [392247,85959] 0 2024-02-28T23:07:30.413 INFO:tasks.workunit.client.1.smithi184.stdout:6/336: dread f8 [4194304,4194304] 0 2024-02-28T23:07:30.414 INFO:tasks.workunit.client.1.smithi184.stdout:2/397: dwrite d10/f16 [4194304,4194304] 0 2024-02-28T23:07:30.414 INFO:tasks.workunit.client.1.smithi184.stdout:9/401: fsync d5/db/de/d10/d12/d2f/f51 0 2024-02-28T23:07:30.415 INFO:tasks.workunit.client.1.smithi184.stdout:8/406: link d1/da/dc/d18/f19 d1/da/d10/d17/f9c 0 2024-02-28T23:07:30.415 INFO:tasks.workunit.client.1.smithi184.stdout:3/422: write d1/d4/d6/d1f/d26/d3a/d59/d6a/f77 [114603,113099] 0 2024-02-28T23:07:30.418 INFO:tasks.workunit.client.1.smithi184.stdout:1/468: truncate d20/d32/d3e/f9d 987208 0 2024-02-28T23:07:30.419 INFO:tasks.workunit.client.1.smithi184.stdout:9/402: rmdir d5 39 2024-02-28T23:07:30.424 INFO:tasks.workunit.client.1.smithi184.stdout:1/469: chown d20/d46/d90/f55 0 1 2024-02-28T23:07:30.426 INFO:tasks.workunit.client.1.smithi184.stdout:0/414: rename d0/fe to d0/df/d13/d27/d31/f8f 0 2024-02-28T23:07:30.430 INFO:tasks.workunit.client.1.smithi184.stdout:3/423: mkdir d1/d4/d6/d1f/d26/d3a/d59/d82 0 2024-02-28T23:07:30.432 INFO:tasks.workunit.client.1.smithi184.stdout:3/424: chown d1/d4/d5/d40/l4b 26595529 1 2024-02-28T23:07:30.434 INFO:tasks.workunit.client.1.smithi184.stdout:1/470: mkdir d20/d32/d3e/da2 0 2024-02-28T23:07:30.435 INFO:tasks.workunit.client.1.smithi184.stdout:9/403: creat d5/d47/d68/d7c/f8b x:0 0 0 2024-02-28T23:07:30.439 INFO:tasks.workunit.client.1.smithi184.stdout:7/372: sync 2024-02-28T23:07:30.439 INFO:tasks.workunit.client.1.smithi184.stdout:8/407: dread d1/da/d10/d17/d63/f69 [0,4194304] 0 2024-02-28T23:07:30.439 INFO:tasks.workunit.client.1.smithi184.stdout:5/399: truncate db/d12/d1c/f2b 89744 0 2024-02-28T23:07:30.440 INFO:tasks.workunit.client.1.smithi184.stdout:0/415: dread d0/df/d13/d27/f8b [0,4194304] 0 2024-02-28T23:07:30.446 INFO:tasks.workunit.client.1.smithi184.stdout:7/373: truncate d6/d9/d13/d14/d45/f84 63757 0 2024-02-28T23:07:30.446 INFO:tasks.workunit.client.1.smithi184.stdout:8/408: symlink d1/da/l9d 0 2024-02-28T23:07:30.447 INFO:tasks.workunit.client.1.smithi184.stdout:3/425: fsync d1/d4/d6/d1f/d26/d3a/d59/d6a/f77 0 2024-02-28T23:07:30.448 INFO:tasks.workunit.client.1.smithi184.stdout:2/398: truncate d10/d1f/d21/d5e/d15/d24/d5f/d63/f82 7206621 0 2024-02-28T23:07:30.449 INFO:tasks.workunit.client.1.smithi184.stdout:0/416: mknod d0/df/d13/d27/d31/c90 0 2024-02-28T23:07:30.455 INFO:tasks.workunit.client.1.smithi184.stdout:6/337: dwrite dc/de/d10/f4c [0,4194304] 0 2024-02-28T23:07:30.455 INFO:tasks.workunit.client.1.smithi184.stdout:2/399: chown d10/d1f/d21/d5e/l17 46674 1 2024-02-28T23:07:30.458 INFO:tasks.workunit.client.1.smithi184.stdout:8/409: creat d1/da/dc/d16/d32/d80/f9e x:0 0 0 2024-02-28T23:07:30.461 INFO:tasks.workunit.client.1.smithi184.stdout:7/374: write d6/d9/d13/d1e/d2f/f62 [812054,49020] 0 2024-02-28T23:07:30.461 INFO:tasks.workunit.client.1.smithi184.stdout:6/338: creat dc/d53/f6b x:0 0 0 2024-02-28T23:07:30.461 INFO:tasks.workunit.client.1.smithi184.stdout:2/400: unlink d10/d1f/d21/d5e/l46 0 2024-02-28T23:07:30.461 INFO:tasks.workunit.client.1.smithi184.stdout:5/400: write db/d12/d18/d2e/d3c/d5d/f3e [1044898,56744] 0 2024-02-28T23:07:30.466 INFO:tasks.workunit.client.1.smithi184.stdout:0/417: rmdir d0/d1d/d3a/d84 0 2024-02-28T23:07:30.467 INFO:tasks.workunit.client.1.smithi184.stdout:2/401: write d10/f51 [882263,76515] 0 2024-02-28T23:07:30.469 INFO:tasks.workunit.client.1.smithi184.stdout:1/471: dwrite d20/f2d [0,4194304] 0 2024-02-28T23:07:30.469 INFO:tasks.workunit.client.1.smithi184.stdout:8/410: chown d1/da/dc/d16/d32/d42 129668619 1 2024-02-28T23:07:30.472 INFO:tasks.workunit.client.1.smithi184.stdout:1/472: chown d20/d32/d3e/d61/d8b/c8d 483375352 1 2024-02-28T23:07:30.473 INFO:tasks.workunit.client.1.smithi184.stdout:6/339: rmdir dc/de/d56 39 2024-02-28T23:07:30.475 INFO:tasks.workunit.client.1.smithi184.stdout:6/340: readlink dc/de/d2a/l2c 0 2024-02-28T23:07:30.476 INFO:tasks.workunit.client.1.smithi184.stdout:8/411: creat d1/da/dc/d16/d32/f9f x:0 0 0 2024-02-28T23:07:30.476 INFO:tasks.workunit.client.1.smithi184.stdout:5/401: creat db/d44/f82 x:0 0 0 2024-02-28T23:07:30.481 INFO:tasks.workunit.client.1.smithi184.stdout:1/473: creat d20/d32/d3e/d82/d85/fa3 x:0 0 0 2024-02-28T23:07:30.481 INFO:tasks.workunit.client.0.smithi159.stdout:9/771: link d4/d3d/d3e/d6e/lb1 d4/d3d/d3e/d55/d9e/db3/lf1 0 2024-02-28T23:07:30.482 INFO:tasks.workunit.client.1.smithi184.stdout:6/341: mknod dc/d42/c6c 0 2024-02-28T23:07:30.483 INFO:tasks.workunit.client.1.smithi184.stdout:1/474: chown d20/d32/d3e/l87 442767 1 2024-02-28T23:07:30.483 INFO:tasks.workunit.client.1.smithi184.stdout:6/342: chown dc/f48 3 1 2024-02-28T23:07:30.485 INFO:tasks.workunit.client.1.smithi184.stdout:7/375: creat d6/d9/d13/d1e/d2f/f89 x:0 0 0 2024-02-28T23:07:30.488 INFO:tasks.workunit.client.1.smithi184.stdout:0/418: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:30.495 INFO:tasks.workunit.client.1.smithi184.stdout:8/412: link d1/da/dc/d16/d32/d80/f9e d1/da/dc/d16/d29/fa0 0 2024-02-28T23:07:30.495 INFO:tasks.workunit.client.0.smithi159.stdout:5/730: write d8/d19/d23/d35/d65/da3/df4/da5/ddc/ff6 [293549,129733] 0 2024-02-28T23:07:30.497 INFO:tasks.workunit.client.1.smithi184.stdout:7/376: rename d6/d9/d13/d1e/d2f/f62 to d6/d9/d13/d3e/d7e/f8a 0 2024-02-28T23:07:30.499 INFO:tasks.workunit.client.0.smithi159.stdout:1/758: link d6/d12/d1a/f2b d6/d12/d33/da7/f102 0 2024-02-28T23:07:30.499 INFO:tasks.workunit.client.1.smithi184.stdout:2/402: dread fb [0,4194304] 0 2024-02-28T23:07:30.500 INFO:tasks.workunit.client.0.smithi159.stdout:6/757: dwrite d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/fb9 [0,4194304] 0 2024-02-28T23:07:30.501 INFO:tasks.workunit.client.1.smithi184.stdout:2/403: chown d10/d55/c73 7372 1 2024-02-28T23:07:30.503 INFO:tasks.workunit.client.1.smithi184.stdout:6/343: mkdir dc/d60/d6d 0 2024-02-28T23:07:30.504 INFO:tasks.workunit.client.0.smithi159.stdout:9/772: dwrite d4/f25 [0,4194304] 0 2024-02-28T23:07:30.508 INFO:tasks.workunit.client.1.smithi184.stdout:1/475: dread f15 [0,4194304] 0 2024-02-28T23:07:30.510 INFO:tasks.workunit.client.1.smithi184.stdout:1/476: write d20/d32/d4b/fa1 [52105,106239] 0 2024-02-28T23:07:30.511 INFO:tasks.workunit.client.0.smithi159.stdout:9/773: stat d4/d3d/d3e/lbb 0 2024-02-28T23:07:30.525 INFO:tasks.workunit.client.0.smithi159.stdout:5/731: creat d8/d19/d23/d35/d38/ffe x:0 0 0 2024-02-28T23:07:30.526 INFO:tasks.workunit.client.1.smithi184.stdout:0/419: rename d0/d47 to d0/df/d13/d27/d31/d5b/d8e/d91 0 2024-02-28T23:07:30.526 INFO:tasks.workunit.client.1.smithi184.stdout:7/377: symlink d6/d9/d13/d1e/d2f/d33/l8b 0 2024-02-28T23:07:30.532 INFO:tasks.workunit.client.0.smithi159.stdout:5/732: chown d8/d19/d23/d35/d65/da3/df4/lb3 645 1 2024-02-28T23:07:30.535 INFO:tasks.workunit.client.1.smithi184.stdout:6/344: unlink dc/de/d2a/f2b 0 2024-02-28T23:07:30.537 INFO:tasks.workunit.client.0.smithi159.stdout:4/854: dread d9/d20/f22 [0,4194304] 0 2024-02-28T23:07:30.537 INFO:tasks.workunit.client.0.smithi159.stdout:1/759: link d6/d12/d16/fe0 d6/d12/d33/d3c/f103 0 2024-02-28T23:07:30.540 INFO:tasks.workunit.client.0.smithi159.stdout:1/760: chown d6/d1d/d46/d88/dd3/d9c/db3/dc4/ddc 99 1 2024-02-28T23:07:30.555 INFO:tasks.workunit.client.1.smithi184.stdout:4/395: sync 2024-02-28T23:07:30.638 INFO:tasks.workunit.client.1.smithi184.stdout:7/378: sync 2024-02-28T23:07:30.638 INFO:tasks.workunit.client.1.smithi184.stdout:9/404: sync 2024-02-28T23:07:30.638 INFO:tasks.workunit.client.1.smithi184.stdout:3/426: sync 2024-02-28T23:07:30.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.645+0000 7f7557c00700 1 -- 172.21.15.159:0/3319502591 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f755019e7a0 con 0x7f7550074d60 2024-02-28T23:07:30.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.646+0000 7f754d600700 1 -- 172.21.15.159:0/3319502591 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+766 (secure 0 0 0) 0x7f753c05afc0 con 0x7f7550074d60 2024-02-28T23:07:30.645 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:07:30.645 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:07:30.645 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:07:30.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:07:30.645 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:07:30.645 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-02-28T23:07:30.645 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:07:30.645 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:07:30.646 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:07:30.646 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:07:30.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:07:30.646 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:07:30.646 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:07:30.646 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:07:30.646 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:07:30.646 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 13, 2024-02-28T23:07:30.646 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:07:30.646 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:07:30.646 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:07:30.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.649+0000 7f7557c00700 1 -- 172.21.15.159:0/3319502591 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f753806cf40 msgr2=0x7f753806f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:30.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.649+0000 7f7557c00700 1 --2- 172.21.15.159:0/3319502591 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f753806cf40 0x7f753806f400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7544010420 tx=0x7f75440073d0 comp rx=0 tx=0).stop 2024-02-28T23:07:30.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.649+0000 7f7557c00700 1 -- 172.21.15.159:0/3319502591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7550074d60 msgr2=0x7f7550198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:30.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.649+0000 7f7557c00700 1 --2- 172.21.15.159:0/3319502591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7550074d60 0x7f7550198aa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f753c005b40 tx=0x7f753c00bd70 comp rx=0 tx=0).stop 2024-02-28T23:07:30.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.649+0000 7f7557c00700 1 -- 172.21.15.159:0/3319502591 shutdown_connections 2024-02-28T23:07:30.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.649+0000 7f7557c00700 1 --2- 172.21.15.159:0/3319502591 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f753806cf40 0x7f753806f400 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:30.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.649+0000 7f7557c00700 1 --2- 172.21.15.159:0/3319502591 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7550073790 0x7f7550198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:30.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.649+0000 7f7557c00700 1 --2- 172.21.15.159:0/3319502591 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7550074d60 0x7f7550198aa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:30.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.649+0000 7f7557c00700 1 -- 172.21.15.159:0/3319502591 >> 172.21.15.159:0/3319502591 conn(0x7f75500fc140 msgr2=0x7f7550106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:07:30.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.649+0000 7f7557c00700 1 -- 172.21.15.159:0/3319502591 shutdown_connections 2024-02-28T23:07:30.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.649+0000 7f7557c00700 1 -- 172.21.15.159:0/3319502591 wait complete. 2024-02-28T23:07:30.657 INFO:tasks.workunit.client.1.smithi184.stdout:5/402: getdents db/d12/d18/d2e/d3c/d5d 0 2024-02-28T23:07:30.658 INFO:tasks.workunit.client.0.smithi159.stdout:5/733: dread - d8/d19/d23/d35/d41/d92/dc8/ff1 zero size 2024-02-28T23:07:30.658 INFO:tasks.workunit.client.1.smithi184.stdout:8/413: write d1/da/dc/f73 [36114,90736] 0 2024-02-28T23:07:30.661 INFO:tasks.workunit.client.1.smithi184.stdout:1/477: write d20/f25 [1441573,112481] 0 2024-02-28T23:07:30.666 INFO:tasks.workunit.client.1.smithi184.stdout:5/403: read db/d12/d18/d2e/d3c/d5d/f37 [718003,88336] 0 2024-02-28T23:07:30.668 INFO:tasks.workunit.client.1.smithi184.stdout:0/420: mkdir d0/df/d13/d27/d31/d5b/d8e/d92 0 2024-02-28T23:07:30.669 INFO:tasks.workunit.client.1.smithi184.stdout:6/345: mkdir dc/de/d2a/d5c/d6e 0 2024-02-28T23:07:30.670 INFO:tasks.workunit.client.0.smithi159.stdout:5/734: mkdir d8/d19/d23/d35/d41/daa/df5/dff 0 2024-02-28T23:07:30.671 INFO:tasks.workunit.client.1.smithi184.stdout:0/421: chown d0/d1f/f28 24685721 1 2024-02-28T23:07:30.673 INFO:tasks.workunit.client.0.smithi159.stdout:6/758: dwrite d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/fa3 [4194304,4194304] 0 2024-02-28T23:07:30.674 INFO:tasks.workunit.client.1.smithi184.stdout:9/405: fdatasync d5/d17/f3d 0 2024-02-28T23:07:30.676 INFO:tasks.workunit.client.0.smithi159.stdout:4/855: write d9/d4c/d6c/d98/fb6 [1799513,52578] 0 2024-02-28T23:07:30.677 INFO:tasks.workunit.client.1.smithi184.stdout:3/427: mkdir d1/d4/d6/d83 0 2024-02-28T23:07:30.679 INFO:tasks.workunit.client.1.smithi184.stdout:7/379: creat d6/d9/d13/d14/d45/f8c x:0 0 0 2024-02-28T23:07:30.680 INFO:tasks.workunit.client.0.smithi159.stdout:1/761: write d6/d12/f9a [52040,97977] 0 2024-02-28T23:07:30.681 INFO:tasks.workunit.client.0.smithi159.stdout:1/762: fsync d6/d1d/d46/f5f 0 2024-02-28T23:07:30.682 INFO:tasks.workunit.client.1.smithi184.stdout:9/406: dread - d5/db/de/f74 zero size 2024-02-28T23:07:30.682 INFO:tasks.workunit.client.0.smithi159.stdout:5/735: mkdir d8/d19/d23/d35/d100 0 2024-02-28T23:07:30.683 INFO:tasks.workunit.client.1.smithi184.stdout:8/414: mkdir d1/da/d10/d43/da1 0 2024-02-28T23:07:30.684 INFO:tasks.workunit.client.0.smithi159.stdout:4/856: creat d9/d20/d87/d115/d1c/dc3/f12d x:0 0 0 2024-02-28T23:07:30.684 INFO:tasks.workunit.client.1.smithi184.stdout:2/404: dwrite d10/d1f/d38/d54/f59 [4194304,4194304] 0 2024-02-28T23:07:30.685 INFO:tasks.workunit.client.1.smithi184.stdout:4/396: getdents d1/d8/d3d/d44/d77 0 2024-02-28T23:07:30.687 INFO:tasks.workunit.client.0.smithi159.stdout:6/759: creat d0/d1b/d33/d11/d34/d9d/da2/dbf/ff3 x:0 0 0 2024-02-28T23:07:30.689 INFO:tasks.workunit.client.1.smithi184.stdout:1/478: write d20/f47 [424054,38075] 0 2024-02-28T23:07:30.690 INFO:tasks.workunit.client.0.smithi159.stdout:1/763: symlink d6/d1d/d1f/db8/dcc/l104 0 2024-02-28T23:07:30.691 INFO:tasks.workunit.client.1.smithi184.stdout:4/397: fdatasync d1/d4/f1f 0 2024-02-28T23:07:30.693 INFO:tasks.workunit.client.1.smithi184.stdout:4/398: readlink d1/l2d 0 2024-02-28T23:07:30.695 INFO:tasks.workunit.client.1.smithi184.stdout:6/346: mkdir dc/d60/d62/d6f 0 2024-02-28T23:07:30.696 INFO:tasks.workunit.client.1.smithi184.stdout:7/380: mkdir d6/d9/da/dc/d7d/d8d 0 2024-02-28T23:07:30.697 INFO:tasks.workunit.client.0.smithi159.stdout:6/760: creat d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/ff4 x:0 0 0 2024-02-28T23:07:30.697 INFO:tasks.workunit.client.0.smithi159.stdout:5/736: dread d8/d19/d23/f5c [0,4194304] 0 2024-02-28T23:07:30.698 INFO:tasks.workunit.client.1.smithi184.stdout:7/381: readlink d6/d9/d13/d3e/l6e 0 2024-02-28T23:07:30.699 INFO:tasks.workunit.client.0.smithi159.stdout:6/761: readlink d0/d1b/d33/d11/l40 0 2024-02-28T23:07:30.700 INFO:tasks.workunit.client.1.smithi184.stdout:0/422: dread d0/df/d13/d27/d2b/f44 [0,4194304] 0 2024-02-28T23:07:30.700 INFO:tasks.workunit.client.0.smithi159.stdout:1/764: rename d6/d12/d16/de9 to d6/d1d/d46/df9/d105 0 2024-02-28T23:07:30.700 INFO:tasks.workunit.client.1.smithi184.stdout:7/382: chown d6/d9/d13/d1e/f21 3186620 1 2024-02-28T23:07:30.701 INFO:tasks.workunit.client.1.smithi184.stdout:0/423: read - d0/df/f61 zero size 2024-02-28T23:07:30.701 INFO:tasks.workunit.client.0.smithi159.stdout:1/765: chown d6/d1d/l30 15444298 1 2024-02-28T23:07:30.703 INFO:tasks.workunit.client.0.smithi159.stdout:1/766: read - d6/d12/d16/fe0 zero size 2024-02-28T23:07:30.704 INFO:tasks.workunit.client.1.smithi184.stdout:8/415: symlink d1/da/dc/d16/d4d/d82/la2 0 2024-02-28T23:07:30.706 INFO:tasks.workunit.client.1.smithi184.stdout:2/405: unlink d10/d1f/d21/d5e/d15/d24/l5a 0 2024-02-28T23:07:30.706 INFO:tasks.workunit.client.0.smithi159.stdout:5/737: dread - d8/d19/d23/d35/d41/daa/fd8 zero size 2024-02-28T23:07:30.708 INFO:tasks.workunit.client.1.smithi184.stdout:9/407: mknod d5/d47/d68/d7c/c8c 0 2024-02-28T23:07:30.710 INFO:tasks.workunit.client.0.smithi159.stdout:6/762: creat d0/d1b/d33/d11/d34/d9d/da2/d96/ff5 x:0 0 0 2024-02-28T23:07:30.712 INFO:tasks.workunit.client.1.smithi184.stdout:3/428: rename d1/d4/d6/d1e/c4a to d1/d4/d6/d83/c84 0 2024-02-28T23:07:30.712 INFO:tasks.workunit.client.1.smithi184.stdout:3/429: dread - d1/d4/f7c zero size 2024-02-28T23:07:30.713 INFO:tasks.workunit.client.0.smithi159.stdout:6/763: dread - d0/d1b/d33/d11/d34/d9d/da2/fd3 zero size 2024-02-28T23:07:30.716 INFO:tasks.workunit.client.0.smithi159.stdout:6/764: stat d0/d1b/d33/d11/d34/d9d/da2/db7/db1/le7 0 2024-02-28T23:07:30.716 INFO:tasks.workunit.client.0.smithi159.stdout:1/767: unlink d6/d12/d33/d3c/f41 0 2024-02-28T23:07:30.717 INFO:tasks.workunit.client.1.smithi184.stdout:6/347: mknod dc/d60/d62/c70 0 2024-02-28T23:07:30.718 INFO:tasks.workunit.client.0.smithi159.stdout:1/768: dread - d6/d1d/d46/d88/fef zero size 2024-02-28T23:07:30.720 INFO:tasks.workunit.client.1.smithi184.stdout:0/424: mkdir d0/d1d/d4c/d93 0 2024-02-28T23:07:30.721 INFO:tasks.workunit.client.1.smithi184.stdout:8/416: mknod d1/da/dc/d16/d32/d42/ca3 0 2024-02-28T23:07:30.721 INFO:tasks.workunit.client.0.smithi159.stdout:5/738: creat d8/d19/d23/d35/d41/daa/d88/f101 x:0 0 0 2024-02-28T23:07:30.725 INFO:tasks.workunit.client.1.smithi184.stdout:9/408: dwrite d5/d26/d50/f3b [0,4194304] 0 2024-02-28T23:07:30.727 INFO:tasks.workunit.client.0.smithi159.stdout:4/857: dread d9/f1b [0,4194304] 0 2024-02-28T23:07:30.727 INFO:tasks.workunit.client.1.smithi184.stdout:1/479: creat d20/d32/d3e/d91/fa4 x:0 0 0 2024-02-28T23:07:30.729 INFO:tasks.workunit.client.0.smithi159.stdout:6/765: mknod d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88/cf6 0 2024-02-28T23:07:30.729 INFO:tasks.workunit.client.1.smithi184.stdout:8/417: dread d1/da/dc/d18/f64 [0,4194304] 0 2024-02-28T23:07:30.729 INFO:tasks.workunit.client.1.smithi184.stdout:5/404: sync 2024-02-28T23:07:30.730 INFO:tasks.workunit.client.1.smithi184.stdout:8/418: chown d1/da/dc/d16/f25 1348 1 2024-02-28T23:07:30.732 INFO:tasks.workunit.client.1.smithi184.stdout:8/419: write d1/da/df/f1f [3280328,6391] 0 2024-02-28T23:07:30.733 INFO:tasks.workunit.client.0.smithi159.stdout:5/739: truncate d8/d19/d23/d35/d65/da3/df4/da5/d90/f9d 31486 0 2024-02-28T23:07:30.736 INFO:tasks.workunit.client.0.smithi159.stdout:4/858: unlink d9/d4c/f58 0 2024-02-28T23:07:30.737 INFO:tasks.workunit.client.0.smithi159.stdout:6/766: symlink d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/lf7 0 2024-02-28T23:07:30.745 INFO:tasks.workunit.client.0.smithi159.stdout:4/859: read - d9/d20/d87/d115/d1c/d8e/f109 zero size 2024-02-28T23:07:30.747 INFO:tasks.workunit.client.0.smithi159.stdout:4/860: dread - d9/d42/d54/d9c/dd7/f11c zero size 2024-02-28T23:07:30.749 INFO:tasks.workunit.client.0.smithi159.stdout:6/767: mknod d0/d1b/d33/d11/d34/d9d/da2/d96/cf8 0 2024-02-28T23:07:30.753 INFO:tasks.workunit.client.0.smithi159.stdout:5/740: creat d8/d19/d23/d2a/f102 x:0 0 0 2024-02-28T23:07:30.753 INFO:tasks.workunit.client.0.smithi159.stdout:4/861: mknod d9/d4c/d6c/d98/df2/c12e 0 2024-02-28T23:07:30.757 INFO:tasks.workunit.client.0.smithi159.stdout:1/769: dwrite d6/d1d/d46/f82 [0,4194304] 0 2024-02-28T23:07:30.762 INFO:tasks.workunit.client.0.smithi159.stdout:5/741: dread d8/d16/f1e [0,4194304] 0 2024-02-28T23:07:30.777 INFO:tasks.workunit.client.0.smithi159.stdout:1/770: rename d6/d12/d16/f42 to d6/d12/d1a/d92/f106 0 2024-02-28T23:07:30.778 INFO:tasks.workunit.client.0.smithi159.stdout:6/768: write d0/d1b/f8a [714710,62314] 0 2024-02-28T23:07:30.779 INFO:tasks.workunit.client.0.smithi159.stdout:5/742: link d8/d19/d23/d35/cb0 d8/db4/c103 0 2024-02-28T23:07:30.785 INFO:tasks.workunit.client.0.smithi159.stdout:4/862: write d9/d20/d87/d115/d1c/d23/d2d/f41 [4808793,64000] 0 2024-02-28T23:07:30.786 INFO:tasks.workunit.client.0.smithi159.stdout:6/769: dread d0/d1b/d5b/fba [0,4194304] 0 2024-02-28T23:07:30.788 INFO:tasks.workunit.client.1.smithi184.stdout:6/348: rmdir dc/d60 39 2024-02-28T23:07:30.789 INFO:tasks.workunit.client.0.smithi159.stdout:5/743: creat d8/d19/d23/d35/d65/f104 x:0 0 0 2024-02-28T23:07:30.791 INFO:tasks.workunit.client.1.smithi184.stdout:0/425: symlink d0/d1d/l94 0 2024-02-28T23:07:30.795 INFO:tasks.workunit.client.1.smithi184.stdout:9/409: mkdir d5/db/de/d10/d12/d2f/d3f/d8d 0 2024-02-28T23:07:30.798 INFO:tasks.workunit.client.0.smithi159.stdout:4/863: dread d9/d20/d87/d115/dc5/ff9 [0,4194304] 0 2024-02-28T23:07:30.799 INFO:tasks.workunit.client.0.smithi159.stdout:1/771: dwrite d6/d1d/d46/d88/dd3/d9c/db3/dc4/fe8 [0,4194304] 0 2024-02-28T23:07:30.800 INFO:tasks.workunit.client.0.smithi159.stdout:4/864: fsync d9/d42/d54/d55/f128 0 2024-02-28T23:07:30.803 INFO:tasks.workunit.client.0.smithi159.stdout:4/865: dread - d9/d20/fbf zero size 2024-02-28T23:07:30.804 INFO:tasks.workunit.client.1.smithi184.stdout:6/349: dwrite dc/de/d10/f3d [0,4194304] 0 2024-02-28T23:07:30.808 INFO:tasks.workunit.client.0.smithi159.stdout:6/770: link d0/d6d/f6e d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dac/dd9/ff9 0 2024-02-28T23:07:30.811 INFO:tasks.workunit.client.0.smithi159.stdout:5/744: dwrite d8/d16/fab [4194304,4194304] 0 2024-02-28T23:07:30.811 INFO:tasks.workunit.client.1.smithi184.stdout:8/420: rename d1/da/f3a to d1/da/d10/d17/d63/fa4 0 2024-02-28T23:07:30.813 INFO:tasks.workunit.client.1.smithi184.stdout:8/421: chown d1/da/dc/d16/d32 1049029728 1 2024-02-28T23:07:30.816 INFO:tasks.workunit.client.1.smithi184.stdout:7/383: rename d6/f8 to d6/f8e 0 2024-02-28T23:07:30.817 INFO:tasks.workunit.client.1.smithi184.stdout:4/399: truncate d1/d8/f4a 107188 0 2024-02-28T23:07:30.818 INFO:tasks.workunit.client.1.smithi184.stdout:3/430: write d1/d4/d1c/f31 [3428836,49159] 0 2024-02-28T23:07:30.821 INFO:tasks.workunit.client.0.smithi159.stdout:4/866: creat d9/d20/d87/d115/d1c/d23/d2d/d59/f12f x:0 0 0 2024-02-28T23:07:30.826 INFO:tasks.workunit.client.1.smithi184.stdout:2/406: truncate d10/f11 520159 0 2024-02-28T23:07:30.834 INFO:tasks.workunit.client.1.smithi184.stdout:4/400: dwrite d1/dc/df/f5f [0,4194304] 0 2024-02-28T23:07:30.836 INFO:tasks.workunit.client.1.smithi184.stdout:5/405: rmdir db/d12/d1c/d21/d25 39 2024-02-28T23:07:30.839 INFO:tasks.workunit.client.0.smithi159.stdout:1/772: link l5 d6/d1d/d46/d88/dd3/d9c/db3/l107 0 2024-02-28T23:07:30.841 INFO:tasks.workunit.client.0.smithi159.stdout:0/888: sync 2024-02-28T23:07:30.842 INFO:tasks.workunit.client.0.smithi159.stdout:1/773: write d6/d12/d31/d69/f77 [2462588,77840] 0 2024-02-28T23:07:30.847 INFO:tasks.workunit.client.0.smithi159.stdout:6/771: dread d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/f9b [0,4194304] 0 2024-02-28T23:07:30.848 INFO:tasks.workunit.client.1.smithi184.stdout:8/422: creat d1/da/dc/d16/d32/fa5 x:0 0 0 2024-02-28T23:07:30.848 INFO:tasks.workunit.client.1.smithi184.stdout:4/401: fsync d1/dc/df/d38/d57/f71 0 2024-02-28T23:07:30.848 INFO:tasks.workunit.client.1.smithi184.stdout:7/384: symlink d6/d9/da/dc/d7d/l8f 0 2024-02-28T23:07:30.848 INFO:tasks.workunit.client.1.smithi184.stdout:1/480: link d20/d46/l4c d20/d32/d3e/d9a/la5 0 2024-02-28T23:07:30.849 INFO:tasks.workunit.client.1.smithi184.stdout:0/426: dwrite d0/df/d13/d27/d31/f8f [0,4194304] 0 2024-02-28T23:07:30.849 INFO:tasks.workunit.client.0.smithi159.stdout:4/867: rename d9/d42/cb9 to d9/d4c/d6c/c130 0 2024-02-28T23:07:30.852 INFO:tasks.workunit.client.0.smithi159.stdout:6/772: write d0/d1b/d33/d11/d34/d9d/fee [401208,111574] 0 2024-02-28T23:07:30.855 INFO:tasks.workunit.client.1.smithi184.stdout:6/350: dwrite dc/de/d10/f43 [0,4194304] 0 2024-02-28T23:07:30.856 INFO:tasks.workunit.client.1.smithi184.stdout:9/410: symlink d5/db/de/d10/d12/d2f/d7d/l8e 0 2024-02-28T23:07:30.857 INFO:tasks.workunit.client.1.smithi184.stdout:6/351: chown dc/l4e 594280853 1 2024-02-28T23:07:30.857 INFO:tasks.workunit.client.1.smithi184.stdout:5/406: creat db/d12/d18/d2e/d3c/f83 x:0 0 0 2024-02-28T23:07:30.860 INFO:tasks.workunit.client.1.smithi184.stdout:5/407: write db/f7f [542407,57516] 0 2024-02-28T23:07:30.865 INFO:tasks.workunit.client.1.smithi184.stdout:2/407: link d10/d1f/d38/d54/f83 d10/d1f/d21/d6a/f84 0 2024-02-28T23:07:30.868 INFO:tasks.workunit.client.0.smithi159.stdout:1/774: dwrite d6/d12/d33/da7/ff7 [0,4194304] 0 2024-02-28T23:07:30.868 INFO:tasks.workunit.client.0.smithi159.stdout:6/773: symlink d0/lfa 0 2024-02-28T23:07:30.868 INFO:tasks.workunit.client.1.smithi184.stdout:0/427: dwrite d0/df/d13/d27/d31/f8f [4194304,4194304] 0 2024-02-28T23:07:30.875 INFO:tasks.workunit.client.1.smithi184.stdout:8/423: fsync d1/da/f2c 0 2024-02-28T23:07:30.877 INFO:tasks.workunit.client.1.smithi184.stdout:8/424: write d1/f86 [290728,119218] 0 2024-02-28T23:07:30.879 INFO:tasks.workunit.client.1.smithi184.stdout:3/431: link d1/d4/d6/d1e/l44 d1/d4/d6/d1f/d26/d3a/d59/d82/l85 0 2024-02-28T23:07:30.880 INFO:tasks.workunit.client.1.smithi184.stdout:6/352: read - dc/de/f5a zero size 2024-02-28T23:07:30.880 INFO:tasks.workunit.client.1.smithi184.stdout:3/432: readlink d1/d4/d5/l2f 0 2024-02-28T23:07:30.881 INFO:tasks.workunit.client.1.smithi184.stdout:8/425: readlink d1/da/dc/d18/l5f 0 2024-02-28T23:07:30.882 INFO:tasks.workunit.client.1.smithi184.stdout:9/411: truncate d5/db/f42 4904965 0 2024-02-28T23:07:30.884 INFO:tasks.workunit.client.1.smithi184.stdout:8/426: rename d1/da to d1/da/dc/d18/da6 22 2024-02-28T23:07:30.885 INFO:tasks.workunit.client.1.smithi184.stdout:3/433: write d1/d4/d6/d1e/d72/f7a [952840,45127] 0 2024-02-28T23:07:30.890 INFO:tasks.workunit.client.1.smithi184.stdout:0/428: fsync d0/d1f/f4b 0 2024-02-28T23:07:30.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.894+0000 7f774e000700 1 -- 172.21.15.159:0/2426123371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748103ff0 msgr2=0x7f7748104450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:30.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.894+0000 7f774e000700 1 --2- 172.21.15.159:0/2426123371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748103ff0 0x7f7748104450 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7734009910 tx=0x7f7734009c20 comp rx=0 tx=0).stop 2024-02-28T23:07:30.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.895+0000 7f774e000700 1 -- 172.21.15.159:0/2426123371 shutdown_connections 2024-02-28T23:07:30.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.895+0000 7f774e000700 1 --2- 172.21.15.159:0/2426123371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748103ff0 0x7f7748104450 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:30.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.895+0000 7f774e000700 1 --2- 172.21.15.159:0/2426123371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7748102df0 0x7f7748103210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:30.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.895+0000 7f774e000700 1 -- 172.21.15.159:0/2426123371 >> 172.21.15.159:0/2426123371 conn(0x7f77480fe390 msgr2=0x7f77481007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:07:30.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.895+0000 7f774e000700 1 -- 172.21.15.159:0/2426123371 shutdown_connections 2024-02-28T23:07:30.895 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:30 smithi159 ceph-mon[28802]: pgmap v34: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 74 MiB/s rd, 241 MiB/s wr, 483 op/s 2024-02-28T23:07:30.895 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:30 smithi159 ceph-mon[28802]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:07:30.895 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:30 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3319502591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:07:30.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.896+0000 7f774e000700 1 -- 172.21.15.159:0/2426123371 wait complete. 2024-02-28T23:07:30.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.897+0000 7f774e000700 1 Processor -- start 2024-02-28T23:07:30.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.898+0000 7f774e000700 1 -- start start 2024-02-28T23:07:30.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.899+0000 7f774e000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7748102df0 0x7f7748071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:30.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.899+0000 7f774e000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748103ff0 0x7f77480722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:30.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.899+0000 7f774e000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77480728f0 con 0x7f7748103ff0 2024-02-28T23:07:30.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.899+0000 7f774e000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77481a6320 con 0x7f7748102df0 2024-02-28T23:07:30.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.900+0000 7f7747400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7748102df0 0x7f7748071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:30.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.900+0000 7f7747400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7748102df0 0x7f7748071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:55684/0 (socket says 172.21.15.159:55684) 2024-02-28T23:07:30.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.900+0000 7f7747400700 1 -- 172.21.15.159:0/2448384507 learned_addr learned my addr 172.21.15.159:0/2448384507 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:07:30.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.900+0000 7f7746a00700 1 --2- 172.21.15.159:0/2448384507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748103ff0 0x7f77480722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:30.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.901+0000 7f7746a00700 1 -- 172.21.15.159:0/2448384507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7748102df0 msgr2=0x7f7748071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:30.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.901+0000 7f7746a00700 1 --2- 172.21.15.159:0/2448384507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7748102df0 0x7f7748071d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:30.900 INFO:tasks.workunit.client.0.smithi159.stdout:1/775: dread d6/d12/d31/d5a/fa2 [0,4194304] 0 2024-02-28T23:07:30.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.901+0000 7f7746a00700 1 -- 172.21.15.159:0/2448384507 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77340095f0 con 0x7f7748103ff0 2024-02-28T23:07:30.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.902+0000 7f7746a00700 1 --2- 172.21.15.159:0/2448384507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748103ff0 0x7f77480722d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7734000c00 tx=0x7f773400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:07:30.902 INFO:tasks.workunit.client.1.smithi184.stdout:3/434: dread d1/d4/d1c/f31 [0,4194304] 0 2024-02-28T23:07:30.902 INFO:tasks.workunit.client.0.smithi159.stdout:1/776: stat d6/f9 0 2024-02-28T23:07:30.902 INFO:tasks.workunit.client.0.smithi159.stdout:5/745: write d8/d16/f72 [2100842,70133] 0 2024-02-28T23:07:30.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.903+0000 7f773fe00700 1 -- 172.21.15.159:0/2448384507 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f773401d070 con 0x7f7748103ff0 2024-02-28T23:07:30.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.904+0000 7f773fe00700 1 -- 172.21.15.159:0/2448384507 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f7734005dc0 con 0x7f7748103ff0 2024-02-28T23:07:30.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.904+0000 7f773fe00700 1 -- 172.21.15.159:0/2448384507 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7734021410 con 0x7f7748103ff0 2024-02-28T23:07:30.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.904+0000 7f774e000700 1 -- 172.21.15.159:0/2448384507 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77481a64c0 con 0x7f7748103ff0 2024-02-28T23:07:30.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.904+0000 7f774e000700 1 -- 172.21.15.159:0/2448384507 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77481a6960 con 0x7f7748103ff0 2024-02-28T23:07:30.905 INFO:tasks.workunit.client.1.smithi184.stdout:0/429: dread d0/df/d13/d27/d31/f8f [4194304,4194304] 0 2024-02-28T23:07:30.905 INFO:tasks.workunit.client.1.smithi184.stdout:6/353: mkdir dc/de/d2a/d5c/d71 0 2024-02-28T23:07:30.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.906+0000 7f774e000700 1 -- 172.21.15.159:0/2448384507 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f774810b950 con 0x7f7748103ff0 2024-02-28T23:07:30.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.909+0000 7f773fe00700 1 -- 172.21.15.159:0/2448384507 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 25) v1 ==== 90929+0+0 (secure 0 0 0) 0x7f773400f7d0 con 0x7f7748103ff0 2024-02-28T23:07:30.908 INFO:tasks.workunit.client.1.smithi184.stdout:9/412: mkdir d5/d17/d8f 0 2024-02-28T23:07:30.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.911+0000 7f773fe00700 1 --2- 172.21.15.159:0/2448384507 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f772c06ce70 0x7f772c06f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:07:30.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.911+0000 7f773fe00700 1 -- 172.21.15.159:0/2448384507 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5812+0+0 (secure 0 0 0) 0x7f773408d9d0 con 0x7f7748103ff0 2024-02-28T23:07:30.909 INFO:tasks.workunit.client.1.smithi184.stdout:2/408: mknod d10/d1f/d38/d53/c85 0 2024-02-28T23:07:30.910 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.911+0000 7f7747400700 1 --2- 172.21.15.159:0/2448384507 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f772c06ce70 0x7f772c06f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:07:30.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.912+0000 7f7747400700 1 --2- 172.21.15.159:0/2448384507 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f772c06ce70 0x7f772c06f330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f77481a2290 tx=0x7f773800b4a0 comp rx=0 tx=0).ready entity=mgr.24357 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:07:30.913 INFO:tasks.workunit.client.0.smithi159.stdout:5/746: mknod d8/d59/c105 0 2024-02-28T23:07:30.914 INFO:tasks.workunit.client.1.smithi184.stdout:5/408: unlink db/d12/d18/f1a 0 2024-02-28T23:07:30.916 INFO:tasks.workunit.client.0.smithi159.stdout:1/777: creat d6/d12/d33/d3c/f108 x:0 0 0 2024-02-28T23:07:30.916 INFO:tasks.workunit.client.1.smithi184.stdout:7/385: rmdir d6/d9 39 2024-02-28T23:07:30.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:30.918+0000 7f773fe00700 1 -- 172.21.15.159:0/2448384507 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f7734057700 con 0x7f7748103ff0 2024-02-28T23:07:30.919 INFO:tasks.workunit.client.0.smithi159.stdout:5/747: mknod d8/d59/c106 0 2024-02-28T23:07:30.919 INFO:tasks.workunit.client.1.smithi184.stdout:0/430: dread d0/df/f41 [0,4194304] 0 2024-02-28T23:07:30.922 INFO:tasks.workunit.client.1.smithi184.stdout:0/431: write d0/df/d13/d27/d31/d51/f8d [925121,125865] 0 2024-02-28T23:07:30.926 INFO:tasks.workunit.client.0.smithi159.stdout:2/689: sync 2024-02-28T23:07:30.926 INFO:tasks.workunit.client.0.smithi159.stdout:9/774: sync 2024-02-28T23:07:30.926 INFO:tasks.workunit.client.0.smithi159.stdout:8/889: sync 2024-02-28T23:07:30.926 INFO:tasks.workunit.client.0.smithi159.stdout:7/650: sync 2024-02-28T23:07:30.926 INFO:tasks.workunit.client.0.smithi159.stdout:3/710: sync 2024-02-28T23:07:30.936 INFO:tasks.workunit.client.1.smithi184.stdout:4/402: creat d1/dc/df/d27/f79 x:0 0 0 2024-02-28T23:07:30.937 INFO:tasks.workunit.client.0.smithi159.stdout:6/774: dread d0/d1b/d33/f18 [0,4194304] 0 2024-02-28T23:07:30.939 INFO:tasks.workunit.client.0.smithi159.stdout:1/778: creat d6/d12/d1a/d92/d97/f109 x:0 0 0 2024-02-28T23:07:30.940 INFO:tasks.workunit.client.0.smithi159.stdout:4/868: dwrite d9/d20/d87/d115/fcf [0,4194304] 0 2024-02-28T23:07:30.946 INFO:tasks.workunit.client.1.smithi184.stdout:1/481: dwrite d20/f2c [0,4194304] 0 2024-02-28T23:07:30.948 INFO:tasks.workunit.client.0.smithi159.stdout:5/748: rename d8/f8b to d8/d19/d23/d35/d41/daa/d79/f107 0 2024-02-28T23:07:30.952 INFO:tasks.workunit.client.1.smithi184.stdout:5/409: dread db/d12/d18/f20 [0,4194304] 0 2024-02-28T23:07:30.959 INFO:tasks.workunit.client.0.smithi159.stdout:9/775: mknod d4/d3d/d3e/d55/d37/d62/d8f/cf2 0 2024-02-28T23:07:30.964 INFO:tasks.workunit.client.1.smithi184.stdout:9/413: mknod d5/d17/d43/c90 0 2024-02-28T23:07:30.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/427: dwrite d1/da/dc/d16/d29/fa0 [0,4194304] 0 2024-02-28T23:07:30.965 INFO:tasks.workunit.client.0.smithi159.stdout:9/776: write d4/d3d/d3e/d55/d9e/db3/dc1/fc4 [2025179,14904] 0 2024-02-28T23:07:30.965 INFO:tasks.workunit.client.0.smithi159.stdout:2/690: dwrite d9/d50/d54/d84/d37/f8c [0,4194304] 0 2024-02-28T23:07:30.965 INFO:tasks.workunit.client.1.smithi184.stdout:8/428: dread - d1/f99 zero size 2024-02-28T23:07:30.966 INFO:tasks.workunit.client.1.smithi184.stdout:2/409: rmdir d10/d1f/d38/d54 39 2024-02-28T23:07:30.969 INFO:tasks.workunit.client.1.smithi184.stdout:2/410: chown d10/d1f/d21/d5e/d15/d60/d66 977165411 1 2024-02-28T23:07:30.977 INFO:tasks.workunit.client.0.smithi159.stdout:1/779: symlink d6/d1d/d46/d88/l10a 0 2024-02-28T23:07:30.979 INFO:tasks.workunit.client.0.smithi159.stdout:6/775: symlink d0/d1b/d33/d3f/d44/d7a/lfb 0 2024-02-28T23:07:30.981 INFO:tasks.workunit.client.0.smithi159.stdout:1/780: stat d6/d12/d1a/d92/cbc 0 2024-02-28T23:07:30.981 INFO:tasks.workunit.client.1.smithi184.stdout:6/354: dwrite dc/de/d10/d16/f2d [0,4194304] 0 2024-02-28T23:07:30.983 INFO:tasks.workunit.client.1.smithi184.stdout:8/429: dwrite d1/da/dc/d16/d32/f9f [0,4194304] 0 2024-02-28T23:07:30.986 INFO:tasks.workunit.client.0.smithi159.stdout:4/869: mknod d9/d4c/d6c/d98/df2/c131 0 2024-02-28T23:07:30.994 INFO:tasks.workunit.client.0.smithi159.stdout:7/651: rename d5/d16/f30 to d5/d56/d50/d88/fd4 0 2024-02-28T23:07:30.994 INFO:tasks.workunit.client.0.smithi159.stdout:4/870: truncate d9/d20/d87/d115/d1c/d8e/ddc/fcc 4552983 0 2024-02-28T23:07:30.995 INFO:tasks.workunit.client.1.smithi184.stdout:2/411: dread d10/d1f/d21/d5e/f1a [0,4194304] 0 2024-02-28T23:07:31.002 INFO:tasks.workunit.client.0.smithi159.stdout:2/691: mknod d9/d36/d59/cf6 0 2024-02-28T23:07:31.003 INFO:tasks.workunit.client.0.smithi159.stdout:9/777: mknod d4/de4/de3/cf3 0 2024-02-28T23:07:31.005 INFO:tasks.workunit.client.0.smithi159.stdout:2/692: read - d9/d50/d54/d8d/fd8 zero size 2024-02-28T23:07:31.006 INFO:tasks.workunit.client.1.smithi184.stdout:3/435: rename d1/d4/d6/d1f/d26/d3a/f3d to d1/d4/d6/d1f/d26/d3a/d59/d67/f86 0 2024-02-28T23:07:31.006 INFO:tasks.workunit.client.0.smithi159.stdout:6/776: mknod d0/d1b/dc5/cfc 0 2024-02-28T23:07:31.009 INFO:tasks.workunit.client.1.smithi184.stdout:1/482: write d20/f2d [1398813,127940] 0 2024-02-28T23:07:31.009 INFO:tasks.workunit.client.0.smithi159.stdout:1/781: creat d6/d1d/d46/d88/dd3/f10b x:0 0 0 2024-02-28T23:07:31.009 INFO:tasks.workunit.client.1.smithi184.stdout:5/410: write db/d12/d1c/d21/f2a [3638286,125042] 0 2024-02-28T23:07:31.012 INFO:tasks.workunit.client.0.smithi159.stdout:8/890: link d2/d11/d35/d9c/da0/f101 d2/d11/d52/d47/db6/dba/f119 0 2024-02-28T23:07:31.013 INFO:tasks.workunit.client.0.smithi159.stdout:3/711: dread d0/d6/d3e/d2f/f4b [0,4194304] 0 2024-02-28T23:07:31.021 INFO:tasks.workunit.client.1.smithi184.stdout:9/414: creat d5/db/de/d10/d6a/f91 x:0 0 0 2024-02-28T23:07:31.022 INFO:tasks.workunit.client.1.smithi184.stdout:9/415: dread - d5/db/f1f zero size 2024-02-28T23:07:31.023 INFO:tasks.workunit.client.1.smithi184.stdout:9/416: chown d5/d26/d50 407 1 2024-02-28T23:07:31.023 INFO:tasks.workunit.client.0.smithi159.stdout:4/871: creat d9/d4c/d6c/d98/f132 x:0 0 0 2024-02-28T23:07:31.030 INFO:tasks.workunit.client.1.smithi184.stdout:0/432: getdents d0/df/d13/d27/d31/d5b/d8e/d92 0 2024-02-28T23:07:31.032 INFO:tasks.workunit.client.0.smithi159.stdout:5/749: dwrite d8/d19/d23/f56 [0,4194304] 0 2024-02-28T23:07:31.033 INFO:tasks.workunit.client.0.smithi159.stdout:6/777: symlink d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/lfd 0 2024-02-28T23:07:31.034 INFO:tasks.workunit.client.1.smithi184.stdout:6/355: mknod dc/d42/c72 0 2024-02-28T23:07:31.036 INFO:tasks.workunit.client.1.smithi184.stdout:8/430: creat d1/da/dc/d16/d32/fa7 x:0 0 0 2024-02-28T23:07:31.041 INFO:tasks.workunit.client.0.smithi159.stdout:8/891: fsync d2/d3/fa6 0 2024-02-28T23:07:31.045 INFO:tasks.workunit.client.0.smithi159.stdout:4/872: rmdir d9/d42/d54/d56/df5 39 2024-02-28T23:07:31.045 INFO:tasks.workunit.client.1.smithi184.stdout:2/412: symlink d10/d1f/d21/d5e/d15/d24/l86 0 2024-02-28T23:07:31.048 INFO:tasks.workunit.client.0.smithi159.stdout:2/693: rename d9/d23/d2c/d55/d13/f5f to d9/d36/d59/ff7 0 2024-02-28T23:07:31.052 INFO:tasks.workunit.client.1.smithi184.stdout:7/386: rename d6/d9/d13/d14/f2a to d6/d9/d13/d3e/d7e/f90 0 2024-02-28T23:07:31.053 INFO:tasks.workunit.client.1.smithi184.stdout:1/483: creat d20/d32/d3e/d82/d85/fa6 x:0 0 0 2024-02-28T23:07:31.054 INFO:tasks.workunit.client.1.smithi184.stdout:4/403: truncate d1/d8/d37/f60 451097 0 2024-02-28T23:07:31.056 INFO:tasks.workunit.client.1.smithi184.stdout:6/356: dwrite dc/de/f15 [0,4194304] 0 2024-02-28T23:07:31.056 INFO:tasks.workunit.client.1.smithi184.stdout:5/411: chown db/d12/d1c/d21/d4d/l5c 38672 1 2024-02-28T23:07:31.057 INFO:tasks.workunit.client.0.smithi159.stdout:7/652: dwrite d5/d16/d1a/d27/d46/f66 [0,4194304] 0 2024-02-28T23:07:31.059 INFO:tasks.workunit.client.1.smithi184.stdout:4/404: truncate d1/d4/f1f 4297710 0 2024-02-28T23:07:31.060 INFO:tasks.workunit.client.0.smithi159.stdout:9/778: dwrite d4/d3d/d3e/d55/d4c/f92 [0,4194304] 0 2024-02-28T23:07:31.063 INFO:tasks.workunit.client.1.smithi184.stdout:2/413: dread fb [0,4194304] 0 2024-02-28T23:07:31.065 INFO:tasks.workunit.client.1.smithi184.stdout:8/431: dwrite d1/da/dc/d16/f97 [0,4194304] 0 2024-02-28T23:07:31.067 INFO:tasks.workunit.client.1.smithi184.stdout:3/436: unlink d1/f21 0 2024-02-28T23:07:31.077 INFO:tasks.workunit.client.1.smithi184.stdout:1/484: truncate d20/f76 532856 0 2024-02-28T23:07:31.078 INFO:tasks.workunit.client.1.smithi184.stdout:4/405: dwrite d1/d8/f5a [0,4194304] 0 2024-02-28T23:07:31.083 INFO:tasks.workunit.client.0.smithi159.stdout:3/712: dread d0/d3f/dd2/d7c/d79/f98 [0,4194304] 0 2024-02-28T23:07:31.084 INFO:tasks.workunit.client.1.smithi184.stdout:6/357: write dc/de/f29 [5702166,17615] 0 2024-02-28T23:07:31.087 INFO:tasks.workunit.client.1.smithi184.stdout:5/412: creat db/d44/f84 x:0 0 0 2024-02-28T23:07:31.090 INFO:tasks.workunit.client.1.smithi184.stdout:8/432: readlink d1/da/d10/d6b/l94 0 2024-02-28T23:07:31.095 INFO:tasks.workunit.client.1.smithi184.stdout:6/358: read dc/de/f1e [987091,123491] 0 2024-02-28T23:07:31.096 INFO:tasks.workunit.client.1.smithi184.stdout:7/387: mkdir d6/d91 0 2024-02-28T23:07:31.097 INFO:tasks.workunit.client.1.smithi184.stdout:9/417: dwrite d5/d17/f3d [0,4194304] 0 2024-02-28T23:07:31.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:30 smithi184 ceph-mon[36198]: pgmap v34: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 74 MiB/s rd, 241 MiB/s wr, 483 op/s 2024-02-28T23:07:31.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:30 smithi184 ceph-mon[36198]: from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:07:31.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:30 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3319502591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:07:31.102 INFO:tasks.workunit.client.1.smithi184.stdout:9/418: fsync d5/d47/d68/d7c/f8b 0 2024-02-28T23:07:31.108 INFO:tasks.workunit.client.1.smithi184.stdout:8/433: fdatasync d1/da/d10/d17/f13 0 2024-02-28T23:07:31.114 INFO:tasks.workunit.client.1.smithi184.stdout:6/359: dwrite dc/d53/f6b [0,4194304] 0 2024-02-28T23:07:31.116 INFO:tasks.workunit.client.1.smithi184.stdout:3/437: rmdir d1/d4/d1c/d62/d79 0 2024-02-28T23:07:31.121 INFO:tasks.workunit.client.1.smithi184.stdout:0/433: truncate d0/d1d/f3d 1380468 0 2024-02-28T23:07:31.124 INFO:tasks.workunit.client.1.smithi184.stdout:2/414: getdents d10/d55 0 2024-02-28T23:07:31.126 INFO:tasks.workunit.client.1.smithi184.stdout:4/406: dread d1/d8/d3d/d44/f66 [0,4194304] 0 2024-02-28T23:07:31.130 INFO:tasks.workunit.client.1.smithi184.stdout:8/434: creat d1/da/dc/d16/d4d/d82/fa8 x:0 0 0 2024-02-28T23:07:31.131 INFO:tasks.workunit.client.1.smithi184.stdout:8/435: write d1/da/dc/d18/f51 [269049,79273] 0 2024-02-28T23:07:31.133 INFO:tasks.workunit.client.1.smithi184.stdout:3/438: readlink d1/d4/l48 0 2024-02-28T23:07:31.140 INFO:tasks.workunit.client.1.smithi184.stdout:5/413: rename db/f1e to db/d12/f85 0 2024-02-28T23:07:31.141 INFO:tasks.workunit.client.1.smithi184.stdout:7/388: rename d6/d9/d13/d3e/d7e to d6/d9/d13/d3e/d7e/d92 22 2024-02-28T23:07:31.144 INFO:tasks.workunit.client.1.smithi184.stdout:8/436: symlink d1/da/df/d20/la9 0 2024-02-28T23:07:31.145 INFO:tasks.workunit.client.1.smithi184.stdout:4/407: dwrite d1/d8/d3d/f74 [0,4194304] 0 2024-02-28T23:07:31.146 INFO:tasks.workunit.client.1.smithi184.stdout:8/437: chown d1/da/d10/d6b 4567851 1 2024-02-28T23:07:31.149 INFO:tasks.workunit.client.1.smithi184.stdout:2/415: mknod d10/d1f/d21/d5e/d15/c87 0 2024-02-28T23:07:31.149 INFO:tasks.workunit.client.1.smithi184.stdout:1/485: write d20/f50 [836435,106381] 0 2024-02-28T23:07:31.151 INFO:tasks.workunit.client.1.smithi184.stdout:2/416: stat d10/d1f/d21/d5e/d15/d24/l86 0 2024-02-28T23:07:31.154 INFO:tasks.workunit.client.0.smithi159.stdout:0/889: sync 2024-02-28T23:07:31.154 INFO:tasks.workunit.client.1.smithi184.stdout:5/414: unlink db/d12/d18/d2e/d3c/d5d/f37 0 2024-02-28T23:07:31.157 INFO:tasks.workunit.client.1.smithi184.stdout:7/389: fsync d6/d9/d13/d3e/d7e/f8a 0 2024-02-28T23:07:31.157 INFO:tasks.workunit.client.1.smithi184.stdout:3/439: mkdir d1/d4/d1c/d61/d87 0 2024-02-28T23:07:31.159 INFO:tasks.workunit.client.1.smithi184.stdout:1/486: fdatasync d20/f24 0 2024-02-28T23:07:31.163 INFO:tasks.workunit.client.1.smithi184.stdout:9/419: dread d5/db/de/d10/f2b [0,4194304] 0 2024-02-28T23:07:31.163 INFO:tasks.workunit.client.1.smithi184.stdout:2/417: dread d10/d1f/d38/f5c [0,4194304] 0 2024-02-28T23:07:31.165 INFO:tasks.workunit.client.1.smithi184.stdout:9/420: stat d5/d26/d50 0 2024-02-28T23:07:31.165 INFO:tasks.workunit.client.1.smithi184.stdout:6/360: dread dc/de/f20 [0,4194304] 0 2024-02-28T23:07:31.166 INFO:tasks.workunit.client.1.smithi184.stdout:0/434: dread d0/d1f/f4b [0,4194304] 0 2024-02-28T23:07:31.167 INFO:tasks.workunit.client.0.smithi159.stdout:1/782: creat d6/d12/d31/d69/dc0/dca/f10c x:0 0 0 2024-02-28T23:07:31.168 INFO:tasks.workunit.client.1.smithi184.stdout:0/435: fsync d0/d1d/d3a/f56 0 2024-02-28T23:07:31.169 INFO:tasks.workunit.client.0.smithi159.stdout:1/783: chown d6/d12/d31/fae 49388349 1 2024-02-28T23:07:31.170 INFO:tasks.workunit.client.1.smithi184.stdout:7/390: dread d6/d9/d13/d1e/f22 [0,4194304] 0 2024-02-28T23:07:31.175 INFO:tasks.workunit.client.0.smithi159.stdout:6/778: creat d0/d1b/d33/d11/d34/d9d/ffe x:0 0 0 2024-02-28T23:07:31.176 INFO:tasks.workunit.client.1.smithi184.stdout:3/440: creat d1/d4/d6/d1f/d24/f88 x:0 0 0 2024-02-28T23:07:31.177 INFO:tasks.workunit.client.1.smithi184.stdout:5/415: creat db/d12/d50/d6b/f86 x:0 0 0 2024-02-28T23:07:31.177 INFO:tasks.workunit.client.0.smithi159.stdout:4/873: creat d9/d20/d87/d115/dc5/f133 x:0 0 0 2024-02-28T23:07:31.179 INFO:tasks.workunit.client.1.smithi184.stdout:9/421: mkdir d5/d47/d59/d92 0 2024-02-28T23:07:31.179 INFO:tasks.workunit.client.1.smithi184.stdout:2/418: dwrite d10/d55/f70 [0,4194304] 0 2024-02-28T23:07:31.180 INFO:tasks.workunit.client.1.smithi184.stdout:9/422: readlink d5/d26/l3a 0 2024-02-28T23:07:31.182 INFO:tasks.workunit.client.0.smithi159.stdout:8/892: creat d2/d11/d52/d26/d36/d38/d77/dc5/f11a x:0 0 0 2024-02-28T23:07:31.187 INFO:tasks.workunit.client.1.smithi184.stdout:0/436: mkdir d0/df/d13/d5a/d95 0 2024-02-28T23:07:31.190 INFO:tasks.workunit.client.1.smithi184.stdout:3/441: dread d1/d4/d6/d1f/f60 [0,4194304] 0 2024-02-28T23:07:31.192 INFO:tasks.workunit.client.0.smithi159.stdout:9/779: chown d4/d3d/f7e 605 1 2024-02-28T23:07:31.194 INFO:tasks.workunit.client.0.smithi159.stdout:0/890: read - d0/d5/d14/f113 zero size 2024-02-28T23:07:31.196 INFO:tasks.workunit.client.0.smithi159.stdout:0/891: chown d0/d5/d14/d34/d6c/fbc 6 1 2024-02-28T23:07:31.201 INFO:tasks.workunit.client.0.smithi159.stdout:1/784: rmdir d6/d1d 39 2024-02-28T23:07:31.203 INFO:tasks.workunit.client.1.smithi184.stdout:4/408: getdents d1/dc/df/d38/d3c 0 2024-02-28T23:07:31.205 INFO:tasks.workunit.client.0.smithi159.stdout:6/779: mknod d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88/cff 0 2024-02-28T23:07:31.207 INFO:tasks.workunit.client.0.smithi159.stdout:4/874: mkdir d9/d42/d54/d55/da8/d134 0 2024-02-28T23:07:31.209 INFO:tasks.workunit.client.0.smithi159.stdout:4/875: stat d9/d4c/d6c/d98/fb6 0 2024-02-28T23:07:31.211 INFO:tasks.workunit.client.1.smithi184.stdout:5/416: rename db/d12/d18/l7e to db/d12/d18/d2e/d3c/d5d/l87 0 2024-02-28T23:07:31.213 INFO:tasks.workunit.client.0.smithi159.stdout:8/893: mknod d2/d73/dc2/c11b 0 2024-02-28T23:07:31.216 INFO:tasks.workunit.client.1.smithi184.stdout:2/419: symlink d10/d1f/d21/d4d/d71/l88 0 2024-02-28T23:07:31.217 INFO:tasks.workunit.client.0.smithi159.stdout:8/894: write d2/fe4 [282435,80450] 0 2024-02-28T23:07:31.217 INFO:tasks.workunit.client.1.smithi184.stdout:2/420: stat d10/f14 0 2024-02-28T23:07:31.222 INFO:tasks.workunit.client.0.smithi159.stdout:2/694: truncate d9/d23/d2c/f4a 2245603 0 2024-02-28T23:07:31.225 INFO:tasks.workunit.client.1.smithi184.stdout:5/417: dwrite db/d1f/f5b [0,4194304] 0 2024-02-28T23:07:31.226 INFO:tasks.workunit.client.1.smithi184.stdout:9/423: dwrite d5/d47/d4a/f82 [0,4194304] 0 2024-02-28T23:07:31.227 INFO:tasks.workunit.client.0.smithi159.stdout:5/750: creat d8/d19/d23/d35/d38/f108 x:0 0 0 2024-02-28T23:07:31.230 INFO:tasks.workunit.client.0.smithi159.stdout:2/695: write d9/d50/d54/d8d/fd4 [1030623,26385] 0 2024-02-28T23:07:31.231 INFO:tasks.workunit.client.0.smithi159.stdout:7/653: dwrite d5/d10/f85 [0,4194304] 0 2024-02-28T23:07:31.235 INFO:tasks.workunit.client.0.smithi159.stdout:5/751: readlink d8/d19/d23/d35/d65/da3/dd2/lda 0 2024-02-28T23:07:31.235 INFO:tasks.workunit.client.1.smithi184.stdout:4/409: mkdir d1/d8/d19/d56/d7a 0 2024-02-28T23:07:31.235 INFO:tasks.workunit.client.1.smithi184.stdout:2/421: mkdir d10/d55/d89 0 2024-02-28T23:07:31.238 INFO:tasks.workunit.client.0.smithi159.stdout:3/713: dwrite d0/d6/d3e/d2f/f6b [0,4194304] 0 2024-02-28T23:07:31.244 INFO:tasks.workunit.client.0.smithi159.stdout:2/696: fdatasync d9/d50/d62/fc2 0 2024-02-28T23:07:31.244 INFO:tasks.workunit.client.1.smithi184.stdout:6/361: link dc/de/l1a dc/d60/d62/l73 0 2024-02-28T23:07:31.246 INFO:tasks.workunit.client.1.smithi184.stdout:4/410: creat d1/dc/df/d3b/d5c/f7b x:0 0 0 2024-02-28T23:07:31.247 INFO:tasks.workunit.client.0.smithi159.stdout:7/654: dread d5/d56/f5a [0,4194304] 0 2024-02-28T23:07:31.249 INFO:tasks.workunit.client.1.smithi184.stdout:3/442: link d1/d4/f23 d1/d4/f89 0 2024-02-28T23:07:31.250 INFO:tasks.workunit.client.1.smithi184.stdout:9/424: mknod d5/d17/d8f/c93 0 2024-02-28T23:07:31.253 INFO:tasks.workunit.client.0.smithi159.stdout:9/780: getdents d4/d76 0 2024-02-28T23:07:31.253 INFO:tasks.workunit.client.0.smithi159.stdout:6/780: dread d0/d6d/fab [0,4194304] 0 2024-02-28T23:07:31.254 INFO:tasks.workunit.client.0.smithi159.stdout:5/752: symlink d8/d19/d23/d35/d38/d6d/l109 0 2024-02-28T23:07:31.255 INFO:tasks.workunit.client.0.smithi159.stdout:3/714: dread d0/d3f/fcf [0,4194304] 0 2024-02-28T23:07:31.259 INFO:tasks.workunit.client.0.smithi159.stdout:1/785: dwrite d6/d12/d16/fe0 [0,4194304] 0 2024-02-28T23:07:31.259 INFO:tasks.workunit.client.0.smithi159.stdout:2/697: symlink d9/d36/dc3/lf8 0 2024-02-28T23:07:31.260 INFO:tasks.workunit.client.1.smithi184.stdout:9/425: rmdir d5/d47/d68/d7c 39 2024-02-28T23:07:31.262 INFO:tasks.workunit.client.1.smithi184.stdout:6/362: dwrite dc/de/d10/f4c [0,4194304] 0 2024-02-28T23:07:31.263 INFO:tasks.workunit.client.1.smithi184.stdout:5/418: getdents db/d12/d50 0 2024-02-28T23:07:31.263 INFO:tasks.workunit.client.1.smithi184.stdout:2/422: dwrite d10/d1f/d21/d5e/d15/f39 [0,4194304] 0 2024-02-28T23:07:31.270 INFO:tasks.workunit.client.1.smithi184.stdout:4/411: link d1/dc/df/c2c d1/dc/df/d38/d57/c7c 0 2024-02-28T23:07:31.272 INFO:tasks.workunit.client.1.smithi184.stdout:9/426: fsync d5/db/de/d10/f30 0 2024-02-28T23:07:31.273 INFO:tasks.workunit.client.1.smithi184.stdout:0/437: write d0/d1d/f35 [1295511,129311] 0 2024-02-28T23:07:31.274 INFO:tasks.workunit.client.0.smithi159.stdout:8/895: dwrite d2/d11/f4b [4194304,4194304] 0 2024-02-28T23:07:31.278 INFO:tasks.workunit.client.0.smithi159.stdout:4/876: write d9/ffc [149450,122143] 0 2024-02-28T23:07:31.283 INFO:tasks.workunit.client.1.smithi184.stdout:2/423: mknod d10/d55/c8a 0 2024-02-28T23:07:31.284 INFO:tasks.workunit.client.1.smithi184.stdout:2/424: write fa [2651734,7398] 0 2024-02-28T23:07:31.286 INFO:tasks.workunit.client.0.smithi159.stdout:3/715: rename d0/d6/d3e/f7f to d0/d6/d3e/da9/fe0 0 2024-02-28T23:07:31.290 INFO:tasks.workunit.client.1.smithi184.stdout:7/391: sync 2024-02-28T23:07:31.290 INFO:tasks.workunit.client.1.smithi184.stdout:8/438: sync 2024-02-28T23:07:31.290 INFO:tasks.workunit.client.1.smithi184.stdout:1/487: sync 2024-02-28T23:07:31.291 INFO:tasks.workunit.client.0.smithi159.stdout:2/698: unlink d9/d50/d54/d84/f9f 0 2024-02-28T23:07:31.291 INFO:tasks.workunit.client.1.smithi184.stdout:8/439: readlink d1/l4 0 2024-02-28T23:07:31.291 INFO:tasks.workunit.client.1.smithi184.stdout:1/488: fdatasync d20/d32/d3e/f63 0 2024-02-28T23:07:31.291 INFO:tasks.workunit.client.1.smithi184.stdout:3/443: getdents d1/d4/d6/d1f 0 2024-02-28T23:07:31.294 INFO:tasks.workunit.client.1.smithi184.stdout:3/444: readlink d1/d4/d6/d1f/d24/l25 0 2024-02-28T23:07:31.295 INFO:tasks.workunit.client.0.smithi159.stdout:5/753: truncate d8/d19/d23/d2a/f9f 251109 0 2024-02-28T23:07:31.298 INFO:tasks.workunit.client.0.smithi159.stdout:5/754: dread - d8/d19/d23/d35/d41/d92/fe3 zero size 2024-02-28T23:07:31.303 INFO:tasks.workunit.client.1.smithi184.stdout:0/438: creat d0/df/f96 x:0 0 0 2024-02-28T23:07:31.303 INFO:tasks.workunit.client.1.smithi184.stdout:0/439: chown d0/d1d/d3a 60063697 1 2024-02-28T23:07:31.305 INFO:tasks.workunit.client.1.smithi184.stdout:9/427: rmdir d5/db/de/d10/d12/d2f 39 2024-02-28T23:07:31.310 INFO:tasks.workunit.client.1.smithi184.stdout:5/419: dread db/d12/f39 [4194304,4194304] 0 2024-02-28T23:07:31.311 INFO:tasks.workunit.client.0.smithi159.stdout:9/781: write d4/d3d/d3e/d55/d37/d62/d77/fa9 [311960,112589] 0 2024-02-28T23:07:31.316 INFO:tasks.workunit.client.1.smithi184.stdout:2/425: symlink d10/d1f/d21/d5e/d15/d60/d66/l8b 0 2024-02-28T23:07:31.317 INFO:tasks.workunit.client.0.smithi159.stdout:3/716: truncate d0/f4c 1007020 0 2024-02-28T23:07:31.318 INFO:tasks.workunit.client.0.smithi159.stdout:6/781: write d0/d1b/f1f [1175410,759] 0 2024-02-28T23:07:31.320 INFO:tasks.workunit.client.0.smithi159.stdout:7/655: creat d5/d16/d1a/d27/fd5 x:0 0 0 2024-02-28T23:07:31.320 INFO:tasks.workunit.client.0.smithi159.stdout:1/786: dwrite d6/d1d/d46/d88/fd0 [0,4194304] 0 2024-02-28T23:07:31.323 INFO:tasks.workunit.client.0.smithi159.stdout:6/782: chown d0/d1b/f56 630 1 2024-02-28T23:07:31.325 INFO:tasks.workunit.client.0.smithi159.stdout:1/787: chown d6/f9 17 1 2024-02-28T23:07:31.326 INFO:tasks.workunit.client.0.smithi159.stdout:8/896: write d2/d11/d35/d5f/f92 [40237,110203] 0 2024-02-28T23:07:31.331 INFO:tasks.workunit.client.1.smithi184.stdout:6/363: truncate dc/de/d10/f3d 1832245 0 2024-02-28T23:07:31.331 INFO:tasks.workunit.client.1.smithi184.stdout:3/445: creat d1/d4/d1c/f8a x:0 0 0 2024-02-28T23:07:31.332 INFO:tasks.workunit.client.1.smithi184.stdout:0/440: chown d0/d1d/f3d 56787421 1 2024-02-28T23:07:31.333 INFO:tasks.workunit.client.0.smithi159.stdout:1/788: truncate d6/d12/f70 61465 0 2024-02-28T23:07:31.334 INFO:tasks.workunit.client.1.smithi184.stdout:9/428: rmdir d5/db 39 2024-02-28T23:07:31.335 INFO:tasks.workunit.client.1.smithi184.stdout:3/446: write d1/d4/d6/d1f/d26/d3a/f4d [1666567,16098] 0 2024-02-28T23:07:31.337 INFO:tasks.workunit.client.1.smithi184.stdout:0/441: dread d0/df/d13/d27/f8b [0,4194304] 0 2024-02-28T23:07:31.338 INFO:tasks.workunit.client.1.smithi184.stdout:2/426: rmdir d10/d1f 39 2024-02-28T23:07:31.339 INFO:tasks.workunit.client.1.smithi184.stdout:0/442: write d0/df/d13/d27/f76 [708476,118865] 0 2024-02-28T23:07:31.341 INFO:tasks.workunit.client.1.smithi184.stdout:1/489: fsync d20/f88 0 2024-02-28T23:07:31.342 INFO:tasks.workunit.client.1.smithi184.stdout:7/392: truncate d6/d9/da/dc/d49/d50/f61 548815 0 2024-02-28T23:07:31.342 INFO:tasks.workunit.client.1.smithi184.stdout:0/443: fsync d0/df/d13/d27/d58/f87 0 2024-02-28T23:07:31.343 INFO:tasks.workunit.client.0.smithi159.stdout:3/717: rmdir d0/d3f/dd2/d63 39 2024-02-28T23:07:31.344 INFO:tasks.workunit.client.1.smithi184.stdout:4/412: mknod d1/dc/df/d27/d34/c7d 0 2024-02-28T23:07:31.346 INFO:tasks.workunit.client.1.smithi184.stdout:0/444: write d0/df/d13/d5a/f70 [486779,37642] 0 2024-02-28T23:07:31.348 INFO:tasks.workunit.client.1.smithi184.stdout:8/440: getdents d1/da/dc/d16/d4d/d8a 0 2024-02-28T23:07:31.351 INFO:tasks.workunit.client.0.smithi159.stdout:7/656: unlink d5/d56/d50/daa/cb3 0 2024-02-28T23:07:31.353 INFO:tasks.workunit.client.0.smithi159.stdout:8/897: dwrite d2/d11/d52/d26/d36/d38/d77/d9e/dc1/dc4/fe9 [0,4194304] 0 2024-02-28T23:07:31.356 INFO:tasks.workunit.client.1.smithi184.stdout:1/490: dwrite f1c [0,4194304] 0 2024-02-28T23:07:31.356 INFO:tasks.workunit.client.0.smithi159.stdout:6/783: mknod d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/c100 0 2024-02-28T23:07:31.357 INFO:tasks.workunit.client.0.smithi159.stdout:5/755: creat d8/db4/de8/f10a x:0 0 0 2024-02-28T23:07:31.359 INFO:tasks.workunit.client.0.smithi159.stdout:6/784: chown d0/cc7 69130535 1 2024-02-28T23:07:31.359 INFO:tasks.workunit.client.0.smithi159.stdout:4/877: dwrite d9/d42/dc8/fd1 [0,4194304] 0 2024-02-28T23:07:31.362 INFO:tasks.workunit.client.0.smithi159.stdout:8/898: write d2/d11/d52/d26/f4c [365593,41049] 0 2024-02-28T23:07:31.363 INFO:tasks.workunit.client.1.smithi184.stdout:5/420: rename db/c30 to db/d12/d18/d2e/d3c/d5d/c88 0 2024-02-28T23:07:31.364 INFO:tasks.workunit.client.0.smithi159.stdout:2/699: truncate d9/d50/d54/d8d/fd4 25701 0 2024-02-28T23:07:31.365 INFO:tasks.workunit.client.1.smithi184.stdout:3/447: readlink d1/d4/d6/d1f/d26/d3a/d59/d82/l85 0 2024-02-28T23:07:31.368 INFO:tasks.workunit.client.0.smithi159.stdout:9/782: creat d4/d3d/d3e/d55/d37/def/ff4 x:0 0 0 2024-02-28T23:07:31.371 INFO:tasks.workunit.client.0.smithi159.stdout:3/718: dread - d0/d2b/fb9 zero size 2024-02-28T23:07:31.372 INFO:tasks.workunit.client.1.smithi184.stdout:6/364: symlink dc/de/l74 0 2024-02-28T23:07:31.374 INFO:tasks.workunit.client.1.smithi184.stdout:1/491: dwrite d20/f88 [0,4194304] 0 2024-02-28T23:07:31.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.377+0000 7f774e000700 1 -- 172.21.15.159:0/2448384507 --> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7748108940 con 0x7f772c06ce70 2024-02-28T23:07:31.378 INFO:tasks.workunit.client.0.smithi159.stdout:6/785: mknod d0/d1b/d33/d3f/d44/d7a/c101 0 2024-02-28T23:07:31.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.380+0000 7f773fe00700 1 -- 172.21.15.159:0/2448384507 <== mgr.24357 v2:172.21.15.184:6828/2879526003 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f7748108940 con 0x7f772c06ce70 2024-02-28T23:07:31.379 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:07:31.379 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:07:31.380 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:07:31.380 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:07:31.380 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [], 2024-02-28T23:07:31.380 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "1/2 daemons upgraded", 2024-02-28T23:07:31.380 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading mgr daemons", 2024-02-28T23:07:31.380 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:07:31.380 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:07:31.381 INFO:tasks.workunit.client.0.smithi159.stdout:8/899: rmdir d2/d11/d52/d26/d36/d38/d77/d9e/dc1/df7/d102 39 2024-02-28T23:07:31.381 INFO:tasks.workunit.client.1.smithi184.stdout:0/445: rename d0/d1d/d3a/f56 to d0/df/d13/f97 0 2024-02-28T23:07:31.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.383+0000 7f774e000700 1 -- 172.21.15.159:0/2448384507 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f772c06ce70 msgr2=0x7f772c06f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:31.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.383+0000 7f774e000700 1 --2- 172.21.15.159:0/2448384507 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f772c06ce70 0x7f772c06f330 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f77481a2290 tx=0x7f773800b4a0 comp rx=0 tx=0).stop 2024-02-28T23:07:31.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.383+0000 7f774e000700 1 -- 172.21.15.159:0/2448384507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748103ff0 msgr2=0x7f77480722d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:07:31.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.383+0000 7f774e000700 1 --2- 172.21.15.159:0/2448384507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748103ff0 0x7f77480722d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7734000c00 tx=0x7f773400bd70 comp rx=0 tx=0).stop 2024-02-28T23:07:31.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.383+0000 7f774e000700 1 -- 172.21.15.159:0/2448384507 shutdown_connections 2024-02-28T23:07:31.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.383+0000 7f774e000700 1 --2- 172.21.15.159:0/2448384507 >> [v2:172.21.15.184:6828/2879526003,v1:172.21.15.184:6829/2879526003] conn(0x7f772c06ce70 0x7f772c06f330 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:31.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.383+0000 7f774e000700 1 --2- 172.21.15.159:0/2448384507 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7748102df0 0x7f7748071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:07:31.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.383+0000 7f774e000700 1 --2- 172.21.15.159:0/2448384507 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7748103ff0 0x7f77480722d0 secure :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7734000c00 tx=0x7f773400bd70 comp rx=0 tx=0).stop 2024-02-28T23:07:31.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.383+0000 7f774e000700 1 -- 172.21.15.159:0/2448384507 >> 172.21.15.159:0/2448384507 conn(0x7f77480fe390 msgr2=0x7f7748107220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:07:31.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.385+0000 7f774e000700 1 -- 172.21.15.159:0/2448384507 shutdown_connections 2024-02-28T23:07:31.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:07:31.385+0000 7f774e000700 1 -- 172.21.15.159:0/2448384507 wait complete. 2024-02-28T23:07:31.384 INFO:tasks.workunit.client.0.smithi159.stdout:2/700: creat d9/d23/d2c/d55/d13/ff9 x:0 0 0 2024-02-28T23:07:31.387 INFO:tasks.workunit.client.0.smithi159.stdout:1/789: mkdir d6/d12/d31/d10d 0 2024-02-28T23:07:31.388 INFO:tasks.workunit.client.1.smithi184.stdout:3/448: rmdir d1/d4/d5/d40 39 2024-02-28T23:07:31.391 INFO:tasks.workunit.client.0.smithi159.stdout:9/783: creat d4/d76/ff5 x:0 0 0 2024-02-28T23:07:31.397 INFO:tasks.workunit.client.1.smithi184.stdout:2/427: creat d10/d1f/d38/d53/f8c x:0 0 0 2024-02-28T23:07:31.397 INFO:tasks.workunit.client.0.smithi159.stdout:3/719: chown d0/lcc 30 1 2024-02-28T23:07:31.398 INFO:tasks.workunit.client.0.smithi159.stdout:5/756: write d8/d19/d23/d35/d65/db5/fca [709379,129482] 0 2024-02-28T23:07:31.401 INFO:tasks.workunit.client.0.smithi159.stdout:6/786: creat d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/f102 x:0 0 0 2024-02-28T23:07:31.403 INFO:tasks.workunit.client.0.smithi159.stdout:8/900: fsync d2/d11/d52/f4d 0 2024-02-28T23:07:31.404 INFO:tasks.workunit.client.1.smithi184.stdout:0/446: dwrite d0/d1d/f4d [0,4194304] 0 2024-02-28T23:07:31.405 INFO:tasks.workunit.client.0.smithi159.stdout:1/790: creat d6/d12/d33/da7/f10e x:0 0 0 2024-02-28T23:07:31.406 INFO:tasks.workunit.client.1.smithi184.stdout:9/429: rename d5/d47/d4a/c49 to d5/db/de/c94 0 2024-02-28T23:07:31.409 INFO:tasks.workunit.client.1.smithi184.stdout:3/449: stat d1/d4/d6/d1f/d26/d3a/d59/c5f 0 2024-02-28T23:07:31.411 INFO:tasks.workunit.client.1.smithi184.stdout:2/428: unlink d10/d1f/d21/d5e/f6c 0 2024-02-28T23:07:31.411 INFO:tasks.workunit.client.0.smithi159.stdout:4/878: dwrite d9/d42/d54/d9c/ff8 [0,4194304] 0 2024-02-28T23:07:31.412 INFO:tasks.workunit.client.1.smithi184.stdout:0/447: dread d0/df/f41 [0,4194304] 0 2024-02-28T23:07:31.414 INFO:tasks.workunit.client.1.smithi184.stdout:0/448: write d0/d1d/d3a/f60 [253729,44929] 0 2024-02-28T23:07:31.419 INFO:tasks.workunit.client.0.smithi159.stdout:5/757: mknod d8/d19/d23/d35/d41/d77/c10b 0 2024-02-28T23:07:31.421 INFO:tasks.workunit.client.0.smithi159.stdout:6/787: rmdir d0/d1b/d33/d11/d34/d9d/da2/db7/db1 39 2024-02-28T23:07:31.425 INFO:tasks.workunit.client.0.smithi159.stdout:6/788: dread - d0/d1b/dc5/fdf zero size 2024-02-28T23:07:31.427 INFO:tasks.workunit.client.1.smithi184.stdout:2/429: dread d10/d1f/d21/d5e/d15/f2e [0,4194304] 0 2024-02-28T23:07:31.430 INFO:tasks.workunit.client.1.smithi184.stdout:1/492: creat d20/d32/d3e/d82/d85/d8c/fa7 x:0 0 0 2024-02-28T23:07:31.433 INFO:tasks.workunit.client.0.smithi159.stdout:9/784: fsync d4/d3d/d3e/d55/f2e 0 2024-02-28T23:07:31.434 INFO:tasks.workunit.client.1.smithi184.stdout:5/421: rename db/d12/d18/d2e/d3c/f49 to db/d12/d18/d2e/f89 0 2024-02-28T23:07:31.434 INFO:tasks.workunit.client.0.smithi159.stdout:7/657: dread d5/d16/d1a/d27/d46/d65/d81/d83/f8a [0,4194304] 0 2024-02-28T23:07:31.435 INFO:tasks.workunit.client.0.smithi159.stdout:3/720: mknod d0/d6/ce1 0 2024-02-28T23:07:31.436 INFO:tasks.workunit.client.0.smithi159.stdout:4/879: creat d9/d20/d87/d115/d1c/d23/d2d/f135 x:0 0 0 2024-02-28T23:07:31.438 INFO:tasks.workunit.client.1.smithi184.stdout:7/393: dwrite d6/d9/d13/d1e/d2f/f38 [0,4194304] 0 2024-02-28T23:07:31.439 INFO:tasks.workunit.client.0.smithi159.stdout:3/721: read d0/d47/d88/f99 [351533,5849] 0 2024-02-28T23:07:31.439 INFO:tasks.workunit.client.0.smithi159.stdout:5/758: unlink d8/d19/f36 0 2024-02-28T23:07:31.440 INFO:tasks.workunit.client.1.smithi184.stdout:6/365: creat dc/f75 x:0 0 0 2024-02-28T23:07:31.445 INFO:tasks.workunit.client.0.smithi159.stdout:5/759: write d8/d19/d23/d35/d41/d77/fe5 [1569023,99044] 0 2024-02-28T23:07:31.446 INFO:tasks.workunit.client.1.smithi184.stdout:8/441: getdents d1/da/dc/d16 0 2024-02-28T23:07:31.449 INFO:tasks.workunit.client.1.smithi184.stdout:8/442: chown d1/da/dc/d16/d32/d42/d77/f85 11 1 2024-02-28T23:07:31.449 INFO:tasks.workunit.client.0.smithi159.stdout:7/658: symlink d5/d16/d1a/d24/ld6 0 2024-02-28T23:07:31.450 INFO:tasks.workunit.client.1.smithi184.stdout:3/450: rename d1/d4/d1c/f52 to d1/d4/d1c/d61/d87/f8b 0 2024-02-28T23:07:31.452 INFO:tasks.workunit.client.1.smithi184.stdout:3/451: chown d1/d4/d5 22 1 2024-02-28T23:07:31.453 INFO:tasks.workunit.client.1.smithi184.stdout:5/422: write db/d12/d1c/d21/d25/f69 [994005,18399] 0 2024-02-28T23:07:31.458 INFO:tasks.workunit.client.0.smithi159.stdout:1/791: dread d6/d12/d1a/f53 [0,4194304] 0 2024-02-28T23:07:31.464 INFO:tasks.workunit.client.1.smithi184.stdout:8/443: creat d1/da/dc/d16/d4d/d82/faa x:0 0 0 2024-02-28T23:07:31.466 INFO:tasks.workunit.client.1.smithi184.stdout:4/413: sync 2024-02-28T23:07:31.467 INFO:tasks.workunit.client.0.smithi159.stdout:7/659: dread - d5/d56/d50/daa/fae zero size 2024-02-28T23:07:31.468 INFO:tasks.workunit.client.1.smithi184.stdout:7/394: write d6/f35 [606149,114661] 0 2024-02-28T23:07:31.470 INFO:tasks.workunit.client.1.smithi184.stdout:6/366: symlink dc/de/d2a/d5c/d6e/l76 0 2024-02-28T23:07:31.471 INFO:tasks.workunit.client.0.smithi159.stdout:3/722: symlink d0/d47/d88/da5/le2 0 2024-02-28T23:07:31.472 INFO:tasks.workunit.client.0.smithi159.stdout:3/723: chown d0/d2b/l33 139 1 2024-02-28T23:07:31.473 INFO:tasks.workunit.client.1.smithi184.stdout:0/449: link d0/df/d13/d27/d31/l48 d0/df/d13/d27/d31/d5b/d8e/d92/l98 0 2024-02-28T23:07:31.476 INFO:tasks.workunit.client.1.smithi184.stdout:2/430: creat d10/d1f/f8d x:0 0 0 2024-02-28T23:07:31.476 INFO:tasks.workunit.client.0.smithi159.stdout:3/724: read d0/d2b/d55/d75/d6d/f66 [914008,58231] 0 2024-02-28T23:07:31.476 INFO:tasks.workunit.client.0.smithi159.stdout:8/901: getdents d2/d11/d35 0 2024-02-28T23:07:31.477 INFO:tasks.workunit.client.1.smithi184.stdout:8/444: mknod d1/da/dc/d16/d4d/d82/cab 0 2024-02-28T23:07:31.477 INFO:tasks.workunit.client.1.smithi184.stdout:0/450: read d0/d1f/f25 [1365041,55416] 0 2024-02-28T23:07:31.478 INFO:tasks.workunit.client.1.smithi184.stdout:1/493: dread d20/d32/d3e/f3f [0,4194304] 0 2024-02-28T23:07:31.480 INFO:tasks.workunit.client.0.smithi159.stdout:9/785: truncate d4/d3d/d3e/d55/d9e/db3/dc1/fc4 995088 0 2024-02-28T23:07:31.483 INFO:tasks.workunit.client.1.smithi184.stdout:5/423: link db/d12/d1c/d21/d2f/f7a db/d12/d1c/d21/d25/f8a 0 2024-02-28T23:07:31.484 INFO:tasks.workunit.client.0.smithi159.stdout:6/789: write d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dac/dd9/feb [557846,16172] 0 2024-02-28T23:07:31.486 INFO:tasks.workunit.client.0.smithi159.stdout:7/660: write d5/d56/d50/d88/fd0 [3133343,69973] 0 2024-02-28T23:07:31.488 INFO:tasks.workunit.client.1.smithi184.stdout:7/395: truncate d6/d9/d13/d1e/d2f/f44 650877 0 2024-02-28T23:07:31.488 INFO:tasks.workunit.client.0.smithi159.stdout:6/790: chown d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/fde 330829 1 2024-02-28T23:07:31.489 INFO:tasks.workunit.client.1.smithi184.stdout:4/414: write d1/d8/d3d/d44/f66 [1351940,66584] 0 2024-02-28T23:07:31.491 INFO:tasks.workunit.client.0.smithi159.stdout:6/791: readlink d0/d1b/d33/d3f/la4 0 2024-02-28T23:07:31.491 INFO:tasks.workunit.client.0.smithi159.stdout:8/902: fdatasync d2/d73/ffc 0 2024-02-28T23:07:31.492 INFO:tasks.workunit.client.1.smithi184.stdout:3/452: dwrite d1/d4/d6/d1e/d72/f54 [0,4194304] 0 2024-02-28T23:07:31.497 INFO:tasks.workunit.client.1.smithi184.stdout:3/453: chown d1/d4/d6/d1f/d26/f2a 25458 1 2024-02-28T23:07:31.498 INFO:tasks.workunit.client.1.smithi184.stdout:7/396: truncate d6/d9/d13/d14/d45/f84 137536 0 2024-02-28T23:07:31.499 INFO:tasks.workunit.client.0.smithi159.stdout:5/760: truncate d8/d19/d23/d35/d41/daa/d79/f107 787620 0 2024-02-28T23:07:31.503 INFO:tasks.workunit.client.1.smithi184.stdout:8/445: dwrite d1/da/dc/d16/d32/d80/f9e [0,4194304] 0 2024-02-28T23:07:31.508 INFO:tasks.workunit.client.0.smithi159.stdout:7/661: write d5/fb [1962004,106465] 0 2024-02-28T23:07:31.509 INFO:tasks.workunit.client.0.smithi159.stdout:4/880: getdents d9 0 2024-02-28T23:07:31.514 INFO:tasks.workunit.client.1.smithi184.stdout:1/494: dread d20/f25 [4194304,4194304] 0 2024-02-28T23:07:31.514 INFO:tasks.workunit.client.1.smithi184.stdout:9/430: sync 2024-02-28T23:07:31.515 INFO:tasks.workunit.client.0.smithi159.stdout:8/903: symlink d2/d11/d52/d26/d36/l11c 0 2024-02-28T23:07:31.515 INFO:tasks.workunit.client.1.smithi184.stdout:9/431: chown d5/d17 383270186 1 2024-02-28T23:07:31.518 INFO:tasks.workunit.client.0.smithi159.stdout:6/792: mknod d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88/c103 0 2024-02-28T23:07:31.519 INFO:tasks.workunit.client.0.smithi159.stdout:1/792: dwrite d6/d12/d1a/f23 [0,4194304] 0 2024-02-28T23:07:31.520 INFO:tasks.workunit.client.1.smithi184.stdout:0/451: dwrite d0/df/d13/d27/d31/f45 [0,4194304] 0 2024-02-28T23:07:31.520 INFO:tasks.workunit.client.1.smithi184.stdout:2/431: creat d10/d1f/d38/d54/f8e x:0 0 0 2024-02-28T23:07:31.523 INFO:tasks.workunit.client.0.smithi159.stdout:9/786: symlink d4/lf6 0 2024-02-28T23:07:31.531 INFO:tasks.workunit.client.1.smithi184.stdout:7/397: symlink d6/d9/da/dc/d49/d50/l93 0 2024-02-28T23:07:31.531 INFO:tasks.workunit.client.1.smithi184.stdout:1/495: dwrite d20/d46/d90/f92 [0,4194304] 0 2024-02-28T23:07:31.536 INFO:tasks.workunit.client.1.smithi184.stdout:8/446: mkdir d1/da/d33/dac 0 2024-02-28T23:07:31.543 INFO:tasks.workunit.client.1.smithi184.stdout:3/454: write d1/d4/d6/d1f/d26/f2a [4236896,103885] 0 2024-02-28T23:07:31.546 INFO:tasks.workunit.client.1.smithi184.stdout:6/367: rmdir dc/de/d2a/d5c/d66 0 2024-02-28T23:07:31.551 INFO:tasks.workunit.client.0.smithi159.stdout:4/881: creat d9/d42/d54/d56/df5/f136 x:0 0 0 2024-02-28T23:07:31.551 INFO:tasks.workunit.client.0.smithi159.stdout:1/793: dwrite d6/d1d/d46/d88/fef [0,4194304] 0 2024-02-28T23:07:31.553 INFO:tasks.workunit.client.0.smithi159.stdout:9/787: dwrite d4/d3d/fe1 [0,4194304] 0 2024-02-28T23:07:31.554 INFO:tasks.workunit.client.1.smithi184.stdout:0/452: truncate d0/d1f/f4b 7133312 0 2024-02-28T23:07:31.559 INFO:tasks.workunit.client.0.smithi159.stdout:7/662: symlink d5/d16/d1a/d27/ld7 0 2024-02-28T23:07:31.559 INFO:tasks.workunit.client.1.smithi184.stdout:4/415: mknod d1/c7e 0 2024-02-28T23:07:31.560 INFO:tasks.workunit.client.0.smithi159.stdout:9/788: chown d4/d3d/d3e/d55/d4c/l60 3868924 1 2024-02-28T23:07:31.560 INFO:tasks.workunit.client.0.smithi159.stdout:3/725: link d0/d3f/dd2/d6a/ld7 d0/d3f/dd2/le3 0 2024-02-28T23:07:31.564 INFO:tasks.workunit.client.1.smithi184.stdout:4/416: write d1/dc/df/d38/d57/f71 [749238,96294] 0 2024-02-28T23:07:31.564 INFO:tasks.workunit.client.1.smithi184.stdout:7/398: write d6/d9/d13/f28 [3657648,843] 0 2024-02-28T23:07:31.564 INFO:tasks.workunit.client.0.smithi159.stdout:5/761: readlink d8/d19/d23/d35/d38/l55 0 2024-02-28T23:07:31.568 INFO:tasks.workunit.client.1.smithi184.stdout:1/496: rename d20/d32/d3e/d82/d85/d8c/fa7 to d20/d32/d3e/d82/fa8 0 2024-02-28T23:07:31.568 INFO:tasks.workunit.client.1.smithi184.stdout:5/424: dwrite db/d12/f85 [0,4194304] 0 2024-02-28T23:07:31.568 INFO:tasks.workunit.client.0.smithi159.stdout:1/794: creat d6/d12/d1a/d92/d97/f10f x:0 0 0 2024-02-28T23:07:31.574 INFO:tasks.workunit.client.0.smithi159.stdout:7/663: truncate d5/f1e 2097588 0 2024-02-28T23:07:31.576 INFO:tasks.workunit.client.1.smithi184.stdout:6/368: fdatasync dc/de/f20 0 2024-02-28T23:07:31.577 INFO:tasks.workunit.client.1.smithi184.stdout:9/432: chown d5/db/d5c/d5e/c81 1660042110 1 2024-02-28T23:07:31.579 INFO:tasks.workunit.client.1.smithi184.stdout:6/369: chown dc/de/d10 9 1 2024-02-28T23:07:31.580 INFO:tasks.workunit.client.0.smithi159.stdout:5/762: readlink d8/d19/d23/d35/d38/l9e 0 2024-02-28T23:07:31.581 INFO:tasks.workunit.client.0.smithi159.stdout:1/795: mkdir d6/d12/d31/d69/dc0/dca/d110 0 2024-02-28T23:07:31.582 INFO:tasks.workunit.client.1.smithi184.stdout:9/433: chown d5/db/de/d10/d6a/f91 1832 1 2024-02-28T23:07:31.586 INFO:tasks.workunit.client.0.smithi159.stdout:6/793: dread d0/d1b/f3c [4194304,4194304] 0 2024-02-28T23:07:31.588 INFO:tasks.workunit.client.0.smithi159.stdout:9/789: truncate d4/d3d/d3e/d55/f49 1764789 0 2024-02-28T23:07:31.588 INFO:tasks.workunit.client.1.smithi184.stdout:4/417: read d1/d8/d19/f39 [388546,50111] 0 2024-02-28T23:07:31.594 INFO:tasks.workunit.client.1.smithi184.stdout:5/425: dwrite db/d12/f47 [0,4194304] 0 2024-02-28T23:07:31.595 INFO:tasks.workunit.client.0.smithi159.stdout:3/726: truncate d0/d2b/d55/d75/d6d/f66 2568516 0 2024-02-28T23:07:31.596 INFO:tasks.workunit.client.1.smithi184.stdout:0/453: rename d0/df/f61 to d0/df/d13/d5a/d95/f99 0 2024-02-28T23:07:31.598 INFO:tasks.workunit.client.1.smithi184.stdout:9/434: dread d5/db/de/f6d [0,4194304] 0 2024-02-28T23:07:31.603 INFO:tasks.workunit.client.1.smithi184.stdout:3/455: dread d1/d4/d6/d1e/d72/f50 [4194304,4194304] 0 2024-02-28T23:07:31.605 INFO:tasks.workunit.client.0.smithi159.stdout:4/882: link d9/d20/d87/d115/d1c/d23/d2d/f8d d9/d20/d87/d115/d1c/d23/d7a/f137 0 2024-02-28T23:07:31.607 INFO:tasks.workunit.client.0.smithi159.stdout:6/794: dread - d0/d1b/d5b/f9c zero size 2024-02-28T23:07:31.609 INFO:tasks.workunit.client.1.smithi184.stdout:8/447: dread d1/da/d10/f2d [0,4194304] 0 2024-02-28T23:07:31.610 INFO:tasks.workunit.client.0.smithi159.stdout:3/727: creat d0/d2b/d55/fe4 x:0 0 0 2024-02-28T23:07:31.610 INFO:tasks.workunit.client.1.smithi184.stdout:7/399: symlink d6/d9/d13/d1e/d2f/l94 0 2024-02-28T23:07:31.611 INFO:tasks.workunit.client.0.smithi159.stdout:7/664: getdents d5/d16/d1a/d24/d64/db4/dc8 0 2024-02-28T23:07:31.612 INFO:tasks.workunit.client.0.smithi159.stdout:6/795: write d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/f28 [3475989,115399] 0 2024-02-28T23:07:31.613 INFO:tasks.workunit.client.0.smithi159.stdout:5/763: rename d8/d19/d23/d35/d41/daa/df5 to d8/d19/d23/d35/d41/d92/d10c 0 2024-02-28T23:07:31.615 INFO:tasks.workunit.client.1.smithi184.stdout:2/432: sync 2024-02-28T23:07:31.616 INFO:tasks.workunit.client.0.smithi159.stdout:4/883: chown d9/d42/db1/f102 6613887 1 2024-02-28T23:07:31.619 INFO:tasks.workunit.client.0.smithi159.stdout:3/728: unlink d0/d3f/dd2/f5a 0 2024-02-28T23:07:31.622 INFO:tasks.workunit.client.1.smithi184.stdout:4/418: dwrite d1/d4/f1f [0,4194304] 0 2024-02-28T23:07:31.623 INFO:tasks.workunit.client.1.smithi184.stdout:6/370: creat dc/d60/d62/d6f/f77 x:0 0 0 2024-02-28T23:07:31.623 INFO:tasks.workunit.client.1.smithi184.stdout:5/426: dwrite f8 [0,4194304] 0 2024-02-28T23:07:31.624 INFO:tasks.workunit.client.1.smithi184.stdout:8/448: symlink d1/da/df/d20/lad 0 2024-02-28T23:07:31.627 INFO:tasks.workunit.client.0.smithi159.stdout:3/729: dread d0/d3f/dd2/d7c/d79/f98 [0,4194304] 0 2024-02-28T23:07:31.628 INFO:tasks.workunit.client.1.smithi184.stdout:5/427: chown db/d1f/f42 3982348 1 2024-02-28T23:07:31.629 INFO:tasks.workunit.client.1.smithi184.stdout:3/456: mknod d1/d4/d6/d1f/d26/d3a/d59/d6a/d74/c8c 0 2024-02-28T23:07:31.630 INFO:tasks.workunit.client.1.smithi184.stdout:9/435: dwrite d5/fa [0,4194304] 0 2024-02-28T23:07:31.632 INFO:tasks.workunit.client.1.smithi184.stdout:1/497: dread d20/d32/d3e/f4a [0,4194304] 0 2024-02-28T23:07:31.636 INFO:tasks.workunit.client.1.smithi184.stdout:0/454: write d0/d1f/f28 [1372819,1797] 0 2024-02-28T23:07:31.637 INFO:tasks.workunit.client.0.smithi159.stdout:9/790: link d4/l9a d4/d3d/d3e/d55/d9e/db3/lf7 0 2024-02-28T23:07:31.638 INFO:tasks.workunit.client.1.smithi184.stdout:6/371: mkdir dc/d60/d78 0 2024-02-28T23:07:31.639 INFO:tasks.workunit.client.1.smithi184.stdout:0/455: readlink d0/df/d13/d27/l36 0 2024-02-28T23:07:31.640 INFO:tasks.workunit.client.0.smithi159.stdout:5/764: creat d8/d19/d23/d35/d65/da3/df4/da5/d90/f10d x:0 0 0 2024-02-28T23:07:31.644 INFO:tasks.workunit.client.1.smithi184.stdout:4/419: fsync d1/d4/f1f 0 2024-02-28T23:07:31.647 INFO:tasks.workunit.client.1.smithi184.stdout:9/436: mkdir d5/db/d65/d95 0 2024-02-28T23:07:31.649 INFO:tasks.workunit.client.1.smithi184.stdout:9/437: chown d5/db/de/d10/d12/f2d 897016 1 2024-02-28T23:07:31.659 INFO:tasks.workunit.client.0.smithi159.stdout:6/796: creat d0/f104 x:0 0 0 2024-02-28T23:07:31.659 INFO:tasks.workunit.client.1.smithi184.stdout:8/449: mknod d1/da/dc/d16/d4d/d8a/cae 0 2024-02-28T23:07:31.667 INFO:tasks.workunit.client.1.smithi184.stdout:6/372: mkdir dc/de/d2a/d5c/d79 0 2024-02-28T23:07:31.667 INFO:tasks.workunit.client.1.smithi184.stdout:7/400: truncate d6/f8e 1416344 0 2024-02-28T23:07:31.668 INFO:tasks.workunit.client.1.smithi184.stdout:0/456: creat d0/d1f/f9a x:0 0 0 2024-02-28T23:07:31.668 INFO:tasks.workunit.client.1.smithi184.stdout:4/420: readlink d1/dc/df/d27/l6b 0 2024-02-28T23:07:31.668 INFO:tasks.workunit.client.0.smithi159.stdout:3/730: creat d0/d6/d3e/da9/fe5 x:0 0 0 2024-02-28T23:07:31.669 INFO:tasks.workunit.client.0.smithi159.stdout:7/665: creat d5/d16/d1a/d27/d46/fd8 x:0 0 0 2024-02-28T23:07:31.669 INFO:tasks.workunit.client.0.smithi159.stdout:9/791: mknod d4/d3d/d3e/d4a/dc5/cf8 0 2024-02-28T23:07:31.670 INFO:tasks.workunit.client.0.smithi159.stdout:1/796: truncate d6/d1d/d46/d88/dd3/d63/f74 533005 0 2024-02-28T23:07:31.672 INFO:tasks.workunit.client.0.smithi159.stdout:5/765: stat d8/f17 0 2024-02-28T23:07:31.672 INFO:tasks.workunit.client.0.smithi159.stdout:9/792: chown d4/d3d/d3e/f72 225 1 2024-02-28T23:07:31.675 INFO:tasks.workunit.client.0.smithi159.stdout:7/666: truncate d5/d56/f5a 187759 0 2024-02-28T23:07:31.675 INFO:tasks.workunit.client.0.smithi159.stdout:1/797: rmdir d6/d12 39 2024-02-28T23:07:31.675 INFO:tasks.workunit.client.1.smithi184.stdout:2/433: dread d10/f43 [0,4194304] 0 2024-02-28T23:07:31.678 INFO:tasks.workunit.client.1.smithi184.stdout:4/421: getdents d1/dc/df/d38/d3c 0 2024-02-28T23:07:31.679 INFO:tasks.workunit.client.0.smithi159.stdout:7/667: chown d5/d56/d50/d88/fd0 710 1 2024-02-28T23:07:31.679 INFO:tasks.workunit.client.0.smithi159.stdout:4/884: getdents d9/d20/d87 0 2024-02-28T23:07:31.682 INFO:tasks.workunit.client.1.smithi184.stdout:4/422: write d1/d8/d37/f4c [4129924,11472] 0 2024-02-28T23:07:31.684 INFO:tasks.workunit.client.1.smithi184.stdout:1/498: dwrite d20/d46/f57 [0,4194304] 0 2024-02-28T23:07:31.687 INFO:tasks.workunit.client.0.smithi159.stdout:9/793: read d4/d3d/d3e/d4a/f59 [15158,4986] 0 2024-02-28T23:07:31.689 INFO:tasks.workunit.client.1.smithi184.stdout:7/401: creat d6/d9/da/dc/d49/f95 x:0 0 0 2024-02-28T23:07:31.689 INFO:tasks.workunit.client.1.smithi184.stdout:6/373: rename dc/de/d2a/l57 to dc/de/l7a 0 2024-02-28T23:07:31.690 INFO:tasks.workunit.client.0.smithi159.stdout:7/668: symlink d5/d16/d1a/d27/d46/d65/d81/d98/ld9 0 2024-02-28T23:07:31.691 INFO:tasks.workunit.client.1.smithi184.stdout:9/438: dwrite d5/d47/d68/d7c/f8b [0,4194304] 0 2024-02-28T23:07:31.705 INFO:tasks.workunit.client.1.smithi184.stdout:2/434: dwrite d10/d1f/d38/d54/f59 [8388608,4194304] 0 2024-02-28T23:07:31.706 INFO:tasks.workunit.client.1.smithi184.stdout:3/457: sync 2024-02-28T23:07:31.707 INFO:tasks.workunit.client.0.smithi159.stdout:5/766: dread d8/d19/d23/d35/d65/da3/df4/feb [0,4194304] 0 2024-02-28T23:07:31.709 INFO:tasks.workunit.client.0.smithi159.stdout:7/669: dwrite d5/d16/d1a/d27/d46/f99 [0,4194304] 0 2024-02-28T23:07:31.712 INFO:tasks.workunit.client.1.smithi184.stdout:2/435: truncate d10/d1f/d38/d53/f8c 267801 0 2024-02-28T23:07:31.738 INFO:tasks.workunit.client.1.smithi184.stdout:5/428: write db/d12/d1c/f3a [1489908,10407] 0 2024-02-28T23:07:31.744 INFO:tasks.workunit.client.1.smithi184.stdout:2/436: dwrite d10/d1f/d38/d54/f8e [0,4194304] 0 2024-02-28T23:07:31.752 INFO:tasks.workunit.client.1.smithi184.stdout:1/499: dread d20/d32/f34 [0,4194304] 0 2024-02-28T23:07:31.773 INFO:tasks.workunit.client.1.smithi184.stdout:8/450: write d1/da/dc/d16/d29/f54 [1023011,12189] 0 2024-02-28T23:07:31.781 INFO:tasks.workunit.client.0.smithi159.stdout:3/731: dwrite d0/d47/fc5 [0,4194304] 0 2024-02-28T23:07:31.784 INFO:tasks.workunit.client.1.smithi184.stdout:7/402: dread - d6/d9/f5e zero size 2024-02-28T23:07:31.786 INFO:tasks.workunit.client.1.smithi184.stdout:7/403: read - d6/d9/f5e zero size 2024-02-28T23:07:31.786 INFO:tasks.workunit.client.0.smithi159.stdout:5/767: mkdir d8/d19/d23/d35/d41/daa/d10e 0 2024-02-28T23:07:31.790 INFO:tasks.workunit.client.1.smithi184.stdout:0/457: rename d0/df/d13/l54 to d0/d7c/l9b 0 2024-02-28T23:07:31.798 INFO:tasks.workunit.client.1.smithi184.stdout:8/451: dwrite d1/da/dc/d16/d4d/f8b [0,4194304] 0 2024-02-28T23:07:31.799 INFO:tasks.workunit.client.1.smithi184.stdout:3/458: chown d1/d4/d6/d1f/d26/d3a/d59/f7d 488362 1 2024-02-28T23:07:31.805 INFO:tasks.workunit.client.0.smithi159.stdout:3/732: chown d0/d6/lf 9854295 1 2024-02-28T23:07:31.808 INFO:tasks.workunit.client.0.smithi159.stdout:5/768: dread d8/d19/d23/d2a/f9f [0,4194304] 0 2024-02-28T23:07:31.812 INFO:tasks.workunit.client.0.smithi159.stdout:4/885: getdents d9/d42/dc8 0 2024-02-28T23:07:31.816 INFO:tasks.workunit.client.0.smithi159.stdout:5/769: getdents d8/d19/d23/d35/d65/da3/dd2/def 0 2024-02-28T23:07:31.827 INFO:tasks.workunit.client.0.smithi159.stdout:4/886: getdents d9/d20/d87/d115/d1c/d23/d7a/d10d 0 2024-02-28T23:07:31.843 INFO:tasks.workunit.client.1.smithi184.stdout:1/500: creat d20/d32/d4d/fa9 x:0 0 0 2024-02-28T23:07:31.844 INFO:tasks.workunit.client.1.smithi184.stdout:4/423: symlink d1/d8/d3d/d44/d77/l7f 0 2024-02-28T23:07:31.848 INFO:tasks.workunit.client.1.smithi184.stdout:7/404: chown d6/d9/d13/d1e/d2f/d34/d47 19 1 2024-02-28T23:07:31.851 INFO:tasks.workunit.client.1.smithi184.stdout:0/458: mknod d0/df/d13/d27/d31/d5b/d8e/d91/c9c 0 2024-02-28T23:07:31.852 INFO:tasks.workunit.client.0.smithi159.stdout:9/794: unlink d4/d3d/d3e/d55/d4c/db6/ce8 0 2024-02-28T23:07:31.855 INFO:tasks.workunit.client.1.smithi184.stdout:8/452: mknod d1/da/d33/caf 0 2024-02-28T23:07:31.856 INFO:tasks.workunit.client.1.smithi184.stdout:0/459: write d0/df/d13/d5a/f70 [1447183,75045] 0 2024-02-28T23:07:31.856 INFO:tasks.workunit.client.1.smithi184.stdout:5/429: symlink db/d12/d1c/d80/l8b 0 2024-02-28T23:07:31.858 INFO:tasks.workunit.client.1.smithi184.stdout:1/501: creat d20/d32/d3e/d91/faa x:0 0 0 2024-02-28T23:07:31.863 INFO:tasks.workunit.client.1.smithi184.stdout:5/430: write db/d44/f82 [839633,95419] 0 2024-02-28T23:07:31.864 INFO:tasks.workunit.client.1.smithi184.stdout:8/453: unlink d1/da/dc/d16/d4d/d82/faa 0 2024-02-28T23:07:31.866 INFO:tasks.workunit.client.1.smithi184.stdout:0/460: write d0/d1d/f6d [318979,112046] 0 2024-02-28T23:07:31.871 INFO:tasks.workunit.client.1.smithi184.stdout:5/431: write db/d1f/f78 [1189161,95794] 0 2024-02-28T23:07:31.876 INFO:tasks.workunit.client.1.smithi184.stdout:3/459: dread d1/d4/f89 [0,4194304] 0 2024-02-28T23:07:31.876 INFO:tasks.workunit.client.1.smithi184.stdout:0/461: mkdir d0/df/d13/d9d 0 2024-02-28T23:07:31.876 INFO:tasks.workunit.client.1.smithi184.stdout:4/424: dwrite d1/dc/df/d27/f79 [0,4194304] 0 2024-02-28T23:07:31.880 INFO:tasks.workunit.client.1.smithi184.stdout:1/502: getdents d20/d32/d4b 0 2024-02-28T23:07:31.882 INFO:tasks.workunit.client.1.smithi184.stdout:0/462: dread - d0/df/f63 zero size 2024-02-28T23:07:31.883 INFO:tasks.workunit.client.1.smithi184.stdout:5/432: symlink db/d12/d18/d2e/d3c/d5d/d66/l8c 0 2024-02-28T23:07:31.883 INFO:tasks.workunit.client.1.smithi184.stdout:3/460: chown d1/d4/d6/d1f/d26/c69 203699563 1 2024-02-28T23:07:31.883 INFO:tasks.workunit.client.1.smithi184.stdout:8/454: dread d1/da/dc/d16/d32/f4b [0,4194304] 0 2024-02-28T23:07:31.887 INFO:tasks.workunit.client.1.smithi184.stdout:3/461: readlink d1/d4/d6/d1f/d26/l49 0 2024-02-28T23:07:31.887 INFO:tasks.workunit.client.1.smithi184.stdout:5/433: chown db/d12/d1c/d21/d25/l29 69208 1 2024-02-28T23:07:31.891 INFO:tasks.workunit.client.0.smithi159.stdout:9/795: dread d4/fe [0,4194304] 0 2024-02-28T23:07:31.892 INFO:tasks.workunit.client.1.smithi184.stdout:3/462: write d1/d4/d6/d1f/d26/d3a/d59/d6a/f77 [588470,119572] 0 2024-02-28T23:07:31.894 INFO:tasks.workunit.client.1.smithi184.stdout:8/455: mknod d1/da/df/d20/cb0 0 2024-02-28T23:07:31.895 INFO:tasks.workunit.client.1.smithi184.stdout:0/463: mkdir d0/df/d13/d27/d31/d5b/d9e 0 2024-02-28T23:07:31.899 INFO:tasks.workunit.client.0.smithi159.stdout:9/796: link d4/f5 d4/d3d/d3e/d55/d37/d62/d77/db9/dc7/ff9 0 2024-02-28T23:07:31.903 INFO:tasks.workunit.client.1.smithi184.stdout:1/503: dwrite d20/d32/d4d/f7d [0,4194304] 0 2024-02-28T23:07:31.905 INFO:tasks.workunit.client.0.smithi159.stdout:9/797: write d4/d3d/d3e/d55/d37/d62/d6a/fe6 [838678,10255] 0 2024-02-28T23:07:31.910 INFO:tasks.workunit.client.1.smithi184.stdout:0/464: link d0/df/d13/d27/d58/c74 d0/d7c/c9f 0 2024-02-28T23:07:31.910 INFO:tasks.workunit.client.1.smithi184.stdout:8/456: dread d1/da/dc/d16/d4d/f5a [0,4194304] 0 2024-02-28T23:07:31.911 INFO:tasks.workunit.client.1.smithi184.stdout:1/504: symlink d20/d32/lab 0 2024-02-28T23:07:31.914 INFO:tasks.workunit.client.1.smithi184.stdout:0/465: write d0/df/d13/d27/d58/f87 [115536,64660] 0 2024-02-28T23:07:31.915 INFO:tasks.workunit.client.0.smithi159.stdout:1/798: write d6/d12/d33/d3c/f8d [490187,61316] 0 2024-02-28T23:07:31.917 INFO:tasks.workunit.client.0.smithi159.stdout:1/799: chown d6/d1d/d1f/db8/dcc 217693 1 2024-02-28T23:07:31.920 INFO:tasks.workunit.client.1.smithi184.stdout:1/505: write d20/f47 [253761,86226] 0 2024-02-28T23:07:31.922 INFO:tasks.workunit.client.0.smithi159.stdout:1/800: creat d6/d12/d31/d69/f111 x:0 0 0 2024-02-28T23:07:31.924 INFO:tasks.workunit.client.1.smithi184.stdout:0/466: rename d0/l8 to d0/la0 0 2024-02-28T23:07:31.926 INFO:tasks.workunit.client.0.smithi159.stdout:1/801: creat d6/d1d/d46/d88/dd3/d63/f112 x:0 0 0 2024-02-28T23:07:31.931 INFO:tasks.workunit.client.1.smithi184.stdout:0/467: symlink d0/d1d/d4c/d93/la1 0 2024-02-28T23:07:31.932 INFO:tasks.workunit.client.0.smithi159.stdout:1/802: rename d6/d1d/d46/d88/dd3/d9c/db3/dc4/cd6 to d6/d1d/d46/df9/d105/c113 0 2024-02-28T23:07:31.934 INFO:tasks.workunit.client.1.smithi184.stdout:8/457: dwrite d1/da/dc/d16/d32/f46 [0,4194304] 0 2024-02-28T23:07:31.934 INFO:tasks.workunit.client.1.smithi184.stdout:0/468: stat d0/d7c/l9b 0 2024-02-28T23:07:31.934 INFO:tasks.workunit.client.0.smithi159.stdout:1/803: write d6/d1d/d46/d88/fef [5045044,77222] 0 2024-02-28T23:07:31.936 INFO:tasks.workunit.client.1.smithi184.stdout:0/469: chown d0/c9 1885 1 2024-02-28T23:07:31.940 INFO:tasks.workunit.client.0.smithi159.stdout:1/804: creat d6/d1d/d46/df9/d105/f114 x:0 0 0 2024-02-28T23:07:31.943 INFO:tasks.workunit.client.1.smithi184.stdout:0/470: mknod d0/df/d13/d27/d31/d5b/d8e/ca2 0 2024-02-28T23:07:31.943 INFO:tasks.workunit.client.1.smithi184.stdout:1/506: dwrite d20/d32/d3e/d82/d85/fa6 [0,4194304] 0 2024-02-28T23:07:31.946 INFO:tasks.workunit.client.1.smithi184.stdout:0/471: readlink d0/df/d13/d27/d31/l7e 0 2024-02-28T23:07:31.948 INFO:tasks.workunit.client.1.smithi184.stdout:1/507: creat d20/d32/d3e/d61/d8b/fac x:0 0 0 2024-02-28T23:07:31.951 INFO:tasks.workunit.client.1.smithi184.stdout:0/472: unlink d0/d1d/l5d 0 2024-02-28T23:07:31.955 INFO:tasks.workunit.client.1.smithi184.stdout:8/458: dwrite d1/da/dc/d16/d29/f54 [0,4194304] 0 2024-02-28T23:07:31.957 INFO:tasks.workunit.client.1.smithi184.stdout:5/434: unlink db/d12/d18/d2e/c57 0 2024-02-28T23:07:31.958 INFO:tasks.workunit.client.1.smithi184.stdout:5/435: chown db/d12/d18 293191740 1 2024-02-28T23:07:31.958 INFO:tasks.workunit.client.1.smithi184.stdout:8/459: chown d1/da/d10/c1e 221868 1 2024-02-28T23:07:31.959 INFO:tasks.workunit.client.0.smithi159.stdout:4/887: truncate d9/d42/d54/d9c/ff8 2583633 0 2024-02-28T23:07:31.960 INFO:tasks.workunit.client.1.smithi184.stdout:8/460: readlink d1/da/dc/d16/d29/l9a 0 2024-02-28T23:07:31.963 INFO:tasks.workunit.client.0.smithi159.stdout:4/888: creat d9/d42/d54/d55/da8/f138 x:0 0 0 2024-02-28T23:07:31.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/461: unlink d1/da/dc/c2b 0 2024-02-28T23:07:31.966 INFO:tasks.workunit.client.0.smithi159.stdout:4/889: chown d9/d20/d87/d115/d1c/c74 6244833 1 2024-02-28T23:07:31.967 INFO:tasks.workunit.client.0.smithi159.stdout:5/770: rmdir d8/d19/d23/d35/d65/da3/dd2 39 2024-02-28T23:07:31.969 INFO:tasks.workunit.client.1.smithi184.stdout:5/436: truncate db/d12/d1c/d21/f5e 576935 0 2024-02-28T23:07:31.970 INFO:tasks.workunit.client.1.smithi184.stdout:6/374: write dc/de/d10/f3d [1939638,119856] 0 2024-02-28T23:07:31.972 INFO:tasks.workunit.client.0.smithi159.stdout:4/890: rename d9/d4c/d6c/f68 to d9/d4c/d6c/d98/d103/f139 0 2024-02-28T23:07:31.973 INFO:tasks.workunit.client.1.smithi184.stdout:6/375: dread - dc/f4f zero size 2024-02-28T23:07:31.974 INFO:tasks.workunit.client.1.smithi184.stdout:5/437: fdatasync db/d12/f39 0 2024-02-28T23:07:31.980 INFO:tasks.workunit.client.1.smithi184.stdout:5/438: creat db/d12/d50/f8d x:0 0 0 2024-02-28T23:07:31.980 INFO:tasks.workunit.client.1.smithi184.stdout:0/473: dwrite d0/df/d13/d27/f39 [4194304,4194304] 0 2024-02-28T23:07:31.980 INFO:tasks.workunit.client.1.smithi184.stdout:6/376: write dc/de/d10/f3d [570745,2311] 0 2024-02-28T23:07:31.983 INFO:tasks.workunit.client.1.smithi184.stdout:2/437: rmdir d10/d1f/d38 39 2024-02-28T23:07:31.983 INFO:tasks.workunit.client.1.smithi184.stdout:6/377: fdatasync dc/d53/f6b 0 2024-02-28T23:07:31.986 INFO:tasks.workunit.client.1.smithi184.stdout:4/425: write d1/d8/f4a [119309,107541] 0 2024-02-28T23:07:31.986 INFO:tasks.workunit.client.0.smithi159.stdout:1/805: symlink d6/d12/d1a/d92/l115 0 2024-02-28T23:07:31.989 INFO:tasks.workunit.client.1.smithi184.stdout:9/439: dwrite d5/db/de/d10/d12/d2f/d3f/f45 [0,4194304] 0 2024-02-28T23:07:31.990 INFO:tasks.workunit.client.1.smithi184.stdout:3/463: write d1/d4/d6/d1f/d24/f3e [462755,4806] 0 2024-02-28T23:07:31.993 INFO:tasks.workunit.client.1.smithi184.stdout:2/438: chown d10/d1f/d21/d5e/d15/d24/d5f/d63 85022 1 2024-02-28T23:07:31.994 INFO:tasks.workunit.client.1.smithi184.stdout:0/474: mkdir d0/df/d13/d27/d31/d5b/d8e/da3 0 2024-02-28T23:07:31.996 INFO:tasks.workunit.client.0.smithi159.stdout:1/806: rename d6/d12/d33/d3c/faa to d6/d12/d31/d69/dc0/df3/f116 0 2024-02-28T23:07:31.998 INFO:tasks.workunit.client.1.smithi184.stdout:4/426: dread - d1/dc/df/d22/d51/f72 zero size 2024-02-28T23:07:31.999 INFO:tasks.workunit.client.1.smithi184.stdout:7/405: dwrite d6/d9/d13/d1e/d2f/d34/d47/f58 [0,4194304] 0 2024-02-28T23:07:31.999 INFO:tasks.workunit.client.0.smithi159.stdout:0/892: sync 2024-02-28T23:07:32.002 INFO:tasks.workunit.client.1.smithi184.stdout:0/475: write d0/d1d/d4c/f6f [500807,40010] 0 2024-02-28T23:07:32.013 INFO:tasks.workunit.client.0.smithi159.stdout:4/891: mkdir d9/d20/d87/d13a 0 2024-02-28T23:07:32.013 INFO:tasks.workunit.client.0.smithi159.stdout:4/892: stat d9/fa2 0 2024-02-28T23:07:32.018 INFO:tasks.workunit.client.1.smithi184.stdout:6/378: dwrite dc/de/d2a/f65 [0,4194304] 0 2024-02-28T23:07:32.020 INFO:tasks.workunit.client.1.smithi184.stdout:2/439: creat d10/d1f/d38/f8f x:0 0 0 2024-02-28T23:07:32.023 INFO:tasks.workunit.client.0.smithi159.stdout:5/771: write d8/f13 [3593606,106238] 0 2024-02-28T23:07:32.024 INFO:tasks.workunit.client.0.smithi159.stdout:4/893: rmdir d9/d4c 39 2024-02-28T23:07:32.025 INFO:tasks.workunit.client.1.smithi184.stdout:2/440: readlink d10/d1f/d21/l61 0 2024-02-28T23:07:32.028 INFO:tasks.workunit.client.0.smithi159.stdout:5/772: write d8/d19/d23/d35/d41/daa/d79/fe4 [349591,89088] 0 2024-02-28T23:07:32.033 INFO:tasks.workunit.client.1.smithi184.stdout:2/441: dread d10/f34 [0,4194304] 0 2024-02-28T23:07:32.033 INFO:tasks.workunit.client.1.smithi184.stdout:4/427: dwrite d1/d8/f4a [0,4194304] 0 2024-02-28T23:07:32.034 INFO:tasks.workunit.client.1.smithi184.stdout:1/508: dwrite f1d [0,4194304] 0 2024-02-28T23:07:32.035 INFO:tasks.workunit.client.1.smithi184.stdout:4/428: fdatasync d1/f33 0 2024-02-28T23:07:32.037 INFO:tasks.workunit.client.1.smithi184.stdout:1/509: chown c0 348465 1 2024-02-28T23:07:32.037 INFO:tasks.workunit.client.0.smithi159.stdout:5/773: creat d8/d19/d23/d35/d41/daa/d88/f10f x:0 0 0 2024-02-28T23:07:32.038 INFO:tasks.workunit.client.1.smithi184.stdout:3/464: link d1/d4/d6/d1f/f2c d1/f8d 0 2024-02-28T23:07:32.046 INFO:tasks.workunit.client.1.smithi184.stdout:9/440: write d5/db/de/d10/d12/f54 [953932,26569] 0 2024-02-28T23:07:32.048 INFO:tasks.workunit.client.0.smithi159.stdout:4/894: rmdir d9/d20/d87/d115/dc5 39 2024-02-28T23:07:32.051 INFO:tasks.workunit.client.1.smithi184.stdout:0/476: getdents d0/df/d13/d27/d31/d5b/d8e 0 2024-02-28T23:07:32.053 INFO:tasks.workunit.client.1.smithi184.stdout:0/477: stat d0/f65 0 2024-02-28T23:07:32.054 INFO:tasks.workunit.client.1.smithi184.stdout:2/442: chown d10/d1f/f48 2152 1 2024-02-28T23:07:32.055 INFO:tasks.workunit.client.1.smithi184.stdout:5/439: dwrite db/d12/d18/d2e/d3c/d5d/f54 [0,4194304] 0 2024-02-28T23:07:32.058 INFO:tasks.workunit.client.1.smithi184.stdout:5/440: stat db/d12/d1c/d21/d25/l29 0 2024-02-28T23:07:32.058 INFO:tasks.workunit.client.1.smithi184.stdout:7/406: dwrite d6/f59 [0,4194304] 0 2024-02-28T23:07:32.062 INFO:tasks.workunit.client.0.smithi159.stdout:0/893: dwrite d0/d5/d38/d76/d96/fc7 [0,4194304] 0 2024-02-28T23:07:32.064 INFO:tasks.workunit.client.0.smithi159.stdout:1/807: dwrite d6/f62 [0,4194304] 0 2024-02-28T23:07:32.074 INFO:tasks.workunit.client.1.smithi184.stdout:5/441: dwrite db/d12/d18/f20 [0,4194304] 0 2024-02-28T23:07:32.079 INFO:tasks.workunit.client.1.smithi184.stdout:5/442: fdatasync db/d12/d18/d2e/d3c/f83 0 2024-02-28T23:07:32.084 INFO:tasks.workunit.client.1.smithi184.stdout:2/443: rename d10/d1f/d38/f8f to d10/d1f/d38/d54/f90 0 2024-02-28T23:07:32.092 INFO:tasks.workunit.client.1.smithi184.stdout:7/407: fdatasync d6/d9/d13/d1e/f21 0 2024-02-28T23:07:32.093 INFO:tasks.workunit.client.1.smithi184.stdout:1/510: mkdir d20/d32/d3e/da2/dad 0 2024-02-28T23:07:32.093 INFO:tasks.workunit.client.1.smithi184.stdout:3/465: mknod d1/d4/d5/c8e 0 2024-02-28T23:07:32.098 INFO:tasks.workunit.client.1.smithi184.stdout:5/443: dread - db/d12/d18/d2e/f89 zero size 2024-02-28T23:07:32.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:31 smithi184 ceph-mon[36198]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:07:32.101 INFO:tasks.workunit.client.0.smithi159.stdout:4/895: write d9/d20/d87/d115/d1c/f39 [606112,25044] 0 2024-02-28T23:07:32.102 INFO:tasks.workunit.client.1.smithi184.stdout:2/444: dread d10/f34 [0,4194304] 0 2024-02-28T23:07:32.103 INFO:tasks.workunit.client.0.smithi159.stdout:0/894: symlink d0/d5/d38/d63/l13d 0 2024-02-28T23:07:32.104 INFO:tasks.workunit.client.0.smithi159.stdout:1/808: unlink d6/d1d/d1f/lac 0 2024-02-28T23:07:32.104 INFO:tasks.workunit.client.0.smithi159.stdout:0/895: stat d0/d5/d14/d34/d133 0 2024-02-28T23:07:32.108 INFO:tasks.workunit.client.1.smithi184.stdout:1/511: creat d20/d32/d3e/da2/dad/fae x:0 0 0 2024-02-28T23:07:32.108 INFO:tasks.workunit.client.1.smithi184.stdout:0/478: dwrite d0/df/d13/d27/f8b [0,4194304] 0 2024-02-28T23:07:32.108 INFO:tasks.workunit.client.1.smithi184.stdout:6/379: dread dc/de/d10/d16/f2d [0,4194304] 0 2024-02-28T23:07:32.108 INFO:tasks.workunit.client.1.smithi184.stdout:5/444: unlink db/d12/d1c/d21/d25/f8a 0 2024-02-28T23:07:32.111 INFO:tasks.workunit.client.0.smithi159.stdout:1/809: creat d6/d12/d31/d69/dc0/dca/d110/f117 x:0 0 0 2024-02-28T23:07:32.113 INFO:tasks.workunit.client.1.smithi184.stdout:3/466: truncate d1/d4/d1c/f31 2856977 0 2024-02-28T23:07:32.113 INFO:tasks.workunit.client.0.smithi159.stdout:4/896: fdatasync d9/d42/d54/fd3 0 2024-02-28T23:07:32.114 INFO:tasks.workunit.client.1.smithi184.stdout:2/445: chown d10/d1f/f32 161975 1 2024-02-28T23:07:32.114 INFO:tasks.workunit.client.1.smithi184.stdout:5/445: chown db/d12/d1c/d21/d2f/f4e 46959 1 2024-02-28T23:07:32.115 INFO:tasks.workunit.client.1.smithi184.stdout:1/512: mknod d20/d32/d3e/caf 0 2024-02-28T23:07:32.117 INFO:tasks.workunit.client.1.smithi184.stdout:6/380: creat dc/de/d2a/f7b x:0 0 0 2024-02-28T23:07:32.123 INFO:tasks.workunit.client.1.smithi184.stdout:7/408: dwrite d6/f46 [0,4194304] 0 2024-02-28T23:07:32.124 INFO:tasks.workunit.client.0.smithi159.stdout:0/896: rename d0/d5/d14/d34/d3d/l79 to d0/d5/d14/d25/db5/l13e 0 2024-02-28T23:07:32.125 INFO:tasks.workunit.client.0.smithi159.stdout:4/897: fdatasync d9/d20/d87/d115/fe6 0 2024-02-28T23:07:32.126 INFO:tasks.workunit.client.0.smithi159.stdout:0/897: readlink d0/d5/d14/l108 0 2024-02-28T23:07:32.127 INFO:tasks.workunit.client.1.smithi184.stdout:5/446: dread db/d44/f4c [0,4194304] 0 2024-02-28T23:07:32.128 INFO:tasks.workunit.client.0.smithi159.stdout:1/810: unlink d6/d1d/d46/d88/dd3/d9c/le2 0 2024-02-28T23:07:32.130 INFO:tasks.workunit.client.1.smithi184.stdout:2/446: write d10/d1f/d21/d5e/d15/d60/d66/f6b [41132,37651] 0 2024-02-28T23:07:32.131 INFO:tasks.workunit.client.1.smithi184.stdout:3/467: truncate d1/d4/f5a 662670 0 2024-02-28T23:07:32.132 INFO:tasks.workunit.client.0.smithi159.stdout:0/898: creat d0/de/d75/db8/f13f x:0 0 0 2024-02-28T23:07:32.135 INFO:tasks.workunit.client.1.smithi184.stdout:0/479: rename d0/d1d/d4c/f6f to d0/fa4 0 2024-02-28T23:07:32.135 INFO:tasks.workunit.client.0.smithi159.stdout:1/811: readlink d6/d12/d1a/d92/dc8/lfe 0 2024-02-28T23:07:32.137 INFO:tasks.workunit.client.1.smithi184.stdout:0/480: write d0/f37 [556575,119152] 0 2024-02-28T23:07:32.137 INFO:tasks.workunit.client.1.smithi184.stdout:5/447: creat db/d12/d18/d2e/f8e x:0 0 0 2024-02-28T23:07:32.138 INFO:tasks.workunit.client.1.smithi184.stdout:1/513: getdents d20/d32/d4b 0 2024-02-28T23:07:32.142 INFO:tasks.workunit.client.0.smithi159.stdout:1/812: creat d6/d1d/d46/d88/dd3/d9c/db3/dc4/ddc/f118 x:0 0 0 2024-02-28T23:07:32.143 INFO:tasks.workunit.client.1.smithi184.stdout:5/448: read db/d12/d18/d2e/d3c/d5d/f3e [577645,36853] 0 2024-02-28T23:07:32.144 INFO:tasks.workunit.client.0.smithi159.stdout:1/813: chown d6/d12/d33/f51 101 1 2024-02-28T23:07:32.144 INFO:tasks.workunit.client.0.smithi159.stdout:4/898: rmdir d9/d20/d87/d13a 0 2024-02-28T23:07:32.146 INFO:tasks.workunit.client.0.smithi159.stdout:1/814: dread - d6/d1d/d1f/f8c zero size 2024-02-28T23:07:32.149 INFO:tasks.workunit.client.0.smithi159.stdout:1/815: dread - d6/d12/d31/d69/dc0/dca/d110/f117 zero size 2024-02-28T23:07:32.149 INFO:tasks.workunit.client.1.smithi184.stdout:6/381: rename dc/d53 to dc/d60/d7c 0 2024-02-28T23:07:32.150 INFO:tasks.workunit.client.0.smithi159.stdout:1/816: read - d6/d12/d33/d3c/f108 zero size 2024-02-28T23:07:32.152 INFO:tasks.workunit.client.1.smithi184.stdout:0/481: truncate d0/df/d13/f14 1870784 0 2024-02-28T23:07:32.154 INFO:tasks.workunit.client.1.smithi184.stdout:3/468: mkdir d1/d4/d5/d40/d8f 0 2024-02-28T23:07:32.156 INFO:tasks.workunit.client.1.smithi184.stdout:5/449: rmdir db/d12/d18 39 2024-02-28T23:07:32.156 INFO:tasks.workunit.client.1.smithi184.stdout:3/469: chown d1/d4/d6/d1f/d24/c47 62592526 1 2024-02-28T23:07:32.159 INFO:tasks.workunit.client.0.smithi159.stdout:4/899: rename d9/d42/d54/f80 to d9/d20/d87/d115/d1c/d23/d2d/d59/f13b 0 2024-02-28T23:07:32.160 INFO:tasks.workunit.client.1.smithi184.stdout:3/470: chown d1/d4/d6/d1f/d24/l25 321033965 1 2024-02-28T23:07:32.163 INFO:tasks.workunit.client.1.smithi184.stdout:7/409: rename d6/d9/da/dc/d49/d50/l93 to d6/d9/d13/d14/l96 0 2024-02-28T23:07:32.163 INFO:tasks.workunit.client.1.smithi184.stdout:4/429: dwrite d1/dc/df/f16 [0,4194304] 0 2024-02-28T23:07:32.164 INFO:tasks.workunit.client.1.smithi184.stdout:4/430: dread - d1/d4/d43/d73/f5e zero size 2024-02-28T23:07:32.167 INFO:tasks.workunit.client.0.smithi159.stdout:0/899: dread d0/de/d75/db8/fed [0,4194304] 0 2024-02-28T23:07:32.168 INFO:tasks.workunit.client.1.smithi184.stdout:9/441: truncate d5/d26/f78 860819 0 2024-02-28T23:07:32.168 INFO:tasks.workunit.client.1.smithi184.stdout:0/482: creat d0/df/d13/d27/d31/d5b/d8e/fa5 x:0 0 0 2024-02-28T23:07:32.170 INFO:tasks.workunit.client.0.smithi159.stdout:4/900: mkdir d9/d20/d87/d115/dc5/d13c 0 2024-02-28T23:07:32.171 INFO:tasks.workunit.client.1.smithi184.stdout:6/382: creat dc/de/d56/f7d x:0 0 0 2024-02-28T23:07:32.173 INFO:tasks.workunit.client.1.smithi184.stdout:8/462: sync 2024-02-28T23:07:32.176 INFO:tasks.workunit.client.1.smithi184.stdout:3/471: creat d1/d4/d1c/d61/f90 x:0 0 0 2024-02-28T23:07:32.176 INFO:tasks.workunit.client.0.smithi159.stdout:5/774: write d8/d19/d23/d35/d41/fce [357986,67006] 0 2024-02-28T23:07:32.183 INFO:tasks.workunit.client.0.smithi159.stdout:1/817: dread d6/fc1 [0,4194304] 0 2024-02-28T23:07:32.187 INFO:tasks.workunit.client.1.smithi184.stdout:0/483: creat d0/df/d13/d27/d31/d5b/d8e/d91/fa6 x:0 0 0 2024-02-28T23:07:32.191 INFO:tasks.workunit.client.0.smithi159.stdout:1/818: rename d6/d1d/c8e to d6/d1d/d46/d88/db4/ddb/d101/c119 0 2024-02-28T23:07:32.197 INFO:tasks.workunit.client.1.smithi184.stdout:5/450: creat db/d12/d1c/f8f x:0 0 0 2024-02-28T23:07:32.201 INFO:tasks.workunit.client.1.smithi184.stdout:8/463: mknod d1/da/df/d20/d7c/cb1 0 2024-02-28T23:07:32.201 INFO:tasks.workunit.client.0.smithi159.stdout:2/701: sync 2024-02-28T23:07:32.203 INFO:tasks.workunit.client.1.smithi184.stdout:8/464: chown d1/da/dc/d16/d32/d42/f9b 68176 1 2024-02-28T23:07:32.204 INFO:tasks.workunit.client.1.smithi184.stdout:1/514: rename d20/d32/d3e/da2/dad to d20/d32/db0 0 2024-02-28T23:07:32.205 INFO:tasks.workunit.client.1.smithi184.stdout:3/472: creat d1/d4/d5/d40/d8f/f91 x:0 0 0 2024-02-28T23:07:32.206 INFO:tasks.workunit.client.0.smithi159.stdout:2/702: mkdir d9/d36/dfa 0 2024-02-28T23:07:32.207 INFO:tasks.workunit.client.0.smithi159.stdout:1/819: dread d6/d12/f93 [0,4194304] 0 2024-02-28T23:07:32.207 INFO:tasks.workunit.client.1.smithi184.stdout:3/473: chown d1/d4/d6/d1f/d26/d3a/d59/d67 933 1 2024-02-28T23:07:32.207 INFO:tasks.workunit.client.1.smithi184.stdout:7/410: link d6/d9/da/dc/d49/d50/c6a d6/d9/d13/d1e/d2f/d34/d47/c97 0 2024-02-28T23:07:32.208 INFO:tasks.workunit.client.0.smithi159.stdout:1/820: stat d6/d12/d31/d69/f77 0 2024-02-28T23:07:32.209 INFO:tasks.workunit.client.1.smithi184.stdout:3/474: chown d1/d4/d6/d1f/d26/d3a/d59/d82 13837059 1 2024-02-28T23:07:32.209 INFO:tasks.workunit.client.0.smithi159.stdout:5/775: dread d8/f13 [0,4194304] 0 2024-02-28T23:07:32.210 INFO:tasks.workunit.client.1.smithi184.stdout:3/475: fsync d1/d4/d1c/f27 0 2024-02-28T23:07:32.210 INFO:tasks.workunit.client.1.smithi184.stdout:5/451: write db/d12/d18/d2e/d3c/d5d/f33 [2368656,86081] 0 2024-02-28T23:07:32.211 INFO:tasks.workunit.client.1.smithi184.stdout:3/476: stat d1/d4/l80 0 2024-02-28T23:07:32.212 INFO:tasks.workunit.client.0.smithi159.stdout:2/703: read d9/f3c [457083,40879] 0 2024-02-28T23:07:32.213 INFO:tasks.workunit.client.0.smithi159.stdout:2/704: stat d9/d50/dcc 0 2024-02-28T23:07:32.214 INFO:tasks.workunit.client.1.smithi184.stdout:2/447: rename d10/d1f/d21/d4d/d67/d65/c79 to d10/d55/d89/c91 0 2024-02-28T23:07:32.215 INFO:tasks.workunit.client.0.smithi159.stdout:2/705: chown d9/d23/d2c/d55/f29 16148 1 2024-02-28T23:07:32.216 INFO:tasks.workunit.client.1.smithi184.stdout:1/515: symlink d20/d46/lb1 0 2024-02-28T23:07:32.216 INFO:tasks.workunit.client.1.smithi184.stdout:2/448: write d10/d1f/d38/d54/f8e [2162421,22052] 0 2024-02-28T23:07:32.219 INFO:tasks.workunit.client.1.smithi184.stdout:7/411: fsync d6/d9/da/f37 0 2024-02-28T23:07:32.221 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:31 smithi159 ceph-mon[28802]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:07:32.223 INFO:tasks.workunit.client.0.smithi159.stdout:0/900: write d0/d5/d14/d34/d6c/fbc [643865,94607] 0 2024-02-28T23:07:32.226 INFO:tasks.workunit.client.1.smithi184.stdout:3/477: mkdir d1/d4/d1c/d62/d92 0 2024-02-28T23:07:32.228 INFO:tasks.workunit.client.0.smithi159.stdout:5/776: mknod d8/d19/d23/d35/d100/c110 0 2024-02-28T23:07:32.228 INFO:tasks.workunit.client.1.smithi184.stdout:9/442: write d5/d26/d50/f38 [1946219,70454] 0 2024-02-28T23:07:32.229 INFO:tasks.workunit.client.0.smithi159.stdout:4/901: dwrite d9/d42/d54/fd3 [0,4194304] 0 2024-02-28T23:07:32.232 INFO:tasks.workunit.client.1.smithi184.stdout:2/449: write d10/d1f/d38/f5c [771324,70188] 0 2024-02-28T23:07:32.234 INFO:tasks.workunit.client.1.smithi184.stdout:4/431: dwrite d1/d8/d19/f39 [0,4194304] 0 2024-02-28T23:07:32.237 INFO:tasks.workunit.client.1.smithi184.stdout:3/478: mknod d1/d4/d6/d83/c93 0 2024-02-28T23:07:32.237 INFO:tasks.workunit.client.1.smithi184.stdout:8/465: rename d1/da/df/d20/c7e to d1/da/dc/d16/d29/cb2 0 2024-02-28T23:07:32.240 INFO:tasks.workunit.client.1.smithi184.stdout:3/479: readlink d1/d4/d5/d40/l4b 0 2024-02-28T23:07:32.246 INFO:tasks.workunit.client.1.smithi184.stdout:7/412: mkdir d6/d9/d13/d1e/d2f/d98 0 2024-02-28T23:07:32.246 INFO:tasks.workunit.client.0.smithi159.stdout:4/902: creat d9/f13d x:0 0 0 2024-02-28T23:07:32.248 INFO:tasks.workunit.client.0.smithi159.stdout:1/821: write d6/d12/f18 [1809122,27879] 0 2024-02-28T23:07:32.248 INFO:tasks.workunit.client.0.smithi159.stdout:5/777: getdents d8/db4/de8 0 2024-02-28T23:07:32.253 INFO:tasks.workunit.client.1.smithi184.stdout:2/450: dwrite fa [0,4194304] 0 2024-02-28T23:07:32.253 INFO:tasks.workunit.client.0.smithi159.stdout:2/706: write d9/d36/d59/f7d [1002047,46562] 0 2024-02-28T23:07:32.254 INFO:tasks.workunit.client.0.smithi159.stdout:2/707: readlink d9/d36/l3e 0 2024-02-28T23:07:32.255 INFO:tasks.workunit.client.1.smithi184.stdout:8/466: symlink d1/da/dc/d16/d32/lb3 0 2024-02-28T23:07:32.256 INFO:tasks.workunit.client.1.smithi184.stdout:2/451: write d10/d1f/d21/d5e/d15/d60/d66/f7c [1219907,23781] 0 2024-02-28T23:07:32.259 INFO:tasks.workunit.client.0.smithi159.stdout:4/903: unlink d9/d42/d54/d55/f6a 0 2024-02-28T23:07:32.259 INFO:tasks.workunit.client.1.smithi184.stdout:3/480: mknod d1/d4/d1c/d62/d66/c94 0 2024-02-28T23:07:32.259 INFO:tasks.workunit.client.1.smithi184.stdout:2/452: stat d10/d1f/d21/d5e/d15/l4a 0 2024-02-28T23:07:32.259 INFO:tasks.workunit.client.0.smithi159.stdout:4/904: stat d9/d42/dc8 0 2024-02-28T23:07:32.264 INFO:tasks.workunit.client.1.smithi184.stdout:2/453: write d10/d1f/d38/d53/f8c [1236073,104562] 0 2024-02-28T23:07:32.264 INFO:tasks.workunit.client.1.smithi184.stdout:7/413: fdatasync f5 0 2024-02-28T23:07:32.265 INFO:tasks.workunit.client.0.smithi159.stdout:0/901: truncate d0/d5/d14/d34/d6c/fbc 691602 0 2024-02-28T23:07:32.267 INFO:tasks.workunit.client.1.smithi184.stdout:7/414: chown d6/d9/d13/d1e/d2f/d33/d80/f87 8956656 1 2024-02-28T23:07:32.267 INFO:tasks.workunit.client.1.smithi184.stdout:4/432: truncate d1/d4/f11 53765 0 2024-02-28T23:07:32.268 INFO:tasks.workunit.client.1.smithi184.stdout:7/415: stat d6/d68 0 2024-02-28T23:07:32.270 INFO:tasks.workunit.client.0.smithi159.stdout:7/670: sync 2024-02-28T23:07:32.270 INFO:tasks.workunit.client.0.smithi159.stdout:3/733: sync 2024-02-28T23:07:32.271 INFO:tasks.workunit.client.0.smithi159.stdout:1/822: dwrite d6/d12/d33/d3c/f103 [4194304,4194304] 0 2024-02-28T23:07:32.272 INFO:tasks.workunit.client.0.smithi159.stdout:8/904: sync 2024-02-28T23:07:32.272 INFO:tasks.workunit.client.0.smithi159.stdout:6/797: sync 2024-02-28T23:07:32.272 INFO:tasks.workunit.client.0.smithi159.stdout:9/798: sync 2024-02-28T23:07:32.273 INFO:tasks.workunit.client.1.smithi184.stdout:3/481: dread d1/d4/d6/d1f/d26/d3a/d59/d6a/f77 [0,4194304] 0 2024-02-28T23:07:32.273 INFO:tasks.workunit.client.1.smithi184.stdout:8/467: creat d1/da/dc/d16/d32/fb4 x:0 0 0 2024-02-28T23:07:32.275 INFO:tasks.workunit.client.1.smithi184.stdout:8/468: read - d1/da/dc/d16/d32/fb4 zero size 2024-02-28T23:07:32.275 INFO:tasks.workunit.client.0.smithi159.stdout:6/798: write d0/d1b/d33/d8c/fe5 [418816,117474] 0 2024-02-28T23:07:32.278 INFO:tasks.workunit.client.1.smithi184.stdout:8/469: write d1/da/dc/d16/d32/f9f [1917796,120822] 0 2024-02-28T23:07:32.278 INFO:tasks.workunit.client.0.smithi159.stdout:0/902: creat d0/d5/d14/d25/d5c/f140 x:0 0 0 2024-02-28T23:07:32.278 INFO:tasks.workunit.client.0.smithi159.stdout:1/823: dread - d6/d1d/d46/d88/dd3/d9c/db3/dc4/dc6/ff8 zero size 2024-02-28T23:07:32.283 INFO:tasks.workunit.client.0.smithi159.stdout:9/799: chown d4/d3d/d3e/d55/lec 2156990 1 2024-02-28T23:07:32.284 INFO:tasks.workunit.client.0.smithi159.stdout:3/734: mknod d0/d6/d3e/da9/ce6 0 2024-02-28T23:07:32.288 INFO:tasks.workunit.client.1.smithi184.stdout:5/452: rename db/d12/d50/d6b to db/d90 0 2024-02-28T23:07:32.289 INFO:tasks.workunit.client.0.smithi159.stdout:5/778: write d8/d19/d23/d35/d41/f87 [4132205,2000] 0 2024-02-28T23:07:32.292 INFO:tasks.workunit.client.0.smithi159.stdout:8/905: rename d2/d11/d52/lcf to d2/d11/d52/d47/db6/l11d 0 2024-02-28T23:07:32.294 INFO:tasks.workunit.client.0.smithi159.stdout:8/906: readlink d2/d11/d35/d5f/dfe/l6c 0 2024-02-28T23:07:32.295 INFO:tasks.workunit.client.0.smithi159.stdout:2/708: write d9/d50/d54/d84/d37/d5c/fa3 [1452095,6374] 0 2024-02-28T23:07:32.298 INFO:tasks.workunit.client.1.smithi184.stdout:9/443: link d5/d17/d43/c90 d5/db/de/d10/d12/d2f/d3f/c96 0 2024-02-28T23:07:32.300 INFO:tasks.workunit.client.0.smithi159.stdout:6/799: creat d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/f105 x:0 0 0 2024-02-28T23:07:32.301 INFO:tasks.workunit.client.1.smithi184.stdout:3/482: symlink d1/d4/d6/d1f/d26/d3a/d59/d6a/d74/l95 0 2024-02-28T23:07:32.302 INFO:tasks.workunit.client.0.smithi159.stdout:6/800: readlink d0/d1b/dc5/le4 0 2024-02-28T23:07:32.302 INFO:tasks.workunit.client.0.smithi159.stdout:1/824: dwrite d6/d12/d1a/f23 [0,4194304] 0 2024-02-28T23:07:32.302 INFO:tasks.workunit.client.0.smithi159.stdout:4/905: write d9/d42/fab [5175893,107956] 0 2024-02-28T23:07:32.302 INFO:tasks.workunit.client.1.smithi184.stdout:4/433: dread d1/d8/d19/f1a [0,4194304] 0 2024-02-28T23:07:32.304 INFO:tasks.workunit.client.1.smithi184.stdout:3/483: stat d1/d4/d6/d1f/d24/c47 0 2024-02-28T23:07:32.306 INFO:tasks.workunit.client.0.smithi159.stdout:3/735: rmdir d0/d6/d34 39 2024-02-28T23:07:32.306 INFO:tasks.workunit.client.0.smithi159.stdout:1/825: write d6/d12/d31/d69/dc0/dca/f10c [912371,83106] 0 2024-02-28T23:07:32.308 INFO:tasks.workunit.client.1.smithi184.stdout:9/444: dread d5/f7 [4194304,4194304] 0 2024-02-28T23:07:32.313 INFO:tasks.workunit.client.0.smithi159.stdout:2/709: symlink d9/d50/lfb 0 2024-02-28T23:07:32.314 INFO:tasks.workunit.client.1.smithi184.stdout:2/454: symlink d10/d1f/d21/d6a/l92 0 2024-02-28T23:07:32.315 INFO:tasks.workunit.client.0.smithi159.stdout:2/710: stat d9/d50/d54/d84/f97 0 2024-02-28T23:07:32.318 INFO:tasks.workunit.client.1.smithi184.stdout:1/516: rename d20/d46/f75 to d20/d32/d3e/d82/fb2 0 2024-02-28T23:07:32.319 INFO:tasks.workunit.client.0.smithi159.stdout:5/779: mkdir d8/d19/d23/d35/d65/da3/df4/da5/d111 0 2024-02-28T23:07:32.320 INFO:tasks.workunit.client.1.smithi184.stdout:5/453: mknod db/d12/d18/d2e/d3c/d5d/d66/c91 0 2024-02-28T23:07:32.322 INFO:tasks.workunit.client.1.smithi184.stdout:7/416: mknod d6/d9/d13/c99 0 2024-02-28T23:07:32.324 INFO:tasks.workunit.client.1.smithi184.stdout:0/484: sync 2024-02-28T23:07:32.324 INFO:tasks.workunit.client.1.smithi184.stdout:6/383: sync 2024-02-28T23:07:32.325 INFO:tasks.workunit.client.0.smithi159.stdout:6/801: mkdir d0/d1b/d33/d11/d34/d9d/da2/db7/db1/d106 0 2024-02-28T23:07:32.326 INFO:tasks.workunit.client.1.smithi184.stdout:1/517: dread f1c [0,4194304] 0 2024-02-28T23:07:32.327 INFO:tasks.workunit.client.0.smithi159.stdout:3/736: mkdir d0/d3f/dd2/d6a/de7 0 2024-02-28T23:07:32.328 INFO:tasks.workunit.client.1.smithi184.stdout:1/518: read d20/f76 [527868,13502] 0 2024-02-28T23:07:32.329 INFO:tasks.workunit.client.1.smithi184.stdout:4/434: unlink d1/d8/l45 0 2024-02-28T23:07:32.330 INFO:tasks.workunit.client.0.smithi159.stdout:0/903: dwrite d0/de/d46/fa7 [0,4194304] 0 2024-02-28T23:07:32.330 INFO:tasks.workunit.client.0.smithi159.stdout:7/671: link d5/d16/d1a/d24/d64/c91 d5/d16/d1a/d27/d46/d65/d81/cda 0 2024-02-28T23:07:32.331 INFO:tasks.workunit.client.1.smithi184.stdout:4/435: write d1/d8/d35/f47 [1437391,12411] 0 2024-02-28T23:07:32.333 INFO:tasks.workunit.client.0.smithi159.stdout:1/826: dread - d6/d1d/d46/d88/dd3/d9c/db3/fd2 zero size 2024-02-28T23:07:32.334 INFO:tasks.workunit.client.1.smithi184.stdout:8/470: creat d1/da/dc/d16/d29/d92/fb5 x:0 0 0 2024-02-28T23:07:32.335 INFO:tasks.workunit.client.0.smithi159.stdout:1/827: readlink d6/d12/d31/d69/l52 0 2024-02-28T23:07:32.338 INFO:tasks.workunit.client.0.smithi159.stdout:8/907: write d2/d11/d35/d9c/da0/f101 [186147,61743] 0 2024-02-28T23:07:32.340 INFO:tasks.workunit.client.0.smithi159.stdout:2/711: fdatasync d9/d50/d54/d84/d37/d5c/f7b 0 2024-02-28T23:07:32.343 INFO:tasks.workunit.client.0.smithi159.stdout:5/780: fsync d8/d16/f1a 0 2024-02-28T23:07:32.343 INFO:tasks.workunit.client.0.smithi159.stdout:9/800: dwrite d4/d3d/d3e/d55/d4c/d4e/dbe/fd1 [0,4194304] 0 2024-02-28T23:07:32.343 INFO:tasks.workunit.client.0.smithi159.stdout:8/908: write d2/d3/f20 [1548954,92026] 0 2024-02-28T23:07:32.347 INFO:tasks.workunit.client.0.smithi159.stdout:4/906: truncate d9/d4c/d6c/fbb 1609111 0 2024-02-28T23:07:32.351 INFO:tasks.workunit.client.1.smithi184.stdout:7/417: mknod d6/d9/d13/d1e/d2f/d33/d80/c9a 0 2024-02-28T23:07:32.352 INFO:tasks.workunit.client.1.smithi184.stdout:7/418: dread - d6/d9/da/dc/d7d/f6b zero size 2024-02-28T23:07:32.354 INFO:tasks.workunit.client.1.smithi184.stdout:6/384: chown dc/d60/d7c/l5f 602 1 2024-02-28T23:07:32.358 INFO:tasks.workunit.client.1.smithi184.stdout:0/485: mknod d0/d1d/d4c/d93/ca7 0 2024-02-28T23:07:32.362 INFO:tasks.workunit.client.1.smithi184.stdout:0/486: dread d0/df/d13/d27/d58/f87 [0,4194304] 0 2024-02-28T23:07:32.362 INFO:tasks.workunit.client.0.smithi159.stdout:1/828: dwrite d6/d12/d31/d69/dc0/dca/d110/f117 [0,4194304] 0 2024-02-28T23:07:32.364 INFO:tasks.workunit.client.1.smithi184.stdout:0/487: dread - d0/df/d13/d27/d31/d51/f73 zero size 2024-02-28T23:07:32.366 INFO:tasks.workunit.client.1.smithi184.stdout:0/488: chown d0/df/d13/d27/d31 255710 1 2024-02-28T23:07:32.366 INFO:tasks.workunit.client.0.smithi159.stdout:0/904: rename d0/de/d75/d5f/cf8 to d0/de/d75/db8/d103/d124/c141 0 2024-02-28T23:07:32.367 INFO:tasks.workunit.client.1.smithi184.stdout:1/519: mkdir d20/d46/d90/db3 0 2024-02-28T23:07:32.375 INFO:tasks.workunit.client.0.smithi159.stdout:2/712: creat d9/d50/ffc x:0 0 0 2024-02-28T23:07:32.376 INFO:tasks.workunit.client.0.smithi159.stdout:8/909: dread d2/d11/d52/d6e/f104 [0,4194304] 0 2024-02-28T23:07:32.376 INFO:tasks.workunit.client.1.smithi184.stdout:9/445: mknod d5/db/c97 0 2024-02-28T23:07:32.376 INFO:tasks.workunit.client.1.smithi184.stdout:8/471: write d1/da/d10/f2f [11779,107197] 0 2024-02-28T23:07:32.378 INFO:tasks.workunit.client.0.smithi159.stdout:9/801: creat d4/d3d/d3e/d55/d37/d62/da6/ffa x:0 0 0 2024-02-28T23:07:32.379 INFO:tasks.workunit.client.1.smithi184.stdout:9/446: write d5/db/f7f [205951,85067] 0 2024-02-28T23:07:32.379 INFO:tasks.workunit.client.0.smithi159.stdout:5/781: creat d8/d19/d23/d35/d65/da3/df4/f112 x:0 0 0 2024-02-28T23:07:32.380 INFO:tasks.workunit.client.0.smithi159.stdout:9/802: stat d4/d3d/d3e/d55/d4c/f92 0 2024-02-28T23:07:32.381 INFO:tasks.workunit.client.1.smithi184.stdout:7/419: mknod d6/d68/c9b 0 2024-02-28T23:07:32.382 INFO:tasks.workunit.client.1.smithi184.stdout:6/385: rmdir dc/de 39 2024-02-28T23:07:32.384 INFO:tasks.workunit.client.0.smithi159.stdout:7/672: mknod d5/d56/cdb 0 2024-02-28T23:07:32.384 INFO:tasks.workunit.client.1.smithi184.stdout:7/420: chown d6/d9/da/dc/d7d/l8f 115 1 2024-02-28T23:07:32.391 INFO:tasks.workunit.client.1.smithi184.stdout:8/472: creat d1/da/dc/fb6 x:0 0 0 2024-02-28T23:07:32.393 INFO:tasks.workunit.client.1.smithi184.stdout:2/455: rename d10/d1f/d21/d5e/f1a to d10/d1f/f93 0 2024-02-28T23:07:32.394 INFO:tasks.workunit.client.1.smithi184.stdout:8/473: chown d1/da/dc/d16/d32/d42/ca3 91 1 2024-02-28T23:07:32.397 INFO:tasks.workunit.client.1.smithi184.stdout:3/484: dwrite d1/f8d [0,4194304] 0 2024-02-28T23:07:32.399 INFO:tasks.workunit.client.0.smithi159.stdout:8/910: unlink d2/d11/d35/d5f/dfe/c7d 0 2024-02-28T23:07:32.399 INFO:tasks.workunit.client.0.smithi159.stdout:2/713: read d9/d36/d59/fad [402044,42193] 0 2024-02-28T23:07:32.402 INFO:tasks.workunit.client.1.smithi184.stdout:1/520: write d20/d32/d4d/f81 [884296,16758] 0 2024-02-28T23:07:32.404 INFO:tasks.workunit.client.0.smithi159.stdout:6/802: creat d0/d1b/d33/d3f/d44/f107 x:0 0 0 2024-02-28T23:07:32.405 INFO:tasks.workunit.client.0.smithi159.stdout:4/907: dread d9/d20/d87/d115/d1c/d8e/deb/f106 [0,4194304] 0 2024-02-28T23:07:32.406 INFO:tasks.workunit.client.1.smithi184.stdout:6/386: creat dc/d42/f7e x:0 0 0 2024-02-28T23:07:32.408 INFO:tasks.workunit.client.1.smithi184.stdout:7/421: rmdir d6 39 2024-02-28T23:07:32.410 INFO:tasks.workunit.client.0.smithi159.stdout:9/803: symlink d4/d3d/d3e/d55/d37/d62/da6/dac/lfb 0 2024-02-28T23:07:32.412 INFO:tasks.workunit.client.0.smithi159.stdout:7/673: fsync d5/d16/d1a/d27/d46/f8d 0 2024-02-28T23:07:32.416 INFO:tasks.workunit.client.1.smithi184.stdout:1/521: dwrite d20/d32/d3e/d61/d8b/f8e [0,4194304] 0 2024-02-28T23:07:32.416 INFO:tasks.workunit.client.1.smithi184.stdout:2/456: mkdir d10/d1f/d21/d5e/d15/d24/d94 0 2024-02-28T23:07:32.417 INFO:tasks.workunit.client.0.smithi159.stdout:0/905: dwrite d0/de/d75/db8/fbf [0,4194304] 0 2024-02-28T23:07:32.420 INFO:tasks.workunit.client.0.smithi159.stdout:8/911: symlink d2/d11/d52/d26/d36/d38/d77/d9e/dc1/dc4/l11e 0 2024-02-28T23:07:32.423 INFO:tasks.workunit.client.1.smithi184.stdout:9/447: link d5/db/de/d10/d12/f54 d5/d17/d8f/f98 0 2024-02-28T23:07:32.423 INFO:tasks.workunit.client.1.smithi184.stdout:3/485: stat d1/d4/c41 0 2024-02-28T23:07:32.425 INFO:tasks.workunit.client.1.smithi184.stdout:5/454: link db/cf db/c92 0 2024-02-28T23:07:32.427 INFO:tasks.workunit.client.0.smithi159.stdout:6/803: mknod d0/d1b/d33/d11/d34/d9d/da2/dbf/c108 0 2024-02-28T23:07:32.428 INFO:tasks.workunit.client.1.smithi184.stdout:6/387: write dc/de/d10/f4b [3717432,54015] 0 2024-02-28T23:07:32.428 INFO:tasks.workunit.client.0.smithi159.stdout:4/908: dread - d9/d42/d54/d55/f9b zero size 2024-02-28T23:07:32.433 INFO:tasks.workunit.client.0.smithi159.stdout:6/804: write d0/d1b/d33/d11/d34/d9d/da2/fd3 [277634,109321] 0 2024-02-28T23:07:32.438 INFO:tasks.workunit.client.0.smithi159.stdout:9/804: rename d4/d3d/d3e/d55/d37/d62/da6/dac to d4/d3d/d3e/d55/d9e/dfc 0 2024-02-28T23:07:32.442 INFO:tasks.workunit.client.0.smithi159.stdout:2/714: getdents d9/d50/d62/dce 0 2024-02-28T23:07:32.443 INFO:tasks.workunit.client.1.smithi184.stdout:8/474: write d1/da/d10/f2d [1772198,44802] 0 2024-02-28T23:07:32.444 INFO:tasks.workunit.client.0.smithi159.stdout:2/715: chown d9/d23/d2c/d55/fb6 10 1 2024-02-28T23:07:32.444 INFO:tasks.workunit.client.0.smithi159.stdout:8/912: symlink d2/d11/d52/d26/d36/l11f 0 2024-02-28T23:07:32.445 INFO:tasks.workunit.client.0.smithi159.stdout:1/829: write d6/d12/d16/f24 [3157288,75659] 0 2024-02-28T23:07:32.446 INFO:tasks.workunit.client.1.smithi184.stdout:8/475: chown d1/da/dc/d16/d32/lb3 172392165 1 2024-02-28T23:07:32.447 INFO:tasks.workunit.client.0.smithi159.stdout:4/909: dread d9/d20/d87/d115/fcf [0,4194304] 0 2024-02-28T23:07:32.449 INFO:tasks.workunit.client.1.smithi184.stdout:8/476: truncate d1/da/f79 611568 0 2024-02-28T23:07:32.450 INFO:tasks.workunit.client.0.smithi159.stdout:3/737: link d0/d2b/d55/d6e/l96 d0/d3f/le8 0 2024-02-28T23:07:32.451 INFO:tasks.workunit.client.1.smithi184.stdout:3/486: dwrite d1/d4/f42 [0,4194304] 0 2024-02-28T23:07:32.452 INFO:tasks.workunit.client.0.smithi159.stdout:5/782: write d8/d19/d23/d2a/f3b [204284,57047] 0 2024-02-28T23:07:32.455 INFO:tasks.workunit.client.1.smithi184.stdout:1/522: link d20/d32/d3e/l5f d20/d32/d3e/da2/lb4 0 2024-02-28T23:07:32.456 INFO:tasks.workunit.client.1.smithi184.stdout:3/487: write d1/d4/d6/d1f/d26/f78 [177366,92846] 0 2024-02-28T23:07:32.456 INFO:tasks.workunit.client.1.smithi184.stdout:2/457: creat d10/d1f/d21/d4d/d67/f95 x:0 0 0 2024-02-28T23:07:32.456 INFO:tasks.workunit.client.1.smithi184.stdout:4/436: sync 2024-02-28T23:07:32.457 INFO:tasks.workunit.client.0.smithi159.stdout:6/805: write d0/d1b/fcb [6413070,121020] 0 2024-02-28T23:07:32.458 INFO:tasks.workunit.client.1.smithi184.stdout:5/455: creat db/d12/d1c/d21/d4d/f93 x:0 0 0 2024-02-28T23:07:32.459 INFO:tasks.workunit.client.0.smithi159.stdout:7/674: dread d5/d16/d1a/d24/d64/f79 [4194304,4194304] 0 2024-02-28T23:07:32.459 INFO:tasks.workunit.client.0.smithi159.stdout:0/906: mknod d0/de/d75/d5f/d97/c142 0 2024-02-28T23:07:32.460 INFO:tasks.workunit.client.1.smithi184.stdout:3/488: fsync d1/d4/d6/d1f/d26/f78 0 2024-02-28T23:07:32.463 INFO:tasks.workunit.client.1.smithi184.stdout:5/456: truncate db/d12/d18/d2e/f8e 272693 0 2024-02-28T23:07:32.464 INFO:tasks.workunit.client.1.smithi184.stdout:3/489: chown d1/d4/d6/d1f/d26/d3a/d59/d82/l85 15395 1 2024-02-28T23:07:32.467 INFO:tasks.workunit.client.1.smithi184.stdout:7/422: write d6/d9/d13/d1e/d2f/d34/d47/f55 [732806,32766] 0 2024-02-28T23:07:32.467 INFO:tasks.workunit.client.1.smithi184.stdout:8/477: creat d1/da/dc/d16/d29/fb7 x:0 0 0 2024-02-28T23:07:32.468 INFO:tasks.workunit.client.0.smithi159.stdout:8/913: unlink d2/d3/l45 0 2024-02-28T23:07:32.469 INFO:tasks.workunit.client.1.smithi184.stdout:7/423: readlink d6/d9/da/l23 0 2024-02-28T23:07:32.471 INFO:tasks.workunit.client.1.smithi184.stdout:8/478: read d1/da/dc/d16/d29/f54 [3952113,36598] 0 2024-02-28T23:07:32.473 INFO:tasks.workunit.client.1.smithi184.stdout:1/523: dread - d20/d46/f69 zero size 2024-02-28T23:07:32.474 INFO:tasks.workunit.client.1.smithi184.stdout:8/479: fsync d1/da/d10/f2d 0 2024-02-28T23:07:32.474 INFO:tasks.workunit.client.1.smithi184.stdout:6/388: write dc/de/d10/f38 [1862931,68519] 0 2024-02-28T23:07:32.475 INFO:tasks.workunit.client.1.smithi184.stdout:1/524: write d20/f24 [960068,76755] 0 2024-02-28T23:07:32.477 INFO:tasks.workunit.client.0.smithi159.stdout:3/738: mknod d0/d2b/d4f/ce9 0 2024-02-28T23:07:32.478 INFO:tasks.workunit.client.0.smithi159.stdout:4/910: chown d9/d20/d87/d115/c119 107 1 2024-02-28T23:07:32.479 INFO:tasks.workunit.client.1.smithi184.stdout:2/458: mkdir d10/d1f/d38/d54/d96 0 2024-02-28T23:07:32.479 INFO:tasks.workunit.client.1.smithi184.stdout:6/389: chown dc/de/d10/c31 79939 1 2024-02-28T23:07:32.479 INFO:tasks.workunit.client.1.smithi184.stdout:9/448: dwrite d5/d26/d50/f53 [0,4194304] 0 2024-02-28T23:07:32.481 INFO:tasks.workunit.client.0.smithi159.stdout:2/716: write d9/d23/d2c/d55/f5b [1768665,122719] 0 2024-02-28T23:07:32.481 INFO:tasks.workunit.client.0.smithi159.stdout:3/739: readlink d0/d47/l9d 0 2024-02-28T23:07:32.484 INFO:tasks.workunit.client.1.smithi184.stdout:5/457: symlink db/d12/d50/l94 0 2024-02-28T23:07:32.484 INFO:tasks.workunit.client.1.smithi184.stdout:3/490: creat d1/d4/d6/d1f/d26/d3a/d59/d6a/d74/f96 x:0 0 0 2024-02-28T23:07:32.487 INFO:tasks.workunit.client.1.smithi184.stdout:5/458: chown db/d12/d1c/f8f 59476405 1 2024-02-28T23:07:32.487 INFO:tasks.workunit.client.1.smithi184.stdout:7/424: dwrite d6/f46 [0,4194304] 0 2024-02-28T23:07:32.488 INFO:tasks.workunit.client.0.smithi159.stdout:0/907: symlink d0/d5/d14/d25/l143 0 2024-02-28T23:07:32.490 INFO:tasks.workunit.client.0.smithi159.stdout:3/740: chown d0/d6/d3e/c1c 13584887 1 2024-02-28T23:07:32.491 INFO:tasks.workunit.client.1.smithi184.stdout:4/437: rename d1/f10 to d1/d8/d37/d49/f80 0 2024-02-28T23:07:32.495 INFO:tasks.workunit.client.1.smithi184.stdout:8/480: rmdir d1/da/d10/d6b 39 2024-02-28T23:07:32.495 INFO:tasks.workunit.client.0.smithi159.stdout:5/783: mkdir d8/d19/d23/d35/d65/da3/df4/da5/d111/d113 0 2024-02-28T23:07:32.496 INFO:tasks.workunit.client.0.smithi159.stdout:8/914: read d2/d11/d35/d5f/dfe/d68/f8d [1661185,4403] 0 2024-02-28T23:07:32.496 INFO:tasks.workunit.client.0.smithi159.stdout:7/675: symlink d5/ldc 0 2024-02-28T23:07:32.496 INFO:tasks.workunit.client.0.smithi159.stdout:2/717: truncate d9/d50/d54/d84/d37/d5c/fea 549142 0 2024-02-28T23:07:32.497 INFO:tasks.workunit.client.0.smithi159.stdout:5/784: readlink d8/d59/lc0 0 2024-02-28T23:07:32.497 INFO:tasks.workunit.client.0.smithi159.stdout:4/911: symlink d9/d20/d87/d115/d1c/d23/d2d/l13e 0 2024-02-28T23:07:32.498 INFO:tasks.workunit.client.1.smithi184.stdout:4/438: readlink d1/dc/df/d22/d51/l68 0 2024-02-28T23:07:32.498 INFO:tasks.workunit.client.1.smithi184.stdout:6/390: fdatasync dc/de/f36 0 2024-02-28T23:07:32.500 INFO:tasks.workunit.client.1.smithi184.stdout:1/525: creat d20/d32/d3e/d82/d85/d8c/fb5 x:0 0 0 2024-02-28T23:07:32.501 INFO:tasks.workunit.client.1.smithi184.stdout:0/489: sync 2024-02-28T23:07:32.504 INFO:tasks.workunit.client.1.smithi184.stdout:9/449: creat d5/d17/d43/f99 x:0 0 0 2024-02-28T23:07:32.504 INFO:tasks.workunit.client.1.smithi184.stdout:2/459: dwrite d10/d1f/d21/d5e/f58 [0,4194304] 0 2024-02-28T23:07:32.505 INFO:tasks.workunit.client.0.smithi159.stdout:1/830: dwrite d6/d1d/f68 [0,4194304] 0 2024-02-28T23:07:32.505 INFO:tasks.workunit.client.0.smithi159.stdout:8/915: chown d2/d11/d52/d26/d36/c8e 16218206 1 2024-02-28T23:07:32.506 INFO:tasks.workunit.client.1.smithi184.stdout:9/450: write d5/fa [922589,61501] 0 2024-02-28T23:07:32.508 INFO:tasks.workunit.client.1.smithi184.stdout:9/451: write d5/d17/d43/f48 [11403667,25013] 0 2024-02-28T23:07:32.511 INFO:tasks.workunit.client.0.smithi159.stdout:3/741: creat d0/d3f/dd2/d7c/d79/d9b/fea x:0 0 0 2024-02-28T23:07:32.511 INFO:tasks.workunit.client.1.smithi184.stdout:8/481: rename d1/da/f2c to d1/da/dc/d16/d29/d7d/fb8 0 2024-02-28T23:07:32.512 INFO:tasks.workunit.client.1.smithi184.stdout:6/391: mknod dc/de/d56/c7f 0 2024-02-28T23:07:32.514 INFO:tasks.workunit.client.0.smithi159.stdout:4/912: symlink d9/d4c/d6c/d98/d103/l13f 0 2024-02-28T23:07:32.514 INFO:tasks.workunit.client.1.smithi184.stdout:0/490: mknod d0/d1d/ca8 0 2024-02-28T23:07:32.515 INFO:tasks.workunit.client.1.smithi184.stdout:1/526: dread d20/f76 [0,4194304] 0 2024-02-28T23:07:32.516 INFO:tasks.workunit.client.0.smithi159.stdout:4/913: fsync d9/d4c/fb7 0 2024-02-28T23:07:32.518 INFO:tasks.workunit.client.1.smithi184.stdout:6/392: read dc/de/f20 [1107596,120522] 0 2024-02-28T23:07:32.520 INFO:tasks.workunit.client.0.smithi159.stdout:4/914: write d9/d20/d87/d115/d1c/d23/d2d/d59/f12f [551916,57724] 0 2024-02-28T23:07:32.522 INFO:tasks.workunit.client.0.smithi159.stdout:2/718: mknod d9/d50/d54/d84/df2/cfd 0 2024-02-28T23:07:32.523 INFO:tasks.workunit.client.1.smithi184.stdout:7/425: mkdir d6/d9/da/dc/d49/d9c 0 2024-02-28T23:07:32.525 INFO:tasks.workunit.client.0.smithi159.stdout:0/908: creat d0/f144 x:0 0 0 2024-02-28T23:07:32.525 INFO:tasks.workunit.client.1.smithi184.stdout:6/393: truncate dc/de/f5a 661001 0 2024-02-28T23:07:32.526 INFO:tasks.workunit.client.1.smithi184.stdout:6/394: dread - dc/d42/f7e zero size 2024-02-28T23:07:32.534 INFO:tasks.workunit.client.0.smithi159.stdout:6/806: write d0/d1b/d33/d8c/f6f [2154147,49486] 0 2024-02-28T23:07:32.534 INFO:tasks.workunit.client.1.smithi184.stdout:9/452: symlink d5/d26/d50/l9a 0 2024-02-28T23:07:32.535 INFO:tasks.workunit.client.1.smithi184.stdout:9/453: write d5/f13 [2105615,120645] 0 2024-02-28T23:07:32.536 INFO:tasks.workunit.client.1.smithi184.stdout:8/482: fsync d1/da/df/d20/f26 0 2024-02-28T23:07:32.541 INFO:tasks.workunit.client.0.smithi159.stdout:9/805: truncate d4/d3d/fe1 2633289 0 2024-02-28T23:07:32.543 INFO:tasks.workunit.client.0.smithi159.stdout:8/916: mkdir d2/d11/d52/d26/d36/d38/dfb/d120 0 2024-02-28T23:07:32.545 INFO:tasks.workunit.client.0.smithi159.stdout:5/785: symlink d8/d19/d23/d35/d65/da3/df4/da5/d111/d113/l114 0 2024-02-28T23:07:32.546 INFO:tasks.workunit.client.1.smithi184.stdout:0/491: mkdir d0/d1d/d3a/da9 0 2024-02-28T23:07:32.546 INFO:tasks.workunit.client.0.smithi159.stdout:4/915: dread - d9/d42/db1/f102 zero size 2024-02-28T23:07:32.548 INFO:tasks.workunit.client.0.smithi159.stdout:2/719: rmdir d9/d50/d62 39 2024-02-28T23:07:32.550 INFO:tasks.workunit.client.1.smithi184.stdout:2/460: rmdir d10/d33 39 2024-02-28T23:07:32.552 INFO:tasks.workunit.client.0.smithi159.stdout:0/909: truncate d0/de/d46/f61 487641 0 2024-02-28T23:07:32.554 INFO:tasks.workunit.client.1.smithi184.stdout:7/426: mknod d6/d9/d13/d1e/d2f/d34/d47/c9d 0 2024-02-28T23:07:32.556 INFO:tasks.workunit.client.0.smithi159.stdout:2/720: dread d9/d36/d59/f7d [0,4194304] 0 2024-02-28T23:07:32.557 INFO:tasks.workunit.client.1.smithi184.stdout:6/395: unlink dc/f48 0 2024-02-28T23:07:32.557 INFO:tasks.workunit.client.0.smithi159.stdout:2/721: readlink d9/d50/dcc/lbe 0 2024-02-28T23:07:32.558 INFO:tasks.workunit.client.1.smithi184.stdout:6/396: chown dc/de/d10/l25 17 1 2024-02-28T23:07:32.563 INFO:tasks.workunit.client.0.smithi159.stdout:5/786: dread d8/f17 [0,4194304] 0 2024-02-28T23:07:32.565 INFO:tasks.workunit.client.1.smithi184.stdout:8/483: creat d1/da/dc/d16/d29/fb9 x:0 0 0 2024-02-28T23:07:32.565 INFO:tasks.workunit.client.0.smithi159.stdout:4/916: mknod d9/d20/d87/c140 0 2024-02-28T23:07:32.566 INFO:tasks.workunit.client.1.smithi184.stdout:9/454: dread d5/db/d65/f6c [0,4194304] 0 2024-02-28T23:07:32.566 INFO:tasks.workunit.client.1.smithi184.stdout:4/439: link d1/dc/l20 d1/dc/df/d38/l81 0 2024-02-28T23:07:32.568 INFO:tasks.workunit.client.1.smithi184.stdout:5/459: dwrite db/d44/f4c [0,4194304] 0 2024-02-28T23:07:32.568 INFO:tasks.workunit.client.1.smithi184.stdout:9/455: readlink d5/d17/d43/l46 0 2024-02-28T23:07:32.569 INFO:tasks.workunit.client.0.smithi159.stdout:4/917: read d9/d20/d87/d115/d1c/d23/d2d/f41 [2054186,9065] 0 2024-02-28T23:07:32.572 INFO:tasks.workunit.client.0.smithi159.stdout:0/910: truncate d0/f1e 5196925 0 2024-02-28T23:07:32.572 INFO:tasks.workunit.client.1.smithi184.stdout:8/484: read d1/da/d10/d17/d63/f68 [452232,85860] 0 2024-02-28T23:07:32.572 INFO:tasks.workunit.client.1.smithi184.stdout:0/492: rmdir d0/df 39 2024-02-28T23:07:32.573 INFO:tasks.workunit.client.1.smithi184.stdout:9/456: chown d5/db/de/d10/d12/l33 124007957 1 2024-02-28T23:07:32.574 INFO:tasks.workunit.client.1.smithi184.stdout:1/527: rename d20/c41 to d20/d32/d3e/d82/d85/d86/cb6 0 2024-02-28T23:07:32.576 INFO:tasks.workunit.client.0.smithi159.stdout:1/831: rename d6/d1d/d46/d88/dd3/f44 to d6/d12/f11a 0 2024-02-28T23:07:32.579 INFO:tasks.workunit.client.1.smithi184.stdout:6/397: dwrite dc/d60/d62/d6f/f77 [0,4194304] 0 2024-02-28T23:07:32.579 INFO:tasks.workunit.client.1.smithi184.stdout:2/461: creat d10/d1f/d38/d54/f97 x:0 0 0 2024-02-28T23:07:32.581 INFO:tasks.workunit.client.1.smithi184.stdout:3/491: truncate d1/d4/d6/d1f/d26/f2a 2342958 0 2024-02-28T23:07:32.582 INFO:tasks.workunit.client.0.smithi159.stdout:6/807: mkdir d0/d1b/dc4/ddd/d109 0 2024-02-28T23:07:32.583 INFO:tasks.workunit.client.0.smithi159.stdout:6/808: stat d0/d1b/d33/l68 0 2024-02-28T23:07:32.585 INFO:tasks.workunit.client.1.smithi184.stdout:5/460: dread db/d44/f82 [0,4194304] 0 2024-02-28T23:07:32.585 INFO:tasks.workunit.client.0.smithi159.stdout:8/917: mknod d2/c121 0 2024-02-28T23:07:32.586 INFO:tasks.workunit.client.0.smithi159.stdout:7/676: truncate d5/d16/d1a/d24/d64/f79 4101906 0 2024-02-28T23:07:32.586 INFO:tasks.workunit.client.1.smithi184.stdout:5/461: dread - db/f7c zero size 2024-02-28T23:07:32.596 INFO:tasks.workunit.client.0.smithi159.stdout:3/742: dwrite d0/d6/d3e/d2f/f4b [0,4194304] 0 2024-02-28T23:07:32.601 INFO:tasks.workunit.client.1.smithi184.stdout:6/398: dwrite dc/de/d10/f1b [0,4194304] 0 2024-02-28T23:07:32.602 INFO:tasks.workunit.client.0.smithi159.stdout:4/918: mkdir d9/d20/d87/d115/d1c/d23/d7a/d10d/d141 0 2024-02-28T23:07:32.603 INFO:tasks.workunit.client.1.smithi184.stdout:3/492: dwrite d1/d4/d1c/f8a [0,4194304] 0 2024-02-28T23:07:32.605 INFO:tasks.workunit.client.0.smithi159.stdout:1/832: creat d6/d12/d31/d5a/f11b x:0 0 0 2024-02-28T23:07:32.607 INFO:tasks.workunit.client.0.smithi159.stdout:2/722: rename d9/d50/dcc/fbc to d9/d50/d62/ffe 0 2024-02-28T23:07:32.608 INFO:tasks.workunit.client.1.smithi184.stdout:8/485: truncate d1/da/dc/d16/d29/f2a 3030800 0 2024-02-28T23:07:32.608 INFO:tasks.workunit.client.1.smithi184.stdout:2/462: symlink d10/d1f/d21/d6a/l98 0 2024-02-28T23:07:32.609 INFO:tasks.workunit.client.0.smithi159.stdout:6/809: mknod d0/d1b/d33/d3f/c10a 0 2024-02-28T23:07:32.613 INFO:tasks.workunit.client.1.smithi184.stdout:8/486: write d1/da/dc/d16/d32/d42/f6f [527306,41596] 0 2024-02-28T23:07:32.623 INFO:tasks.workunit.client.1.smithi184.stdout:4/440: truncate d1/d8/d37/f60 141876 0 2024-02-28T23:07:32.625 INFO:tasks.workunit.client.0.smithi159.stdout:7/677: creat d5/d16/d1a/d27/d46/d65/d81/d83/d9d/fdd x:0 0 0 2024-02-28T23:07:32.627 INFO:tasks.workunit.client.1.smithi184.stdout:3/493: dwrite d1/f8d [0,4194304] 0 2024-02-28T23:07:32.629 INFO:tasks.workunit.client.1.smithi184.stdout:1/528: mknod d20/d32/cb7 0 2024-02-28T23:07:32.630 INFO:tasks.workunit.client.0.smithi159.stdout:9/806: truncate d4/d3d/d3e/d55/d4c/f92 193297 0 2024-02-28T23:07:32.631 INFO:tasks.workunit.client.1.smithi184.stdout:2/463: dread d10/d1f/d38/d54/f8e [0,4194304] 0 2024-02-28T23:07:32.632 INFO:tasks.workunit.client.1.smithi184.stdout:4/441: write d1/dc/df/d38/d3c/f65 [677019,33750] 0 2024-02-28T23:07:32.633 INFO:tasks.workunit.client.1.smithi184.stdout:0/493: creat d0/df/d13/d27/d31/d51/d85/faa x:0 0 0 2024-02-28T23:07:32.636 INFO:tasks.workunit.client.1.smithi184.stdout:2/464: stat d10/d1f/d21/d5e/d15/f39 0 2024-02-28T23:07:32.636 INFO:tasks.workunit.client.1.smithi184.stdout:9/457: unlink d5/db/de/d10/d12/d2f/d3f/c96 0 2024-02-28T23:07:32.640 INFO:tasks.workunit.client.1.smithi184.stdout:6/399: dread dc/de/f1e [0,4194304] 0 2024-02-28T23:07:32.642 INFO:tasks.workunit.client.0.smithi159.stdout:4/919: mknod d9/d20/d87/d115/d1c/d8e/ddc/dc9/c142 0 2024-02-28T23:07:32.643 INFO:tasks.workunit.client.1.smithi184.stdout:6/400: rename dc/de/d2a/d5c/d6e to dc/de/d2a/d5c/d6e/d80 22 2024-02-28T23:07:32.648 INFO:tasks.workunit.client.0.smithi159.stdout:1/833: creat d6/d12/d1a/d92/dc8/f11c x:0 0 0 2024-02-28T23:07:32.650 INFO:tasks.workunit.client.0.smithi159.stdout:8/918: write d2/d11/d52/d26/d36/d38/ff3 [290606,79159] 0 2024-02-28T23:07:32.650 INFO:tasks.workunit.client.1.smithi184.stdout:1/529: stat d20/c6a 0 2024-02-28T23:07:32.656 INFO:tasks.workunit.client.1.smithi184.stdout:4/442: fdatasync d1/dc/df/f59 0 2024-02-28T23:07:32.660 INFO:tasks.workunit.client.0.smithi159.stdout:7/678: creat d5/d16/d1a/d24/fde x:0 0 0 2024-02-28T23:07:32.660 INFO:tasks.workunit.client.0.smithi159.stdout:5/787: write d8/f31 [898474,27794] 0 2024-02-28T23:07:32.661 INFO:tasks.workunit.client.1.smithi184.stdout:2/465: write d10/f43 [5169466,95502] 0 2024-02-28T23:07:32.666 INFO:tasks.workunit.client.0.smithi159.stdout:9/807: creat d4/d3d/d3e/d55/d9e/dfc/dea/ffd x:0 0 0 2024-02-28T23:07:32.668 INFO:tasks.workunit.client.0.smithi159.stdout:0/911: link d0/de/ce5 d0/de/d75/d5f/c145 0 2024-02-28T23:07:32.670 INFO:tasks.workunit.client.1.smithi184.stdout:5/462: truncate db/d1f/f5b 1283389 0 2024-02-28T23:07:32.674 INFO:tasks.workunit.client.0.smithi159.stdout:7/679: dread d5/d16/d1a/d27/d46/d65/d81/d83/f8a [0,4194304] 0 2024-02-28T23:07:32.675 INFO:tasks.workunit.client.1.smithi184.stdout:2/466: dwrite d10/d1f/d38/d54/f97 [0,4194304] 0 2024-02-28T23:07:32.675 INFO:tasks.workunit.client.0.smithi159.stdout:1/834: unlink d6/d12/d1a/d92/dc8/ff0 0 2024-02-28T23:07:32.676 INFO:tasks.workunit.client.0.smithi159.stdout:4/920: dread d9/f1f [0,4194304] 0 2024-02-28T23:07:32.679 INFO:tasks.workunit.client.1.smithi184.stdout:0/494: write d0/f57 [671482,6587] 0 2024-02-28T23:07:32.683 INFO:tasks.workunit.client.1.smithi184.stdout:7/427: sync 2024-02-28T23:07:32.685 INFO:tasks.workunit.client.1.smithi184.stdout:4/443: rmdir d1/dc/df/d27/d34 39 2024-02-28T23:07:32.685 INFO:tasks.workunit.client.0.smithi159.stdout:0/912: mknod d0/de/de7/d101/c146 0 2024-02-28T23:07:32.686 INFO:tasks.workunit.client.1.smithi184.stdout:4/444: fsync d1/dc/df/d3b/d5c/f7b 0 2024-02-28T23:07:32.687 INFO:tasks.workunit.client.1.smithi184.stdout:6/401: mknod dc/de/d10/c81 0 2024-02-28T23:07:32.688 INFO:tasks.workunit.client.1.smithi184.stdout:6/402: chown dc/de/d2a/d5c/d6e 0 1 2024-02-28T23:07:32.690 INFO:tasks.workunit.client.1.smithi184.stdout:8/487: creat d1/da/d10/fba x:0 0 0 2024-02-28T23:07:32.692 INFO:tasks.workunit.client.0.smithi159.stdout:7/680: creat d5/d56/d2a/fdf x:0 0 0 2024-02-28T23:07:32.693 INFO:tasks.workunit.client.0.smithi159.stdout:5/788: dread d8/d19/d23/f5c [0,4194304] 0 2024-02-28T23:07:32.695 INFO:tasks.workunit.client.0.smithi159.stdout:6/810: dread d0/d1b/d33/d11/d34/f35 [4194304,4194304] 0 2024-02-28T23:07:32.699 INFO:tasks.workunit.client.0.smithi159.stdout:4/921: mkdir d9/d20/d87/d115/d1c/d8e/d143 0 2024-02-28T23:07:32.700 INFO:tasks.workunit.client.1.smithi184.stdout:1/530: mkdir d20/d32/d3e/d61/d8b/d9c/db8 0 2024-02-28T23:07:32.700 INFO:tasks.workunit.client.0.smithi159.stdout:4/922: dread - d9/d20/fe3 zero size 2024-02-28T23:07:32.701 INFO:tasks.workunit.client.1.smithi184.stdout:5/463: symlink db/d12/d18/d2e/d3c/d5d/d66/l95 0 2024-02-28T23:07:32.702 INFO:tasks.workunit.client.1.smithi184.stdout:3/494: sync 2024-02-28T23:07:32.703 INFO:tasks.workunit.client.1.smithi184.stdout:6/403: dwrite dc/de/f15 [0,4194304] 0 2024-02-28T23:07:32.703 INFO:tasks.workunit.client.0.smithi159.stdout:9/808: write d4/d3d/d3e/d55/d37/f9b [254163,80229] 0 2024-02-28T23:07:32.703 INFO:tasks.workunit.client.0.smithi159.stdout:8/919: dwrite d2/d73/ffc [0,4194304] 0 2024-02-28T23:07:32.705 INFO:tasks.workunit.client.1.smithi184.stdout:0/495: fdatasync d0/d7c/f7f 0 2024-02-28T23:07:32.706 INFO:tasks.workunit.client.0.smithi159.stdout:0/913: rmdir d0/d5/d38/d76/d96 39 2024-02-28T23:07:32.709 INFO:tasks.workunit.client.1.smithi184.stdout:7/428: write d6/d68/f75 [5695538,59922] 0 2024-02-28T23:07:32.712 INFO:tasks.workunit.client.0.smithi159.stdout:7/681: creat d5/d16/d1a/d27/d3e/fe0 x:0 0 0 2024-02-28T23:07:32.715 INFO:tasks.workunit.client.1.smithi184.stdout:7/429: truncate d6/f35 1532451 0 2024-02-28T23:07:32.715 INFO:tasks.workunit.client.1.smithi184.stdout:9/458: dwrite d5/db/f42 [4194304,4194304] 0 2024-02-28T23:07:32.716 INFO:tasks.workunit.client.0.smithi159.stdout:8/920: read d2/d11/d35/d5f/dfe/d68/fb1 [5098266,33076] 0 2024-02-28T23:07:32.716 INFO:tasks.workunit.client.0.smithi159.stdout:1/835: symlink d6/d1d/d46/d88/dd3/d9c/df2/l11d 0 2024-02-28T23:07:32.718 INFO:tasks.workunit.client.1.smithi184.stdout:8/488: mknod d1/da/dc/d16/d4d/d8a/cbb 0 2024-02-28T23:07:32.721 INFO:tasks.workunit.client.0.smithi159.stdout:1/836: write d6/d12/d31/f56 [2725850,51890] 0 2024-02-28T23:07:32.722 INFO:tasks.workunit.client.0.smithi159.stdout:2/723: rename d9/d50/d54/d8d/fd4 to d9/fff 0 2024-02-28T23:07:32.722 INFO:tasks.workunit.client.1.smithi184.stdout:1/531: dwrite d20/f24 [0,4194304] 0 2024-02-28T23:07:32.723 INFO:tasks.workunit.client.0.smithi159.stdout:4/923: fsync d9/d4c/d6c/fa4 0 2024-02-28T23:07:32.724 INFO:tasks.workunit.client.1.smithi184.stdout:9/459: write d5/db/de/d10/d12/d2f/f7b [175456,22806] 0 2024-02-28T23:07:32.735 INFO:tasks.workunit.client.1.smithi184.stdout:5/464: dwrite db/d12/d1c/d21/d2f/f55 [0,4194304] 0 2024-02-28T23:07:32.744 INFO:tasks.workunit.client.0.smithi159.stdout:5/789: rename d8/d16/f1e to d8/d19/d23/d35/d100/f115 0 2024-02-28T23:07:32.744 INFO:tasks.workunit.client.1.smithi184.stdout:6/404: dwrite dc/de/d10/f3d [0,4194304] 0 2024-02-28T23:07:32.745 INFO:tasks.workunit.client.1.smithi184.stdout:0/496: fdatasync d0/f17 0 2024-02-28T23:07:32.746 INFO:tasks.workunit.client.1.smithi184.stdout:3/495: creat d1/d4/d1c/d62/d92/f97 x:0 0 0 2024-02-28T23:07:32.748 INFO:tasks.workunit.client.1.smithi184.stdout:2/467: dwrite d10/d1f/d21/d5e/d15/d24/f56 [0,4194304] 0 2024-02-28T23:07:32.748 INFO:tasks.workunit.client.1.smithi184.stdout:9/460: unlink d5/d73/f85 0 2024-02-28T23:07:32.750 INFO:tasks.workunit.client.0.smithi159.stdout:1/837: fdatasync d6/d1d/d46/d88/dd3/d9c/fc2 0 2024-02-28T23:07:32.752 INFO:tasks.workunit.client.0.smithi159.stdout:4/924: rmdir d9/d4c/d6c/d98/df2 39 2024-02-28T23:07:32.752 INFO:tasks.workunit.client.0.smithi159.stdout:1/838: chown d6/d1d/d46/d88/fd0 0 1 2024-02-28T23:07:32.753 INFO:tasks.workunit.client.1.smithi184.stdout:2/468: read d10/d1f/d38/d54/f76 [828873,36975] 0 2024-02-28T23:07:32.755 INFO:tasks.workunit.client.0.smithi159.stdout:1/839: chown d6/d12/d33 1583402 1 2024-02-28T23:07:32.763 INFO:tasks.workunit.client.0.smithi159.stdout:6/811: getdents d0/d1b/d33/d11/d34/d9d/da2 0 2024-02-28T23:07:32.763 INFO:tasks.workunit.client.0.smithi159.stdout:6/812: truncate d0/fc 4574583 0 2024-02-28T23:07:32.763 INFO:tasks.workunit.client.0.smithi159.stdout:6/813: dread - d0/f104 zero size 2024-02-28T23:07:32.766 INFO:tasks.workunit.client.0.smithi159.stdout:0/914: rename d0/d5/d14/d34/d6c/daf/fc6 to d0/d5/d14/d25/d2c/f147 0 2024-02-28T23:07:32.770 INFO:tasks.workunit.client.0.smithi159.stdout:5/790: rmdir d8/d19/d23/d35/d65 39 2024-02-28T23:07:32.772 INFO:tasks.workunit.client.0.smithi159.stdout:5/791: write d8/db4/fd1 [725085,38507] 0 2024-02-28T23:07:32.778 INFO:tasks.workunit.client.0.smithi159.stdout:8/921: write d2/d11/d52/d26/d36/d38/d77/f9f [380245,24657] 0 2024-02-28T23:07:32.782 INFO:tasks.workunit.client.1.smithi184.stdout:8/489: dread d1/da/dc/d16/d29/f2a [0,4194304] 0 2024-02-28T23:07:32.783 INFO:tasks.workunit.client.0.smithi159.stdout:9/809: getdents d4/d3d/d3e/d4a 0 2024-02-28T23:07:32.787 INFO:tasks.workunit.client.0.smithi159.stdout:6/814: truncate d0/d6d/fa1 571268 0 2024-02-28T23:07:32.787 INFO:tasks.workunit.client.0.smithi159.stdout:0/915: mknod d0/d5/d38/d63/dd8/c148 0 2024-02-28T23:07:32.788 INFO:tasks.workunit.client.0.smithi159.stdout:9/810: dread d4/d3d/d3e/d4a/f59 [0,4194304] 0 2024-02-28T23:07:32.793 INFO:tasks.workunit.client.0.smithi159.stdout:5/792: fdatasync d8/d19/d23/d35/d41/daa/f8e 0 2024-02-28T23:07:32.794 INFO:tasks.workunit.client.1.smithi184.stdout:0/497: dread d0/df/d13/d27/d31/f8f [0,4194304] 0 2024-02-28T23:07:32.795 INFO:tasks.workunit.client.0.smithi159.stdout:5/793: dread d8/d19/d23/d2a/f9f [0,4194304] 0 2024-02-28T23:07:32.796 INFO:tasks.workunit.client.0.smithi159.stdout:5/794: chown d8/d19/d23/d35/d38 34 1 2024-02-28T23:07:32.797 INFO:tasks.workunit.client.0.smithi159.stdout:2/724: fdatasync d9/fff 0 2024-02-28T23:07:32.801 INFO:tasks.workunit.client.0.smithi159.stdout:7/682: getdents d5/d16/d1a/d27/d75/dac 0 2024-02-28T23:07:32.804 INFO:tasks.workunit.client.0.smithi159.stdout:1/840: write d6/d12/d16/f64 [710065,77355] 0 2024-02-28T23:07:32.806 INFO:tasks.workunit.client.1.smithi184.stdout:4/445: creat d1/dc/df/f82 x:0 0 0 2024-02-28T23:07:32.810 INFO:tasks.workunit.client.0.smithi159.stdout:6/815: rename d0/d6d/f95 to d0/d6d/f10b 0 2024-02-28T23:07:32.812 INFO:tasks.workunit.client.1.smithi184.stdout:0/498: dread d0/d1f/f28 [0,4194304] 0 2024-02-28T23:07:32.812 INFO:tasks.workunit.client.0.smithi159.stdout:6/816: read d0/d1b/fcb [7645389,108362] 0 2024-02-28T23:07:32.814 INFO:tasks.workunit.client.0.smithi159.stdout:0/916: dread - d0/d5/d14/d25/d2c/f147 zero size 2024-02-28T23:07:32.814 INFO:tasks.workunit.client.1.smithi184.stdout:0/499: write d0/df/d13/d27/d31/d51/f8c [76552,50397] 0 2024-02-28T23:07:32.815 INFO:tasks.workunit.client.1.smithi184.stdout:7/430: fsync d6/d9/d13/d14/f42 0 2024-02-28T23:07:32.816 INFO:tasks.workunit.client.0.smithi159.stdout:0/917: chown d0/de/c4c 6 1 2024-02-28T23:07:32.819 INFO:tasks.workunit.client.0.smithi159.stdout:9/811: rename d4/d3d/d3e/d55/d37/f79 to d4/d3d/d3e/d55/d37/d62/d6a/ffe 0 2024-02-28T23:07:32.824 INFO:tasks.workunit.client.1.smithi184.stdout:6/405: creat dc/d60/d62/f82 x:0 0 0 2024-02-28T23:07:32.825 INFO:tasks.workunit.client.1.smithi184.stdout:6/406: write dc/de/f40 [2643655,83978] 0 2024-02-28T23:07:32.834 INFO:tasks.workunit.client.0.smithi159.stdout:8/922: dread d2/d11/d35/d9c/da0/fb9 [0,4194304] 0 2024-02-28T23:07:32.835 INFO:tasks.workunit.client.1.smithi184.stdout:9/461: unlink d5/db/de/c63 0 2024-02-28T23:07:32.836 INFO:tasks.workunit.client.0.smithi159.stdout:1/841: unlink d6/fb 0 2024-02-28T23:07:32.839 INFO:tasks.workunit.client.1.smithi184.stdout:1/532: mknod d20/d46/d90/db3/cb9 0 2024-02-28T23:07:32.840 INFO:tasks.workunit.client.0.smithi159.stdout:7/683: write d5/d16/d1a/f70 [1266144,90971] 0 2024-02-28T23:07:32.842 INFO:tasks.workunit.client.1.smithi184.stdout:2/469: symlink d10/d1f/d21/d6a/l99 0 2024-02-28T23:07:32.842 INFO:tasks.workunit.client.0.smithi159.stdout:0/918: dread d0/d5/d14/d78/f87 [0,4194304] 0 2024-02-28T23:07:32.845 INFO:tasks.workunit.client.1.smithi184.stdout:8/490: creat d1/da/dc/d16/fbc x:0 0 0 2024-02-28T23:07:32.845 INFO:tasks.workunit.client.0.smithi159.stdout:9/812: fsync d4/d3d/d3e/f73 0 2024-02-28T23:07:32.847 INFO:tasks.workunit.client.1.smithi184.stdout:4/446: symlink d1/d4/d43/l83 0 2024-02-28T23:07:32.852 INFO:tasks.workunit.client.0.smithi159.stdout:5/795: mkdir d8/d19/d23/d35/d41/d116 0 2024-02-28T23:07:32.854 INFO:tasks.workunit.client.0.smithi159.stdout:8/923: creat d2/d11/d52/d26/d36/f122 x:0 0 0 2024-02-28T23:07:32.856 INFO:tasks.workunit.client.0.smithi159.stdout:1/842: creat d6/d12/d1a/d92/dc9/dfb/f11e x:0 0 0 2024-02-28T23:07:32.856 INFO:tasks.workunit.client.0.smithi159.stdout:2/725: dread d9/d50/d54/d84/d37/f4d [0,4194304] 0 2024-02-28T23:07:32.857 INFO:tasks.workunit.client.1.smithi184.stdout:5/465: write db/f61 [784598,11691] 0 2024-02-28T23:07:32.859 INFO:tasks.workunit.client.1.smithi184.stdout:5/466: readlink db/d12/d1c/d21/d4d/l5c 0 2024-02-28T23:07:32.861 INFO:tasks.workunit.client.0.smithi159.stdout:0/919: read d0/d5/d14/d25/f77 [4075368,18698] 0 2024-02-28T23:07:32.864 INFO:tasks.workunit.client.0.smithi159.stdout:9/813: rename d4/d3d/l4f to d4/d3d/d3e/d55/d37/d62/lff 0 2024-02-28T23:07:32.866 INFO:tasks.workunit.client.0.smithi159.stdout:5/796: mkdir d8/d19/d23/d35/d41/daa/d88/d117 0 2024-02-28T23:07:32.866 INFO:tasks.workunit.client.1.smithi184.stdout:0/500: dwrite d0/d1d/f3d [0,4194304] 0 2024-02-28T23:07:32.868 INFO:tasks.workunit.client.0.smithi159.stdout:5/797: readlink d8/d19/d23/d35/d41/l5f 0 2024-02-28T23:07:32.872 INFO:tasks.workunit.client.0.smithi159.stdout:8/924: read d2/d3/f30 [148883,111294] 0 2024-02-28T23:07:32.878 INFO:tasks.workunit.client.0.smithi159.stdout:6/817: link d0/d1b/d33/d8c/cb8 d0/d1b/d33/d11/d34/d9d/da2/db7/db1/d106/c10c 0 2024-02-28T23:07:32.882 INFO:tasks.workunit.client.0.smithi159.stdout:2/726: dwrite d9/d50/d62/fe2 [0,4194304] 0 2024-02-28T23:07:32.884 INFO:tasks.workunit.client.0.smithi159.stdout:2/727: chown d9/d23/da9 111885312 1 2024-02-28T23:07:32.887 INFO:tasks.workunit.client.0.smithi159.stdout:1/843: fsync d6/d1d/d46/f4c 0 2024-02-28T23:07:32.889 INFO:tasks.workunit.client.0.smithi159.stdout:1/844: stat d6/d1d/d46/f5f 0 2024-02-28T23:07:32.891 INFO:tasks.workunit.client.0.smithi159.stdout:5/798: creat d8/d19/d23/d35/d41/d92/d10c/dff/f118 x:0 0 0 2024-02-28T23:07:32.892 INFO:tasks.workunit.client.1.smithi184.stdout:6/407: creat dc/d60/d6d/f83 x:0 0 0 2024-02-28T23:07:32.893 INFO:tasks.workunit.client.0.smithi159.stdout:0/920: dread d0/de/d46/f61 [0,4194304] 0 2024-02-28T23:07:32.894 INFO:tasks.workunit.client.0.smithi159.stdout:6/818: truncate d0/d1b/d5b/fba 1588802 0 2024-02-28T23:07:32.895 INFO:tasks.workunit.client.1.smithi184.stdout:3/496: creat d1/f98 x:0 0 0 2024-02-28T23:07:32.899 INFO:tasks.workunit.client.1.smithi184.stdout:1/533: mknod d20/d32/d3e/d9a/cba 0 2024-02-28T23:07:32.903 INFO:tasks.workunit.client.0.smithi159.stdout:5/799: unlink d8/d19/d23/d2a/lee 0 2024-02-28T23:07:32.903 INFO:tasks.workunit.client.1.smithi184.stdout:2/470: truncate d10/d1f/d21/d5e/d15/f2b 997565 0 2024-02-28T23:07:32.903 INFO:tasks.workunit.client.1.smithi184.stdout:4/447: mknod d1/d8/d19/d67/c84 0 2024-02-28T23:07:32.904 INFO:tasks.workunit.client.1.smithi184.stdout:7/431: rmdir d6/d91 0 2024-02-28T23:07:32.906 INFO:tasks.workunit.client.0.smithi159.stdout:6/819: rename d0/d1b/d33/d11/l46 to d0/d1b/d33/d11/d34/d9d/da2/db7/db1/l10d 0 2024-02-28T23:07:32.907 INFO:tasks.workunit.client.1.smithi184.stdout:5/467: mknod db/c96 0 2024-02-28T23:07:32.909 INFO:tasks.workunit.client.1.smithi184.stdout:3/497: fsync d1/d4/d6/d1e/d72/f50 0 2024-02-28T23:07:32.912 INFO:tasks.workunit.client.1.smithi184.stdout:0/501: symlink d0/df/d13/d27/d31/d5b/d9e/lab 0 2024-02-28T23:07:32.912 INFO:tasks.workunit.client.0.smithi159.stdout:9/814: dread d4/d3d/d3e/d4a/fab [0,4194304] 0 2024-02-28T23:07:32.913 INFO:tasks.workunit.client.1.smithi184.stdout:5/468: chown db/d12/d18/d2e/d3c/d5d/d66/f6e 618799696 1 2024-02-28T23:07:32.915 INFO:tasks.workunit.client.1.smithi184.stdout:6/408: dwrite dc/de/d10/f43 [0,4194304] 0 2024-02-28T23:07:32.916 INFO:tasks.workunit.client.1.smithi184.stdout:1/534: dread d20/f88 [0,4194304] 0 2024-02-28T23:07:32.921 INFO:tasks.workunit.client.1.smithi184.stdout:6/409: stat dc/d42/c72 0 2024-02-28T23:07:32.921 INFO:tasks.workunit.client.0.smithi159.stdout:9/815: creat d4/d3d/d3e/d55/d4c/d4e/d6b/f100 x:0 0 0 2024-02-28T23:07:32.922 INFO:tasks.workunit.client.0.smithi159.stdout:6/820: symlink d0/d1b/d33/d3f/d44/l10e 0 2024-02-28T23:07:32.925 INFO:tasks.workunit.client.0.smithi159.stdout:8/925: dwrite d2/d11/d52/d26/d36/d38/d77/dc5/fd9 [0,4194304] 0 2024-02-28T23:07:32.925 INFO:tasks.workunit.client.0.smithi159.stdout:0/921: getdents d0/d5/d14/d78/da8 0 2024-02-28T23:07:32.929 INFO:tasks.workunit.client.0.smithi159.stdout:1/845: dwrite d6/d12/f18 [4194304,4194304] 0 2024-02-28T23:07:32.933 INFO:tasks.workunit.client.0.smithi159.stdout:1/846: fdatasync d6/d1d/d46/d88/dd3/d63/f112 0 2024-02-28T23:07:32.933 INFO:tasks.workunit.client.0.smithi159.stdout:5/800: link d8/d19/d23/d35/d41/daa/d79/l81 d8/d19/d23/d2a/l119 0 2024-02-28T23:07:32.935 INFO:tasks.workunit.client.1.smithi184.stdout:1/535: creat d20/d46/fbb x:0 0 0 2024-02-28T23:07:32.937 INFO:tasks.workunit.client.1.smithi184.stdout:9/462: sync 2024-02-28T23:07:32.939 INFO:tasks.workunit.client.0.smithi159.stdout:8/926: mkdir d2/d11/d52/d26/d36/d38/d77/d123 0 2024-02-28T23:07:32.941 INFO:tasks.workunit.client.0.smithi159.stdout:0/922: readlink d0/de/d75/db8/d103/d121/l127 0 2024-02-28T23:07:32.942 INFO:tasks.workunit.client.0.smithi159.stdout:0/923: chown d0/d5/d38 46371125 1 2024-02-28T23:07:32.943 INFO:tasks.workunit.client.1.smithi184.stdout:9/463: dread - d5/db/f79 zero size 2024-02-28T23:07:32.944 INFO:tasks.workunit.client.0.smithi159.stdout:9/816: dread d4/d3d/d3e/d55/d37/d62/d8f/fed [0,4194304] 0 2024-02-28T23:07:32.944 INFO:tasks.workunit.client.0.smithi159.stdout:6/821: readlink d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/l1c 0 2024-02-28T23:07:32.945 INFO:tasks.workunit.client.1.smithi184.stdout:4/448: dread d1/d8/d3d/f74 [0,4194304] 0 2024-02-28T23:07:32.946 INFO:tasks.workunit.client.1.smithi184.stdout:6/410: dread dc/de/d10/f1b [0,4194304] 0 2024-02-28T23:07:32.946 INFO:tasks.workunit.client.1.smithi184.stdout:7/432: rename d6/d9/da/dc/d49/f66 to d6/f9e 0 2024-02-28T23:07:32.946 INFO:tasks.workunit.client.1.smithi184.stdout:0/502: dwrite d0/d1d/f6d [0,4194304] 0 2024-02-28T23:07:32.946 INFO:tasks.workunit.client.1.smithi184.stdout:5/469: dwrite db/d44/f84 [0,4194304] 0 2024-02-28T23:07:32.948 INFO:tasks.workunit.client.0.smithi159.stdout:8/927: chown d2/d11/d35/d5f/dfe/d68/f8d 14004 1 2024-02-28T23:07:32.951 INFO:tasks.workunit.client.0.smithi159.stdout:2/728: dread d9/d50/d54/d84/fa8 [0,4194304] 0 2024-02-28T23:07:32.954 INFO:tasks.workunit.client.0.smithi159.stdout:0/924: mknod d0/d5/d38/d63/dad/c149 0 2024-02-28T23:07:32.957 INFO:tasks.workunit.client.0.smithi159.stdout:1/847: creat d6/d12/d16/f11f x:0 0 0 2024-02-28T23:07:32.958 INFO:tasks.workunit.client.0.smithi159.stdout:0/925: write d0/d5/d14/d25/d2c/dab/fd0 [904429,1923] 0 2024-02-28T23:07:32.959 INFO:tasks.workunit.client.1.smithi184.stdout:8/491: dwrite d1/da/dc/d16/d4d/f5a [0,4194304] 0 2024-02-28T23:07:32.960 INFO:tasks.workunit.client.1.smithi184.stdout:5/470: chown db/d12/d18/d2e/d3c/d5d/d66/l8c 253372 1 2024-02-28T23:07:32.962 INFO:tasks.workunit.client.0.smithi159.stdout:2/729: truncate d9/d23/d2c/f2d 2367558 0 2024-02-28T23:07:32.962 INFO:tasks.workunit.client.1.smithi184.stdout:4/449: truncate d1/dc/df/f82 1044332 0 2024-02-28T23:07:32.964 INFO:tasks.workunit.client.1.smithi184.stdout:2/471: dread d10/d1f/d21/d5e/f3d [0,4194304] 0 2024-02-28T23:07:32.964 INFO:tasks.workunit.client.1.smithi184.stdout:4/450: chown d1/dc/df/d5b 31393 1 2024-02-28T23:07:32.965 INFO:tasks.workunit.client.0.smithi159.stdout:2/730: stat d9/d80/fe5 0 2024-02-28T23:07:32.968 INFO:tasks.workunit.client.1.smithi184.stdout:4/451: write d1/d4/d43/d73/f5e [184541,60505] 0 2024-02-28T23:07:32.971 INFO:tasks.workunit.client.1.smithi184.stdout:9/464: fsync d5/db/d65/f6c 0 2024-02-28T23:07:32.972 INFO:tasks.workunit.client.0.smithi159.stdout:8/928: creat d2/f124 x:0 0 0 2024-02-28T23:07:32.973 INFO:tasks.workunit.client.0.smithi159.stdout:1/848: read d6/d12/f15 [1767802,120143] 0 2024-02-28T23:07:32.973 INFO:tasks.workunit.client.0.smithi159.stdout:6/822: getdents d0/d1b/d33/d3f 0 2024-02-28T23:07:32.975 INFO:tasks.workunit.client.1.smithi184.stdout:0/503: unlink d0/df/d13/d27/f76 0 2024-02-28T23:07:32.976 INFO:tasks.workunit.client.1.smithi184.stdout:8/492: stat d1/da/l6c 0 2024-02-28T23:07:32.977 INFO:tasks.workunit.client.0.smithi159.stdout:5/801: write d8/d59/fe9 [2794740,112352] 0 2024-02-28T23:07:32.978 INFO:tasks.workunit.client.1.smithi184.stdout:6/411: write dc/de/d10/d16/f2d [3129582,24909] 0 2024-02-28T23:07:32.978 INFO:tasks.workunit.client.0.smithi159.stdout:2/731: fsync d9/d23/d2c/d55/f29 0 2024-02-28T23:07:32.979 INFO:tasks.workunit.client.1.smithi184.stdout:2/472: creat d10/d1f/d21/d5e/d15/d60/f9a x:0 0 0 2024-02-28T23:07:32.981 INFO:tasks.workunit.client.1.smithi184.stdout:2/473: chown f8 491788567 1 2024-02-28T23:07:32.986 INFO:tasks.workunit.client.0.smithi159.stdout:2/732: symlink d9/d36/dc3/l100 0 2024-02-28T23:07:32.993 INFO:tasks.workunit.client.0.smithi159.stdout:5/802: symlink d8/d19/d23/d35/d65/da3/df4/da5/ddc/l11a 0 2024-02-28T23:07:32.994 INFO:tasks.workunit.client.0.smithi159.stdout:2/733: rename d9/lbd to d9/d23/de6/l101 0 2024-02-28T23:07:32.997 INFO:tasks.workunit.client.1.smithi184.stdout:0/504: rename d0/df/d13/d27/d31/d5b/d9e to d0/df/d13/d27/d31/d5b/d8e/d92/dac 0 2024-02-28T23:07:32.998 INFO:tasks.workunit.client.1.smithi184.stdout:3/498: truncate d1/d4/d6/d1f/d26/f29 1251294 0 2024-02-28T23:07:32.999 INFO:tasks.workunit.client.0.smithi159.stdout:8/929: dread d2/d11/d52/d6e/f87 [0,4194304] 0 2024-02-28T23:07:33.000 INFO:tasks.workunit.client.1.smithi184.stdout:0/505: fdatasync d0/df/d13/d27/d31/d5b/d8e/d91/fa6 0 2024-02-28T23:07:33.005 INFO:tasks.workunit.client.0.smithi159.stdout:9/817: dwrite d4/f11 [4194304,4194304] 0 2024-02-28T23:07:33.009 INFO:tasks.workunit.client.0.smithi159.stdout:6/823: dread d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/fc1 [0,4194304] 0 2024-02-28T23:07:33.011 INFO:tasks.workunit.client.1.smithi184.stdout:7/433: dread d6/d9/da/f31 [0,4194304] 0 2024-02-28T23:07:33.023 INFO:tasks.workunit.client.1.smithi184.stdout:8/493: unlink d1/da/dc/d16/f5c 0 2024-02-28T23:07:33.028 INFO:tasks.workunit.client.0.smithi159.stdout:0/926: write d0/de/f2b [1575285,106414] 0 2024-02-28T23:07:33.028 INFO:tasks.workunit.client.0.smithi159.stdout:8/930: rmdir d2/d11 39 2024-02-28T23:07:33.034 INFO:tasks.workunit.client.1.smithi184.stdout:1/536: dwrite d20/d32/d4d/f7d [0,4194304] 0 2024-02-28T23:07:33.038 INFO:tasks.workunit.client.1.smithi184.stdout:5/471: dwrite db/d12/d18/d2e/d3c/d5d/f4b [0,4194304] 0 2024-02-28T23:07:33.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:32 smithi184 ceph-mon[36198]: pgmap v35: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 56 MiB/s rd, 168 MiB/s wr, 342 op/s 2024-02-28T23:07:33.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:32 smithi159 ceph-mon[28802]: pgmap v35: 65 pgs: 65 active+clean; 2.4 GiB data, 7.3 GiB used, 529 GiB / 536 GiB avail; 56 MiB/s rd, 168 MiB/s wr, 342 op/s 2024-02-28T23:07:33.282 INFO:tasks.workunit.client.0.smithi159.stdout:6/824: mknod d0/d1b/d33/d11/d34/d9d/da2/dbf/c10f 0 2024-02-28T23:07:33.285 INFO:tasks.workunit.client.1.smithi184.stdout:3/499: creat d1/d4/d6/d1e/d72/f99 x:0 0 0 2024-02-28T23:07:33.288 INFO:tasks.workunit.client.1.smithi184.stdout:9/465: write d5/db/de/d10/d12/d2f/f52 [2051319,32310] 0 2024-02-28T23:07:33.288 INFO:tasks.workunit.client.1.smithi184.stdout:3/500: readlink d1/d4/d1c/l2d 0 2024-02-28T23:07:33.294 INFO:tasks.workunit.client.1.smithi184.stdout:7/434: fsync d6/f67 0 2024-02-28T23:07:33.300 INFO:tasks.workunit.client.1.smithi184.stdout:7/435: chown d6/d9/da/dc/f1b 417009 1 2024-02-28T23:07:33.320 INFO:tasks.workunit.client.0.smithi159.stdout:1/849: dwrite d6/d12/f93 [0,4194304] 0 2024-02-28T23:07:33.325 INFO:tasks.workunit.client.0.smithi159.stdout:2/734: write d9/d23/da9/fb4 [348525,116182] 0 2024-02-28T23:07:33.326 INFO:tasks.workunit.client.0.smithi159.stdout:3/743: sync 2024-02-28T23:07:33.326 INFO:tasks.workunit.client.0.smithi159.stdout:5/803: dwrite d8/d19/d23/d35/fc2 [0,4194304] 0 2024-02-28T23:07:33.328 INFO:tasks.workunit.client.1.smithi184.stdout:4/452: getdents d1 0 2024-02-28T23:07:33.331 INFO:tasks.workunit.client.1.smithi184.stdout:4/453: chown d1/d8/d19/l54 1438 1 2024-02-28T23:07:33.332 INFO:tasks.workunit.client.1.smithi184.stdout:1/537: mknod d20/d46/d90/cbc 0 2024-02-28T23:07:33.339 INFO:tasks.workunit.client.0.smithi159.stdout:5/804: dread d8/f13 [0,4194304] 0 2024-02-28T23:07:33.340 INFO:tasks.workunit.client.1.smithi184.stdout:5/472: unlink db/d12/d18/d2e/f8e 0 2024-02-28T23:07:33.340 INFO:tasks.workunit.client.1.smithi184.stdout:1/538: read d20/f47 [406764,23107] 0 2024-02-28T23:07:33.345 INFO:tasks.workunit.client.1.smithi184.stdout:9/466: truncate d5/d17/f3c 5173798 0 2024-02-28T23:07:33.346 INFO:tasks.workunit.client.0.smithi159.stdout:0/927: write d0/d5/d14/d78/da8/fb1 [389477,81953] 0 2024-02-28T23:07:33.350 INFO:tasks.workunit.client.1.smithi184.stdout:6/412: link dc/l4e dc/de/d2a/d5c/d79/l84 0 2024-02-28T23:07:33.352 INFO:tasks.workunit.client.1.smithi184.stdout:7/436: dread d6/f16 [0,4194304] 0 2024-02-28T23:07:33.353 INFO:tasks.workunit.client.1.smithi184.stdout:8/494: mkdir d1/da/dc/d16/dbd 0 2024-02-28T23:07:33.355 INFO:tasks.workunit.client.1.smithi184.stdout:6/413: truncate dc/de/f5a 1145751 0 2024-02-28T23:07:33.355 INFO:tasks.workunit.client.1.smithi184.stdout:8/495: readlink d1/da/df/l4e 0 2024-02-28T23:07:33.358 INFO:tasks.workunit.client.1.smithi184.stdout:7/437: write d6/d9/d13/d14/f7b [565305,21804] 0 2024-02-28T23:07:33.359 INFO:tasks.workunit.client.1.smithi184.stdout:8/496: chown d1/da/dc/d18/l4a 3653 1 2024-02-28T23:07:33.360 INFO:tasks.workunit.client.1.smithi184.stdout:4/454: unlink d1/d8/d19/f39 0 2024-02-28T23:07:33.361 INFO:tasks.workunit.client.1.smithi184.stdout:7/438: chown d6/d9/d13/d1e/d2f/d33/c51 24629624 1 2024-02-28T23:07:33.365 INFO:tasks.workunit.client.0.smithi159.stdout:0/928: dwrite d0/d5/d14/d78/da8/fb1 [0,4194304] 0 2024-02-28T23:07:33.366 INFO:tasks.workunit.client.1.smithi184.stdout:7/439: dread d6/d9/d13/d1e/d2f/d33/f36 [0,4194304] 0 2024-02-28T23:07:33.367 INFO:tasks.workunit.client.1.smithi184.stdout:0/506: creat d0/fad x:0 0 0 2024-02-28T23:07:33.370 INFO:tasks.workunit.client.1.smithi184.stdout:3/501: write d1/d4/f57 [5354148,69204] 0 2024-02-28T23:07:33.371 INFO:tasks.workunit.client.1.smithi184.stdout:5/473: rename db/d12/d18/d2e/d3c/d5d/d66/l95 to db/d12/d18/d2e/d3c/d5d/d66/l97 0 2024-02-28T23:07:33.374 INFO:tasks.workunit.client.1.smithi184.stdout:2/474: link f8 d10/d33/f9b 0 2024-02-28T23:07:33.375 INFO:tasks.workunit.client.1.smithi184.stdout:6/414: dwrite dc/de/d10/f43 [0,4194304] 0 2024-02-28T23:07:33.381 INFO:tasks.workunit.client.0.smithi159.stdout:4/925: sync 2024-02-28T23:07:33.381 INFO:tasks.workunit.client.1.smithi184.stdout:8/497: fsync d1/da/dc/d16/d4d/d82/fa8 0 2024-02-28T23:07:33.390 INFO:tasks.workunit.client.1.smithi184.stdout:9/467: dread d5/db/de/d10/f2b [0,4194304] 0 2024-02-28T23:07:33.391 INFO:tasks.workunit.client.1.smithi184.stdout:4/455: creat d1/d8/d19/d56/f85 x:0 0 0 2024-02-28T23:07:33.394 INFO:tasks.workunit.client.1.smithi184.stdout:4/456: truncate d1/d8/d19/d56/f85 652283 0 2024-02-28T23:07:33.395 INFO:tasks.workunit.client.1.smithi184.stdout:0/507: creat d0/df/d13/d5a/fae x:0 0 0 2024-02-28T23:07:33.397 INFO:tasks.workunit.client.1.smithi184.stdout:4/457: chown d1/d8/d3d/d44/f66 28937 1 2024-02-28T23:07:33.399 INFO:tasks.workunit.client.1.smithi184.stdout:5/474: dread db/d1f/f78 [0,4194304] 0 2024-02-28T23:07:33.400 INFO:tasks.workunit.client.1.smithi184.stdout:6/415: symlink dc/de/d2a/l85 0 2024-02-28T23:07:33.402 INFO:tasks.workunit.client.1.smithi184.stdout:3/502: creat d1/d4/d1c/d61/f9a x:0 0 0 2024-02-28T23:07:33.404 INFO:tasks.workunit.client.1.smithi184.stdout:8/498: mkdir d1/da/d10/d17/d63/dbe 0 2024-02-28T23:07:33.405 INFO:tasks.workunit.client.1.smithi184.stdout:9/468: rmdir d5/d47/d68 39 2024-02-28T23:07:33.408 INFO:tasks.workunit.client.0.smithi159.stdout:8/931: symlink d2/l125 0 2024-02-28T23:07:33.408 INFO:tasks.workunit.client.1.smithi184.stdout:0/508: rmdir d0/df/d13/d27 39 2024-02-28T23:07:33.411 INFO:tasks.workunit.client.0.smithi159.stdout:1/850: fdatasync d6/d1d/fc7 0 2024-02-28T23:07:33.413 INFO:tasks.workunit.client.0.smithi159.stdout:2/735: stat d9/d23/d2c/d55/c10 0 2024-02-28T23:07:33.414 INFO:tasks.workunit.client.1.smithi184.stdout:3/503: fdatasync d1/d4/d6/d1e/d72/f7a 0 2024-02-28T23:07:33.414 INFO:tasks.workunit.client.1.smithi184.stdout:6/416: dread dc/de/d10/d16/f2d [0,4194304] 0 2024-02-28T23:07:33.416 INFO:tasks.workunit.client.1.smithi184.stdout:8/499: chown d1/c84 26 1 2024-02-28T23:07:33.416 INFO:tasks.workunit.client.1.smithi184.stdout:6/417: readlink dc/d60/l68 0 2024-02-28T23:07:33.417 INFO:tasks.workunit.client.1.smithi184.stdout:1/539: getdents d20/d46/d90 0 2024-02-28T23:07:33.419 INFO:tasks.workunit.client.0.smithi159.stdout:0/929: symlink d0/de/de7/l14a 0 2024-02-28T23:07:33.424 INFO:tasks.workunit.client.0.smithi159.stdout:9/818: sync 2024-02-28T23:07:33.424 INFO:tasks.workunit.client.0.smithi159.stdout:7/684: sync 2024-02-28T23:07:33.425 INFO:tasks.workunit.client.1.smithi184.stdout:0/509: dread - d0/df/d13/d27/d31/d51/f73 zero size 2024-02-28T23:07:33.425 INFO:tasks.workunit.client.0.smithi159.stdout:6/825: symlink d0/d1b/d33/d11/l110 0 2024-02-28T23:07:33.426 INFO:tasks.workunit.client.0.smithi159.stdout:6/826: chown d0/lfa 32 1 2024-02-28T23:07:33.426 INFO:tasks.workunit.client.1.smithi184.stdout:5/475: symlink db/l98 0 2024-02-28T23:07:33.430 INFO:tasks.workunit.client.1.smithi184.stdout:3/504: dwrite d1/d4/fb [0,4194304] 0 2024-02-28T23:07:33.431 INFO:tasks.workunit.client.0.smithi159.stdout:1/851: read d6/d12/d1a/f53 [492396,16838] 0 2024-02-28T23:07:33.432 INFO:tasks.workunit.client.0.smithi159.stdout:3/744: getdents d0/d3f/dd2/d6a/de7 0 2024-02-28T23:07:33.433 INFO:tasks.workunit.client.1.smithi184.stdout:3/505: read - d1/d4/d1c/d62/d92/f97 zero size 2024-02-28T23:07:33.433 INFO:tasks.workunit.client.1.smithi184.stdout:4/458: dread d1/d8/f5a [0,4194304] 0 2024-02-28T23:07:33.433 INFO:tasks.workunit.client.1.smithi184.stdout:6/418: chown dc/l4e 6623 1 2024-02-28T23:07:33.433 INFO:tasks.workunit.client.1.smithi184.stdout:7/440: dread d6/d9/da/dc/f3c [0,4194304] 0 2024-02-28T23:07:33.434 INFO:tasks.workunit.client.0.smithi159.stdout:1/852: write d6/d1d/d46/d88/dd3/d9c/db3/dc4/fe8 [4940175,47407] 0 2024-02-28T23:07:33.435 INFO:tasks.workunit.client.1.smithi184.stdout:7/441: readlink d6/d9/da/l23 0 2024-02-28T23:07:33.435 INFO:tasks.workunit.client.1.smithi184.stdout:3/506: write d1/f8d [4136520,70112] 0 2024-02-28T23:07:33.436 INFO:tasks.workunit.client.1.smithi184.stdout:1/540: mknod d20/d32/d3e/d61/d8b/d9c/cbd 0 2024-02-28T23:07:33.437 INFO:tasks.workunit.client.0.smithi159.stdout:5/805: symlink d8/d19/d23/d35/d41/l11b 0 2024-02-28T23:07:33.438 INFO:tasks.workunit.client.1.smithi184.stdout:1/541: dread - d20/d32/d3e/d91/fa4 zero size 2024-02-28T23:07:33.440 INFO:tasks.workunit.client.0.smithi159.stdout:0/930: creat d0/d5/d38/d63/dad/f14b x:0 0 0 2024-02-28T23:07:33.441 INFO:tasks.workunit.client.1.smithi184.stdout:1/542: chown d20/d32/d3e/f4a 2126987596 1 2024-02-28T23:07:33.443 INFO:tasks.workunit.client.0.smithi159.stdout:5/806: readlink d8/d19/d23/d35/d65/da3/df4/da5/d90/le7 0 2024-02-28T23:07:33.444 INFO:tasks.workunit.client.1.smithi184.stdout:1/543: fsync fb 0 2024-02-28T23:07:33.445 INFO:tasks.workunit.client.1.smithi184.stdout:0/510: creat d0/df/d13/d27/d31/d51/faf x:0 0 0 2024-02-28T23:07:33.445 INFO:tasks.workunit.client.1.smithi184.stdout:5/476: symlink db/d12/d18/d2e/l99 0 2024-02-28T23:07:33.445 INFO:tasks.workunit.client.1.smithi184.stdout:0/511: write d0/df/f63 [865649,64365] 0 2024-02-28T23:07:33.445 INFO:tasks.workunit.client.1.smithi184.stdout:5/477: stat db 0 2024-02-28T23:07:33.446 INFO:tasks.workunit.client.1.smithi184.stdout:1/544: truncate d20/d32/db0/fae 325313 0 2024-02-28T23:07:33.447 INFO:tasks.workunit.client.0.smithi159.stdout:9/819: rmdir d4 39 2024-02-28T23:07:33.447 INFO:tasks.workunit.client.1.smithi184.stdout:0/512: stat d0/d1f/f43 0 2024-02-28T23:07:33.447 INFO:tasks.workunit.client.0.smithi159.stdout:7/685: dread - d5/d16/d1a/d24/f6e zero size 2024-02-28T23:07:33.447 INFO:tasks.workunit.client.1.smithi184.stdout:8/500: creat d1/da/dc/d16/d29/d7d/fbf x:0 0 0 2024-02-28T23:07:33.453 INFO:tasks.workunit.client.0.smithi159.stdout:8/932: unlink d2/d11/d52/d26/d36/d38/l7b 0 2024-02-28T23:07:33.453 INFO:tasks.workunit.client.1.smithi184.stdout:3/507: dwrite d1/d4/d1c/d62/d66/f6f [0,4194304] 0 2024-02-28T23:07:33.457 INFO:tasks.workunit.client.0.smithi159.stdout:2/736: link d9/d50/d62/fe2 d9/d23/da9/f102 0 2024-02-28T23:07:33.458 INFO:tasks.workunit.client.1.smithi184.stdout:7/442: dread d6/d9/d13/d3e/d7e/f90 [4194304,4194304] 0 2024-02-28T23:07:33.461 INFO:tasks.workunit.client.0.smithi159.stdout:3/745: truncate d0/d3f/dd2/d6a/fd0 639163 0 2024-02-28T23:07:33.464 INFO:tasks.workunit.client.0.smithi159.stdout:5/807: unlink d8/d16/l97 0 2024-02-28T23:07:33.465 INFO:tasks.workunit.client.0.smithi159.stdout:4/926: dwrite d9/d42/d54/d9c/dd7/fff [0,4194304] 0 2024-02-28T23:07:33.469 INFO:tasks.workunit.client.1.smithi184.stdout:2/475: sync 2024-02-28T23:07:33.470 INFO:tasks.workunit.client.1.smithi184.stdout:1/545: chown d20/d46/d90/l6d 589567 1 2024-02-28T23:07:33.471 INFO:tasks.workunit.client.1.smithi184.stdout:2/476: write d10/d1f/d38/d54/f97 [1170685,5404] 0 2024-02-28T23:07:33.472 INFO:tasks.workunit.client.1.smithi184.stdout:6/419: mkdir dc/de/d10/d86 0 2024-02-28T23:07:33.474 INFO:tasks.workunit.client.0.smithi159.stdout:7/686: truncate d5/d56/d50/daa/fae 1047255 0 2024-02-28T23:07:33.481 INFO:tasks.workunit.client.0.smithi159.stdout:1/853: creat d6/d12/d33/d72/f120 x:0 0 0 2024-02-28T23:07:33.487 INFO:tasks.workunit.client.0.smithi159.stdout:8/933: dwrite d2/f124 [0,4194304] 0 2024-02-28T23:07:33.489 INFO:tasks.workunit.client.1.smithi184.stdout:3/508: mkdir d1/d4/d1c/d62/d92/d9b 0 2024-02-28T23:07:33.490 INFO:tasks.workunit.client.1.smithi184.stdout:8/501: write d1/da/d10/d17/f9c [4680277,96788] 0 2024-02-28T23:07:33.494 INFO:tasks.workunit.client.1.smithi184.stdout:9/469: getdents d5/d47/d4a 0 2024-02-28T23:07:33.496 INFO:tasks.workunit.client.0.smithi159.stdout:9/820: mknod d4/d3d/d3e/d55/d4c/db6/c101 0 2024-02-28T23:07:33.496 INFO:tasks.workunit.client.0.smithi159.stdout:6/827: rename d0/d6d/fab to d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/f111 0 2024-02-28T23:07:33.496 INFO:tasks.workunit.client.1.smithi184.stdout:9/470: truncate d5/d26/d50/f38 2956756 0 2024-02-28T23:07:33.497 INFO:tasks.workunit.client.1.smithi184.stdout:7/443: unlink d6/l41 0 2024-02-28T23:07:33.500 INFO:tasks.workunit.client.0.smithi159.stdout:2/737: dread d9/d23/d2c/d55/f29 [0,4194304] 0 2024-02-28T23:07:33.501 INFO:tasks.workunit.client.1.smithi184.stdout:4/459: truncate d1/d8/d37/f4c 1956174 0 2024-02-28T23:07:33.502 INFO:tasks.workunit.client.1.smithi184.stdout:5/478: symlink db/d12/l9a 0 2024-02-28T23:07:33.506 INFO:tasks.workunit.client.1.smithi184.stdout:0/513: symlink d0/lb0 0 2024-02-28T23:07:33.510 INFO:tasks.workunit.client.1.smithi184.stdout:9/471: dwrite d5/d17/f3d [4194304,4194304] 0 2024-02-28T23:07:33.513 INFO:tasks.workunit.client.0.smithi159.stdout:1/854: mkdir d6/d1d/d1f/db8/dcc/d121 0 2024-02-28T23:07:33.519 INFO:tasks.workunit.client.1.smithi184.stdout:6/420: read - dc/de/d2a/f35 zero size 2024-02-28T23:07:33.519 INFO:tasks.workunit.client.0.smithi159.stdout:4/927: dwrite d9/d20/d87/d115/d1c/f86 [0,4194304] 0 2024-02-28T23:07:33.520 INFO:tasks.workunit.client.1.smithi184.stdout:6/421: fsync dc/de/f5a 0 2024-02-28T23:07:33.520 INFO:tasks.workunit.client.0.smithi159.stdout:7/687: write d5/d16/d1a/d27/d46/f8d [2172991,98679] 0 2024-02-28T23:07:33.524 INFO:tasks.workunit.client.0.smithi159.stdout:1/855: write d6/d1d/f68 [2053403,85580] 0 2024-02-28T23:07:33.525 INFO:tasks.workunit.client.1.smithi184.stdout:8/502: fdatasync d1/da/d10/d17/d63/fa4 0 2024-02-28T23:07:33.530 INFO:tasks.workunit.client.0.smithi159.stdout:7/688: write d5/d10/f85 [1854154,26565] 0 2024-02-28T23:07:33.533 INFO:tasks.workunit.client.0.smithi159.stdout:5/808: dwrite d8/d19/d23/d35/d38/d6d/f9a [0,4194304] 0 2024-02-28T23:07:33.534 INFO:tasks.workunit.client.1.smithi184.stdout:6/422: dread dc/d60/d62/d6f/f77 [0,4194304] 0 2024-02-28T23:07:33.535 INFO:tasks.workunit.client.1.smithi184.stdout:5/479: rmdir db/d90 39 2024-02-28T23:07:33.537 INFO:tasks.workunit.client.1.smithi184.stdout:0/514: creat d0/df/d13/d27/d31/d5b/fb1 x:0 0 0 2024-02-28T23:07:33.541 INFO:tasks.workunit.client.1.smithi184.stdout:2/477: getdents d10/d1f/d21/d5e/d15/d24/d94 0 2024-02-28T23:07:33.544 INFO:tasks.workunit.client.1.smithi184.stdout:2/478: write d10/d1f/d38/d54/f59 [13605530,69862] 0 2024-02-28T23:07:33.546 INFO:tasks.workunit.client.0.smithi159.stdout:4/928: rmdir d9/d20/d87/d115/d1c/d8e/ddc/dc9 39 2024-02-28T23:07:33.551 INFO:tasks.workunit.client.0.smithi159.stdout:6/828: mkdir d0/d1b/d33/d11/d112 0 2024-02-28T23:07:33.551 INFO:tasks.workunit.client.1.smithi184.stdout:8/503: creat d1/da/d10/d17/fc0 x:0 0 0 2024-02-28T23:07:33.554 INFO:tasks.workunit.client.1.smithi184.stdout:7/444: mknod d6/d9/c9f 0 2024-02-28T23:07:33.557 INFO:tasks.workunit.client.0.smithi159.stdout:3/746: dwrite d0/d3f/dd2/d6a/fd0 [0,4194304] 0 2024-02-28T23:07:33.558 INFO:tasks.workunit.client.1.smithi184.stdout:6/423: dwrite dc/de/d10/f43 [0,4194304] 0 2024-02-28T23:07:33.560 INFO:tasks.workunit.client.0.smithi159.stdout:7/689: rmdir d5/d56/d50 39 2024-02-28T23:07:33.563 INFO:tasks.workunit.client.1.smithi184.stdout:1/546: truncate f15 2696765 0 2024-02-28T23:07:33.571 INFO:tasks.workunit.client.0.smithi159.stdout:9/821: dwrite d4/d3d/d3e/d55/d37/d62/d8f/fd8 [0,4194304] 0 2024-02-28T23:07:33.580 INFO:tasks.workunit.client.1.smithi184.stdout:3/509: link d1/d4/d6/d1f/f2c d1/d4/d5/f9c 0 2024-02-28T23:07:33.581 INFO:tasks.workunit.client.0.smithi159.stdout:0/931: rename d0/d5/d14/d78/l9f to d0/d5/d38/d76/l14c 0 2024-02-28T23:07:33.581 INFO:tasks.workunit.client.1.smithi184.stdout:3/510: fsync d1/d4/d1c/f8a 0 2024-02-28T23:07:33.587 INFO:tasks.workunit.client.0.smithi159.stdout:4/929: creat d9/d20/d87/d115/dc5/f144 x:0 0 0 2024-02-28T23:07:33.591 INFO:tasks.workunit.client.0.smithi159.stdout:2/738: dwrite d9/d23/d2c/d55/f2a [0,4194304] 0 2024-02-28T23:07:33.592 INFO:tasks.workunit.client.1.smithi184.stdout:5/480: dread db/d12/d1c/d21/f2a [0,4194304] 0 2024-02-28T23:07:33.593 INFO:tasks.workunit.client.0.smithi159.stdout:2/739: write d9/d50/d54/fef [951469,124065] 0 2024-02-28T23:07:33.596 INFO:tasks.workunit.client.1.smithi184.stdout:5/481: dread - db/d12/d1c/f8f zero size 2024-02-28T23:07:33.596 INFO:tasks.workunit.client.0.smithi159.stdout:1/856: dwrite d6/d12/d33/f51 [0,4194304] 0 2024-02-28T23:07:33.597 INFO:tasks.workunit.client.1.smithi184.stdout:6/424: truncate dc/de/d10/f24 603660 0 2024-02-28T23:07:33.602 INFO:tasks.workunit.client.1.smithi184.stdout:9/472: dread d5/db/f20 [0,4194304] 0 2024-02-28T23:07:33.605 INFO:tasks.workunit.client.1.smithi184.stdout:7/445: dread d6/d9/d13/d1e/d2f/f44 [0,4194304] 0 2024-02-28T23:07:33.610 INFO:tasks.workunit.client.0.smithi159.stdout:5/809: creat d8/d19/d23/d35/d65/da3/dd2/def/f11c x:0 0 0 2024-02-28T23:07:33.613 INFO:tasks.workunit.client.0.smithi159.stdout:8/934: dread d2/d3/f3d [0,4194304] 0 2024-02-28T23:07:33.614 INFO:tasks.workunit.client.1.smithi184.stdout:5/482: dwrite f8 [0,4194304] 0 2024-02-28T23:07:33.614 INFO:tasks.workunit.client.1.smithi184.stdout:0/515: mkdir d0/db2 0 2024-02-28T23:07:33.618 INFO:tasks.workunit.client.1.smithi184.stdout:3/511: symlink d1/d4/d6/d1f/d26/d3a/d59/d6a/d6e/l9d 0 2024-02-28T23:07:33.618 INFO:tasks.workunit.client.0.smithi159.stdout:9/822: symlink d4/d3d/d3e/d55/d9e/dfc/l102 0 2024-02-28T23:07:33.618 INFO:tasks.workunit.client.0.smithi159.stdout:8/935: chown d2/d11/d74/f7e 96 1 2024-02-28T23:07:33.620 INFO:tasks.workunit.client.0.smithi159.stdout:6/829: mkdir d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d113 0 2024-02-28T23:07:33.620 INFO:tasks.workunit.client.1.smithi184.stdout:8/504: mknod d1/da/d10/d17/d63/dbe/cc1 0 2024-02-28T23:07:33.623 INFO:tasks.workunit.client.1.smithi184.stdout:5/483: chown db/d12/d18/d2e/d3c/d5d/f54 3916 1 2024-02-28T23:07:33.624 INFO:tasks.workunit.client.1.smithi184.stdout:6/425: dwrite dc/de/f29 [0,4194304] 0 2024-02-28T23:07:33.624 INFO:tasks.workunit.client.0.smithi159.stdout:4/930: creat d9/d20/d87/d115/dc5/f145 x:0 0 0 2024-02-28T23:07:33.625 INFO:tasks.workunit.client.1.smithi184.stdout:3/512: write d1/d4/d6/d1e/d72/f7a [678499,113728] 0 2024-02-28T23:07:33.625 INFO:tasks.workunit.client.0.smithi159.stdout:9/823: write d4/d3d/d3e/d55/d37/d62/da6/ffa [876642,100640] 0 2024-02-28T23:07:33.629 INFO:tasks.workunit.client.1.smithi184.stdout:5/484: write db/f7c [197540,40986] 0 2024-02-28T23:07:33.629 INFO:tasks.workunit.client.1.smithi184.stdout:4/460: dwrite d1/d8/d37/f4c [0,4194304] 0 2024-02-28T23:07:33.632 INFO:tasks.workunit.client.1.smithi184.stdout:9/473: creat d5/db/de/d10/d6a/f9b x:0 0 0 2024-02-28T23:07:33.636 INFO:tasks.workunit.client.1.smithi184.stdout:7/446: rmdir d6/d9/d13/d1e/d2f 39 2024-02-28T23:07:33.636 INFO:tasks.workunit.client.1.smithi184.stdout:2/479: sync 2024-02-28T23:07:33.636 INFO:tasks.workunit.client.1.smithi184.stdout:9/474: chown d5/db/f79 10111947 1 2024-02-28T23:07:33.637 INFO:tasks.workunit.client.0.smithi159.stdout:3/747: write d0/d3f/dd2/d7c/d79/fd9 [4898575,112808] 0 2024-02-28T23:07:33.637 INFO:tasks.workunit.client.0.smithi159.stdout:1/857: dwrite d6/d12/d33/d3c/f8d [0,4194304] 0 2024-02-28T23:07:33.638 INFO:tasks.workunit.client.1.smithi184.stdout:1/547: write d20/d46/f6c [498975,56449] 0 2024-02-28T23:07:33.642 INFO:tasks.workunit.client.1.smithi184.stdout:3/513: read d1/d4/f57 [833166,127140] 0 2024-02-28T23:07:33.643 INFO:tasks.workunit.client.1.smithi184.stdout:8/505: fsync d1/da/dc/d16/d32/d42/f6f 0 2024-02-28T23:07:33.646 INFO:tasks.workunit.client.0.smithi159.stdout:4/931: stat d9/d42/d54/d56/df5/f124 0 2024-02-28T23:07:33.646 INFO:tasks.workunit.client.0.smithi159.stdout:9/824: stat d4/d3d/d3e/d55/d9e/db3/lf1 0 2024-02-28T23:07:33.646 INFO:tasks.workunit.client.1.smithi184.stdout:9/475: chown d5/db/de/f23 78 1 2024-02-28T23:07:33.650 INFO:tasks.workunit.client.0.smithi159.stdout:2/740: link d9/f25 d9/d50/dcc/d44/dc0/dda/f103 0 2024-02-28T23:07:33.652 INFO:tasks.workunit.client.1.smithi184.stdout:8/506: write d1/da/d10/d17/f9c [5768165,127734] 0 2024-02-28T23:07:33.652 INFO:tasks.workunit.client.1.smithi184.stdout:0/516: dwrite d0/df/f63 [0,4194304] 0 2024-02-28T23:07:33.656 INFO:tasks.workunit.client.0.smithi159.stdout:7/690: dwrite d5/d56/d50/d88/fcc [0,4194304] 0 2024-02-28T23:07:33.656 INFO:tasks.workunit.client.0.smithi159.stdout:0/932: dwrite d0/d5/d14/d25/d2c/f43 [0,4194304] 0 2024-02-28T23:07:33.662 INFO:tasks.workunit.client.1.smithi184.stdout:7/447: truncate d6/d9/da/f10 415570 0 2024-02-28T23:07:33.663 INFO:tasks.workunit.client.1.smithi184.stdout:4/461: dread d1/d8/d37/f60 [0,4194304] 0 2024-02-28T23:07:33.666 INFO:tasks.workunit.client.0.smithi159.stdout:8/936: write d2/d3/f14 [3426554,41591] 0 2024-02-28T23:07:33.666 INFO:tasks.workunit.client.0.smithi159.stdout:2/741: creat d9/d36/dc3/f104 x:0 0 0 2024-02-28T23:07:33.667 INFO:tasks.workunit.client.1.smithi184.stdout:9/476: mknod d5/db/de/d10/d6a/c9c 0 2024-02-28T23:07:33.667 INFO:tasks.workunit.client.0.smithi159.stdout:5/810: write d8/d19/f2e [62491,21468] 0 2024-02-28T23:07:33.667 INFO:tasks.workunit.client.0.smithi159.stdout:3/748: creat d0/d3f/feb x:0 0 0 2024-02-28T23:07:33.668 INFO:tasks.workunit.client.1.smithi184.stdout:4/462: dread d1/d4/f11 [0,4194304] 0 2024-02-28T23:07:33.668 INFO:tasks.workunit.client.1.smithi184.stdout:0/517: truncate d0/df/d13/d27/d31/d51/f8d 1980325 0 2024-02-28T23:07:33.669 INFO:tasks.workunit.client.0.smithi159.stdout:9/825: rename d4/c21 to d4/d3d/d3e/d55/d9e/c103 0 2024-02-28T23:07:33.675 INFO:tasks.workunit.client.1.smithi184.stdout:4/463: write d1/dc/df/d38/d57/f71 [1545136,106238] 0 2024-02-28T23:07:33.676 INFO:tasks.workunit.client.0.smithi159.stdout:0/933: rmdir d0/d5/d14/d34/d6c/d94 39 2024-02-28T23:07:33.679 INFO:tasks.workunit.client.1.smithi184.stdout:1/548: dwrite d20/f50 [0,4194304] 0 2024-02-28T23:07:33.679 INFO:tasks.workunit.client.0.smithi159.stdout:3/749: fdatasync d0/d2b/f29 0 2024-02-28T23:07:33.682 INFO:tasks.workunit.client.1.smithi184.stdout:4/464: fsync d1/dc/df/f82 0 2024-02-28T23:07:33.682 INFO:tasks.workunit.client.1.smithi184.stdout:2/480: rename d10/d1f/d21/d5e/d15/d60/d66/f7c to d10/d1f/d38/f9c 0 2024-02-28T23:07:33.682 INFO:tasks.workunit.client.1.smithi184.stdout:3/514: dread d1/d4/d6/d1f/d26/f78 [0,4194304] 0 2024-02-28T23:07:33.689 INFO:tasks.workunit.client.1.smithi184.stdout:8/507: mknod d1/da/d10/d6b/cc2 0 2024-02-28T23:07:33.690 INFO:tasks.workunit.client.1.smithi184.stdout:3/515: write d1/d4/d6/d1f/d26/d3a/d59/d6a/d74/f96 [823534,13988] 0 2024-02-28T23:07:33.690 INFO:tasks.workunit.client.1.smithi184.stdout:6/426: write dc/de/d10/f19 [2156161,18669] 0 2024-02-28T23:07:33.691 INFO:tasks.workunit.client.1.smithi184.stdout:4/465: read - d1/dc/df/d3b/d5c/f7b zero size 2024-02-28T23:07:33.694 INFO:tasks.workunit.client.1.smithi184.stdout:0/518: truncate d0/d1f/f52 262452 0 2024-02-28T23:07:33.694 INFO:tasks.workunit.client.0.smithi159.stdout:2/742: fdatasync d9/f25 0 2024-02-28T23:07:33.699 INFO:tasks.workunit.client.1.smithi184.stdout:9/477: truncate d5/d17/d8f/f98 180411 0 2024-02-28T23:07:33.707 INFO:tasks.workunit.client.1.smithi184.stdout:2/481: write fb [4737021,83067] 0 2024-02-28T23:07:33.707 INFO:tasks.workunit.client.1.smithi184.stdout:8/508: dread d1/da/dc/d16/d32/d42/f6f [0,4194304] 0 2024-02-28T23:07:33.708 INFO:tasks.workunit.client.1.smithi184.stdout:3/516: fsync d1/d4/d6/d1f/f2c 0 2024-02-28T23:07:33.709 INFO:tasks.workunit.client.0.smithi159.stdout:1/858: dwrite d6/d1d/d46/d88/dd3/d9c/fc2 [0,4194304] 0 2024-02-28T23:07:33.712 INFO:tasks.workunit.client.0.smithi159.stdout:2/743: mkdir d9/d50/d62/dba/d105 0 2024-02-28T23:07:33.712 INFO:tasks.workunit.client.1.smithi184.stdout:0/519: rename d0/df/d13/d27/d2b to d0/df/d13/d27/d31/db3 0 2024-02-28T23:07:33.714 INFO:tasks.workunit.client.1.smithi184.stdout:6/427: mkdir dc/de/d2a/d5c/d79/d87 0 2024-02-28T23:07:33.721 INFO:tasks.workunit.client.0.smithi159.stdout:3/750: creat d0/d3f/dd2/d63/fec x:0 0 0 2024-02-28T23:07:33.722 INFO:tasks.workunit.client.1.smithi184.stdout:1/549: dwrite d20/d32/d3e/d82/d85/d8c/fb5 [0,4194304] 0 2024-02-28T23:07:33.723 INFO:tasks.workunit.client.1.smithi184.stdout:5/485: dwrite db/d12/d1c/d21/f5e [0,4194304] 0 2024-02-28T23:07:33.727 INFO:tasks.workunit.client.1.smithi184.stdout:7/448: write d6/d9/da/f31 [1971200,28092] 0 2024-02-28T23:07:33.728 INFO:tasks.workunit.client.0.smithi159.stdout:5/811: link d8/db4/de8/f10a d8/f11d 0 2024-02-28T23:07:33.728 INFO:tasks.workunit.client.1.smithi184.stdout:8/509: truncate d1/da/dc/d16/d4d/f87 170059 0 2024-02-28T23:07:33.728 INFO:tasks.workunit.client.1.smithi184.stdout:7/449: readlink d6/d9/da/l23 0 2024-02-28T23:07:33.733 INFO:tasks.workunit.client.0.smithi159.stdout:1/859: mknod d6/d12/d1a/d92/dc9/c122 0 2024-02-28T23:07:33.736 INFO:tasks.workunit.client.0.smithi159.stdout:7/691: dwrite d5/d16/d1a/d24/d64/fa5 [0,4194304] 0 2024-02-28T23:07:33.736 INFO:tasks.workunit.client.0.smithi159.stdout:1/860: chown d6/d1d/d46 0 1 2024-02-28T23:07:33.741 INFO:tasks.workunit.client.0.smithi159.stdout:7/692: write d5/d16/d1a/d27/d46/f8d [262727,115897] 0 2024-02-28T23:07:33.741 INFO:tasks.workunit.client.0.smithi159.stdout:0/934: dwrite d0/d5/d14/d34/d6c/ffa [0,4194304] 0 2024-02-28T23:07:33.745 INFO:tasks.workunit.client.1.smithi184.stdout:0/520: dread d0/d1d/d3a/f60 [0,4194304] 0 2024-02-28T23:07:33.746 INFO:tasks.workunit.client.0.smithi159.stdout:5/812: symlink d8/d19/d23/d35/d41/daa/l11e 0 2024-02-28T23:07:33.751 INFO:tasks.workunit.client.0.smithi159.stdout:4/932: rename d9/d42/d54/c114 to d9/d4c/d6c/d98/c146 0 2024-02-28T23:07:33.753 INFO:tasks.workunit.client.0.smithi159.stdout:8/937: getdents d2/d11/d52/d26/d36/d38/d77 0 2024-02-28T23:07:33.753 INFO:tasks.workunit.client.1.smithi184.stdout:6/428: dwrite dc/d60/d62/f82 [0,4194304] 0 2024-02-28T23:07:33.754 INFO:tasks.workunit.client.1.smithi184.stdout:2/482: link d10/d1f/d38/d54/f76 d10/d1f/d38/d53/f9d 0 2024-02-28T23:07:33.755 INFO:tasks.workunit.client.1.smithi184.stdout:8/510: dwrite d1/da/dc/d16/d29/fb9 [0,4194304] 0 2024-02-28T23:07:33.757 INFO:tasks.workunit.client.0.smithi159.stdout:8/938: write d2/d11/d52/d26/f4c [1782101,112823] 0 2024-02-28T23:07:33.759 INFO:tasks.workunit.client.1.smithi184.stdout:6/429: write dc/d42/f59 [1589326,72075] 0 2024-02-28T23:07:33.759 INFO:tasks.workunit.client.1.smithi184.stdout:9/478: symlink d5/d47/d68/l9d 0 2024-02-28T23:07:33.760 INFO:tasks.workunit.client.1.smithi184.stdout:2/483: stat d10/d1f/d38 0 2024-02-28T23:07:33.760 INFO:tasks.workunit.client.0.smithi159.stdout:3/751: symlink d0/d3f/led 0 2024-02-28T23:07:33.762 INFO:tasks.workunit.client.0.smithi159.stdout:3/752: write d0/d47/fc5 [1276730,106309] 0 2024-02-28T23:07:33.764 INFO:tasks.workunit.client.0.smithi159.stdout:3/753: dread - d0/d3f/feb zero size 2024-02-28T23:07:33.776 INFO:tasks.workunit.client.0.smithi159.stdout:7/693: dread - d5/d16/d1a/d27/d46/d65/d81/f92 zero size 2024-02-28T23:07:33.778 INFO:tasks.workunit.client.0.smithi159.stdout:0/935: symlink d0/de/d75/d5f/l14d 0 2024-02-28T23:07:33.779 INFO:tasks.workunit.client.1.smithi184.stdout:1/550: dwrite d20/d32/d3e/d82/d85/d8c/fb5 [4194304,4194304] 0 2024-02-28T23:07:33.781 INFO:tasks.workunit.client.0.smithi159.stdout:0/936: write d0/d5/d38/d63/dad/f129 [376626,113203] 0 2024-02-28T23:07:33.783 INFO:tasks.workunit.client.0.smithi159.stdout:9/826: rename d4/l48 to d4/d3d/d3e/d55/d37/d62/d6a/l104 0 2024-02-28T23:07:33.784 INFO:tasks.workunit.client.0.smithi159.stdout:1/861: rename d6/d12 to d6/d12/d31/d69/dc0/dca/d110/d123 22 2024-02-28T23:07:33.786 INFO:tasks.workunit.client.0.smithi159.stdout:4/933: creat d9/d20/d87/d115/d1c/d23/d7a/d10d/f147 x:0 0 0 2024-02-28T23:07:33.792 INFO:tasks.workunit.client.0.smithi159.stdout:2/744: truncate d9/d50/d54/fef 605080 0 2024-02-28T23:07:33.793 INFO:tasks.workunit.client.0.smithi159.stdout:8/939: mknod d2/d73/dc2/c126 0 2024-02-28T23:07:33.798 INFO:tasks.workunit.client.0.smithi159.stdout:3/754: mknod d0/d6/d3e/d2f/cee 0 2024-02-28T23:07:33.801 INFO:tasks.workunit.client.0.smithi159.stdout:5/813: getdents d8/db4/de8 0 2024-02-28T23:07:33.802 INFO:tasks.workunit.client.0.smithi159.stdout:3/755: write d0/d2b/d55/fe4 [905573,112101] 0 2024-02-28T23:07:33.805 INFO:tasks.workunit.client.1.smithi184.stdout:6/430: dread dc/de/f40 [0,4194304] 0 2024-02-28T23:07:33.806 INFO:tasks.workunit.client.0.smithi159.stdout:0/937: mknod d0/de/d75/de8/c14e 0 2024-02-28T23:07:33.806 INFO:tasks.workunit.client.1.smithi184.stdout:6/431: read - dc/de/d2a/f35 zero size 2024-02-28T23:07:33.806 INFO:tasks.workunit.client.0.smithi159.stdout:9/827: mkdir d4/d3d/d3e/d55/d37/d62/d105 0 2024-02-28T23:07:33.808 INFO:tasks.workunit.client.1.smithi184.stdout:3/517: creat d1/d4/d6/d1f/d26/d3a/d59/d82/f9e x:0 0 0 2024-02-28T23:07:33.810 INFO:tasks.workunit.client.0.smithi159.stdout:1/862: creat d6/d1d/d46/df9/f124 x:0 0 0 2024-02-28T23:07:33.811 INFO:tasks.workunit.client.0.smithi159.stdout:8/940: dwrite d2/d11/d52/d26/f31 [0,4194304] 0 2024-02-28T23:07:33.811 INFO:tasks.workunit.client.1.smithi184.stdout:7/450: stat d6/d9/d13/d1e/d2f 0 2024-02-28T23:07:33.814 INFO:tasks.workunit.client.0.smithi159.stdout:1/863: write d6/d12/d33/d3c/f8d [220847,1828] 0 2024-02-28T23:07:33.822 INFO:tasks.workunit.client.1.smithi184.stdout:4/466: getdents d1/dc/df/d3b/d5c 0 2024-02-28T23:07:33.826 INFO:tasks.workunit.client.0.smithi159.stdout:3/756: readlink d0/d6/d3e/d57/l5f 0 2024-02-28T23:07:33.828 INFO:tasks.workunit.client.0.smithi159.stdout:5/814: mkdir d8/d19/d23/d35/d65/da3/dd2/def/d11f 0 2024-02-28T23:07:33.829 INFO:tasks.workunit.client.1.smithi184.stdout:5/486: mkdir db/d12/d1c/d9b 0 2024-02-28T23:07:33.830 INFO:tasks.workunit.client.1.smithi184.stdout:5/487: dread - db/d12/d1c/d21/d4d/f93 zero size 2024-02-28T23:07:33.832 INFO:tasks.workunit.client.0.smithi159.stdout:9/828: mkdir d4/d3d/d3e/d55/d4c/d4e/d6b/db5/d106 0 2024-02-28T23:07:33.832 INFO:tasks.workunit.client.0.smithi159.stdout:7/694: write d5/d16/d1a/d24/f77 [1266785,46213] 0 2024-02-28T23:07:33.833 INFO:tasks.workunit.client.1.smithi184.stdout:0/521: mkdir d0/df/d13/d27/d31/db3/db4 0 2024-02-28T23:07:33.835 INFO:tasks.workunit.client.0.smithi159.stdout:9/829: dread - d4/d3d/d3e/d55/d4c/d4e/d6b/f100 zero size 2024-02-28T23:07:33.836 INFO:tasks.workunit.client.0.smithi159.stdout:6/830: sync 2024-02-28T23:07:33.836 INFO:tasks.workunit.client.0.smithi159.stdout:4/934: creat d9/d20/d87/d115/d1c/d8e/d143/f148 x:0 0 0 2024-02-28T23:07:33.837 INFO:tasks.workunit.client.0.smithi159.stdout:7/695: chown d5/d16/d1a/d27/d3e/fe0 447533 1 2024-02-28T23:07:33.840 INFO:tasks.workunit.client.0.smithi159.stdout:7/696: stat d5/d16/d1a/d27/d46/d65/d81 0 2024-02-28T23:07:33.840 INFO:tasks.workunit.client.0.smithi159.stdout:8/941: mkdir d2/d11/d35/d5f/dfe/d68/d127 0 2024-02-28T23:07:33.842 INFO:tasks.workunit.client.0.smithi159.stdout:6/831: chown d0/d1b/d33/d11/d34/d9d/da2/dbf/ff3 118622 1 2024-02-28T23:07:33.844 INFO:tasks.workunit.client.0.smithi159.stdout:2/745: write d9/f3c [471729,53387] 0 2024-02-28T23:07:33.851 INFO:tasks.workunit.client.0.smithi159.stdout:0/938: creat d0/d5/d38/d76/d96/f14f x:0 0 0 2024-02-28T23:07:33.852 INFO:tasks.workunit.client.1.smithi184.stdout:6/432: rmdir dc/de/d2a/d5c/d6e 39 2024-02-28T23:07:33.852 INFO:tasks.workunit.client.1.smithi184.stdout:3/518: rmdir d1/d4/d6/d1f/d26/d3a/d59/d67 39 2024-02-28T23:07:33.852 INFO:tasks.workunit.client.1.smithi184.stdout:7/451: rmdir d6/d9/da 39 2024-02-28T23:07:33.853 INFO:tasks.workunit.client.1.smithi184.stdout:3/519: chown d1/d4/d1c/l3f 102570 1 2024-02-28T23:07:33.854 INFO:tasks.workunit.client.0.smithi159.stdout:4/935: creat d9/d4c/d6c/d98/d103/f149 x:0 0 0 2024-02-28T23:07:33.855 INFO:tasks.workunit.client.1.smithi184.stdout:4/467: readlink l0 0 2024-02-28T23:07:33.855 INFO:tasks.workunit.client.1.smithi184.stdout:4/468: chown d1/d8/d35 448 1 2024-02-28T23:07:33.857 INFO:tasks.workunit.client.1.smithi184.stdout:4/469: chown d1/d8/d37/c46 55250 1 2024-02-28T23:07:33.857 INFO:tasks.workunit.client.1.smithi184.stdout:5/488: truncate db/d44/f82 162942 0 2024-02-28T23:07:33.860 INFO:tasks.workunit.client.1.smithi184.stdout:0/522: creat d0/df/d13/d27/d31/d5b/d8e/fb5 x:0 0 0 2024-02-28T23:07:33.867 INFO:tasks.workunit.client.0.smithi159.stdout:1/864: write d6/d12/d1a/d92/fec [33654,99727] 0 2024-02-28T23:07:33.868 INFO:tasks.workunit.client.0.smithi159.stdout:9/830: dread d4/f5f [0,4194304] 0 2024-02-28T23:07:33.870 INFO:tasks.workunit.client.1.smithi184.stdout:5/489: dwrite db/f7c [0,4194304] 0 2024-02-28T23:07:33.872 INFO:tasks.workunit.client.0.smithi159.stdout:5/815: truncate d8/f15 3376509 0 2024-02-28T23:07:33.872 INFO:tasks.workunit.client.0.smithi159.stdout:6/832: write d0/f7 [200479,125368] 0 2024-02-28T23:07:33.873 INFO:tasks.workunit.client.0.smithi159.stdout:9/831: read d4/d3d/d3e/d55/f43 [7990257,50990] 0 2024-02-28T23:07:33.877 INFO:tasks.workunit.client.0.smithi159.stdout:7/697: write d5/d16/d1a/f96 [227490,68425] 0 2024-02-28T23:07:33.878 INFO:tasks.workunit.client.0.smithi159.stdout:0/939: symlink d0/de/d75/db8/d103/l150 0 2024-02-28T23:07:33.880 INFO:tasks.workunit.client.0.smithi159.stdout:0/940: dread - d0/f144 zero size 2024-02-28T23:07:33.882 INFO:tasks.workunit.client.0.smithi159.stdout:7/698: write d5/d16/d1a/d27/d3e/fe0 [364457,61241] 0 2024-02-28T23:07:33.883 INFO:tasks.workunit.client.1.smithi184.stdout:4/470: mknod d1/d8/c86 0 2024-02-28T23:07:33.883 INFO:tasks.workunit.client.0.smithi159.stdout:7/699: stat d5/d56/d50 0 2024-02-28T23:07:33.886 INFO:tasks.workunit.client.0.smithi159.stdout:7/700: stat d5/d56/d50/f53 0 2024-02-28T23:07:33.888 INFO:tasks.workunit.client.0.smithi159.stdout:8/942: creat d2/d11/d52/d26/d36/d38/d77/d110/f128 x:0 0 0 2024-02-28T23:07:33.888 INFO:tasks.workunit.client.1.smithi184.stdout:4/471: read d1/dc/df/d22/d51/f64 [190747,57336] 0 2024-02-28T23:07:33.890 INFO:tasks.workunit.client.0.smithi159.stdout:8/943: chown d2/d11/d35/d5f/dfe/d68 0 1 2024-02-28T23:07:33.891 INFO:tasks.workunit.client.0.smithi159.stdout:3/757: rename d0/d3f/dd2/d7c to d0/def 0 2024-02-28T23:07:33.891 INFO:tasks.workunit.client.1.smithi184.stdout:6/433: dwrite dc/de/d10/f3d [4194304,4194304] 0 2024-02-28T23:07:33.892 INFO:tasks.workunit.client.1.smithi184.stdout:4/472: write d1/dc/df/d38/d57/f71 [1478360,120662] 0 2024-02-28T23:07:33.894 INFO:tasks.workunit.client.0.smithi159.stdout:1/865: unlink d6/d12/d1a/f53 0 2024-02-28T23:07:33.895 INFO:tasks.workunit.client.1.smithi184.stdout:8/511: sync 2024-02-28T23:07:33.895 INFO:tasks.workunit.client.1.smithi184.stdout:2/484: creat d10/f9e x:0 0 0 2024-02-28T23:07:33.895 INFO:tasks.workunit.client.1.smithi184.stdout:1/551: link d20/d32/d3e/f7c d20/d46/d90/da0/fbe 0 2024-02-28T23:07:33.897 INFO:tasks.workunit.client.1.smithi184.stdout:8/512: readlink d1/da/dc/d18/l4a 0 2024-02-28T23:07:33.899 INFO:tasks.workunit.client.0.smithi159.stdout:5/816: creat d8/d19/d23/d35/d65/da3/df4/da5/d111/f120 x:0 0 0 2024-02-28T23:07:33.900 INFO:tasks.workunit.client.1.smithi184.stdout:7/452: link d6/d9/d13/d1e/d2f/f38 d6/d9/d13/d3e/fa0 0 2024-02-28T23:07:33.901 INFO:tasks.workunit.client.1.smithi184.stdout:0/523: write d0/d1f/f43 [1155713,92408] 0 2024-02-28T23:07:33.903 INFO:tasks.workunit.client.0.smithi159.stdout:6/833: mkdir d0/d1b/d33/d11/d34/d9d/da2/db7/db1/d114 0 2024-02-28T23:07:33.909 INFO:tasks.workunit.client.0.smithi159.stdout:8/944: creat d2/d11/d52/d47/db6/dba/f129 x:0 0 0 2024-02-28T23:07:33.913 INFO:tasks.workunit.client.1.smithi184.stdout:6/434: fdatasync dc/d60/d62/d6f/f77 0 2024-02-28T23:07:33.917 INFO:tasks.workunit.client.0.smithi159.stdout:9/832: truncate d4/de4/de3/fe7 2613106 0 2024-02-28T23:07:33.918 INFO:tasks.workunit.client.0.smithi159.stdout:4/936: creat d9/d20/d87/d115/d1c/f14a x:0 0 0 2024-02-28T23:07:33.932 INFO:tasks.workunit.client.0.smithi159.stdout:3/758: creat d0/d2b/d4f/dc3/ff0 x:0 0 0 2024-02-28T23:07:33.932 INFO:tasks.workunit.client.1.smithi184.stdout:7/453: unlink d6/d9/d13/c99 0 2024-02-28T23:07:33.933 INFO:tasks.workunit.client.0.smithi159.stdout:6/834: write d0/d1b/d33/f59 [2467615,37562] 0 2024-02-28T23:07:33.935 INFO:tasks.workunit.client.0.smithi159.stdout:8/945: mkdir d2/d11/d52/d47/db6/dba/d12a 0 2024-02-28T23:07:33.935 INFO:tasks.workunit.client.0.smithi159.stdout:5/817: dread d8/d19/d23/f61 [0,4194304] 0 2024-02-28T23:07:33.935 INFO:tasks.workunit.client.1.smithi184.stdout:5/490: truncate f8 816647 0 2024-02-28T23:07:33.936 INFO:tasks.workunit.client.1.smithi184.stdout:0/524: mknod d0/d1d/d4c/d93/cb6 0 2024-02-28T23:07:33.937 INFO:tasks.workunit.client.1.smithi184.stdout:5/491: write db/d44/f84 [1343063,124186] 0 2024-02-28T23:07:33.937 INFO:tasks.workunit.client.0.smithi159.stdout:7/701: dread d5/d16/d1a/d24/f59 [0,4194304] 0 2024-02-28T23:07:33.937 INFO:tasks.workunit.client.1.smithi184.stdout:0/525: stat d0/d1f/f28 0 2024-02-28T23:07:33.938 INFO:tasks.workunit.client.0.smithi159.stdout:1/866: mknod d6/d12/c125 0 2024-02-28T23:07:33.942 INFO:tasks.workunit.client.1.smithi184.stdout:4/473: readlink d1/dc/df/d27/d34/l52 0 2024-02-28T23:07:33.943 INFO:tasks.workunit.client.0.smithi159.stdout:7/702: read d5/d16/d1a/f96 [203637,70933] 0 2024-02-28T23:07:33.944 INFO:tasks.workunit.client.0.smithi159.stdout:3/759: symlink d0/d2b/d55/d75/lf1 0 2024-02-28T23:07:33.945 INFO:tasks.workunit.client.1.smithi184.stdout:6/435: mkdir dc/d60/d62/d88 0 2024-02-28T23:07:33.947 INFO:tasks.workunit.client.0.smithi159.stdout:6/835: stat d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/c53 0 2024-02-28T23:07:33.948 INFO:tasks.workunit.client.1.smithi184.stdout:2/485: fsync d10/f11 0 2024-02-28T23:07:33.952 INFO:tasks.workunit.client.0.smithi159.stdout:6/836: chown d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/fb4 1 1 2024-02-28T23:07:33.953 INFO:tasks.workunit.client.0.smithi159.stdout:5/818: dwrite d8/d19/d23/f61 [4194304,4194304] 0 2024-02-28T23:07:33.954 INFO:tasks.workunit.client.1.smithi184.stdout:7/454: chown d6/d9/da/dc/d7d/d6c/f81 1 1 2024-02-28T23:07:33.955 INFO:tasks.workunit.client.1.smithi184.stdout:7/455: write d6/f59 [2061269,84221] 0 2024-02-28T23:07:33.956 INFO:tasks.workunit.client.0.smithi159.stdout:0/941: rename d0/de/d75/de8 to d0/d5/d14/d25/db5/d151 0 2024-02-28T23:07:33.960 INFO:tasks.workunit.client.1.smithi184.stdout:6/436: dwrite dc/de/d10/d16/f37 [0,4194304] 0 2024-02-28T23:07:33.964 INFO:tasks.workunit.client.1.smithi184.stdout:5/492: chown db/d90/f86 10429 1 2024-02-28T23:07:33.966 INFO:tasks.workunit.client.0.smithi159.stdout:3/760: unlink d0/d6/d3e/f4a 0 2024-02-28T23:07:33.966 INFO:tasks.workunit.client.1.smithi184.stdout:3/520: getdents d1/d4/d1c/d62/d92 0 2024-02-28T23:07:33.971 INFO:tasks.workunit.client.1.smithi184.stdout:4/474: mkdir d1/d8/d19/d67/d87 0 2024-02-28T23:07:33.973 INFO:tasks.workunit.client.0.smithi159.stdout:6/837: read - d0/d1b/d33/d11/d34/d9d/da2/d4e/fdc zero size 2024-02-28T23:07:33.976 INFO:tasks.workunit.client.0.smithi159.stdout:5/819: mkdir d8/d19/d23/d35/d65/da3/df4/da5/d121 0 2024-02-28T23:07:33.978 INFO:tasks.workunit.client.1.smithi184.stdout:2/486: rename d10/d1f/d21/d5e/d15/f39 to d10/d1f/d21/d4d/d71/f9f 0 2024-02-28T23:07:33.981 INFO:tasks.workunit.client.0.smithi159.stdout:9/833: rename d4/d3d/d3e/d55/d9e/db3 to d4/d3d/d3e/d55/d37/d62/d107 0 2024-02-28T23:07:33.986 INFO:tasks.workunit.client.1.smithi184.stdout:0/526: write d0/df/f30 [3139392,12524] 0 2024-02-28T23:07:33.986 INFO:tasks.workunit.client.0.smithi159.stdout:0/942: chown d0/f6 28078 1 2024-02-28T23:07:33.987 INFO:tasks.workunit.client.1.smithi184.stdout:7/456: truncate d6/d9/d13/f57 102629 0 2024-02-28T23:07:33.987 INFO:tasks.workunit.client.0.smithi159.stdout:7/703: dwrite d5/d56/d50/d88/fd4 [0,4194304] 0 2024-02-28T23:07:33.988 INFO:tasks.workunit.client.1.smithi184.stdout:7/457: fdatasync f4 0 2024-02-28T23:07:33.990 INFO:tasks.workunit.client.0.smithi159.stdout:1/867: creat d6/d1d/d1f/db8/dcc/d121/f126 x:0 0 0 2024-02-28T23:07:33.992 INFO:tasks.workunit.client.0.smithi159.stdout:3/761: dread - d0/d2b/fd5 zero size 2024-02-28T23:07:33.993 INFO:tasks.workunit.client.1.smithi184.stdout:9/479: sync 2024-02-28T23:07:33.996 INFO:tasks.workunit.client.0.smithi159.stdout:6/838: symlink d0/d1b/l115 0 2024-02-28T23:07:33.998 INFO:tasks.workunit.client.1.smithi184.stdout:5/493: write db/d12/d18/f20 [5437001,70913] 0 2024-02-28T23:07:34.006 INFO:tasks.workunit.client.0.smithi159.stdout:5/820: rename d8/d19/d23/d2a to d8/d16/d122 0 2024-02-28T23:07:34.007 INFO:tasks.workunit.client.1.smithi184.stdout:2/487: dread d10/d1f/f41 [0,4194304] 0 2024-02-28T23:07:34.013 INFO:tasks.workunit.client.1.smithi184.stdout:1/552: link d20/c80 d20/d32/d3e/d82/d85/d8c/cbf 0 2024-02-28T23:07:34.013 INFO:tasks.workunit.client.0.smithi159.stdout:0/943: unlink d0/d5/d38/d63/dad/f129 0 2024-02-28T23:07:34.014 INFO:tasks.workunit.client.0.smithi159.stdout:0/944: stat d0/de/d46 0 2024-02-28T23:07:34.015 INFO:tasks.workunit.client.0.smithi159.stdout:1/868: mknod d6/d12/d31/d69/dc0/dca/c127 0 2024-02-28T23:07:34.015 INFO:tasks.workunit.client.1.smithi184.stdout:8/513: sync 2024-02-28T23:07:34.016 INFO:tasks.workunit.client.1.smithi184.stdout:4/475: truncate d1/dc/df/d22/d51/f64 294667 0 2024-02-28T23:07:34.019 INFO:tasks.workunit.client.0.smithi159.stdout:7/704: creat d5/d16/d1a/d27/d46/d65/d81/d83/d9d/fe1 x:0 0 0 2024-02-28T23:07:34.024 INFO:tasks.workunit.client.1.smithi184.stdout:6/437: rename dc/de to dc/de/d10/d89 22 2024-02-28T23:07:34.027 INFO:tasks.workunit.client.1.smithi184.stdout:3/521: dwrite d1/d4/d6/d1f/d24/f5e [0,4194304] 0 2024-02-28T23:07:34.029 INFO:tasks.workunit.client.0.smithi159.stdout:5/821: truncate d8/d19/d23/d35/d65/da3/df4/da5/d90/fa8 1165994 0 2024-02-28T23:07:34.031 INFO:tasks.workunit.client.0.smithi159.stdout:9/834: dwrite d4/d3d/f7e [0,4194304] 0 2024-02-28T23:07:34.033 INFO:tasks.workunit.client.0.smithi159.stdout:5/822: write d8/d19/d23/d35/fc2 [1030610,108821] 0 2024-02-28T23:07:34.039 INFO:tasks.workunit.client.0.smithi159.stdout:6/839: dread d0/d1b/d33/d11/d34/d9d/da2/fca [0,4194304] 0 2024-02-28T23:07:34.039 INFO:tasks.workunit.client.1.smithi184.stdout:6/438: dwrite dc/d60/d62/d6f/f77 [0,4194304] 0 2024-02-28T23:07:34.040 INFO:tasks.workunit.client.1.smithi184.stdout:6/439: chown dc/de/d10/d16 750 1 2024-02-28T23:07:34.041 INFO:tasks.workunit.client.1.smithi184.stdout:7/458: creat d6/d9/da/dc/fa1 x:0 0 0 2024-02-28T23:07:34.043 INFO:tasks.workunit.client.0.smithi159.stdout:0/945: creat d0/de/db7/f152 x:0 0 0 2024-02-28T23:07:34.043 INFO:tasks.workunit.client.1.smithi184.stdout:7/459: chown d6/d9/d13/d1e/d2f/l5c 2015 1 2024-02-28T23:07:34.061 INFO:tasks.workunit.client.0.smithi159.stdout:3/762: mknod d0/d3f/dd2/cf2 0 2024-02-28T23:07:34.063 INFO:tasks.workunit.client.1.smithi184.stdout:5/494: symlink db/d44/l9c 0 2024-02-28T23:07:34.067 INFO:tasks.workunit.client.0.smithi159.stdout:7/705: symlink d5/d16/d1a/d27/d37/le2 0 2024-02-28T23:07:34.068 INFO:tasks.workunit.client.1.smithi184.stdout:8/514: creat d1/da/dc/d16/d29/d7d/fc3 x:0 0 0 2024-02-28T23:07:34.069 INFO:tasks.workunit.client.0.smithi159.stdout:5/823: mkdir d8/d19/d23/d35/d38/d6d/df8/d123 0 2024-02-28T23:07:34.071 INFO:tasks.workunit.client.1.smithi184.stdout:4/476: truncate d1/d8/d37/f60 688107 0 2024-02-28T23:07:34.076 INFO:tasks.workunit.client.0.smithi159.stdout:6/840: creat d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/f116 x:0 0 0 2024-02-28T23:07:34.078 INFO:tasks.workunit.client.1.smithi184.stdout:2/488: sync 2024-02-28T23:07:34.082 INFO:tasks.workunit.client.0.smithi159.stdout:0/946: fdatasync d0/d5/d14/ffb 0 2024-02-28T23:07:34.083 INFO:tasks.workunit.client.0.smithi159.stdout:1/869: dwrite d6/d12/d1a/fa3 [0,4194304] 0 2024-02-28T23:07:34.087 INFO:tasks.workunit.client.1.smithi184.stdout:8/515: dwrite d1/da/d33/f8c [0,4194304] 0 2024-02-28T23:07:34.105 INFO:tasks.workunit.client.1.smithi184.stdout:5/495: rmdir db/d12/d18 39 2024-02-28T23:07:34.106 INFO:tasks.workunit.client.1.smithi184.stdout:1/553: mkdir d20/d32/dc0 0 2024-02-28T23:07:34.117 INFO:tasks.workunit.client.1.smithi184.stdout:6/440: dwrite f3 [0,4194304] 0 2024-02-28T23:07:34.117 INFO:tasks.workunit.client.1.smithi184.stdout:3/522: mkdir d1/d4/d5/d9f 0 2024-02-28T23:07:34.120 INFO:tasks.workunit.client.1.smithi184.stdout:9/480: creat d5/db/de/d10/d12/f9e x:0 0 0 2024-02-28T23:07:34.121 INFO:tasks.workunit.client.1.smithi184.stdout:3/523: write d1/d4/d6/d1f/d26/d3a/d59/d6a/d74/f96 [1252979,120452] 0 2024-02-28T23:07:34.124 INFO:tasks.workunit.client.1.smithi184.stdout:3/524: write d1/d4/d6/d1f/d24/f88 [182132,33644] 0 2024-02-28T23:07:34.126 INFO:tasks.workunit.client.1.smithi184.stdout:1/554: creat d20/d46/fc1 x:0 0 0 2024-02-28T23:07:34.128 INFO:tasks.workunit.client.1.smithi184.stdout:7/460: write d6/d9/d13/d1e/f21 [4988485,17190] 0 2024-02-28T23:07:34.131 INFO:tasks.workunit.client.1.smithi184.stdout:4/477: dread d1/dc/df/d27/f79 [0,4194304] 0 2024-02-28T23:07:34.135 INFO:tasks.workunit.client.1.smithi184.stdout:0/527: getdents d0/d1d/d4c 0 2024-02-28T23:07:34.137 INFO:tasks.workunit.client.1.smithi184.stdout:6/441: readlink dc/de/l1a 0 2024-02-28T23:07:34.140 INFO:tasks.workunit.client.1.smithi184.stdout:9/481: truncate d5/d26/d50/f35 756227 0 2024-02-28T23:07:34.141 INFO:tasks.workunit.client.1.smithi184.stdout:9/482: truncate d5/db/f1f 962393 0 2024-02-28T23:07:34.142 INFO:tasks.workunit.client.1.smithi184.stdout:3/525: symlink d1/d4/d6/la0 0 2024-02-28T23:07:34.142 INFO:tasks.workunit.client.1.smithi184.stdout:1/555: rmdir d20/d32/d3e/d82 39 2024-02-28T23:07:34.143 INFO:tasks.workunit.client.1.smithi184.stdout:3/526: readlink d1/d4/d6/d1f/d26/l49 0 2024-02-28T23:07:34.144 INFO:tasks.workunit.client.0.smithi159.stdout:3/763: stat d0/d2b/f26 0 2024-02-28T23:07:34.145 INFO:tasks.workunit.client.0.smithi159.stdout:5/824: fdatasync d8/d19/d23/d35/d65/da3/df4/da5/fbf 0 2024-02-28T23:07:34.146 INFO:tasks.workunit.client.1.smithi184.stdout:7/461: creat d6/d9/d13/d14/fa2 x:0 0 0 2024-02-28T23:07:34.147 INFO:tasks.workunit.client.0.smithi159.stdout:7/706: creat d5/d16/d1a/d27/d37/dcd/fe3 x:0 0 0 2024-02-28T23:07:34.148 INFO:tasks.workunit.client.1.smithi184.stdout:8/516: truncate d1/da/dc/d16/d4d/f8b 2103858 0 2024-02-28T23:07:34.148 INFO:tasks.workunit.client.0.smithi159.stdout:7/707: chown d5/d16/d1a/d27 274697510 1 2024-02-28T23:07:34.149 INFO:tasks.workunit.client.1.smithi184.stdout:2/489: rename d10/d1f/d21/d4d/f52 to d10/fa0 0 2024-02-28T23:07:34.150 INFO:tasks.workunit.client.0.smithi159.stdout:6/841: dread - d0/d6d/f10b zero size 2024-02-28T23:07:34.150 INFO:tasks.workunit.client.1.smithi184.stdout:4/478: symlink d1/d8/d35/l88 0 2024-02-28T23:07:34.154 INFO:tasks.workunit.client.0.smithi159.stdout:0/947: fdatasync d0/d5/d14/d25/d2c/dab/ff2 0 2024-02-28T23:07:34.155 INFO:tasks.workunit.client.0.smithi159.stdout:0/948: readlink d0/de/db7/lec 0 2024-02-28T23:07:34.158 INFO:tasks.workunit.client.0.smithi159.stdout:3/764: creat d0/def/d79/d9b/ff3 x:0 0 0 2024-02-28T23:07:34.159 INFO:tasks.workunit.client.1.smithi184.stdout:5/496: link db/d12/d18/d2e/f79 db/d12/d18/d2e/d3c/d72/f9d 0 2024-02-28T23:07:34.165 INFO:tasks.workunit.client.1.smithi184.stdout:8/517: mknod d1/da/dc/d18/cc4 0 2024-02-28T23:07:34.167 INFO:tasks.workunit.client.0.smithi159.stdout:6/842: creat d0/d1b/d33/d11/d34/d9d/da2/d4d/f117 x:0 0 0 2024-02-28T23:07:34.168 INFO:tasks.workunit.client.1.smithi184.stdout:8/518: dread - d1/da/dc/d16/d32/d42/d77/f90 zero size 2024-02-28T23:07:34.168 INFO:tasks.workunit.client.0.smithi159.stdout:6/843: stat d0/d1b/d33/d3f/d44/d7a/le6 0 2024-02-28T23:07:34.169 INFO:tasks.workunit.client.1.smithi184.stdout:6/442: rename dc/de/d10/d86 to dc/de/d56/d8a 0 2024-02-28T23:07:34.170 INFO:tasks.workunit.client.1.smithi184.stdout:6/443: chown dc/d60/l68 1 1 2024-02-28T23:07:34.173 INFO:tasks.workunit.client.1.smithi184.stdout:0/528: link d0/df/d13/f3b d0/df/d13/d27/d31/d5b/fb7 0 2024-02-28T23:07:34.174 INFO:tasks.workunit.client.1.smithi184.stdout:4/479: rmdir d1/dc/df/d22/d51 39 2024-02-28T23:07:34.175 INFO:tasks.workunit.client.0.smithi159.stdout:5/825: write d8/d19/d23/d35/d41/daa/d79/fa4 [170914,80125] 0 2024-02-28T23:07:34.176 INFO:tasks.workunit.client.0.smithi159.stdout:3/765: stat d0/d6/d34/f62 0 2024-02-28T23:07:34.177 INFO:tasks.workunit.client.1.smithi184.stdout:9/483: mknod d5/db/de/d10/d12/c9f 0 2024-02-28T23:07:34.177 INFO:tasks.workunit.client.1.smithi184.stdout:3/527: write d1/d4/d6/d1f/f2c [3504794,116201] 0 2024-02-28T23:07:34.178 INFO:tasks.workunit.client.0.smithi159.stdout:7/708: write d5/d16/f19 [2902670,122511] 0 2024-02-28T23:07:34.178 INFO:tasks.workunit.client.1.smithi184.stdout:5/497: mkdir db/d12/d50/d9e 0 2024-02-28T23:07:34.182 INFO:tasks.workunit.client.1.smithi184.stdout:3/528: chown d1/d4/d5/d40 2122089056 1 2024-02-28T23:07:34.183 INFO:tasks.workunit.client.1.smithi184.stdout:1/556: dwrite d20/d32/d3e/f7c [0,4194304] 0 2024-02-28T23:07:34.185 INFO:tasks.workunit.client.1.smithi184.stdout:1/557: chown d20/d46/d90/da0 46 1 2024-02-28T23:07:34.189 INFO:tasks.workunit.client.1.smithi184.stdout:6/444: dread f3 [0,4194304] 0 2024-02-28T23:07:34.189 INFO:tasks.workunit.client.1.smithi184.stdout:7/462: dread d6/f3d [0,4194304] 0 2024-02-28T23:07:34.197 INFO:tasks.workunit.client.1.smithi184.stdout:9/484: dwrite d5/db/de/d10/d12/d2f/f52 [0,4194304] 0 2024-02-28T23:07:34.259 INFO:tasks.workunit.client.0.smithi159.stdout:2/746: sync 2024-02-28T23:07:34.264 INFO:tasks.workunit.client.1.smithi184.stdout:2/490: fdatasync d10/d1f/d21/d5e/d15/f2b 0 2024-02-28T23:07:34.268 INFO:tasks.workunit.client.0.smithi159.stdout:6/844: creat d0/d1b/dc4/ddd/d109/f118 x:0 0 0 2024-02-28T23:07:34.268 INFO:tasks.workunit.client.0.smithi159.stdout:1/870: getdents d6/d1d/d46/d88/db4 0 2024-02-28T23:07:34.270 INFO:tasks.workunit.client.0.smithi159.stdout:0/949: creat d0/d5/d14/f153 x:0 0 0 2024-02-28T23:07:34.270 INFO:tasks.workunit.client.1.smithi184.stdout:9/485: sync 2024-02-28T23:07:34.274 INFO:tasks.workunit.client.0.smithi159.stdout:3/766: symlink d0/d6/d3e/d2f/ddf/lf4 0 2024-02-28T23:07:34.277 INFO:tasks.workunit.client.1.smithi184.stdout:3/529: creat d1/d4/d5/d40/fa1 x:0 0 0 2024-02-28T23:07:34.277 INFO:tasks.workunit.client.0.smithi159.stdout:7/709: fsync d5/d10/f11 0 2024-02-28T23:07:34.278 INFO:tasks.workunit.client.1.smithi184.stdout:1/558: stat d20/d32/l95 0 2024-02-28T23:07:34.280 INFO:tasks.workunit.client.0.smithi159.stdout:6/845: fdatasync d0/d1b/d33/d11/d34/d9d/da2/db7/db1/fbc 0 2024-02-28T23:07:34.283 INFO:tasks.workunit.client.1.smithi184.stdout:8/519: mkdir d1/da/d33/dac/dc5 0 2024-02-28T23:07:34.284 INFO:tasks.workunit.client.1.smithi184.stdout:6/445: write dc/de/d10/f38 [2251460,129264] 0 2024-02-28T23:07:34.284 INFO:tasks.workunit.client.0.smithi159.stdout:2/747: rename d9/d36/f5a to d9/d50/d54/d84/df2/f106 0 2024-02-28T23:07:34.284 INFO:tasks.workunit.client.1.smithi184.stdout:1/559: chown d20/d46/fbb 30389 1 2024-02-28T23:07:34.289 INFO:tasks.workunit.client.0.smithi159.stdout:1/871: unlink d6/la0 0 2024-02-28T23:07:34.293 INFO:tasks.workunit.client.0.smithi159.stdout:3/767: dwrite d0/d3f/dd2/d63/fec [0,4194304] 0 2024-02-28T23:07:34.294 INFO:tasks.workunit.client.0.smithi159.stdout:0/950: write d0/d5/d38/d63/f7c [618076,121248] 0 2024-02-28T23:07:34.295 INFO:tasks.workunit.client.1.smithi184.stdout:5/498: creat db/d12/d18/d2e/d3c/d72/f9f x:0 0 0 2024-02-28T23:07:34.296 INFO:tasks.workunit.client.0.smithi159.stdout:6/846: mknod d0/d1b/d33/c119 0 2024-02-28T23:07:34.298 INFO:tasks.workunit.client.1.smithi184.stdout:7/463: link d6/d9/d13/d14/d45/f84 d6/d9/d13/d3e/d7e/fa3 0 2024-02-28T23:07:34.299 INFO:tasks.workunit.client.0.smithi159.stdout:5/826: dwrite d8/fe [0,4194304] 0 2024-02-28T23:07:34.300 INFO:tasks.workunit.client.0.smithi159.stdout:2/748: chown d9/d50/d54/fef 123487259 1 2024-02-28T23:07:34.300 INFO:tasks.workunit.client.1.smithi184.stdout:7/464: chown d6/d9/d13/d3e/d7e 56192 1 2024-02-28T23:07:34.301 INFO:tasks.workunit.client.1.smithi184.stdout:3/530: symlink d1/d4/d6/d1f/d26/d3a/la2 0 2024-02-28T23:07:34.306 INFO:tasks.workunit.client.1.smithi184.stdout:3/531: write d1/d4/d6/d1f/f68 [482013,109493] 0 2024-02-28T23:07:34.311 INFO:tasks.workunit.client.0.smithi159.stdout:1/872: creat d6/d12/d31/d10d/f128 x:0 0 0 2024-02-28T23:07:34.311 INFO:tasks.workunit.client.0.smithi159.stdout:3/768: chown d0/l25 100 1 2024-02-28T23:07:34.313 INFO:tasks.workunit.client.1.smithi184.stdout:0/529: creat d0/fb8 x:0 0 0 2024-02-28T23:07:34.314 INFO:tasks.workunit.client.0.smithi159.stdout:5/827: creat d8/d59/f124 x:0 0 0 2024-02-28T23:07:34.315 INFO:tasks.workunit.client.0.smithi159.stdout:2/749: creat d9/d50/d54/d8d/f107 x:0 0 0 2024-02-28T23:07:34.316 INFO:tasks.workunit.client.1.smithi184.stdout:5/499: symlink db/d12/d18/d2e/d3c/d5d/d66/la0 0 2024-02-28T23:07:34.318 INFO:tasks.workunit.client.0.smithi159.stdout:7/710: rename d5/d16/d1a/d24/d64/fa5 to d5/d56/fe4 0 2024-02-28T23:07:34.319 INFO:tasks.workunit.client.1.smithi184.stdout:5/500: dread - db/d12/d18/d2e/d3c/d72/f9f zero size 2024-02-28T23:07:34.321 INFO:tasks.workunit.client.0.smithi159.stdout:0/951: mkdir d0/de/de7/d101/d125/d154 0 2024-02-28T23:07:34.323 INFO:tasks.workunit.client.1.smithi184.stdout:8/520: dread d1/da/dc/d18/f19 [0,4194304] 0 2024-02-28T23:07:34.323 INFO:tasks.workunit.client.1.smithi184.stdout:1/560: rmdir d20/d32/d3e/d82/d85/d86 39 2024-02-28T23:07:34.324 INFO:tasks.workunit.client.0.smithi159.stdout:6/847: symlink d0/d1b/d33/d11/d34/d9d/da2/db7/db1/d106/l11a 0 2024-02-28T23:07:34.325 INFO:tasks.workunit.client.1.smithi184.stdout:3/532: dread d1/d4/f23 [0,4194304] 0 2024-02-28T23:07:34.326 INFO:tasks.workunit.client.0.smithi159.stdout:1/873: write d6/d1d/d46/d88/dd3/d63/f66 [348033,1031] 0 2024-02-28T23:07:34.327 INFO:tasks.workunit.client.1.smithi184.stdout:3/533: write d1/d4/d1c/d61/f90 [178265,101557] 0 2024-02-28T23:07:34.328 INFO:tasks.workunit.client.0.smithi159.stdout:3/769: truncate d0/d3f/dd2/f9e 1941638 0 2024-02-28T23:07:34.329 INFO:tasks.workunit.client.1.smithi184.stdout:6/446: getdents dc/de/d2a/d5c/d71 0 2024-02-28T23:07:34.330 INFO:tasks.workunit.client.0.smithi159.stdout:3/770: stat d0/d6/d3e/d57/l67 0 2024-02-28T23:07:34.331 INFO:tasks.workunit.client.1.smithi184.stdout:3/534: truncate d1/d4/d6/d1f/d24/f5e 4553278 0 2024-02-28T23:07:34.336 INFO:tasks.workunit.client.1.smithi184.stdout:4/480: getdents d1/d8/d37 0 2024-02-28T23:07:34.339 INFO:tasks.workunit.client.1.smithi184.stdout:9/486: truncate d5/d17/d43/f48 2381534 0 2024-02-28T23:07:34.339 INFO:tasks.workunit.client.0.smithi159.stdout:6/848: mknod d0/d6d/c11b 0 2024-02-28T23:07:34.342 INFO:tasks.workunit.client.0.smithi159.stdout:3/771: fdatasync d0/d2b/fd5 0 2024-02-28T23:07:34.343 INFO:tasks.workunit.client.1.smithi184.stdout:1/561: creat d20/d32/d3e/d82/fc2 x:0 0 0 2024-02-28T23:07:34.344 INFO:tasks.workunit.client.1.smithi184.stdout:1/562: write fb [3457965,28065] 0 2024-02-28T23:07:34.346 INFO:tasks.workunit.client.0.smithi159.stdout:1/874: truncate d6/d12/d1a/d92/fa6 854012 0 2024-02-28T23:07:34.347 INFO:tasks.workunit.client.1.smithi184.stdout:0/530: dread d0/d1f/f28 [0,4194304] 0 2024-02-28T23:07:34.348 INFO:tasks.workunit.client.1.smithi184.stdout:8/521: rmdir d1/da/d10/d17/d63/dbe 39 2024-02-28T23:07:34.351 INFO:tasks.workunit.client.1.smithi184.stdout:8/522: truncate d1/da/d10/f2f 1011662 0 2024-02-28T23:07:34.352 INFO:tasks.workunit.client.0.smithi159.stdout:7/711: write d5/d16/d1a/d27/d46/d65/d81/f92 [448433,36622] 0 2024-02-28T23:07:34.353 INFO:tasks.workunit.client.1.smithi184.stdout:7/465: mknod d6/d9/da/dc/d7d/d8d/ca4 0 2024-02-28T23:07:34.354 INFO:tasks.workunit.client.0.smithi159.stdout:0/952: write d0/d5/f3f [3675779,80579] 0 2024-02-28T23:07:34.356 INFO:tasks.workunit.client.1.smithi184.stdout:3/535: fdatasync d1/d4/d6/f51 0 2024-02-28T23:07:34.358 INFO:tasks.workunit.client.0.smithi159.stdout:0/953: readlink d0/d5/d14/d25/la3 0 2024-02-28T23:07:34.359 INFO:tasks.workunit.client.1.smithi184.stdout:3/536: chown d1/d4/d6/d1f/d24/c75 13 1 2024-02-28T23:07:34.360 INFO:tasks.workunit.client.0.smithi159.stdout:5/828: dread d8/d16/d122/f4b [0,4194304] 0 2024-02-28T23:07:34.363 INFO:tasks.workunit.client.0.smithi159.stdout:3/772: readlink d0/d6/d34/l68 0 2024-02-28T23:07:34.363 INFO:tasks.workunit.client.1.smithi184.stdout:2/491: getdents d10/d1f 0 2024-02-28T23:07:34.364 INFO:tasks.workunit.client.1.smithi184.stdout:3/537: readlink d1/d4/d6/d1f/d26/d3a/d59/d6a/d74/l95 0 2024-02-28T23:07:34.364 INFO:tasks.workunit.client.1.smithi184.stdout:4/481: fdatasync d1/dc/df/d27/f79 0 2024-02-28T23:07:34.365 INFO:tasks.workunit.client.0.smithi159.stdout:6/849: dwrite d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/f28 [0,4194304] 0 2024-02-28T23:07:34.368 INFO:tasks.workunit.client.1.smithi184.stdout:4/482: chown d1/dc/df/d5b/d6c 1041962897 1 2024-02-28T23:07:34.368 INFO:tasks.workunit.client.1.smithi184.stdout:5/501: mkdir db/da1 0 2024-02-28T23:07:34.370 INFO:tasks.workunit.client.1.smithi184.stdout:5/502: stat db/d12/d1c/d80 0 2024-02-28T23:07:34.372 INFO:tasks.workunit.client.1.smithi184.stdout:0/531: symlink d0/df/d13/d27/d31/db3/lb9 0 2024-02-28T23:07:34.373 INFO:tasks.workunit.client.0.smithi159.stdout:0/954: fdatasync d0/d5/d14/d78/f8c 0 2024-02-28T23:07:34.375 INFO:tasks.workunit.client.1.smithi184.stdout:7/466: dwrite d6/f46 [0,4194304] 0 2024-02-28T23:07:34.375 INFO:tasks.workunit.client.0.smithi159.stdout:6/850: chown d0/d1b/d33/d11/d34/la5 538 1 2024-02-28T23:07:34.376 INFO:tasks.workunit.client.1.smithi184.stdout:7/467: chown d6/f3d 15 1 2024-02-28T23:07:34.377 INFO:tasks.workunit.client.1.smithi184.stdout:7/468: readlink d6/d9/d13/l54 0 2024-02-28T23:07:34.377 INFO:tasks.workunit.client.0.smithi159.stdout:0/955: chown d0/d5/d14/d25/fa9 130491 1 2024-02-28T23:07:34.379 INFO:tasks.workunit.client.0.smithi159.stdout:3/773: unlink d0/d6/d3e/da9/lbd 0 2024-02-28T23:07:34.382 INFO:tasks.workunit.client.0.smithi159.stdout:0/956: dread - d0/d5/d14/f113 zero size 2024-02-28T23:07:34.393 INFO:tasks.workunit.client.1.smithi184.stdout:4/483: readlink d1/dc/df/l62 0 2024-02-28T23:07:34.393 INFO:tasks.workunit.client.1.smithi184.stdout:5/503: dwrite db/d12/d18/d2e/d3c/d5d/f33 [0,4194304] 0 2024-02-28T23:07:34.396 INFO:tasks.workunit.client.1.smithi184.stdout:7/469: dwrite d6/d9/d13/f28 [0,4194304] 0 2024-02-28T23:07:34.397 INFO:tasks.workunit.client.1.smithi184.stdout:0/532: mknod d0/d7c/cba 0 2024-02-28T23:07:34.398 INFO:tasks.workunit.client.0.smithi159.stdout:7/712: dwrite d5/d56/d50/daa/fa4 [0,4194304] 0 2024-02-28T23:07:34.398 INFO:tasks.workunit.client.1.smithi184.stdout:4/484: read - d1/dc/df/d3b/d5c/f7b zero size 2024-02-28T23:07:34.399 INFO:tasks.workunit.client.0.smithi159.stdout:3/774: creat d0/d2b/d55/d75/d6d/ff5 x:0 0 0 2024-02-28T23:07:34.400 INFO:tasks.workunit.client.0.smithi159.stdout:1/875: getdents d6/d1d/d46/d88/dd3/d9c/db3/dc4/dc6 0 2024-02-28T23:07:34.409 INFO:tasks.workunit.client.0.smithi159.stdout:5/829: dwrite d8/d19/f68 [0,4194304] 0 2024-02-28T23:07:34.412 INFO:tasks.workunit.client.1.smithi184.stdout:0/533: dwrite d0/df/d13/d27/d31/f45 [0,4194304] 0 2024-02-28T23:07:34.417 INFO:tasks.workunit.client.0.smithi159.stdout:3/775: creat d0/d6/d3e/d2f/d78/ff6 x:0 0 0 2024-02-28T23:07:34.420 INFO:tasks.workunit.client.0.smithi159.stdout:3/776: truncate d0/d3f/feb 987658 0 2024-02-28T23:07:34.422 INFO:tasks.workunit.client.0.smithi159.stdout:7/713: mkdir d5/d16/d1a/d27/d46/d65/d81/d98/de5 0 2024-02-28T23:07:34.424 INFO:tasks.workunit.client.1.smithi184.stdout:1/563: link d20/d46/f69 d20/d32/d3e/d61/d8b/fc3 0 2024-02-28T23:07:34.425 INFO:tasks.workunit.client.0.smithi159.stdout:7/714: chown d5/d56/d50/d5b/c86 1165673627 1 2024-02-28T23:07:34.425 INFO:tasks.workunit.client.1.smithi184.stdout:5/504: symlink db/d12/d18/d2e/la2 0 2024-02-28T23:07:34.428 INFO:tasks.workunit.client.0.smithi159.stdout:6/851: dread d0/fb [0,4194304] 0 2024-02-28T23:07:34.429 INFO:tasks.workunit.client.1.smithi184.stdout:5/505: fsync db/d12/d18/d2e/d3c/f83 0 2024-02-28T23:07:34.430 INFO:tasks.workunit.client.0.smithi159.stdout:5/830: readlink d8/d19/d23/d35/d38/l73 0 2024-02-28T23:07:34.432 INFO:tasks.workunit.client.0.smithi159.stdout:3/777: mknod d0/d47/d88/da5/cf7 0 2024-02-28T23:07:34.434 INFO:tasks.workunit.client.1.smithi184.stdout:4/485: symlink d1/dc/l89 0 2024-02-28T23:07:34.434 INFO:tasks.workunit.client.1.smithi184.stdout:9/487: dwrite d5/d26/f55 [0,4194304] 0 2024-02-28T23:07:34.435 INFO:tasks.workunit.client.0.smithi159.stdout:6/852: chown d0/d1b/d33/d11/d34/d9d/da2/db7/f27 47635 1 2024-02-28T23:07:34.437 INFO:tasks.workunit.client.1.smithi184.stdout:4/486: stat d1/dc/df/c1e 0 2024-02-28T23:07:34.440 INFO:tasks.workunit.client.1.smithi184.stdout:7/470: creat d6/d9/d13/d1e/d2f/d33/d80/fa5 x:0 0 0 2024-02-28T23:07:34.441 INFO:tasks.workunit.client.1.smithi184.stdout:0/534: rename d0/df/d13/f1a to d0/d7c/fbb 0 2024-02-28T23:07:34.442 INFO:tasks.workunit.client.0.smithi159.stdout:5/831: truncate d8/d19/f54 452646 0 2024-02-28T23:07:34.443 INFO:tasks.workunit.client.1.smithi184.stdout:7/471: chown d6/f16 1 1 2024-02-28T23:07:34.447 INFO:tasks.workunit.client.1.smithi184.stdout:7/472: fsync d6/d68/f7a 0 2024-02-28T23:07:34.448 INFO:tasks.workunit.client.0.smithi159.stdout:5/832: creat d8/d19/d23/d35/d41/daa/f125 x:0 0 0 2024-02-28T23:07:34.448 INFO:tasks.workunit.client.1.smithi184.stdout:6/447: sync 2024-02-28T23:07:34.454 INFO:tasks.workunit.client.1.smithi184.stdout:4/487: link d1/d8/c86 d1/d8/d19/d67/d87/c8a 0 2024-02-28T23:07:34.458 INFO:tasks.workunit.client.1.smithi184.stdout:4/488: chown d1/d8/d37 1632 1 2024-02-28T23:07:34.460 INFO:tasks.workunit.client.1.smithi184.stdout:7/473: mkdir d6/d9/da/dc/d49/da6 0 2024-02-28T23:07:34.461 INFO:tasks.workunit.client.1.smithi184.stdout:6/448: unlink dc/de/l49 0 2024-02-28T23:07:34.462 INFO:tasks.workunit.client.0.smithi159.stdout:1/876: dread d6/d1d/d46/d88/dd3/d9c/db3/dc4/fe8 [0,4194304] 0 2024-02-28T23:07:34.462 INFO:tasks.workunit.client.1.smithi184.stdout:8/523: sync 2024-02-28T23:07:34.463 INFO:tasks.workunit.client.1.smithi184.stdout:4/489: readlink d1/dc/df/d5b/d6c/l6e 0 2024-02-28T23:07:34.463 INFO:tasks.workunit.client.1.smithi184.stdout:9/488: dwrite d5/db/f7f [0,4194304] 0 2024-02-28T23:07:34.464 INFO:tasks.workunit.client.0.smithi159.stdout:1/877: rmdir d6/d1d/d46/df9/d105 39 2024-02-28T23:07:34.467 INFO:tasks.workunit.client.0.smithi159.stdout:1/878: creat d6/d1d/d46/d88/dd3/d9c/f129 x:0 0 0 2024-02-28T23:07:34.470 INFO:tasks.workunit.client.1.smithi184.stdout:7/474: write d6/d9/d13/d3e/d7e/f8a [496833,89442] 0 2024-02-28T23:07:34.474 INFO:tasks.workunit.client.1.smithi184.stdout:6/449: creat dc/d60/d78/f8b x:0 0 0 2024-02-28T23:07:34.475 INFO:tasks.workunit.client.1.smithi184.stdout:0/535: dwrite d0/d1d/f6d [0,4194304] 0 2024-02-28T23:07:34.475 INFO:tasks.workunit.client.0.smithi159.stdout:0/957: dread d0/d5/f33 [0,4194304] 0 2024-02-28T23:07:34.480 INFO:tasks.workunit.client.0.smithi159.stdout:4/937: sync 2024-02-28T23:07:34.486 INFO:tasks.workunit.client.1.smithi184.stdout:9/489: dread d5/db/d5c/f84 [0,4194304] 0 2024-02-28T23:07:34.486 INFO:tasks.workunit.client.1.smithi184.stdout:6/450: unlink dc/de/d2a/c54 0 2024-02-28T23:07:34.487 INFO:tasks.workunit.client.1.smithi184.stdout:8/524: dwrite d1/da/dc/d16/d29/fb7 [0,4194304] 0 2024-02-28T23:07:34.488 INFO:tasks.workunit.client.1.smithi184.stdout:6/451: chown f8 47801841 1 2024-02-28T23:07:34.490 INFO:tasks.workunit.client.1.smithi184.stdout:6/452: fdatasync dc/d42/f7e 0 2024-02-28T23:07:34.490 INFO:tasks.workunit.client.1.smithi184.stdout:0/536: mknod d0/df/d13/d27/d31/db3/cbc 0 2024-02-28T23:07:34.491 INFO:tasks.workunit.client.0.smithi159.stdout:3/778: rename d0/d6/d3e to d0/d2b/d55/df8 0 2024-02-28T23:07:34.492 INFO:tasks.workunit.client.1.smithi184.stdout:2/492: write f8 [1983139,46588] 0 2024-02-28T23:07:34.493 INFO:tasks.workunit.client.0.smithi159.stdout:0/958: fdatasync d0/d5/d14/d34/d6c/fbc 0 2024-02-28T23:07:34.494 INFO:tasks.workunit.client.1.smithi184.stdout:2/493: chown d10/d1f/d21/d6a/l99 13 1 2024-02-28T23:07:34.495 INFO:tasks.workunit.client.1.smithi184.stdout:9/490: creat d5/d26/fa0 x:0 0 0 2024-02-28T23:07:34.501 INFO:tasks.workunit.client.1.smithi184.stdout:9/491: write d5/db/de/d10/d12/f9e [123415,1201] 0 2024-02-28T23:07:34.501 INFO:tasks.workunit.client.1.smithi184.stdout:8/525: creat d1/da/dc/d16/d32/fc6 x:0 0 0 2024-02-28T23:07:34.501 INFO:tasks.workunit.client.0.smithi159.stdout:4/938: chown d9/d20/d87/d115/d1c/d8e/ddc/dc9/c11d 1951647713 1 2024-02-28T23:07:34.502 INFO:tasks.workunit.client.0.smithi159.stdout:5/833: dread d8/d59/fe9 [0,4194304] 0 2024-02-28T23:07:34.502 INFO:tasks.workunit.client.0.smithi159.stdout:4/939: write d9/d20/d87/d115/d1c/f86 [3748378,93982] 0 2024-02-28T23:07:34.502 INFO:tasks.workunit.client.0.smithi159.stdout:5/834: dread - d8/d16/d122/f102 zero size 2024-02-28T23:07:34.502 INFO:tasks.workunit.client.1.smithi184.stdout:3/538: truncate d1/d4/d6/d1f/d26/d3a/d59/d6a/d74/f96 228399 0 2024-02-28T23:07:34.504 INFO:tasks.workunit.client.0.smithi159.stdout:3/779: unlink d0/def/f64 0 2024-02-28T23:07:34.505 INFO:tasks.workunit.client.1.smithi184.stdout:7/475: link d6/d9/c9f d6/d9/d13/d1e/d2f/d33/d80/ca7 0 2024-02-28T23:07:34.507 INFO:tasks.workunit.client.1.smithi184.stdout:9/492: dread d5/db/de/d10/d12/f2d [0,4194304] 0 2024-02-28T23:07:34.507 INFO:tasks.workunit.client.1.smithi184.stdout:7/476: stat d6/d9/d13/d1e/d2f/d34/d47/f58 0 2024-02-28T23:07:34.509 INFO:tasks.workunit.client.1.smithi184.stdout:0/537: rename d0 to d0/dbd 22 2024-02-28T23:07:34.510 INFO:tasks.workunit.client.1.smithi184.stdout:0/538: write d0/f57 [1454073,37102] 0 2024-02-28T23:07:34.512 INFO:tasks.workunit.client.1.smithi184.stdout:0/539: read d0/d1d/f35 [389660,18552] 0 2024-02-28T23:07:34.514 INFO:tasks.workunit.client.0.smithi159.stdout:7/715: dwrite d5/d16/d1a/fad [0,4194304] 0 2024-02-28T23:07:34.514 INFO:tasks.workunit.client.1.smithi184.stdout:2/494: fsync d10/d1f/f93 0 2024-02-28T23:07:34.516 INFO:tasks.workunit.client.0.smithi159.stdout:4/940: mknod d9/d20/d87/c14b 0 2024-02-28T23:07:34.519 INFO:tasks.workunit.client.1.smithi184.stdout:8/526: mkdir d1/da/df/d20/dc7 0 2024-02-28T23:07:34.522 INFO:tasks.workunit.client.0.smithi159.stdout:5/835: symlink d8/db4/de8/l126 0 2024-02-28T23:07:34.524 INFO:tasks.workunit.client.0.smithi159.stdout:5/836: fdatasync d8/d19/d23/d35/d41/daa/d79/fe4 0 2024-02-28T23:07:34.527 INFO:tasks.workunit.client.1.smithi184.stdout:3/539: creat d1/d4/d1c/d62/fa3 x:0 0 0 2024-02-28T23:07:34.529 INFO:tasks.workunit.client.0.smithi159.stdout:3/780: fsync d0/d47/d88/fc0 0 2024-02-28T23:07:34.530 INFO:tasks.workunit.client.1.smithi184.stdout:1/564: dwrite d20/f47 [0,4194304] 0 2024-02-28T23:07:34.531 INFO:tasks.workunit.client.0.smithi159.stdout:3/781: chown d0/def/d79/d9b/fb2 6420 1 2024-02-28T23:07:34.532 INFO:tasks.workunit.client.1.smithi184.stdout:1/565: chown d20/d32/d4b/c5a 1104566 1 2024-02-28T23:07:34.532 INFO:tasks.workunit.client.1.smithi184.stdout:6/453: mknod dc/de/d10/c8c 0 2024-02-28T23:07:34.533 INFO:tasks.workunit.client.0.smithi159.stdout:3/782: fsync d0/d2b/d55/df8/d2f/f6b 0 2024-02-28T23:07:34.533 INFO:tasks.workunit.client.1.smithi184.stdout:5/506: dwrite db/d12/f1d [0,4194304] 0 2024-02-28T23:07:34.534 INFO:tasks.workunit.client.1.smithi184.stdout:1/566: chown d20/d32/cb7 3 1 2024-02-28T23:07:34.535 INFO:tasks.workunit.client.1.smithi184.stdout:6/454: truncate dc/f75 28974 0 2024-02-28T23:07:34.537 INFO:tasks.workunit.client.0.smithi159.stdout:0/959: symlink d0/d5/d14/d34/d133/l155 0 2024-02-28T23:07:34.543 INFO:tasks.workunit.client.1.smithi184.stdout:7/477: symlink d6/d9/d13/d1e/d2f/d34/d65/la8 0 2024-02-28T23:07:34.552 INFO:tasks.workunit.client.1.smithi184.stdout:5/507: dwrite db/d12/d1c/d21/d2f/f55 [0,4194304] 0 2024-02-28T23:07:34.552 INFO:tasks.workunit.client.1.smithi184.stdout:6/455: dwrite dc/de/d10/f3d [0,4194304] 0 2024-02-28T23:07:34.553 INFO:tasks.workunit.client.1.smithi184.stdout:6/456: stat f3 0 2024-02-28T23:07:34.555 INFO:tasks.workunit.client.0.smithi159.stdout:4/941: chown d9/d20/d87/d115/d1c/d23/d2d/d59/f13b 6922 1 2024-02-28T23:07:34.559 INFO:tasks.workunit.client.0.smithi159.stdout:5/837: dread d8/d16/fab [4194304,4194304] 0 2024-02-28T23:07:34.571 INFO:tasks.workunit.client.1.smithi184.stdout:5/508: dwrite db/d12/d18/d2e/d3c/d5d/f4b [0,4194304] 0 2024-02-28T23:07:34.572 INFO:tasks.workunit.client.1.smithi184.stdout:2/495: dread - d10/d1f/d21/d4d/f72 zero size 2024-02-28T23:07:34.572 INFO:tasks.workunit.client.1.smithi184.stdout:4/490: sync 2024-02-28T23:07:34.580 INFO:tasks.workunit.client.1.smithi184.stdout:3/540: mknod d1/d4/d6/d1f/ca4 0 2024-02-28T23:07:34.582 INFO:tasks.workunit.client.0.smithi159.stdout:0/960: truncate d0/d5/d14/d25/d5c/f67 3098662 0 2024-02-28T23:07:34.583 INFO:tasks.workunit.client.1.smithi184.stdout:3/541: read d1/d4/d1c/d61/f90 [192692,129571] 0 2024-02-28T23:07:34.588 INFO:tasks.workunit.client.1.smithi184.stdout:4/491: dwrite d1/dc/df/f14 [0,4194304] 0 2024-02-28T23:07:34.589 INFO:tasks.workunit.client.0.smithi159.stdout:5/838: creat d8/d19/d23/d35/d100/f127 x:0 0 0 2024-02-28T23:07:34.597 INFO:tasks.workunit.client.1.smithi184.stdout:7/478: creat d6/d9/d13/d1e/d2f/d33/fa9 x:0 0 0 2024-02-28T23:07:34.599 INFO:tasks.workunit.client.0.smithi159.stdout:3/783: fsync d0/d3f/dd2/f9e 0 2024-02-28T23:07:34.602 INFO:tasks.workunit.client.1.smithi184.stdout:5/509: dread db/f61 [0,4194304] 0 2024-02-28T23:07:34.606 INFO:tasks.workunit.client.0.smithi159.stdout:5/839: fsync d8/f11d 0 2024-02-28T23:07:34.607 INFO:tasks.workunit.client.0.smithi159.stdout:3/784: write d0/d2b/d55/df8/d2f/d78/ff6 [949322,19125] 0 2024-02-28T23:07:34.607 INFO:tasks.workunit.client.1.smithi184.stdout:9/493: write d5/d47/d4a/f82 [4527421,16318] 0 2024-02-28T23:07:34.609 INFO:tasks.workunit.client.1.smithi184.stdout:0/540: mknod d0/df/d13/d27/d31/d5b/d8e/da3/cbe 0 2024-02-28T23:07:34.609 INFO:tasks.workunit.client.0.smithi159.stdout:7/716: dwrite d5/fe [0,4194304] 0 2024-02-28T23:07:34.610 INFO:tasks.workunit.client.1.smithi184.stdout:9/494: chown d5/db/de/d10/d12/d2f/f51 1466911 1 2024-02-28T23:07:34.611 INFO:tasks.workunit.client.0.smithi159.stdout:4/942: dwrite d9/d20/fe3 [0,4194304] 0 2024-02-28T23:07:34.613 INFO:tasks.workunit.client.1.smithi184.stdout:0/541: read d0/df/d13/f29 [861231,117395] 0 2024-02-28T23:07:34.620 INFO:tasks.workunit.client.0.smithi159.stdout:0/961: dwrite d0/d5/d14/d25/d2c/dab/f10c [0,4194304] 0 2024-02-28T23:07:34.626 INFO:tasks.workunit.client.1.smithi184.stdout:8/527: rename d1/da/dc/d16/d29/c4f to d1/da/dc/d16/dbd/cc8 0 2024-02-28T23:07:34.634 INFO:tasks.workunit.client.0.smithi159.stdout:7/717: dread d5/fe [0,4194304] 0 2024-02-28T23:07:34.635 INFO:tasks.workunit.client.1.smithi184.stdout:4/492: write d1/d8/f5a [2505459,21213] 0 2024-02-28T23:07:34.637 INFO:tasks.workunit.client.1.smithi184.stdout:9/495: truncate d5/d17/d43/f60 541283 0 2024-02-28T23:07:34.640 INFO:tasks.workunit.client.0.smithi159.stdout:4/943: dwrite d9/d20/d87/d115/d1c/d23/f63 [0,4194304] 0 2024-02-28T23:07:34.642 INFO:tasks.workunit.client.0.smithi159.stdout:0/962: read d0/d5/d14/d25/d2c/d4b/f54 [1142974,125648] 0 2024-02-28T23:07:34.646 INFO:tasks.workunit.client.1.smithi184.stdout:2/496: rename d10/d1f/f57 to d10/d55/d89/fa1 0 2024-02-28T23:07:34.650 INFO:tasks.workunit.client.0.smithi159.stdout:4/944: mknod d9/d42/d54/d9c/dd7/c14c 0 2024-02-28T23:07:34.650 INFO:tasks.workunit.client.1.smithi184.stdout:5/510: mknod db/da1/ca3 0 2024-02-28T23:07:34.657 INFO:tasks.workunit.client.1.smithi184.stdout:8/528: dread d1/da/dc/d16/d32/f39 [0,4194304] 0 2024-02-28T23:07:34.657 INFO:tasks.workunit.client.0.smithi159.stdout:5/840: write d8/d19/d23/d35/d65/fcb [649423,21403] 0 2024-02-28T23:07:34.658 INFO:tasks.workunit.client.1.smithi184.stdout:4/493: symlink d1/d8/d19/d67/d87/l8b 0 2024-02-28T23:07:34.659 INFO:tasks.workunit.client.0.smithi159.stdout:8/946: sync 2024-02-28T23:07:34.659 INFO:tasks.workunit.client.0.smithi159.stdout:9/835: sync 2024-02-28T23:07:34.660 INFO:tasks.workunit.client.1.smithi184.stdout:9/496: mknod d5/db/d5c/ca1 0 2024-02-28T23:07:34.660 INFO:tasks.workunit.client.1.smithi184.stdout:6/457: truncate dc/de/d10/f1b 4947745 0 2024-02-28T23:07:34.663 INFO:tasks.workunit.client.1.smithi184.stdout:0/542: write d0/df/d13/d27/d31/db3/f66 [4122056,25089] 0 2024-02-28T23:07:34.664 INFO:tasks.workunit.client.1.smithi184.stdout:6/458: chown dc/de/d2a/d5c/d79/l84 312137595 1 2024-02-28T23:07:34.665 INFO:tasks.workunit.client.0.smithi159.stdout:4/945: creat d9/d20/d87/d115/d1c/dc3/f14d x:0 0 0 2024-02-28T23:07:34.665 INFO:tasks.workunit.client.0.smithi159.stdout:9/836: readlink d4/d3d/d3e/d55/d4c/d4e/d6b/laf 0 2024-02-28T23:07:34.667 INFO:tasks.workunit.client.1.smithi184.stdout:2/497: symlink d10/la2 0 2024-02-28T23:07:34.668 INFO:tasks.workunit.client.1.smithi184.stdout:7/479: getdents d6/d68 0 2024-02-28T23:07:34.668 INFO:tasks.workunit.client.0.smithi159.stdout:8/947: chown d2/d11/d52/f62 5867 1 2024-02-28T23:07:34.669 INFO:tasks.workunit.client.1.smithi184.stdout:3/542: creat d1/d4/d6/d1f/fa5 x:0 0 0 2024-02-28T23:07:34.670 INFO:tasks.workunit.client.1.smithi184.stdout:8/529: mkdir d1/da/dc/dc9 0 2024-02-28T23:07:34.670 INFO:tasks.workunit.client.1.smithi184.stdout:6/459: write dc/de/d10/f43 [2128909,58373] 0 2024-02-28T23:07:34.673 INFO:tasks.workunit.client.1.smithi184.stdout:3/543: readlink d1/d4/d5/d40/l4b 0 2024-02-28T23:07:34.673 INFO:tasks.workunit.client.1.smithi184.stdout:1/567: dwrite d20/f72 [0,4194304] 0 2024-02-28T23:07:34.674 INFO:tasks.workunit.client.0.smithi159.stdout:0/963: dwrite d0/d5/d38/f91 [0,4194304] 0 2024-02-28T23:07:34.678 INFO:tasks.workunit.client.0.smithi159.stdout:3/785: dread d0/d2b/f29 [0,4194304] 0 2024-02-28T23:07:34.679 INFO:tasks.workunit.client.1.smithi184.stdout:4/494: dwrite d1/d8/d37/f4c [0,4194304] 0 2024-02-28T23:07:34.680 INFO:tasks.workunit.client.1.smithi184.stdout:4/495: stat d1/dc/df/l62 0 2024-02-28T23:07:34.681 INFO:tasks.workunit.client.1.smithi184.stdout:9/497: creat d5/db/de/d10/d12/d2f/d7d/fa2 x:0 0 0 2024-02-28T23:07:34.682 INFO:tasks.workunit.client.1.smithi184.stdout:9/498: chown d5/d17 1 1 2024-02-28T23:07:34.684 INFO:tasks.workunit.client.1.smithi184.stdout:5/511: write db/d12/d1c/d21/d4d/f56 [4969716,12199] 0 2024-02-28T23:07:34.686 INFO:tasks.workunit.client.1.smithi184.stdout:9/499: fdatasync d5/d17/d43/f99 0 2024-02-28T23:07:34.691 INFO:tasks.workunit.client.0.smithi159.stdout:8/948: truncate d2/d11/d52/d47/db6/dba/f129 920117 0 2024-02-28T23:07:34.695 INFO:tasks.workunit.client.0.smithi159.stdout:5/841: link d8/d19/d23/d35/d65/da3/dd2/def/f11c d8/d19/d23/d35/d38/d6d/f128 0 2024-02-28T23:07:34.696 INFO:tasks.workunit.client.0.smithi159.stdout:3/786: symlink d0/d3f/dd2/d63/lf9 0 2024-02-28T23:07:34.697 INFO:tasks.workunit.client.0.smithi159.stdout:4/946: write d9/d20/d87/d115/d1c/d23/d2d/d59/f123 [209348,35131] 0 2024-02-28T23:07:34.701 INFO:tasks.workunit.client.0.smithi159.stdout:7/718: dwrite d5/d16/d1a/d27/f31 [0,4194304] 0 2024-02-28T23:07:34.703 INFO:tasks.workunit.client.0.smithi159.stdout:2/750: sync 2024-02-28T23:07:34.703 INFO:tasks.workunit.client.0.smithi159.stdout:4/947: dread - d9/d20/fbf zero size 2024-02-28T23:07:34.706 INFO:tasks.workunit.client.0.smithi159.stdout:9/837: dwrite d4/d3d/d3e/d4a/f56 [4194304,4194304] 0 2024-02-28T23:07:34.711 INFO:tasks.workunit.client.0.smithi159.stdout:4/948: chown d9/d20/d87/d115/d1c/d23/d2d/d59/f13b 271728 1 2024-02-28T23:07:34.711 INFO:tasks.workunit.client.1.smithi184.stdout:6/460: mknod dc/de/d10/d3a/c8d 0 2024-02-28T23:07:34.711 INFO:tasks.workunit.client.0.smithi159.stdout:5/842: read d8/d16/f6a [3469407,103131] 0 2024-02-28T23:07:34.713 INFO:tasks.workunit.client.1.smithi184.stdout:6/461: write dc/de/d10/f3d [6661683,42515] 0 2024-02-28T23:07:34.713 INFO:tasks.workunit.client.0.smithi159.stdout:0/964: dwrite d0/de/d46/fa7 [0,4194304] 0 2024-02-28T23:07:34.721 INFO:tasks.workunit.client.0.smithi159.stdout:7/719: unlink d5/d16/d1a/c25 0 2024-02-28T23:07:34.721 INFO:tasks.workunit.client.0.smithi159.stdout:0/965: write d0/d5/d38/d76/d96/f14f [354095,26848] 0 2024-02-28T23:07:34.730 INFO:tasks.workunit.client.0.smithi159.stdout:8/949: write d2/d3/f3d [1414419,62846] 0 2024-02-28T23:07:34.731 INFO:tasks.workunit.client.0.smithi159.stdout:9/838: truncate d4/d76/fdd 827903 0 2024-02-28T23:07:34.734 INFO:tasks.workunit.client.0.smithi159.stdout:4/949: creat d9/d20/d87/d115/d1c/d23/d7a/d10d/f14e x:0 0 0 2024-02-28T23:07:34.736 INFO:tasks.workunit.client.1.smithi184.stdout:8/530: dread d1/da/dc/d18/f57 [0,4194304] 0 2024-02-28T23:07:34.736 INFO:tasks.workunit.client.1.smithi184.stdout:0/543: creat d0/d7c/d8a/fbf x:0 0 0 2024-02-28T23:07:34.737 INFO:tasks.workunit.client.0.smithi159.stdout:9/839: readlink d4/d3d/d3e/d55/d37/l75 0 2024-02-28T23:07:34.738 INFO:tasks.workunit.client.1.smithi184.stdout:8/531: write d1/da/dc/d18/f38 [112792,13817] 0 2024-02-28T23:07:34.746 INFO:tasks.workunit.client.0.smithi159.stdout:7/720: dwrite d5/d16/d1a/d27/d46/f66 [0,4194304] 0 2024-02-28T23:07:34.748 INFO:tasks.workunit.client.1.smithi184.stdout:8/532: truncate d1/da/dc/d16/d32/fc6 946043 0 2024-02-28T23:07:34.751 INFO:tasks.workunit.client.1.smithi184.stdout:3/544: chown d1/d4/d6/d1f/f2c 3641859 1 2024-02-28T23:07:34.752 INFO:tasks.workunit.client.0.smithi159.stdout:8/950: mknod d2/d11/d74/c12b 0 2024-02-28T23:07:34.752 INFO:tasks.workunit.client.0.smithi159.stdout:5/843: dread d8/d19/d23/d35/d65/da3/df4/da5/d90/fa8 [0,4194304] 0 2024-02-28T23:07:34.753 INFO:tasks.workunit.client.1.smithi184.stdout:3/545: chown d1/d4/d6/d83 1 1 2024-02-28T23:07:34.756 INFO:tasks.workunit.client.0.smithi159.stdout:3/787: truncate d0/d6/f13 660096 0 2024-02-28T23:07:34.762 INFO:tasks.workunit.client.0.smithi159.stdout:2/751: dwrite d9/d23/d2c/f79 [0,4194304] 0 2024-02-28T23:07:34.765 INFO:tasks.workunit.client.1.smithi184.stdout:1/568: dwrite f19 [0,4194304] 0 2024-02-28T23:07:34.766 INFO:tasks.workunit.client.0.smithi159.stdout:9/840: unlink d4/d3d/d3e/d55/d4c/d4e/l67 0 2024-02-28T23:07:34.767 INFO:tasks.workunit.client.0.smithi159.stdout:2/752: write d9/d23/d2c/f79 [3200558,109043] 0 2024-02-28T23:07:34.768 INFO:tasks.workunit.client.0.smithi159.stdout:4/950: write d9/d4c/d6c/fa4 [3708553,87618] 0 2024-02-28T23:07:34.769 INFO:tasks.workunit.client.0.smithi159.stdout:0/966: dread d0/de/d75/db8/fbf [0,4194304] 0 2024-02-28T23:07:34.770 INFO:tasks.workunit.client.1.smithi184.stdout:7/480: dwrite d6/d9/da/f10 [0,4194304] 0 2024-02-28T23:07:34.770 INFO:tasks.workunit.client.1.smithi184.stdout:5/512: mkdir db/da4 0 2024-02-28T23:07:34.775 INFO:tasks.workunit.client.1.smithi184.stdout:1/569: fsync d20/d32/d3e/d61/d8b/f8f 0 2024-02-28T23:07:34.776 INFO:tasks.workunit.client.1.smithi184.stdout:5/513: chown db/f7b 540375 1 2024-02-28T23:07:34.781 INFO:tasks.workunit.client.1.smithi184.stdout:3/546: dread d1/d4/d1c/d62/d66/f6f [0,4194304] 0 2024-02-28T23:07:34.782 INFO:tasks.workunit.client.1.smithi184.stdout:9/500: dread d5/f6 [0,4194304] 0 2024-02-28T23:07:34.785 INFO:tasks.workunit.client.0.smithi159.stdout:6/853: sync 2024-02-28T23:07:34.785 INFO:tasks.workunit.client.0.smithi159.stdout:1/879: sync 2024-02-28T23:07:34.788 INFO:tasks.workunit.client.0.smithi159.stdout:4/951: chown d9/l32 1459721 1 2024-02-28T23:07:34.796 INFO:tasks.workunit.client.1.smithi184.stdout:1/570: dwrite d20/f88 [0,4194304] 0 2024-02-28T23:07:34.799 INFO:tasks.workunit.client.1.smithi184.stdout:1/571: dread d20/f76 [0,4194304] 0 2024-02-28T23:07:34.804 INFO:tasks.workunit.client.0.smithi159.stdout:7/721: chown d5/d16/l20 2519027 1 2024-02-28T23:07:34.809 INFO:tasks.workunit.client.0.smithi159.stdout:5/844: rename d8/d19/d23/d35/d41/d77/c8a to d8/d19/d23/d35/d41/d92/d10c/c129 0 2024-02-28T23:07:34.811 INFO:tasks.workunit.client.1.smithi184.stdout:1/572: dwrite fb [0,4194304] 0 2024-02-28T23:07:34.814 INFO:tasks.workunit.client.0.smithi159.stdout:6/854: creat d0/d1b/d5b/f11c x:0 0 0 2024-02-28T23:07:34.819 INFO:tasks.workunit.client.0.smithi159.stdout:1/880: creat d6/d1d/d46/d88/dd3/d63/f12a x:0 0 0 2024-02-28T23:07:34.825 INFO:tasks.workunit.client.0.smithi159.stdout:3/788: dwrite d0/def/d79/fab [0,4194304] 0 2024-02-28T23:07:34.827 INFO:tasks.workunit.client.0.smithi159.stdout:9/841: write d4/d3d/d3e/d55/d4c/d4e/dbe/fcc [3511299,67466] 0 2024-02-28T23:07:34.835 INFO:tasks.workunit.client.1.smithi184.stdout:0/544: creat d0/df/d13/d27/d31/d51/d85/fc0 x:0 0 0 2024-02-28T23:07:34.838 INFO:tasks.workunit.client.0.smithi159.stdout:8/951: creat d2/d11/d52/d26/d36/d38/d77/d9e/dc1/df7/f12c x:0 0 0 2024-02-28T23:07:34.843 INFO:tasks.workunit.client.0.smithi159.stdout:2/753: dwrite d9/d50/dcc/d44/dc0/feb [0,4194304] 0 2024-02-28T23:07:34.846 INFO:tasks.workunit.client.0.smithi159.stdout:5/845: dread - d8/d19/d23/d35/d65/da3/df4/da5/fd4 zero size 2024-02-28T23:07:34.849 INFO:tasks.workunit.client.0.smithi159.stdout:2/754: dread - d9/d50/ffc zero size 2024-02-28T23:07:34.849 INFO:tasks.workunit.client.0.smithi159.stdout:8/952: dread - d2/d11/d52/d26/d36/f122 zero size 2024-02-28T23:07:34.850 INFO:tasks.workunit.client.1.smithi184.stdout:4/496: link d1/d4/c24 d1/d8/d3d/c8c 0 2024-02-28T23:07:34.850 INFO:tasks.workunit.client.0.smithi159.stdout:9/842: truncate d4/d3d/d3e/d55/d37/f9b 753941 0 2024-02-28T23:07:34.853 INFO:tasks.workunit.client.0.smithi159.stdout:2/755: stat d9/d36/d59/fad 0 2024-02-28T23:07:34.854 INFO:tasks.workunit.client.0.smithi159.stdout:0/967: dwrite d0/de/f4a [4194304,4194304] 0 2024-02-28T23:07:34.855 INFO:tasks.workunit.client.1.smithi184.stdout:7/481: symlink d6/d9/da/dc/laa 0 2024-02-28T23:07:34.855 INFO:tasks.workunit.client.0.smithi159.stdout:8/953: chown d2/d11/d52/d26/l4a 502 1 2024-02-28T23:07:34.858 INFO:tasks.workunit.client.1.smithi184.stdout:5/514: mkdir db/d44/da5 0 2024-02-28T23:07:34.859 INFO:tasks.workunit.client.1.smithi184.stdout:8/533: sync 2024-02-28T23:07:34.859 INFO:tasks.workunit.client.0.smithi159.stdout:3/789: mknod d0/d47/d88/cfa 0 2024-02-28T23:07:34.860 INFO:tasks.workunit.client.1.smithi184.stdout:2/498: dwrite d10/d33/f7d [0,4194304] 0 2024-02-28T23:07:34.861 INFO:tasks.workunit.client.0.smithi159.stdout:6/855: dread d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/f28 [0,4194304] 0 2024-02-28T23:07:34.869 INFO:tasks.workunit.client.1.smithi184.stdout:1/573: creat d20/d46/d90/db3/fc4 x:0 0 0 2024-02-28T23:07:34.871 INFO:tasks.workunit.client.1.smithi184.stdout:1/574: fsync d20/d46/fbb 0 2024-02-28T23:07:34.871 INFO:tasks.workunit.client.0.smithi159.stdout:5/846: creat d8/db4/de8/f12a x:0 0 0 2024-02-28T23:07:34.873 INFO:tasks.workunit.client.0.smithi159.stdout:0/968: fdatasync d0/d5/d14/ffb 0 2024-02-28T23:07:34.874 INFO:tasks.workunit.client.1.smithi184.stdout:1/575: chown d20/d32/d3e/d82/d85/d8c 4 1 2024-02-28T23:07:34.878 INFO:tasks.workunit.client.0.smithi159.stdout:9/843: fdatasync d4/d3d/d3e/d55/d4c/d4e/d6b/db5/fdb 0 2024-02-28T23:07:34.883 INFO:tasks.workunit.client.0.smithi159.stdout:8/954: mkdir d2/d11/d52/d26/d36/d38/dfb/d12d 0 2024-02-28T23:07:34.884 INFO:tasks.workunit.client.1.smithi184.stdout:6/462: write dc/de/d10/f24 [619508,62721] 0 2024-02-28T23:07:34.886 INFO:tasks.workunit.client.0.smithi159.stdout:3/790: fsync d0/f35 0 2024-02-28T23:07:34.886 INFO:tasks.workunit.client.0.smithi159.stdout:7/722: write d5/d10/f36 [7932309,117553] 0 2024-02-28T23:07:34.887 INFO:tasks.workunit.client.1.smithi184.stdout:7/482: fsync d6/f48 0 2024-02-28T23:07:34.888 INFO:tasks.workunit.client.1.smithi184.stdout:3/547: sync 2024-02-28T23:07:34.889 INFO:tasks.workunit.client.1.smithi184.stdout:2/499: chown l3 121362 1 2024-02-28T23:07:34.889 INFO:tasks.workunit.client.1.smithi184.stdout:8/534: fdatasync d1/da/d33/f59 0 2024-02-28T23:07:34.893 INFO:tasks.workunit.client.0.smithi159.stdout:0/969: mknod d0/d5/d38/d63/dad/c156 0 2024-02-28T23:07:34.893 INFO:tasks.workunit.client.0.smithi159.stdout:8/955: write d2/d11/d52/d47/db6/dba/f129 [757491,122376] 0 2024-02-28T23:07:34.897 INFO:tasks.workunit.client.0.smithi159.stdout:2/756: link d9/f3c d9/d23/d2c/f108 0 2024-02-28T23:07:34.898 INFO:tasks.workunit.client.1.smithi184.stdout:4/497: mkdir d1/d8/d19/d56/d7a/d8d 0 2024-02-28T23:07:34.899 INFO:tasks.workunit.client.1.smithi184.stdout:0/545: write d0/df/d13/d27/d31/db3/f5c [113690,66103] 0 2024-02-28T23:07:34.900 INFO:tasks.workunit.client.1.smithi184.stdout:9/501: dwrite d5/fc [0,4194304] 0 2024-02-28T23:07:34.901 INFO:tasks.workunit.client.0.smithi159.stdout:8/956: write d2/d11/d52/d26/f4c [2169384,119418] 0 2024-02-28T23:07:34.902 INFO:tasks.workunit.client.1.smithi184.stdout:0/546: readlink d0/df/d13/d27/d31/d5b/d8e/d92/dac/lab 0 2024-02-28T23:07:34.903 INFO:tasks.workunit.client.1.smithi184.stdout:6/463: mkdir dc/de/d2a/d8e 0 2024-02-28T23:07:34.904 INFO:tasks.workunit.client.0.smithi159.stdout:1/881: dread d6/d12/f14 [0,4194304] 0 2024-02-28T23:07:34.905 INFO:tasks.workunit.client.1.smithi184.stdout:6/464: write dc/de/d10/f4b [2278129,26755] 0 2024-02-28T23:07:34.907 INFO:tasks.workunit.client.0.smithi159.stdout:4/952: dwrite d9/f18 [4194304,4194304] 0 2024-02-28T23:07:34.907 INFO:tasks.workunit.client.1.smithi184.stdout:6/465: write dc/d60/d62/f82 [5179286,90078] 0 2024-02-28T23:07:34.919 INFO:tasks.workunit.client.0.smithi159.stdout:5/847: mkdir d8/d19/d23/d35/d65/da3/dd2/def/d11f/d12b 0 2024-02-28T23:07:34.923 INFO:tasks.workunit.client.1.smithi184.stdout:3/548: mkdir d1/d4/d1c/d62/d66/da6 0 2024-02-28T23:07:34.928 INFO:tasks.workunit.client.0.smithi159.stdout:0/970: write d0/d5/d14/d34/d6c/d94/f13c [900311,16327] 0 2024-02-28T23:07:34.929 INFO:tasks.workunit.client.1.smithi184.stdout:5/515: rename db/d12/d18/d2e/d3c/c4a to db/d12/d1c/d21/d4d/ca6 0 2024-02-28T23:07:34.931 INFO:tasks.workunit.client.1.smithi184.stdout:4/498: mknod d1/d8/c8e 0 2024-02-28T23:07:34.932 INFO:tasks.workunit.client.0.smithi159.stdout:3/791: write d0/d6/f83 [1358684,115455] 0 2024-02-28T23:07:34.933 INFO:tasks.workunit.client.0.smithi159.stdout:2/757: unlink d9/d50/d62/fa6 0 2024-02-28T23:07:34.934 INFO:tasks.workunit.client.0.smithi159.stdout:3/792: stat d0/def/d79/f89 0 2024-02-28T23:07:34.935 INFO:tasks.workunit.client.1.smithi184.stdout:9/502: mknod d5/db/de/d10/d12/d2f/d7d/ca3 0 2024-02-28T23:07:34.936 INFO:tasks.workunit.client.1.smithi184.stdout:9/503: chown d5/d26/l3a 107 1 2024-02-28T23:07:34.937 INFO:tasks.workunit.client.0.smithi159.stdout:9/844: link d4/d3d/d3e/d55/d37/d62/d77/db9/dc7/fd5 d4/d3d/d3e/d4a/f108 0 2024-02-28T23:07:34.938 INFO:tasks.workunit.client.1.smithi184.stdout:9/504: write d5/db/de/f74 [686941,67117] 0 2024-02-28T23:07:34.941 INFO:tasks.workunit.client.1.smithi184.stdout:0/547: creat d0/df/d13/d27/d31/d5b/d8e/d92/fc1 x:0 0 0 2024-02-28T23:07:34.944 INFO:tasks.workunit.client.0.smithi159.stdout:8/957: read d2/d3/f1d [4144350,32207] 0 2024-02-28T23:07:34.947 INFO:tasks.workunit.client.0.smithi159.stdout:1/882: creat d6/d12/d1a/d92/d97/dd8/f12b x:0 0 0 2024-02-28T23:07:34.948 INFO:tasks.workunit.client.1.smithi184.stdout:7/483: fsync d6/f9e 0 2024-02-28T23:07:34.949 INFO:tasks.workunit.client.0.smithi159.stdout:4/953: mknod d9/d20/d87/d115/d1c/d8e/d143/c14f 0 2024-02-28T23:07:34.956 INFO:tasks.workunit.client.1.smithi184.stdout:5/516: truncate db/f61 1001948 0 2024-02-28T23:07:34.959 INFO:tasks.workunit.client.1.smithi184.stdout:9/505: symlink d5/d17/d8f/la4 0 2024-02-28T23:07:34.959 INFO:tasks.workunit.client.1.smithi184.stdout:5/517: write db/d12/d18/d2e/d3c/d5d/f33 [4457256,15511] 0 2024-02-28T23:07:34.959 INFO:tasks.workunit.client.0.smithi159.stdout:0/971: read - d0/de/d75/fdb zero size 2024-02-28T23:07:34.962 INFO:tasks.workunit.client.1.smithi184.stdout:0/548: dread - d0/f65 zero size 2024-02-28T23:07:34.962 INFO:tasks.workunit.client.1.smithi184.stdout:4/499: dread d1/f12 [0,4194304] 0 2024-02-28T23:07:34.963 INFO:tasks.workunit.client.1.smithi184.stdout:0/549: write d0/d7c/f7f [1032948,78784] 0 2024-02-28T23:07:34.964 INFO:tasks.workunit.client.1.smithi184.stdout:4/500: chown d1/dc/df/d3b/d5c/f7b 4066630 1 2024-02-28T23:07:34.967 INFO:tasks.workunit.client.1.smithi184.stdout:7/484: symlink d6/d9/da/lab 0 2024-02-28T23:07:34.969 INFO:tasks.workunit.client.1.smithi184.stdout:2/500: rmdir d10/d1f/d21/d5e/d15/d60 39 2024-02-28T23:07:34.975 INFO:tasks.workunit.client.0.smithi159.stdout:7/723: mknod d5/d16/d1a/d27/d46/ce6 0 2024-02-28T23:07:34.977 INFO:tasks.workunit.client.1.smithi184.stdout:8/535: creat d1/da/d10/fca x:0 0 0 2024-02-28T23:07:34.979 INFO:tasks.workunit.client.0.smithi159.stdout:1/883: chown d6/d1d/d46/d88/dd3/d63/f74 48475 1 2024-02-28T23:07:34.981 INFO:tasks.workunit.client.1.smithi184.stdout:3/549: symlink d1/d4/d6/d1f/d26/d3a/d59/d6a/la7 0 2024-02-28T23:07:34.982 INFO:tasks.workunit.client.0.smithi159.stdout:2/758: dread d9/d23/f6a [0,4194304] 0 2024-02-28T23:07:34.986 INFO:tasks.workunit.client.1.smithi184.stdout:1/576: rename d20/c33 to d20/d32/dc0/cc5 0 2024-02-28T23:07:34.988 INFO:tasks.workunit.client.0.smithi159.stdout:6/856: getdents d0/d1b/d33/d11 0 2024-02-28T23:07:34.988 INFO:tasks.workunit.client.0.smithi159.stdout:8/958: write d2/d3/f1d [4658241,44997] 0 2024-02-28T23:07:34.992 INFO:tasks.workunit.client.1.smithi184.stdout:9/506: rmdir d5/db/de/d10/d12/d2f/d7d 39 2024-02-28T23:07:34.992 INFO:tasks.workunit.client.0.smithi159.stdout:6/857: read d0/d1b/d33/d11/d34/d9d/da2/f61 [1032791,125011] 0 2024-02-28T23:07:34.993 INFO:tasks.workunit.client.0.smithi159.stdout:3/793: symlink d0/lfb 0 2024-02-28T23:07:34.996 INFO:tasks.workunit.client.1.smithi184.stdout:7/485: mkdir d6/d9/d13/d14/dac 0 2024-02-28T23:07:34.998 INFO:tasks.workunit.client.1.smithi184.stdout:2/501: read - d10/d1f/d21/d5e/d15/d60/f9a zero size 2024-02-28T23:07:34.998 INFO:tasks.workunit.client.1.smithi184.stdout:8/536: fdatasync d1/da/dc/d16/d32/d42/d77/f85 0 2024-02-28T23:07:35.000 INFO:tasks.workunit.client.0.smithi159.stdout:1/884: creat d6/d12/d33/d3c/f12c x:0 0 0 2024-02-28T23:07:35.003 INFO:tasks.workunit.client.0.smithi159.stdout:9/845: write d4/d3d/d3e/d55/d4c/f92 [720052,1883] 0 2024-02-28T23:07:35.009 INFO:tasks.workunit.client.0.smithi159.stdout:2/759: creat d9/d50/d62/dba/f109 x:0 0 0 2024-02-28T23:07:35.009 INFO:tasks.workunit.client.0.smithi159.stdout:6/858: dwrite d0/d1b/d33/d3f/f73 [0,4194304] 0 2024-02-28T23:07:35.013 INFO:tasks.workunit.client.0.smithi159.stdout:5/848: rename d8/d19/f3c to d8/d19/d23/f12c 0 2024-02-28T23:07:35.015 INFO:tasks.workunit.client.0.smithi159.stdout:2/760: dread - d9/d50/ffc zero size 2024-02-28T23:07:35.017 INFO:tasks.workunit.client.1.smithi184.stdout:6/466: rename dc/d42/l69 to dc/de/d2a/l8f 0 2024-02-28T23:07:35.021 INFO:tasks.workunit.client.1.smithi184.stdout:6/467: stat dc/de/d56 0 2024-02-28T23:07:35.023 INFO:tasks.workunit.client.0.smithi159.stdout:6/859: read d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/fc1 [2431854,18274] 0 2024-02-28T23:07:35.025 INFO:tasks.workunit.client.1.smithi184.stdout:0/550: getdents d0/df/d13/d9d 0 2024-02-28T23:07:35.028 INFO:tasks.workunit.client.1.smithi184.stdout:7/486: unlink f5 0 2024-02-28T23:07:35.028 INFO:tasks.workunit.client.1.smithi184.stdout:0/551: chown d0/l16 3021 1 2024-02-28T23:07:35.029 INFO:tasks.workunit.client.0.smithi159.stdout:4/954: dwrite d9/f4e [0,4194304] 0 2024-02-28T23:07:35.030 INFO:tasks.workunit.client.0.smithi159.stdout:7/724: mknod d5/d16/d1a/d27/ce7 0 2024-02-28T23:07:35.030 INFO:tasks.workunit.client.1.smithi184.stdout:3/550: dwrite d1/d4/d6/d1f/d24/f3e [0,4194304] 0 2024-02-28T23:07:35.033 INFO:tasks.workunit.client.1.smithi184.stdout:0/552: read - d0/df/d13/d27/d31/d5b/d8e/d91/fa6 zero size 2024-02-28T23:07:35.034 INFO:tasks.workunit.client.1.smithi184.stdout:2/502: read d10/d1f/d38/d54/f76 [1157594,17761] 0 2024-02-28T23:07:35.036 INFO:tasks.workunit.client.0.smithi159.stdout:8/959: write d2/f15 [2858428,54366] 0 2024-02-28T23:07:35.037 INFO:tasks.workunit.client.0.smithi159.stdout:9/846: mkdir d4/d3d/d3e/d4a/d109 0 2024-02-28T23:07:35.038 INFO:tasks.workunit.client.0.smithi159.stdout:0/972: truncate d0/d5/d14/d25/d2c/f43 245081 0 2024-02-28T23:07:35.044 INFO:tasks.workunit.client.0.smithi159.stdout:2/761: unlink d9/ff1 0 2024-02-28T23:07:35.047 INFO:tasks.workunit.client.1.smithi184.stdout:4/501: rename d1/d8/d3d/d44/d77 to d1/dc/df/d3b/d8f 0 2024-02-28T23:07:35.048 INFO:tasks.workunit.client.0.smithi159.stdout:3/794: write d0/def/d79/d9b/fbe [567550,11885] 0 2024-02-28T23:07:35.049 INFO:tasks.workunit.client.0.smithi159.stdout:3/795: chown d0/fa8 1944643053 1 2024-02-28T23:07:35.051 INFO:tasks.workunit.client.0.smithi159.stdout:3/796: readlink d0/d2b/d55/d75/lf1 0 2024-02-28T23:07:35.052 INFO:tasks.workunit.client.1.smithi184.stdout:8/537: write d1/da/dc/d16/d29/f71 [256089,115323] 0 2024-02-28T23:07:35.054 INFO:tasks.workunit.client.1.smithi184.stdout:6/468: rmdir dc/d60/d6d 39 2024-02-28T23:07:35.057 INFO:tasks.workunit.client.0.smithi159.stdout:1/885: creat d6/d1d/d1f/db8/dee/f12d x:0 0 0 2024-02-28T23:07:35.064 INFO:tasks.workunit.client.0.smithi159.stdout:4/955: truncate d9/d20/f5e 171697 0 2024-02-28T23:07:35.067 INFO:tasks.workunit.client.0.smithi159.stdout:7/725: rmdir d5/d16/d1a/d27/d75/dac/dbe 39 2024-02-28T23:07:35.071 INFO:tasks.workunit.client.0.smithi159.stdout:4/956: fdatasync d9/d20/d87/d115/d1c/dc3/f14d 0 2024-02-28T23:07:35.073 INFO:tasks.workunit.client.1.smithi184.stdout:9/507: write d5/d17/d43/f48 [1913955,120198] 0 2024-02-28T23:07:35.074 INFO:tasks.workunit.client.0.smithi159.stdout:9/847: chown d4/l9 6568 1 2024-02-28T23:07:35.078 INFO:tasks.workunit.client.0.smithi159.stdout:2/762: fsync d9/d23/d2c/d55/d13/f40 0 2024-02-28T23:07:35.081 INFO:tasks.workunit.client.1.smithi184.stdout:2/503: mkdir d10/d1f/d21/d5e/d15/d24/d5f/d63/da3 0 2024-02-28T23:07:35.084 INFO:tasks.workunit.client.0.smithi159.stdout:5/849: mkdir d8/d19/d23/d35/d38/d12d 0 2024-02-28T23:07:35.085 INFO:tasks.workunit.client.1.smithi184.stdout:7/487: write d6/d9/d13/f1f [653200,70380] 0 2024-02-28T23:07:35.088 INFO:tasks.workunit.client.1.smithi184.stdout:4/502: symlink d1/dc/df/d38/l90 0 2024-02-28T23:07:35.089 INFO:tasks.workunit.client.0.smithi159.stdout:5/850: readlink d8/d19/d23/d35/d65/da3/df4/lb3 0 2024-02-28T23:07:35.089 INFO:tasks.workunit.client.0.smithi159.stdout:3/797: fdatasync d0/d6/d34/f45 0 2024-02-28T23:07:35.091 INFO:tasks.workunit.client.1.smithi184.stdout:5/518: getdents db/d12/d1c 0 2024-02-28T23:07:35.092 INFO:tasks.workunit.client.1.smithi184.stdout:8/538: fsync d1/da/dc/d18/f57 0 2024-02-28T23:07:35.095 INFO:tasks.workunit.client.1.smithi184.stdout:8/539: truncate d1/da/dc/d18/f38 1067815 0 2024-02-28T23:07:35.101 INFO:tasks.workunit.client.0.smithi159.stdout:0/973: dwrite d0/de/d75/db8/fbf [0,4194304] 0 2024-02-28T23:07:35.103 INFO:tasks.workunit.client.1.smithi184.stdout:8/540: dread d1/da/d10/d17/f9c [4194304,4194304] 0 2024-02-28T23:07:35.105 INFO:tasks.workunit.client.1.smithi184.stdout:0/553: symlink d0/df/d13/lc2 0 2024-02-28T23:07:35.106 INFO:tasks.workunit.client.0.smithi159.stdout:0/974: write d0/d5/d14/d25/d2c/dab/fd0 [1883995,52884] 0 2024-02-28T23:07:35.109 INFO:tasks.workunit.client.1.smithi184.stdout:8/541: read d1/da/dc/d16/d32/d42/f6f [138601,34912] 0 2024-02-28T23:07:35.110 INFO:tasks.workunit.client.0.smithi159.stdout:6/860: dread d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/f111 [0,4194304] 0 2024-02-28T23:07:35.111 INFO:tasks.workunit.client.0.smithi159.stdout:0/975: chown d0/d5/d14/d25/d2c/dab/f10c 26 1 2024-02-28T23:07:35.111 INFO:tasks.workunit.client.1.smithi184.stdout:1/577: getdents d20/d32/db0 0 2024-02-28T23:07:35.112 INFO:tasks.workunit.client.1.smithi184.stdout:0/554: read d0/d7c/f7f [501152,94526] 0 2024-02-28T23:07:35.115 INFO:tasks.workunit.client.0.smithi159.stdout:5/851: dread d8/d16/d122/f4b [4194304,4194304] 0 2024-02-28T23:07:35.115 INFO:tasks.workunit.client.1.smithi184.stdout:7/488: rename d6/d9/da/dc to d6/d9/d13/d3e/dad 0 2024-02-28T23:07:35.117 INFO:tasks.workunit.client.1.smithi184.stdout:4/503: dread d1/d4/f1f [0,4194304] 0 2024-02-28T23:07:35.118 INFO:tasks.workunit.client.1.smithi184.stdout:3/551: write d1/d4/d6/d1f/d26/f29 [1418978,120951] 0 2024-02-28T23:07:35.119 INFO:tasks.workunit.client.1.smithi184.stdout:4/504: fdatasync d1/f33 0 2024-02-28T23:07:35.119 INFO:tasks.workunit.client.1.smithi184.stdout:9/508: write d5/db/de/f21 [1483578,4423] 0 2024-02-28T23:07:35.121 INFO:tasks.workunit.client.1.smithi184.stdout:6/469: getdents dc/de/d56/d8a 0 2024-02-28T23:07:35.121 INFO:tasks.workunit.client.0.smithi159.stdout:3/798: dwrite d0/d2b/d55/df8/da9/fe5 [0,4194304] 0 2024-02-28T23:07:35.148 INFO:tasks.workunit.client.1.smithi184.stdout:7/489: symlink d6/d9/d13/d3e/d7e/lae 0 2024-02-28T23:07:35.148 INFO:tasks.workunit.client.1.smithi184.stdout:4/505: dread d1/d4/d43/d73/f5e [0,4194304] 0 2024-02-28T23:07:35.149 INFO:tasks.workunit.client.1.smithi184.stdout:5/519: creat db/d12/d50/d9e/fa7 x:0 0 0 2024-02-28T23:07:35.153 INFO:tasks.workunit.client.1.smithi184.stdout:6/470: mkdir dc/d60/d7c/d90 0 2024-02-28T23:07:35.156 INFO:tasks.workunit.client.1.smithi184.stdout:6/471: chown dc/d60/d62/f82 0 1 2024-02-28T23:07:35.157 INFO:tasks.workunit.client.1.smithi184.stdout:0/555: mknod d0/df/d13/cc3 0 2024-02-28T23:07:35.159 INFO:tasks.workunit.client.1.smithi184.stdout:1/578: link d20/f50 d20/d32/d3e/d82/d85/d8c/fc6 0 2024-02-28T23:07:35.160 INFO:tasks.workunit.client.1.smithi184.stdout:0/556: read - d0/d1d/d4c/f69 zero size 2024-02-28T23:07:35.161 INFO:tasks.workunit.client.1.smithi184.stdout:9/509: mknod d5/d47/ca5 0 2024-02-28T23:07:35.164 INFO:tasks.workunit.client.1.smithi184.stdout:3/552: link d1/d4/d6/f81 d1/d4/d6/d1f/d26/d3a/fa8 0 2024-02-28T23:07:35.166 INFO:tasks.workunit.client.1.smithi184.stdout:5/520: symlink db/d12/d18/d2e/d3c/d5d/d66/la8 0 2024-02-28T23:07:35.168 INFO:tasks.workunit.client.1.smithi184.stdout:3/553: chown d1/d4/d5/d40/l4b 26 1 2024-02-28T23:07:35.168 INFO:tasks.workunit.client.1.smithi184.stdout:7/490: rename d6/d9/d13/d1e/d2f/d34 to d6/d9/d13/d3e/dad/d49/da6/daf 0 2024-02-28T23:07:35.169 INFO:tasks.workunit.client.1.smithi184.stdout:2/504: getdents d10/d1f/d21/d4d/d71 0 2024-02-28T23:07:35.170 INFO:tasks.workunit.client.1.smithi184.stdout:4/506: dwrite d1/d4/d43/d73/f5e [0,4194304] 0 2024-02-28T23:07:35.175 INFO:tasks.workunit.client.1.smithi184.stdout:2/505: chown d10/d1f/d21/d5e/d15/d24/f56 4394 1 2024-02-28T23:07:35.175 INFO:tasks.workunit.client.1.smithi184.stdout:6/472: write dc/d60/d6d/f83 [550614,77943] 0 2024-02-28T23:07:35.176 INFO:tasks.workunit.client.1.smithi184.stdout:9/510: creat d5/d26/fa6 x:0 0 0 2024-02-28T23:07:35.178 INFO:tasks.workunit.client.1.smithi184.stdout:6/473: stat dc/de/d10/d3a/c8d 0 2024-02-28T23:07:35.184 INFO:tasks.workunit.client.1.smithi184.stdout:5/521: unlink db/d12/f1d 0 2024-02-28T23:07:35.187 INFO:tasks.workunit.client.0.smithi159.stdout:1/886: mkdir d6/d1d/d1f/db8/dee/d12e 0 2024-02-28T23:07:35.187 INFO:tasks.workunit.client.1.smithi184.stdout:3/554: dread d1/d4/d6/d1f/d26/f29 [0,4194304] 0 2024-02-28T23:07:35.189 INFO:tasks.workunit.client.1.smithi184.stdout:2/506: dread d10/d1f/d38/f9c [0,4194304] 0 2024-02-28T23:07:35.191 INFO:tasks.workunit.client.1.smithi184.stdout:4/507: dwrite d1/d8/d19/d56/f85 [0,4194304] 0 2024-02-28T23:07:35.192 INFO:tasks.workunit.client.1.smithi184.stdout:0/557: unlink d0/d1f/f52 0 2024-02-28T23:07:35.193 INFO:tasks.workunit.client.1.smithi184.stdout:4/508: chown d1 123 1 2024-02-28T23:07:35.193 INFO:tasks.workunit.client.0.smithi159.stdout:8/960: mknod d2/d11/d35/d5f/d109/c12e 0 2024-02-28T23:07:35.193 INFO:tasks.workunit.client.1.smithi184.stdout:3/555: truncate d1/d4/f7c 502061 0 2024-02-28T23:07:35.197 INFO:tasks.workunit.client.1.smithi184.stdout:7/491: rename d6/d9/d13/d1e/d2f/l5c to d6/d9/d13/d3e/dad/d49/da6/daf/d47/lb0 0 2024-02-28T23:07:35.198 INFO:tasks.workunit.client.1.smithi184.stdout:3/556: chown d1/d4/d1c/f27 169 1 2024-02-28T23:07:35.198 INFO:tasks.workunit.client.1.smithi184.stdout:0/558: fsync d0/df/d13/d27/d31/d5b/d8e/fa5 0 2024-02-28T23:07:35.198 INFO:tasks.workunit.client.1.smithi184.stdout:7/492: fsync d6/f59 0 2024-02-28T23:07:35.199 INFO:tasks.workunit.client.1.smithi184.stdout:9/511: truncate d5/db/de/d10/f2b 5633113 0 2024-02-28T23:07:35.202 INFO:tasks.workunit.client.0.smithi159.stdout:2/763: symlink d9/d50/d62/l10a 0 2024-02-28T23:07:35.203 INFO:tasks.workunit.client.1.smithi184.stdout:8/542: dwrite d1/da/dc/d16/d29/d7d/fb8 [0,4194304] 0 2024-02-28T23:07:35.204 INFO:tasks.workunit.client.0.smithi159.stdout:2/764: chown d9/d50/dcc/d44/dc8/fe1 3573992 1 2024-02-28T23:07:35.210 INFO:tasks.workunit.client.1.smithi184.stdout:4/509: unlink d1/d8/d19/c25 0 2024-02-28T23:07:35.213 INFO:tasks.workunit.client.0.smithi159.stdout:6/861: rmdir d0/d6d 39 2024-02-28T23:07:35.215 INFO:tasks.workunit.client.1.smithi184.stdout:2/507: dread f8 [0,4194304] 0 2024-02-28T23:07:35.217 INFO:tasks.workunit.client.0.smithi159.stdout:6/862: chown d0/d1b/d33/d11/d34/d9d/da2/d96/cae 6 1 2024-02-28T23:07:35.218 INFO:tasks.workunit.client.0.smithi159.stdout:3/799: creat d0/d47/d88/ffc x:0 0 0 2024-02-28T23:07:35.218 INFO:tasks.workunit.client.0.smithi159.stdout:6/863: chown d0/d1b/l17 3 1 2024-02-28T23:07:35.224 INFO:tasks.workunit.client.1.smithi184.stdout:7/493: mknod d6/d9/d13/d3e/d7e/cb1 0 2024-02-28T23:07:35.225 INFO:tasks.workunit.client.0.smithi159.stdout:8/961: mkdir d2/d3/d12f 0 2024-02-28T23:07:35.226 INFO:tasks.workunit.client.0.smithi159.stdout:8/962: readlink d2/d3/d8c/lf5 0 2024-02-28T23:07:35.228 INFO:tasks.workunit.client.1.smithi184.stdout:0/559: symlink d0/df/d13/d27/d31/d5b/d8e/da3/lc4 0 2024-02-28T23:07:35.228 INFO:tasks.workunit.client.0.smithi159.stdout:8/963: chown d2/d11/d52/d26/d36/d38/d77/d9e/dc1 100002 1 2024-02-28T23:07:35.229 INFO:tasks.workunit.client.0.smithi159.stdout:8/964: stat d2/c121 0 2024-02-28T23:07:35.229 INFO:tasks.workunit.client.1.smithi184.stdout:8/543: mknod d1/da/d10/d17/ccb 0 2024-02-28T23:07:35.234 INFO:tasks.workunit.client.1.smithi184.stdout:4/510: creat d1/d4/d43/d73/f91 x:0 0 0 2024-02-28T23:07:35.240 INFO:tasks.workunit.client.1.smithi184.stdout:2/508: truncate d10/d1f/d38/d53/f9d 2218794 0 2024-02-28T23:07:35.244 INFO:tasks.workunit.client.1.smithi184.stdout:7/494: mkdir d6/d9/d13/d3e/dad/d49/d50/db2 0 2024-02-28T23:07:35.248 INFO:tasks.workunit.client.0.smithi159.stdout:4/957: rename d9/d42/d54/d9c/dd7 to d9/d4c/d6c/d98/d150 0 2024-02-28T23:07:35.252 INFO:tasks.workunit.client.0.smithi159.stdout:8/965: creat d2/d11/d58/f130 x:0 0 0 2024-02-28T23:07:35.253 INFO:tasks.workunit.client.0.smithi159.stdout:9/848: link d4/d3d/d3e/d55/d37/d62/f69 d4/d3d/d3e/d55/d37/d62/d77/db9/dc7/f10a 0 2024-02-28T23:07:35.255 INFO:tasks.workunit.client.1.smithi184.stdout:6/474: getdents dc/de/d2a 0 2024-02-28T23:07:35.256 INFO:tasks.workunit.client.1.smithi184.stdout:1/579: sync 2024-02-28T23:07:35.256 INFO:tasks.workunit.client.0.smithi159.stdout:1/887: link d6/d1d/d1f/f8c d6/d12/d1a/d92/dc8/f12f 0 2024-02-28T23:07:35.257 INFO:tasks.workunit.client.1.smithi184.stdout:6/475: dread - dc/f4f zero size 2024-02-28T23:07:35.259 INFO:tasks.workunit.client.1.smithi184.stdout:5/522: rename db/d12/d18/d2e/d3c/c65 to db/d12/d1c/d21/ca9 0 2024-02-28T23:07:35.260 INFO:tasks.workunit.client.1.smithi184.stdout:6/476: dread - dc/de/d2a/f35 zero size 2024-02-28T23:07:35.261 INFO:tasks.workunit.client.0.smithi159.stdout:7/726: dwrite d5/f1e [0,4194304] 0 2024-02-28T23:07:35.261 INFO:tasks.workunit.client.1.smithi184.stdout:9/512: creat d5/fa7 x:0 0 0 2024-02-28T23:07:35.263 INFO:tasks.workunit.client.1.smithi184.stdout:9/513: write d5/f13 [4390737,4872] 0 2024-02-28T23:07:35.264 INFO:tasks.workunit.client.1.smithi184.stdout:7/495: dread - d6/d9/f76 zero size 2024-02-28T23:07:35.265 INFO:tasks.workunit.client.1.smithi184.stdout:9/514: fdatasync d5/d26/f78 0 2024-02-28T23:07:35.266 INFO:tasks.workunit.client.0.smithi159.stdout:2/765: dwrite d9/d50/dcc/d44/dc0/fc1 [0,4194304] 0 2024-02-28T23:07:35.267 INFO:tasks.workunit.client.1.smithi184.stdout:1/580: fdatasync d20/f35 0 2024-02-28T23:07:35.269 INFO:tasks.workunit.client.0.smithi159.stdout:3/800: dwrite d0/fac [0,4194304] 0 2024-02-28T23:07:35.273 INFO:tasks.workunit.client.1.smithi184.stdout:8/544: dwrite d1/da/d10/d17/f13 [0,4194304] 0 2024-02-28T23:07:35.274 INFO:tasks.workunit.client.0.smithi159.stdout:3/801: chown d0/c86 109 1 2024-02-28T23:07:35.285 INFO:tasks.workunit.client.0.smithi159.stdout:1/888: rmdir d6/d1d/d1f/db8/dcc/d121 39 2024-02-28T23:07:35.286 INFO:tasks.workunit.client.1.smithi184.stdout:6/477: fdatasync dc/de/d10/f21 0 2024-02-28T23:07:35.293 INFO:tasks.workunit.client.1.smithi184.stdout:9/515: dwrite d5/d47/d68/d7c/f8b [4194304,4194304] 0 2024-02-28T23:07:35.301 INFO:tasks.workunit.client.0.smithi159.stdout:4/958: truncate d9/d20/d87/d115/d1c/d8e/ddc/dc9/fde 799078 0 2024-02-28T23:07:35.304 INFO:tasks.workunit.client.1.smithi184.stdout:6/478: dwrite dc/de/d10/d16/f37 [0,4194304] 0 2024-02-28T23:07:35.315 INFO:tasks.workunit.client.1.smithi184.stdout:5/523: creat db/d44/da5/faa x:0 0 0 2024-02-28T23:07:35.318 INFO:tasks.workunit.client.1.smithi184.stdout:9/516: fsync d5/d47/d68/f6f 0 2024-02-28T23:07:35.319 INFO:tasks.workunit.client.0.smithi159.stdout:0/976: rename d0/d5/d14/d34/d6c/daf/f137 to d0/d5/d14/d34/f157 0 2024-02-28T23:07:35.322 INFO:tasks.workunit.client.1.smithi184.stdout:9/517: write d5/db/de/d10/d12/f9e [1098544,79752] 0 2024-02-28T23:07:35.322 INFO:tasks.workunit.client.0.smithi159.stdout:4/959: dread - d9/d20/d87/d115/d1c/d23/d2d/ffe zero size 2024-02-28T23:07:35.323 INFO:tasks.workunit.client.1.smithi184.stdout:7/496: dwrite d6/d9/d13/d3e/dad/f12 [0,4194304] 0 2024-02-28T23:07:35.327 INFO:tasks.workunit.client.0.smithi159.stdout:1/889: write d6/d12/d31/d5a/f87 [558607,14464] 0 2024-02-28T23:07:35.327 INFO:tasks.workunit.client.0.smithi159.stdout:9/849: dread d4/d3d/d3e/d55/d37/d62/f74 [0,4194304] 0 2024-02-28T23:07:35.330 INFO:tasks.workunit.client.1.smithi184.stdout:3/557: rename d1/d4/d6/d1f/d26/d3a/d59/d6a to d1/d4/d5/da9 0 2024-02-28T23:07:35.332 INFO:tasks.workunit.client.1.smithi184.stdout:3/558: read d1/d4/d5/f9c [4188351,88353] 0 2024-02-28T23:07:35.340 INFO:tasks.workunit.client.0.smithi159.stdout:8/966: dwrite d2/d11/d52/d26/d36/d38/f39 [0,4194304] 0 2024-02-28T23:07:35.344 INFO:tasks.workunit.client.0.smithi159.stdout:8/967: stat d2/d73/dc2/fac 0 2024-02-28T23:07:35.345 INFO:tasks.workunit.client.1.smithi184.stdout:3/559: dread d1/d4/d6/d1e/d72/f7a [0,4194304] 0 2024-02-28T23:07:35.350 INFO:tasks.workunit.client.0.smithi159.stdout:7/727: dread d5/d16/d40/f4e [0,4194304] 0 2024-02-28T23:07:35.350 INFO:tasks.workunit.client.1.smithi184.stdout:7/497: fsync d6/d9/d13/d1e/d2f/f44 0 2024-02-28T23:07:35.351 INFO:tasks.workunit.client.1.smithi184.stdout:1/581: creat d20/d32/d3e/fc7 x:0 0 0 2024-02-28T23:07:35.351 INFO:tasks.workunit.client.0.smithi159.stdout:9/850: mkdir d4/d3d/d3e/d55/d10b 0 2024-02-28T23:07:35.352 INFO:tasks.workunit.client.1.smithi184.stdout:7/498: fdatasync d6/d9/d13/d3e/dad/d49/f88 0 2024-02-28T23:07:35.353 INFO:tasks.workunit.client.1.smithi184.stdout:0/560: rename d0/df/d13/d27/d31/d5b/d8e/ca2 to d0/df/d13/d27/d31/d5b/d8e/d92/cc5 0 2024-02-28T23:07:35.353 INFO:tasks.workunit.client.0.smithi159.stdout:3/802: dwrite d0/d2b/d55/d75/d6d/f3d [8388608,4194304] 0 2024-02-28T23:07:35.355 INFO:tasks.workunit.client.1.smithi184.stdout:5/524: dwrite db/d1f/f78 [0,4194304] 0 2024-02-28T23:07:35.356 INFO:tasks.workunit.client.1.smithi184.stdout:8/545: link d1/da/d10/d17/l8e d1/da/d33/dac/dc5/lcc 0 2024-02-28T23:07:35.356 INFO:tasks.workunit.client.0.smithi159.stdout:0/977: dread d0/d5/d38/f91 [0,4194304] 0 2024-02-28T23:07:35.359 INFO:tasks.workunit.client.1.smithi184.stdout:3/560: dread - d1/d4/d6/d1f/d26/d3a/d59/d67/f6d zero size 2024-02-28T23:07:35.360 INFO:tasks.workunit.client.1.smithi184.stdout:7/499: fsync d6/f48 0 2024-02-28T23:07:35.360 INFO:tasks.workunit.client.0.smithi159.stdout:4/960: getdents d9/d20/d87/d115/dc5/d13c 0 2024-02-28T23:07:35.362 INFO:tasks.workunit.client.1.smithi184.stdout:7/500: chown d6/d9/d13/d3e/dad/f3c 482554237 1 2024-02-28T23:07:35.363 INFO:tasks.workunit.client.1.smithi184.stdout:4/511: rename d1/dc/df/d38/d3c to d1/d8/d19/d92 0 2024-02-28T23:07:35.363 INFO:tasks.workunit.client.0.smithi159.stdout:7/728: mknod d5/d16/d1a/d27/d46/d65/d81/ce8 0 2024-02-28T23:07:35.367 INFO:tasks.workunit.client.0.smithi159.stdout:1/890: dwrite d6/d12/d1a/d92/dc9/dfb/f11e [0,4194304] 0 2024-02-28T23:07:35.369 INFO:tasks.workunit.client.1.smithi184.stdout:0/561: creat d0/df/d13/d27/d31/d5b/d8e/d91/d71/fc6 x:0 0 0 2024-02-28T23:07:35.373 INFO:tasks.workunit.client.0.smithi159.stdout:1/891: stat d6/d12/d31/d69 0 2024-02-28T23:07:35.374 INFO:tasks.workunit.client.1.smithi184.stdout:5/525: symlink db/d12/d18/d2e/d3c/d5d/d66/lab 0 2024-02-28T23:07:35.375 INFO:tasks.workunit.client.1.smithi184.stdout:1/582: mknod d20/d32/cc8 0 2024-02-28T23:07:35.377 INFO:tasks.workunit.client.0.smithi159.stdout:4/961: fdatasync d9/d20/f48 0 2024-02-28T23:07:35.378 INFO:tasks.workunit.client.1.smithi184.stdout:5/526: read db/d44/f84 [2832136,20951] 0 2024-02-28T23:07:35.381 INFO:tasks.workunit.client.1.smithi184.stdout:5/527: truncate db/f7b 640713 0 2024-02-28T23:07:35.383 INFO:tasks.workunit.client.1.smithi184.stdout:5/528: readlink db/d12/d50/l94 0 2024-02-28T23:07:35.384 INFO:tasks.workunit.client.0.smithi159.stdout:2/766: write d9/d50/d54/d84/d37/d5c/f7b [12861,52322] 0 2024-02-28T23:07:35.384 INFO:tasks.workunit.client.0.smithi159.stdout:7/729: creat d5/d16/d40/dce/fe9 x:0 0 0 2024-02-28T23:07:35.386 INFO:tasks.workunit.client.1.smithi184.stdout:7/501: dwrite d6/d9/d13/d3e/dad/d49/f88 [0,4194304] 0 2024-02-28T23:07:35.387 INFO:tasks.workunit.client.0.smithi159.stdout:2/767: chown d9/d23/d2c/f32 1074 1 2024-02-28T23:07:35.387 INFO:tasks.workunit.client.1.smithi184.stdout:4/512: dwrite d1/dc/df/f16 [4194304,4194304] 0 2024-02-28T23:07:35.391 INFO:tasks.workunit.client.1.smithi184.stdout:7/502: truncate d6/d9/d13/f1f 1598914 0 2024-02-28T23:07:35.391 INFO:tasks.workunit.client.1.smithi184.stdout:4/513: truncate d1/d8/d19/d92/f65 1637103 0 2024-02-28T23:07:35.392 INFO:tasks.workunit.client.0.smithi159.stdout:3/803: rename d0/d47/c70 to d0/d2b/cfd 0 2024-02-28T23:07:35.393 INFO:tasks.workunit.client.1.smithi184.stdout:6/479: dread dc/de/d2a/f65 [0,4194304] 0 2024-02-28T23:07:35.402 INFO:tasks.workunit.client.1.smithi184.stdout:8/546: unlink d1/da/f40 0 2024-02-28T23:07:35.402 INFO:tasks.workunit.client.0.smithi159.stdout:1/892: mknod d6/d12/d33/d72/c130 0 2024-02-28T23:07:35.402 INFO:tasks.workunit.client.0.smithi159.stdout:3/804: truncate d0/d2b/d55/df8/d2f/f4b 4983149 0 2024-02-28T23:07:35.404 INFO:tasks.workunit.client.0.smithi159.stdout:7/730: dread d5/d16/d1a/d27/d3e/f4a [0,4194304] 0 2024-02-28T23:07:35.408 INFO:tasks.workunit.client.0.smithi159.stdout:4/962: mkdir d9/d4c/d151 0 2024-02-28T23:07:35.409 INFO:tasks.workunit.client.1.smithi184.stdout:3/561: mknod d1/d4/caa 0 2024-02-28T23:07:35.411 INFO:tasks.workunit.client.1.smithi184.stdout:5/529: dwrite db/d44/f84 [0,4194304] 0 2024-02-28T23:07:35.412 INFO:tasks.workunit.client.1.smithi184.stdout:7/503: dwrite d6/d9/da/f10 [0,4194304] 0 2024-02-28T23:07:35.415 INFO:tasks.workunit.client.1.smithi184.stdout:4/514: rmdir d1/dc/df/d38/d57 39 2024-02-28T23:07:35.415 INFO:tasks.workunit.client.0.smithi159.stdout:8/968: link d2/d11/d52/d47/c106 d2/d3/c131 0 2024-02-28T23:07:35.421 INFO:tasks.workunit.client.1.smithi184.stdout:2/509: rename d10/d1f/d21/d5e/d15/c40 to d10/d1f/d38/d54/d96/ca4 0 2024-02-28T23:07:35.422 INFO:tasks.workunit.client.1.smithi184.stdout:2/510: chown d10/d55/f70 1642182458 1 2024-02-28T23:07:35.426 INFO:tasks.workunit.client.1.smithi184.stdout:8/547: creat d1/da/d10/d6b/fcd x:0 0 0 2024-02-28T23:07:35.429 INFO:tasks.workunit.client.1.smithi184.stdout:8/548: write d1/da/dc/d16/d4d/d82/fa8 [805439,105613] 0 2024-02-28T23:07:35.429 INFO:tasks.workunit.client.0.smithi159.stdout:0/978: link d0/d5/d38/d76/c95 d0/de/d75/db8/d103/d121/c158 0 2024-02-28T23:07:35.430 INFO:tasks.workunit.client.1.smithi184.stdout:1/583: mkdir d20/d32/d3e/dc9 0 2024-02-28T23:07:35.431 INFO:tasks.workunit.client.0.smithi159.stdout:7/731: dwrite d5/d16/d1a/d27/d46/d65/d81/d83/d9d/fdd [0,4194304] 0 2024-02-28T23:07:35.431 INFO:tasks.workunit.client.0.smithi159.stdout:3/805: creat d0/d3f/dd2/d6a/ddd/ffe x:0 0 0 2024-02-28T23:07:35.432 INFO:tasks.workunit.client.1.smithi184.stdout:3/562: rmdir d1/d4/d6/d1f/d26 39 2024-02-28T23:07:35.433 INFO:tasks.workunit.client.1.smithi184.stdout:1/584: write d20/d32/d3e/d91/faa [876302,84070] 0 2024-02-28T23:07:35.433 INFO:tasks.workunit.client.0.smithi159.stdout:8/969: mknod d2/d11/d52/d26/d36/d38/d77/d79/dd7/c132 0 2024-02-28T23:07:35.435 INFO:tasks.workunit.client.0.smithi159.stdout:9/851: dread d4/d52/f57 [0,4194304] 0 2024-02-28T23:07:35.436 INFO:tasks.workunit.client.0.smithi159.stdout:1/893: mknod d6/d1d/d46/df9/d105/c131 0 2024-02-28T23:07:35.436 INFO:tasks.workunit.client.1.smithi184.stdout:7/504: rmdir d6/d9/d13/d3e/dad/d49/da6 39 2024-02-28T23:07:35.443 INFO:tasks.workunit.client.1.smithi184.stdout:8/549: dwrite d1/f86 [0,4194304] 0 2024-02-28T23:07:35.447 INFO:tasks.workunit.client.1.smithi184.stdout:9/518: rename d5/db/de/f6d to d5/d47/d68/d7c/fa8 0 2024-02-28T23:07:35.452 INFO:tasks.workunit.client.0.smithi159.stdout:3/806: creat d0/d2b/d4f/fff x:0 0 0 2024-02-28T23:07:35.454 INFO:tasks.workunit.client.1.smithi184.stdout:2/511: creat d10/d1f/d21/d5e/d15/d24/fa5 x:0 0 0 2024-02-28T23:07:35.455 INFO:tasks.workunit.client.0.smithi159.stdout:8/970: truncate d2/d11/d74/ddb/ff8 699435 0 2024-02-28T23:07:35.459 INFO:tasks.workunit.client.0.smithi159.stdout:1/894: truncate d6/d12/d33/faf 3277010 0 2024-02-28T23:07:35.464 INFO:tasks.workunit.client.1.smithi184.stdout:5/530: link db/d12/f47 db/d12/d50/fac 0 2024-02-28T23:07:35.466 INFO:tasks.workunit.client.0.smithi159.stdout:2/768: getdents d9/d36/dc3 0 2024-02-28T23:07:35.469 INFO:tasks.workunit.client.1.smithi184.stdout:1/585: rmdir d20/d32/d3e/d82/d85 39 2024-02-28T23:07:35.471 INFO:tasks.workunit.client.1.smithi184.stdout:0/562: rename d0/l1b to d0/d7c/d8a/lc7 0 2024-02-28T23:07:35.471 INFO:tasks.workunit.client.0.smithi159.stdout:4/963: dwrite d9/f8c [0,4194304] 0 2024-02-28T23:07:35.471 INFO:tasks.workunit.client.0.smithi159.stdout:3/807: dread - d0/d3f/f8d zero size 2024-02-28T23:07:35.473 INFO:tasks.workunit.client.0.smithi159.stdout:4/964: chown d9/d4c/d6c 26 1 2024-02-28T23:07:35.474 INFO:tasks.workunit.client.1.smithi184.stdout:6/480: link dc/de/d2a/d5c/d79/l84 dc/de/d56/l91 0 2024-02-28T23:07:35.476 INFO:tasks.workunit.client.1.smithi184.stdout:6/481: write dc/de/f5a [2887,33274] 0 2024-02-28T23:07:35.479 INFO:tasks.workunit.client.0.smithi159.stdout:9/852: rename d4/d3d/d3e/d55/d37/d62/d107/lb7 to d4/d3d/d3e/dad/l10c 0 2024-02-28T23:07:35.481 INFO:tasks.workunit.client.0.smithi159.stdout:7/732: write d5/d16/d1a/f96 [408842,114018] 0 2024-02-28T23:07:35.494 INFO:tasks.workunit.client.0.smithi159.stdout:8/971: dread - d2/d11/d52/d26/d36/d38/d77/d9e/dc1/df7/d102/f117 zero size 2024-02-28T23:07:35.494 INFO:tasks.workunit.client.1.smithi184.stdout:2/512: dread d10/f16 [0,4194304] 0 2024-02-28T23:07:35.495 INFO:tasks.workunit.client.1.smithi184.stdout:6/482: dwrite dc/de/d56/f7d [0,4194304] 0 2024-02-28T23:07:35.496 INFO:tasks.workunit.client.0.smithi159.stdout:4/965: stat d9/d4c/d6c/fbb 0 2024-02-28T23:07:35.496 INFO:tasks.workunit.client.0.smithi159.stdout:1/895: write d6/d1d/d46/d88/db4/ddb/d101/fd9 [4453,30794] 0 2024-02-28T23:07:35.496 INFO:tasks.workunit.client.1.smithi184.stdout:0/563: read d0/d7c/f7f [254537,81161] 0 2024-02-28T23:07:35.499 INFO:tasks.workunit.client.1.smithi184.stdout:8/550: truncate d1/da/dc/d16/d32/f9f 4006758 0 2024-02-28T23:07:35.500 INFO:tasks.workunit.client.1.smithi184.stdout:2/513: write d10/d1f/d21/d5e/d15/d60/d66/f6b [779975,108519] 0 2024-02-28T23:07:35.502 INFO:tasks.workunit.client.1.smithi184.stdout:9/519: dwrite d5/d47/d68/f75 [0,4194304] 0 2024-02-28T23:07:35.504 INFO:tasks.workunit.client.1.smithi184.stdout:9/520: chown c2 670665 1 2024-02-28T23:07:35.507 INFO:tasks.workunit.client.0.smithi159.stdout:7/733: rename d5/d16/d1a/d27/d75/lbb to d5/d16/d1a/d27/d46/d65/d81/d98/lea 0 2024-02-28T23:07:35.513 INFO:tasks.workunit.client.0.smithi159.stdout:2/769: dwrite d9/d50/d54/d84/d37/d5c/f99 [0,4194304] 0 2024-02-28T23:07:35.514 INFO:tasks.workunit.client.0.smithi159.stdout:4/966: mknod d9/d20/d87/c152 0 2024-02-28T23:07:35.515 INFO:tasks.workunit.client.1.smithi184.stdout:8/551: symlink d1/da/d33/lce 0 2024-02-28T23:07:35.518 INFO:tasks.workunit.client.1.smithi184.stdout:8/552: chown d1/da/dc/d16/d29/f72 125966 1 2024-02-28T23:07:35.518 INFO:tasks.workunit.client.1.smithi184.stdout:2/514: dwrite d10/d1f/d21/d4d/d67/f95 [0,4194304] 0 2024-02-28T23:07:35.519 INFO:tasks.workunit.client.0.smithi159.stdout:9/853: truncate d4/d3d/d3e/d55/f29 552708 0 2024-02-28T23:07:35.519 INFO:tasks.workunit.client.1.smithi184.stdout:0/564: creat d0/df/d13/d27/d31/d5b/d8e/d91/d71/fc8 x:0 0 0 2024-02-28T23:07:35.520 INFO:tasks.workunit.client.1.smithi184.stdout:0/565: stat d0/d7c/d8a 0 2024-02-28T23:07:35.524 INFO:tasks.workunit.client.1.smithi184.stdout:7/505: rename d6/d9/d13/d14/d45/f84 to d6/d9/fb3 0 2024-02-28T23:07:35.529 INFO:tasks.workunit.client.1.smithi184.stdout:3/563: write d1/d4/d6/d1f/d26/d3a/d59/d67/f86 [1896491,111482] 0 2024-02-28T23:07:35.539 INFO:tasks.workunit.client.0.smithi159.stdout:3/808: write d0/d6/f13 [341517,116218] 0 2024-02-28T23:07:35.543 INFO:tasks.workunit.client.1.smithi184.stdout:9/521: creat d5/db/de/d10/d12/d2f/d3f/d8d/fa9 x:0 0 0 2024-02-28T23:07:35.543 INFO:tasks.workunit.client.0.smithi159.stdout:8/972: write d2/d11/d52/d26/d36/d38/d77/fca [30092,95848] 0 2024-02-28T23:07:35.544 INFO:tasks.workunit.client.1.smithi184.stdout:9/522: write d5/db/f42 [7437006,126451] 0 2024-02-28T23:07:35.545 INFO:tasks.workunit.client.1.smithi184.stdout:2/515: rmdir d10/d1f/d38/d54/d96 39 2024-02-28T23:07:35.547 INFO:tasks.workunit.client.0.smithi159.stdout:3/809: dread d0/d2b/d55/df8/d2f/f4b [4194304,4194304] 0 2024-02-28T23:07:35.549 INFO:tasks.workunit.client.1.smithi184.stdout:0/566: creat d0/df/d13/d5a/fc9 x:0 0 0 2024-02-28T23:07:35.554 INFO:tasks.workunit.client.1.smithi184.stdout:7/506: truncate d6/d9/f4e 4842245 0 2024-02-28T23:07:35.556 INFO:tasks.workunit.client.1.smithi184.stdout:1/586: sync 2024-02-28T23:07:35.557 INFO:tasks.workunit.client.1.smithi184.stdout:6/483: creat dc/d60/f92 x:0 0 0 2024-02-28T23:07:35.559 INFO:tasks.workunit.client.0.smithi159.stdout:4/967: write d9/d20/d87/d115/d1c/dad/f101 [589812,37998] 0 2024-02-28T23:07:35.564 INFO:tasks.workunit.client.1.smithi184.stdout:9/523: chown d5/d47/d68/d7c/fa8 16490554 1 2024-02-28T23:07:35.565 INFO:tasks.workunit.client.1.smithi184.stdout:8/553: dwrite d1/da/f1a [0,4194304] 0 2024-02-28T23:07:35.567 INFO:tasks.workunit.client.1.smithi184.stdout:2/516: symlink d10/d1f/d21/d4d/d67/d65/la6 0 2024-02-28T23:07:35.567 INFO:tasks.workunit.client.0.smithi159.stdout:7/734: rename d5/d10 to d5/d16/d1a/d27/deb 0 2024-02-28T23:07:35.568 INFO:tasks.workunit.client.1.smithi184.stdout:2/517: chown d10/d1f/d38/d54/f8e 25240 1 2024-02-28T23:07:35.570 INFO:tasks.workunit.client.1.smithi184.stdout:0/567: creat d0/df/d13/d27/d31/d5b/d8e/da3/fca x:0 0 0 2024-02-28T23:07:35.570 INFO:tasks.workunit.client.1.smithi184.stdout:2/518: readlink d10/d1f/d21/d5e/d15/d60/d66/l8b 0 2024-02-28T23:07:35.571 INFO:tasks.workunit.client.1.smithi184.stdout:2/519: chown d10/d55 1926 1 2024-02-28T23:07:35.571 INFO:tasks.workunit.client.0.smithi159.stdout:7/735: write d5/d56/d50/daa/fa4 [4572535,43213] 0 2024-02-28T23:07:35.572 INFO:tasks.workunit.client.1.smithi184.stdout:0/568: read - d0/df/d13/d5a/d95/f99 zero size 2024-02-28T23:07:35.572 INFO:tasks.workunit.client.1.smithi184.stdout:2/520: chown d10/d33 127277 1 2024-02-28T23:07:35.573 INFO:tasks.workunit.client.0.smithi159.stdout:1/896: getdents d6/d1d 0 2024-02-28T23:07:35.574 INFO:tasks.workunit.client.1.smithi184.stdout:4/515: rename d1/dc/df/d38/d57/c7c to d1/dc/df/d3b/c93 0 2024-02-28T23:07:35.574 INFO:tasks.workunit.client.1.smithi184.stdout:0/569: chown d0/df/d13/d27/d31/d5b/d8e 63940 1 2024-02-28T23:07:35.577 INFO:tasks.workunit.client.0.smithi159.stdout:2/770: creat d9/d50/d54/d84/d37/f10b x:0 0 0 2024-02-28T23:07:35.577 INFO:tasks.workunit.client.1.smithi184.stdout:7/507: mknod d6/d9/d13/d3e/dad/d7d/d6c/cb4 0 2024-02-28T23:07:35.579 INFO:tasks.workunit.client.1.smithi184.stdout:1/587: mknod d20/d32/d3e/d61/d8b/cca 0 2024-02-28T23:07:35.582 INFO:tasks.workunit.client.1.smithi184.stdout:7/508: chown d6/d9/d13/d3e/l6e 27 1 2024-02-28T23:07:35.582 INFO:tasks.workunit.client.0.smithi159.stdout:9/854: dwrite d4/d3d/d3e/d55/d37/d62/d107/dc1/fc4 [0,4194304] 0 2024-02-28T23:07:35.583 INFO:tasks.workunit.client.1.smithi184.stdout:3/564: fsync d1/d4/d1c/f31 0 2024-02-28T23:07:35.583 INFO:tasks.workunit.client.1.smithi184.stdout:1/588: write d20/d32/d3e/d91/faa [1996664,5828] 0 2024-02-28T23:07:35.583 INFO:tasks.workunit.client.1.smithi184.stdout:1/589: stat fa 0 2024-02-28T23:07:35.586 INFO:tasks.workunit.client.1.smithi184.stdout:9/524: truncate d5/db/de/d10/f30 69662 0 2024-02-28T23:07:35.587 INFO:tasks.workunit.client.0.smithi159.stdout:1/897: unlink d6/d12/d33/d3c/c4d 0 2024-02-28T23:07:35.589 INFO:tasks.workunit.client.1.smithi184.stdout:9/525: fdatasync d5/db/de/d10/d12/d2f/d3f/d8d/fa9 0 2024-02-28T23:07:35.594 INFO:tasks.workunit.client.1.smithi184.stdout:4/516: symlink d1/d8/d19/d92/l94 0 2024-02-28T23:07:35.595 INFO:tasks.workunit.client.0.smithi159.stdout:8/973: link d2/d11/d52/d47/cb0 d2/d11/d52/d26/d36/d38/d77/d9e/dc1/df7/d102/c133 0 2024-02-28T23:07:35.599 INFO:tasks.workunit.client.0.smithi159.stdout:1/898: truncate d6/d12/d1a/fe1 192018 0 2024-02-28T23:07:35.600 INFO:tasks.workunit.client.0.smithi159.stdout:3/810: dread d0/d6/d34/f62 [0,4194304] 0 2024-02-28T23:07:35.603 INFO:tasks.workunit.client.0.smithi159.stdout:4/968: rename d9/d4c/d6c/d98/d150/fff to d9/d42/d54/d56/f153 0 2024-02-28T23:07:35.605 INFO:tasks.workunit.client.1.smithi184.stdout:7/509: chown d6/d9/d13/d3e/dad/d49/da6/daf/l86 775 1 2024-02-28T23:07:35.608 INFO:tasks.workunit.client.1.smithi184.stdout:3/565: mkdir d1/d4/d1c/d62/d66/dab 0 2024-02-28T23:07:35.609 INFO:tasks.workunit.client.1.smithi184.stdout:8/554: creat d1/da/df/d20/dc7/fcf x:0 0 0 2024-02-28T23:07:35.613 INFO:tasks.workunit.client.1.smithi184.stdout:6/484: symlink dc/de/d2a/d5c/l93 0 2024-02-28T23:07:35.618 INFO:tasks.workunit.client.0.smithi159.stdout:3/811: mknod d0/d3f/dd2/d63/c100 0 2024-02-28T23:07:35.618 INFO:tasks.workunit.client.1.smithi184.stdout:5/531: rename db/l41 to db/d12/d50/d9e/lad 0 2024-02-28T23:07:35.619 INFO:tasks.workunit.client.0.smithi159.stdout:2/771: rename d9/d23/d2c/f108 to d9/d50/d62/f10c 0 2024-02-28T23:07:35.619 INFO:tasks.workunit.client.0.smithi159.stdout:8/974: symlink d2/d11/d52/d47/db6/dba/d12a/l134 0 2024-02-28T23:07:35.620 INFO:tasks.workunit.client.1.smithi184.stdout:0/570: write d0/df/d13/d27/d58/f87 [366663,97736] 0 2024-02-28T23:07:35.620 INFO:tasks.workunit.client.1.smithi184.stdout:9/526: creat d5/db/de/d10/d6a/faa x:0 0 0 2024-02-28T23:07:35.622 INFO:tasks.workunit.client.0.smithi159.stdout:4/969: mkdir d9/d20/d87/d115/d1c/dc3/d154 0 2024-02-28T23:07:35.624 INFO:tasks.workunit.client.0.smithi159.stdout:1/899: rmdir d6/d1d/d1f/db8/dcc/d121 39 2024-02-28T23:07:35.628 INFO:tasks.workunit.client.1.smithi184.stdout:3/566: fdatasync d1/d4/d6/d1f/d24/f88 0 2024-02-28T23:07:35.629 INFO:tasks.workunit.client.0.smithi159.stdout:7/736: dwrite d5/d16/d1a/d27/d46/f61 [4194304,4194304] 0 2024-02-28T23:07:35.630 INFO:tasks.workunit.client.1.smithi184.stdout:8/555: fsync d1/da/d10/d17/d63/f69 0 2024-02-28T23:07:35.638 INFO:tasks.workunit.client.1.smithi184.stdout:6/485: creat dc/de/d2a/f94 x:0 0 0 2024-02-28T23:07:35.639 INFO:tasks.workunit.client.1.smithi184.stdout:0/571: dwrite d0/fad [0,4194304] 0 2024-02-28T23:07:35.641 INFO:tasks.workunit.client.1.smithi184.stdout:0/572: fdatasync d0/f37 0 2024-02-28T23:07:35.642 INFO:tasks.workunit.client.0.smithi159.stdout:1/900: dwrite d6/d12/d1a/fa3 [0,4194304] 0 2024-02-28T23:07:35.643 INFO:tasks.workunit.client.1.smithi184.stdout:7/510: write d6/d9/d13/d3e/dad/f77 [1390607,104464] 0 2024-02-28T23:07:35.644 INFO:tasks.workunit.client.1.smithi184.stdout:2/521: creat d10/fa7 x:0 0 0 2024-02-28T23:07:35.645 INFO:tasks.workunit.client.0.smithi159.stdout:1/901: write d6/d12/f9a [2405259,116530] 0 2024-02-28T23:07:35.647 INFO:tasks.workunit.client.0.smithi159.stdout:8/975: write d2/d11/d52/d26/f5a [1280064,10668] 0 2024-02-28T23:07:35.648 INFO:tasks.workunit.client.1.smithi184.stdout:9/527: dread d5/d26/d50/f3b [0,4194304] 0 2024-02-28T23:07:35.648 INFO:tasks.workunit.client.1.smithi184.stdout:1/590: rename d20/d32/d3e/f4a to d20/d32/db0/fcb 0 2024-02-28T23:07:35.648 INFO:tasks.workunit.client.1.smithi184.stdout:5/532: unlink db/d12/l9a 0 2024-02-28T23:07:35.652 INFO:tasks.workunit.client.1.smithi184.stdout:5/533: truncate db/d90/f86 744616 0 2024-02-28T23:07:35.652 INFO:tasks.workunit.client.1.smithi184.stdout:1/591: dread d20/f76 [0,4194304] 0 2024-02-28T23:07:35.654 INFO:tasks.workunit.client.0.smithi159.stdout:1/902: chown d6/d1d/d1f/db8/dcc/d121 623419186 1 2024-02-28T23:07:35.655 INFO:tasks.workunit.client.1.smithi184.stdout:8/556: unlink d1/da/dc/d16/d4d/d82/cab 0 2024-02-28T23:07:35.657 INFO:tasks.workunit.client.0.smithi159.stdout:1/903: read - d6/d1d/d46/df9/d105/f114 zero size 2024-02-28T23:07:35.660 INFO:tasks.workunit.client.0.smithi159.stdout:2/772: dwrite d9/d23/d2c/d55/fcf [0,4194304] 0 2024-02-28T23:07:35.662 INFO:tasks.workunit.client.1.smithi184.stdout:5/534: stat db/cf 0 2024-02-28T23:07:35.662 INFO:tasks.workunit.client.1.smithi184.stdout:0/573: dwrite d0/d1d/f4d [4194304,4194304] 0 2024-02-28T23:07:35.664 INFO:tasks.workunit.client.1.smithi184.stdout:4/517: sync 2024-02-28T23:07:35.664 INFO:tasks.workunit.client.1.smithi184.stdout:9/528: write d5/db/de/d10/d12/d2f/d7d/fa2 [812525,103892] 0 2024-02-28T23:07:35.666 INFO:tasks.workunit.client.0.smithi159.stdout:4/970: link d9/d4c/d6c/d98/df2/c131 d9/d20/c155 0 2024-02-28T23:07:35.668 INFO:tasks.workunit.client.0.smithi159.stdout:1/904: rmdir d6/d12/d31/d69/dc0 39 2024-02-28T23:07:35.670 INFO:tasks.workunit.client.1.smithi184.stdout:3/567: symlink d1/d4/d5/lac 0 2024-02-28T23:07:35.672 INFO:tasks.workunit.client.1.smithi184.stdout:8/557: chown d1/da/dc/d16/d4d/d82/l96 1 1 2024-02-28T23:07:35.673 INFO:tasks.workunit.client.0.smithi159.stdout:2/773: mknod d9/d50/d62/dba/c10d 0 2024-02-28T23:07:35.674 INFO:tasks.workunit.client.1.smithi184.stdout:7/511: getdents d6/d9/d13/d3e/dad/d49/d50/db2 0 2024-02-28T23:07:35.680 INFO:tasks.workunit.client.1.smithi184.stdout:2/522: dwrite d10/f43 [0,4194304] 0 2024-02-28T23:07:35.681 INFO:tasks.workunit.client.0.smithi159.stdout:4/971: rename d9/f8c to d9/d20/d87/d115/d1c/d8e/d143/f156 0 2024-02-28T23:07:35.681 INFO:tasks.workunit.client.1.smithi184.stdout:2/523: chown d10/d1f/d21/d5e/d15/d60 2391629 1 2024-02-28T23:07:35.686 INFO:tasks.workunit.client.0.smithi159.stdout:4/972: write d9/d20/d87/d115/d1c/f86 [3920834,11122] 0 2024-02-28T23:07:35.692 INFO:tasks.workunit.client.1.smithi184.stdout:0/574: mkdir d0/df/d13/d27/d31/d5b/d8e/d91/dcb 0 2024-02-28T23:07:35.692 INFO:tasks.workunit.client.0.smithi159.stdout:1/905: dwrite d6/d12/d33/da7/ff7 [4194304,4194304] 0 2024-02-28T23:07:35.694 INFO:tasks.workunit.client.1.smithi184.stdout:2/524: dwrite d10/d1f/d21/d5e/f58 [0,4194304] 0 2024-02-28T23:07:35.695 INFO:tasks.workunit.client.0.smithi159.stdout:1/906: fsync d6/d12/f9a 0 2024-02-28T23:07:35.697 INFO:tasks.workunit.client.0.smithi159.stdout:1/907: stat d6/d12 0 2024-02-28T23:07:35.703 INFO:tasks.workunit.client.1.smithi184.stdout:6/486: creat dc/de/d2a/d5c/f95 x:0 0 0 2024-02-28T23:07:35.703 INFO:tasks.workunit.client.1.smithi184.stdout:1/592: write d20/f50 [604370,58274] 0 2024-02-28T23:07:35.705 INFO:tasks.workunit.client.1.smithi184.stdout:3/568: symlink d1/d4/d1c/d61/lad 0 2024-02-28T23:07:35.710 INFO:tasks.workunit.client.1.smithi184.stdout:8/558: rmdir d1/da/df/d20/dc7 39 2024-02-28T23:07:35.710 INFO:tasks.workunit.client.1.smithi184.stdout:3/569: truncate d1/d4/f7c 1088431 0 2024-02-28T23:07:35.711 INFO:tasks.workunit.client.1.smithi184.stdout:0/575: dwrite d0/df/d13/d27/d31/db3/f66 [0,4194304] 0 2024-02-28T23:07:35.711 INFO:tasks.workunit.client.0.smithi159.stdout:8/976: truncate d2/d11/d52/d6e/f114 3052467 0 2024-02-28T23:07:35.716 INFO:tasks.workunit.client.1.smithi184.stdout:7/512: rmdir d6/d9/d13/d14/d45 39 2024-02-28T23:07:35.716 INFO:tasks.workunit.client.1.smithi184.stdout:0/576: chown d0/df/d13/d27/d31/d5b/d8e/d91/l62 6 1 2024-02-28T23:07:35.719 INFO:tasks.workunit.client.1.smithi184.stdout:7/513: write d6/d9/d13/d3e/dad/d49/f95 [829336,24857] 0 2024-02-28T23:07:35.720 INFO:tasks.workunit.client.1.smithi184.stdout:0/577: dread - d0/df/d13/d27/d31/d5b/d8e/d91/fa6 zero size 2024-02-28T23:07:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:35 smithi159 ceph-mon[28802]: pgmap v36: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 206 MiB/s wr, 460 op/s 2024-02-28T23:07:35.725 INFO:tasks.workunit.client.0.smithi159.stdout:8/977: dread d2/d11/d52/f62 [0,4194304] 0 2024-02-28T23:07:35.725 INFO:tasks.workunit.client.0.smithi159.stdout:4/973: write d9/d42/d54/d9c/fa3 [2037256,112893] 0 2024-02-28T23:07:35.730 INFO:tasks.workunit.client.1.smithi184.stdout:6/487: creat dc/de/d10/d16/f96 x:0 0 0 2024-02-28T23:07:35.731 INFO:tasks.workunit.client.1.smithi184.stdout:3/570: symlink d1/d4/d5/d40/lae 0 2024-02-28T23:07:35.732 INFO:tasks.workunit.client.1.smithi184.stdout:8/559: mknod d1/da/dc/d16/d32/d80/cd0 0 2024-02-28T23:07:35.733 INFO:tasks.workunit.client.1.smithi184.stdout:0/578: creat d0/df/d13/d27/d31/d5b/d8e/d92/fcc x:0 0 0 2024-02-28T23:07:35.734 INFO:tasks.workunit.client.1.smithi184.stdout:7/514: symlink d6/d9/lb5 0 2024-02-28T23:07:35.736 INFO:tasks.workunit.client.1.smithi184.stdout:0/579: write d0/df/d13/d27/d31/d5b/d8e/d92/fc1 [981302,42074] 0 2024-02-28T23:07:35.737 INFO:tasks.workunit.client.0.smithi159.stdout:2/774: dwrite d9/d23/d2c/d55/d13/d4f/f52 [0,4194304] 0 2024-02-28T23:07:35.739 INFO:tasks.workunit.client.1.smithi184.stdout:0/580: write d0/d1d/f6d [401965,20232] 0 2024-02-28T23:07:35.741 INFO:tasks.workunit.client.0.smithi159.stdout:8/978: rename d2/d11/d35/d5f/f113 to d2/d11/d52/d26/d36/d38/f135 0 2024-02-28T23:07:35.749 INFO:tasks.workunit.client.1.smithi184.stdout:8/560: rename d1/da/dc/d16/d29/fb9 to d1/da/dc/d16/d4d/d82/fd1 0 2024-02-28T23:07:35.750 INFO:tasks.workunit.client.1.smithi184.stdout:9/529: dread d5/db/de/d10/f2b [0,4194304] 0 2024-02-28T23:07:35.751 INFO:tasks.workunit.client.0.smithi159.stdout:2/775: truncate d9/d23/d2c/d55/f29 3687314 0 2024-02-28T23:07:35.752 INFO:tasks.workunit.client.1.smithi184.stdout:9/530: chown c3 134459 1 2024-02-28T23:07:35.753 INFO:tasks.workunit.client.1.smithi184.stdout:5/535: write f8 [1500416,68842] 0 2024-02-28T23:07:35.755 INFO:tasks.workunit.client.0.smithi159.stdout:8/979: dread d2/d11/d52/d26/d36/d38/ff3 [0,4194304] 0 2024-02-28T23:07:35.758 INFO:tasks.workunit.client.1.smithi184.stdout:0/581: unlink d0/df/d13/d27/d31/db3/f44 0 2024-02-28T23:07:35.762 INFO:tasks.workunit.client.0.smithi159.stdout:1/908: dwrite d6/d12/d33/d48/f98 [0,4194304] 0 2024-02-28T23:07:35.762 INFO:tasks.workunit.client.1.smithi184.stdout:0/582: read d0/df/d13/d27/d31/d51/f8d [802288,39608] 0 2024-02-28T23:07:35.763 INFO:tasks.workunit.client.1.smithi184.stdout:4/518: dwrite d1/d8/d37/f60 [0,4194304] 0 2024-02-28T23:07:35.767 INFO:tasks.workunit.client.0.smithi159.stdout:4/974: rename d9/d20/d87/d115/d1c/d8e/ddc/dc9/c142 to d9/d20/d87/d115/d1c/c157 0 2024-02-28T23:07:35.767 INFO:tasks.workunit.client.1.smithi184.stdout:6/488: truncate dc/de/f29 3311164 0 2024-02-28T23:07:35.767 INFO:tasks.workunit.client.1.smithi184.stdout:1/593: dwrite d20/f76 [0,4194304] 0 2024-02-28T23:07:35.772 INFO:tasks.workunit.client.1.smithi184.stdout:2/525: dread d10/d1f/f32 [0,4194304] 0 2024-02-28T23:07:35.780 INFO:tasks.workunit.client.0.smithi159.stdout:1/909: mkdir d6/d12/d31/d69/dc0/d132 0 2024-02-28T23:07:35.784 INFO:tasks.workunit.client.0.smithi159.stdout:1/910: write d6/d1d/d46/d88/dd3/d9c/fc2 [1818575,4616] 0 2024-02-28T23:07:35.786 INFO:tasks.workunit.client.0.smithi159.stdout:1/911: write d6/d12/d1a/d92/d97/f10f [768522,9780] 0 2024-02-28T23:07:35.792 INFO:tasks.workunit.client.0.smithi159.stdout:2/776: rename d9/d50/d54/f8e to d9/d50/d62/dba/d105/f10e 0 2024-02-28T23:07:35.792 INFO:tasks.workunit.client.0.smithi159.stdout:4/975: dread d9/d20/f89 [0,4194304] 0 2024-02-28T23:07:35.801 INFO:tasks.workunit.client.0.smithi159.stdout:8/980: dwrite d2/d11/f1b [0,4194304] 0 2024-02-28T23:07:35.804 INFO:tasks.workunit.client.0.smithi159.stdout:2/777: creat d9/d36/d59/f10f x:0 0 0 2024-02-28T23:07:35.815 INFO:tasks.workunit.client.0.smithi159.stdout:4/976: rename d9/d20/d87/d115/f13 to d9/d42/f158 0 2024-02-28T23:07:35.823 INFO:tasks.workunit.client.0.smithi159.stdout:4/977: mknod d9/d20/d87/d115/d1c/d23/d7a/d10d/c159 0 2024-02-28T23:07:35.829 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:35 smithi184 ceph-mon[36198]: pgmap v36: 65 pgs: 65 active+clean; 2.7 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 73 MiB/s rd, 206 MiB/s wr, 460 op/s 2024-02-28T23:07:35.833 INFO:tasks.workunit.client.1.smithi184.stdout:7/515: mknod d6/d9/d13/d3e/dad/d49/da6/daf/cb6 0 2024-02-28T23:07:35.834 INFO:tasks.workunit.client.1.smithi184.stdout:7/516: chown d6/f8e 404 1 2024-02-28T23:07:35.836 INFO:tasks.workunit.client.0.smithi159.stdout:1/912: dread d6/d12/d33/d3c/f8d [0,4194304] 0 2024-02-28T23:07:35.838 INFO:tasks.workunit.client.1.smithi184.stdout:8/561: rename d1/da/d33/lce to d1/da/dc/d18/ld2 0 2024-02-28T23:07:35.841 INFO:tasks.workunit.client.0.smithi159.stdout:2/778: dread d9/d50/dcc/d44/dc0/dda/f103 [0,4194304] 0 2024-02-28T23:07:35.841 INFO:tasks.workunit.client.1.smithi184.stdout:9/531: truncate d5/db/de/d10/f2b 4373991 0 2024-02-28T23:07:35.842 INFO:tasks.workunit.client.0.smithi159.stdout:1/913: creat d6/d12/d31/d5a/f133 x:0 0 0 2024-02-28T23:07:35.845 INFO:tasks.workunit.client.0.smithi159.stdout:1/914: chown d6/d12/d16/f24 28072 1 2024-02-28T23:07:35.854 INFO:tasks.workunit.client.0.smithi159.stdout:8/981: dwrite d2/d73/dc2/fae [0,4194304] 0 2024-02-28T23:07:35.857 INFO:tasks.workunit.client.0.smithi159.stdout:1/915: mkdir d6/d1d/d46/d88/dd3/d134 0 2024-02-28T23:07:35.859 INFO:tasks.workunit.client.1.smithi184.stdout:3/571: getdents d1/d4/d6/d1f 0 2024-02-28T23:07:35.860 INFO:tasks.workunit.client.1.smithi184.stdout:8/562: fdatasync d1/da/dc/d18/f19 0 2024-02-28T23:07:35.866 INFO:tasks.workunit.client.1.smithi184.stdout:4/519: getdents d1/d29 0 2024-02-28T23:07:35.867 INFO:tasks.workunit.client.1.smithi184.stdout:7/517: dread d6/d9/d13/d3e/dad/d49/da6/daf/d65/f83 [0,4194304] 0 2024-02-28T23:07:35.869 INFO:tasks.workunit.client.0.smithi159.stdout:4/978: dwrite d9/d4c/d6c/d98/fe2 [0,4194304] 0 2024-02-28T23:07:35.871 INFO:tasks.workunit.client.1.smithi184.stdout:0/583: link d0/d1d/f3d d0/df/d13/d27/d31/d5b/d8e/d92/fcd 0 2024-02-28T23:07:35.871 INFO:tasks.workunit.client.1.smithi184.stdout:7/518: chown d6/d9/d13/d3e/dad/laa 92477819 1 2024-02-28T23:07:35.872 INFO:tasks.workunit.client.0.smithi159.stdout:1/916: truncate d6/d1d/d46/d88/dd3/d9c/db3/fd2 770678 0 2024-02-28T23:07:35.873 INFO:tasks.workunit.client.0.smithi159.stdout:2/779: write d9/d50/d62/fdd [932841,17494] 0 2024-02-28T23:07:35.875 INFO:tasks.workunit.client.0.smithi159.stdout:8/982: dwrite d2/d11/d52/d26/d36/d38/d77/dc5/f11a [0,4194304] 0 2024-02-28T23:07:35.879 INFO:tasks.workunit.client.1.smithi184.stdout:5/536: dwrite db/d12/d1c/d21/d2f/f4e [0,4194304] 0 2024-02-28T23:07:35.880 INFO:tasks.workunit.client.0.smithi159.stdout:1/917: creat d6/d1d/d1f/f135 x:0 0 0 2024-02-28T23:07:35.885 INFO:tasks.workunit.client.0.smithi159.stdout:4/979: rename d9/d20/d87/d115/dc5/f144 to d9/d20/d87/d115/dc5/d13c/f15a 0 2024-02-28T23:07:35.887 INFO:tasks.workunit.client.1.smithi184.stdout:4/520: creat d1/d4/f95 x:0 0 0 2024-02-28T23:07:35.888 INFO:tasks.workunit.client.1.smithi184.stdout:6/489: creat dc/f97 x:0 0 0 2024-02-28T23:07:35.889 INFO:tasks.workunit.client.0.smithi159.stdout:8/983: read d2/d11/d52/d26/d36/d38/f39 [2687869,92027] 0 2024-02-28T23:07:35.890 INFO:tasks.workunit.client.1.smithi184.stdout:1/594: dread d20/d32/d3e/d82/d85/d8c/fb5 [4194304,4194304] 0 2024-02-28T23:07:35.891 INFO:tasks.workunit.client.1.smithi184.stdout:7/519: symlink d6/d9/d13/d3e/dad/d7d/d8d/lb7 0 2024-02-28T23:07:35.893 INFO:tasks.workunit.client.1.smithi184.stdout:6/490: truncate dc/d60/f92 538969 0 2024-02-28T23:07:35.894 INFO:tasks.workunit.client.0.smithi159.stdout:8/984: truncate d2/d3/f2a 4246043 0 2024-02-28T23:07:35.896 INFO:tasks.workunit.client.1.smithi184.stdout:4/521: truncate d1/d8/f4a 4517345 0 2024-02-28T23:07:35.896 INFO:tasks.workunit.client.0.smithi159.stdout:1/918: creat d6/d1d/d46/d88/db4/f136 x:0 0 0 2024-02-28T23:07:35.897 INFO:tasks.workunit.client.1.smithi184.stdout:0/584: symlink d0/df/d13/d27/d31/d5b/lce 0 2024-02-28T23:07:35.900 INFO:tasks.workunit.client.1.smithi184.stdout:8/563: dwrite d1/da/dc/d16/d32/f46 [0,4194304] 0 2024-02-28T23:07:35.902 INFO:tasks.workunit.client.0.smithi159.stdout:8/985: creat d2/d11/d52/d26/d36/f136 x:0 0 0 2024-02-28T23:07:35.905 INFO:tasks.workunit.client.1.smithi184.stdout:2/526: creat d10/d1f/fa8 x:0 0 0 2024-02-28T23:07:35.905 INFO:tasks.workunit.client.1.smithi184.stdout:9/532: link d5/db/de/d10/d6a/c9c d5/d17/d8f/cab 0 2024-02-28T23:07:35.906 INFO:tasks.workunit.client.1.smithi184.stdout:3/572: mknod d1/d4/d6/d1f/d26/d3a/d59/caf 0 2024-02-28T23:07:35.907 INFO:tasks.workunit.client.0.smithi159.stdout:2/780: write d9/d50/d54/f6c [940425,14175] 0 2024-02-28T23:07:35.910 INFO:tasks.workunit.client.0.smithi159.stdout:4/980: dwrite d9/d20/d87/d115/d1c/d8e/d143/f156 [0,4194304] 0 2024-02-28T23:07:35.910 INFO:tasks.workunit.client.1.smithi184.stdout:5/537: symlink db/d12/d1c/d21/d25/lae 0 2024-02-28T23:07:35.911 INFO:tasks.workunit.client.1.smithi184.stdout:9/533: chown d5/d47/d68/d7c/c8c 28626245 1 2024-02-28T23:07:35.913 INFO:tasks.workunit.client.1.smithi184.stdout:1/595: creat d20/d46/fcc x:0 0 0 2024-02-28T23:07:35.914 INFO:tasks.workunit.client.1.smithi184.stdout:9/534: fsync d5/d26/f78 0 2024-02-28T23:07:35.915 INFO:tasks.workunit.client.0.smithi159.stdout:1/919: creat d6/d12/d31/d69/f137 x:0 0 0 2024-02-28T23:07:35.916 INFO:tasks.workunit.client.1.smithi184.stdout:7/520: symlink d6/d9/d13/d3e/dad/d7d/d6c/lb8 0 2024-02-28T23:07:35.916 INFO:tasks.workunit.client.0.smithi159.stdout:4/981: chown d9/d42/dc8/fd1 0 1 2024-02-28T23:07:35.916 INFO:tasks.workunit.client.1.smithi184.stdout:4/522: mknod d1/dc/df/d3b/d5c/c96 0 2024-02-28T23:07:35.917 INFO:tasks.workunit.client.0.smithi159.stdout:1/920: chown d6/d12/d31/d69/f77 3793 1 2024-02-28T23:07:35.918 INFO:tasks.workunit.client.1.smithi184.stdout:8/564: mknod d1/da/dc/d18/cd3 0 2024-02-28T23:07:35.919 INFO:tasks.workunit.client.1.smithi184.stdout:6/491: dwrite dc/d42/f7e [0,4194304] 0 2024-02-28T23:07:35.919 INFO:tasks.workunit.client.0.smithi159.stdout:2/781: rename d9/d23/d2c/d55/d13/d4f/f52 to d9/d23/de6/f110 0 2024-02-28T23:07:35.920 INFO:tasks.workunit.client.1.smithi184.stdout:3/573: dread - d1/d4/d1c/f6b zero size 2024-02-28T23:07:35.922 INFO:tasks.workunit.client.0.smithi159.stdout:4/982: rmdir d9/d4c/d6c/d98/d103 39 2024-02-28T23:07:35.924 INFO:tasks.workunit.client.0.smithi159.stdout:4/983: chown d9/f1f 1040646 1 2024-02-28T23:07:35.924 INFO:tasks.workunit.client.1.smithi184.stdout:5/538: creat db/d12/d18/faf x:0 0 0 2024-02-28T23:07:35.926 INFO:tasks.workunit.client.0.smithi159.stdout:1/921: rmdir d6/d1d/d1f 39 2024-02-28T23:07:35.929 INFO:tasks.workunit.client.1.smithi184.stdout:1/596: rmdir d20/d32/d3e/d61/d8b/d9c 39 2024-02-28T23:07:35.935 INFO:tasks.workunit.client.0.smithi159.stdout:8/986: getdents d2 0 2024-02-28T23:07:35.935 INFO:tasks.workunit.client.1.smithi184.stdout:4/523: mkdir d1/dc/df/d5b/d97 0 2024-02-28T23:07:35.936 INFO:tasks.workunit.client.1.smithi184.stdout:7/521: dread d6/d9/d13/d3e/f64 [0,4194304] 0 2024-02-28T23:07:35.938 INFO:tasks.workunit.client.1.smithi184.stdout:2/527: symlink d10/d1f/d38/d54/d96/la9 0 2024-02-28T23:07:35.941 INFO:tasks.workunit.client.1.smithi184.stdout:3/574: mknod d1/d4/d5/da9/d74/cb0 0 2024-02-28T23:07:35.942 INFO:tasks.workunit.client.1.smithi184.stdout:3/575: write d1/d4/d1c/f8a [2097072,130348] 0 2024-02-28T23:07:35.944 INFO:tasks.workunit.client.0.smithi159.stdout:4/984: creat d9/d42/d95/f15b x:0 0 0 2024-02-28T23:07:35.948 INFO:tasks.workunit.client.0.smithi159.stdout:2/782: link d9/d50/dcc/lae d9/d50/d62/dba/d105/l111 0 2024-02-28T23:07:35.949 INFO:tasks.workunit.client.0.smithi159.stdout:2/783: stat d9/fff 0 2024-02-28T23:07:35.950 INFO:tasks.workunit.client.1.smithi184.stdout:8/565: symlink d1/ld4 0 2024-02-28T23:07:35.951 INFO:tasks.workunit.client.1.smithi184.stdout:8/566: fdatasync d1/da/dc/d16/fbc 0 2024-02-28T23:07:35.955 INFO:tasks.workunit.client.0.smithi159.stdout:1/922: link d6/d12/d33/d3c/ced d6/d1d/d46/df9/d105/c138 0 2024-02-28T23:07:35.960 INFO:tasks.workunit.client.1.smithi184.stdout:8/567: truncate d1/da/d33/f59 887538 0 2024-02-28T23:07:35.961 INFO:tasks.workunit.client.1.smithi184.stdout:8/568: readlink d1/l14 0 2024-02-28T23:07:35.965 INFO:tasks.workunit.client.1.smithi184.stdout:3/576: mknod d1/d4/d6/d1f/d26/d3a/d59/cb1 0 2024-02-28T23:07:35.966 INFO:tasks.workunit.client.0.smithi159.stdout:1/923: mkdir d6/d1d/d46/d88/dd3/d9c/db3/dc4/ddc/d139 0 2024-02-28T23:07:35.967 INFO:tasks.workunit.client.1.smithi184.stdout:3/577: chown d1/d4/d5/c19 165 1 2024-02-28T23:07:35.967 INFO:tasks.workunit.client.1.smithi184.stdout:5/539: link db/d12/d1c/d21/d4d/ca6 db/d90/cb0 0 2024-02-28T23:07:35.968 INFO:tasks.workunit.client.1.smithi184.stdout:9/535: truncate d5/db/d5c/f84 3929297 0 2024-02-28T23:07:35.969 INFO:tasks.workunit.client.0.smithi159.stdout:4/985: dwrite d9/d42/d95/f15b [0,4194304] 0 2024-02-28T23:07:35.970 INFO:tasks.workunit.client.0.smithi159.stdout:2/784: dread d9/d36/d59/fad [0,4194304] 0 2024-02-28T23:07:35.971 INFO:tasks.workunit.client.1.smithi184.stdout:1/597: write d20/f3a [488851,125973] 0 2024-02-28T23:07:35.972 INFO:tasks.workunit.client.1.smithi184.stdout:4/524: truncate d1/dc/df/f16 8198771 0 2024-02-28T23:07:35.979 INFO:tasks.workunit.client.0.smithi159.stdout:8/987: dread d2/d3/f1f [0,4194304] 0 2024-02-28T23:07:35.982 INFO:tasks.workunit.client.0.smithi159.stdout:1/924: unlink d6/d12/d33/da7/f102 0 2024-02-28T23:07:35.983 INFO:tasks.workunit.client.0.smithi159.stdout:2/785: write d9/d50/dcc/fd5 [99041,3731] 0 2024-02-28T23:07:35.984 INFO:tasks.workunit.client.0.smithi159.stdout:1/925: dread - d6/d12/d16/f11f zero size 2024-02-28T23:07:35.984 INFO:tasks.workunit.client.1.smithi184.stdout:6/492: getdents dc/d60/d62 0 2024-02-28T23:07:35.985 INFO:tasks.workunit.client.1.smithi184.stdout:3/578: rmdir d1/d4/d6/d1f/d24 39 2024-02-28T23:07:35.985 INFO:tasks.workunit.client.1.smithi184.stdout:7/522: dwrite d6/d9/d13/d3e/dad/d7d/d6c/f79 [0,4194304] 0 2024-02-28T23:07:35.985 INFO:tasks.workunit.client.1.smithi184.stdout:1/598: creat d20/d46/fcd x:0 0 0 2024-02-28T23:07:35.985 INFO:tasks.workunit.client.1.smithi184.stdout:4/525: readlink d1/d8/d19/d92/l61 0 2024-02-28T23:07:35.985 INFO:tasks.workunit.client.1.smithi184.stdout:2/528: dwrite d10/d1f/d21/d4d/f50 [0,4194304] 0 2024-02-28T23:07:35.986 INFO:tasks.workunit.client.1.smithi184.stdout:8/569: symlink d1/ld5 0 2024-02-28T23:07:35.986 INFO:tasks.workunit.client.0.smithi159.stdout:2/786: rmdir d9/d36/dc3 39 2024-02-28T23:07:35.988 INFO:tasks.workunit.client.0.smithi159.stdout:4/986: link d9/d20/d87/d115/d1c/cef d9/d20/d87/d115/d1c/d8e/ddc/dc9/c15c 0 2024-02-28T23:07:35.989 INFO:tasks.workunit.client.1.smithi184.stdout:6/493: chown dc/de/d10/d3a 20083 1 2024-02-28T23:07:35.992 INFO:tasks.workunit.client.1.smithi184.stdout:4/526: dread - d1/d8/d37/f75 zero size 2024-02-28T23:07:35.998 INFO:tasks.workunit.client.0.smithi159.stdout:2/787: rename d9/f16 to d9/d50/d54/d84/f112 0 2024-02-28T23:07:35.998 INFO:tasks.workunit.client.0.smithi159.stdout:4/987: stat d9/d42/fc6 0 2024-02-28T23:07:35.998 INFO:tasks.workunit.client.1.smithi184.stdout:1/599: symlink d20/d32/d3e/d9a/lce 0 2024-02-28T23:07:35.999 INFO:tasks.workunit.client.0.smithi159.stdout:8/988: dwrite d2/d3/f14 [0,4194304] 0 2024-02-28T23:07:36.005 INFO:tasks.workunit.client.0.smithi159.stdout:2/788: mkdir d9/d50/d54/d84/d113 0 2024-02-28T23:07:36.005 INFO:tasks.workunit.client.1.smithi184.stdout:1/600: rmdir d20/d46/d90 39 2024-02-28T23:07:36.005 INFO:tasks.workunit.client.1.smithi184.stdout:9/536: dwrite d5/db/de/d10/d12/d2f/f51 [4194304,4194304] 0 2024-02-28T23:07:36.007 INFO:tasks.workunit.client.0.smithi159.stdout:2/789: fdatasync d9/d50/d54/d84/d37/f10b 0 2024-02-28T23:07:36.010 INFO:tasks.workunit.client.1.smithi184.stdout:7/523: dwrite d6/d9/d13/d3e/dad/d49/f95 [0,4194304] 0 2024-02-28T23:07:36.012 INFO:tasks.workunit.client.0.smithi159.stdout:4/988: unlink d9/d20/d87/d115/d1c/d8e/deb/f121 0 2024-02-28T23:07:36.014 INFO:tasks.workunit.client.0.smithi159.stdout:5/852: sync 2024-02-28T23:07:36.014 INFO:tasks.workunit.client.1.smithi184.stdout:0/585: sync 2024-02-28T23:07:36.018 INFO:tasks.workunit.client.1.smithi184.stdout:8/570: dwrite d1/da/d10/d17/d63/f68 [0,4194304] 0 2024-02-28T23:07:36.020 INFO:tasks.workunit.client.1.smithi184.stdout:9/537: creat d5/db/de/d10/fac x:0 0 0 2024-02-28T23:07:36.023 INFO:tasks.workunit.client.0.smithi159.stdout:2/790: rename d9/d50/d62/dba/fd1 to d9/d50/d54/d84/f114 0 2024-02-28T23:07:36.030 INFO:tasks.workunit.client.1.smithi184.stdout:1/601: unlink d20/d32/d3e/d82/d85/d8c/fb5 0 2024-02-28T23:07:36.039 INFO:tasks.workunit.client.1.smithi184.stdout:3/579: dread d1/d4/d6/d1f/d26/d3a/f4d [0,4194304] 0 2024-02-28T23:07:36.039 INFO:tasks.workunit.client.1.smithi184.stdout:9/538: symlink d5/db/de/d10/lad 0 2024-02-28T23:07:36.042 INFO:tasks.workunit.client.1.smithi184.stdout:4/527: truncate d1/d8/d3d/d44/f66 1714653 0 2024-02-28T23:07:36.044 INFO:tasks.workunit.client.1.smithi184.stdout:3/580: dread - d1/d4/d6/d1f/d26/d3a/d59/d67/f6d zero size 2024-02-28T23:07:36.047 INFO:tasks.workunit.client.0.smithi159.stdout:8/989: write d2/d11/d35/d5f/dfe/d68/fb1 [320814,92191] 0 2024-02-28T23:07:36.048 INFO:tasks.workunit.client.1.smithi184.stdout:2/529: dwrite d10/d1f/d21/d5e/f2c [0,4194304] 0 2024-02-28T23:07:36.051 INFO:tasks.workunit.client.1.smithi184.stdout:6/494: dread f3 [0,4194304] 0 2024-02-28T23:07:36.051 INFO:tasks.workunit.client.0.smithi159.stdout:4/989: link d9/d42/d54/d55/da8/f10b d9/d20/d87/d115/d1c/dc3/f15d 0 2024-02-28T23:07:36.052 INFO:tasks.workunit.client.1.smithi184.stdout:8/571: truncate d1/da/dc/d16/d32/d42/f61 4914650 0 2024-02-28T23:07:36.054 INFO:tasks.workunit.client.1.smithi184.stdout:6/495: write dc/de/d10/d16/f96 [553564,23097] 0 2024-02-28T23:07:36.058 INFO:tasks.workunit.client.0.smithi159.stdout:8/990: rename d2/d11/d58 to d2/d11/d52/d47/db6/dba/d12a/d137 0 2024-02-28T23:07:36.059 INFO:tasks.workunit.client.1.smithi184.stdout:9/539: mkdir d5/db/de/d10/d6a/dae 0 2024-02-28T23:07:36.061 INFO:tasks.workunit.client.1.smithi184.stdout:9/540: write d5/db/de/d10/f2a [6525937,85730] 0 2024-02-28T23:07:36.063 INFO:tasks.workunit.client.0.smithi159.stdout:4/990: fsync d9/d20/d87/d115/d1c/d23/f24 0 2024-02-28T23:07:36.064 INFO:tasks.workunit.client.1.smithi184.stdout:7/524: dread d6/d68/f75 [0,4194304] 0 2024-02-28T23:07:36.064 INFO:tasks.workunit.client.1.smithi184.stdout:1/602: creat d20/d46/d90/fcf x:0 0 0 2024-02-28T23:07:36.071 INFO:tasks.workunit.client.1.smithi184.stdout:2/530: creat d10/d1f/d38/d54/d96/faa x:0 0 0 2024-02-28T23:07:36.072 INFO:tasks.workunit.client.0.smithi159.stdout:4/991: chown d9/d20/d87/d115/d1c/d23/d7a/d10d/f14e 110575 1 2024-02-28T23:07:36.073 INFO:tasks.workunit.client.1.smithi184.stdout:5/540: sync 2024-02-28T23:07:36.078 INFO:tasks.workunit.client.1.smithi184.stdout:7/525: dread d6/d9/d13/d3e/dad/d7d/d6c/f79 [0,4194304] 0 2024-02-28T23:07:36.078 INFO:tasks.workunit.client.1.smithi184.stdout:8/572: creat d1/da/dc/d16/d32/d80/fd6 x:0 0 0 2024-02-28T23:07:36.082 INFO:tasks.workunit.client.1.smithi184.stdout:8/573: write d1/da/d10/f2f [1717120,97008] 0 2024-02-28T23:07:36.082 INFO:tasks.workunit.client.1.smithi184.stdout:4/528: dread d1/d8/d35/f42 [0,4194304] 0 2024-02-28T23:07:36.083 INFO:tasks.workunit.client.0.smithi159.stdout:5/853: write d8/d19/d23/f12c [2482636,47739] 0 2024-02-28T23:07:36.086 INFO:tasks.workunit.client.1.smithi184.stdout:9/541: symlink d5/d26/d50/laf 0 2024-02-28T23:07:36.087 INFO:tasks.workunit.client.1.smithi184.stdout:1/603: dread d20/f50 [0,4194304] 0 2024-02-28T23:07:36.088 INFO:tasks.workunit.client.1.smithi184.stdout:0/586: truncate d0/df/d13/d27/d31/d51/f8c 328131 0 2024-02-28T23:07:36.088 INFO:tasks.workunit.client.1.smithi184.stdout:9/542: readlink d5/db/de/d10/d12/d2f/d7d/l8e 0 2024-02-28T23:07:36.089 INFO:tasks.workunit.client.0.smithi159.stdout:2/791: dwrite d9/d23/f6a [0,4194304] 0 2024-02-28T23:07:36.098 INFO:tasks.workunit.client.1.smithi184.stdout:3/581: link d1/d4/d6/d1f/d26/d3a/d59/d67/f86 d1/d4/d6/d1f/d26/d3a/d59/d67/fb2 0 2024-02-28T23:07:36.099 INFO:tasks.workunit.client.1.smithi184.stdout:3/582: readlink d1/d4/d5/l2f 0 2024-02-28T23:07:36.099 INFO:tasks.workunit.client.1.smithi184.stdout:5/541: dread db/d44/f4c [0,4194304] 0 2024-02-28T23:07:36.100 INFO:tasks.workunit.client.0.smithi159.stdout:8/991: write d2/d11/d52/d26/d36/d38/d77/d9e/fc0 [553585,127590] 0 2024-02-28T23:07:36.102 INFO:tasks.workunit.client.1.smithi184.stdout:5/542: stat db/d12/d1c/d80/l8b 0 2024-02-28T23:07:36.102 INFO:tasks.workunit.client.1.smithi184.stdout:9/543: dwrite d5/d26/f55 [4194304,4194304] 0 2024-02-28T23:07:36.109 INFO:tasks.workunit.client.1.smithi184.stdout:2/531: dread d10/d1f/d21/d5e/d15/f2e [0,4194304] 0 2024-02-28T23:07:36.112 INFO:tasks.workunit.client.1.smithi184.stdout:2/532: write d10/d1f/d21/d5e/d15/d24/fa5 [130044,78863] 0 2024-02-28T23:07:36.112 INFO:tasks.workunit.client.1.smithi184.stdout:0/587: rmdir d0/df 39 2024-02-28T23:07:36.123 INFO:tasks.workunit.client.1.smithi184.stdout:6/496: link dc/de/c5b dc/de/d2a/c98 0 2024-02-28T23:07:36.126 INFO:tasks.workunit.client.1.smithi184.stdout:5/543: mknod db/d44/cb1 0 2024-02-28T23:07:36.128 INFO:tasks.workunit.client.1.smithi184.stdout:8/574: mkdir d1/da/dd7 0 2024-02-28T23:07:36.128 INFO:tasks.workunit.client.1.smithi184.stdout:3/583: dread d1/d4/d5/da9/f77 [0,4194304] 0 2024-02-28T23:07:36.129 INFO:tasks.workunit.client.1.smithi184.stdout:9/544: symlink d5/d17/d43/lb0 0 2024-02-28T23:07:36.135 INFO:tasks.workunit.client.1.smithi184.stdout:7/526: write d6/d9/d13/d3e/fa0 [1878285,47620] 0 2024-02-28T23:07:36.135 INFO:tasks.workunit.client.1.smithi184.stdout:2/533: dread - d10/d1f/d21/d5e/f47 zero size 2024-02-28T23:07:36.142 INFO:tasks.workunit.client.1.smithi184.stdout:5/544: dread db/d44/f82 [0,4194304] 0 2024-02-28T23:07:36.142 INFO:tasks.workunit.client.0.smithi159.stdout:4/992: rename d9/d20/d87/d115/d1c/d8e to d9/d42/d54/d9c/d15e 0 2024-02-28T23:07:36.145 INFO:tasks.workunit.client.1.smithi184.stdout:8/575: mknod d1/da/dc/d16/dbd/cd8 0 2024-02-28T23:07:36.147 INFO:tasks.workunit.client.1.smithi184.stdout:3/584: mknod d1/d4/d1c/d61/cb3 0 2024-02-28T23:07:36.148 INFO:tasks.workunit.client.1.smithi184.stdout:3/585: fdatasync d1/d4/d6/d1f/fa5 0 2024-02-28T23:07:36.153 INFO:tasks.workunit.client.1.smithi184.stdout:9/545: unlink d5/f7 0 2024-02-28T23:07:36.155 INFO:tasks.workunit.client.0.smithi159.stdout:5/854: mknod d8/d19/d23/d35/d65/da3/dd2/def/d11f/d12b/c12e 0 2024-02-28T23:07:36.155 INFO:tasks.workunit.client.1.smithi184.stdout:4/529: link d1/dc/df/d27/d34/c55 d1/dc/df/d5b/d6c/c98 0 2024-02-28T23:07:36.157 INFO:tasks.workunit.client.0.smithi159.stdout:5/855: readlink d8/d19/d23/d35/d65/da3/laf 0 2024-02-28T23:07:36.157 INFO:tasks.workunit.client.0.smithi159.stdout:4/993: truncate d9/f1f 361126 0 2024-02-28T23:07:36.158 INFO:tasks.workunit.client.1.smithi184.stdout:0/588: creat d0/df/fcf x:0 0 0 2024-02-28T23:07:36.159 INFO:tasks.workunit.client.1.smithi184.stdout:1/604: mkdir d20/d32/d3e/d61/d8b/d9c/db8/dd0 0 2024-02-28T23:07:36.162 INFO:tasks.workunit.client.1.smithi184.stdout:2/534: unlink d10/d1f/d21/c36 0 2024-02-28T23:07:36.164 INFO:tasks.workunit.client.0.smithi159.stdout:4/994: truncate d9/d42/fc6 2593083 0 2024-02-28T23:07:36.167 INFO:tasks.workunit.client.0.smithi159.stdout:2/792: dread d9/d50/d62/dba/d105/f10e [0,4194304] 0 2024-02-28T23:07:36.167 INFO:tasks.workunit.client.1.smithi184.stdout:5/545: dread db/d12/d18/f20 [0,4194304] 0 2024-02-28T23:07:36.169 INFO:tasks.workunit.client.0.smithi159.stdout:2/793: stat d9/d36/l41 0 2024-02-28T23:07:36.171 INFO:tasks.workunit.client.1.smithi184.stdout:8/576: symlink d1/da/dc/d16/d29/ld9 0 2024-02-28T23:07:36.177 INFO:tasks.workunit.client.1.smithi184.stdout:9/546: mknod d5/db/de/d10/cb1 0 2024-02-28T23:07:36.178 INFO:tasks.workunit.client.0.smithi159.stdout:8/992: write d2/d11/d52/d26/d36/d38/ff9 [4947544,93037] 0 2024-02-28T23:07:36.181 INFO:tasks.workunit.client.1.smithi184.stdout:6/497: dwrite dc/d60/f58 [0,4194304] 0 2024-02-28T23:07:36.189 INFO:tasks.workunit.client.1.smithi184.stdout:2/535: mkdir d10/d1f/d38/d54/d96/dab 0 2024-02-28T23:07:36.189 INFO:tasks.workunit.client.0.smithi159.stdout:8/993: truncate d2/d11/d35/d5f/dfe/d68/fcd 957636 0 2024-02-28T23:07:36.190 INFO:tasks.workunit.client.1.smithi184.stdout:5/546: creat db/d12/d50/fb2 x:0 0 0 2024-02-28T23:07:36.190 INFO:tasks.workunit.client.1.smithi184.stdout:3/586: dwrite d1/d4/d6/d1f/d26/f29 [0,4194304] 0 2024-02-28T23:07:36.196 INFO:tasks.workunit.client.1.smithi184.stdout:1/605: dread d20/f2d [0,4194304] 0 2024-02-28T23:07:36.198 INFO:tasks.workunit.client.0.smithi159.stdout:8/994: fsync d2/d11/d52/d6e/f87 0 2024-02-28T23:07:36.200 INFO:tasks.workunit.client.1.smithi184.stdout:4/530: rename d1/dc/df/d22/d51 to d1/d8/d19/d67/d99 0 2024-02-28T23:07:36.203 INFO:tasks.workunit.client.1.smithi184.stdout:0/589: truncate d0/df/d13/d27/f2c 194552 0 2024-02-28T23:07:36.206 INFO:tasks.workunit.client.0.smithi159.stdout:4/995: dwrite d9/d20/d87/d115/f47 [4194304,4194304] 0 2024-02-28T23:07:36.207 INFO:tasks.workunit.client.1.smithi184.stdout:2/536: rmdir d10/d1f/d21/d4d 39 2024-02-28T23:07:36.208 INFO:tasks.workunit.client.1.smithi184.stdout:8/577: symlink d1/da/d10/d17/d63/dbe/lda 0 2024-02-28T23:07:36.210 INFO:tasks.workunit.client.1.smithi184.stdout:3/587: rmdir d1/d4/d6/d1f/d26/d3a/d59/d82 39 2024-02-28T23:07:36.211 INFO:tasks.workunit.client.0.smithi159.stdout:8/995: chown d2/d11/d52/d26/d36/d38/d77/d79/cf2 4081 1 2024-02-28T23:07:36.218 INFO:tasks.workunit.client.1.smithi184.stdout:1/606: rmdir d20 39 2024-02-28T23:07:36.218 INFO:tasks.workunit.client.0.smithi159.stdout:5/856: dwrite d8/d19/d23/d35/d65/db5/fea [0,4194304] 0 2024-02-28T23:07:36.221 INFO:tasks.workunit.client.1.smithi184.stdout:0/590: dwrite d0/df/fcf [0,4194304] 0 2024-02-28T23:07:36.222 INFO:tasks.workunit.client.0.smithi159.stdout:2/794: dwrite d9/d23/d2c/d55/fee [0,4194304] 0 2024-02-28T23:07:36.227 INFO:tasks.workunit.client.1.smithi184.stdout:0/591: stat d0/df/d13/d27/d31/d5b/d8e/d91/c78 0 2024-02-28T23:07:36.230 INFO:tasks.workunit.client.0.smithi159.stdout:5/857: readlink d8/d19/d23/d35/d38/l7c 0 2024-02-28T23:07:36.234 INFO:tasks.workunit.client.1.smithi184.stdout:4/531: mkdir d1/d9a 0 2024-02-28T23:07:36.235 INFO:tasks.workunit.client.1.smithi184.stdout:3/588: dread d1/d4/d1c/d61/d87/f8b [0,4194304] 0 2024-02-28T23:07:36.236 INFO:tasks.workunit.client.1.smithi184.stdout:4/532: readlink d1/d4/d43/d73/l69 0 2024-02-28T23:07:36.236 INFO:tasks.workunit.client.1.smithi184.stdout:9/547: write d5/d17/f3c [2724129,74701] 0 2024-02-28T23:07:36.237 INFO:tasks.workunit.client.0.smithi159.stdout:8/996: creat d2/d11/d52/d26/d36/d38/d77/d110/f138 x:0 0 0 2024-02-28T23:07:36.238 INFO:tasks.workunit.client.1.smithi184.stdout:7/527: getdents d6/d9/d13/d3e/dad/d49/da6/daf 0 2024-02-28T23:07:36.239 INFO:tasks.workunit.client.1.smithi184.stdout:4/533: chown d1/c7e 212015329 1 2024-02-28T23:07:36.240 INFO:tasks.workunit.client.1.smithi184.stdout:7/528: fdatasync d6/f8e 0 2024-02-28T23:07:36.242 INFO:tasks.workunit.client.0.smithi159.stdout:2/795: mknod d9/d50/dcc/d44/dc0/c115 0 2024-02-28T23:07:36.246 INFO:tasks.workunit.client.1.smithi184.stdout:8/578: creat d1/da/dc/d16/d29/d92/fdb x:0 0 0 2024-02-28T23:07:36.248 INFO:tasks.workunit.client.1.smithi184.stdout:8/579: chown d1/da/dc/d16/d32/d42/f6f 4 1 2024-02-28T23:07:36.249 INFO:tasks.workunit.client.1.smithi184.stdout:0/592: dread d0/df/f41 [0,4194304] 0 2024-02-28T23:07:36.252 INFO:tasks.workunit.client.0.smithi159.stdout:8/997: mkdir d2/d3/d139 0 2024-02-28T23:07:36.252 INFO:tasks.workunit.client.1.smithi184.stdout:4/534: dread d1/d8/d37/d49/f80 [0,4194304] 0 2024-02-28T23:07:36.256 INFO:tasks.workunit.client.1.smithi184.stdout:5/547: creat db/fb3 x:0 0 0 2024-02-28T23:07:36.259 INFO:tasks.workunit.client.1.smithi184.stdout:7/529: creat d6/d68/fb9 x:0 0 0 2024-02-28T23:07:36.262 INFO:tasks.workunit.client.0.smithi159.stdout:4/996: dwrite d9/d20/d87/d115/d1c/f1d [4194304,4194304] 0 2024-02-28T23:07:36.267 INFO:tasks.workunit.client.0.smithi159.stdout:8/998: rename d2/d11/d52/d26/d36/d38/d77/d79/dd7 to d2/d11/d52/d26/d36/d38/d77/dc5/df6/d13a 0 2024-02-28T23:07:36.268 INFO:tasks.workunit.client.1.smithi184.stdout:0/593: mknod d0/df/d13/d27/d31/d5b/d8e/d92/cd0 0 2024-02-28T23:07:36.269 INFO:tasks.workunit.client.1.smithi184.stdout:9/548: write d5/f24 [2202885,34642] 0 2024-02-28T23:07:36.269 INFO:tasks.workunit.client.1.smithi184.stdout:0/594: stat d0/d1d/l2a 0 2024-02-28T23:07:36.269 INFO:tasks.workunit.client.0.smithi159.stdout:4/997: chown d9/f1f 0 1 2024-02-28T23:07:36.270 INFO:tasks.workunit.client.1.smithi184.stdout:6/498: getdents dc/de/d2a/d5c 0 2024-02-28T23:07:36.271 INFO:tasks.workunit.client.1.smithi184.stdout:9/549: chown d5/d17/d8f/c93 0 1 2024-02-28T23:07:36.273 INFO:tasks.workunit.client.0.smithi159.stdout:8/999: truncate d2/d73/dc2/fd4 681524 0 2024-02-28T23:07:36.273 INFO:tasks.workunit.client.1.smithi184.stdout:5/548: creat db/da1/fb4 x:0 0 0 2024-02-28T23:07:36.274 INFO:tasks.workunit.client.0.smithi159.stdout:4/998: read - d9/d20/d87/d115/dc5/f145 zero size 2024-02-28T23:07:36.275 INFO:tasks.workunit.client.1.smithi184.stdout:5/549: write db/d12/d50/fb2 [266359,107470] 0 2024-02-28T23:07:36.276 INFO:tasks.workunit.client.0.smithi159.stdout:5/858: dread d8/d19/d23/d35/f5e [0,4194304] 0 2024-02-28T23:07:36.277 INFO:tasks.workunit.client.1.smithi184.stdout:5/550: stat db/d12/d1c/d21/d2f/c58 0 2024-02-28T23:07:36.279 INFO:tasks.workunit.client.1.smithi184.stdout:3/589: mknod d1/d4/d6/d1f/d24/d76/cb4 0 2024-02-28T23:07:36.281 INFO:tasks.workunit.client.0.smithi159.stdout:5/859: dread - d8/d16/d122/f5a zero size 2024-02-28T23:07:36.283 INFO:tasks.workunit.client.1.smithi184.stdout:6/499: truncate f3 2224136 0 2024-02-28T23:07:36.283 INFO:tasks.workunit.client.1.smithi184.stdout:4/535: truncate d1/dc/f23 1561271 0 2024-02-28T23:07:36.284 INFO:tasks.workunit.client.1.smithi184.stdout:2/537: getdents d10/d1f/d21/d5e/d15/d24 0 2024-02-28T23:07:36.285 INFO:tasks.workunit.client.1.smithi184.stdout:6/500: dread - dc/f4f zero size 2024-02-28T23:07:36.289 INFO:tasks.workunit.client.1.smithi184.stdout:8/580: creat d1/da/d10/d17/d63/fdc x:0 0 0 2024-02-28T23:07:36.293 INFO:tasks.workunit.client.1.smithi184.stdout:5/551: dwrite db/d12/d18/d2e/d3c/d5d/f33 [0,4194304] 0 2024-02-28T23:07:36.293 INFO:tasks.workunit.client.0.smithi159.stdout:5/860: mkdir d8/d19/d23/d12f 0 2024-02-28T23:07:36.294 INFO:tasks.workunit.client.1.smithi184.stdout:3/590: read d1/d4/f5a [136702,95346] 0 2024-02-28T23:07:36.294 INFO:tasks.workunit.client.1.smithi184.stdout:5/552: readlink db/d44/l9c 0 2024-02-28T23:07:36.296 INFO:tasks.workunit.client.1.smithi184.stdout:5/553: chown db/d12/d1c 9 1 2024-02-28T23:07:36.297 INFO:tasks.workunit.client.1.smithi184.stdout:9/550: rename d5/db/d5c/f84 to d5/d47/d59/fb2 0 2024-02-28T23:07:36.300 INFO:tasks.workunit.client.1.smithi184.stdout:7/530: link d6/d9/d13/d3e/dad/d49/da6/daf/d65/f83 d6/d9/d13/d3e/dad/d49/d50/db2/fba 0 2024-02-28T23:07:36.300 INFO:tasks.workunit.client.1.smithi184.stdout:9/551: write d5/db/de/d10/d12/d2f/f7b [24790,68089] 0 2024-02-28T23:07:36.301 INFO:tasks.workunit.client.1.smithi184.stdout:0/595: dread d0/d1f/f26 [0,4194304] 0 2024-02-28T23:07:36.303 INFO:tasks.workunit.client.1.smithi184.stdout:9/552: dread - d5/db/de/d10/d6a/f91 zero size 2024-02-28T23:07:36.306 INFO:tasks.workunit.client.1.smithi184.stdout:7/531: truncate d6/d68/f7a 446457 0 2024-02-28T23:07:36.307 INFO:tasks.workunit.client.0.smithi159.stdout:6/864: sync 2024-02-28T23:07:36.308 INFO:tasks.workunit.client.1.smithi184.stdout:1/607: sync 2024-02-28T23:07:36.313 INFO:tasks.workunit.client.1.smithi184.stdout:6/501: mkdir dc/d60/d62/d6f/d99 0 2024-02-28T23:07:36.313 INFO:tasks.workunit.client.1.smithi184.stdout:8/581: mkdir d1/da/dc/d16/d32/d42/d77/ddd 0 2024-02-28T23:07:36.313 INFO:tasks.workunit.client.1.smithi184.stdout:5/554: mkdir db/d12/d18/db5 0 2024-02-28T23:07:36.313 INFO:tasks.workunit.client.0.smithi159.stdout:6/865: mknod d0/d1b/d33/d3f/d44/d8b/c11d 0 2024-02-28T23:07:36.315 INFO:tasks.workunit.client.1.smithi184.stdout:5/555: read db/d44/f4c [3740896,55570] 0 2024-02-28T23:07:36.317 INFO:tasks.workunit.client.1.smithi184.stdout:2/538: write d10/d1f/f4c [3907580,69452] 0 2024-02-28T23:07:36.317 INFO:tasks.workunit.client.0.smithi159.stdout:6/866: creat d0/d1b/dc4/ddd/f11e x:0 0 0 2024-02-28T23:07:36.318 INFO:tasks.workunit.client.0.smithi159.stdout:6/867: readlink d0/d1b/d33/d11/l40 0 2024-02-28T23:07:36.320 INFO:tasks.workunit.client.1.smithi184.stdout:7/532: rename d6/d9/d13/d3e/d7e/cb1 to d6/d9/d13/d3e/cbb 0 2024-02-28T23:07:36.321 INFO:tasks.workunit.client.1.smithi184.stdout:1/608: truncate d20/d46/d90/db3/fc4 422687 0 2024-02-28T23:07:36.323 INFO:tasks.workunit.client.0.smithi159.stdout:5/861: dwrite d8/f9b [0,4194304] 0 2024-02-28T23:07:36.328 INFO:tasks.workunit.client.1.smithi184.stdout:9/553: dread d5/db/de/d10/d12/d2f/d3f/f45 [0,4194304] 0 2024-02-28T23:07:36.330 INFO:tasks.workunit.client.0.smithi159.stdout:5/862: dread - d8/d16/d122/f5a zero size 2024-02-28T23:07:36.330 INFO:tasks.workunit.client.1.smithi184.stdout:9/554: chown d5/db/de/d10/d12/f2d 51048 1 2024-02-28T23:07:36.331 INFO:tasks.workunit.client.1.smithi184.stdout:8/582: creat d1/da/df/d20/d7c/fde x:0 0 0 2024-02-28T23:07:36.332 INFO:tasks.workunit.client.1.smithi184.stdout:0/596: symlink d0/df/d13/ld1 0 2024-02-28T23:07:36.332 INFO:tasks.workunit.client.1.smithi184.stdout:8/583: readlink d1/l14 0 2024-02-28T23:07:36.335 INFO:tasks.workunit.client.1.smithi184.stdout:3/591: creat d1/fb5 x:0 0 0 2024-02-28T23:07:36.336 INFO:tasks.workunit.client.1.smithi184.stdout:9/555: chown d5/db/de/d10/f7a 8146175 1 2024-02-28T23:07:36.337 INFO:tasks.workunit.client.0.smithi159.stdout:5/863: fdatasync d8/d19/d23/d35/d41/daa/f8e 0 2024-02-28T23:07:36.339 INFO:tasks.workunit.client.1.smithi184.stdout:6/502: mkdir dc/de/d2a/d5c/d79/d87/d9a 0 2024-02-28T23:07:36.340 INFO:tasks.workunit.client.0.smithi159.stdout:6/868: write d0/d1b/f1a [965750,52630] 0 2024-02-28T23:07:36.341 INFO:tasks.workunit.client.1.smithi184.stdout:2/539: rename d10/d1f/c23 to d10/d1f/d38/d53/cac 0 2024-02-28T23:07:36.343 INFO:tasks.workunit.client.0.smithi159.stdout:6/869: readlink d0/d1b/d33/d11/l31 0 2024-02-28T23:07:36.345 INFO:tasks.workunit.client.1.smithi184.stdout:2/540: truncate d10/d1f/d38/d54/d96/faa 398211 0 2024-02-28T23:07:36.346 INFO:tasks.workunit.client.1.smithi184.stdout:7/533: truncate d6/f59 3526886 0 2024-02-28T23:07:36.347 INFO:tasks.workunit.client.1.smithi184.stdout:2/541: stat d10/d55/f70 0 2024-02-28T23:07:36.348 INFO:tasks.workunit.client.0.smithi159.stdout:5/864: creat d8/d19/d23/d35/d41/daa/d10e/f130 x:0 0 0 2024-02-28T23:07:36.353 INFO:tasks.workunit.client.1.smithi184.stdout:4/536: dwrite d1/d8/d3d/d44/f66 [0,4194304] 0 2024-02-28T23:07:36.358 INFO:tasks.workunit.client.0.smithi159.stdout:6/870: write d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/fde [846686,102461] 0 2024-02-28T23:07:36.359 INFO:tasks.workunit.client.1.smithi184.stdout:1/609: truncate d20/d32/db0/fcb 3669155 0 2024-02-28T23:07:36.360 INFO:tasks.workunit.client.0.smithi159.stdout:5/865: unlink d8/d19/d23/d35/d38/f3e 0 2024-02-28T23:07:36.361 INFO:tasks.workunit.client.1.smithi184.stdout:5/556: dwrite db/d12/d18/d2e/d3c/d5d/d66/f74 [0,4194304] 0 2024-02-28T23:07:36.362 INFO:tasks.workunit.client.0.smithi159.stdout:6/871: chown d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88/c103 149043 1 2024-02-28T23:07:36.362 INFO:tasks.workunit.client.1.smithi184.stdout:1/610: chown d20/d32/d3e/d82 741399113 1 2024-02-28T23:07:36.368 INFO:tasks.workunit.client.0.smithi159.stdout:6/872: creat d0/d1b/d33/f11f x:0 0 0 2024-02-28T23:07:36.369 INFO:tasks.workunit.client.1.smithi184.stdout:2/542: dwrite d10/d33/f7d [0,4194304] 0 2024-02-28T23:07:36.369 INFO:tasks.workunit.client.1.smithi184.stdout:8/584: dread d1/da/dc/d16/d29/d7d/fb8 [0,4194304] 0 2024-02-28T23:07:36.375 INFO:tasks.workunit.client.1.smithi184.stdout:6/503: creat dc/de/d10/f9b x:0 0 0 2024-02-28T23:07:36.376 INFO:tasks.workunit.client.1.smithi184.stdout:3/592: dwrite d1/d4/d6/f81 [0,4194304] 0 2024-02-28T23:07:36.376 INFO:tasks.workunit.client.1.smithi184.stdout:7/534: dread d6/d9/d13/d3e/dad/f77 [0,4194304] 0 2024-02-28T23:07:36.379 INFO:tasks.workunit.client.1.smithi184.stdout:2/543: dread - d10/d1f/d21/d6a/f84 zero size 2024-02-28T23:07:36.383 INFO:tasks.workunit.client.1.smithi184.stdout:5/557: creat db/d12/d1c/d21/fb6 x:0 0 0 2024-02-28T23:07:36.391 INFO:tasks.workunit.client.1.smithi184.stdout:0/597: rename d0/d7c/c9f to d0/df/d13/cd2 0 2024-02-28T23:07:36.396 INFO:tasks.workunit.client.1.smithi184.stdout:7/535: dread d6/d9/fb3 [0,4194304] 0 2024-02-28T23:07:36.401 INFO:tasks.workunit.client.1.smithi184.stdout:8/585: dwrite d1/da/dc/d16/d32/d80/fd6 [0,4194304] 0 2024-02-28T23:07:36.402 INFO:tasks.workunit.client.1.smithi184.stdout:6/504: symlink dc/d60/d6d/l9c 0 2024-02-28T23:07:36.404 INFO:tasks.workunit.client.1.smithi184.stdout:9/556: rename d5/f13 to d5/d73/fb3 0 2024-02-28T23:07:36.404 INFO:tasks.workunit.client.1.smithi184.stdout:7/536: rmdir d6/d9/d13/d3e/dad/d49/d50 39 2024-02-28T23:07:36.407 INFO:tasks.workunit.client.1.smithi184.stdout:8/586: dread d1/da/dc/f73 [0,4194304] 0 2024-02-28T23:07:36.407 INFO:tasks.workunit.client.1.smithi184.stdout:0/598: dread d0/d7c/f7f [0,4194304] 0 2024-02-28T23:07:36.407 INFO:tasks.workunit.client.1.smithi184.stdout:9/557: write d5/d47/d4a/f82 [2546120,76778] 0 2024-02-28T23:07:36.409 INFO:tasks.workunit.client.1.smithi184.stdout:5/558: mknod db/d12/d1c/d9b/cb7 0 2024-02-28T23:07:36.411 INFO:tasks.workunit.client.1.smithi184.stdout:8/587: readlink d1/da/d10/d17/l78 0 2024-02-28T23:07:36.413 INFO:tasks.workunit.client.1.smithi184.stdout:4/537: rename d1/d8/d37/f75 to d1/d8/f9b 0 2024-02-28T23:07:36.413 INFO:tasks.workunit.client.0.smithi159.stdout:6/873: dwrite d0/d1b/d33/d3f/d44/fa0 [0,4194304] 0 2024-02-28T23:07:36.413 INFO:tasks.workunit.client.0.smithi159.stdout:5/866: dread d8/d19/d23/f56 [0,4194304] 0 2024-02-28T23:07:36.420 INFO:tasks.workunit.client.1.smithi184.stdout:6/505: mkdir dc/d60/d62/d6f/d99/d9d 0 2024-02-28T23:07:36.420 INFO:tasks.workunit.client.1.smithi184.stdout:9/558: rmdir d5/db/de/d10/d12 39 2024-02-28T23:07:36.424 INFO:tasks.workunit.client.1.smithi184.stdout:8/588: creat d1/da/dc/d16/d4d/d82/fdf x:0 0 0 2024-02-28T23:07:36.424 INFO:tasks.workunit.client.1.smithi184.stdout:9/559: chown d5/d47/d4a/c2e 31007068 1 2024-02-28T23:07:36.426 INFO:tasks.workunit.client.0.smithi159.stdout:6/874: truncate d0/d6d/f6e 2396775 0 2024-02-28T23:07:36.427 INFO:tasks.workunit.client.1.smithi184.stdout:2/544: rename d10/d1f/d21/d5e/d15/d24/d5f/d63 to d10/d1f/d21/d5e/dad 0 2024-02-28T23:07:36.428 INFO:tasks.workunit.client.1.smithi184.stdout:4/538: creat d1/d8/d37/f9c x:0 0 0 2024-02-28T23:07:36.428 INFO:tasks.workunit.client.1.smithi184.stdout:0/599: dwrite d0/df/d13/d27/d31/d5b/d8e/d92/fcc [0,4194304] 0 2024-02-28T23:07:36.429 INFO:tasks.workunit.client.1.smithi184.stdout:2/545: read d10/f16 [122689,120626] 0 2024-02-28T23:07:36.429 INFO:tasks.workunit.client.0.smithi159.stdout:5/867: creat d8/d19/d23/d35/d65/f131 x:0 0 0 2024-02-28T23:07:36.431 INFO:tasks.workunit.client.1.smithi184.stdout:6/506: creat dc/d60/d7c/f9e x:0 0 0 2024-02-28T23:07:36.432 INFO:tasks.workunit.client.1.smithi184.stdout:0/600: write d0/df/d13/d27/d31/d51/d85/faa [15026,97844] 0 2024-02-28T23:07:36.433 INFO:tasks.workunit.client.1.smithi184.stdout:4/539: read d1/d8/d19/f1a [4192442,61885] 0 2024-02-28T23:07:36.433 INFO:tasks.workunit.client.0.smithi159.stdout:6/875: rmdir d0/d1b/d33/d11/d34/d9d/da2/d4e/d86 39 2024-02-28T23:07:36.434 INFO:tasks.workunit.client.1.smithi184.stdout:4/540: chown d1/dc/df/d27 31286 1 2024-02-28T23:07:36.438 INFO:tasks.workunit.client.0.smithi159.stdout:5/868: mknod d8/d19/d23/d35/d65/da3/dd2/dd7/c132 0 2024-02-28T23:07:36.442 INFO:tasks.workunit.client.1.smithi184.stdout:2/546: creat d10/d1f/d21/d6a/fae x:0 0 0 2024-02-28T23:07:36.444 INFO:tasks.workunit.client.1.smithi184.stdout:4/541: creat d1/dc/df/d5b/d6c/f9d x:0 0 0 2024-02-28T23:07:36.445 INFO:tasks.workunit.client.1.smithi184.stdout:8/589: mkdir d1/da/d10/d43/da1/de0 0 2024-02-28T23:07:36.446 INFO:tasks.workunit.client.0.smithi159.stdout:5/869: creat d8/d19/d23/d35/d41/daa/d88/f133 x:0 0 0 2024-02-28T23:07:36.447 INFO:tasks.workunit.client.1.smithi184.stdout:6/507: dwrite dc/de/d10/f19 [4194304,4194304] 0 2024-02-28T23:07:36.448 INFO:tasks.workunit.client.1.smithi184.stdout:8/590: write d1/da/d10/d17/d63/fa4 [815243,51657] 0 2024-02-28T23:07:36.449 INFO:tasks.workunit.client.0.smithi159.stdout:5/870: stat d8/d19/d23/d35/d41/d92/d10c/dff 0 2024-02-28T23:07:36.452 INFO:tasks.workunit.client.0.smithi159.stdout:5/871: readlink d8/d19/d23/d35/d65/da3/df4/da5/d111/d113/l114 0 2024-02-28T23:07:36.453 INFO:tasks.workunit.client.1.smithi184.stdout:5/559: link db/d90/cb0 db/d12/d18/d2e/cb8 0 2024-02-28T23:07:36.459 INFO:tasks.workunit.client.0.smithi159.stdout:5/872: fdatasync d8/d19/d23/d35/d41/f5d 0 2024-02-28T23:07:36.459 INFO:tasks.workunit.client.1.smithi184.stdout:4/542: creat d1/dc/df/d3b/d5c/f9e x:0 0 0 2024-02-28T23:07:36.463 INFO:tasks.workunit.client.1.smithi184.stdout:3/593: rename d1/d4/d1c/d61/lad to d1/d4/d6/d1f/d26/d3a/d59/lb6 0 2024-02-28T23:07:36.463 INFO:tasks.workunit.client.1.smithi184.stdout:7/537: write d6/d9/d13/d3e/dad/d49/d50/f61 [1212021,124892] 0 2024-02-28T23:07:36.467 INFO:tasks.workunit.client.1.smithi184.stdout:8/591: rmdir d1/da/dc 39 2024-02-28T23:07:36.470 INFO:tasks.workunit.client.1.smithi184.stdout:9/560: link d5/db/de/d10/d12/d2f/d3f/f66 d5/d47/d59/d92/fb4 0 2024-02-28T23:07:36.474 INFO:tasks.workunit.client.0.smithi159.stdout:5/873: read - d8/db4/de8/f10a zero size 2024-02-28T23:07:36.477 INFO:tasks.workunit.client.1.smithi184.stdout:3/594: creat d1/d4/d1c/d62/fb7 x:0 0 0 2024-02-28T23:07:36.477 INFO:tasks.workunit.client.1.smithi184.stdout:7/538: fdatasync d6/d9/d13/d3e/dad/f1b 0 2024-02-28T23:07:36.480 INFO:tasks.workunit.client.0.smithi159.stdout:5/874: mknod d8/d19/d23/d35/d41/daa/d10e/c134 0 2024-02-28T23:07:36.481 INFO:tasks.workunit.client.0.smithi159.stdout:5/875: chown d8/f14 4 1 2024-02-28T23:07:36.481 INFO:tasks.workunit.client.1.smithi184.stdout:9/561: creat d5/d26/fb5 x:0 0 0 2024-02-28T23:07:36.482 INFO:tasks.workunit.client.1.smithi184.stdout:6/508: write dc/de/d10/f1b [5719469,104770] 0 2024-02-28T23:07:36.483 INFO:tasks.workunit.client.0.smithi159.stdout:5/876: dread - d8/d19/d23/d35/d38/f108 zero size 2024-02-28T23:07:36.488 INFO:tasks.workunit.client.1.smithi184.stdout:2/547: dwrite d10/d1f/f2f [0,4194304] 0 2024-02-28T23:07:36.491 INFO:tasks.workunit.client.1.smithi184.stdout:5/560: truncate db/d12/d18/d2e/d3c/d5d/f33 2821567 0 2024-02-28T23:07:36.493 INFO:tasks.workunit.client.1.smithi184.stdout:8/592: creat d1/fe1 x:0 0 0 2024-02-28T23:07:36.493 INFO:tasks.workunit.client.1.smithi184.stdout:4/543: truncate d1/d8/d3d/d44/f66 3260620 0 2024-02-28T23:07:36.494 INFO:tasks.workunit.client.1.smithi184.stdout:7/539: write d6/d9/d13/d14/f7c [407173,37989] 0 2024-02-28T23:07:36.497 INFO:tasks.workunit.client.1.smithi184.stdout:4/544: dread - d1/d4/d43/d73/f91 zero size 2024-02-28T23:07:36.497 INFO:tasks.workunit.client.1.smithi184.stdout:6/509: creat dc/de/d2a/d5c/d79/d87/f9f x:0 0 0 2024-02-28T23:07:36.497 INFO:tasks.workunit.client.1.smithi184.stdout:3/595: write d1/d4/d6/d1f/d26/d3a/d59/d67/fb2 [337744,95291] 0 2024-02-28T23:07:36.501 INFO:tasks.workunit.client.1.smithi184.stdout:2/548: fdatasync d10/d1f/d21/d4d/d67/f95 0 2024-02-28T23:07:36.502 INFO:tasks.workunit.client.1.smithi184.stdout:9/562: link d5/d26/fb5 d5/d26/d50/fb6 0 2024-02-28T23:07:36.503 INFO:tasks.workunit.client.1.smithi184.stdout:1/611: sync 2024-02-28T23:07:36.506 INFO:tasks.workunit.client.1.smithi184.stdout:1/612: write d20/d32/d3e/fc7 [454631,53724] 0 2024-02-28T23:07:36.506 INFO:tasks.workunit.client.0.smithi159.stdout:5/877: dwrite d8/d19/f1f [0,4194304] 0 2024-02-28T23:07:36.509 INFO:tasks.workunit.client.1.smithi184.stdout:4/545: mkdir d1/d29/d9f 0 2024-02-28T23:07:36.511 INFO:tasks.workunit.client.1.smithi184.stdout:2/549: readlink d10/d33/l62 0 2024-02-28T23:07:36.514 INFO:tasks.workunit.client.0.smithi159.stdout:5/878: symlink d8/d19/d23/d35/d65/da3/df4/da5/d111/d113/l135 0 2024-02-28T23:07:36.514 INFO:tasks.workunit.client.1.smithi184.stdout:1/613: creat d20/d46/d90/fd1 x:0 0 0 2024-02-28T23:07:36.520 INFO:tasks.workunit.client.1.smithi184.stdout:7/540: creat d6/d9/d13/d1e/fbc x:0 0 0 2024-02-28T23:07:36.521 INFO:tasks.workunit.client.1.smithi184.stdout:2/550: truncate d10/d1f/d21/d6a/f84 611091 0 2024-02-28T23:07:36.521 INFO:tasks.workunit.client.0.smithi159.stdout:5/879: fsync d8/f3f 0 2024-02-28T23:07:36.522 INFO:tasks.workunit.client.1.smithi184.stdout:7/541: write d6/d9/d13/f1f [1449778,944] 0 2024-02-28T23:07:36.523 INFO:tasks.workunit.client.1.smithi184.stdout:4/546: mkdir d1/d29/d9f/da0 0 2024-02-28T23:07:36.527 INFO:tasks.workunit.client.1.smithi184.stdout:9/563: link d5/d17/d43/f48 d5/db/de/d10/d12/fb7 0 2024-02-28T23:07:36.527 INFO:tasks.workunit.client.1.smithi184.stdout:8/593: write d1/da/df/f28 [2636903,25159] 0 2024-02-28T23:07:36.528 INFO:tasks.workunit.client.1.smithi184.stdout:6/510: write f8 [8350357,56032] 0 2024-02-28T23:07:36.531 INFO:tasks.workunit.client.1.smithi184.stdout:6/511: chown dc/de/f5a 7791 1 2024-02-28T23:07:36.533 INFO:tasks.workunit.client.0.smithi159.stdout:5/880: creat d8/d19/d23/d35/d65/f136 x:0 0 0 2024-02-28T23:07:36.533 INFO:tasks.workunit.client.1.smithi184.stdout:5/561: dwrite db/d12/d1c/d21/f2a [4194304,4194304] 0 2024-02-28T23:07:36.536 INFO:tasks.workunit.client.0.smithi159.stdout:5/881: chown d8/d19/d23/d35/d41/c93 6308 1 2024-02-28T23:07:36.536 INFO:tasks.workunit.client.1.smithi184.stdout:4/547: symlink d1/d8/d35/la1 0 2024-02-28T23:07:36.536 INFO:tasks.workunit.client.1.smithi184.stdout:5/562: read db/d1f/f78 [3228780,63157] 0 2024-02-28T23:07:36.537 INFO:tasks.workunit.client.1.smithi184.stdout:4/548: fdatasync d1/f33 0 2024-02-28T23:07:36.539 INFO:tasks.workunit.client.1.smithi184.stdout:9/564: fdatasync d5/db/de/d10/d12/f27 0 2024-02-28T23:07:36.540 INFO:tasks.workunit.client.1.smithi184.stdout:6/512: symlink dc/de/d10/d16/la0 0 2024-02-28T23:07:36.543 INFO:tasks.workunit.client.1.smithi184.stdout:2/551: dread d10/f16 [0,4194304] 0 2024-02-28T23:07:36.544 INFO:tasks.workunit.client.1.smithi184.stdout:7/542: creat d6/d9/d13/d3e/dad/d49/d50/db2/fbd x:0 0 0 2024-02-28T23:07:36.544 INFO:tasks.workunit.client.1.smithi184.stdout:3/596: dwrite d1/d4/d6/d1f/f2c [0,4194304] 0 2024-02-28T23:07:36.545 INFO:tasks.workunit.client.1.smithi184.stdout:8/594: creat d1/da/dd7/fe2 x:0 0 0 2024-02-28T23:07:36.546 INFO:tasks.workunit.client.1.smithi184.stdout:7/543: stat d6/d9/lb5 0 2024-02-28T23:07:36.547 INFO:tasks.workunit.client.0.smithi159.stdout:5/882: rename d8/d19/d23/d35/d65/da3/df4/da5/ddc/lf0 to d8/d19/d23/d35/d41/d77/l137 0 2024-02-28T23:07:36.548 INFO:tasks.workunit.client.1.smithi184.stdout:3/597: dread d1/d4/f5a [0,4194304] 0 2024-02-28T23:07:36.551 INFO:tasks.workunit.client.1.smithi184.stdout:3/598: dread d1/d4/f5a [0,4194304] 0 2024-02-28T23:07:36.554 INFO:tasks.workunit.client.1.smithi184.stdout:9/565: mkdir d5/d17/d43/db8 0 2024-02-28T23:07:36.556 INFO:tasks.workunit.client.1.smithi184.stdout:9/566: write d5/f24 [5204741,63290] 0 2024-02-28T23:07:36.557 INFO:tasks.workunit.client.1.smithi184.stdout:2/552: creat d10/d1f/d21/d5e/d15/d60/faf x:0 0 0 2024-02-28T23:07:36.566 INFO:tasks.workunit.client.1.smithi184.stdout:1/614: link d20/d32/c3d d20/d32/d3e/d82/cd2 0 2024-02-28T23:07:36.566 INFO:tasks.workunit.client.1.smithi184.stdout:3/599: mknod d1/d4/d1c/d61/d87/cb8 0 2024-02-28T23:07:36.566 INFO:tasks.workunit.client.1.smithi184.stdout:1/615: dread - d20/d32/d4d/fa9 zero size 2024-02-28T23:07:36.566 INFO:tasks.workunit.client.1.smithi184.stdout:8/595: rmdir d1/da/dc/d16/d29/d92 39 2024-02-28T23:07:36.566 INFO:tasks.workunit.client.1.smithi184.stdout:3/600: fsync d1/d4/d6/d1f/d26/f78 0 2024-02-28T23:07:36.567 INFO:tasks.workunit.client.1.smithi184.stdout:0/601: sync 2024-02-28T23:07:36.567 INFO:tasks.workunit.client.1.smithi184.stdout:9/567: rmdir d5/db/de/d10 39 2024-02-28T23:07:36.569 INFO:tasks.workunit.client.0.smithi159.stdout:5/883: chown d8/d19/d23/d35/d41/d77/l137 162 1 2024-02-28T23:07:36.570 INFO:tasks.workunit.client.0.smithi159.stdout:5/884: readlink d8/d19/d23/d35/d41/d92/ld6 0 2024-02-28T23:07:36.571 INFO:tasks.workunit.client.1.smithi184.stdout:8/596: creat d1/da/d33/fe3 x:0 0 0 2024-02-28T23:07:36.574 INFO:tasks.workunit.client.1.smithi184.stdout:7/544: write d6/d9/d13/d3e/dad/f1b [4083998,11988] 0 2024-02-28T23:07:36.578 INFO:tasks.workunit.client.0.smithi159.stdout:5/885: mknod d8/d19/d23/d35/d65/c138 0 2024-02-28T23:07:36.578 INFO:tasks.workunit.client.1.smithi184.stdout:1/616: unlink d20/d32/d3e/d61/d8b/d9c/cbd 0 2024-02-28T23:07:36.581 INFO:tasks.workunit.client.0.smithi159.stdout:5/886: mkdir d8/d19/d23/d35/d41/d77/dfd/d139 0 2024-02-28T23:07:36.582 INFO:tasks.workunit.client.1.smithi184.stdout:9/568: write d5/d17/f3d [3043528,87471] 0 2024-02-28T23:07:36.582 INFO:tasks.workunit.client.1.smithi184.stdout:0/602: write d0/d1d/d4c/f69 [208604,56550] 0 2024-02-28T23:07:36.584 INFO:tasks.workunit.client.1.smithi184.stdout:3/601: creat d1/fb9 x:0 0 0 2024-02-28T23:07:36.585 INFO:tasks.workunit.client.1.smithi184.stdout:8/597: write d1/da/dc/d16/d29/d92/fb5 [304552,221] 0 2024-02-28T23:07:36.587 INFO:tasks.workunit.client.1.smithi184.stdout:7/545: link d6/d9/d13/d1e/fbc d6/d68/fbe 0 2024-02-28T23:07:36.588 INFO:tasks.workunit.client.1.smithi184.stdout:6/513: dread dc/de/d10/f4b [0,4194304] 0 2024-02-28T23:07:36.590 INFO:tasks.workunit.client.1.smithi184.stdout:4/549: dwrite d1/dc/df/f16 [8388608,4194304] 0 2024-02-28T23:07:36.592 INFO:tasks.workunit.client.1.smithi184.stdout:2/553: dwrite d10/d1f/d21/d5e/f3d [0,4194304] 0 2024-02-28T23:07:36.595 INFO:tasks.workunit.client.1.smithi184.stdout:5/563: dwrite db/d12/d1c/d21/d2f/f7a [0,4194304] 0 2024-02-28T23:07:36.601 INFO:tasks.workunit.client.0.smithi159.stdout:0/979: sync 2024-02-28T23:07:36.601 INFO:tasks.workunit.client.1.smithi184.stdout:4/550: write d1/dc/df/d3b/d5c/f9e [92695,92953] 0 2024-02-28T23:07:36.601 INFO:tasks.workunit.client.1.smithi184.stdout:3/602: rmdir d1/d4/d6/d83 39 2024-02-28T23:07:36.601 INFO:tasks.workunit.client.1.smithi184.stdout:6/514: read dc/d60/d62/d6f/f77 [2130534,110822] 0 2024-02-28T23:07:36.603 INFO:tasks.workunit.client.0.smithi159.stdout:0/980: readlink d0/d5/d14/d25/db5/le3 0 2024-02-28T23:07:36.605 INFO:tasks.workunit.client.1.smithi184.stdout:2/554: symlink d10/d1f/d21/d5e/dad/lb0 0 2024-02-28T23:07:36.605 INFO:tasks.workunit.client.1.smithi184.stdout:6/515: write dc/de/d10/f1b [5392626,52920] 0 2024-02-28T23:07:36.607 INFO:tasks.workunit.client.0.smithi159.stdout:5/887: dwrite d8/d16/d122/f8c [0,4194304] 0 2024-02-28T23:07:36.608 INFO:tasks.workunit.client.0.smithi159.stdout:0/981: read d0/d5/d38/fde [1683699,6293] 0 2024-02-28T23:07:36.611 INFO:tasks.workunit.client.1.smithi184.stdout:6/516: write dc/f75 [246228,323] 0 2024-02-28T23:07:36.613 INFO:tasks.workunit.client.1.smithi184.stdout:9/569: unlink d5/db/de/d10/fac 0 2024-02-28T23:07:36.615 INFO:tasks.workunit.client.1.smithi184.stdout:0/603: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:36.618 INFO:tasks.workunit.client.0.smithi159.stdout:0/982: fdatasync d0/de/f68 0 2024-02-28T23:07:36.621 INFO:tasks.workunit.client.0.smithi159.stdout:0/983: read d0/de/d46/f61 [255753,103612] 0 2024-02-28T23:07:36.621 INFO:tasks.workunit.client.1.smithi184.stdout:5/564: write db/d12/d1c/f2b [407209,379] 0 2024-02-28T23:07:36.623 INFO:tasks.workunit.client.1.smithi184.stdout:0/604: fsync d0/d1d/f6d 0 2024-02-28T23:07:36.623 INFO:tasks.workunit.client.1.smithi184.stdout:1/617: truncate d20/d32/d3e/d61/d8b/f8e 3944304 0 2024-02-28T23:07:36.624 INFO:tasks.workunit.client.0.smithi159.stdout:0/984: read d0/d5/d14/d25/f77 [4045440,861] 0 2024-02-28T23:07:36.627 INFO:tasks.workunit.client.1.smithi184.stdout:4/551: truncate d1/dc/df/f31 71040 0 2024-02-28T23:07:36.628 INFO:tasks.workunit.client.1.smithi184.stdout:6/517: mkdir dc/de/d56/d8a/da1 0 2024-02-28T23:07:36.630 INFO:tasks.workunit.client.1.smithi184.stdout:2/555: truncate d10/d1f/f8d 36831 0 2024-02-28T23:07:36.635 INFO:tasks.workunit.client.1.smithi184.stdout:4/552: truncate d1/d4/f95 111408 0 2024-02-28T23:07:36.636 INFO:tasks.workunit.client.1.smithi184.stdout:5/565: creat db/d12/d1c/d80/fb9 x:0 0 0 2024-02-28T23:07:36.636 INFO:tasks.workunit.client.1.smithi184.stdout:3/603: creat d1/d4/d6/d83/fba x:0 0 0 2024-02-28T23:07:36.641 INFO:tasks.workunit.client.1.smithi184.stdout:8/598: dwrite d1/da/d10/d43/f5e [0,4194304] 0 2024-02-28T23:07:36.641 INFO:tasks.workunit.client.0.smithi159.stdout:0/985: link d0/de/f3b d0/d5/d14/d34/d3d/df5/f159 0 2024-02-28T23:07:36.642 INFO:tasks.workunit.client.1.smithi184.stdout:7/546: dwrite d6/d9/d13/d3e/dad/d7d/d6c/f81 [0,4194304] 0 2024-02-28T23:07:36.642 INFO:tasks.workunit.client.1.smithi184.stdout:6/518: mkdir dc/de/d2a/d5c/d79/da2 0 2024-02-28T23:07:36.646 INFO:tasks.workunit.client.1.smithi184.stdout:8/599: chown d1/l14 29709 1 2024-02-28T23:07:36.646 INFO:tasks.workunit.client.0.smithi159.stdout:0/986: mkdir d0/d5/d38/d15a 0 2024-02-28T23:07:36.649 INFO:tasks.workunit.client.0.smithi159.stdout:0/987: mkdir d0/de/de7/d15b 0 2024-02-28T23:07:36.650 INFO:tasks.workunit.client.1.smithi184.stdout:0/605: symlink d0/df/d13/d27/d31/d5b/d8e/d92/dac/ld3 0 2024-02-28T23:07:36.651 INFO:tasks.workunit.client.0.smithi159.stdout:0/988: chown d0/d5/d14/d34/cd7 106 1 2024-02-28T23:07:36.654 INFO:tasks.workunit.client.1.smithi184.stdout:4/553: rename d1/dc/df/d27/d34/l52 to d1/dc/df/d3b/la2 0 2024-02-28T23:07:36.656 INFO:tasks.workunit.client.1.smithi184.stdout:5/566: unlink db/d12/d18/d2e/d3c/l81 0 2024-02-28T23:07:36.658 INFO:tasks.workunit.client.0.smithi159.stdout:0/989: fdatasync d0/d5/d14/d25/d2c/f147 0 2024-02-28T23:07:36.664 INFO:tasks.workunit.client.1.smithi184.stdout:1/618: dwrite d20/d32/f48 [0,4194304] 0 2024-02-28T23:07:36.664 INFO:tasks.workunit.client.1.smithi184.stdout:2/556: creat d10/fb1 x:0 0 0 2024-02-28T23:07:36.666 INFO:tasks.workunit.client.1.smithi184.stdout:9/570: dwrite d5/d47/f67 [0,4194304] 0 2024-02-28T23:07:36.667 INFO:tasks.workunit.client.1.smithi184.stdout:3/604: dwrite d1/d4/fb [4194304,4194304] 0 2024-02-28T23:07:36.670 INFO:tasks.workunit.client.1.smithi184.stdout:9/571: readlink d5/db/l62 0 2024-02-28T23:07:36.675 INFO:tasks.workunit.client.1.smithi184.stdout:6/519: symlink dc/de/d56/d8a/da1/la3 0 2024-02-28T23:07:36.676 INFO:tasks.workunit.client.1.smithi184.stdout:5/567: creat db/d90/fba x:0 0 0 2024-02-28T23:07:36.679 INFO:tasks.workunit.client.1.smithi184.stdout:8/600: creat d1/da/fe4 x:0 0 0 2024-02-28T23:07:36.681 INFO:tasks.workunit.client.1.smithi184.stdout:6/520: chown dc/d60/d62/d6f 4691963 1 2024-02-28T23:07:36.681 INFO:tasks.workunit.client.0.smithi159.stdout:5/888: dread d8/d16/d122/f4e [0,4194304] 0 2024-02-28T23:07:36.685 INFO:tasks.workunit.client.1.smithi184.stdout:4/554: truncate d1/dc/df/d38/f53 1430149 0 2024-02-28T23:07:36.685 INFO:tasks.workunit.client.1.smithi184.stdout:7/547: rename d6/d68/c9b to d6/d9/cbf 0 2024-02-28T23:07:36.686 INFO:tasks.workunit.client.1.smithi184.stdout:3/605: fdatasync d1/d4/d6/d1f/f2b 0 2024-02-28T23:07:36.687 INFO:tasks.workunit.client.0.smithi159.stdout:0/990: dwrite d0/d5/d14/d34/d6c/fbc [0,4194304] 0 2024-02-28T23:07:36.690 INFO:tasks.workunit.client.1.smithi184.stdout:5/568: creat db/d12/d50/d9e/fbb x:0 0 0 2024-02-28T23:07:36.690 INFO:tasks.workunit.client.1.smithi184.stdout:6/521: chown dc/c22 172689 1 2024-02-28T23:07:36.690 INFO:tasks.workunit.client.1.smithi184.stdout:8/601: dread - d1/da/df/d20/dc7/fcf zero size 2024-02-28T23:07:36.690 INFO:tasks.workunit.client.1.smithi184.stdout:0/606: dread d0/d1d/f35 [0,4194304] 0 2024-02-28T23:07:36.690 INFO:tasks.workunit.client.1.smithi184.stdout:5/569: chown db/da1 3861 1 2024-02-28T23:07:36.691 INFO:tasks.workunit.client.0.smithi159.stdout:9/855: sync 2024-02-28T23:07:36.691 INFO:tasks.workunit.client.0.smithi159.stdout:3/812: sync 2024-02-28T23:07:36.691 INFO:tasks.workunit.client.0.smithi159.stdout:5/889: mknod d8/d19/d23/d35/d41/d77/dfd/c13a 0 2024-02-28T23:07:36.692 INFO:tasks.workunit.client.1.smithi184.stdout:3/606: stat d1/d4/d6/d1f/d26/d3a/f4d 0 2024-02-28T23:07:36.692 INFO:tasks.workunit.client.1.smithi184.stdout:9/572: dread d5/db/d65/f6c [0,4194304] 0 2024-02-28T23:07:36.694 INFO:tasks.workunit.client.1.smithi184.stdout:1/619: rename f16 to d20/d32/db0/fd3 0 2024-02-28T23:07:36.696 INFO:tasks.workunit.client.1.smithi184.stdout:6/522: readlink dc/de/l1a 0 2024-02-28T23:07:36.698 INFO:tasks.workunit.client.1.smithi184.stdout:3/607: fsync d1/d4/d1c/d61/f9a 0 2024-02-28T23:07:36.705 INFO:tasks.workunit.client.1.smithi184.stdout:7/548: dwrite d6/d9/d13/d14/f42 [0,4194304] 0 2024-02-28T23:07:36.720 INFO:tasks.workunit.client.1.smithi184.stdout:2/557: dread d10/d1f/f93 [0,4194304] 0 2024-02-28T23:07:36.721 INFO:tasks.workunit.client.0.smithi159.stdout:5/890: dwrite d8/d19/f1f [0,4194304] 0 2024-02-28T23:07:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:36 smithi159 ceph-mon[28802]: pgmap v37: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 68 MiB/s rd, 177 MiB/s wr, 368 op/s 2024-02-28T23:07:36.787 INFO:tasks.workunit.client.0.smithi159.stdout:7/737: sync 2024-02-28T23:07:36.787 INFO:tasks.workunit.client.0.smithi159.stdout:2/796: sync 2024-02-28T23:07:36.787 INFO:tasks.workunit.client.0.smithi159.stdout:6/876: sync 2024-02-28T23:07:36.787 INFO:tasks.workunit.client.0.smithi159.stdout:4/999: sync 2024-02-28T23:07:36.787 INFO:tasks.workunit.client.0.smithi159.stdout:1/926: sync 2024-02-28T23:07:36.792 INFO:tasks.workunit.client.0.smithi159.stdout:1/927: dread - d6/d1d/d46/d88/dd3/d9c/db3/dc4/ddc/f118 zero size 2024-02-28T23:07:36.797 INFO:tasks.workunit.client.0.smithi159.stdout:7/738: dread d5/d16/d1a/f96 [0,4194304] 0 2024-02-28T23:07:36.843 INFO:tasks.workunit.client.1.smithi184.stdout:0/607: mknod d0/df/d13/d27/d31/db3/cd4 0 2024-02-28T23:07:36.846 INFO:tasks.workunit.client.1.smithi184.stdout:0/608: dread - d0/df/d13/f18 zero size 2024-02-28T23:07:36.848 INFO:tasks.workunit.client.0.smithi159.stdout:9/856: creat d4/d3d/d3e/d55/d9e/dfc/dea/f10d x:0 0 0 2024-02-28T23:07:36.849 INFO:tasks.workunit.client.1.smithi184.stdout:1/620: mknod d20/d32/dc0/cd4 0 2024-02-28T23:07:36.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:36 smithi184 ceph-mon[36198]: pgmap v37: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 68 MiB/s rd, 177 MiB/s wr, 368 op/s 2024-02-28T23:07:36.854 INFO:tasks.workunit.client.1.smithi184.stdout:9/573: creat d5/db/d65/fb9 x:0 0 0 2024-02-28T23:07:36.855 INFO:tasks.workunit.client.0.smithi159.stdout:0/991: rename d0/d5/d14/d34/d3d/f83 to d0/d5/d38/d15a/f15c 0 2024-02-28T23:07:36.858 INFO:tasks.workunit.client.0.smithi159.stdout:0/992: write d0/de/db7/f152 [617234,110621] 0 2024-02-28T23:07:36.859 INFO:tasks.workunit.client.0.smithi159.stdout:5/891: mkdir d8/d19/d23/d35/d65/da3/df4/da5/d13b 0 2024-02-28T23:07:36.861 INFO:tasks.workunit.client.1.smithi184.stdout:5/570: creat db/d12/d1c/d21/d4d/fbc x:0 0 0 2024-02-28T23:07:36.862 INFO:tasks.workunit.client.0.smithi159.stdout:2/797: unlink d9/f11 0 2024-02-28T23:07:36.871 INFO:tasks.workunit.client.1.smithi184.stdout:3/608: creat d1/d4/d1c/fbb x:0 0 0 2024-02-28T23:07:36.878 INFO:tasks.workunit.client.0.smithi159.stdout:7/739: mknod d5/d16/d1a/d24/d64/cec 0 2024-02-28T23:07:36.897 INFO:tasks.workunit.client.0.smithi159.stdout:2/798: dread - d9/d80/fe5 zero size 2024-02-28T23:07:36.908 INFO:tasks.workunit.client.0.smithi159.stdout:1/928: creat d6/d1d/d46/d88/dd3/d134/f13a x:0 0 0 2024-02-28T23:07:36.912 INFO:tasks.workunit.client.0.smithi159.stdout:7/740: chown d5/d16/d1a/da0/cb0 0 1 2024-02-28T23:07:36.920 INFO:tasks.workunit.client.0.smithi159.stdout:2/799: mknod d9/d23/d2c/d55/d13/d4f/c116 0 2024-02-28T23:07:36.925 INFO:tasks.workunit.client.0.smithi159.stdout:1/929: creat d6/d12/d31/d10d/f13b x:0 0 0 2024-02-28T23:07:36.937 INFO:tasks.workunit.client.0.smithi159.stdout:2/800: dread - d9/d50/dcc/d44/fe4 zero size 2024-02-28T23:07:36.940 INFO:tasks.workunit.client.0.smithi159.stdout:0/993: getdents d0/de/de7/d117 0 2024-02-28T23:07:36.943 INFO:tasks.workunit.client.0.smithi159.stdout:2/801: mkdir d9/d50/d54/d84/df2/d117 0 2024-02-28T23:07:36.948 INFO:tasks.workunit.client.1.smithi184.stdout:5/571: write db/d12/f85 [2726429,105593] 0 2024-02-28T23:07:36.949 INFO:tasks.workunit.client.0.smithi159.stdout:0/994: truncate d0/d5/d14/d25/f77 1986890 0 2024-02-28T23:07:36.952 INFO:tasks.workunit.client.1.smithi184.stdout:4/555: rename d1/dc/df/f14 to d1/dc/df/d27/fa3 0 2024-02-28T23:07:36.954 INFO:tasks.workunit.client.1.smithi184.stdout:0/609: symlink d0/df/d13/d9d/ld5 0 2024-02-28T23:07:36.960 INFO:tasks.workunit.client.1.smithi184.stdout:0/610: stat d0/df/d13/d27/d31/d5b/d8e/d91/c9c 0 2024-02-28T23:07:36.961 INFO:tasks.workunit.client.0.smithi159.stdout:6/877: link d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88/c90 d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/c120 0 2024-02-28T23:07:36.963 INFO:tasks.workunit.client.1.smithi184.stdout:3/609: creat d1/d4/d1c/d62/d92/d9b/fbc x:0 0 0 2024-02-28T23:07:36.964 INFO:tasks.workunit.client.1.smithi184.stdout:0/611: chown d0/df/d13/d27/f8b 1013 1 2024-02-28T23:07:36.964 INFO:tasks.workunit.client.1.smithi184.stdout:5/572: mknod db/d12/d18/cbd 0 2024-02-28T23:07:36.967 INFO:tasks.workunit.client.0.smithi159.stdout:2/802: dwrite d9/d50/dcc/d44/dc0/feb [4194304,4194304] 0 2024-02-28T23:07:36.973 INFO:tasks.workunit.client.1.smithi184.stdout:5/573: write db/d12/f85 [632113,101542] 0 2024-02-28T23:07:36.975 INFO:tasks.workunit.client.0.smithi159.stdout:2/803: fsync d9/d36/f3f 0 2024-02-28T23:07:36.975 INFO:tasks.workunit.client.1.smithi184.stdout:0/612: dread - d0/df/d13/d27/d31/d5b/d8e/d91/fa6 zero size 2024-02-28T23:07:36.978 INFO:tasks.workunit.client.0.smithi159.stdout:6/878: symlink d0/d1b/d33/d11/d34/d9d/da2/db7/db1/d114/l121 0 2024-02-28T23:07:36.978 INFO:tasks.workunit.client.1.smithi184.stdout:5/574: stat db/d12/d18/d2e/la2 0 2024-02-28T23:07:36.980 INFO:tasks.workunit.client.1.smithi184.stdout:5/575: chown db/d90 30 1 2024-02-28T23:07:36.984 INFO:tasks.workunit.client.1.smithi184.stdout:9/574: unlink d5/d47/d68/l9d 0 2024-02-28T23:07:36.984 INFO:tasks.workunit.client.1.smithi184.stdout:7/549: rename d6/d9/c9f to d6/d9/d13/d3e/dad/d7d/cc0 0 2024-02-28T23:07:36.988 INFO:tasks.workunit.client.1.smithi184.stdout:3/610: unlink d1/d4/d6/d1f/d26/d3a/d59/d67/fb2 0 2024-02-28T23:07:36.989 INFO:tasks.workunit.client.0.smithi159.stdout:2/804: mknod d9/d50/d62/dba/d105/c118 0 2024-02-28T23:07:36.992 INFO:tasks.workunit.client.1.smithi184.stdout:3/611: dread - d1/d4/d1c/fbb zero size 2024-02-28T23:07:36.994 INFO:tasks.workunit.client.1.smithi184.stdout:0/613: chown d0/df/d13/d27/d58/c74 100 1 2024-02-28T23:07:37.001 INFO:tasks.workunit.client.0.smithi159.stdout:6/879: mkdir d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d113/d122 0 2024-02-28T23:07:37.004 INFO:tasks.workunit.client.1.smithi184.stdout:7/550: mknod d6/d9/d13/d3e/dad/d49/d50/cc1 0 2024-02-28T23:07:37.012 INFO:tasks.workunit.client.1.smithi184.stdout:0/614: creat d0/df/d13/d5a/d95/fd6 x:0 0 0 2024-02-28T23:07:37.016 INFO:tasks.workunit.client.1.smithi184.stdout:0/615: fdatasync d0/df/d13/d27/d31/d51/f8d 0 2024-02-28T23:07:37.033 INFO:tasks.workunit.client.1.smithi184.stdout:9/575: dread d5/d73/fb3 [4194304,4194304] 0 2024-02-28T23:07:37.046 INFO:tasks.workunit.client.1.smithi184.stdout:9/576: creat d5/db/de/d10/d12/d2f/fba x:0 0 0 2024-02-28T23:07:37.048 INFO:tasks.workunit.client.1.smithi184.stdout:0/616: dwrite d0/df/f63 [0,4194304] 0 2024-02-28T23:07:37.056 INFO:tasks.workunit.client.0.smithi159.stdout:3/813: write d0/d6/f32 [114333,96914] 0 2024-02-28T23:07:37.073 INFO:tasks.workunit.client.1.smithi184.stdout:2/558: rename d10/d1f/d38/d54/f97 to d10/d1f/d21/d5e/d15/d60/fb2 0 2024-02-28T23:07:37.074 INFO:tasks.workunit.client.1.smithi184.stdout:6/523: write dc/de/d2a/f35 [1025871,32284] 0 2024-02-28T23:07:37.074 INFO:tasks.workunit.client.0.smithi159.stdout:3/814: dread d0/d2b/d55/df8/d2f/f56 [0,4194304] 0 2024-02-28T23:07:37.078 INFO:tasks.workunit.client.1.smithi184.stdout:0/617: read - d0/df/d13/d27/d31/d5b/d8e/d91/d71/fc8 zero size 2024-02-28T23:07:37.088 INFO:tasks.workunit.client.1.smithi184.stdout:4/556: rename d1/dc/df/f5f to d1/d8/d3d/d44/fa4 0 2024-02-28T23:07:37.091 INFO:tasks.workunit.client.1.smithi184.stdout:9/577: mkdir d5/db/de/d10/d12/dbb 0 2024-02-28T23:07:37.103 INFO:tasks.workunit.client.0.smithi159.stdout:9/857: creat d4/d3d/d3e/d55/f10e x:0 0 0 2024-02-28T23:07:37.106 INFO:tasks.workunit.client.1.smithi184.stdout:4/557: rmdir d1/dc/df/d3b/d5c 39 2024-02-28T23:07:37.116 INFO:tasks.workunit.client.1.smithi184.stdout:4/558: mknod d1/dc/df/d3b/d5c/ca5 0 2024-02-28T23:07:37.124 INFO:tasks.workunit.client.0.smithi159.stdout:5/892: dwrite d8/d19/d23/d35/d41/daa/d88/f101 [0,4194304] 0 2024-02-28T23:07:37.142 INFO:tasks.workunit.client.1.smithi184.stdout:3/612: sync 2024-02-28T23:07:37.142 INFO:tasks.workunit.client.1.smithi184.stdout:7/551: sync 2024-02-28T23:07:37.145 INFO:tasks.workunit.client.0.smithi159.stdout:3/815: creat d0/d2b/d55/df8/d2f/d78/f101 x:0 0 0 2024-02-28T23:07:37.146 INFO:tasks.workunit.client.1.smithi184.stdout:7/552: write d6/f35 [1673817,56329] 0 2024-02-28T23:07:37.146 INFO:tasks.workunit.client.0.smithi159.stdout:3/816: fsync d0/d47/fc5 0 2024-02-28T23:07:37.148 INFO:tasks.workunit.client.0.smithi159.stdout:3/817: read - d0/d2b/d4f/dc3/ff0 zero size 2024-02-28T23:07:37.155 INFO:tasks.workunit.client.1.smithi184.stdout:0/618: rmdir d0/df/d13/d27/d31 39 2024-02-28T23:07:37.156 INFO:tasks.workunit.client.0.smithi159.stdout:9/858: mkdir d4/d3d/d3e/dad/d10f 0 2024-02-28T23:07:37.159 INFO:tasks.workunit.client.1.smithi184.stdout:7/553: truncate d6/d9/d13/d3e/dad/f27 568019 0 2024-02-28T23:07:37.166 INFO:tasks.workunit.client.1.smithi184.stdout:0/619: dread - d0/df/d13/d27/d31/d5b/d8e/d91/d71/fc6 zero size 2024-02-28T23:07:37.169 INFO:tasks.workunit.client.1.smithi184.stdout:8/602: truncate d1/da/d10/d17/f13 2496639 0 2024-02-28T23:07:37.170 INFO:tasks.workunit.client.0.smithi159.stdout:9/859: getdents d4/d3d/d3e/d55/d4c 0 2024-02-28T23:07:37.177 INFO:tasks.workunit.client.1.smithi184.stdout:8/603: rmdir d1/da/df/d20 39 2024-02-28T23:07:37.180 INFO:tasks.workunit.client.0.smithi159.stdout:9/860: truncate d4/d3d/d3e/dad/fbf 3526295 0 2024-02-28T23:07:37.182 INFO:tasks.workunit.client.1.smithi184.stdout:0/620: mknod d0/df/d13/d27/d31/d5b/d8e/d92/cd7 0 2024-02-28T23:07:37.191 INFO:tasks.workunit.client.0.smithi159.stdout:0/995: dwrite d0/d5/d38/fde [0,4194304] 0 2024-02-28T23:07:37.192 INFO:tasks.workunit.client.1.smithi184.stdout:7/554: dread d6/d68/f75 [0,4194304] 0 2024-02-28T23:07:37.196 INFO:tasks.workunit.client.0.smithi159.stdout:2/805: write d9/d23/d2c/d55/fb7 [398325,12678] 0 2024-02-28T23:07:37.196 INFO:tasks.workunit.client.1.smithi184.stdout:7/555: chown d6/d9/d13/c52 1912622 1 2024-02-28T23:07:37.196 INFO:tasks.workunit.client.1.smithi184.stdout:3/613: dwrite d1/d4/d5/d40/f64 [0,4194304] 0 2024-02-28T23:07:37.200 INFO:tasks.workunit.client.1.smithi184.stdout:0/621: creat d0/df/d13/d27/d58/fd8 x:0 0 0 2024-02-28T23:07:37.202 INFO:tasks.workunit.client.0.smithi159.stdout:5/893: dread d8/d19/d23/d35/d41/daa/f70 [0,4194304] 0 2024-02-28T23:07:37.208 INFO:tasks.workunit.client.1.smithi184.stdout:3/614: truncate d1/d4/d1c/d62/d92/d9b/fbc 512842 0 2024-02-28T23:07:37.210 INFO:tasks.workunit.client.0.smithi159.stdout:0/996: creat d0/d5/d14/d34/d3d/f15d x:0 0 0 2024-02-28T23:07:37.216 INFO:tasks.workunit.client.1.smithi184.stdout:8/604: getdents d1/da/dc/d16/d4d/d8a 0 2024-02-28T23:07:37.219 INFO:tasks.workunit.client.1.smithi184.stdout:5/576: rename db/d12/d1c/d21/d4d/l64 to db/d12/lbe 0 2024-02-28T23:07:37.223 INFO:tasks.workunit.client.0.smithi159.stdout:0/997: creat d0/de/d75/db8/d103/d124/f15e x:0 0 0 2024-02-28T23:07:37.238 INFO:tasks.workunit.client.1.smithi184.stdout:7/556: dread d6/d9/d13/d3e/dad/d49/f88 [0,4194304] 0 2024-02-28T23:07:37.251 INFO:tasks.workunit.client.1.smithi184.stdout:7/557: dread d6/d9/da/f10 [0,4194304] 0 2024-02-28T23:07:37.337 INFO:tasks.workunit.client.0.smithi159.stdout:9/861: getdents d4/d3d/d3e/d55/d4c 0 2024-02-28T23:07:37.340 INFO:tasks.workunit.client.1.smithi184.stdout:8/605: creat d1/da/dc/d16/d4d/fe5 x:0 0 0 2024-02-28T23:07:37.341 INFO:tasks.workunit.client.0.smithi159.stdout:5/894: creat d8/d19/d23/d35/d65/da3/df4/da5/df3/f13c x:0 0 0 2024-02-28T23:07:37.343 INFO:tasks.workunit.client.1.smithi184.stdout:0/622: symlink d0/df/d13/d27/d31/d5b/d8e/d91/dcb/ld9 0 2024-02-28T23:07:37.344 INFO:tasks.workunit.client.0.smithi159.stdout:0/998: rmdir d0/de/db7 39 2024-02-28T23:07:37.349 INFO:tasks.workunit.client.1.smithi184.stdout:6/524: rename dc/d60/d7c/f64 to dc/de/d2a/d5c/d6e/fa4 0 2024-02-28T23:07:37.353 INFO:tasks.workunit.client.0.smithi159.stdout:0/999: dread - d0/d5/d38/d63/f13a zero size 2024-02-28T23:07:37.354 INFO:tasks.workunit.client.1.smithi184.stdout:6/525: write dc/de/f36 [2782578,116238] 0 2024-02-28T23:07:37.355 INFO:tasks.workunit.client.0.smithi159.stdout:9/862: dread d4/d3d/d3e/d55/d37/d62/d6a/ffe [0,4194304] 0 2024-02-28T23:07:37.355 INFO:tasks.workunit.client.0.smithi159.stdout:5/895: truncate d8/d19/d23/d35/d65/fac 545304 0 2024-02-28T23:07:37.360 INFO:tasks.workunit.client.0.smithi159.stdout:9/863: stat d4/d3d/d3e/d55/d37/d62/db0 0 2024-02-28T23:07:37.361 INFO:tasks.workunit.client.1.smithi184.stdout:0/623: fdatasync d0/df/d13/f49 0 2024-02-28T23:07:37.363 INFO:tasks.workunit.client.1.smithi184.stdout:9/578: rename d5/d47/d4a/c2e to d5/db/de/d10/d12/d2f/d7d/cbc 0 2024-02-28T23:07:37.369 INFO:tasks.workunit.client.1.smithi184.stdout:9/579: write d5/d17/f5a [382426,99206] 0 2024-02-28T23:07:37.370 INFO:tasks.workunit.client.1.smithi184.stdout:7/558: unlink d6/d9/d13/d14/l96 0 2024-02-28T23:07:37.372 INFO:tasks.workunit.client.1.smithi184.stdout:4/559: rename d1/d8/d35/f47 to d1/dc/df/d5b/fa6 0 2024-02-28T23:07:37.375 INFO:tasks.workunit.client.1.smithi184.stdout:5/577: link db/d12/d1c/d21/f2a db/d12/d1c/d21/fbf 0 2024-02-28T23:07:37.376 INFO:tasks.workunit.client.1.smithi184.stdout:0/624: creat d0/d1d/d4c/fda x:0 0 0 2024-02-28T23:07:37.379 INFO:tasks.workunit.client.1.smithi184.stdout:6/526: mknod dc/d60/ca5 0 2024-02-28T23:07:37.382 INFO:tasks.workunit.client.1.smithi184.stdout:8/606: getdents d1/da/dc/d16/d29/d7d 0 2024-02-28T23:07:37.384 INFO:tasks.workunit.client.1.smithi184.stdout:4/560: creat d1/d8/d35/fa7 x:0 0 0 2024-02-28T23:07:37.386 INFO:tasks.workunit.client.1.smithi184.stdout:7/559: fdatasync d6/d9/d13/d3e/dad/d49/da6/daf/d47/f58 0 2024-02-28T23:07:37.387 INFO:tasks.workunit.client.1.smithi184.stdout:5/578: creat db/d12/d1c/d21/d25/fc0 x:0 0 0 2024-02-28T23:07:37.388 INFO:tasks.workunit.client.1.smithi184.stdout:9/580: creat d5/db/de/fbd x:0 0 0 2024-02-28T23:07:37.389 INFO:tasks.workunit.client.1.smithi184.stdout:7/560: readlink d6/l25 0 2024-02-28T23:07:37.389 INFO:tasks.workunit.client.1.smithi184.stdout:1/621: mknod d20/d32/cd5 0 2024-02-28T23:07:37.393 INFO:tasks.workunit.client.1.smithi184.stdout:5/579: chown db/d12/d1c/d21/d4d 498315 1 2024-02-28T23:07:37.393 INFO:tasks.workunit.client.1.smithi184.stdout:8/607: chown d1/da/df/d20/d7c/cb1 4406284 1 2024-02-28T23:07:37.395 INFO:tasks.workunit.client.1.smithi184.stdout:6/527: creat dc/d60/d7c/d90/fa6 x:0 0 0 2024-02-28T23:07:37.397 INFO:tasks.workunit.client.1.smithi184.stdout:7/561: mknod d6/d9/d13/d3e/dad/d49/d50/cc2 0 2024-02-28T23:07:37.398 INFO:tasks.workunit.client.1.smithi184.stdout:1/622: rmdir d20/d32/d3e/d61/d8b/d9c/db8 39 2024-02-28T23:07:37.402 INFO:tasks.workunit.client.1.smithi184.stdout:9/581: truncate d5/db/de/d10/d6a/faa 241324 0 2024-02-28T23:07:37.409 INFO:tasks.workunit.client.1.smithi184.stdout:8/608: write d1/da/d10/d17/d63/fdc [860112,36094] 0 2024-02-28T23:07:37.409 INFO:tasks.workunit.client.1.smithi184.stdout:7/562: chown d6/d9/d13/d1e/fbc 0 1 2024-02-28T23:07:37.409 INFO:tasks.workunit.client.1.smithi184.stdout:9/582: readlink d5/d26/d50/l41 0 2024-02-28T23:07:37.409 INFO:tasks.workunit.client.1.smithi184.stdout:6/528: creat dc/de/d2a/d5c/d79/d87/fa7 x:0 0 0 2024-02-28T23:07:37.411 INFO:tasks.workunit.client.1.smithi184.stdout:1/623: creat d20/d32/fd6 x:0 0 0 2024-02-28T23:07:37.411 INFO:tasks.workunit.client.1.smithi184.stdout:6/529: fdatasync dc/d60/f92 0 2024-02-28T23:07:37.412 INFO:tasks.workunit.client.1.smithi184.stdout:7/563: chown d6/d9/d13/d3e/d7e/f8a 428692582 1 2024-02-28T23:07:37.412 INFO:tasks.workunit.client.1.smithi184.stdout:2/559: dwrite d10/f11 [0,4194304] 0 2024-02-28T23:07:37.413 INFO:tasks.workunit.client.1.smithi184.stdout:8/609: mknod d1/da/dc/d16/d32/ce6 0 2024-02-28T23:07:37.417 INFO:tasks.workunit.client.1.smithi184.stdout:9/583: mkdir d5/db/de/d10/d12/d2f/d3f/dbe 0 2024-02-28T23:07:37.417 INFO:tasks.workunit.client.1.smithi184.stdout:4/561: dread d1/d8/d37/d49/f80 [0,4194304] 0 2024-02-28T23:07:37.419 INFO:tasks.workunit.client.1.smithi184.stdout:4/562: fsync d1/d4/f1f 0 2024-02-28T23:07:37.420 INFO:tasks.workunit.client.1.smithi184.stdout:2/560: symlink d10/lb3 0 2024-02-28T23:07:37.420 INFO:tasks.workunit.client.1.smithi184.stdout:1/624: chown d20/d32/d3e/d61/d8b/f8e 9635230 1 2024-02-28T23:07:37.421 INFO:tasks.workunit.client.1.smithi184.stdout:4/563: write d1/f33 [4976540,74733] 0 2024-02-28T23:07:37.423 INFO:tasks.workunit.client.1.smithi184.stdout:4/564: stat d1/d8/d19/d92/l94 0 2024-02-28T23:07:37.424 INFO:tasks.workunit.client.1.smithi184.stdout:9/584: write d5/d26/d50/f53 [4168516,57480] 0 2024-02-28T23:07:37.429 INFO:tasks.workunit.client.1.smithi184.stdout:7/564: symlink d6/d9/d13/d14/dac/lc3 0 2024-02-28T23:07:37.430 INFO:tasks.workunit.client.1.smithi184.stdout:6/530: mknod dc/d60/d62/d6f/ca8 0 2024-02-28T23:07:37.434 INFO:tasks.workunit.client.1.smithi184.stdout:7/565: write d6/d9/d13/d14/fa2 [82181,112747] 0 2024-02-28T23:07:37.437 INFO:tasks.workunit.client.1.smithi184.stdout:4/565: unlink d1/dc/df/d27/l6b 0 2024-02-28T23:07:37.440 INFO:tasks.workunit.client.0.smithi159.stdout:3/818: dwrite d0/d2b/fd5 [0,4194304] 0 2024-02-28T23:07:37.440 INFO:tasks.workunit.client.1.smithi184.stdout:1/625: dwrite d20/d46/d90/db3/fc4 [0,4194304] 0 2024-02-28T23:07:37.450 INFO:tasks.workunit.client.0.smithi159.stdout:2/806: dwrite d9/d23/d2c/d55/f72 [0,4194304] 0 2024-02-28T23:07:37.454 INFO:tasks.workunit.client.1.smithi184.stdout:3/615: truncate d1/d4/d6/d1f/d24/f5e 1653177 0 2024-02-28T23:07:37.465 INFO:tasks.workunit.client.0.smithi159.stdout:9/864: write d4/d76/f98 [4405613,72466] 0 2024-02-28T23:07:37.466 INFO:tasks.workunit.client.1.smithi184.stdout:6/531: symlink dc/de/d10/la9 0 2024-02-28T23:07:37.467 INFO:tasks.workunit.client.0.smithi159.stdout:3/819: creat d0/d6/f102 x:0 0 0 2024-02-28T23:07:37.470 INFO:tasks.workunit.client.1.smithi184.stdout:7/566: mkdir d6/d9/d13/d1e/d2f/d98/dc4 0 2024-02-28T23:07:37.475 INFO:tasks.workunit.client.1.smithi184.stdout:3/616: truncate d1/d4/d6/d1f/d26/d3a/d59/d82/f9e 232304 0 2024-02-28T23:07:37.476 INFO:tasks.workunit.client.1.smithi184.stdout:3/617: stat d1/d4/d1c/d61 0 2024-02-28T23:07:37.477 INFO:tasks.workunit.client.1.smithi184.stdout:1/626: creat d20/d32/d3e/d82/d85/d86/fd7 x:0 0 0 2024-02-28T23:07:37.481 INFO:tasks.workunit.client.1.smithi184.stdout:1/627: write d20/d32/d4d/f7d [4272802,7990] 0 2024-02-28T23:07:37.483 INFO:tasks.workunit.client.1.smithi184.stdout:1/628: readlink d20/d32/d3e/l5b 0 2024-02-28T23:07:37.485 INFO:tasks.workunit.client.1.smithi184.stdout:7/567: mkdir d6/d9/dc5 0 2024-02-28T23:07:37.487 INFO:tasks.workunit.client.1.smithi184.stdout:0/625: dwrite d0/df/d13/f53 [0,4194304] 0 2024-02-28T23:07:37.488 INFO:tasks.workunit.client.1.smithi184.stdout:4/566: rename d1/dc/df/f31 to d1/dc/df/d27/fa8 0 2024-02-28T23:07:37.491 INFO:tasks.workunit.client.1.smithi184.stdout:4/567: chown d1/d8/d19/d67/d87/l8b 25994025 1 2024-02-28T23:07:37.494 INFO:tasks.workunit.client.1.smithi184.stdout:5/580: dwrite db/d12/f77 [0,4194304] 0 2024-02-28T23:07:37.496 INFO:tasks.workunit.client.1.smithi184.stdout:1/629: mknod d20/d32/d3e/d82/d85/d86/cd8 0 2024-02-28T23:07:37.497 INFO:tasks.workunit.client.1.smithi184.stdout:5/581: read - db/d12/d18/faf zero size 2024-02-28T23:07:37.498 INFO:tasks.workunit.client.1.smithi184.stdout:7/568: symlink d6/d9/d13/d1e/d2f/d33/d80/lc6 0 2024-02-28T23:07:37.499 INFO:tasks.workunit.client.1.smithi184.stdout:5/582: chown db/da1/ca3 123 1 2024-02-28T23:07:37.500 INFO:tasks.workunit.client.1.smithi184.stdout:0/626: symlink d0/d1d/ldb 0 2024-02-28T23:07:37.502 INFO:tasks.workunit.client.1.smithi184.stdout:0/627: chown d0/d7c 41339797 1 2024-02-28T23:07:37.506 INFO:tasks.workunit.client.0.smithi159.stdout:9/865: dread d4/f11 [0,4194304] 0 2024-02-28T23:07:37.506 INFO:tasks.workunit.client.1.smithi184.stdout:6/532: getdents dc/d60/d62 0 2024-02-28T23:07:37.506 INFO:tasks.workunit.client.0.smithi159.stdout:3/820: dread d0/def/d79/fd9 [0,4194304] 0 2024-02-28T23:07:37.518 INFO:tasks.workunit.client.0.smithi159.stdout:3/821: mkdir d0/d2b/d55/df8/da9/d103 0 2024-02-28T23:07:37.529 INFO:tasks.workunit.client.0.smithi159.stdout:3/822: mknod d0/d2b/d55/df8/c104 0 2024-02-28T23:07:37.531 INFO:tasks.workunit.client.0.smithi159.stdout:3/823: chown d0/d3f/dd2/d6a/fa0 1389 1 2024-02-28T23:07:37.534 INFO:tasks.workunit.client.1.smithi184.stdout:2/561: truncate d10/d1f/d21/d4d/d71/f9f 2314169 0 2024-02-28T23:07:37.534 INFO:tasks.workunit.client.1.smithi184.stdout:9/585: write d5/db/de/d10/d12/f2d [673794,129057] 0 2024-02-28T23:07:37.539 INFO:tasks.workunit.client.1.smithi184.stdout:2/562: readlink d10/d1f/d21/d4d/d71/l88 0 2024-02-28T23:07:37.541 INFO:tasks.workunit.client.1.smithi184.stdout:8/610: dwrite d1/da/dc/d18/f65 [0,4194304] 0 2024-02-28T23:07:37.541 INFO:tasks.workunit.client.1.smithi184.stdout:3/618: write d1/d4/f14 [2213142,31837] 0 2024-02-28T23:07:37.541 INFO:tasks.workunit.client.1.smithi184.stdout:4/568: dwrite d1/d8/d37/f4c [0,4194304] 0 2024-02-28T23:07:37.541 INFO:tasks.workunit.client.0.smithi159.stdout:9/866: write d4/d3d/d3e/d55/d4c/dee/f8d [385500,116749] 0 2024-02-28T23:07:37.544 INFO:tasks.workunit.client.1.smithi184.stdout:5/583: rename db/d12/d18/d2e/d3c/d72 to db/d12/d18/d2e/dc1 0 2024-02-28T23:07:37.546 INFO:tasks.workunit.client.1.smithi184.stdout:0/628: creat d0/df/d13/d27/d31/d51/fdc x:0 0 0 2024-02-28T23:07:37.550 INFO:tasks.workunit.client.1.smithi184.stdout:5/584: readlink db/d12/d1c/d80/l8b 0 2024-02-28T23:07:37.554 INFO:tasks.workunit.client.1.smithi184.stdout:9/586: getdents d5/db/de/d10/d12/dbb 0 2024-02-28T23:07:37.554 INFO:tasks.workunit.client.1.smithi184.stdout:7/569: dwrite d6/d9/d13/d14/f7b [0,4194304] 0 2024-02-28T23:07:37.557 INFO:tasks.workunit.client.1.smithi184.stdout:4/569: creat d1/dc/df/d5b/fa9 x:0 0 0 2024-02-28T23:07:37.558 INFO:tasks.workunit.client.1.smithi184.stdout:0/629: creat d0/d1d/d4c/fdd x:0 0 0 2024-02-28T23:07:37.561 INFO:tasks.workunit.client.1.smithi184.stdout:6/533: creat dc/d60/faa x:0 0 0 2024-02-28T23:07:37.566 INFO:tasks.workunit.client.1.smithi184.stdout:3/619: dwrite d1/d4/d6/d1f/fa5 [0,4194304] 0 2024-02-28T23:07:37.567 INFO:tasks.workunit.client.1.smithi184.stdout:8/611: mkdir d1/da/dc/d16/de7 0 2024-02-28T23:07:37.569 INFO:tasks.workunit.client.1.smithi184.stdout:3/620: fdatasync d1/d4/d6/d1f/d26/d3a/fa8 0 2024-02-28T23:07:37.571 INFO:tasks.workunit.client.1.smithi184.stdout:7/570: symlink d6/d9/d13/d3e/dad/lc7 0 2024-02-28T23:07:37.575 INFO:tasks.workunit.client.1.smithi184.stdout:0/630: rename d0/df/d13/d27/d31/db3/f5c to d0/df/d13/d5a/d95/fde 0 2024-02-28T23:07:37.577 INFO:tasks.workunit.client.0.smithi159.stdout:3/824: dwrite d0/d6/d34/f41 [0,4194304] 0 2024-02-28T23:07:37.577 INFO:tasks.workunit.client.1.smithi184.stdout:8/612: rmdir d1/da/d10/d6b 39 2024-02-28T23:07:37.577 INFO:tasks.workunit.client.1.smithi184.stdout:0/631: read d0/d1d/f35 [880732,48647] 0 2024-02-28T23:07:37.577 INFO:tasks.workunit.client.1.smithi184.stdout:0/632: stat d0/df/f96 0 2024-02-28T23:07:37.578 INFO:tasks.workunit.client.0.smithi159.stdout:3/825: readlink d0/d47/l9d 0 2024-02-28T23:07:37.581 INFO:tasks.workunit.client.1.smithi184.stdout:0/633: truncate d0/df/d13/d27/d31/d5b/fb1 466452 0 2024-02-28T23:07:37.582 INFO:tasks.workunit.client.1.smithi184.stdout:6/534: unlink dc/de/c46 0 2024-02-28T23:07:37.582 INFO:tasks.workunit.client.1.smithi184.stdout:9/587: dread d5/d26/d50/f35 [0,4194304] 0 2024-02-28T23:07:37.586 INFO:tasks.workunit.client.1.smithi184.stdout:3/621: creat d1/d4/d5/da9/d74/fbd x:0 0 0 2024-02-28T23:07:37.591 INFO:tasks.workunit.client.1.smithi184.stdout:7/571: symlink d6/d9/d13/d1e/d2f/d33/lc8 0 2024-02-28T23:07:37.592 INFO:tasks.workunit.client.1.smithi184.stdout:0/634: symlink d0/d7c/d8a/ldf 0 2024-02-28T23:07:37.594 INFO:tasks.workunit.client.0.smithi159.stdout:9/867: write d4/d76/fa3 [942418,22580] 0 2024-02-28T23:07:37.596 INFO:tasks.workunit.client.1.smithi184.stdout:6/535: rename dc/de/d2a/c3b to dc/d60/d7c/d61/cab 0 2024-02-28T23:07:37.599 INFO:tasks.workunit.client.1.smithi184.stdout:6/536: write dc/d60/d62/f82 [467084,98148] 0 2024-02-28T23:07:37.601 INFO:tasks.workunit.client.1.smithi184.stdout:2/563: write d10/f18 [328842,108299] 0 2024-02-28T23:07:37.603 INFO:tasks.workunit.client.1.smithi184.stdout:8/613: creat d1/da/dc/dc9/fe8 x:0 0 0 2024-02-28T23:07:37.604 INFO:tasks.workunit.client.1.smithi184.stdout:7/572: mkdir d6/d9/d13/d3e/dad/d7d/dc9 0 2024-02-28T23:07:37.604 INFO:tasks.workunit.client.1.smithi184.stdout:6/537: dread - dc/de/d2a/d5c/d79/d87/f9f zero size 2024-02-28T23:07:37.606 INFO:tasks.workunit.client.1.smithi184.stdout:8/614: dread - d1/da/dc/d16/d4d/fe5 zero size 2024-02-28T23:07:37.606 INFO:tasks.workunit.client.1.smithi184.stdout:6/538: chown dc/de/d10 15 1 2024-02-28T23:07:37.615 INFO:tasks.workunit.client.1.smithi184.stdout:5/585: dwrite db/d1f/f42 [0,4194304] 0 2024-02-28T23:07:37.615 INFO:tasks.workunit.client.1.smithi184.stdout:3/622: creat d1/d4/d6/fbe x:0 0 0 2024-02-28T23:07:37.616 INFO:tasks.workunit.client.0.smithi159.stdout:3/826: write d0/d6/d34/f41 [5117564,118738] 0 2024-02-28T23:07:37.616 INFO:tasks.workunit.client.0.smithi159.stdout:9/868: dwrite d4/d3d/d3e/d4a/f56 [0,4194304] 0 2024-02-28T23:07:37.622 INFO:tasks.workunit.client.1.smithi184.stdout:0/635: rename d0/df/d13/f14 to d0/df/d13/d27/d31/d5b/d8e/d92/fe0 0 2024-02-28T23:07:37.623 INFO:tasks.workunit.client.1.smithi184.stdout:6/539: creat dc/de/d2a/d5c/d79/fac x:0 0 0 2024-02-28T23:07:37.626 INFO:tasks.workunit.client.1.smithi184.stdout:4/570: truncate d1/dc/df/f16 12299357 0 2024-02-28T23:07:37.629 INFO:tasks.workunit.client.1.smithi184.stdout:0/636: fsync d0/df/f63 0 2024-02-28T23:07:37.631 INFO:tasks.workunit.client.0.smithi159.stdout:9/869: rename d4/d3d/d3e/d4a/fab to d4/d3d/d3e/d55/d37/d62/db0/f110 0 2024-02-28T23:07:37.632 INFO:tasks.workunit.client.1.smithi184.stdout:9/588: dread d5/fc [0,4194304] 0 2024-02-28T23:07:37.634 INFO:tasks.workunit.client.1.smithi184.stdout:1/630: sync 2024-02-28T23:07:37.634 INFO:tasks.workunit.client.1.smithi184.stdout:1/631: readlink d20/d32/lab 0 2024-02-28T23:07:37.636 INFO:tasks.workunit.client.0.smithi159.stdout:3/827: symlink d0/d6/l105 0 2024-02-28T23:07:37.638 INFO:tasks.workunit.client.1.smithi184.stdout:5/586: symlink db/d12/d50/d9e/lc2 0 2024-02-28T23:07:37.641 INFO:tasks.workunit.client.1.smithi184.stdout:3/623: rename d1/d4/d6/f53 to d1/d4/d1c/d61/d87/fbf 0 2024-02-28T23:07:37.643 INFO:tasks.workunit.client.1.smithi184.stdout:4/571: readlink d1/dc/df/d3b/la2 0 2024-02-28T23:07:37.644 INFO:tasks.workunit.client.0.smithi159.stdout:9/870: rename d4/d3d/d3e/d55/d37/d62/d107/dc1 to d4/d3d/d3e/d55/d37/d62/db0/d111 0 2024-02-28T23:07:37.646 INFO:tasks.workunit.client.1.smithi184.stdout:2/564: dread d10/d1f/f41 [0,4194304] 0 2024-02-28T23:07:37.646 INFO:tasks.workunit.client.0.smithi159.stdout:9/871: read d4/f5 [1234873,27731] 0 2024-02-28T23:07:37.647 INFO:tasks.workunit.client.1.smithi184.stdout:4/572: truncate d1/d4/d43/d73/f91 692323 0 2024-02-28T23:07:37.647 INFO:tasks.workunit.client.0.smithi159.stdout:3/828: unlink d0/f4c 0 2024-02-28T23:07:37.648 INFO:tasks.workunit.client.1.smithi184.stdout:7/573: write d6/d9/d13/d1e/fbc [538918,124252] 0 2024-02-28T23:07:37.649 INFO:tasks.workunit.client.1.smithi184.stdout:2/565: chown d10/d1f/d21/d4d/d67/c78 2738 1 2024-02-28T23:07:37.650 INFO:tasks.workunit.client.1.smithi184.stdout:1/632: dwrite d20/d32/d3e/f7c [0,4194304] 0 2024-02-28T23:07:37.653 INFO:tasks.workunit.client.1.smithi184.stdout:0/637: rmdir d0/d1d/d4c/d93 39 2024-02-28T23:07:37.656 INFO:tasks.workunit.client.0.smithi159.stdout:3/829: dread d0/d2b/d55/fe4 [0,4194304] 0 2024-02-28T23:07:37.662 INFO:tasks.workunit.client.1.smithi184.stdout:1/633: dread d20/d46/d90/db3/fc4 [0,4194304] 0 2024-02-28T23:07:37.662 INFO:tasks.workunit.client.1.smithi184.stdout:8/615: write d1/da/dc/d16/d32/f98 [886568,72756] 0 2024-02-28T23:07:37.666 INFO:tasks.workunit.client.1.smithi184.stdout:6/540: rename dc/de/d56 to dc/de/d2a/d8e/dad 0 2024-02-28T23:07:37.669 INFO:tasks.workunit.client.0.smithi159.stdout:9/872: creat d4/d3d/d3e/d55/d4c/d4e/dbe/f112 x:0 0 0 2024-02-28T23:07:37.671 INFO:tasks.workunit.client.1.smithi184.stdout:6/541: write dc/f97 [523996,104421] 0 2024-02-28T23:07:37.673 INFO:tasks.workunit.client.1.smithi184.stdout:2/566: fsync d10/f34 0 2024-02-28T23:07:37.676 INFO:tasks.workunit.client.1.smithi184.stdout:9/589: dread d5/db/f20 [0,4194304] 0 2024-02-28T23:07:37.679 INFO:tasks.workunit.client.1.smithi184.stdout:1/634: creat d20/d32/d3e/d61/fd9 x:0 0 0 2024-02-28T23:07:37.680 INFO:tasks.workunit.client.1.smithi184.stdout:2/567: read d10/d1f/f32 [2503977,45440] 0 2024-02-28T23:07:37.683 INFO:tasks.workunit.client.0.smithi159.stdout:6/880: sync 2024-02-28T23:07:37.684 INFO:tasks.workunit.client.0.smithi159.stdout:1/930: sync 2024-02-28T23:07:37.684 INFO:tasks.workunit.client.0.smithi159.stdout:7/741: sync 2024-02-28T23:07:37.689 INFO:tasks.workunit.client.1.smithi184.stdout:5/587: rename db/d44/f82 to db/d12/d1c/fc3 0 2024-02-28T23:07:37.690 INFO:tasks.workunit.client.0.smithi159.stdout:3/830: write d0/d47/fbc [6727976,72752] 0 2024-02-28T23:07:37.694 INFO:tasks.workunit.client.0.smithi159.stdout:7/742: rename d5/d16/d1a/d27/d37/c93 to d5/d16/d1a/d27/d37/ced 0 2024-02-28T23:07:37.695 INFO:tasks.workunit.client.1.smithi184.stdout:3/624: dread d1/d4/d1c/d61/d87/fbf [4194304,4194304] 0 2024-02-28T23:07:37.696 INFO:tasks.workunit.client.0.smithi159.stdout:3/831: rmdir d0/d6/d34 39 2024-02-28T23:07:37.696 INFO:tasks.workunit.client.1.smithi184.stdout:2/568: dwrite d10/fa7 [0,4194304] 0 2024-02-28T23:07:37.697 INFO:tasks.workunit.client.0.smithi159.stdout:7/743: chown d5/d56/d50/d5b/c82 3154020 1 2024-02-28T23:07:37.701 INFO:tasks.workunit.client.0.smithi159.stdout:9/873: truncate d4/d76/f98 2197449 0 2024-02-28T23:07:37.702 INFO:tasks.workunit.client.1.smithi184.stdout:9/590: read d5/db/de/d10/f30 [9636,38732] 0 2024-02-28T23:07:37.702 INFO:tasks.workunit.client.0.smithi159.stdout:6/881: write d0/d1b/d33/d11/d34/d9d/da2/d4d/f58 [157788,79174] 0 2024-02-28T23:07:37.705 INFO:tasks.workunit.client.1.smithi184.stdout:0/638: dread d0/d1f/f4b [0,4194304] 0 2024-02-28T23:07:37.705 INFO:tasks.workunit.client.1.smithi184.stdout:1/635: creat d20/d32/d3e/d91/fda x:0 0 0 2024-02-28T23:07:37.707 INFO:tasks.workunit.client.1.smithi184.stdout:8/616: mkdir d1/da/dc/d16/d32/d42/d77/ddd/de9 0 2024-02-28T23:07:37.717 INFO:tasks.workunit.client.1.smithi184.stdout:3/625: creat d1/d4/d1c/d61/fc0 x:0 0 0 2024-02-28T23:07:37.717 INFO:tasks.workunit.client.1.smithi184.stdout:3/626: stat d1/d4/f14 0 2024-02-28T23:07:37.718 INFO:tasks.workunit.client.1.smithi184.stdout:9/591: truncate d5/db/de/d10/f30 538743 0 2024-02-28T23:07:37.719 INFO:tasks.workunit.client.1.smithi184.stdout:3/627: read - d1/f98 zero size 2024-02-28T23:07:37.719 INFO:tasks.workunit.client.1.smithi184.stdout:1/636: dread - d20/d46/f89 zero size 2024-02-28T23:07:37.720 INFO:tasks.workunit.client.1.smithi184.stdout:0/639: mkdir d0/df/d13/d27/d58/de1 0 2024-02-28T23:07:37.725 INFO:tasks.workunit.client.1.smithi184.stdout:6/542: link dc/de/d10/c8c dc/de/d2a/cae 0 2024-02-28T23:07:37.726 INFO:tasks.workunit.client.1.smithi184.stdout:7/574: getdents d6/d9/d13/d14 0 2024-02-28T23:07:37.728 INFO:tasks.workunit.client.1.smithi184.stdout:9/592: rename d5/d47/d4a/c32 to d5/d17/d57/cbf 0 2024-02-28T23:07:37.729 INFO:tasks.workunit.client.1.smithi184.stdout:3/628: mkdir d1/d4/d6/d1f/d26/d3a/d59/d67/dc1 0 2024-02-28T23:07:37.782 INFO:tasks.workunit.client.0.smithi159.stdout:6/882: write d0/d1b/d33/f43 [994502,113185] 0 2024-02-28T23:07:37.782 INFO:tasks.workunit.client.0.smithi159.stdout:7/744: write d5/d16/d1a/d27/d3e/f76 [5228386,118798] 0 2024-02-28T23:07:37.782 INFO:tasks.workunit.client.0.smithi159.stdout:9/874: read - d4/d3d/d3e/d55/d4c/d4e/d6b/db5/fd9 zero size 2024-02-28T23:07:37.785 INFO:tasks.workunit.client.1.smithi184.stdout:5/588: fsync db/d12/d1c/d21/d25/f69 0 2024-02-28T23:07:37.785 INFO:tasks.workunit.client.0.smithi159.stdout:7/745: readlink d5/d16/d1a/d27/d75/l7e 0 2024-02-28T23:07:37.787 INFO:tasks.workunit.client.0.smithi159.stdout:6/883: mkdir d0/d1b/d33/d123 0 2024-02-28T23:07:37.790 INFO:tasks.workunit.client.0.smithi159.stdout:3/832: dread d0/d47/fbc [0,4194304] 0 2024-02-28T23:07:37.793 INFO:tasks.workunit.client.0.smithi159.stdout:9/875: creat d4/d3d/d3e/f113 x:0 0 0 2024-02-28T23:07:37.799 INFO:tasks.workunit.client.1.smithi184.stdout:2/569: write d10/d1f/d38/d54/f69 [5784845,59686] 0 2024-02-28T23:07:37.800 INFO:tasks.workunit.client.0.smithi159.stdout:3/833: mkdir d0/d2b/d55/df8/da9/d103/d106 0 2024-02-28T23:07:37.806 INFO:tasks.workunit.client.0.smithi159.stdout:9/876: symlink d4/d3d/d3e/d55/d4c/d4e/l114 0 2024-02-28T23:07:37.806 INFO:tasks.workunit.client.1.smithi184.stdout:3/629: truncate d1/fb5 850131 0 2024-02-28T23:07:37.808 INFO:tasks.workunit.client.0.smithi159.stdout:3/834: creat d0/d2b/d55/d75/d6d/f107 x:0 0 0 2024-02-28T23:07:37.809 INFO:tasks.workunit.client.0.smithi159.stdout:7/746: dwrite d5/d16/f1f [0,4194304] 0 2024-02-28T23:07:37.810 INFO:tasks.workunit.client.0.smithi159.stdout:6/884: getdents d0/d1b/d5b 0 2024-02-28T23:07:37.812 INFO:tasks.workunit.client.1.smithi184.stdout:8/617: dread d1/da/dc/d16/d4d/f8b [0,4194304] 0 2024-02-28T23:07:37.812 INFO:tasks.workunit.client.0.smithi159.stdout:9/877: dread - d4/d3d/d3e/d55/d4c/d4e/dbe/f112 zero size 2024-02-28T23:07:37.814 INFO:tasks.workunit.client.1.smithi184.stdout:1/637: dwrite d20/d32/f48 [4194304,4194304] 0 2024-02-28T23:07:37.816 INFO:tasks.workunit.client.1.smithi184.stdout:9/593: truncate d5/db/de/d10/d12/d2f/d3f/d8d/fa9 334904 0 2024-02-28T23:07:37.816 INFO:tasks.workunit.client.0.smithi159.stdout:7/747: mkdir d5/d16/d1a/d27/d3e/dee 0 2024-02-28T23:07:37.817 INFO:tasks.workunit.client.1.smithi184.stdout:3/630: chown d1/d4/d6/d1f/d26/d3a/f4d 193 1 2024-02-28T23:07:37.818 INFO:tasks.workunit.client.1.smithi184.stdout:9/594: chown d5/db/d5c 29841 1 2024-02-28T23:07:37.819 INFO:tasks.workunit.client.1.smithi184.stdout:7/575: dwrite d6/d9/d13/f28 [0,4194304] 0 2024-02-28T23:07:37.820 INFO:tasks.workunit.client.0.smithi159.stdout:3/835: symlink d0/d3f/dd2/d6a/de7/l108 0 2024-02-28T23:07:37.823 INFO:tasks.workunit.client.0.smithi159.stdout:6/885: mkdir d0/d1b/d33/d11/d34/d9d/da2/d4e/d124 0 2024-02-28T23:07:37.829 INFO:tasks.workunit.client.0.smithi159.stdout:7/748: unlink d5/d16/d1a/d27/deb/f36 0 2024-02-28T23:07:37.830 INFO:tasks.workunit.client.1.smithi184.stdout:4/573: sync 2024-02-28T23:07:37.832 INFO:tasks.workunit.client.0.smithi159.stdout:3/836: symlink d0/def/d79/d9b/l109 0 2024-02-28T23:07:37.840 INFO:tasks.workunit.client.1.smithi184.stdout:9/595: dread d5/db/de/d10/d12/f9e [0,4194304] 0 2024-02-28T23:07:37.844 INFO:tasks.workunit.client.0.smithi159.stdout:3/837: mkdir d0/d2b/d55/d10a 0 2024-02-28T23:07:37.847 INFO:tasks.workunit.client.0.smithi159.stdout:6/886: mknod d0/d1b/d33/d11/d34/d9d/da2/dcf/c125 0 2024-02-28T23:07:37.852 INFO:tasks.workunit.client.1.smithi184.stdout:6/543: mknod dc/d60/caf 0 2024-02-28T23:07:37.853 INFO:tasks.workunit.client.0.smithi159.stdout:3/838: rename d0/d2b/d55/df8/d2f/d78/f101 to d0/d47/d88/f10b 0 2024-02-28T23:07:37.854 INFO:tasks.workunit.client.0.smithi159.stdout:5/896: sync 2024-02-28T23:07:37.854 INFO:tasks.workunit.client.0.smithi159.stdout:2/807: sync 2024-02-28T23:07:37.857 INFO:tasks.workunit.client.0.smithi159.stdout:5/897: stat d8/d19/d23/d35/d41/daa/d88/f101 0 2024-02-28T23:07:37.858 INFO:tasks.workunit.client.1.smithi184.stdout:5/589: chown db/d12/d1c/d21/c6d 1127 1 2024-02-28T23:07:37.859 INFO:tasks.workunit.client.1.smithi184.stdout:0/640: sync 2024-02-28T23:07:37.860 INFO:tasks.workunit.client.1.smithi184.stdout:2/570: creat d10/d1f/d21/d5e/fb4 x:0 0 0 2024-02-28T23:07:37.861 INFO:tasks.workunit.client.1.smithi184.stdout:5/590: chown db/d12/d1c/d21/d2f/c73 3316 1 2024-02-28T23:07:37.868 INFO:tasks.workunit.client.0.smithi159.stdout:6/887: mkdir d0/d1b/d33/d11/d34/d9d/da2/d4e/d126 0 2024-02-28T23:07:37.870 INFO:tasks.workunit.client.1.smithi184.stdout:1/638: symlink d20/d32/d3e/d82/d85/d8c/ldb 0 2024-02-28T23:07:37.875 INFO:tasks.workunit.client.0.smithi159.stdout:7/749: dread d5/f1e [0,4194304] 0 2024-02-28T23:07:37.875 INFO:tasks.workunit.client.0.smithi159.stdout:9/878: write d4/d3d/d3e/d55/f29 [1374235,127931] 0 2024-02-28T23:07:37.876 INFO:tasks.workunit.client.1.smithi184.stdout:7/576: read - d6/d9/d13/d14/d45/f8c zero size 2024-02-28T23:07:37.877 INFO:tasks.workunit.client.0.smithi159.stdout:7/750: read - d5/d56/d2a/f97 zero size 2024-02-28T23:07:37.878 INFO:tasks.workunit.client.0.smithi159.stdout:6/888: fsync d0/d1b/d33/d11/d34/d9d/ffe 0 2024-02-28T23:07:37.880 INFO:tasks.workunit.client.1.smithi184.stdout:6/544: dread dc/de/d10/f38 [0,4194304] 0 2024-02-28T23:07:37.880 INFO:tasks.workunit.client.1.smithi184.stdout:7/577: chown d6/d9/fb3 639 1 2024-02-28T23:07:37.882 INFO:tasks.workunit.client.1.smithi184.stdout:6/545: chown dc/d60/l67 178093913 1 2024-02-28T23:07:37.891 INFO:tasks.workunit.client.1.smithi184.stdout:5/591: read db/f61 [680220,7576] 0 2024-02-28T23:07:37.891 INFO:tasks.workunit.client.1.smithi184.stdout:0/641: mknod d0/df/d13/d27/d31/ce2 0 2024-02-28T23:07:37.893 INFO:tasks.workunit.client.0.smithi159.stdout:7/751: unlink d5/d16/d1a/d27/d46/f66 0 2024-02-28T23:07:37.896 INFO:tasks.workunit.client.0.smithi159.stdout:2/808: rename d9/d23/d2c/f4a to d9/d50/d62/f119 0 2024-02-28T23:07:37.898 INFO:tasks.workunit.client.1.smithi184.stdout:8/618: symlink d1/da/df/lea 0 2024-02-28T23:07:37.898 INFO:tasks.workunit.client.0.smithi159.stdout:5/898: link d8/d19/d23/d35/d41/daa/d88/f10f d8/d19/d23/d35/d65/da3/df4/da5/d90/f13d 0 2024-02-28T23:07:37.900 INFO:tasks.workunit.client.0.smithi159.stdout:3/839: getdents d0/d2b/d55/d75 0 2024-02-28T23:07:37.902 INFO:tasks.workunit.client.1.smithi184.stdout:1/639: read d20/f2c [1673805,90154] 0 2024-02-28T23:07:37.902 INFO:tasks.workunit.client.1.smithi184.stdout:3/631: rename d1/d4/d5/da9/d74/f96 to d1/d4/d6/d1f/d24/d76/fc2 0 2024-02-28T23:07:37.904 INFO:tasks.workunit.client.0.smithi159.stdout:7/752: mknod d5/d16/d1a/d27/d37/cef 0 2024-02-28T23:07:37.908 INFO:tasks.workunit.client.1.smithi184.stdout:9/596: creat d5/d47/d59/d92/fc0 x:0 0 0 2024-02-28T23:07:37.912 INFO:tasks.workunit.client.0.smithi159.stdout:9/879: dwrite d4/d3d/d3e/d55/f46 [4194304,4194304] 0 2024-02-28T23:07:37.912 INFO:tasks.workunit.client.0.smithi159.stdout:6/889: rename d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/fb4 to d0/d1b/d33/d11/d34/f127 0 2024-02-28T23:07:37.914 INFO:tasks.workunit.client.1.smithi184.stdout:7/578: creat d6/d9/d13/d3e/dad/d49/da6/daf/fca x:0 0 0 2024-02-28T23:07:37.922 INFO:tasks.workunit.client.0.smithi159.stdout:7/753: write d5/d56/fe4 [4783010,113650] 0 2024-02-28T23:07:37.925 INFO:tasks.workunit.client.1.smithi184.stdout:5/592: mkdir db/d12/d1c/d21/d2f/dc4 0 2024-02-28T23:07:37.926 INFO:tasks.workunit.client.0.smithi159.stdout:3/840: mkdir d0/d2b/d55/df8/d10c 0 2024-02-28T23:07:37.927 INFO:tasks.workunit.client.1.smithi184.stdout:0/642: rmdir d0/df/d13/d27/d31/d5b/d8e/d92 39 2024-02-28T23:07:37.928 INFO:tasks.workunit.client.0.smithi159.stdout:6/890: truncate d0/d1b/d33/d11/d34/d9d/da2/fca 4838905 0 2024-02-28T23:07:37.930 INFO:tasks.workunit.client.0.smithi159.stdout:1/931: sync 2024-02-28T23:07:37.931 INFO:tasks.workunit.client.0.smithi159.stdout:2/809: symlink d9/d50/d54/d84/d37/l11a 0 2024-02-28T23:07:37.932 INFO:tasks.workunit.client.0.smithi159.stdout:6/891: dread - d0/d1b/d33/d11/d34/d9d/ffe zero size 2024-02-28T23:07:37.933 INFO:tasks.workunit.client.1.smithi184.stdout:1/640: symlink d20/d32/d3e/d82/d85/d8c/ldc 0 2024-02-28T23:07:37.933 INFO:tasks.workunit.client.1.smithi184.stdout:6/546: mknod dc/de/d10/cb0 0 2024-02-28T23:07:37.934 INFO:tasks.workunit.client.1.smithi184.stdout:0/643: read d0/d1d/f6d [3464936,48062] 0 2024-02-28T23:07:37.935 INFO:tasks.workunit.client.0.smithi159.stdout:7/754: fsync d5/d16/d1a/d27/deb/d60/f94 0 2024-02-28T23:07:37.937 INFO:tasks.workunit.client.0.smithi159.stdout:2/810: chown d9/d50/d54/d84/d37/d5c 2 1 2024-02-28T23:07:37.939 INFO:tasks.workunit.client.1.smithi184.stdout:9/597: rename d5/d26/d50/f53 to d5/db/de/d10/d6a/fc1 0 2024-02-28T23:07:37.940 INFO:tasks.workunit.client.1.smithi184.stdout:4/574: dwrite d1/dc/df/d27/fa8 [0,4194304] 0 2024-02-28T23:07:37.941 INFO:tasks.workunit.client.0.smithi159.stdout:3/841: creat d0/d2b/d55/df8/d2f/ddf/f10d x:0 0 0 2024-02-28T23:07:37.944 INFO:tasks.workunit.client.1.smithi184.stdout:7/579: unlink d6/d9/d13/d14/d45/l4a 0 2024-02-28T23:07:37.950 INFO:tasks.workunit.client.0.smithi159.stdout:2/811: dread d9/d23/da9/fb4 [0,4194304] 0 2024-02-28T23:07:37.951 INFO:tasks.workunit.client.0.smithi159.stdout:5/899: getdents d8/d19/d23/d35/d38 0 2024-02-28T23:07:37.955 INFO:tasks.workunit.client.0.smithi159.stdout:5/900: chown d8/d19/d23/d35/d41/daa/d88 574629 1 2024-02-28T23:07:37.962 INFO:tasks.workunit.client.0.smithi159.stdout:7/755: unlink d5/d16/d1a/d27/d46/d65/d81/d83/d9d/fe1 0 2024-02-28T23:07:37.963 INFO:tasks.workunit.client.1.smithi184.stdout:6/547: dwrite dc/f97 [0,4194304] 0 2024-02-28T23:07:37.964 INFO:tasks.workunit.client.0.smithi159.stdout:6/892: mknod d0/d1b/d33/d11/d34/d9d/da2/db7/db1/d114/c128 0 2024-02-28T23:07:37.967 INFO:tasks.workunit.client.1.smithi184.stdout:1/641: readlink d20/d32/d3e/l5f 0 2024-02-28T23:07:37.968 INFO:tasks.workunit.client.0.smithi159.stdout:3/842: unlink d0/d2b/d55/df8/c1b 0 2024-02-28T23:07:37.971 INFO:tasks.workunit.client.1.smithi184.stdout:1/642: dread d20/d32/f44 [0,4194304] 0 2024-02-28T23:07:37.973 INFO:tasks.workunit.client.0.smithi159.stdout:1/932: mknod d6/d12/d16/de3/df4/c13c 0 2024-02-28T23:07:37.973 INFO:tasks.workunit.client.1.smithi184.stdout:1/643: write d20/d32/d3e/fc7 [594584,39548] 0 2024-02-28T23:07:37.986 INFO:tasks.workunit.client.1.smithi184.stdout:9/598: dread d5/d47/d4a/f82 [0,4194304] 0 2024-02-28T23:07:37.993 INFO:tasks.workunit.client.0.smithi159.stdout:5/901: rename d8/d19/d23/d35/d65/da3/df4/da5/d90/f96 to d8/d19/d23/d35/d65/da3/df4/da5/d90/f13e 0 2024-02-28T23:07:37.994 INFO:tasks.workunit.client.1.smithi184.stdout:2/571: getdents d10/d1f/d38/d54/d96 0 2024-02-28T23:07:37.995 INFO:tasks.workunit.client.1.smithi184.stdout:2/572: chown d10/d1f/d21/d5e 10889 1 2024-02-28T23:07:37.995 INFO:tasks.workunit.client.0.smithi159.stdout:5/902: chown d8/d19/d23/d35/d65/da3/df4/da5 82703521 1 2024-02-28T23:07:37.996 INFO:tasks.workunit.client.1.smithi184.stdout:8/619: creat d1/da/dc/d16/d29/feb x:0 0 0 2024-02-28T23:07:37.998 INFO:tasks.workunit.client.1.smithi184.stdout:2/573: chown d10/d1f/d21/d6a/l92 0 1 2024-02-28T23:07:37.998 INFO:tasks.workunit.client.1.smithi184.stdout:6/548: symlink dc/d60/d62/lb1 0 2024-02-28T23:07:37.998 INFO:tasks.workunit.client.0.smithi159.stdout:7/756: chown d5/d16/d1a/d27/d75/dac/dbe/lc2 994887 1 2024-02-28T23:07:37.998 INFO:tasks.workunit.client.0.smithi159.stdout:5/903: dread - d8/d19/d23/d35/d65/f136 zero size 2024-02-28T23:07:37.999 INFO:tasks.workunit.client.1.smithi184.stdout:8/620: write d1/da/d10/fca [466573,65682] 0 2024-02-28T23:07:38.001 INFO:tasks.workunit.client.1.smithi184.stdout:3/632: sync 2024-02-28T23:07:38.003 INFO:tasks.workunit.client.0.smithi159.stdout:2/812: fsync d9/d50/faa 0 2024-02-28T23:07:38.005 INFO:tasks.workunit.client.0.smithi159.stdout:3/843: dread d0/d3f/fb5 [0,4194304] 0 2024-02-28T23:07:38.007 INFO:tasks.workunit.client.0.smithi159.stdout:6/893: rename d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/l7e to d0/d1b/d33/d11/d34/d9d/da2/dbf/l129 0 2024-02-28T23:07:38.008 INFO:tasks.workunit.client.1.smithi184.stdout:3/633: write d1/d4/d6/d1e/d72/f99 [385428,22377] 0 2024-02-28T23:07:38.009 INFO:tasks.workunit.client.1.smithi184.stdout:3/634: fdatasync d1/d4/fb 0 2024-02-28T23:07:38.011 INFO:tasks.workunit.client.1.smithi184.stdout:9/599: dwrite d5/d26/d50/f38 [0,4194304] 0 2024-02-28T23:07:38.012 INFO:tasks.workunit.client.0.smithi159.stdout:1/933: symlink d6/d1d/l13d 0 2024-02-28T23:07:38.018 INFO:tasks.workunit.client.1.smithi184.stdout:5/593: rename db/d1f/c6c to db/d12/cc5 0 2024-02-28T23:07:38.018 INFO:tasks.workunit.client.0.smithi159.stdout:6/894: read d0/d1b/d33/d11/d34/d9d/da2/f61 [257900,33563] 0 2024-02-28T23:07:38.019 INFO:tasks.workunit.client.1.smithi184.stdout:5/594: stat db/d12/d1c 0 2024-02-28T23:07:38.020 INFO:tasks.workunit.client.1.smithi184.stdout:8/621: truncate d1/da/df/d20/f30 194973 0 2024-02-28T23:07:38.021 INFO:tasks.workunit.client.1.smithi184.stdout:1/644: symlink d20/d32/d3e/dc9/ldd 0 2024-02-28T23:07:38.022 INFO:tasks.workunit.client.1.smithi184.stdout:8/622: chown d1/da/dc/d16/de7 42366 1 2024-02-28T23:07:38.023 INFO:tasks.workunit.client.0.smithi159.stdout:2/813: unlink d9/d50/dcc/f5d 0 2024-02-28T23:07:38.024 INFO:tasks.workunit.client.0.smithi159.stdout:6/895: readlink d0/d1b/d33/d11/d34/la5 0 2024-02-28T23:07:38.025 INFO:tasks.workunit.client.0.smithi159.stdout:3/844: creat d0/d6/d34/f10e x:0 0 0 2024-02-28T23:07:38.025 INFO:tasks.workunit.client.1.smithi184.stdout:8/623: chown d1/da/dc/d16/d32/d42/d77/f90 1001150108 1 2024-02-28T23:07:38.028 INFO:tasks.workunit.client.1.smithi184.stdout:9/600: mkdir d5/db/d65/dc2 0 2024-02-28T23:07:38.035 INFO:tasks.workunit.client.0.smithi159.stdout:2/814: mknod d9/d23/c11b 0 2024-02-28T23:07:38.037 INFO:tasks.workunit.client.1.smithi184.stdout:6/549: link dc/de/f36 dc/d60/d78/fb2 0 2024-02-28T23:07:38.037 INFO:tasks.workunit.client.0.smithi159.stdout:2/815: chown d9/d36/d59 0 1 2024-02-28T23:07:38.038 INFO:tasks.workunit.client.1.smithi184.stdout:0/644: rename d0/df/d13/d5a to d0/d1f/de3 0 2024-02-28T23:07:38.041 INFO:tasks.workunit.client.0.smithi159.stdout:1/934: creat d6/d1d/d1f/db8/dcc/f13e x:0 0 0 2024-02-28T23:07:38.043 INFO:tasks.workunit.client.1.smithi184.stdout:1/645: symlink d20/d32/d3e/dc9/lde 0 2024-02-28T23:07:38.046 INFO:tasks.workunit.client.1.smithi184.stdout:4/575: truncate d1/d8/d3d/f74 1054126 0 2024-02-28T23:07:38.047 INFO:tasks.workunit.client.1.smithi184.stdout:1/646: read d20/d46/f6c [15831,126098] 0 2024-02-28T23:07:38.048 INFO:tasks.workunit.client.0.smithi159.stdout:6/896: rmdir d0/d1b/d33/d11/d34/d9d/da2/dbf 39 2024-02-28T23:07:38.048 INFO:tasks.workunit.client.1.smithi184.stdout:5/595: dwrite db/da1/fb4 [0,4194304] 0 2024-02-28T23:07:38.055 INFO:tasks.workunit.client.0.smithi159.stdout:2/816: stat d9/d50/d54/l89 0 2024-02-28T23:07:38.067 INFO:tasks.workunit.client.0.smithi159.stdout:5/904: dwrite d8/d19/d23/fdb [0,4194304] 0 2024-02-28T23:07:38.070 INFO:tasks.workunit.client.1.smithi184.stdout:9/601: dread d5/db/de/d10/d12/d2f/f51 [0,4194304] 0 2024-02-28T23:07:38.070 INFO:tasks.workunit.client.1.smithi184.stdout:2/574: rename d10/d1f/d21/d4d/d71 to d10/d55/d89/db5 0 2024-02-28T23:07:38.071 INFO:tasks.workunit.client.0.smithi159.stdout:1/935: truncate d6/d1d/d46/d88/dd3/d63/f66 587677 0 2024-02-28T23:07:38.071 INFO:tasks.workunit.client.0.smithi159.stdout:7/757: dwrite d5/d16/d1a/d27/deb/d60/f94 [0,4194304] 0 2024-02-28T23:07:38.071 INFO:tasks.workunit.client.0.smithi159.stdout:3/845: dwrite d0/d3f/dd2/d6a/ddd/ffe [0,4194304] 0 2024-02-28T23:07:38.075 INFO:tasks.workunit.client.1.smithi184.stdout:7/580: write d6/d9/d13/d3e/dad/d49/da6/daf/d47/f56 [3832178,4792] 0 2024-02-28T23:07:38.077 INFO:tasks.workunit.client.1.smithi184.stdout:7/581: chown d6/l25 45848 1 2024-02-28T23:07:38.080 INFO:tasks.workunit.client.1.smithi184.stdout:7/582: write d6/d9/d13/f1f [2160232,36155] 0 2024-02-28T23:07:38.081 INFO:tasks.workunit.client.1.smithi184.stdout:3/635: dwrite d1/d4/d1c/d61/d87/f8b [0,4194304] 0 2024-02-28T23:07:38.082 INFO:tasks.workunit.client.0.smithi159.stdout:9/880: sync 2024-02-28T23:07:38.083 INFO:tasks.workunit.client.1.smithi184.stdout:0/645: fdatasync d0/d1f/de3/f70 0 2024-02-28T23:07:38.087 INFO:tasks.workunit.client.1.smithi184.stdout:0/646: write d0/df/d13/d27/d31/d51/d85/fc0 [993417,81643] 0 2024-02-28T23:07:38.088 INFO:tasks.workunit.client.0.smithi159.stdout:1/936: write d6/d12/d1a/d92/d97/f10f [942092,119381] 0 2024-02-28T23:07:38.089 INFO:tasks.workunit.client.1.smithi184.stdout:0/647: stat d0/df/d13/f29 0 2024-02-28T23:07:38.094 INFO:tasks.workunit.client.1.smithi184.stdout:8/624: rename d1/da/dc/d16/d32/fa5 to d1/da/dc/d16/d29/d92/fec 0 2024-02-28T23:07:38.095 INFO:tasks.workunit.client.1.smithi184.stdout:8/625: stat d1/da/d10/f2d 0 2024-02-28T23:07:38.096 INFO:tasks.workunit.client.1.smithi184.stdout:9/602: truncate d5/db/f20 1636468 0 2024-02-28T23:07:38.107 INFO:tasks.workunit.client.1.smithi184.stdout:3/636: unlink d1/d4/d6/d1f/d26/f78 0 2024-02-28T23:07:38.111 INFO:tasks.workunit.client.1.smithi184.stdout:3/637: write d1/d4/d6/d1f/d26/d3a/d59/d82/f9e [145579,126691] 0 2024-02-28T23:07:38.114 INFO:tasks.workunit.client.1.smithi184.stdout:4/576: truncate d1/dc/df/f82 627992 0 2024-02-28T23:07:38.119 INFO:tasks.workunit.client.1.smithi184.stdout:7/583: rename d6/d9/da/f10 to d6/d9/d13/d3e/dad/d49/d9c/fcb 0 2024-02-28T23:07:38.120 INFO:tasks.workunit.client.1.smithi184.stdout:7/584: readlink d6/d9/da/l23 0 2024-02-28T23:07:38.122 INFO:tasks.workunit.client.1.smithi184.stdout:8/626: unlink d1/da/dc/d16/d32/d80/fd6 0 2024-02-28T23:07:38.144 INFO:tasks.workunit.client.1.smithi184.stdout:3/638: mknod d1/d4/d6/d1f/d24/cc3 0 2024-02-28T23:07:38.146 INFO:tasks.workunit.client.1.smithi184.stdout:3/639: write d1/d4/d1c/d61/d87/f8b [1096823,8232] 0 2024-02-28T23:07:38.151 INFO:tasks.workunit.client.1.smithi184.stdout:4/577: unlink d1/dc/df/d27/fa8 0 2024-02-28T23:07:38.151 INFO:tasks.workunit.client.1.smithi184.stdout:2/575: write d10/d1f/d38/f5c [1357653,96230] 0 2024-02-28T23:07:38.156 INFO:tasks.workunit.client.1.smithi184.stdout:8/627: fdatasync d1/da/f5b 0 2024-02-28T23:07:38.163 INFO:tasks.workunit.client.1.smithi184.stdout:6/550: getdents dc/d42 0 2024-02-28T23:07:38.164 INFO:tasks.workunit.client.1.smithi184.stdout:1/647: getdents d20/d32/dc0 0 2024-02-28T23:07:38.165 INFO:tasks.workunit.client.1.smithi184.stdout:1/648: fdatasync d20/d32/fd6 0 2024-02-28T23:07:38.166 INFO:tasks.workunit.client.1.smithi184.stdout:6/551: write dc/de/d10/d16/f37 [1567709,61045] 0 2024-02-28T23:07:38.168 INFO:tasks.workunit.client.1.smithi184.stdout:2/576: dwrite d10/d1f/d21/d5e/f2c [0,4194304] 0 2024-02-28T23:07:38.169 INFO:tasks.workunit.client.1.smithi184.stdout:5/596: write db/d12/d1c/f3a [474485,47949] 0 2024-02-28T23:07:38.172 INFO:tasks.workunit.client.1.smithi184.stdout:2/577: truncate d10/d1f/d21/d6a/fae 313641 0 2024-02-28T23:07:38.176 INFO:tasks.workunit.client.1.smithi184.stdout:0/648: sync 2024-02-28T23:07:38.178 INFO:tasks.workunit.client.1.smithi184.stdout:0/649: stat d0/lb0 0 2024-02-28T23:07:38.179 INFO:tasks.workunit.client.1.smithi184.stdout:4/578: rename d1/dc/df/d27/fa3 to d1/d8/d19/d67/d99/faa 0 2024-02-28T23:07:38.187 INFO:tasks.workunit.client.1.smithi184.stdout:8/628: fsync d1/da/d10/d6b/fcd 0 2024-02-28T23:07:38.189 INFO:tasks.workunit.client.1.smithi184.stdout:5/597: dwrite db/d90/fba [0,4194304] 0 2024-02-28T23:07:38.189 INFO:tasks.workunit.client.1.smithi184.stdout:1/649: rmdir d20 39 2024-02-28T23:07:38.190 INFO:tasks.workunit.client.1.smithi184.stdout:2/578: dwrite d10/d1f/d38/d54/d96/faa [0,4194304] 0 2024-02-28T23:07:38.202 INFO:tasks.workunit.client.1.smithi184.stdout:0/650: symlink d0/df/d13/d27/d31/d5b/le4 0 2024-02-28T23:07:38.204 INFO:tasks.workunit.client.1.smithi184.stdout:8/629: dread d1/da/d10/d43/f5e [0,4194304] 0 2024-02-28T23:07:38.208 INFO:tasks.workunit.client.1.smithi184.stdout:7/585: link d6/f48 d6/d9/d13/d14/d45/fcc 0 2024-02-28T23:07:38.209 INFO:tasks.workunit.client.1.smithi184.stdout:0/651: truncate d0/d1f/de3/fc9 392288 0 2024-02-28T23:07:38.214 INFO:tasks.workunit.client.1.smithi184.stdout:9/603: getdents d5/db/de/d10/d12/d2f/d7d 0 2024-02-28T23:07:38.214 INFO:tasks.workunit.client.1.smithi184.stdout:2/579: dwrite d10/d1f/d38/f5c [0,4194304] 0 2024-02-28T23:07:38.226 INFO:tasks.workunit.client.0.smithi159.stdout:7/758: symlink d5/d16/d1a/d27/d95/lf0 0 2024-02-28T23:07:38.228 INFO:tasks.workunit.client.0.smithi159.stdout:5/905: creat d8/d19/d23/d35/d65/da3/dd2/def/d11f/d12b/f13f x:0 0 0 2024-02-28T23:07:38.243 INFO:tasks.workunit.client.0.smithi159.stdout:3/846: mknod d0/d2b/d55/d10a/c10f 0 2024-02-28T23:07:38.244 INFO:tasks.workunit.client.0.smithi159.stdout:1/937: read d6/d12/d31/d5a/fa2 [390528,90147] 0 2024-02-28T23:07:38.245 INFO:tasks.workunit.client.1.smithi184.stdout:6/552: sync 2024-02-28T23:07:38.246 INFO:tasks.workunit.client.0.smithi159.stdout:5/906: creat d8/d19/f140 x:0 0 0 2024-02-28T23:07:38.247 INFO:tasks.workunit.client.1.smithi184.stdout:0/652: mkdir d0/d1d/d3a/de5 0 2024-02-28T23:07:38.249 INFO:tasks.workunit.client.1.smithi184.stdout:7/586: chown d6/d9/d13/d3e/dad/d49/da6/daf/d47/c97 44414884 1 2024-02-28T23:07:38.250 INFO:tasks.workunit.client.1.smithi184.stdout:0/653: write d0/df/d13/d27/d31/d51/d85/fc0 [330213,35241] 0 2024-02-28T23:07:38.250 INFO:tasks.workunit.client.1.smithi184.stdout:9/604: fsync d5/d26/d50/f35 0 2024-02-28T23:07:38.254 INFO:tasks.workunit.client.1.smithi184.stdout:2/580: chown d10/d1f/d38/d54/f76 121278755 1 2024-02-28T23:07:38.255 INFO:tasks.workunit.client.0.smithi159.stdout:3/847: mkdir d0/d2b/d55/df8/d57/d110 0 2024-02-28T23:07:38.258 INFO:tasks.workunit.client.0.smithi159.stdout:1/938: rmdir d6/d12/d33/da7 39 2024-02-28T23:07:38.259 INFO:tasks.workunit.client.1.smithi184.stdout:1/650: rmdir d20/d32/d3e/d82 39 2024-02-28T23:07:38.260 INFO:tasks.workunit.client.1.smithi184.stdout:1/651: dread - d20/d46/d90/fd1 zero size 2024-02-28T23:07:38.261 INFO:tasks.workunit.client.1.smithi184.stdout:3/640: getdents d1/d4/d6/d83 0 2024-02-28T23:07:38.262 INFO:tasks.workunit.client.0.smithi159.stdout:5/907: truncate d8/d19/d23/d35/d41/d92/fe3 44199 0 2024-02-28T23:07:38.263 INFO:tasks.workunit.client.1.smithi184.stdout:3/641: chown d1/d4/d6/d1e/d72/f99 2 1 2024-02-28T23:07:38.268 INFO:tasks.workunit.client.0.smithi159.stdout:1/939: symlink d6/d12/d1a/d92/d97/dd8/l13f 0 2024-02-28T23:07:38.272 INFO:tasks.workunit.client.1.smithi184.stdout:6/553: mknod dc/de/d2a/d8e/dad/d8a/cb3 0 2024-02-28T23:07:38.273 INFO:tasks.workunit.client.0.smithi159.stdout:1/940: fsync d6/d1d/d46/d88/dd3/d63/f66 0 2024-02-28T23:07:38.273 INFO:tasks.workunit.client.0.smithi159.stdout:6/897: getdents d0/d1b/d33/d11/d34/d9d/da2/d4e/d72 0 2024-02-28T23:07:38.274 INFO:tasks.workunit.client.0.smithi159.stdout:2/817: write d9/d50/d54/d84/d37/f8c [3494712,108294] 0 2024-02-28T23:07:38.276 INFO:tasks.workunit.client.0.smithi159.stdout:5/908: symlink d8/db4/de8/l141 0 2024-02-28T23:07:38.279 INFO:tasks.workunit.client.0.smithi159.stdout:9/881: dwrite d4/fe [0,4194304] 0 2024-02-28T23:07:38.279 INFO:tasks.workunit.client.0.smithi159.stdout:2/818: stat d9/d23/d2c/d55/d13/d4f/c9c 0 2024-02-28T23:07:38.284 INFO:tasks.workunit.client.1.smithi184.stdout:0/654: unlink d0/df/d13/d27/d31/db3/lb9 0 2024-02-28T23:07:38.284 INFO:tasks.workunit.client.1.smithi184.stdout:2/581: mknod d10/d1f/d21/d5e/d15/d24/d5f/cb6 0 2024-02-28T23:07:38.285 INFO:tasks.workunit.client.1.smithi184.stdout:5/598: dwrite db/d12/d18/d2e/d3c/d5d/d66/f6e [4194304,4194304] 0 2024-02-28T23:07:38.288 INFO:tasks.workunit.client.1.smithi184.stdout:2/582: chown d10/la2 11905 1 2024-02-28T23:07:38.291 INFO:tasks.workunit.client.1.smithi184.stdout:4/579: link d1/d8/d3d/d44/f66 d1/d8/d37/fab 0 2024-02-28T23:07:38.292 INFO:tasks.workunit.client.1.smithi184.stdout:8/630: creat d1/fed x:0 0 0 2024-02-28T23:07:38.293 INFO:tasks.workunit.client.0.smithi159.stdout:2/819: unlink d9/d23/da9/ff5 0 2024-02-28T23:07:38.293 INFO:tasks.workunit.client.0.smithi159.stdout:3/848: write d0/d2b/d55/df8/d2f/f4b [332468,72506] 0 2024-02-28T23:07:38.303 INFO:tasks.workunit.client.1.smithi184.stdout:3/642: mknod d1/d4/d5/cc4 0 2024-02-28T23:07:38.304 INFO:tasks.workunit.client.0.smithi159.stdout:9/882: unlink d4/d3d/d3e/dad/fbf 0 2024-02-28T23:07:38.307 INFO:tasks.workunit.client.1.smithi184.stdout:2/583: creat d10/d1f/d38/d53/fb7 x:0 0 0 2024-02-28T23:07:38.307 INFO:tasks.workunit.client.1.smithi184.stdout:5/599: mknod db/d12/d18/d2e/d3c/d5d/cc6 0 2024-02-28T23:07:38.310 INFO:tasks.workunit.client.0.smithi159.stdout:3/849: creat d0/d3f/dd2/d63/f111 x:0 0 0 2024-02-28T23:07:38.311 INFO:tasks.workunit.client.0.smithi159.stdout:9/883: symlink d4/de4/l115 0 2024-02-28T23:07:38.312 INFO:tasks.workunit.client.1.smithi184.stdout:9/605: creat d5/d47/fc3 x:0 0 0 2024-02-28T23:07:38.314 INFO:tasks.workunit.client.1.smithi184.stdout:9/606: fdatasync d5/db/de/f74 0 2024-02-28T23:07:38.314 INFO:tasks.workunit.client.1.smithi184.stdout:9/607: fdatasync d5/d47/d68/f75 0 2024-02-28T23:07:38.318 INFO:tasks.workunit.client.0.smithi159.stdout:3/850: fdatasync d0/d2b/d55/df8/da9/fe5 0 2024-02-28T23:07:38.324 INFO:tasks.workunit.client.0.smithi159.stdout:2/820: dwrite d9/d23/d2c/d55/fee [0,4194304] 0 2024-02-28T23:07:38.325 INFO:tasks.workunit.client.0.smithi159.stdout:1/941: write d6/d1d/d46/d88/dd3/f10b [720113,31249] 0 2024-02-28T23:07:38.330 INFO:tasks.workunit.client.1.smithi184.stdout:2/584: symlink d10/d55/d89/db5/lb8 0 2024-02-28T23:07:38.332 INFO:tasks.workunit.client.0.smithi159.stdout:1/942: chown d6/d12/d33/d72/f120 8 1 2024-02-28T23:07:38.333 INFO:tasks.workunit.client.0.smithi159.stdout:6/898: write d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/d88/fa8 [264310,28442] 0 2024-02-28T23:07:38.334 INFO:tasks.workunit.client.0.smithi159.stdout:2/821: readlink d9/d50/dcc/d44/dc0/dda/lec 0 2024-02-28T23:07:38.339 INFO:tasks.workunit.client.1.smithi184.stdout:4/580: rename d1/dc/df/d3b/c93 to d1/dc/df/d38/d57/cac 0 2024-02-28T23:07:38.340 INFO:tasks.workunit.client.1.smithi184.stdout:6/554: dwrite dc/d60/d7c/f6b [0,4194304] 0 2024-02-28T23:07:38.341 INFO:tasks.workunit.client.1.smithi184.stdout:7/587: dwrite d6/f59 [0,4194304] 0 2024-02-28T23:07:38.343 INFO:tasks.workunit.client.0.smithi159.stdout:5/909: write d8/d19/d23/d35/d41/daa/d79/f107 [918126,29071] 0 2024-02-28T23:07:38.347 INFO:tasks.workunit.client.0.smithi159.stdout:6/899: rmdir d0/d1b/d33/d11/d34 39 2024-02-28T23:07:38.348 INFO:tasks.workunit.client.0.smithi159.stdout:1/943: rmdir d6/d1d/d46/df9 39 2024-02-28T23:07:38.351 INFO:tasks.workunit.client.0.smithi159.stdout:1/944: stat d6/d12/d31/d5a/f133 0 2024-02-28T23:07:38.351 INFO:tasks.workunit.client.1.smithi184.stdout:1/652: creat d20/d32/d3e/d82/d85/fdf x:0 0 0 2024-02-28T23:07:38.354 INFO:tasks.workunit.client.1.smithi184.stdout:8/631: creat d1/da/dc/d16/d29/fee x:0 0 0 2024-02-28T23:07:38.355 INFO:tasks.workunit.client.1.smithi184.stdout:4/581: creat d1/d8/d19/fad x:0 0 0 2024-02-28T23:07:38.360 INFO:tasks.workunit.client.0.smithi159.stdout:1/945: creat d6/d1d/d46/d88/dd3/d134/f140 x:0 0 0 2024-02-28T23:07:38.365 INFO:tasks.workunit.client.1.smithi184.stdout:9/608: symlink d5/db/de/d10/d12/dbb/lc4 0 2024-02-28T23:07:38.369 INFO:tasks.workunit.client.1.smithi184.stdout:0/655: getdents d0/d1d/d3a 0 2024-02-28T23:07:38.370 INFO:tasks.workunit.client.0.smithi159.stdout:1/946: rmdir d6/d12/d33 39 2024-02-28T23:07:38.371 INFO:tasks.workunit.client.1.smithi184.stdout:9/609: read d5/d26/f78 [2770000,113533] 0 2024-02-28T23:07:38.372 INFO:tasks.workunit.client.1.smithi184.stdout:0/656: write d0/d1f/f28 [1788027,77619] 0 2024-02-28T23:07:38.375 INFO:tasks.workunit.client.1.smithi184.stdout:0/657: readlink d0/df/d13/d27/l77 0 2024-02-28T23:07:38.376 INFO:tasks.workunit.client.1.smithi184.stdout:1/653: unlink f1d 0 2024-02-28T23:07:38.377 INFO:tasks.workunit.client.1.smithi184.stdout:5/600: link db/d44/cb1 db/d12/d1c/d21/d2f/dc4/cc7 0 2024-02-28T23:07:38.381 INFO:tasks.workunit.client.1.smithi184.stdout:5/601: chown db/d12/d18/d2e/d3c/d5d/d66/f6a 694 1 2024-02-28T23:07:38.389 INFO:tasks.workunit.client.0.smithi159.stdout:6/900: mkdir d0/d1b/d33/d11/d34/d9d/da2/dcf/d12a 0 2024-02-28T23:07:38.393 INFO:tasks.workunit.client.1.smithi184.stdout:9/610: dwrite d5/d47/d68/f75 [0,4194304] 0 2024-02-28T23:07:38.395 INFO:tasks.workunit.client.1.smithi184.stdout:3/643: dwrite d1/d4/d6/d1f/d26/d3a/d59/f7d [0,4194304] 0 2024-02-28T23:07:38.395 INFO:tasks.workunit.client.0.smithi159.stdout:9/884: dwrite d4/d3d/d3e/d55/d37/d62/f69 [0,4194304] 0 2024-02-28T23:07:38.396 INFO:tasks.workunit.client.1.smithi184.stdout:6/555: rename dc/de/d2a/d5c/d79/l84 to dc/d60/d62/d6f/d99/lb4 0 2024-02-28T23:07:38.400 INFO:tasks.workunit.client.1.smithi184.stdout:2/585: creat d10/d33/fb9 x:0 0 0 2024-02-28T23:07:38.402 INFO:tasks.workunit.client.0.smithi159.stdout:2/822: write d9/d23/d2c/f91 [345502,93506] 0 2024-02-28T23:07:38.403 INFO:tasks.workunit.client.0.smithi159.stdout:1/947: link d6/d12/d31/d69/dc0/feb d6/d12/d16/de3/df4/f141 0 2024-02-28T23:07:38.404 INFO:tasks.workunit.client.0.smithi159.stdout:3/851: dwrite d0/d2b/d55/df8/d57/f6c [0,4194304] 0 2024-02-28T23:07:38.408 INFO:tasks.workunit.client.0.smithi159.stdout:5/910: write d8/d19/d23/d35/d65/da3/df4/f112 [723095,81977] 0 2024-02-28T23:07:38.411 INFO:tasks.workunit.client.1.smithi184.stdout:1/654: creat d20/d32/d4b/fe0 x:0 0 0 2024-02-28T23:07:38.422 INFO:tasks.workunit.client.1.smithi184.stdout:5/602: creat db/d12/d18/d2e/fc8 x:0 0 0 2024-02-28T23:07:38.423 INFO:tasks.workunit.client.1.smithi184.stdout:5/603: stat db/d12/d1c/d21/d2f/f5a 0 2024-02-28T23:07:38.425 INFO:tasks.workunit.client.1.smithi184.stdout:5/604: dread - db/d12/d50/d9e/fa7 zero size 2024-02-28T23:07:38.428 INFO:tasks.workunit.client.0.smithi159.stdout:5/911: truncate d8/d19/d23/d35/d65/da3/df4/f112 1284122 0 2024-02-28T23:07:38.433 INFO:tasks.workunit.client.0.smithi159.stdout:9/885: symlink d4/d3d/l116 0 2024-02-28T23:07:38.434 INFO:tasks.workunit.client.0.smithi159.stdout:1/948: mknod d6/d12/d31/d69/dc0/c142 0 2024-02-28T23:07:38.439 INFO:tasks.workunit.client.1.smithi184.stdout:7/588: creat d6/fcd x:0 0 0 2024-02-28T23:07:38.442 INFO:tasks.workunit.client.1.smithi184.stdout:4/582: dread d1/d4/d43/d73/f5e [0,4194304] 0 2024-02-28T23:07:38.448 INFO:tasks.workunit.client.0.smithi159.stdout:1/949: rename d6/d1d/d46/d88/dd3/d9c/db3/dc4 to d6/d12/d16/de3/d143 0 2024-02-28T23:07:38.449 INFO:tasks.workunit.client.1.smithi184.stdout:2/586: truncate d10/d1f/d21/d5e/f47 855010 0 2024-02-28T23:07:38.450 INFO:tasks.workunit.client.1.smithi184.stdout:1/655: mkdir d20/d46/d90/de1 0 2024-02-28T23:07:38.451 INFO:tasks.workunit.client.1.smithi184.stdout:2/587: dread - d10/d1f/d21/d4d/f72 zero size 2024-02-28T23:07:38.452 INFO:tasks.workunit.client.1.smithi184.stdout:8/632: creat d1/da/dc/d16/fef x:0 0 0 2024-02-28T23:07:38.453 INFO:tasks.workunit.client.0.smithi159.stdout:5/912: dread d8/d19/d23/d35/d41/daa/d88/f101 [0,4194304] 0 2024-02-28T23:07:38.455 INFO:tasks.workunit.client.1.smithi184.stdout:5/605: read db/d12/d1c/d21/d25/f69 [1942125,71121] 0 2024-02-28T23:07:38.456 INFO:tasks.workunit.client.1.smithi184.stdout:7/589: fsync d6/d9/d13/d1e/f22 0 2024-02-28T23:07:38.458 INFO:tasks.workunit.client.0.smithi159.stdout:1/950: creat d6/f144 x:0 0 0 2024-02-28T23:07:38.459 INFO:tasks.workunit.client.1.smithi184.stdout:3/644: creat d1/d4/d6/d1f/d26/d3a/d59/d67/dc1/fc5 x:0 0 0 2024-02-28T23:07:38.460 INFO:tasks.workunit.client.0.smithi159.stdout:6/901: write d0/d6d/fa1 [336987,2046] 0 2024-02-28T23:07:38.462 INFO:tasks.workunit.client.1.smithi184.stdout:8/633: creat d1/da/dc/ff0 x:0 0 0 2024-02-28T23:07:38.462 INFO:tasks.workunit.client.1.smithi184.stdout:7/590: dread d6/d9/d13/d1e/d2f/d33/f36 [0,4194304] 0 2024-02-28T23:07:38.463 INFO:tasks.workunit.client.0.smithi159.stdout:5/913: mkdir d8/d19/d23/d35/d41/d92/d10c/dff/d142 0 2024-02-28T23:07:38.465 INFO:tasks.workunit.client.1.smithi184.stdout:5/606: symlink db/d12/d18/d2e/dc1/lc9 0 2024-02-28T23:07:38.467 INFO:tasks.workunit.client.0.smithi159.stdout:6/902: fdatasync d0/d1b/d5b/f9c 0 2024-02-28T23:07:38.468 INFO:tasks.workunit.client.1.smithi184.stdout:6/556: write dc/de/f20 [1243627,23198] 0 2024-02-28T23:07:38.471 INFO:tasks.workunit.client.0.smithi159.stdout:9/886: write d4/d3d/d3e/d55/d9e/fc3 [976454,103717] 0 2024-02-28T23:07:38.472 INFO:tasks.workunit.client.0.smithi159.stdout:6/903: read d0/d1b/f1a [4557349,28505] 0 2024-02-28T23:07:38.474 INFO:tasks.workunit.client.1.smithi184.stdout:3/645: dread - d1/d4/d5/d40/d8f/f91 zero size 2024-02-28T23:07:38.475 INFO:tasks.workunit.client.1.smithi184.stdout:0/658: write d0/d7c/fbb [8778462,922] 0 2024-02-28T23:07:38.477 INFO:tasks.workunit.client.1.smithi184.stdout:0/659: chown d0/d1d/c24 6404 1 2024-02-28T23:07:38.481 INFO:tasks.workunit.client.0.smithi159.stdout:2/823: dread d9/d50/d54/d84/f45 [0,4194304] 0 2024-02-28T23:07:38.481 INFO:tasks.workunit.client.1.smithi184.stdout:1/656: link d20/d32/d3e/d82/fa8 d20/d32/d3e/dc9/fe2 0 2024-02-28T23:07:38.481 INFO:tasks.workunit.client.1.smithi184.stdout:9/611: getdents d5/db/d5c 0 2024-02-28T23:07:38.484 INFO:tasks.workunit.client.0.smithi159.stdout:9/887: fdatasync d4/f5 0 2024-02-28T23:07:38.485 INFO:tasks.workunit.client.1.smithi184.stdout:2/588: dread d10/d1f/d21/d4d/d67/f95 [0,4194304] 0 2024-02-28T23:07:38.486 INFO:tasks.workunit.client.0.smithi159.stdout:5/914: symlink d8/d19/d23/d35/d38/d6d/df8/d123/l143 0 2024-02-28T23:07:38.487 INFO:tasks.workunit.client.1.smithi184.stdout:2/589: fdatasync fb 0 2024-02-28T23:07:38.487 INFO:tasks.workunit.client.0.smithi159.stdout:9/888: stat d4/d3d/d3e/d55/d4c/dee/f8d 0 2024-02-28T23:07:38.488 INFO:tasks.workunit.client.1.smithi184.stdout:4/583: creat d1/dc/df/d27/fae x:0 0 0 2024-02-28T23:07:38.490 INFO:tasks.workunit.client.0.smithi159.stdout:1/951: getdents d6/d12/d31/d69/dc0/dca 0 2024-02-28T23:07:38.492 INFO:tasks.workunit.client.1.smithi184.stdout:0/660: rename d0/df/d13/d27/d31/db3/cbc to d0/d1f/ce6 0 2024-02-28T23:07:38.494 INFO:tasks.workunit.client.1.smithi184.stdout:0/661: chown d0/df/d13/d27/d31 63625629 1 2024-02-28T23:07:38.494 INFO:tasks.workunit.client.1.smithi184.stdout:8/634: link d1/da/dc/d16/d4d/f87 d1/da/d10/d17/ff1 0 2024-02-28T23:07:38.495 INFO:tasks.workunit.client.0.smithi159.stdout:2/824: chown d9/d50/d54/d84/d37/c78 0 1 2024-02-28T23:07:38.496 INFO:tasks.workunit.client.1.smithi184.stdout:5/607: creat db/d12/d1c/d9b/fca x:0 0 0 2024-02-28T23:07:38.496 INFO:tasks.workunit.client.1.smithi184.stdout:8/635: dread - d1/da/dc/d16/d4d/fe5 zero size 2024-02-28T23:07:38.497 INFO:tasks.workunit.client.1.smithi184.stdout:1/657: fsync d20/d32/d3e/d82/d85/fa6 0 2024-02-28T23:07:38.499 INFO:tasks.workunit.client.0.smithi159.stdout:9/889: mknod d4/d3d/d3e/dad/d10f/c117 0 2024-02-28T23:07:38.504 INFO:tasks.workunit.client.0.smithi159.stdout:1/952: mknod d6/d12/d33/d48/c145 0 2024-02-28T23:07:38.504 INFO:tasks.workunit.client.0.smithi159.stdout:6/904: getdents d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94 0 2024-02-28T23:07:38.505 INFO:tasks.workunit.client.1.smithi184.stdout:4/584: rename d1/dc/df/d3b/d5c/f9e to d1/d8/d19/d56/d7a/faf 0 2024-02-28T23:07:38.510 INFO:tasks.workunit.client.0.smithi159.stdout:2/825: truncate d9/d50/faa 775461 0 2024-02-28T23:07:38.511 INFO:tasks.workunit.client.1.smithi184.stdout:9/612: mkdir d5/db/de/dc5 0 2024-02-28T23:07:38.514 INFO:tasks.workunit.client.1.smithi184.stdout:8/636: rmdir d1/da/d33/dac 39 2024-02-28T23:07:38.516 INFO:tasks.workunit.client.0.smithi159.stdout:2/826: write d9/d50/d54/d84/d37/d5c/f7b [2870177,75995] 0 2024-02-28T23:07:38.519 INFO:tasks.workunit.client.0.smithi159.stdout:5/915: dwrite d8/d19/d23/d35/d41/daa/d79/fa4 [0,4194304] 0 2024-02-28T23:07:38.519 INFO:tasks.workunit.client.1.smithi184.stdout:5/608: mknod db/d12/d18/d2e/d3c/ccb 0 2024-02-28T23:07:38.520 INFO:tasks.workunit.client.0.smithi159.stdout:9/890: creat d4/d3d/d3e/f118 x:0 0 0 2024-02-28T23:07:38.521 INFO:tasks.workunit.client.1.smithi184.stdout:1/658: stat d20/d32/d3e/d61/d8b/d9c/db8/dd0 0 2024-02-28T23:07:38.530 INFO:tasks.workunit.client.0.smithi159.stdout:2/827: symlink d9/d50/d54/d84/l11c 0 2024-02-28T23:07:38.530 INFO:tasks.workunit.client.0.smithi159.stdout:1/953: dwrite d6/d12/d31/d69/f137 [0,4194304] 0 2024-02-28T23:07:38.530 INFO:tasks.workunit.client.1.smithi184.stdout:7/591: truncate d6/d9/d13/d1e/d2f/f38 2585131 0 2024-02-28T23:07:38.531 INFO:tasks.workunit.client.0.smithi159.stdout:6/905: rename d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/f111 to d0/d1b/d33/d11/d34/f12b 0 2024-02-28T23:07:38.535 INFO:tasks.workunit.client.1.smithi184.stdout:3/646: creat d1/d4/d5/fc6 x:0 0 0 2024-02-28T23:07:38.542 INFO:tasks.workunit.client.1.smithi184.stdout:6/557: write dc/de/f29 [542763,44841] 0 2024-02-28T23:07:38.548 INFO:tasks.workunit.client.1.smithi184.stdout:8/637: mkdir d1/da/dc/d16/d32/d42/d77/df2 0 2024-02-28T23:07:38.548 INFO:tasks.workunit.client.1.smithi184.stdout:0/662: write d0/df/f67 [1686094,106839] 0 2024-02-28T23:07:38.549 INFO:tasks.workunit.client.0.smithi159.stdout:6/906: mknod d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/c12c 0 2024-02-28T23:07:38.551 INFO:tasks.workunit.client.1.smithi184.stdout:0/663: read d0/d1d/d4c/f6b [349565,70091] 0 2024-02-28T23:07:38.555 INFO:tasks.workunit.client.1.smithi184.stdout:1/659: creat d20/d32/d3e/d61/fe3 x:0 0 0 2024-02-28T23:07:38.556 INFO:tasks.workunit.client.1.smithi184.stdout:3/647: creat d1/d4/d6/d1f/d26/d3a/d59/d82/fc7 x:0 0 0 2024-02-28T23:07:38.558 INFO:tasks.workunit.client.0.smithi159.stdout:5/916: creat d8/d19/d23/d35/d65/da3/df4/da5/d121/f144 x:0 0 0 2024-02-28T23:07:38.560 INFO:tasks.workunit.client.1.smithi184.stdout:9/613: link d5/f6 d5/d47/d68/d7c/fc6 0 2024-02-28T23:07:38.561 INFO:tasks.workunit.client.0.smithi159.stdout:6/907: chown d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/c83 42903237 1 2024-02-28T23:07:38.564 INFO:tasks.workunit.client.0.smithi159.stdout:2/828: creat d9/d23/f11d x:0 0 0 2024-02-28T23:07:38.568 INFO:tasks.workunit.client.0.smithi159.stdout:7/759: sync 2024-02-28T23:07:38.576 INFO:tasks.workunit.client.1.smithi184.stdout:9/614: dwrite d5/d47/d59/d92/fc0 [0,4194304] 0 2024-02-28T23:07:38.579 INFO:tasks.workunit.client.1.smithi184.stdout:0/664: creat d0/d1d/d3a/fe7 x:0 0 0 2024-02-28T23:07:38.580 INFO:tasks.workunit.client.0.smithi159.stdout:9/891: dread d4/d3d/fe1 [0,4194304] 0 2024-02-28T23:07:38.580 INFO:tasks.workunit.client.0.smithi159.stdout:1/954: write d6/d1d/d46/d88/dd3/d63/f74 [303206,47801] 0 2024-02-28T23:07:38.581 INFO:tasks.workunit.client.1.smithi184.stdout:2/590: getdents d10/d1f/d21/d4d/d67 0 2024-02-28T23:07:38.582 INFO:tasks.workunit.client.0.smithi159.stdout:7/760: fsync d5/d16/d1a/d27/d3e/f48 0 2024-02-28T23:07:38.586 INFO:tasks.workunit.client.0.smithi159.stdout:2/829: mknod d9/d36/d59/c11e 0 2024-02-28T23:07:38.586 INFO:tasks.workunit.client.1.smithi184.stdout:2/591: fsync d10/d1f/d38/d53/fb7 0 2024-02-28T23:07:38.589 INFO:tasks.workunit.client.0.smithi159.stdout:1/955: write d6/d12/f93 [1126311,123345] 0 2024-02-28T23:07:38.590 INFO:tasks.workunit.client.0.smithi159.stdout:5/917: dwrite d8/d19/d23/d35/d41/daa/d79/fe4 [0,4194304] 0 2024-02-28T23:07:38.590 INFO:tasks.workunit.client.1.smithi184.stdout:4/585: dread d1/dc/df/f16 [0,4194304] 0 2024-02-28T23:07:38.590 INFO:tasks.workunit.client.1.smithi184.stdout:2/592: chown d10/d1f/d21/d5e/d15/d60/d6f/l7e 177601476 1 2024-02-28T23:07:38.594 INFO:tasks.workunit.client.1.smithi184.stdout:2/593: write d10/d33/f7d [117157,118956] 0 2024-02-28T23:07:38.596 INFO:tasks.workunit.client.1.smithi184.stdout:5/609: creat db/d12/d1c/fcc x:0 0 0 2024-02-28T23:07:38.597 INFO:tasks.workunit.client.0.smithi159.stdout:9/892: mkdir d4/d3d/d3e/d55/d37/d62/db0/d111/d119 0 2024-02-28T23:07:38.600 INFO:tasks.workunit.client.0.smithi159.stdout:7/761: mknod d5/cf1 0 2024-02-28T23:07:38.601 INFO:tasks.workunit.client.1.smithi184.stdout:5/610: stat db/d12/f77 0 2024-02-28T23:07:38.602 INFO:tasks.workunit.client.1.smithi184.stdout:7/592: creat d6/d9/fce x:0 0 0 2024-02-28T23:07:38.604 INFO:tasks.workunit.client.1.smithi184.stdout:6/558: link dc/de/d2a/d5c/l93 dc/de/d2a/d5c/lb5 0 2024-02-28T23:07:38.606 INFO:tasks.workunit.client.0.smithi159.stdout:9/893: chown d4/d3d/d3e/d55/d37/c4b 5049 1 2024-02-28T23:07:38.610 INFO:tasks.workunit.client.0.smithi159.stdout:2/830: truncate d9/d50/d62/ffe 399076 0 2024-02-28T23:07:38.611 INFO:tasks.workunit.client.1.smithi184.stdout:8/638: dwrite d1/da/dc/d18/f57 [0,4194304] 0 2024-02-28T23:07:38.615 INFO:tasks.workunit.client.1.smithi184.stdout:3/648: dwrite d1/d4/d6/d1f/f68 [0,4194304] 0 2024-02-28T23:07:38.616 INFO:tasks.workunit.client.1.smithi184.stdout:9/615: symlink d5/db/de/d10/d12/d2f/lc7 0 2024-02-28T23:07:38.617 INFO:tasks.workunit.client.1.smithi184.stdout:8/639: fdatasync d1/da/dc/d16/fef 0 2024-02-28T23:07:38.618 INFO:tasks.workunit.client.0.smithi159.stdout:6/908: dwrite d0/d1b/d33/d11/d34/d9d/da2/db7/db1/fbc [0,4194304] 0 2024-02-28T23:07:38.619 INFO:tasks.workunit.client.0.smithi159.stdout:5/918: link d8/d19/d23/d35/d41/d77/c10b d8/d19/d23/d35/d41/d92/d10c/c145 0 2024-02-28T23:07:38.619 INFO:tasks.workunit.client.0.smithi159.stdout:3/852: sync 2024-02-28T23:07:38.620 INFO:tasks.workunit.client.1.smithi184.stdout:8/640: chown d1/fe1 0 1 2024-02-28T23:07:38.626 INFO:tasks.workunit.client.1.smithi184.stdout:8/641: read d1/da/dc/d16/d32/f46 [4106445,8923] 0 2024-02-28T23:07:38.626 INFO:tasks.workunit.client.1.smithi184.stdout:3/649: mkdir d1/d4/d6/d1f/d26/d3a/d59/d82/dc8 0 2024-02-28T23:07:38.627 INFO:tasks.workunit.client.1.smithi184.stdout:4/586: link d1/dc/l20 d1/d8/d19/d67/lb0 0 2024-02-28T23:07:38.629 INFO:tasks.workunit.client.0.smithi159.stdout:6/909: readlink d0/d1b/d33/l68 0 2024-02-28T23:07:38.629 INFO:tasks.workunit.client.0.smithi159.stdout:3/853: truncate d0/d2b/fd5 5134521 0 2024-02-28T23:07:38.630 INFO:tasks.workunit.client.0.smithi159.stdout:7/762: dread d5/d56/d50/daa/fae [0,4194304] 0 2024-02-28T23:07:38.631 INFO:tasks.workunit.client.1.smithi184.stdout:6/559: mkdir dc/de/db6 0 2024-02-28T23:07:38.633 INFO:tasks.workunit.client.1.smithi184.stdout:3/650: chown d1/d4/d6/la0 1914072 1 2024-02-28T23:07:38.636 INFO:tasks.workunit.client.1.smithi184.stdout:4/587: chown d1/d8/d19/d67/d87/l8b 25 1 2024-02-28T23:07:38.636 INFO:tasks.workunit.client.0.smithi159.stdout:6/910: fdatasync d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/fb9 0 2024-02-28T23:07:38.640 INFO:tasks.workunit.client.1.smithi184.stdout:7/593: dwrite d6/d68/fb9 [0,4194304] 0 2024-02-28T23:07:38.642 INFO:tasks.workunit.client.1.smithi184.stdout:5/611: dwrite db/d12/d1c/d21/d4d/f93 [0,4194304] 0 2024-02-28T23:07:38.643 INFO:tasks.workunit.client.0.smithi159.stdout:3/854: rename d0/def/c9a to d0/d3f/dd2/d6a/de7/c112 0 2024-02-28T23:07:38.647 INFO:tasks.workunit.client.1.smithi184.stdout:6/560: dread dc/f75 [0,4194304] 0 2024-02-28T23:07:38.648 INFO:tasks.workunit.client.0.smithi159.stdout:9/894: dwrite d4/d3d/d3e/d55/d37/d62/da6/ffa [0,4194304] 0 2024-02-28T23:07:38.651 INFO:tasks.workunit.client.1.smithi184.stdout:5/612: chown db/d12/d1c/d21/fb6 29455101 1 2024-02-28T23:07:38.651 INFO:tasks.workunit.client.1.smithi184.stdout:7/594: chown d6/d9/d13/d3e/dad/d49/da6/daf 33 1 2024-02-28T23:07:38.654 INFO:tasks.workunit.client.1.smithi184.stdout:1/660: sync 2024-02-28T23:07:38.656 INFO:tasks.workunit.client.1.smithi184.stdout:4/588: mkdir d1/d8/d19/d56/d7a/d8d/db1 0 2024-02-28T23:07:38.660 INFO:tasks.workunit.client.0.smithi159.stdout:6/911: write d0/d1b/d33/d11/d34/d9d/da2/f61 [3587340,25183] 0 2024-02-28T23:07:38.661 INFO:tasks.workunit.client.1.smithi184.stdout:7/595: symlink d6/d9/d13/d3e/dad/d49/d50/db2/lcf 0 2024-02-28T23:07:38.662 INFO:tasks.workunit.client.0.smithi159.stdout:9/895: mkdir d4/de4/d11a 0 2024-02-28T23:07:38.667 INFO:tasks.workunit.client.1.smithi184.stdout:3/651: getdents d1/d4/d6/d1f/d24/d76 0 2024-02-28T23:07:38.669 INFO:tasks.workunit.client.1.smithi184.stdout:5/613: unlink db/d12/d50/d9e/lad 0 2024-02-28T23:07:38.669 INFO:tasks.workunit.client.1.smithi184.stdout:3/652: stat d1/d4/fb 0 2024-02-28T23:07:38.669 INFO:tasks.workunit.client.1.smithi184.stdout:1/661: creat d20/d32/d3e/d61/d8b/d9c/db8/fe4 x:0 0 0 2024-02-28T23:07:38.672 INFO:tasks.workunit.client.1.smithi184.stdout:3/653: chown d1/d4/d6/la0 4852 1 2024-02-28T23:07:38.675 INFO:tasks.workunit.client.0.smithi159.stdout:9/896: symlink d4/d3d/d3e/d55/l11b 0 2024-02-28T23:07:38.675 INFO:tasks.workunit.client.1.smithi184.stdout:5/614: unlink db/d12/d18/d2e/l99 0 2024-02-28T23:07:38.678 INFO:tasks.workunit.client.1.smithi184.stdout:4/589: dread d1/d8/d37/f60 [0,4194304] 0 2024-02-28T23:07:38.678 INFO:tasks.workunit.client.1.smithi184.stdout:6/561: getdents dc/d60/d78 0 2024-02-28T23:07:38.678 INFO:tasks.workunit.client.1.smithi184.stdout:5/615: read db/d12/d1c/d21/d4d/f93 [1212254,12088] 0 2024-02-28T23:07:38.679 INFO:tasks.workunit.client.1.smithi184.stdout:3/654: symlink d1/d4/d6/d1f/d26/lc9 0 2024-02-28T23:07:38.680 INFO:tasks.workunit.client.0.smithi159.stdout:6/912: link d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/c53 d0/d1b/c12d 0 2024-02-28T23:07:38.681 INFO:tasks.workunit.client.1.smithi184.stdout:5/616: stat db/d12/d18/d2e/d3c 0 2024-02-28T23:07:38.683 INFO:tasks.workunit.client.1.smithi184.stdout:5/617: chown db/d90/f86 50 1 2024-02-28T23:07:38.686 INFO:tasks.workunit.client.1.smithi184.stdout:5/618: readlink db/d12/d18/d2e/d3c/d5d/d66/la8 0 2024-02-28T23:07:38.686 INFO:tasks.workunit.client.1.smithi184.stdout:1/662: creat d20/d46/fe5 x:0 0 0 2024-02-28T23:07:38.694 INFO:tasks.workunit.client.0.smithi159.stdout:6/913: mkdir d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/d12e 0 2024-02-28T23:07:38.695 INFO:tasks.workunit.client.1.smithi184.stdout:4/590: dwrite d1/d8/d35/fa7 [0,4194304] 0 2024-02-28T23:07:38.698 INFO:tasks.workunit.client.1.smithi184.stdout:1/663: unlink d20/f24 0 2024-02-28T23:07:38.700 INFO:tasks.workunit.client.0.smithi159.stdout:6/914: symlink d0/d1b/l12f 0 2024-02-28T23:07:38.707 INFO:tasks.workunit.client.0.smithi159.stdout:1/956: dwrite d6/d12/d1a/d92/dc8/f12f [0,4194304] 0 2024-02-28T23:07:38.708 INFO:tasks.workunit.client.1.smithi184.stdout:0/665: truncate d0/df/fcf 162546 0 2024-02-28T23:07:38.710 INFO:tasks.workunit.client.1.smithi184.stdout:4/591: rename d1/d29 to d1/dc/df/d5b/db2 0 2024-02-28T23:07:38.716 INFO:tasks.workunit.client.1.smithi184.stdout:1/664: fdatasync d20/d32/d4b/fa1 0 2024-02-28T23:07:38.725 INFO:tasks.workunit.client.1.smithi184.stdout:2/594: dwrite d10/d1f/d21/d5e/d15/f2e [0,4194304] 0 2024-02-28T23:07:38.725 INFO:tasks.workunit.client.0.smithi159.stdout:2/831: dwrite d9/d23/da9/f102 [0,4194304] 0 2024-02-28T23:07:38.725 INFO:tasks.workunit.client.0.smithi159.stdout:1/957: rename d6/d1d/d1f/db8/dcc/l104 to d6/d1d/d46/d88/dd3/d134/l146 0 2024-02-28T23:07:38.726 INFO:tasks.workunit.client.0.smithi159.stdout:6/915: creat d0/d1b/d33/d11/d34/d9d/da2/dbf/f130 x:0 0 0 2024-02-28T23:07:38.728 INFO:tasks.workunit.client.1.smithi184.stdout:8/642: write d1/da/d10/f8d [845427,72630] 0 2024-02-28T23:07:38.730 INFO:tasks.workunit.client.0.smithi159.stdout:3/855: write d0/def/d79/f98 [878200,47660] 0 2024-02-28T23:07:38.731 INFO:tasks.workunit.client.1.smithi184.stdout:9/616: dwrite d5/db/de/d10/d12/d2f/d3f/f66 [0,4194304] 0 2024-02-28T23:07:38.734 INFO:tasks.workunit.client.1.smithi184.stdout:8/643: write d1/da/dc/d16/d4d/d82/fa8 [140659,114826] 0 2024-02-28T23:07:38.734 INFO:tasks.workunit.client.1.smithi184.stdout:4/592: rename d1/d8/d19/d56/d7a/d8d to d1/d8/d19/d92/db3 0 2024-02-28T23:07:38.739 INFO:tasks.workunit.client.0.smithi159.stdout:5/919: dwrite d8/d19/d23/d35/d41/f58 [0,4194304] 0 2024-02-28T23:07:38.743 INFO:tasks.workunit.client.1.smithi184.stdout:8/644: dread d1/da/d10/fca [0,4194304] 0 2024-02-28T23:07:38.746 INFO:tasks.workunit.client.1.smithi184.stdout:8/645: fsync d1/f86 0 2024-02-28T23:07:38.747 INFO:tasks.workunit.client.1.smithi184.stdout:9/617: dread d5/d17/f28 [4194304,4194304] 0 2024-02-28T23:07:38.748 INFO:tasks.workunit.client.0.smithi159.stdout:7/763: truncate d5/d16/d1a/d27/deb/f85 769569 0 2024-02-28T23:07:38.749 INFO:tasks.workunit.client.1.smithi184.stdout:8/646: chown d1/da/dc/d16/d4d/f87 0 1 2024-02-28T23:07:38.751 INFO:tasks.workunit.client.0.smithi159.stdout:6/916: truncate d0/d1b/f1a 4584793 0 2024-02-28T23:07:38.757 INFO:tasks.workunit.client.0.smithi159.stdout:3/856: readlink d0/d3f/dd2/d6a/la1 0 2024-02-28T23:07:38.757 INFO:tasks.workunit.client.1.smithi184.stdout:1/665: creat d20/d32/d4b/fe6 x:0 0 0 2024-02-28T23:07:38.763 INFO:tasks.workunit.client.1.smithi184.stdout:2/595: chown d10/d1f/c3b 271722 1 2024-02-28T23:07:38.766 INFO:tasks.workunit.client.1.smithi184.stdout:7/596: dwrite d6/d9/d13/d1e/f22 [0,4194304] 0 2024-02-28T23:07:38.768 INFO:tasks.workunit.client.1.smithi184.stdout:2/596: write d10/d1f/d21/d5e/d15/f2e [736269,120397] 0 2024-02-28T23:07:38.771 INFO:tasks.workunit.client.1.smithi184.stdout:5/619: write db/f61 [233133,72549] 0 2024-02-28T23:07:38.774 INFO:tasks.workunit.client.1.smithi184.stdout:5/620: readlink db/d12/d18/d2e/d3c/d5d/d66/lab 0 2024-02-28T23:07:38.775 INFO:tasks.workunit.client.0.smithi159.stdout:6/917: rmdir d0/d1b/d33/d11/d34/d9d/da2/d4e 39 2024-02-28T23:07:38.776 INFO:tasks.workunit.client.1.smithi184.stdout:5/621: write db/d12/d50/d9e/fbb [451868,113378] 0 2024-02-28T23:07:38.777 INFO:tasks.workunit.client.1.smithi184.stdout:5/622: stat db/c96 0 2024-02-28T23:07:38.779 INFO:tasks.workunit.client.0.smithi159.stdout:1/958: dwrite d6/d12/d16/de3/d143/fe8 [0,4194304] 0 2024-02-28T23:07:38.780 INFO:tasks.workunit.client.0.smithi159.stdout:6/918: readlink d0/d1b/ld8 0 2024-02-28T23:07:38.785 INFO:tasks.workunit.client.0.smithi159.stdout:9/897: dwrite d4/d3d/d3e/d55/d37/d62/d6a/fe6 [0,4194304] 0 2024-02-28T23:07:38.791 INFO:tasks.workunit.client.0.smithi159.stdout:1/959: truncate d6/d12/d1a/fa3 5098632 0 2024-02-28T23:07:38.795 INFO:tasks.workunit.client.0.smithi159.stdout:7/764: mkdir d5/d16/d1a/d27/d46/df2 0 2024-02-28T23:07:38.803 INFO:tasks.workunit.client.1.smithi184.stdout:6/562: getdents dc/de/d2a/d5c/d6e 0 2024-02-28T23:07:38.806 INFO:tasks.workunit.client.1.smithi184.stdout:9/618: fsync d5/d47/d68/d7c/fa8 0 2024-02-28T23:07:38.807 INFO:tasks.workunit.client.1.smithi184.stdout:8/647: mkdir d1/da/d10/d43/da1/df3 0 2024-02-28T23:07:38.810 INFO:tasks.workunit.client.1.smithi184.stdout:8/648: write d1/f86 [327455,124783] 0 2024-02-28T23:07:38.817 INFO:tasks.workunit.client.0.smithi159.stdout:2/832: dwrite d9/d50/d54/d84/f45 [0,4194304] 0 2024-02-28T23:07:38.817 INFO:tasks.workunit.client.0.smithi159.stdout:2/833: readlink d9/d36/d59/l6e 0 2024-02-28T23:07:38.817 INFO:tasks.workunit.client.1.smithi184.stdout:1/666: write d20/f2d [7606,34532] 0 2024-02-28T23:07:38.829 INFO:tasks.workunit.client.1.smithi184.stdout:0/666: write d0/df/d13/d27/d31/d51/f8c [43323,57604] 0 2024-02-28T23:07:38.836 INFO:tasks.workunit.client.1.smithi184.stdout:7/597: creat d6/d9/d13/d3e/dad/d7d/d8d/fd0 x:0 0 0 2024-02-28T23:07:38.837 INFO:tasks.workunit.client.0.smithi159.stdout:3/857: write d0/d2b/d55/df8/d2f/d78/fc7 [807704,22915] 0 2024-02-28T23:07:38.838 INFO:tasks.workunit.client.0.smithi159.stdout:5/920: dwrite d8/d16/fb2 [0,4194304] 0 2024-02-28T23:07:38.840 INFO:tasks.workunit.client.1.smithi184.stdout:7/598: chown d6/d9/d13/d3e/dad/f1b 304769 1 2024-02-28T23:07:38.841 INFO:tasks.workunit.client.1.smithi184.stdout:2/597: rename d10/d1f/d21/d5e/l17 to d10/d1f/d38/d54/d96/lba 0 2024-02-28T23:07:38.845 INFO:tasks.workunit.client.0.smithi159.stdout:2/834: dread - d9/d50/d54/d8d/fd8 zero size 2024-02-28T23:07:38.845 INFO:tasks.workunit.client.0.smithi159.stdout:6/919: creat d0/d1b/d33/d11/d34/d9d/da2/d4d/f131 x:0 0 0 2024-02-28T23:07:38.847 INFO:tasks.workunit.client.1.smithi184.stdout:7/599: read d6/d9/d13/d3e/dad/d49/da6/daf/d47/f56 [1233302,20861] 0 2024-02-28T23:07:38.847 INFO:tasks.workunit.client.0.smithi159.stdout:6/920: readlink d0/d1b/d33/d3f/lbe 0 2024-02-28T23:07:38.856 INFO:tasks.workunit.client.1.smithi184.stdout:9/619: dread d5/d17/d43/f48 [0,4194304] 0 2024-02-28T23:07:38.860 INFO:tasks.workunit.client.0.smithi159.stdout:5/921: creat d8/d19/d23/d35/d38/d6d/f146 x:0 0 0 2024-02-28T23:07:38.863 INFO:tasks.workunit.client.0.smithi159.stdout:9/898: creat d4/d52/f11c x:0 0 0 2024-02-28T23:07:38.864 INFO:tasks.workunit.client.0.smithi159.stdout:7/765: dwrite d5/d56/d2a/f69 [0,4194304] 0 2024-02-28T23:07:38.866 INFO:tasks.workunit.client.1.smithi184.stdout:0/667: dread d0/df/d13/d27/d31/db3/f66 [0,4194304] 0 2024-02-28T23:07:38.868 INFO:tasks.workunit.client.0.smithi159.stdout:5/922: fsync d8/d19/d23/d35/d65/da3/df4/da5/d121/f144 0 2024-02-28T23:07:38.877 INFO:tasks.workunit.client.0.smithi159.stdout:1/960: link d6/d12/d1a/c22 d6/d12/d31/d69/dc0/dca/c147 0 2024-02-28T23:07:38.879 INFO:tasks.workunit.client.1.smithi184.stdout:5/623: dwrite db/d12/d1c/d21/fbf [0,4194304] 0 2024-02-28T23:07:38.888 INFO:tasks.workunit.client.0.smithi159.stdout:2/835: mkdir d9/d23/d11f 0 2024-02-28T23:07:38.893 INFO:tasks.workunit.client.0.smithi159.stdout:2/836: write d9/d23/d2c/d55/fee [3888437,100426] 0 2024-02-28T23:07:38.897 INFO:tasks.workunit.client.0.smithi159.stdout:5/923: symlink d8/d19/d23/d35/d38/l147 0 2024-02-28T23:07:38.899 INFO:tasks.workunit.client.0.smithi159.stdout:2/837: write d9/d23/d2c/d55/fcf [4089742,88966] 0 2024-02-28T23:07:38.904 INFO:tasks.workunit.client.0.smithi159.stdout:5/924: stat d8/d19/d23/d35/d41/fce 0 2024-02-28T23:07:38.904 INFO:tasks.workunit.client.0.smithi159.stdout:9/899: symlink d4/de4/d11a/l11d 0 2024-02-28T23:07:38.906 INFO:tasks.workunit.client.0.smithi159.stdout:9/900: stat d4/d3d/d3e/d55/d37/d62/da6 0 2024-02-28T23:07:38.911 INFO:tasks.workunit.client.0.smithi159.stdout:3/858: truncate d0/d6/f32 85426 0 2024-02-28T23:07:38.913 INFO:tasks.workunit.client.0.smithi159.stdout:7/766: dread d5/d56/d50/d88/fd0 [0,4194304] 0 2024-02-28T23:07:38.922 INFO:tasks.workunit.client.0.smithi159.stdout:2/838: rename d9/d23/f6a to d9/d36/dfa/f120 0 2024-02-28T23:07:38.924 INFO:tasks.workunit.client.0.smithi159.stdout:9/901: readlink d4/l9a 0 2024-02-28T23:07:38.926 INFO:tasks.workunit.client.1.smithi184.stdout:1/667: fdatasync f1c 0 2024-02-28T23:07:38.926 INFO:tasks.workunit.client.1.smithi184.stdout:8/649: dread d1/da/dc/d18/f51 [0,4194304] 0 2024-02-28T23:07:38.928 INFO:tasks.workunit.client.0.smithi159.stdout:1/961: link d6/d1d/d46/d88/dd3/d63/f12a d6/d12/d16/de3/d143/dc6/f148 0 2024-02-28T23:07:38.937 INFO:tasks.workunit.client.0.smithi159.stdout:6/921: getdents d0/d1b/d33/d3f/d44/d8b 0 2024-02-28T23:07:38.942 INFO:tasks.workunit.client.1.smithi184.stdout:4/593: link d1/d8/d19/d67/d99/f72 d1/dc/df/d5b/db2/fb4 0 2024-02-28T23:07:38.942 INFO:tasks.workunit.client.1.smithi184.stdout:6/563: sync 2024-02-28T23:07:38.942 INFO:tasks.workunit.client.1.smithi184.stdout:3/655: sync 2024-02-28T23:07:38.944 INFO:tasks.workunit.client.0.smithi159.stdout:7/767: rename d5/d56/d50/daa/fae to d5/d16/d1a/d27/d37/ff3 0 2024-02-28T23:07:38.945 INFO:tasks.workunit.client.1.smithi184.stdout:3/656: stat d1/d4/d6/d1f/d26/d3a/d59/f7d 0 2024-02-28T23:07:38.946 INFO:tasks.workunit.client.1.smithi184.stdout:7/600: rename d6/d9/d13/d3e/dad/d7d/d6c/f79 to d6/d9/d13/d3e/dad/fd1 0 2024-02-28T23:07:38.947 INFO:tasks.workunit.client.0.smithi159.stdout:5/925: write d8/d16/f1a [577040,114685] 0 2024-02-28T23:07:38.947 INFO:tasks.workunit.client.1.smithi184.stdout:7/601: chown d6/fcd 226407387 1 2024-02-28T23:07:38.950 INFO:tasks.workunit.client.0.smithi159.stdout:2/839: creat d9/d50/d54/d84/d37/d5c/f121 x:0 0 0 2024-02-28T23:07:38.952 INFO:tasks.workunit.client.0.smithi159.stdout:3/859: write d0/d47/fcb [3170463,68628] 0 2024-02-28T23:07:38.955 INFO:tasks.workunit.client.0.smithi159.stdout:9/902: creat d4/d3d/d3e/d55/d37/d62/da6/f11e x:0 0 0 2024-02-28T23:07:38.962 INFO:tasks.workunit.client.0.smithi159.stdout:7/768: unlink d5/d16/d1a/d27/d46/f99 0 2024-02-28T23:07:38.963 INFO:tasks.workunit.client.0.smithi159.stdout:5/926: symlink d8/d19/d23/d35/d65/da3/df4/da5/d121/l148 0 2024-02-28T23:07:38.967 INFO:tasks.workunit.client.0.smithi159.stdout:5/927: write d8/db4/de8/f12a [295823,86972] 0 2024-02-28T23:07:38.970 INFO:tasks.workunit.client.1.smithi184.stdout:9/620: sync 2024-02-28T23:07:38.971 INFO:tasks.workunit.client.0.smithi159.stdout:3/860: truncate d0/d2b/d55/d75/d6d/fca 2072725 0 2024-02-28T23:07:38.972 INFO:tasks.workunit.client.1.smithi184.stdout:4/594: read d1/d8/d3d/f74 [10175,49495] 0 2024-02-28T23:07:38.973 INFO:tasks.workunit.client.0.smithi159.stdout:3/861: chown d0/d6/ce1 2382 1 2024-02-28T23:07:38.975 INFO:tasks.workunit.client.0.smithi159.stdout:3/862: write d0/d47/d88/ffc [11218,59009] 0 2024-02-28T23:07:38.979 INFO:tasks.workunit.client.1.smithi184.stdout:7/602: rmdir d6/d9/da 39 2024-02-28T23:07:38.980 INFO:tasks.workunit.client.0.smithi159.stdout:3/863: truncate d0/d2b/d55/df8/d57/f6c 4775430 0 2024-02-28T23:07:38.980 INFO:tasks.workunit.client.1.smithi184.stdout:0/668: write d0/df/f11 [27920,75424] 0 2024-02-28T23:07:38.981 INFO:tasks.workunit.client.1.smithi184.stdout:7/603: fsync d6/d68/fb9 0 2024-02-28T23:07:38.984 INFO:tasks.workunit.client.0.smithi159.stdout:1/962: rename d6/d12/d1a/d92/fa6 to d6/d12/d16/de3/d143/ddc/d139/f149 0 2024-02-28T23:07:38.987 INFO:tasks.workunit.client.0.smithi159.stdout:9/903: symlink d4/d3d/d3e/d4a/d109/l11f 0 2024-02-28T23:07:38.990 INFO:tasks.workunit.client.1.smithi184.stdout:2/598: creat d10/d1f/d21/fbb x:0 0 0 2024-02-28T23:07:38.990 INFO:tasks.workunit.client.0.smithi159.stdout:6/922: rmdir d0/d1b/d33/d123 0 2024-02-28T23:07:38.992 INFO:tasks.workunit.client.0.smithi159.stdout:2/840: write d9/d50/d54/d84/d37/d5c/fd0 [680987,32226] 0 2024-02-28T23:07:38.994 INFO:tasks.workunit.client.0.smithi159.stdout:1/963: readlink l5 0 2024-02-28T23:07:38.995 INFO:tasks.workunit.client.1.smithi184.stdout:4/595: dwrite d1/d4/d43/d73/f91 [0,4194304] 0 2024-02-28T23:07:38.996 INFO:tasks.workunit.client.1.smithi184.stdout:3/657: creat d1/d4/d1c/d62/d66/da6/fca x:0 0 0 2024-02-28T23:07:38.998 INFO:tasks.workunit.client.0.smithi159.stdout:9/904: unlink d4/de4/d11a/l11d 0 2024-02-28T23:07:39.002 INFO:tasks.workunit.client.1.smithi184.stdout:9/621: dread d5/db/de/d10/d12/f9e [0,4194304] 0 2024-02-28T23:07:39.002 INFO:tasks.workunit.client.0.smithi159.stdout:9/905: chown d4/d3d/d3e/d55/d37/def 5160 1 2024-02-28T23:07:39.003 INFO:tasks.workunit.client.1.smithi184.stdout:8/650: dwrite d1/da/dc/d16/d32/f4b [0,4194304] 0 2024-02-28T23:07:39.003 INFO:tasks.workunit.client.1.smithi184.stdout:7/604: creat d6/d9/d13/d14/d45/fd2 x:0 0 0 2024-02-28T23:07:39.004 INFO:tasks.workunit.client.0.smithi159.stdout:3/864: dwrite d0/d2b/d4f/dc3/ff0 [0,4194304] 0 2024-02-28T23:07:39.006 INFO:tasks.workunit.client.0.smithi159.stdout:9/906: stat d4/d3d/d3e/d55/d4c/d4e/d6b/f100 0 2024-02-28T23:07:39.007 INFO:tasks.workunit.client.1.smithi184.stdout:1/668: link f17 d20/d46/d90/de1/fe7 0 2024-02-28T23:07:39.007 INFO:tasks.workunit.client.0.smithi159.stdout:3/865: dread - d0/d2b/d55/d75/d6d/ff5 zero size 2024-02-28T23:07:39.012 INFO:tasks.workunit.client.0.smithi159.stdout:2/841: dread d9/d23/da9/fb4 [0,4194304] 0 2024-02-28T23:07:39.014 INFO:tasks.workunit.client.1.smithi184.stdout:7/605: read d6/d9/d13/f1f [1979324,119723] 0 2024-02-28T23:07:39.018 INFO:tasks.workunit.client.1.smithi184.stdout:6/564: mkdir dc/de/d2a/d5c/d71/db7 0 2024-02-28T23:07:39.020 INFO:tasks.workunit.client.1.smithi184.stdout:6/565: chown dc 0 1 2024-02-28T23:07:39.020 INFO:tasks.workunit.client.0.smithi159.stdout:7/769: rename d5/d16/d1a/fad to d5/d16/d1a/d27/d75/dac/ff4 0 2024-02-28T23:07:39.022 INFO:tasks.workunit.client.1.smithi184.stdout:6/566: stat dc/d42/f59 0 2024-02-28T23:07:39.027 INFO:tasks.workunit.client.1.smithi184.stdout:4/596: mknod d1/dc/df/d27/d34/cb5 0 2024-02-28T23:07:39.031 INFO:tasks.workunit.client.0.smithi159.stdout:2/842: rmdir d9/d50/d62 39 2024-02-28T23:07:39.035 INFO:tasks.workunit.client.1.smithi184.stdout:5/624: sync 2024-02-28T23:07:39.037 INFO:tasks.workunit.client.0.smithi159.stdout:9/907: fsync d4/d76/fdd 0 2024-02-28T23:07:39.041 INFO:tasks.workunit.client.1.smithi184.stdout:4/597: dread d1/d4/d43/d73/f91 [0,4194304] 0 2024-02-28T23:07:39.042 INFO:tasks.workunit.client.1.smithi184.stdout:4/598: chown d1/d8/d19/d67 1038516 1 2024-02-28T23:07:39.044 INFO:tasks.workunit.client.1.smithi184.stdout:0/669: link d0/d1d/f3d d0/df/d13/d9d/fe8 0 2024-02-28T23:07:39.051 INFO:tasks.workunit.client.1.smithi184.stdout:7/606: symlink d6/d9/d13/d1e/d2f/d33/ld3 0 2024-02-28T23:07:39.059 INFO:tasks.workunit.client.1.smithi184.stdout:6/567: chown dc/de/d2a/d5c/d79/d87 20934 1 2024-02-28T23:07:39.076 INFO:tasks.workunit.client.0.smithi159.stdout:1/964: getdents d6/d1d/d1f/db8 0 2024-02-28T23:07:39.077 INFO:tasks.workunit.client.0.smithi159.stdout:3/866: write d0/d2b/d55/f8a [4733920,17876] 0 2024-02-28T23:07:39.078 INFO:tasks.workunit.client.1.smithi184.stdout:8/651: write d1/da/f79 [1493966,119496] 0 2024-02-28T23:07:39.082 INFO:tasks.workunit.client.1.smithi184.stdout:1/669: write d20/d32/d3e/f63 [812464,54425] 0 2024-02-28T23:07:39.083 INFO:tasks.workunit.client.0.smithi159.stdout:7/770: write d5/d16/d1a/f9a [1233075,34417] 0 2024-02-28T23:07:39.086 INFO:tasks.workunit.client.1.smithi184.stdout:4/599: creat d1/d8/d19/d67/fb6 x:0 0 0 2024-02-28T23:07:39.089 INFO:tasks.workunit.client.1.smithi184.stdout:0/670: dread d0/df/d13/d27/f2c [0,4194304] 0 2024-02-28T23:07:39.090 INFO:tasks.workunit.client.1.smithi184.stdout:2/599: creat d10/d1f/d38/d54/fbc x:0 0 0 2024-02-28T23:07:39.090 INFO:tasks.workunit.client.0.smithi159.stdout:6/923: dwrite d0/d1b/d33/d11/d34/d9d/da2/fed [0,4194304] 0 2024-02-28T23:07:39.095 INFO:tasks.workunit.client.1.smithi184.stdout:6/568: fsync dc/de/d2a/d5c/f95 0 2024-02-28T23:07:39.095 INFO:tasks.workunit.client.0.smithi159.stdout:5/928: rename d8/d19/d23/d35/d41/d92/d10c/c145 to d8/d19/d23/d35/d65/da3/c149 0 2024-02-28T23:07:39.096 INFO:tasks.workunit.client.1.smithi184.stdout:3/658: write d1/d4/d6/d1f/f60 [4697892,120228] 0 2024-02-28T23:07:39.099 INFO:tasks.workunit.client.0.smithi159.stdout:3/867: creat d0/d47/d88/f113 x:0 0 0 2024-02-28T23:07:39.099 INFO:tasks.workunit.client.1.smithi184.stdout:6/569: read dc/d60/f58 [4172526,87563] 0 2024-02-28T23:07:39.102 INFO:tasks.workunit.client.1.smithi184.stdout:6/570: fsync dc/de/f20 0 2024-02-28T23:07:39.103 INFO:tasks.workunit.client.0.smithi159.stdout:9/908: truncate d4/d3d/f7e 1146024 0 2024-02-28T23:07:39.103 INFO:tasks.workunit.client.0.smithi159.stdout:2/843: dwrite d9/d50/d54/d84/d37/d5c/fea [0,4194304] 0 2024-02-28T23:07:39.106 INFO:tasks.workunit.client.1.smithi184.stdout:0/671: dwrite d0/df/d13/d27/d31/f45 [0,4194304] 0 2024-02-28T23:07:39.108 INFO:tasks.workunit.client.0.smithi159.stdout:2/844: dread - d9/d50/d54/d84/d37/d5c/f121 zero size 2024-02-28T23:07:39.113 INFO:tasks.workunit.client.1.smithi184.stdout:9/622: dwrite d5/d17/d43/f60 [0,4194304] 0 2024-02-28T23:07:39.124 INFO:tasks.workunit.client.1.smithi184.stdout:1/670: read f2 [1004149,96171] 0 2024-02-28T23:07:39.124 INFO:tasks.workunit.client.1.smithi184.stdout:5/625: rename db/d12/d50/d9e/fa7 to db/fcd 0 2024-02-28T23:07:39.128 INFO:tasks.workunit.client.1.smithi184.stdout:8/652: symlink d1/da/d10/d17/d63/lf4 0 2024-02-28T23:07:39.130 INFO:tasks.workunit.client.1.smithi184.stdout:9/623: rmdir d5/d47/d59/d92 39 2024-02-28T23:07:39.131 INFO:tasks.workunit.client.1.smithi184.stdout:5/626: write db/d12/d50/fb2 [1094264,49534] 0 2024-02-28T23:07:39.133 INFO:tasks.workunit.client.1.smithi184.stdout:1/671: symlink d20/d46/d90/le8 0 2024-02-28T23:07:39.137 INFO:tasks.workunit.client.1.smithi184.stdout:5/627: dread - db/d44/da5/faa zero size 2024-02-28T23:07:39.138 INFO:tasks.workunit.client.1.smithi184.stdout:1/672: write d20/d32/d3e/d91/faa [2753342,25317] 0 2024-02-28T23:07:39.143 INFO:tasks.workunit.client.1.smithi184.stdout:7/607: rename d6/d9/d13/d1e/d2f/f44 to d6/d9/d13/d3e/dad/d49/d9c/fd4 0 2024-02-28T23:07:39.144 INFO:tasks.workunit.client.1.smithi184.stdout:0/672: creat d0/df/d13/d27/d31/d5b/d8e/d92/dac/fe9 x:0 0 0 2024-02-28T23:07:39.146 INFO:tasks.workunit.client.1.smithi184.stdout:2/600: dwrite d10/d55/d89/fa1 [0,4194304] 0 2024-02-28T23:07:39.146 INFO:tasks.workunit.client.1.smithi184.stdout:8/653: unlink d1/da/df/lea 0 2024-02-28T23:07:39.149 INFO:tasks.workunit.client.1.smithi184.stdout:0/673: fdatasync d0/df/d13/d27/d31/d51/d85/fc0 0 2024-02-28T23:07:39.149 INFO:tasks.workunit.client.1.smithi184.stdout:6/571: creat dc/de/d10/fb8 x:0 0 0 2024-02-28T23:07:39.151 INFO:tasks.workunit.client.1.smithi184.stdout:2/601: read d10/f34 [202712,109066] 0 2024-02-28T23:07:39.158 INFO:tasks.workunit.client.1.smithi184.stdout:5/628: rmdir db/d12/d1c/d21/d2f/dc4 39 2024-02-28T23:07:39.162 INFO:tasks.workunit.client.1.smithi184.stdout:4/600: dread d1/dc/f23 [0,4194304] 0 2024-02-28T23:07:39.164 INFO:tasks.workunit.client.1.smithi184.stdout:5/629: write db/d12/d1c/d21/f2a [7454242,88217] 0 2024-02-28T23:07:39.168 INFO:tasks.workunit.client.1.smithi184.stdout:4/601: chown d1/dc/df/d5b/db2/d9f/da0 14589327 1 2024-02-28T23:07:39.168 INFO:tasks.workunit.client.1.smithi184.stdout:3/659: dwrite d1/d4/d1c/f27 [0,4194304] 0 2024-02-28T23:07:39.172 INFO:tasks.workunit.client.0.smithi159.stdout:7/771: mkdir d5/d56/d50/d88/df5 0 2024-02-28T23:07:39.173 INFO:tasks.workunit.client.1.smithi184.stdout:6/572: dwrite dc/de/f20 [8388608,4194304] 0 2024-02-28T23:07:39.176 INFO:tasks.workunit.client.1.smithi184.stdout:6/573: write dc/d60/faa [363193,12825] 0 2024-02-28T23:07:39.188 INFO:tasks.workunit.client.0.smithi159.stdout:5/929: symlink d8/d19/d23/d35/d41/d92/d10c/l14a 0 2024-02-28T23:07:39.198 INFO:tasks.workunit.client.1.smithi184.stdout:1/673: write d20/d32/d3e/dc9/fe2 [262730,102037] 0 2024-02-28T23:07:39.201 INFO:tasks.workunit.client.0.smithi159.stdout:2/845: creat d9/d50/dcc/f122 x:0 0 0 2024-02-28T23:07:39.203 INFO:tasks.workunit.client.0.smithi159.stdout:7/772: dwrite d5/d16/d1a/d27/d46/f61 [0,4194304] 0 2024-02-28T23:07:39.206 INFO:tasks.workunit.client.1.smithi184.stdout:9/624: rmdir d5/db/d65/d95 0 2024-02-28T23:07:39.208 INFO:tasks.workunit.client.1.smithi184.stdout:9/625: write d5/d47/fc3 [589695,105337] 0 2024-02-28T23:07:39.215 INFO:tasks.workunit.client.1.smithi184.stdout:0/674: write d0/df/d13/d27/d31/d51/f59 [825185,17447] 0 2024-02-28T23:07:39.217 INFO:tasks.workunit.client.1.smithi184.stdout:5/630: dread db/d12/d1c/d21/d2f/f5a [0,4194304] 0 2024-02-28T23:07:39.218 INFO:tasks.workunit.client.0.smithi159.stdout:1/965: write d6/d1d/fc7 [433071,108321] 0 2024-02-28T23:07:39.221 INFO:tasks.workunit.client.1.smithi184.stdout:3/660: dread - d1/d4/d6/d1f/d26/d3a/d59/f73 zero size 2024-02-28T23:07:39.222 INFO:tasks.workunit.client.1.smithi184.stdout:6/574: mkdir dc/de/d2a/d5c/d79/db9 0 2024-02-28T23:07:39.223 INFO:tasks.workunit.client.1.smithi184.stdout:8/654: dwrite d1/da/dc/d16/d29/f54 [0,4194304] 0 2024-02-28T23:07:39.223 INFO:tasks.workunit.client.0.smithi159.stdout:1/966: write d6/d12/d31/d5a/f87 [285148,65426] 0 2024-02-28T23:07:39.224 INFO:tasks.workunit.client.1.smithi184.stdout:2/602: getdents d10/d1f/d38/d54/d96/dab 0 2024-02-28T23:07:39.226 INFO:tasks.workunit.client.0.smithi159.stdout:6/924: mknod d0/d1b/d33/d11/d34/d9d/da2/d4e/d126/c132 0 2024-02-28T23:07:39.227 INFO:tasks.workunit.client.1.smithi184.stdout:5/631: chown db/d12/d18/d2e/d3c/d5d/d66/f6a 5606 1 2024-02-28T23:07:39.228 INFO:tasks.workunit.client.1.smithi184.stdout:8/655: dread - d1/da/dc/d16/fef zero size 2024-02-28T23:07:39.232 INFO:tasks.workunit.client.1.smithi184.stdout:1/674: creat d20/d46/d90/fe9 x:0 0 0 2024-02-28T23:07:39.235 INFO:tasks.workunit.client.1.smithi184.stdout:1/675: truncate d20/d32/fd6 734022 0 2024-02-28T23:07:39.235 INFO:tasks.workunit.client.1.smithi184.stdout:9/626: read d5/db/de/d10/d12/f4d [142433,74385] 0 2024-02-28T23:07:39.235 INFO:tasks.workunit.client.0.smithi159.stdout:9/909: rename d4/d3d/d3e/d55/d4c/d4e/ce0 to d4/d3d/d3e/d55/c120 0 2024-02-28T23:07:39.236 INFO:tasks.workunit.client.1.smithi184.stdout:8/656: chown d1/da/d10/d17/d63/f68 207333 1 2024-02-28T23:07:39.238 INFO:tasks.workunit.client.1.smithi184.stdout:7/608: write d6/f48 [435802,95632] 0 2024-02-28T23:07:39.239 INFO:tasks.workunit.client.1.smithi184.stdout:6/575: dread dc/de/d2a/f35 [0,4194304] 0 2024-02-28T23:07:39.241 INFO:tasks.workunit.client.1.smithi184.stdout:8/657: readlink d1/da/dc/d16/d4d/d82/l96 0 2024-02-28T23:07:39.242 INFO:tasks.workunit.client.1.smithi184.stdout:7/609: chown f0 12 1 2024-02-28T23:07:39.246 INFO:tasks.workunit.client.1.smithi184.stdout:2/603: dwrite d10/f16 [4194304,4194304] 0 2024-02-28T23:07:39.246 INFO:tasks.workunit.client.1.smithi184.stdout:6/576: truncate dc/de/d2a/d5c/d79/fac 460750 0 2024-02-28T23:07:39.248 INFO:tasks.workunit.client.1.smithi184.stdout:5/632: dwrite db/d12/d1c/f3a [0,4194304] 0 2024-02-28T23:07:39.249 INFO:tasks.workunit.client.1.smithi184.stdout:0/675: creat d0/d1f/de3/fea x:0 0 0 2024-02-28T23:07:39.250 INFO:tasks.workunit.client.0.smithi159.stdout:1/967: creat d6/d12/d16/de3/f14a x:0 0 0 2024-02-28T23:07:39.251 INFO:tasks.workunit.client.1.smithi184.stdout:4/602: write d1/d8/d3d/f74 [728927,33823] 0 2024-02-28T23:07:39.254 INFO:tasks.workunit.client.1.smithi184.stdout:0/676: chown d0/df/d13/d27/d31/d5b/d8e/d92/dac/fe9 681 1 2024-02-28T23:07:39.259 INFO:tasks.workunit.client.1.smithi184.stdout:0/677: stat d0/d7c 0 2024-02-28T23:07:39.262 INFO:tasks.workunit.client.1.smithi184.stdout:3/661: creat d1/d4/d6/d1f/d26/d3a/d59/d67/fcb x:0 0 0 2024-02-28T23:07:39.263 INFO:tasks.workunit.client.1.smithi184.stdout:2/604: dwrite d10/d33/f7d [4194304,4194304] 0 2024-02-28T23:07:39.264 INFO:tasks.workunit.client.1.smithi184.stdout:3/662: readlink d1/d4/d6/d1f/d24/l25 0 2024-02-28T23:07:39.266 INFO:tasks.workunit.client.0.smithi159.stdout:2/846: write d9/d36/dc3/fdb [1039371,81376] 0 2024-02-28T23:07:39.270 INFO:tasks.workunit.client.1.smithi184.stdout:1/676: truncate f2 484968 0 2024-02-28T23:07:39.272 INFO:tasks.workunit.client.1.smithi184.stdout:1/677: write d20/d32/d4d/fa9 [560016,112498] 0 2024-02-28T23:07:39.273 INFO:tasks.workunit.client.1.smithi184.stdout:1/678: readlink d20/d32/l95 0 2024-02-28T23:07:39.276 INFO:tasks.workunit.client.0.smithi159.stdout:3/868: dwrite d0/d6/f32 [0,4194304] 0 2024-02-28T23:07:39.277 INFO:tasks.workunit.client.0.smithi159.stdout:5/930: getdents d8/d19/d23/d35/d41/d92 0 2024-02-28T23:07:39.281 INFO:tasks.workunit.client.0.smithi159.stdout:1/968: dread - d6/d12/d31/d5a/f11b zero size 2024-02-28T23:07:39.287 INFO:tasks.workunit.client.0.smithi159.stdout:6/925: link d0/f8 d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/f133 0 2024-02-28T23:07:39.288 INFO:tasks.workunit.client.1.smithi184.stdout:4/603: stat d1/dc/df/d38/d57/cac 0 2024-02-28T23:07:39.291 INFO:tasks.workunit.client.1.smithi184.stdout:0/678: fdatasync d0/df/d13/d27/d31/d5b/d8e/d92/fcd 0 2024-02-28T23:07:39.297 INFO:tasks.workunit.client.1.smithi184.stdout:2/605: creat d10/d1f/d21/d5e/fbd x:0 0 0 2024-02-28T23:07:39.305 INFO:tasks.workunit.client.1.smithi184.stdout:3/663: creat d1/d4/d1c/d62/d92/d9b/fcc x:0 0 0 2024-02-28T23:07:39.307 INFO:tasks.workunit.client.1.smithi184.stdout:3/664: write d1/d4/d1c/d61/d87/f8b [1383785,129518] 0 2024-02-28T23:07:39.309 INFO:tasks.workunit.client.1.smithi184.stdout:9/627: getdents d5/db/de/d10/d6a/dae 0 2024-02-28T23:07:39.318 INFO:tasks.workunit.client.1.smithi184.stdout:5/633: unlink db/d1f/f5b 0 2024-02-28T23:07:39.323 INFO:tasks.workunit.client.1.smithi184.stdout:4/604: fdatasync d1/d4/f11 0 2024-02-28T23:07:39.323 INFO:tasks.workunit.client.0.smithi159.stdout:2/847: truncate d9/d23/de6/f110 2692382 0 2024-02-28T23:07:39.328 INFO:tasks.workunit.client.0.smithi159.stdout:5/931: creat d8/d19/d23/d35/d38/d6d/f14b x:0 0 0 2024-02-28T23:07:39.330 INFO:tasks.workunit.client.0.smithi159.stdout:3/869: link d0/d2b/d55/d75/d6d/f66 d0/def/f114 0 2024-02-28T23:07:39.330 INFO:tasks.workunit.client.1.smithi184.stdout:9/628: symlink d5/db/de/d10/d6a/lc8 0 2024-02-28T23:07:39.331 INFO:tasks.workunit.client.0.smithi159.stdout:6/926: write d0/d1b/d33/d11/d34/d9d/ffe [904991,110857] 0 2024-02-28T23:07:39.333 INFO:tasks.workunit.client.1.smithi184.stdout:1/679: dwrite d20/f50 [0,4194304] 0 2024-02-28T23:07:39.335 INFO:tasks.workunit.client.1.smithi184.stdout:9/629: dread d5/db/de/d10/d6a/faa [0,4194304] 0 2024-02-28T23:07:39.335 INFO:tasks.workunit.client.0.smithi159.stdout:6/927: chown d0/d1b/d33/d11/d34/d9d/fee 11 1 2024-02-28T23:07:39.337 INFO:tasks.workunit.client.1.smithi184.stdout:6/577: rmdir dc/d60/d62/d88 0 2024-02-28T23:07:39.339 INFO:tasks.workunit.client.0.smithi159.stdout:1/969: dwrite d6/d12/d16/de3/d143/dc6/ff8 [0,4194304] 0 2024-02-28T23:07:39.344 INFO:tasks.workunit.client.1.smithi184.stdout:5/634: symlink db/d12/d1c/d21/d2f/dc4/lce 0 2024-02-28T23:07:39.347 INFO:tasks.workunit.client.0.smithi159.stdout:2/848: mkdir d9/d50/d123 0 2024-02-28T23:07:39.347 INFO:tasks.workunit.client.0.smithi159.stdout:5/932: rmdir d8/d19/d23/d35/d65/da3/df4/da5/ddc 39 2024-02-28T23:07:39.347 INFO:tasks.workunit.client.0.smithi159.stdout:2/849: chown d9/d36/l7c 1281115 1 2024-02-28T23:07:39.347 INFO:tasks.workunit.client.0.smithi159.stdout:3/870: fdatasync d0/def/d79/d9b/fea 0 2024-02-28T23:07:39.351 INFO:tasks.workunit.client.0.smithi159.stdout:1/970: creat d6/d1d/d1f/db8/f14b x:0 0 0 2024-02-28T23:07:39.352 INFO:tasks.workunit.client.1.smithi184.stdout:1/680: dwrite d20/d32/fd6 [0,4194304] 0 2024-02-28T23:07:39.352 INFO:tasks.workunit.client.1.smithi184.stdout:0/679: mknod d0/df/d13/d27/ceb 0 2024-02-28T23:07:39.356 INFO:tasks.workunit.client.1.smithi184.stdout:7/610: getdents d6/d9/d13/d3e/dad/d7d 0 2024-02-28T23:07:39.363 INFO:tasks.workunit.client.0.smithi159.stdout:1/971: creat d6/d12/d33/d48/f14c x:0 0 0 2024-02-28T23:07:39.363 INFO:tasks.workunit.client.0.smithi159.stdout:3/871: dread d0/d3f/feb [0,4194304] 0 2024-02-28T23:07:39.367 INFO:tasks.workunit.client.1.smithi184.stdout:9/630: fsync d5/d17/f28 0 2024-02-28T23:07:39.369 INFO:tasks.workunit.client.1.smithi184.stdout:9/631: write d5/db/de/d10/d12/d2f/f51 [6112064,114233] 0 2024-02-28T23:07:39.377 INFO:tasks.workunit.client.1.smithi184.stdout:2/606: creat d10/d1f/d21/d5e/d15/fbe x:0 0 0 2024-02-28T23:07:39.378 INFO:tasks.workunit.client.1.smithi184.stdout:2/607: readlink l2 0 2024-02-28T23:07:39.378 INFO:tasks.workunit.client.1.smithi184.stdout:1/681: fsync d20/d46/d90/f55 0 2024-02-28T23:07:39.379 INFO:tasks.workunit.client.0.smithi159.stdout:1/972: mknod d6/d12/d1a/d92/d97/c14d 0 2024-02-28T23:07:39.390 INFO:tasks.workunit.client.1.smithi184.stdout:9/632: dwrite d5/d17/f28 [4194304,4194304] 0 2024-02-28T23:07:39.392 INFO:tasks.workunit.client.1.smithi184.stdout:9/633: readlink d5/d17/d8f/la4 0 2024-02-28T23:07:39.393 INFO:tasks.workunit.client.1.smithi184.stdout:8/658: sync 2024-02-28T23:07:39.394 INFO:tasks.workunit.client.0.smithi159.stdout:6/928: dread d0/d1b/f3c [0,4194304] 0 2024-02-28T23:07:39.397 INFO:tasks.workunit.client.1.smithi184.stdout:4/605: write d1/dc/df/d5b/db2/fb4 [1013049,22135] 0 2024-02-28T23:07:39.408 INFO:tasks.workunit.client.0.smithi159.stdout:2/850: write d9/d50/dcc/f74 [124147,61019] 0 2024-02-28T23:07:39.411 INFO:tasks.workunit.client.1.smithi184.stdout:7/611: link d6/d9/d13/d3e/f64 d6/d9/d13/d3e/dad/d49/da6/fd5 0 2024-02-28T23:07:39.413 INFO:tasks.workunit.client.0.smithi159.stdout:6/929: symlink d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/l134 0 2024-02-28T23:07:39.414 INFO:tasks.workunit.client.0.smithi159.stdout:2/851: stat d9/lb2 0 2024-02-28T23:07:39.414 INFO:tasks.workunit.client.0.smithi159.stdout:2/852: readlink d9/d23/la7 0 2024-02-28T23:07:39.417 INFO:tasks.workunit.client.0.smithi159.stdout:5/933: write d8/d16/d122/f45 [1507986,104321] 0 2024-02-28T23:07:39.418 INFO:tasks.workunit.client.1.smithi184.stdout:6/578: truncate dc/de/d2a/d5c/d79/fac 323605 0 2024-02-28T23:07:39.424 INFO:tasks.workunit.client.0.smithi159.stdout:3/872: dread d0/d2b/d55/d6e/fb6 [0,4194304] 0 2024-02-28T23:07:39.424 INFO:tasks.workunit.client.1.smithi184.stdout:8/659: read d1/da/d10/f2d [645730,18906] 0 2024-02-28T23:07:39.424 INFO:tasks.workunit.client.1.smithi184.stdout:5/635: dwrite db/d12/f47 [0,4194304] 0 2024-02-28T23:07:39.427 INFO:tasks.workunit.client.1.smithi184.stdout:5/636: dread db/d90/f86 [0,4194304] 0 2024-02-28T23:07:39.430 INFO:tasks.workunit.client.1.smithi184.stdout:4/606: dread d1/d8/d19/f1a [0,4194304] 0 2024-02-28T23:07:39.431 INFO:tasks.workunit.client.1.smithi184.stdout:9/634: mkdir d5/db/de/d10/dc9 0 2024-02-28T23:07:39.435 INFO:tasks.workunit.client.0.smithi159.stdout:6/930: dread - d0/d1b/d33/d11/d34/d9d/da2/d96/ff5 zero size 2024-02-28T23:07:39.442 INFO:tasks.workunit.client.0.smithi159.stdout:1/973: getdents d6/d12/d1a/d92/dc8 0 2024-02-28T23:07:39.442 INFO:tasks.workunit.client.1.smithi184.stdout:7/612: dread d6/d9/d13/d3e/dad/f1b [0,4194304] 0 2024-02-28T23:07:39.446 INFO:tasks.workunit.client.0.smithi159.stdout:3/873: mkdir d0/d2b/d55/d10a/d115 0 2024-02-28T23:07:39.447 INFO:tasks.workunit.client.0.smithi159.stdout:2/853: truncate d9/d50/d54/d84/d37/f53 1584240 0 2024-02-28T23:07:39.448 INFO:tasks.workunit.client.1.smithi184.stdout:8/660: chown d1/da/d10/c93 7 1 2024-02-28T23:07:39.449 INFO:tasks.workunit.client.1.smithi184.stdout:8/661: read - d1/da/dc/d16/d29/d92/fdb zero size 2024-02-28T23:07:39.451 INFO:tasks.workunit.client.0.smithi159.stdout:2/854: read d9/d50/d54/d84/fa8 [3469896,52776] 0 2024-02-28T23:07:39.454 INFO:tasks.workunit.client.0.smithi159.stdout:2/855: dread - d9/d50/d54/d84/d37/d5c/f121 zero size 2024-02-28T23:07:39.457 INFO:tasks.workunit.client.1.smithi184.stdout:5/637: mknod db/d12/d1c/d80/ccf 0 2024-02-28T23:07:39.462 INFO:tasks.workunit.client.0.smithi159.stdout:3/874: unlink d0/c14 0 2024-02-28T23:07:39.464 INFO:tasks.workunit.client.0.smithi159.stdout:3/875: chown d0/d2b/d4f/ce9 63222 1 2024-02-28T23:07:39.464 INFO:tasks.workunit.client.0.smithi159.stdout:6/931: write d0/fc [3941721,17442] 0 2024-02-28T23:07:39.468 INFO:tasks.workunit.client.1.smithi184.stdout:4/607: mkdir d1/d4/d43/d73/db7 0 2024-02-28T23:07:39.471 INFO:tasks.workunit.client.1.smithi184.stdout:4/608: write d1/d8/d19/d67/d99/f72 [326412,48602] 0 2024-02-28T23:07:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:39 smithi159 ceph-mon[28802]: pgmap v38: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 62 MiB/s rd, 157 MiB/s wr, 347 op/s 2024-02-28T23:07:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:39 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:39 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:39 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:07:39.473 INFO:tasks.workunit.client.1.smithi184.stdout:9/635: mknod d5/d17/d8f/cca 0 2024-02-28T23:07:39.475 INFO:tasks.workunit.client.0.smithi159.stdout:2/856: rmdir d9/d23/de6 39 2024-02-28T23:07:39.479 INFO:tasks.workunit.client.1.smithi184.stdout:6/579: rename dc/de/c5b to dc/de/d2a/d5c/d79/da2/cba 0 2024-02-28T23:07:39.481 INFO:tasks.workunit.client.1.smithi184.stdout:3/665: sync 2024-02-28T23:07:39.481 INFO:tasks.workunit.client.1.smithi184.stdout:1/682: getdents d20/d32/d3e/d61/d8b/d9c/db8 0 2024-02-28T23:07:39.481 INFO:tasks.workunit.client.0.smithi159.stdout:6/932: mkdir d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d113/d135 0 2024-02-28T23:07:39.482 INFO:tasks.workunit.client.0.smithi159.stdout:6/933: chown d0/d1b/d33/d11 467774 1 2024-02-28T23:07:39.483 INFO:tasks.workunit.client.1.smithi184.stdout:6/580: write dc/d60/d7c/d90/fa6 [492061,54702] 0 2024-02-28T23:07:39.484 INFO:tasks.workunit.client.0.smithi159.stdout:1/974: creat d6/d1d/d1f/db8/dcc/f14e x:0 0 0 2024-02-28T23:07:39.493 INFO:tasks.workunit.client.1.smithi184.stdout:6/581: dread dc/de/f5a [0,4194304] 0 2024-02-28T23:07:39.494 INFO:tasks.workunit.client.1.smithi184.stdout:4/609: creat d1/d8/d19/d67/d99/fb8 x:0 0 0 2024-02-28T23:07:39.497 INFO:tasks.workunit.client.1.smithi184.stdout:9/636: fsync d5/d17/d43/f5b 0 2024-02-28T23:07:39.501 INFO:tasks.workunit.client.1.smithi184.stdout:7/613: rename d6/d9/d13/d3e/dad/d49/d50/db2/fbd to d6/d68/fd6 0 2024-02-28T23:07:39.501 INFO:tasks.workunit.client.1.smithi184.stdout:1/683: dwrite f1c [0,4194304] 0 2024-02-28T23:07:39.504 INFO:tasks.workunit.client.1.smithi184.stdout:7/614: write d6/d9/d13/d3e/dad/f12 [3146512,109881] 0 2024-02-28T23:07:39.504 INFO:tasks.workunit.client.1.smithi184.stdout:1/684: write d20/d32/d4b/fe0 [1029154,90677] 0 2024-02-28T23:07:39.505 INFO:tasks.workunit.client.0.smithi159.stdout:2/857: getdents d9/d23/da9 0 2024-02-28T23:07:39.511 INFO:tasks.workunit.client.1.smithi184.stdout:5/638: write db/d12/d50/f8d [653217,61519] 0 2024-02-28T23:07:39.520 INFO:tasks.workunit.client.1.smithi184.stdout:4/610: rename d1/dc/df/d5b/d6c/l6e to d1/d8/d35/lb9 0 2024-02-28T23:07:39.526 INFO:tasks.workunit.client.0.smithi159.stdout:3/876: dwrite d0/d2b/d55/df8/da9/fe0 [0,4194304] 0 2024-02-28T23:07:39.527 INFO:tasks.workunit.client.1.smithi184.stdout:1/685: mknod d20/d32/d3e/dc9/cea 0 2024-02-28T23:07:39.527 INFO:tasks.workunit.client.0.smithi159.stdout:2/858: write d9/d23/d2c/f32 [525611,15258] 0 2024-02-28T23:07:39.527 INFO:tasks.workunit.client.0.smithi159.stdout:3/877: stat d0/d3f/dd2/d63/lf9 0 2024-02-28T23:07:39.529 INFO:tasks.workunit.client.1.smithi184.stdout:3/666: dwrite d1/d4/d6/d1f/d24/d76/fc2 [0,4194304] 0 2024-02-28T23:07:39.531 INFO:tasks.workunit.client.0.smithi159.stdout:6/934: dwrite d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/f116 [0,4194304] 0 2024-02-28T23:07:39.531 INFO:tasks.workunit.client.0.smithi159.stdout:3/878: dread - d0/d6/d34/f10e zero size 2024-02-28T23:07:39.535 INFO:tasks.workunit.client.1.smithi184.stdout:3/667: write d1/d4/d6/d1f/d26/d3a/d59/d67/fcb [370426,35834] 0 2024-02-28T23:07:39.538 INFO:tasks.workunit.client.1.smithi184.stdout:3/668: readlink d1/d4/d5/da9/d6e/l9d 0 2024-02-28T23:07:39.538 INFO:tasks.workunit.client.1.smithi184.stdout:0/680: sync 2024-02-28T23:07:39.538 INFO:tasks.workunit.client.1.smithi184.stdout:2/608: sync 2024-02-28T23:07:39.540 INFO:tasks.workunit.client.1.smithi184.stdout:6/582: creat dc/d60/d62/d6f/d99/d9d/fbb x:0 0 0 2024-02-28T23:07:39.543 INFO:tasks.workunit.client.1.smithi184.stdout:9/637: symlink d5/db/lcb 0 2024-02-28T23:07:39.548 INFO:tasks.workunit.client.1.smithi184.stdout:7/615: rename d6/d9/d13/d3e/dad/d49/f95 to d6/d9/d13/d3e/dad/d7d/d8d/fd7 0 2024-02-28T23:07:39.549 INFO:tasks.workunit.client.1.smithi184.stdout:8/662: getdents d1/da/dc/d16/d29/d92 0 2024-02-28T23:07:39.550 INFO:tasks.workunit.client.0.smithi159.stdout:3/879: truncate d0/def/f114 1029553 0 2024-02-28T23:07:39.552 INFO:tasks.workunit.client.1.smithi184.stdout:9/638: dread d5/d47/d68/f6f [0,4194304] 0 2024-02-28T23:07:39.552 INFO:tasks.workunit.client.1.smithi184.stdout:8/663: dread - d1/da/dc/d16/d29/d92/fec zero size 2024-02-28T23:07:39.554 INFO:tasks.workunit.client.1.smithi184.stdout:0/681: dwrite d0/df/d13/d27/d31/d5b/fb1 [0,4194304] 0 2024-02-28T23:07:39.555 INFO:tasks.workunit.client.1.smithi184.stdout:7/616: truncate d6/d9/d13/d3e/dad/d7d/d8d/fd0 377909 0 2024-02-28T23:07:39.556 INFO:tasks.workunit.client.0.smithi159.stdout:6/935: rmdir d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d113/d122 0 2024-02-28T23:07:39.557 INFO:tasks.workunit.client.1.smithi184.stdout:0/682: chown d0/df/d13/d27/d31/f8f 1250231 1 2024-02-28T23:07:39.557 INFO:tasks.workunit.client.1.smithi184.stdout:1/686: creat d20/d32/d3e/d61/feb x:0 0 0 2024-02-28T23:07:39.559 INFO:tasks.workunit.client.0.smithi159.stdout:3/880: creat d0/d47/d88/f116 x:0 0 0 2024-02-28T23:07:39.560 INFO:tasks.workunit.client.1.smithi184.stdout:3/669: mkdir d1/d4/d5/da9/d74/dcd 0 2024-02-28T23:07:39.562 INFO:tasks.workunit.client.0.smithi159.stdout:6/936: mkdir d0/d1b/d33/d8c/d136 0 2024-02-28T23:07:39.563 INFO:tasks.workunit.client.1.smithi184.stdout:6/583: rename dc/de/d10/d16/la0 to dc/de/d10/d16/lbc 0 2024-02-28T23:07:39.564 INFO:tasks.workunit.client.1.smithi184.stdout:6/584: chown dc/d60/d7c/f6b 192467979 1 2024-02-28T23:07:39.571 INFO:tasks.workunit.client.0.smithi159.stdout:6/937: symlink d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/l137 0 2024-02-28T23:07:39.572 INFO:tasks.workunit.client.1.smithi184.stdout:1/687: readlink d20/l6b 0 2024-02-28T23:07:39.572 INFO:tasks.workunit.client.1.smithi184.stdout:0/683: fdatasync d0/d1f/de3/f70 0 2024-02-28T23:07:39.573 INFO:tasks.workunit.client.1.smithi184.stdout:7/617: creat d6/d9/d13/d3e/dad/d7d/d6c/fd8 x:0 0 0 2024-02-28T23:07:39.574 INFO:tasks.workunit.client.1.smithi184.stdout:2/609: dwrite d10/d1f/f41 [0,4194304] 0 2024-02-28T23:07:39.576 INFO:tasks.workunit.client.1.smithi184.stdout:3/670: creat d1/d4/d1c/d62/d92/d9b/fce x:0 0 0 2024-02-28T23:07:39.576 INFO:tasks.workunit.client.1.smithi184.stdout:7/618: chown d6/d9/d13/d3e/dad/d49/d50/db2/fba 13891113 1 2024-02-28T23:07:39.578 INFO:tasks.workunit.client.1.smithi184.stdout:8/664: creat d1/da/dc/d16/de7/ff5 x:0 0 0 2024-02-28T23:07:39.578 INFO:tasks.workunit.client.1.smithi184.stdout:3/671: chown d1/d4/d6/d1f/d26/d3a/d59 156785197 1 2024-02-28T23:07:39.581 INFO:tasks.workunit.client.1.smithi184.stdout:3/672: write d1/d4/d6/d1f/d24/f3e [2730706,108911] 0 2024-02-28T23:07:39.582 INFO:tasks.workunit.client.1.smithi184.stdout:4/611: rename d1/dc/df/d27/c6f to d1/d4/cba 0 2024-02-28T23:07:39.583 INFO:tasks.workunit.client.0.smithi159.stdout:2/859: dread d9/d23/d2c/d55/f5b [0,4194304] 0 2024-02-28T23:07:39.590 INFO:tasks.workunit.client.1.smithi184.stdout:2/610: truncate d10/f51 1626881 0 2024-02-28T23:07:39.592 INFO:tasks.workunit.client.1.smithi184.stdout:0/684: dwrite d0/df/d13/d27/d31/d5b/d8e/da3/fca [0,4194304] 0 2024-02-28T23:07:39.595 INFO:tasks.workunit.client.1.smithi184.stdout:7/619: symlink d6/d9/d13/d3e/dad/d7d/d8d/ld9 0 2024-02-28T23:07:39.598 INFO:tasks.workunit.client.0.smithi159.stdout:2/860: dwrite d9/d23/d2c/f32 [0,4194304] 0 2024-02-28T23:07:39.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:39 smithi184 ceph-mon[36198]: pgmap v38: 65 pgs: 65 active+clean; 2.9 GiB data, 8.7 GiB used, 528 GiB / 536 GiB avail; 62 MiB/s rd, 157 MiB/s wr, 347 op/s 2024-02-28T23:07:39.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:39 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:39.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:39 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:39.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:39 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:07:39.611 INFO:tasks.workunit.client.1.smithi184.stdout:4/612: symlink d1/dc/df/d38/d57/lbb 0 2024-02-28T23:07:39.611 INFO:tasks.workunit.client.1.smithi184.stdout:5/639: write db/d12/d1c/fc3 [1095344,30368] 0 2024-02-28T23:07:39.613 INFO:tasks.workunit.client.1.smithi184.stdout:4/613: dread - d1/dc/df/d3b/d5c/f7b zero size 2024-02-28T23:07:39.615 INFO:tasks.workunit.client.1.smithi184.stdout:1/688: symlink d20/d46/d90/da0/lec 0 2024-02-28T23:07:39.617 INFO:tasks.workunit.client.1.smithi184.stdout:1/689: write d20/d46/fe5 [79544,120359] 0 2024-02-28T23:07:39.618 INFO:tasks.workunit.client.0.smithi159.stdout:2/861: truncate d9/d50/d54/d84/f114 854135 0 2024-02-28T23:07:39.618 INFO:tasks.workunit.client.1.smithi184.stdout:6/585: creat dc/fbd x:0 0 0 2024-02-28T23:07:39.627 INFO:tasks.workunit.client.0.smithi159.stdout:6/938: write d0/d1b/d33/d3f/d44/d8b/fec [107210,105049] 0 2024-02-28T23:07:39.628 INFO:tasks.workunit.client.1.smithi184.stdout:5/640: symlink db/d12/d18/ld0 0 2024-02-28T23:07:39.628 INFO:tasks.workunit.client.0.smithi159.stdout:2/862: chown d9/d50/d54/d84/d37/c4c 32240708 1 2024-02-28T23:07:39.630 INFO:tasks.workunit.client.1.smithi184.stdout:8/665: write d1/da/df/f1f [973126,37404] 0 2024-02-28T23:07:39.631 INFO:tasks.workunit.client.0.smithi159.stdout:6/939: dread - d0/d1b/dc4/ddd/f11e zero size 2024-02-28T23:07:39.636 INFO:tasks.workunit.client.1.smithi184.stdout:3/673: write d1/d4/d1c/d61/d87/fbf [3149574,119576] 0 2024-02-28T23:07:39.639 INFO:tasks.workunit.client.1.smithi184.stdout:9/639: rename d5/db/c97 to d5/ccc 0 2024-02-28T23:07:39.641 INFO:tasks.workunit.client.1.smithi184.stdout:6/586: mknod dc/cbe 0 2024-02-28T23:07:39.643 INFO:tasks.workunit.client.1.smithi184.stdout:4/614: creat d1/dc/df/d27/fbc x:0 0 0 2024-02-28T23:07:39.644 INFO:tasks.workunit.client.0.smithi159.stdout:3/881: dwrite d0/d3f/fb5 [0,4194304] 0 2024-02-28T23:07:39.647 INFO:tasks.workunit.client.1.smithi184.stdout:1/690: dwrite d20/d46/d90/db3/fc4 [0,4194304] 0 2024-02-28T23:07:39.649 INFO:tasks.workunit.client.0.smithi159.stdout:2/863: creat d9/d50/d62/dce/f124 x:0 0 0 2024-02-28T23:07:39.649 INFO:tasks.workunit.client.1.smithi184.stdout:8/666: link d1/da/d10/d17/d63/f68 d1/da/dc/d16/dbd/ff6 0 2024-02-28T23:07:39.653 INFO:tasks.workunit.client.1.smithi184.stdout:7/620: dread d6/f8e [0,4194304] 0 2024-02-28T23:07:39.655 INFO:tasks.workunit.client.1.smithi184.stdout:5/641: creat db/d12/d1c/fd1 x:0 0 0 2024-02-28T23:07:39.657 INFO:tasks.workunit.client.1.smithi184.stdout:9/640: symlink d5/db/d65/lcd 0 2024-02-28T23:07:39.667 INFO:tasks.workunit.client.0.smithi159.stdout:3/882: symlink d0/d47/l117 0 2024-02-28T23:07:39.668 INFO:tasks.workunit.client.1.smithi184.stdout:0/685: truncate d0/fc 975880 0 2024-02-28T23:07:39.668 INFO:tasks.workunit.client.1.smithi184.stdout:2/611: write d10/d1f/d21/d5e/dad/f82 [2418124,103729] 0 2024-02-28T23:07:39.668 INFO:tasks.workunit.client.1.smithi184.stdout:2/612: stat d10/f1d 0 2024-02-28T23:07:39.668 INFO:tasks.workunit.client.1.smithi184.stdout:1/691: creat d20/d32/d3e/d61/d8b/d9c/db8/fed x:0 0 0 2024-02-28T23:07:39.671 INFO:tasks.workunit.client.1.smithi184.stdout:5/642: creat db/d12/d18/d2e/fd2 x:0 0 0 2024-02-28T23:07:39.672 INFO:tasks.workunit.client.1.smithi184.stdout:3/674: link d1/d4/d6/d83/c93 d1/d4/d6/d1e/d72/ccf 0 2024-02-28T23:07:39.676 INFO:tasks.workunit.client.1.smithi184.stdout:6/587: link dc/f97 dc/d60/d62/d6f/d99/fbf 0 2024-02-28T23:07:39.677 INFO:tasks.workunit.client.1.smithi184.stdout:6/588: fdatasync f8 0 2024-02-28T23:07:39.680 INFO:tasks.workunit.client.1.smithi184.stdout:2/613: dwrite d10/d1f/d38/d54/f69 [0,4194304] 0 2024-02-28T23:07:39.680 INFO:tasks.workunit.client.1.smithi184.stdout:4/615: mkdir d1/d8/d37/d6d/dbd 0 2024-02-28T23:07:39.681 INFO:tasks.workunit.client.0.smithi159.stdout:6/940: write d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/f9b [3168417,58977] 0 2024-02-28T23:07:39.682 INFO:tasks.workunit.client.1.smithi184.stdout:4/616: write d1/dc/df/d5b/d6c/f9d [538782,52155] 0 2024-02-28T23:07:39.684 INFO:tasks.workunit.client.1.smithi184.stdout:1/692: mknod d20/d32/d3e/da2/cee 0 2024-02-28T23:07:39.685 INFO:tasks.workunit.client.1.smithi184.stdout:4/617: chown d1/dc/df/d5b/db2/l5d 126 1 2024-02-28T23:07:39.685 INFO:tasks.workunit.client.1.smithi184.stdout:7/621: truncate d6/d9/d13/d3e/dad/d49/da6/daf/f69 4740678 0 2024-02-28T23:07:39.691 INFO:tasks.workunit.client.0.smithi159.stdout:6/941: dread - d0/d1b/d33/d11/d34/d9d/da2/d96/ff5 zero size 2024-02-28T23:07:39.692 INFO:tasks.workunit.client.1.smithi184.stdout:5/643: rename db/da1 to db/d12/d1c/d21/d25/dd3 0 2024-02-28T23:07:39.695 INFO:tasks.workunit.client.1.smithi184.stdout:3/675: symlink d1/d4/d6/d1f/d24/ld0 0 2024-02-28T23:07:39.695 INFO:tasks.workunit.client.1.smithi184.stdout:5/644: read db/d12/d1c/d21/d2f/f55 [1680652,119491] 0 2024-02-28T23:07:39.704 INFO:tasks.workunit.client.1.smithi184.stdout:4/618: symlink d1/d8/d19/lbe 0 2024-02-28T23:07:39.705 INFO:tasks.workunit.client.1.smithi184.stdout:4/619: write d1/d8/f5a [2530636,94832] 0 2024-02-28T23:07:39.707 INFO:tasks.workunit.client.1.smithi184.stdout:4/620: chown d1/lb 369185 1 2024-02-28T23:07:39.707 INFO:tasks.workunit.client.0.smithi159.stdout:2/864: dwrite d9/d23/da9/fab [0,4194304] 0 2024-02-28T23:07:39.712 INFO:tasks.workunit.client.1.smithi184.stdout:7/622: truncate d6/d9/d13/d3e/dad/d49/d9c/fcb 2705356 0 2024-02-28T23:07:39.713 INFO:tasks.workunit.client.1.smithi184.stdout:9/641: truncate d5/db/de/f21 1760801 0 2024-02-28T23:07:39.714 INFO:tasks.workunit.client.0.smithi159.stdout:3/883: dwrite d0/d3f/feb [0,4194304] 0 2024-02-28T23:07:39.714 INFO:tasks.workunit.client.1.smithi184.stdout:9/642: stat d5/d26/f78 0 2024-02-28T23:07:39.716 INFO:tasks.workunit.client.0.smithi159.stdout:2/865: creat d9/d50/d54/d84/f125 x:0 0 0 2024-02-28T23:07:39.717 INFO:tasks.workunit.client.1.smithi184.stdout:9/643: fdatasync d5/db/de/f74 0 2024-02-28T23:07:39.724 INFO:tasks.workunit.client.1.smithi184.stdout:4/621: mkdir d1/d8/d19/d56/dbf 0 2024-02-28T23:07:39.725 INFO:tasks.workunit.client.0.smithi159.stdout:3/884: truncate d0/def/f114 850090 0 2024-02-28T23:07:39.730 INFO:tasks.workunit.client.0.smithi159.stdout:3/885: chown d0/c27 1 1 2024-02-28T23:07:39.736 INFO:tasks.workunit.client.1.smithi184.stdout:0/686: getdents d0/d1f/de3/d95 0 2024-02-28T23:07:39.736 INFO:tasks.workunit.client.1.smithi184.stdout:6/589: rename dc/d60/d62/lb1 to dc/de/d2a/d5c/lc0 0 2024-02-28T23:07:39.737 INFO:tasks.workunit.client.1.smithi184.stdout:1/693: rename d20/d32/db0 to d20/d32/db0/def 22 2024-02-28T23:07:39.738 INFO:tasks.workunit.client.1.smithi184.stdout:7/623: mknod d6/d9/dc5/cda 0 2024-02-28T23:07:39.739 INFO:tasks.workunit.client.0.smithi159.stdout:6/942: dread d0/d1b/d33/d11/d34/d9d/da2/d4d/f58 [0,4194304] 0 2024-02-28T23:07:39.740 INFO:tasks.workunit.client.1.smithi184.stdout:1/694: read d20/d32/f44 [244483,32177] 0 2024-02-28T23:07:39.744 INFO:tasks.workunit.client.1.smithi184.stdout:5/645: dwrite db/d12/d18/d2e/f79 [0,4194304] 0 2024-02-28T23:07:39.746 INFO:tasks.workunit.client.0.smithi159.stdout:2/866: dread d9/d50/d54/f66 [0,4194304] 0 2024-02-28T23:07:39.747 INFO:tasks.workunit.client.1.smithi184.stdout:2/614: link d10/d1f/d21/d5e/d15/f1b d10/d1f/d38/d54/d96/dab/fbf 0 2024-02-28T23:07:39.756 INFO:tasks.workunit.client.0.smithi159.stdout:5/934: sync 2024-02-28T23:07:39.757 INFO:tasks.workunit.client.0.smithi159.stdout:7/773: sync 2024-02-28T23:07:39.759 INFO:tasks.workunit.client.0.smithi159.stdout:3/886: mknod d0/d2b/d55/df8/da9/c118 0 2024-02-28T23:07:39.766 INFO:tasks.workunit.client.1.smithi184.stdout:4/622: rename d1/dc/df/d27/fbc to d1/d8/d35/fc0 0 2024-02-28T23:07:39.766 INFO:tasks.workunit.client.0.smithi159.stdout:5/935: chown d8/d19/d23/d35/d65/da3/df4/da5/c86 189 1 2024-02-28T23:07:39.769 INFO:tasks.workunit.client.0.smithi159.stdout:2/867: dwrite d9/d23/d2c/f79 [0,4194304] 0 2024-02-28T23:07:39.773 INFO:tasks.workunit.client.0.smithi159.stdout:2/868: write d9/d23/f11d [204685,31022] 0 2024-02-28T23:07:39.775 INFO:tasks.workunit.client.1.smithi184.stdout:8/667: sync 2024-02-28T23:07:39.777 INFO:tasks.workunit.client.1.smithi184.stdout:8/668: readlink d1/da/d10/d17/l49 0 2024-02-28T23:07:39.779 INFO:tasks.workunit.client.0.smithi159.stdout:2/869: fsync d9/d50/d54/d84/d37/d5c/f121 0 2024-02-28T23:07:39.783 INFO:tasks.workunit.client.1.smithi184.stdout:3/676: getdents d1/d4/d5/da9/d74 0 2024-02-28T23:07:39.789 INFO:tasks.workunit.client.1.smithi184.stdout:5/646: fdatasync db/d12/d18/d2e/f36 0 2024-02-28T23:07:39.792 INFO:tasks.workunit.client.1.smithi184.stdout:6/590: dwrite dc/f97 [0,4194304] 0 2024-02-28T23:07:39.793 INFO:tasks.workunit.client.0.smithi159.stdout:6/943: dread d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/f133 [0,4194304] 0 2024-02-28T23:07:39.795 INFO:tasks.workunit.client.1.smithi184.stdout:6/591: chown dc/de/d2a/d5c/d71 70128 1 2024-02-28T23:07:39.796 INFO:tasks.workunit.client.1.smithi184.stdout:0/687: dwrite d0/df/d13/f18 [0,4194304] 0 2024-02-28T23:07:39.798 INFO:tasks.workunit.client.0.smithi159.stdout:2/870: rename d9/d50/d54/d8d/fdc to d9/d50/d62/dce/f126 0 2024-02-28T23:07:39.807 INFO:tasks.workunit.client.0.smithi159.stdout:7/774: write d5/d16/d1a/d27/deb/f85 [436941,97299] 0 2024-02-28T23:07:39.807 INFO:tasks.workunit.client.1.smithi184.stdout:4/623: mknod d1/cc1 0 2024-02-28T23:07:39.810 INFO:tasks.workunit.client.0.smithi159.stdout:2/871: truncate d9/f33 670856 0 2024-02-28T23:07:39.819 INFO:tasks.workunit.client.0.smithi159.stdout:2/872: mknod d9/d23/d2c/d55/d13/c127 0 2024-02-28T23:07:39.820 INFO:tasks.workunit.client.1.smithi184.stdout:3/677: creat d1/d4/d6/d1f/d26/d3a/fd1 x:0 0 0 2024-02-28T23:07:39.824 INFO:tasks.workunit.client.1.smithi184.stdout:5/647: rmdir db/d12/d18/d2e/dc1 39 2024-02-28T23:07:39.824 INFO:tasks.workunit.client.1.smithi184.stdout:6/592: rmdir dc/de/d2a/d5c 39 2024-02-28T23:07:39.825 INFO:tasks.workunit.client.1.smithi184.stdout:5/648: dread - db/fb3 zero size 2024-02-28T23:07:39.829 INFO:tasks.workunit.client.1.smithi184.stdout:0/688: unlink d0/df/d13/f53 0 2024-02-28T23:07:39.829 INFO:tasks.workunit.client.1.smithi184.stdout:9/644: sync 2024-02-28T23:07:39.831 INFO:tasks.workunit.client.1.smithi184.stdout:9/645: truncate d5/f24 5877540 0 2024-02-28T23:07:39.833 INFO:tasks.workunit.client.0.smithi159.stdout:7/775: creat d5/d16/d1a/d27/d46/d65/d81/d98/de5/ff6 x:0 0 0 2024-02-28T23:07:39.833 INFO:tasks.workunit.client.0.smithi159.stdout:5/936: write d8/d16/d122/f43 [219424,100206] 0 2024-02-28T23:07:39.834 INFO:tasks.workunit.client.1.smithi184.stdout:0/689: read d0/df/f63 [3929016,97279] 0 2024-02-28T23:07:39.835 INFO:tasks.workunit.client.0.smithi159.stdout:2/873: symlink d9/d36/l128 0 2024-02-28T23:07:39.837 INFO:tasks.workunit.client.1.smithi184.stdout:2/615: dread d10/d1f/d38/d54/f8e [0,4194304] 0 2024-02-28T23:07:39.838 INFO:tasks.workunit.client.1.smithi184.stdout:2/616: read d10/f18 [551842,2294] 0 2024-02-28T23:07:39.838 INFO:tasks.workunit.client.1.smithi184.stdout:2/617: stat fb 0 2024-02-28T23:07:39.839 INFO:tasks.workunit.client.0.smithi159.stdout:7/776: creat d5/d16/d1a/d27/d46/d65/d81/d83/ff7 x:0 0 0 2024-02-28T23:07:39.845 INFO:tasks.workunit.client.1.smithi184.stdout:8/669: write d1/da/f31 [6045801,128126] 0 2024-02-28T23:07:39.846 INFO:tasks.workunit.client.1.smithi184.stdout:1/695: truncate d20/d32/d3e/d82/fb2 2626869 0 2024-02-28T23:07:39.852 INFO:tasks.workunit.client.0.smithi159.stdout:3/887: truncate d0/d2b/d55/d75/d6d/f66 1886522 0 2024-02-28T23:07:39.858 INFO:tasks.workunit.client.0.smithi159.stdout:5/937: dwrite d8/d16/d122/f102 [0,4194304] 0 2024-02-28T23:07:39.859 INFO:tasks.workunit.client.0.smithi159.stdout:5/938: stat d8/d59/f124 0 2024-02-28T23:07:39.866 INFO:tasks.workunit.client.0.smithi159.stdout:7/777: rename d5/d56/d50/d5b/c7f to d5/d16/d1a/d27/d95/cf8 0 2024-02-28T23:07:39.872 INFO:tasks.workunit.client.0.smithi159.stdout:2/874: write d9/d80/fe5 [987763,119680] 0 2024-02-28T23:07:39.873 INFO:tasks.workunit.client.0.smithi159.stdout:2/875: chown d9/c9e 204962913 1 2024-02-28T23:07:39.874 INFO:tasks.workunit.client.0.smithi159.stdout:6/944: dread d0/d1b/d33/d11/d34/f12b [0,4194304] 0 2024-02-28T23:07:39.874 INFO:tasks.workunit.client.0.smithi159.stdout:2/876: chown d9/d23/la7 932675344 1 2024-02-28T23:07:39.876 INFO:tasks.workunit.client.0.smithi159.stdout:1/975: sync 2024-02-28T23:07:39.876 INFO:tasks.workunit.client.0.smithi159.stdout:9/910: sync 2024-02-28T23:07:39.878 INFO:tasks.workunit.client.0.smithi159.stdout:5/939: rename d8/d19/d23/d35/d41/daa/d10e/f130 to d8/d19/d23/d35/d41/daa/d88/d117/f14c 0 2024-02-28T23:07:39.879 INFO:tasks.workunit.client.0.smithi159.stdout:6/945: read d0/d1b/d5b/fba [1020437,129053] 0 2024-02-28T23:07:39.883 INFO:tasks.workunit.client.0.smithi159.stdout:6/946: fsync d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/f9b 0 2024-02-28T23:07:39.888 INFO:tasks.workunit.client.1.smithi184.stdout:8/670: dread d1/da/d10/d17/d63/f68 [0,4194304] 0 2024-02-28T23:07:39.892 INFO:tasks.workunit.client.1.smithi184.stdout:8/671: fdatasync d1/da/d10/d6b/fcd 0 2024-02-28T23:07:39.895 INFO:tasks.workunit.client.0.smithi159.stdout:5/940: chown d8/d19/d23/d35/d41/d92/ccd 8142065 1 2024-02-28T23:07:39.895 INFO:tasks.workunit.client.0.smithi159.stdout:2/877: mknod d9/d23/d11f/c129 0 2024-02-28T23:07:39.895 INFO:tasks.workunit.client.0.smithi159.stdout:7/778: dread d5/d16/d1a/f3c [0,4194304] 0 2024-02-28T23:07:39.897 INFO:tasks.workunit.client.0.smithi159.stdout:6/947: dread d0/f8 [4194304,4194304] 0 2024-02-28T23:07:39.898 INFO:tasks.workunit.client.0.smithi159.stdout:1/976: creat d6/d1d/d1f/db8/dcc/f14f x:0 0 0 2024-02-28T23:07:39.900 INFO:tasks.workunit.client.0.smithi159.stdout:7/779: write d5/d16/d40/dce/fe9 [242571,51079] 0 2024-02-28T23:07:39.909 INFO:tasks.workunit.client.0.smithi159.stdout:3/888: write d0/d2b/d55/d75/d6d/f2d [1624541,22938] 0 2024-02-28T23:07:39.912 INFO:tasks.workunit.client.0.smithi159.stdout:1/977: dread - d6/d1d/d46/d88/dd3/d63/f112 zero size 2024-02-28T23:07:39.913 INFO:tasks.workunit.client.0.smithi159.stdout:9/911: dwrite d4/d3d/d3e/d55/d4c/dee/f8d [0,4194304] 0 2024-02-28T23:07:39.924 INFO:tasks.workunit.client.1.smithi184.stdout:4/624: write d1/d8/d19/d67/d99/faa [5799674,49915] 0 2024-02-28T23:07:39.925 INFO:tasks.workunit.client.0.smithi159.stdout:7/780: rename d5/d16/d1a/d27/d46/d65/l9f to d5/d16/d1a/d27/d3e/lf9 0 2024-02-28T23:07:39.927 INFO:tasks.workunit.client.0.smithi159.stdout:7/781: write d5/d16/d1a/f9a [928418,53358] 0 2024-02-28T23:07:39.928 INFO:tasks.workunit.client.1.smithi184.stdout:7/624: creat d6/d9/d13/d1e/d2f/fdb x:0 0 0 2024-02-28T23:07:39.933 INFO:tasks.workunit.client.0.smithi159.stdout:9/912: mkdir d4/d3d/d3e/d55/d37/d62/d77/db9/d121 0 2024-02-28T23:07:39.934 INFO:tasks.workunit.client.1.smithi184.stdout:3/678: mkdir d1/d4/d6/d1f/d26/dd2 0 2024-02-28T23:07:39.939 INFO:tasks.workunit.client.1.smithi184.stdout:3/679: write d1/d4/d6/d1f/d24/f3e [18563,59355] 0 2024-02-28T23:07:39.949 INFO:tasks.workunit.client.1.smithi184.stdout:0/690: rename d0/df/d13/d27/d58/fd8 to d0/d7c/fec 0 2024-02-28T23:07:39.954 INFO:tasks.workunit.client.1.smithi184.stdout:2/618: mkdir d10/d55/d89/db5/dc0 0 2024-02-28T23:07:39.956 INFO:tasks.workunit.client.0.smithi159.stdout:5/941: write d8/d19/d23/d35/d100/f115 [26240,40861] 0 2024-02-28T23:07:39.958 INFO:tasks.workunit.client.1.smithi184.stdout:1/696: fsync f15 0 2024-02-28T23:07:39.964 INFO:tasks.workunit.client.0.smithi159.stdout:9/913: rename d4/d3d/d3e/d55/d4c/d4e/f63 to d4/d3d/d3e/d4a/d109/f122 0 2024-02-28T23:07:39.966 INFO:tasks.workunit.client.0.smithi159.stdout:6/948: write d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/f21 [2499928,103426] 0 2024-02-28T23:07:39.972 INFO:tasks.workunit.client.0.smithi159.stdout:2/878: dwrite d9/d50/d54/d84/f112 [0,4194304] 0 2024-02-28T23:07:39.976 INFO:tasks.workunit.client.1.smithi184.stdout:6/593: symlink dc/de/d2a/d5c/d79/lc1 0 2024-02-28T23:07:39.978 INFO:tasks.workunit.client.1.smithi184.stdout:1/697: dread d20/d32/d4b/fe0 [0,4194304] 0 2024-02-28T23:07:39.986 INFO:tasks.workunit.client.1.smithi184.stdout:9/646: dread d5/fa [0,4194304] 0 2024-02-28T23:07:39.991 INFO:tasks.workunit.client.1.smithi184.stdout:9/647: readlink d5/db/de/d10/d12/d2f/l31 0 2024-02-28T23:07:39.991 INFO:tasks.workunit.client.0.smithi159.stdout:9/914: mknod d4/d3d/d3e/d55/d4c/d4e/dbe/c123 0 2024-02-28T23:07:39.999 INFO:tasks.workunit.client.0.smithi159.stdout:3/889: dwrite d0/d2b/fb9 [0,4194304] 0 2024-02-28T23:07:39.999 INFO:tasks.workunit.client.0.smithi159.stdout:9/915: write d4/f25 [3910225,2122] 0 2024-02-28T23:07:39.999 INFO:tasks.workunit.client.0.smithi159.stdout:7/782: dread d5/d16/f19 [0,4194304] 0 2024-02-28T23:07:40.005 INFO:tasks.workunit.client.0.smithi159.stdout:3/890: chown d0/d2b/cbf 121328837 1 2024-02-28T23:07:40.007 INFO:tasks.workunit.client.1.smithi184.stdout:3/680: rename d1/d4/d6/d1f to d1/d4/d1c/d62/d66/dd3 0 2024-02-28T23:07:40.010 INFO:tasks.workunit.client.0.smithi159.stdout:1/978: dwrite d6/d12/d31/d69/dc0/df3/f116 [0,4194304] 0 2024-02-28T23:07:40.013 INFO:tasks.workunit.client.0.smithi159.stdout:6/949: truncate d0/d1b/d33/d11/f19 1908510 0 2024-02-28T23:07:40.018 INFO:tasks.workunit.client.1.smithi184.stdout:8/672: write d1/da/dc/d18/f64 [1987220,71839] 0 2024-02-28T23:07:40.022 INFO:tasks.workunit.client.0.smithi159.stdout:9/916: fsync d4/d3d/d3e/d55/d37/d62/d6a/ffe 0 2024-02-28T23:07:40.025 INFO:tasks.workunit.client.1.smithi184.stdout:5/649: truncate db/d12/d18/d2e/f79 802696 0 2024-02-28T23:07:40.025 INFO:tasks.workunit.client.0.smithi159.stdout:9/917: chown d4/d3d/d3e/d55/d4c/d4e/d6b/laf 3525 1 2024-02-28T23:07:40.026 INFO:tasks.workunit.client.0.smithi159.stdout:3/891: rename d0/d3f/dd2/d63/f111 to d0/d2b/d4f/dc3/f119 0 2024-02-28T23:07:40.026 INFO:tasks.workunit.client.0.smithi159.stdout:9/918: fdatasync d4/fe 0 2024-02-28T23:07:40.029 INFO:tasks.workunit.client.0.smithi159.stdout:1/979: creat d6/d1d/d1f/db8/f150 x:0 0 0 2024-02-28T23:07:40.033 INFO:tasks.workunit.client.1.smithi184.stdout:7/625: mkdir d6/d9/d13/d3e/dad/d49/da6/daf/ddc 0 2024-02-28T23:07:40.036 INFO:tasks.workunit.client.0.smithi159.stdout:7/783: write d5/d16/d1a/d24/f59 [3394357,69441] 0 2024-02-28T23:07:40.040 INFO:tasks.workunit.client.1.smithi184.stdout:9/648: rmdir d5/d26 39 2024-02-28T23:07:40.041 INFO:tasks.workunit.client.1.smithi184.stdout:6/594: rename dc/de/f5a to dc/d60/d7c/fc2 0 2024-02-28T23:07:40.051 INFO:tasks.workunit.client.0.smithi159.stdout:3/892: mkdir d0/d2b/d55/d75/d11a 0 2024-02-28T23:07:40.053 INFO:tasks.workunit.client.1.smithi184.stdout:7/626: fsync d6/f67 0 2024-02-28T23:07:40.055 INFO:tasks.workunit.client.0.smithi159.stdout:2/879: link d9/d50/d54/d84/f3b d9/d50/d62/dba/f12a 0 2024-02-28T23:07:40.055 INFO:tasks.workunit.client.0.smithi159.stdout:3/893: write d0/d2b/d55/d75/d6d/ff5 [345754,114929] 0 2024-02-28T23:07:40.056 INFO:tasks.workunit.client.1.smithi184.stdout:2/619: dwrite d10/f2d [0,4194304] 0 2024-02-28T23:07:40.056 INFO:tasks.workunit.client.0.smithi159.stdout:2/880: stat d9/d50/dcc/cc7 0 2024-02-28T23:07:40.056 INFO:tasks.workunit.client.1.smithi184.stdout:3/681: creat d1/d4/d5/d9f/fd4 x:0 0 0 2024-02-28T23:07:40.059 INFO:tasks.workunit.client.1.smithi184.stdout:7/627: write d6/f48 [1634307,114904] 0 2024-02-28T23:07:40.061 INFO:tasks.workunit.client.1.smithi184.stdout:3/682: dread - d1/fb9 zero size 2024-02-28T23:07:40.062 INFO:tasks.workunit.client.1.smithi184.stdout:0/691: creat d0/d1d/d4c/fed x:0 0 0 2024-02-28T23:07:40.062 INFO:tasks.workunit.client.0.smithi159.stdout:9/919: mknod d4/d3d/d3e/c124 0 2024-02-28T23:07:40.063 INFO:tasks.workunit.client.0.smithi159.stdout:7/784: dread d5/d16/d1a/d27/d46/d65/fb7 [0,4194304] 0 2024-02-28T23:07:40.064 INFO:tasks.workunit.client.1.smithi184.stdout:4/625: dwrite d1/d8/f9b [0,4194304] 0 2024-02-28T23:07:40.066 INFO:tasks.workunit.client.0.smithi159.stdout:9/920: chown d4/d3d/d3e/d55/d9e/ca7 27819567 1 2024-02-28T23:07:40.066 INFO:tasks.workunit.client.0.smithi159.stdout:2/881: chown d9/d36/d59/ff7 0 1 2024-02-28T23:07:40.066 INFO:tasks.workunit.client.1.smithi184.stdout:4/626: chown d1/d4 0 1 2024-02-28T23:07:40.068 INFO:tasks.workunit.client.1.smithi184.stdout:3/683: write d1/d4/d5/d40/f64 [905889,30081] 0 2024-02-28T23:07:40.068 INFO:tasks.workunit.client.1.smithi184.stdout:0/692: dread d0/df/d13/d27/f2c [0,4194304] 0 2024-02-28T23:07:40.072 INFO:tasks.workunit.client.1.smithi184.stdout:8/673: mknod d1/da/d10/cf7 0 2024-02-28T23:07:40.076 INFO:tasks.workunit.client.1.smithi184.stdout:0/693: chown d0/fb8 71572 1 2024-02-28T23:07:40.076 INFO:tasks.workunit.client.1.smithi184.stdout:6/595: creat dc/de/d2a/d5c/d6e/fc3 x:0 0 0 2024-02-28T23:07:40.076 INFO:tasks.workunit.client.1.smithi184.stdout:5/650: dread db/d12/d1c/d21/f75 [0,4194304] 0 2024-02-28T23:07:40.077 INFO:tasks.workunit.client.0.smithi159.stdout:7/785: readlink d5/d16/d1a/lc6 0 2024-02-28T23:07:40.077 INFO:tasks.workunit.client.0.smithi159.stdout:9/921: dread d4/d3d/d3e/d55/d37/f9b [0,4194304] 0 2024-02-28T23:07:40.079 INFO:tasks.workunit.client.1.smithi184.stdout:1/698: dwrite d20/f35 [4194304,4194304] 0 2024-02-28T23:07:40.080 INFO:tasks.workunit.client.0.smithi159.stdout:9/922: readlink d4/d3d/d3e/d55/d9e/dfc/lfb 0 2024-02-28T23:07:40.086 INFO:tasks.workunit.client.1.smithi184.stdout:4/627: dread d1/d8/d35/fa7 [0,4194304] 0 2024-02-28T23:07:40.089 INFO:tasks.workunit.client.0.smithi159.stdout:1/980: dwrite d6/d1d/d46/f4c [4194304,4194304] 0 2024-02-28T23:07:40.101 INFO:tasks.workunit.client.1.smithi184.stdout:2/620: rename d10/d1f/d21/d5e/d15/d24/l86 to d10/d1f/d21/d5e/dad/lc1 0 2024-02-28T23:07:40.107 INFO:tasks.workunit.client.1.smithi184.stdout:8/674: mknod d1/da/dc/d16/d32/d42/cf8 0 2024-02-28T23:07:40.108 INFO:tasks.workunit.client.0.smithi159.stdout:1/981: creat d6/d12/d33/d3c/f151 x:0 0 0 2024-02-28T23:07:40.118 INFO:tasks.workunit.client.1.smithi184.stdout:6/596: creat dc/d60/d7c/d61/fc4 x:0 0 0 2024-02-28T23:07:40.118 INFO:tasks.workunit.client.1.smithi184.stdout:2/621: dwrite d10/f16 [4194304,4194304] 0 2024-02-28T23:07:40.119 INFO:tasks.workunit.client.0.smithi159.stdout:9/923: dwrite d4/d76/fa3 [0,4194304] 0 2024-02-28T23:07:40.121 INFO:tasks.workunit.client.1.smithi184.stdout:6/597: write dc/de/d10/d16/f96 [182521,39586] 0 2024-02-28T23:07:40.122 INFO:tasks.workunit.client.1.smithi184.stdout:6/598: fsync dc/de/f29 0 2024-02-28T23:07:40.125 INFO:tasks.workunit.client.1.smithi184.stdout:5/651: rmdir db/d12/d50/d9e 39 2024-02-28T23:07:40.128 INFO:tasks.workunit.client.0.smithi159.stdout:1/982: dread d6/d1d/d1f/f8c [0,4194304] 0 2024-02-28T23:07:40.136 INFO:tasks.workunit.client.1.smithi184.stdout:4/628: creat d1/d4/d43/fc2 x:0 0 0 2024-02-28T23:07:40.137 INFO:tasks.workunit.client.1.smithi184.stdout:2/622: dwrite d10/d55/d89/fa1 [0,4194304] 0 2024-02-28T23:07:40.137 INFO:tasks.workunit.client.0.smithi159.stdout:2/882: dread d9/d50/dcc/d44/dc0/fc1 [0,4194304] 0 2024-02-28T23:07:40.138 INFO:tasks.workunit.client.1.smithi184.stdout:3/684: sync 2024-02-28T23:07:40.142 INFO:tasks.workunit.client.1.smithi184.stdout:9/649: link d5/d17/d43/f48 d5/db/de/d10/dc9/fce 0 2024-02-28T23:07:40.143 INFO:tasks.workunit.client.1.smithi184.stdout:3/685: truncate d1/d4/d5/d9f/fd4 5570 0 2024-02-28T23:07:40.145 INFO:tasks.workunit.client.1.smithi184.stdout:8/675: mknod d1/da/dc/cf9 0 2024-02-28T23:07:40.146 INFO:tasks.workunit.client.0.smithi159.stdout:1/983: dread d6/d12/d1a/d92/dc8/f12f [0,4194304] 0 2024-02-28T23:07:40.156 INFO:tasks.workunit.client.1.smithi184.stdout:6/599: creat dc/d60/d7c/d61/fc5 x:0 0 0 2024-02-28T23:07:40.160 INFO:tasks.workunit.client.1.smithi184.stdout:4/629: rmdir d1/d8/d19/d92 39 2024-02-28T23:07:40.166 INFO:tasks.workunit.client.1.smithi184.stdout:2/623: mkdir d10/d1f/d21/d6a/dc2 0 2024-02-28T23:07:40.167 INFO:tasks.workunit.client.1.smithi184.stdout:2/624: stat d10/d1f/d21/d6a/dc2 0 2024-02-28T23:07:40.168 INFO:tasks.workunit.client.1.smithi184.stdout:0/694: dread d0/df/f67 [0,4194304] 0 2024-02-28T23:07:40.169 INFO:tasks.workunit.client.1.smithi184.stdout:1/699: write d20/d32/d4d/f6e [63882,121041] 0 2024-02-28T23:07:40.170 INFO:tasks.workunit.client.1.smithi184.stdout:3/686: fsync d1/d4/d1c/f6b 0 2024-02-28T23:07:40.174 INFO:tasks.workunit.client.1.smithi184.stdout:1/700: truncate d20/d32/d3e/d61/d8b/d9c/db8/fe4 275088 0 2024-02-28T23:07:40.174 INFO:tasks.workunit.client.1.smithi184.stdout:8/676: mkdir d1/da/dc/d16/d29/d7d/dfa 0 2024-02-28T23:07:40.175 INFO:tasks.workunit.client.1.smithi184.stdout:8/677: stat d1/da/dc/d16/d29/f54 0 2024-02-28T23:07:40.177 INFO:tasks.workunit.client.1.smithi184.stdout:5/652: rename db/d12/d1c/d21/d4d/ca6 to db/d44/cd4 0 2024-02-28T23:07:40.178 INFO:tasks.workunit.client.1.smithi184.stdout:8/678: truncate d1/da/dc/d18/f38 1682637 0 2024-02-28T23:07:40.178 INFO:tasks.workunit.client.1.smithi184.stdout:5/653: read db/d12/d50/fac [477038,84235] 0 2024-02-28T23:07:40.179 INFO:tasks.workunit.client.1.smithi184.stdout:6/600: mkdir dc/de/d2a/d8e/dad/d8a/dc6 0 2024-02-28T23:07:40.179 INFO:tasks.workunit.client.1.smithi184.stdout:8/679: read - d1/da/dc/d16/d29/fee zero size 2024-02-28T23:07:40.181 INFO:tasks.workunit.client.1.smithi184.stdout:6/601: chown dc/d60/d6d/f83 86680990 1 2024-02-28T23:07:40.181 INFO:tasks.workunit.client.1.smithi184.stdout:4/630: creat d1/d8/d37/fc3 x:0 0 0 2024-02-28T23:07:40.183 INFO:tasks.workunit.client.1.smithi184.stdout:7/628: getdents d6/d9/d13/d1e/d2f/d33 0 2024-02-28T23:07:40.188 INFO:tasks.workunit.client.1.smithi184.stdout:0/695: symlink d0/df/d13/d27/d58/lee 0 2024-02-28T23:07:40.191 INFO:tasks.workunit.client.1.smithi184.stdout:0/696: write d0/df/d13/d27/d31/d5b/d8e/d91/fa6 [284245,69922] 0 2024-02-28T23:07:40.194 INFO:tasks.workunit.client.1.smithi184.stdout:6/602: dwrite dc/de/f29 [0,4194304] 0 2024-02-28T23:07:40.196 INFO:tasks.workunit.client.1.smithi184.stdout:6/603: fsync dc/de/f20 0 2024-02-28T23:07:40.204 INFO:tasks.workunit.client.1.smithi184.stdout:6/604: dread dc/d60/d7c/d90/fa6 [0,4194304] 0 2024-02-28T23:07:40.209 INFO:tasks.workunit.client.1.smithi184.stdout:4/631: fsync d1/d8/d37/f60 0 2024-02-28T23:07:40.211 INFO:tasks.workunit.client.1.smithi184.stdout:4/632: write d1/d8/d19/d67/fb6 [919839,15903] 0 2024-02-28T23:07:40.211 INFO:tasks.workunit.client.1.smithi184.stdout:7/629: fdatasync d6/d9/d13/d3e/dad/d49/f88 0 2024-02-28T23:07:40.215 INFO:tasks.workunit.client.1.smithi184.stdout:9/650: write d5/db/de/d10/d12/fb7 [3181330,53621] 0 2024-02-28T23:07:40.217 INFO:tasks.workunit.client.1.smithi184.stdout:9/651: chown d5/d47/d68/f6f 2065431 1 2024-02-28T23:07:40.219 INFO:tasks.workunit.client.1.smithi184.stdout:0/697: symlink d0/df/d13/d9d/lef 0 2024-02-28T23:07:40.224 INFO:tasks.workunit.client.1.smithi184.stdout:1/701: write d20/d32/db0/fae [1032316,50790] 0 2024-02-28T23:07:40.225 INFO:tasks.workunit.client.1.smithi184.stdout:1/702: readlink d20/d32/d3e/dc9/lde 0 2024-02-28T23:07:40.229 INFO:tasks.workunit.client.1.smithi184.stdout:5/654: creat db/d12/d18/db5/fd5 x:0 0 0 2024-02-28T23:07:40.234 INFO:tasks.workunit.client.1.smithi184.stdout:4/633: symlink d1/d8/d3d/d44/lc4 0 2024-02-28T23:07:40.235 INFO:tasks.workunit.client.1.smithi184.stdout:2/625: link d10/d1f/d21/d5e/d15/f2b d10/d1f/d21/d5e/d15/d60/fc3 0 2024-02-28T23:07:40.236 INFO:tasks.workunit.client.1.smithi184.stdout:4/634: chown d1/dc/df/d3b/d8f 1698232 1 2024-02-28T23:07:40.238 INFO:tasks.workunit.client.1.smithi184.stdout:0/698: creat d0/d1f/ff0 x:0 0 0 2024-02-28T23:07:40.243 INFO:tasks.workunit.client.1.smithi184.stdout:8/680: creat d1/da/df/ffb x:0 0 0 2024-02-28T23:07:40.243 INFO:tasks.workunit.client.1.smithi184.stdout:5/655: mkdir db/d12/d1c/d9b/dd6 0 2024-02-28T23:07:40.244 INFO:tasks.workunit.client.0.smithi159.stdout:3/894: rename d0/d2b/d55/df8/d2f/f56 to d0/d47/f11b 0 2024-02-28T23:07:40.248 INFO:tasks.workunit.client.1.smithi184.stdout:4/635: unlink d1/d8/d19/d67/d87/l8b 0 2024-02-28T23:07:40.249 INFO:tasks.workunit.client.1.smithi184.stdout:1/703: symlink d20/d32/d3e/d82/d85/lf0 0 2024-02-28T23:07:40.252 INFO:tasks.workunit.client.0.smithi159.stdout:1/984: mknod d6/d12/d31/d69/dc0/c152 0 2024-02-28T23:07:40.254 INFO:tasks.workunit.client.0.smithi159.stdout:7/786: rename d5/d16/d1a/c2e to d5/d16/d1a/da0/cfa 0 2024-02-28T23:07:40.255 INFO:tasks.workunit.client.1.smithi184.stdout:3/687: sync 2024-02-28T23:07:40.257 INFO:tasks.workunit.client.1.smithi184.stdout:5/656: write db/d12/d50/d9e/fbb [525408,65464] 0 2024-02-28T23:07:40.259 INFO:tasks.workunit.client.1.smithi184.stdout:2/626: rename d10/d55/d89/c91 to d10/d1f/d38/d54/d96/cc4 0 2024-02-28T23:07:40.260 INFO:tasks.workunit.client.1.smithi184.stdout:3/688: write d1/d4/f7c [1752881,112462] 0 2024-02-28T23:07:40.261 INFO:tasks.workunit.client.0.smithi159.stdout:9/924: creat d4/d3d/d3e/d55/d37/d62/d105/f125 x:0 0 0 2024-02-28T23:07:40.261 INFO:tasks.workunit.client.1.smithi184.stdout:9/652: getdents d5/db/d5c/d5e 0 2024-02-28T23:07:40.261 INFO:tasks.workunit.client.1.smithi184.stdout:5/657: stat db/d12/d1c/d21/d25 0 2024-02-28T23:07:40.262 INFO:tasks.workunit.client.1.smithi184.stdout:0/699: dwrite d0/d1d/d4c/fdd [0,4194304] 0 2024-02-28T23:07:40.263 INFO:tasks.workunit.client.1.smithi184.stdout:1/704: creat d20/d32/d3e/d91/ff1 x:0 0 0 2024-02-28T23:07:40.263 INFO:tasks.workunit.client.0.smithi159.stdout:9/925: chown d4/d3d/d3e/d55/d9e/dfc/dea/f10d 1 1 2024-02-28T23:07:40.265 INFO:tasks.workunit.client.0.smithi159.stdout:9/926: chown d4/f11 252 1 2024-02-28T23:07:40.265 INFO:tasks.workunit.client.1.smithi184.stdout:4/636: creat d1/d4/d43/d73/fc5 x:0 0 0 2024-02-28T23:07:40.267 INFO:tasks.workunit.client.1.smithi184.stdout:8/681: symlink d1/da/df/lfc 0 2024-02-28T23:07:40.267 INFO:tasks.workunit.client.0.smithi159.stdout:7/787: creat d5/d16/d1a/d27/d46/d65/d81/d98/ffb x:0 0 0 2024-02-28T23:07:40.268 INFO:tasks.workunit.client.1.smithi184.stdout:0/700: write d0/d7c/fbb [7909430,127616] 0 2024-02-28T23:07:40.268 INFO:tasks.workunit.client.1.smithi184.stdout:5/658: fdatasync db/d12/d50/d9e/fbb 0 2024-02-28T23:07:40.271 INFO:tasks.workunit.client.0.smithi159.stdout:1/985: truncate d6/d1d/f99 433981 0 2024-02-28T23:07:40.271 INFO:tasks.workunit.client.1.smithi184.stdout:0/701: fdatasync d0/d1f/de3/fc9 0 2024-02-28T23:07:40.275 INFO:tasks.workunit.client.1.smithi184.stdout:4/637: truncate d1/d8/d19/d67/d99/f72 1117980 0 2024-02-28T23:07:40.278 INFO:tasks.workunit.client.1.smithi184.stdout:2/627: symlink d10/d1f/d21/d6a/lc5 0 2024-02-28T23:07:40.279 INFO:tasks.workunit.client.0.smithi159.stdout:2/883: getdents d9/d50/dcc/d44/dc0/dda 0 2024-02-28T23:07:40.283 INFO:tasks.workunit.client.1.smithi184.stdout:9/653: fsync d5/db/f7f 0 2024-02-28T23:07:40.286 INFO:tasks.workunit.client.1.smithi184.stdout:9/654: write d5/d47/f67 [4527907,68239] 0 2024-02-28T23:07:40.287 INFO:tasks.workunit.client.0.smithi159.stdout:9/927: mknod d4/d3d/d3e/d55/c126 0 2024-02-28T23:07:40.287 INFO:tasks.workunit.client.1.smithi184.stdout:9/655: chown d5/db 11446729 1 2024-02-28T23:07:40.289 INFO:tasks.workunit.client.1.smithi184.stdout:0/702: dread d0/d1f/de3/f70 [0,4194304] 0 2024-02-28T23:07:40.289 INFO:tasks.workunit.client.0.smithi159.stdout:1/986: truncate d6/d1d/d1f/db8/dcc/f6f 1702322 0 2024-02-28T23:07:40.291 INFO:tasks.workunit.client.1.smithi184.stdout:1/705: fdatasync d20/d46/d90/f92 0 2024-02-28T23:07:40.295 INFO:tasks.workunit.client.1.smithi184.stdout:3/689: dread d1/d4/d1c/d62/d66/dd3/f2b [0,4194304] 0 2024-02-28T23:07:40.296 INFO:tasks.workunit.client.0.smithi159.stdout:3/895: dread d0/d47/f11b [0,4194304] 0 2024-02-28T23:07:40.297 INFO:tasks.workunit.client.0.smithi159.stdout:7/788: link d5/d16/d1a/f9a d5/d16/d1a/d27/d46/d65/d81/d83/d9d/ffc 0 2024-02-28T23:07:40.297 INFO:tasks.workunit.client.1.smithi184.stdout:6/605: sync 2024-02-28T23:07:40.301 INFO:tasks.workunit.client.0.smithi159.stdout:1/987: mknod d6/d1d/d1f/db8/dee/c153 0 2024-02-28T23:07:40.303 INFO:tasks.workunit.client.0.smithi159.stdout:1/988: chown d6/d12/d31/d69/dc0/dca/c127 458619 1 2024-02-28T23:07:40.307 INFO:tasks.workunit.client.0.smithi159.stdout:3/896: mknod d0/d47/d88/c11c 0 2024-02-28T23:07:40.307 INFO:tasks.workunit.client.1.smithi184.stdout:4/638: creat d1/d4/d43/d73/fc6 x:0 0 0 2024-02-28T23:07:40.310 INFO:tasks.workunit.client.0.smithi159.stdout:7/789: creat d5/d16/d1a/d24/ffd x:0 0 0 2024-02-28T23:07:40.318 INFO:tasks.workunit.client.1.smithi184.stdout:9/656: unlink d5/d17/c83 0 2024-02-28T23:07:40.320 INFO:tasks.workunit.client.0.smithi159.stdout:2/884: write d9/f3c [857146,71295] 0 2024-02-28T23:07:40.320 INFO:tasks.workunit.client.1.smithi184.stdout:9/657: stat d5/db/de/d10/d12/d2f/d3f/d8d 0 2024-02-28T23:07:40.321 INFO:tasks.workunit.client.0.smithi159.stdout:7/790: rmdir d5/d16/d1a/d27/d37 39 2024-02-28T23:07:40.323 INFO:tasks.workunit.client.0.smithi159.stdout:1/989: symlink d6/d12/d1a/l154 0 2024-02-28T23:07:40.323 INFO:tasks.workunit.client.0.smithi159.stdout:7/791: chown d5/d56/d50/d5b/c82 1 1 2024-02-28T23:07:40.325 INFO:tasks.workunit.client.1.smithi184.stdout:6/606: dread dc/d60/d78/fb2 [0,4194304] 0 2024-02-28T23:07:40.325 INFO:tasks.workunit.client.1.smithi184.stdout:1/706: mkdir d20/d32/d3e/d91/df2 0 2024-02-28T23:07:40.326 INFO:tasks.workunit.client.0.smithi159.stdout:3/897: mknod d0/d2b/d55/df8/d57/c11d 0 2024-02-28T23:07:40.327 INFO:tasks.workunit.client.1.smithi184.stdout:3/690: mkdir d1/d4/d1c/d62/d66/dd3/d24/dd5 0 2024-02-28T23:07:40.328 INFO:tasks.workunit.client.1.smithi184.stdout:1/707: chown d20/d32/d3e/d61/d8b/cca 29331045 1 2024-02-28T23:07:40.329 INFO:tasks.workunit.client.1.smithi184.stdout:3/691: fsync d1/d4/d5/fc6 0 2024-02-28T23:07:40.331 INFO:tasks.workunit.client.1.smithi184.stdout:5/659: truncate db/d12/d18/d2e/d3c/d5d/f33 3682707 0 2024-02-28T23:07:40.333 INFO:tasks.workunit.client.1.smithi184.stdout:5/660: stat db/d12/d18/faf 0 2024-02-28T23:07:40.333 INFO:tasks.workunit.client.1.smithi184.stdout:4/639: write d1/d8/d19/d56/d7a/faf [690534,53599] 0 2024-02-28T23:07:40.334 INFO:tasks.workunit.client.0.smithi159.stdout:7/792: write d5/d56/d50/d88/fd0 [1917686,27362] 0 2024-02-28T23:07:40.334 INFO:tasks.workunit.client.0.smithi159.stdout:3/898: creat d0/d2b/d4f/dc3/f11e x:0 0 0 2024-02-28T23:07:40.336 INFO:tasks.workunit.client.0.smithi159.stdout:9/928: dwrite d4/de4/de3/fe7 [0,4194304] 0 2024-02-28T23:07:40.336 INFO:tasks.workunit.client.1.smithi184.stdout:5/661: dread - db/d12/d1c/d21/d25/fc0 zero size 2024-02-28T23:07:40.337 INFO:tasks.workunit.client.1.smithi184.stdout:2/628: truncate d10/d1f/d21/d5e/d15/d60/fc3 837338 0 2024-02-28T23:07:40.339 INFO:tasks.workunit.client.0.smithi159.stdout:2/885: mkdir d9/d50/d54/d84/d113/d12b 0 2024-02-28T23:07:40.341 INFO:tasks.workunit.client.1.smithi184.stdout:2/629: fsync d10/d1f/d21/d5e/d15/d60/f9a 0 2024-02-28T23:07:40.346 INFO:tasks.workunit.client.1.smithi184.stdout:6/607: dwrite dc/d60/d6d/f83 [0,4194304] 0 2024-02-28T23:07:40.348 INFO:tasks.workunit.client.0.smithi159.stdout:2/886: dread - d9/d50/d54/d84/d37/fca zero size 2024-02-28T23:07:40.354 INFO:tasks.workunit.client.0.smithi159.stdout:7/793: dread d5/d16/d1a/d27/d3e/fe0 [0,4194304] 0 2024-02-28T23:07:40.355 INFO:tasks.workunit.client.1.smithi184.stdout:0/703: dread d0/df/d13/f97 [0,4194304] 0 2024-02-28T23:07:40.358 INFO:tasks.workunit.client.1.smithi184.stdout:0/704: chown d0/df/d13/d27/d31/d5b/d8e/d92/dac/ld3 60691 1 2024-02-28T23:07:40.359 INFO:tasks.workunit.client.0.smithi159.stdout:6/950: sync 2024-02-28T23:07:40.359 INFO:tasks.workunit.client.0.smithi159.stdout:5/942: sync 2024-02-28T23:07:40.359 INFO:tasks.workunit.client.1.smithi184.stdout:0/705: write d0/df/f11 [2098284,47171] 0 2024-02-28T23:07:40.363 INFO:tasks.workunit.client.1.smithi184.stdout:0/706: chown d0/df/d13/d27/d31/f8f 4042 1 2024-02-28T23:07:40.363 INFO:tasks.workunit.client.0.smithi159.stdout:5/943: readlink d8/db4/de8/l126 0 2024-02-28T23:07:40.363 INFO:tasks.workunit.client.0.smithi159.stdout:6/951: write d0/d1b/d33/d11/d34/d9d/da2/fed [438077,63263] 0 2024-02-28T23:07:40.364 INFO:tasks.workunit.client.1.smithi184.stdout:3/692: symlink d1/d4/d1c/ld6 0 2024-02-28T23:07:40.364 INFO:tasks.workunit.client.1.smithi184.stdout:7/630: sync 2024-02-28T23:07:40.364 INFO:tasks.workunit.client.0.smithi159.stdout:6/952: readlink d0/lfa 0 2024-02-28T23:07:40.366 INFO:tasks.workunit.client.1.smithi184.stdout:3/693: read d1/d4/d1c/d61/d87/fbf [3011964,125938] 0 2024-02-28T23:07:40.367 INFO:tasks.workunit.client.0.smithi159.stdout:1/990: write d6/d1d/d46/d88/dd3/d63/f112 [785073,50777] 0 2024-02-28T23:07:40.368 INFO:tasks.workunit.client.0.smithi159.stdout:2/887: creat d9/d50/dcc/d44/dc0/f12c x:0 0 0 2024-02-28T23:07:40.368 INFO:tasks.workunit.client.1.smithi184.stdout:5/662: creat db/d12/d50/d9e/fd7 x:0 0 0 2024-02-28T23:07:40.369 INFO:tasks.workunit.client.0.smithi159.stdout:9/929: creat d4/d3d/d3e/d55/d4c/d4e/d6b/f127 x:0 0 0 2024-02-28T23:07:40.369 INFO:tasks.workunit.client.0.smithi159.stdout:7/794: stat d5/d16/d1a/d27/d37 0 2024-02-28T23:07:40.372 INFO:tasks.workunit.client.1.smithi184.stdout:2/630: rename d10/d1f/d38/d53 to d10/d1f/d21/d5e/d15/d60/d66/dc6 0 2024-02-28T23:07:40.372 INFO:tasks.workunit.client.0.smithi159.stdout:2/888: fdatasync d9/d23/d2c/d55/fcf 0 2024-02-28T23:07:40.375 INFO:tasks.workunit.client.1.smithi184.stdout:6/608: truncate dc/de/d10/f38 943984 0 2024-02-28T23:07:40.377 INFO:tasks.workunit.client.1.smithi184.stdout:8/682: getdents d1/da/dc/d16/d32/d42/d77/ddd 0 2024-02-28T23:07:40.381 INFO:tasks.workunit.client.1.smithi184.stdout:7/631: dwrite d6/d9/d13/d1e/d2f/d33/f36 [0,4194304] 0 2024-02-28T23:07:40.383 INFO:tasks.workunit.client.1.smithi184.stdout:9/658: write d5/d17/f3c [5134822,107083] 0 2024-02-28T23:07:40.383 INFO:tasks.workunit.client.0.smithi159.stdout:2/889: dread d9/d23/f11d [0,4194304] 0 2024-02-28T23:07:40.385 INFO:tasks.workunit.client.1.smithi184.stdout:1/708: write d20/d32/d3e/f9d [1848386,41785] 0 2024-02-28T23:07:40.385 INFO:tasks.workunit.client.0.smithi159.stdout:2/890: stat d9/d36/d59/ff7 0 2024-02-28T23:07:40.388 INFO:tasks.workunit.client.1.smithi184.stdout:8/683: dread d1/da/dc/d16/d32/d42/f6f [0,4194304] 0 2024-02-28T23:07:40.389 INFO:tasks.workunit.client.1.smithi184.stdout:7/632: read d6/d9/d13/d3e/dad/d7d/d8d/fd0 [125296,4840] 0 2024-02-28T23:07:40.389 INFO:tasks.workunit.client.0.smithi159.stdout:5/944: mknod d8/d19/d23/d35/d41/c14d 0 2024-02-28T23:07:40.390 INFO:tasks.workunit.client.1.smithi184.stdout:4/640: write d1/dc/df/f59 [939004,15641] 0 2024-02-28T23:07:40.391 INFO:tasks.workunit.client.1.smithi184.stdout:3/694: creat d1/d4/d1c/d62/d66/dd3/d26/d3a/fd7 x:0 0 0 2024-02-28T23:07:40.394 INFO:tasks.workunit.client.1.smithi184.stdout:5/663: fdatasync db/d12/d1c/d21/d4d/f56 0 2024-02-28T23:07:40.404 INFO:tasks.workunit.client.1.smithi184.stdout:6/609: rename dc/de/d10/f23 to dc/de/d2a/d5c/d79/d87/d9a/fc7 0 2024-02-28T23:07:40.406 INFO:tasks.workunit.client.1.smithi184.stdout:6/610: stat dc/de/d2a/f94 0 2024-02-28T23:07:40.407 INFO:tasks.workunit.client.1.smithi184.stdout:8/684: dwrite d1/da/dc/d18/f64 [0,4194304] 0 2024-02-28T23:07:40.407 INFO:tasks.workunit.client.1.smithi184.stdout:6/611: read dc/de/f29 [486038,101890] 0 2024-02-28T23:07:40.408 INFO:tasks.workunit.client.0.smithi159.stdout:6/953: write d0/d1b/d33/d11/d34/d9d/da2/d96/ff5 [704615,83800] 0 2024-02-28T23:07:40.409 INFO:tasks.workunit.client.0.smithi159.stdout:2/891: dwrite d9/d50/d54/d84/d37/d5c/f121 [0,4194304] 0 2024-02-28T23:07:40.410 INFO:tasks.workunit.client.1.smithi184.stdout:0/707: mknod d0/db2/cf1 0 2024-02-28T23:07:40.415 INFO:tasks.workunit.client.0.smithi159.stdout:1/991: symlink d6/d1d/d46/df9/l155 0 2024-02-28T23:07:40.415 INFO:tasks.workunit.client.0.smithi159.stdout:6/954: readlink d0/d1b/d33/d11/d34/d9d/da2/d4e/d72/l137 0 2024-02-28T23:07:40.421 INFO:tasks.workunit.client.0.smithi159.stdout:9/930: write d4/d3d/d3e/d55/d37/f9b [1642077,106888] 0 2024-02-28T23:07:40.422 INFO:tasks.workunit.client.1.smithi184.stdout:9/659: dread d5/db/de/d10/f2a [0,4194304] 0 2024-02-28T23:07:40.422 INFO:tasks.workunit.client.0.smithi159.stdout:2/892: mknod d9/d50/d54/d8d/c12d 0 2024-02-28T23:07:40.424 INFO:tasks.workunit.client.1.smithi184.stdout:1/709: mknod d20/d32/d3e/da2/cf3 0 2024-02-28T23:07:40.426 INFO:tasks.workunit.client.1.smithi184.stdout:2/631: write d10/d1f/d21/d5e/d15/d60/d66/dc6/f8c [2066352,105433] 0 2024-02-28T23:07:40.428 INFO:tasks.workunit.client.0.smithi159.stdout:7/795: dread d5/d16/d1a/d27/f31 [0,4194304] 0 2024-02-28T23:07:40.430 INFO:tasks.workunit.client.0.smithi159.stdout:1/992: fdatasync d6/d12/d31/d69/f77 0 2024-02-28T23:07:40.431 INFO:tasks.workunit.client.1.smithi184.stdout:7/633: symlink d6/d68/ldd 0 2024-02-28T23:07:40.433 INFO:tasks.workunit.client.0.smithi159.stdout:7/796: chown d5/d16/d1a/d27/deb/d60 140912960 1 2024-02-28T23:07:40.434 INFO:tasks.workunit.client.0.smithi159.stdout:6/955: mkdir d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dac/d138 0 2024-02-28T23:07:40.436 INFO:tasks.workunit.client.1.smithi184.stdout:4/641: symlink d1/d8/d37/d49/lc7 0 2024-02-28T23:07:40.437 INFO:tasks.workunit.client.0.smithi159.stdout:9/931: fdatasync d4/f32 0 2024-02-28T23:07:40.440 INFO:tasks.workunit.client.1.smithi184.stdout:3/695: mkdir d1/d4/d1c/d62/d92/dd8 0 2024-02-28T23:07:40.444 INFO:tasks.workunit.client.1.smithi184.stdout:5/664: truncate db/d12/d18/d2e/d3c/f83 90566 0 2024-02-28T23:07:40.445 INFO:tasks.workunit.client.0.smithi159.stdout:7/797: dread d5/d16/d1a/f9a [0,4194304] 0 2024-02-28T23:07:40.446 INFO:tasks.workunit.client.1.smithi184.stdout:5/665: chown db/d12/d18/ld0 0 1 2024-02-28T23:07:40.447 INFO:tasks.workunit.client.0.smithi159.stdout:1/993: rename d6/d12/d16/de3/d143/fe8 to d6/d1d/d46/d88/dd3/d134/f156 0 2024-02-28T23:07:40.450 INFO:tasks.workunit.client.0.smithi159.stdout:5/945: dwrite d8/d19/d23/d35/d100/f127 [0,4194304] 0 2024-02-28T23:07:40.451 INFO:tasks.workunit.client.1.smithi184.stdout:4/642: dwrite d1/d4/f95 [0,4194304] 0 2024-02-28T23:07:40.453 INFO:tasks.workunit.client.0.smithi159.stdout:5/946: fsync d8/d19/d23/d35/d65/f136 0 2024-02-28T23:07:40.468 INFO:tasks.workunit.client.1.smithi184.stdout:9/660: write d5/d47/d4a/f82 [3943383,106126] 0 2024-02-28T23:07:40.469 INFO:tasks.workunit.client.0.smithi159.stdout:6/956: write d0/d1b/d33/d8c/f6f [1288764,3194] 0 2024-02-28T23:07:40.472 INFO:tasks.workunit.client.0.smithi159.stdout:1/994: mkdir d6/d12/d31/d69/dc0/dca/d110/d157 0 2024-02-28T23:07:40.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:40 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:40.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:40 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:40.475 INFO:tasks.workunit.client.1.smithi184.stdout:2/632: mkdir d10/d1f/d21/d5e/dad/dc7 0 2024-02-28T23:07:40.476 INFO:tasks.workunit.client.1.smithi184.stdout:2/633: stat d10/d1f/f32 0 2024-02-28T23:07:40.476 INFO:tasks.workunit.client.1.smithi184.stdout:7/634: rmdir d6/d9/d13/d14/dac 39 2024-02-28T23:07:40.483 INFO:tasks.workunit.client.0.smithi159.stdout:2/893: dread d9/d23/d2c/d55/f2a [0,4194304] 0 2024-02-28T23:07:40.483 INFO:tasks.workunit.client.0.smithi159.stdout:9/932: link d4/d76/fa8 d4/d3d/d3e/d55/d37/def/f128 0 2024-02-28T23:07:40.484 INFO:tasks.workunit.client.0.smithi159.stdout:5/947: dwrite d8/db4/de8/f12a [0,4194304] 0 2024-02-28T23:07:40.484 INFO:tasks.workunit.client.1.smithi184.stdout:3/696: dread - d1/d4/d5/d40/fa1 zero size 2024-02-28T23:07:40.488 INFO:tasks.workunit.client.1.smithi184.stdout:0/708: write d0/d1f/de3/f70 [806243,77012] 0 2024-02-28T23:07:40.489 INFO:tasks.workunit.client.1.smithi184.stdout:8/685: dwrite d1/da/d10/d17/fc0 [0,4194304] 0 2024-02-28T23:07:40.489 INFO:tasks.workunit.client.0.smithi159.stdout:1/995: unlink d6/d1d/d1f/fa8 0 2024-02-28T23:07:40.495 INFO:tasks.workunit.client.1.smithi184.stdout:1/710: dread d20/d32/d3e/d82/d85/d86/f96 [0,4194304] 0 2024-02-28T23:07:40.495 INFO:tasks.workunit.client.0.smithi159.stdout:7/798: getdents d5/d16/d1a/d27/d46/d65/d81/d98 0 2024-02-28T23:07:40.497 INFO:tasks.workunit.client.0.smithi159.stdout:6/957: symlink d0/d1b/d33/d11/d34/d9d/da2/d4e/l139 0 2024-02-28T23:07:40.506 INFO:tasks.workunit.client.0.smithi159.stdout:9/933: dwrite d4/d3d/d3e/d55/f46 [0,4194304] 0 2024-02-28T23:07:40.507 INFO:tasks.workunit.client.1.smithi184.stdout:3/697: unlink d1/d4/d1c/d62/d66/dd3/d26/d3a/c5c 0 2024-02-28T23:07:40.509 INFO:tasks.workunit.client.1.smithi184.stdout:8/686: fdatasync d1/da/dc/d16/d32/d42/f9b 0 2024-02-28T23:07:40.511 INFO:tasks.workunit.client.1.smithi184.stdout:8/687: stat d1/da/dc/d16/d29 0 2024-02-28T23:07:40.511 INFO:tasks.workunit.client.0.smithi159.stdout:1/996: dread d6/d12/d16/de3/d143/ddc/d139/f149 [0,4194304] 0 2024-02-28T23:07:40.512 INFO:tasks.workunit.client.1.smithi184.stdout:3/698: truncate d1/d4/d1c/d62/d66/dd3/d26/d3a/fd1 769047 0 2024-02-28T23:07:40.513 INFO:tasks.workunit.client.0.smithi159.stdout:6/958: fsync d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dac/dd9/feb 0 2024-02-28T23:07:40.519 INFO:tasks.workunit.client.1.smithi184.stdout:5/666: fdatasync db/d12/d18/d2e/d3c/d5d/f33 0 2024-02-28T23:07:40.520 INFO:tasks.workunit.client.1.smithi184.stdout:4/643: symlink d1/d8/d19/lc8 0 2024-02-28T23:07:40.521 INFO:tasks.workunit.client.1.smithi184.stdout:1/711: creat d20/d32/d3e/d91/ff4 x:0 0 0 2024-02-28T23:07:40.521 INFO:tasks.workunit.client.0.smithi159.stdout:1/997: write d6/d1d/d46/d88/dd3/d134/f156 [731885,3927] 0 2024-02-28T23:07:40.521 INFO:tasks.workunit.client.0.smithi159.stdout:6/959: creat d0/d1b/dc5/f13a x:0 0 0 2024-02-28T23:07:40.523 INFO:tasks.workunit.client.1.smithi184.stdout:9/661: mkdir d5/db/de/d10/dc9/dcf 0 2024-02-28T23:07:40.525 INFO:tasks.workunit.client.0.smithi159.stdout:7/799: rename d5/d56/d50/d5b/c82 to d5/d16/d1a/d27/cfe 0 2024-02-28T23:07:40.526 INFO:tasks.workunit.client.1.smithi184.stdout:9/662: chown d5/db/de/d10/d12/dbb/lc4 1213 1 2024-02-28T23:07:40.526 INFO:tasks.workunit.client.0.smithi159.stdout:9/934: truncate d4/d3d/d3e/d55/d37/d62/d8f/fd8 3826454 0 2024-02-28T23:07:40.529 INFO:tasks.workunit.client.0.smithi159.stdout:6/960: mknod d0/d1b/d33/d11/d34/d9d/da2/db7/db1/c13b 0 2024-02-28T23:07:40.529 INFO:tasks.workunit.client.1.smithi184.stdout:8/688: symlink d1/da/dc/d16/d29/d92/lfd 0 2024-02-28T23:07:40.530 INFO:tasks.workunit.client.0.smithi159.stdout:6/961: chown d0/d1b/ld8 29777 1 2024-02-28T23:07:40.535 INFO:tasks.workunit.client.1.smithi184.stdout:4/644: dwrite d1/d8/f9b [4194304,4194304] 0 2024-02-28T23:07:40.536 INFO:tasks.workunit.client.1.smithi184.stdout:5/667: rmdir db/d90 39 2024-02-28T23:07:40.536 INFO:tasks.workunit.client.0.smithi159.stdout:9/935: fdatasync d4/d52/f57 0 2024-02-28T23:07:40.540 INFO:tasks.workunit.client.0.smithi159.stdout:6/962: chown d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dac/dd9/feb 447912 1 2024-02-28T23:07:40.541 INFO:tasks.workunit.client.1.smithi184.stdout:4/645: chown d1/d8/d37/fc3 11843183 1 2024-02-28T23:07:40.541 INFO:tasks.workunit.client.1.smithi184.stdout:4/646: chown d1/f12 1 1 2024-02-28T23:07:40.541 INFO:tasks.workunit.client.1.smithi184.stdout:6/612: truncate dc/d60/d6d/f83 3371913 0 2024-02-28T23:07:40.543 INFO:tasks.workunit.client.1.smithi184.stdout:9/663: symlink d5/d47/d4a/ld0 0 2024-02-28T23:07:40.544 INFO:tasks.workunit.client.1.smithi184.stdout:3/699: creat d1/d4/d1c/d62/d66/dd3/d26/dd2/fd9 x:0 0 0 2024-02-28T23:07:40.544 INFO:tasks.workunit.client.1.smithi184.stdout:2/634: dread d10/d1f/d21/d5e/d15/f1b [0,4194304] 0 2024-02-28T23:07:40.546 INFO:tasks.workunit.client.1.smithi184.stdout:5/668: fsync db/d12/d1c/d21/d25/f69 0 2024-02-28T23:07:40.546 INFO:tasks.workunit.client.1.smithi184.stdout:8/689: dwrite d1/da/f79 [0,4194304] 0 2024-02-28T23:07:40.548 INFO:tasks.workunit.client.0.smithi159.stdout:1/998: getdents d6/d12/d33/da7 0 2024-02-28T23:07:40.548 INFO:tasks.workunit.client.0.smithi159.stdout:9/936: chown d4/d3d/d3e/f73 1010170 1 2024-02-28T23:07:40.549 INFO:tasks.workunit.client.1.smithi184.stdout:3/700: write d1/d4/d5/fc6 [518240,121390] 0 2024-02-28T23:07:40.549 INFO:tasks.workunit.client.0.smithi159.stdout:2/894: dwrite d9/d50/dcc/d44/f92 [0,4194304] 0 2024-02-28T23:07:40.551 INFO:tasks.workunit.client.1.smithi184.stdout:1/712: symlink d20/d46/lf5 0 2024-02-28T23:07:40.554 INFO:tasks.workunit.client.1.smithi184.stdout:4/647: symlink d1/d8/d19/d56/d7a/lc9 0 2024-02-28T23:07:40.555 INFO:tasks.workunit.client.1.smithi184.stdout:7/635: getdents d6/d9/d13/d3e 0 2024-02-28T23:07:40.557 INFO:tasks.workunit.client.1.smithi184.stdout:9/664: rename d5/d47/d68/d7c/l86 to d5/db/de/d10/d12/d2f/d7d/ld1 0 2024-02-28T23:07:40.558 INFO:tasks.workunit.client.1.smithi184.stdout:4/648: chown d1/dc/df/f59 115039 1 2024-02-28T23:07:40.559 INFO:tasks.workunit.client.1.smithi184.stdout:1/713: mknod d20/d32/d3e/d61/cf6 0 2024-02-28T23:07:40.560 INFO:tasks.workunit.client.0.smithi159.stdout:6/963: dread d0/d1b/d5b/fba [0,4194304] 0 2024-02-28T23:07:40.560 INFO:tasks.workunit.client.0.smithi159.stdout:5/948: write d8/d19/d23/d35/d65/da3/df4/da5/d111/f120 [395994,114518] 0 2024-02-28T23:07:40.561 INFO:tasks.workunit.client.1.smithi184.stdout:2/635: mkdir d10/d1f/d21/d5e/d15/dc8 0 2024-02-28T23:07:40.563 INFO:tasks.workunit.client.1.smithi184.stdout:2/636: fsync d10/f2d 0 2024-02-28T23:07:40.563 INFO:tasks.workunit.client.0.smithi159.stdout:9/937: mkdir d4/d3d/d3e/d55/d4c/dee/d129 0 2024-02-28T23:07:40.564 INFO:tasks.workunit.client.1.smithi184.stdout:7/636: fsync d6/f46 0 2024-02-28T23:07:40.564 INFO:tasks.workunit.client.1.smithi184.stdout:8/690: mknod d1/da/d10/d17/d63/cfe 0 2024-02-28T23:07:40.567 INFO:tasks.workunit.client.1.smithi184.stdout:9/665: mknod d5/db/de/d10/d12/dbb/cd2 0 2024-02-28T23:07:40.568 INFO:tasks.workunit.client.1.smithi184.stdout:6/613: dwrite dc/de/d10/f1b [4194304,4194304] 0 2024-02-28T23:07:40.572 INFO:tasks.workunit.client.0.smithi159.stdout:7/800: dwrite d5/d16/d1a/d27/d3e/fab [0,4194304] 0 2024-02-28T23:07:40.572 INFO:tasks.workunit.client.1.smithi184.stdout:6/614: dread - dc/fbd zero size 2024-02-28T23:07:40.572 INFO:tasks.workunit.client.1.smithi184.stdout:4/649: symlink d1/d8/d37/d49/lca 0 2024-02-28T23:07:40.582 INFO:tasks.workunit.client.0.smithi159.stdout:9/938: creat d4/d76/f12a x:0 0 0 2024-02-28T23:07:40.583 INFO:tasks.workunit.client.0.smithi159.stdout:1/999: rename d6/d1d/d46/d88/dd3/d134/f140 to d6/d12/d33/da7/f158 0 2024-02-28T23:07:40.584 INFO:tasks.workunit.client.0.smithi159.stdout:5/949: unlink d8/d19/d23/d35/d65/da3/df4/da5/d111/d113/l114 0 2024-02-28T23:07:40.587 INFO:tasks.workunit.client.1.smithi184.stdout:6/615: fsync dc/de/f36 0 2024-02-28T23:07:40.590 INFO:tasks.workunit.client.0.smithi159.stdout:5/950: stat d8/d19/d23/d35/d65/da3/dd2/def 0 2024-02-28T23:07:40.592 INFO:tasks.workunit.client.1.smithi184.stdout:2/637: creat d10/d33/fc9 x:0 0 0 2024-02-28T23:07:40.592 INFO:tasks.workunit.client.1.smithi184.stdout:0/709: dwrite d0/d1f/f26 [4194304,4194304] 0 2024-02-28T23:07:40.596 INFO:tasks.workunit.client.0.smithi159.stdout:6/964: dwrite d0/d1b/d33/d11/d34/d9d/da2/f61 [0,4194304] 0 2024-02-28T23:07:40.597 INFO:tasks.workunit.client.1.smithi184.stdout:1/714: dwrite d20/d32/d3e/f63 [0,4194304] 0 2024-02-28T23:07:40.597 INFO:tasks.workunit.client.0.smithi159.stdout:3/899: sync 2024-02-28T23:07:40.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:40 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:40.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:40 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:40.600 INFO:tasks.workunit.client.1.smithi184.stdout:1/715: chown d20/d32/d4b/f99 54285858 1 2024-02-28T23:07:40.603 INFO:tasks.workunit.client.1.smithi184.stdout:7/637: creat d6/d9/d13/d3e/dad/d49/da6/daf/fde x:0 0 0 2024-02-28T23:07:40.608 INFO:tasks.workunit.client.1.smithi184.stdout:9/666: dread d5/db/de/f23 [0,4194304] 0 2024-02-28T23:07:40.610 INFO:tasks.workunit.client.1.smithi184.stdout:6/616: dread dc/f97 [0,4194304] 0 2024-02-28T23:07:40.610 INFO:tasks.workunit.client.1.smithi184.stdout:6/617: dread - dc/de/d10/fb8 zero size 2024-02-28T23:07:40.611 INFO:tasks.workunit.client.1.smithi184.stdout:1/716: truncate d20/d46/f57 3211898 0 2024-02-28T23:07:40.612 INFO:tasks.workunit.client.0.smithi159.stdout:3/900: creat d0/d2b/d55/d6e/f11f x:0 0 0 2024-02-28T23:07:40.616 INFO:tasks.workunit.client.1.smithi184.stdout:7/638: unlink d6/d9/d13/f28 0 2024-02-28T23:07:40.626 INFO:tasks.workunit.client.1.smithi184.stdout:1/717: dwrite d20/f88 [0,4194304] 0 2024-02-28T23:07:40.632 INFO:tasks.workunit.client.1.smithi184.stdout:6/618: write dc/de/d10/f4b [4876762,37859] 0 2024-02-28T23:07:40.633 INFO:tasks.workunit.client.0.smithi159.stdout:3/901: mknod d0/d6/c120 0 2024-02-28T23:07:40.634 INFO:tasks.workunit.client.0.smithi159.stdout:6/965: getdents d0/d1b/d33/d11/d34/d9d 0 2024-02-28T23:07:40.634 INFO:tasks.workunit.client.1.smithi184.stdout:9/667: fdatasync d5/d26/fb5 0 2024-02-28T23:07:40.635 INFO:tasks.workunit.client.1.smithi184.stdout:1/718: fdatasync d20/d32/d4d/f53 0 2024-02-28T23:07:40.635 INFO:tasks.workunit.client.1.smithi184.stdout:3/701: dread d1/d4/d1c/d62/d66/dd3/f68 [0,4194304] 0 2024-02-28T23:07:40.637 INFO:tasks.workunit.client.0.smithi159.stdout:3/902: readlink d0/d6/d34/l7d 0 2024-02-28T23:07:40.638 INFO:tasks.workunit.client.1.smithi184.stdout:3/702: readlink d1/d4/d5/da9/d74/l95 0 2024-02-28T23:07:40.640 INFO:tasks.workunit.client.1.smithi184.stdout:3/703: dread - d1/d4/d1c/d61/f9a zero size 2024-02-28T23:07:40.644 INFO:tasks.workunit.client.1.smithi184.stdout:1/719: rmdir d20/d32/d3e/d61/d8b/d9c/db8 39 2024-02-28T23:07:40.647 INFO:tasks.workunit.client.1.smithi184.stdout:3/704: creat d1/d4/d1c/d62/d66/dd3/d24/dd5/fda x:0 0 0 2024-02-28T23:07:40.649 INFO:tasks.workunit.client.1.smithi184.stdout:9/668: rmdir d5/db/de/d10/dc9/dcf 0 2024-02-28T23:07:40.650 INFO:tasks.workunit.client.1.smithi184.stdout:1/720: read d20/d32/f34 [423944,98437] 0 2024-02-28T23:07:40.653 INFO:tasks.workunit.client.1.smithi184.stdout:1/721: fdatasync d20/d32/f44 0 2024-02-28T23:07:40.653 INFO:tasks.workunit.client.1.smithi184.stdout:9/669: write d5/fc [4408592,118485] 0 2024-02-28T23:07:40.654 INFO:tasks.workunit.client.1.smithi184.stdout:3/705: getdents d1/d4/d1c/d62/d92/dd8 0 2024-02-28T23:07:40.657 INFO:tasks.workunit.client.1.smithi184.stdout:1/722: write d20/d32/d3e/f7c [3219274,38212] 0 2024-02-28T23:07:40.659 INFO:tasks.workunit.client.1.smithi184.stdout:3/706: symlink d1/d4/d5/da9/d74/ldb 0 2024-02-28T23:07:40.660 INFO:tasks.workunit.client.1.smithi184.stdout:9/670: symlink d5/d47/d68/ld3 0 2024-02-28T23:07:40.661 INFO:tasks.workunit.client.1.smithi184.stdout:9/671: chown d5/d47/d4a 7920242 1 2024-02-28T23:07:40.662 INFO:tasks.workunit.client.1.smithi184.stdout:9/672: chown d5/d73/fb3 5285623 1 2024-02-28T23:07:40.667 INFO:tasks.workunit.client.1.smithi184.stdout:3/707: rename d1/d4/d1c/d62/d92/d9b to d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/ddc 0 2024-02-28T23:07:40.668 INFO:tasks.workunit.client.0.smithi159.stdout:3/903: link d0/d2b/d55/df8/d2f/ddf/lf4 d0/d2b/d55/d75/d11a/l121 0 2024-02-28T23:07:40.669 INFO:tasks.workunit.client.1.smithi184.stdout:3/708: fdatasync d1/d4/d1c/d62/d66/dd3/d26/f29 0 2024-02-28T23:07:40.669 INFO:tasks.workunit.client.1.smithi184.stdout:9/673: fdatasync d5/d17/d8f/f98 0 2024-02-28T23:07:40.670 INFO:tasks.workunit.client.1.smithi184.stdout:9/674: chown d5/d17/d43/db8 344857249 1 2024-02-28T23:07:40.680 INFO:tasks.workunit.client.1.smithi184.stdout:9/675: creat d5/db/fd4 x:0 0 0 2024-02-28T23:07:40.681 INFO:tasks.workunit.client.0.smithi159.stdout:3/904: link d0/def/d79/d9b/l109 d0/d6/d34/l122 0 2024-02-28T23:07:40.682 INFO:tasks.workunit.client.1.smithi184.stdout:9/676: dread - d5/db/de/d10/d6a/f91 zero size 2024-02-28T23:07:40.684 INFO:tasks.workunit.client.1.smithi184.stdout:0/710: dread d0/d1f/f4b [0,4194304] 0 2024-02-28T23:07:40.684 INFO:tasks.workunit.client.1.smithi184.stdout:9/677: fdatasync d5/d47/d68/d7c/f8b 0 2024-02-28T23:07:40.684 INFO:tasks.workunit.client.1.smithi184.stdout:3/709: dwrite d1/d4/d6/d83/fba [0,4194304] 0 2024-02-28T23:07:40.686 INFO:tasks.workunit.client.0.smithi159.stdout:3/905: mkdir d0/d3f/dd2/d6a/de7/d123 0 2024-02-28T23:07:40.688 INFO:tasks.workunit.client.1.smithi184.stdout:0/711: chown d0/d1d/f35 0 1 2024-02-28T23:07:40.691 INFO:tasks.workunit.client.0.smithi159.stdout:3/906: mkdir d0/d2b/d55/df8/da9/d124 0 2024-02-28T23:07:40.695 INFO:tasks.workunit.client.1.smithi184.stdout:0/712: fsync d0/f6 0 2024-02-28T23:07:40.696 INFO:tasks.workunit.client.1.smithi184.stdout:3/710: creat d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d82/dc8/fdd x:0 0 0 2024-02-28T23:07:40.698 INFO:tasks.workunit.client.0.smithi159.stdout:3/907: rmdir d0/d3f/dd2/d63 39 2024-02-28T23:07:40.701 INFO:tasks.workunit.client.0.smithi159.stdout:2/895: truncate d9/d50/d54/d84/d37/f8c 3059703 0 2024-02-28T23:07:40.704 INFO:tasks.workunit.client.1.smithi184.stdout:9/678: dwrite d5/db/de/fbd [0,4194304] 0 2024-02-28T23:07:40.704 INFO:tasks.workunit.client.1.smithi184.stdout:3/711: truncate d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/f6d 279660 0 2024-02-28T23:07:40.705 INFO:tasks.workunit.client.0.smithi159.stdout:3/908: fdatasync d0/def/d79/f89 0 2024-02-28T23:07:40.705 INFO:tasks.workunit.client.1.smithi184.stdout:9/679: chown d5 99236 1 2024-02-28T23:07:40.710 INFO:tasks.workunit.client.1.smithi184.stdout:0/713: truncate d0/fc 1590063 0 2024-02-28T23:07:40.710 INFO:tasks.workunit.client.0.smithi159.stdout:2/896: creat d9/d50/d54/d84/d113/d12b/f12e x:0 0 0 2024-02-28T23:07:40.715 INFO:tasks.workunit.client.1.smithi184.stdout:3/712: symlink d1/d4/d1c/d62/lde 0 2024-02-28T23:07:40.716 INFO:tasks.workunit.client.1.smithi184.stdout:8/691: dwrite d1/da/dc/d16/d4d/f87 [0,4194304] 0 2024-02-28T23:07:40.720 INFO:tasks.workunit.client.1.smithi184.stdout:9/680: stat d5/db/de/d10/d12/d2f/f52 0 2024-02-28T23:07:40.720 INFO:tasks.workunit.client.1.smithi184.stdout:0/714: creat d0/df/d13/d27/d31/d5b/d8e/d92/ff2 x:0 0 0 2024-02-28T23:07:40.729 INFO:tasks.workunit.client.1.smithi184.stdout:5/669: sync 2024-02-28T23:07:40.729 INFO:tasks.workunit.client.1.smithi184.stdout:2/638: truncate d10/d1f/d21/d5e/d15/f2e 384828 0 2024-02-28T23:07:40.730 INFO:tasks.workunit.client.0.smithi159.stdout:2/897: symlink d9/d23/d2c/d55/l12f 0 2024-02-28T23:07:40.732 INFO:tasks.workunit.client.1.smithi184.stdout:5/670: chown db/d12/d18/d2e/d3c/d5d/f54 752549 1 2024-02-28T23:07:40.732 INFO:tasks.workunit.client.0.smithi159.stdout:7/801: dwrite d5/d16/d1a/d27/deb/f11 [0,4194304] 0 2024-02-28T23:07:40.739 INFO:tasks.workunit.client.1.smithi184.stdout:3/713: dwrite d1/f8d [0,4194304] 0 2024-02-28T23:07:40.740 INFO:tasks.workunit.client.0.smithi159.stdout:9/939: dwrite d4/d3d/d3e/d4a/d109/f122 [0,4194304] 0 2024-02-28T23:07:40.742 INFO:tasks.workunit.client.1.smithi184.stdout:0/715: dwrite d0/d1f/de3/fea [0,4194304] 0 2024-02-28T23:07:40.746 INFO:tasks.workunit.client.0.smithi159.stdout:5/951: dwrite d8/d16/d122/f5a [0,4194304] 0 2024-02-28T23:07:40.748 INFO:tasks.workunit.client.1.smithi184.stdout:8/692: dread d1/da/d10/d17/d63/fa4 [0,4194304] 0 2024-02-28T23:07:40.750 INFO:tasks.workunit.client.1.smithi184.stdout:0/716: read d0/fad [1924161,123436] 0 2024-02-28T23:07:40.756 INFO:tasks.workunit.client.1.smithi184.stdout:7/639: dwrite d6/d9/d13/d14/f42 [0,4194304] 0 2024-02-28T23:07:40.756 INFO:tasks.workunit.client.1.smithi184.stdout:6/619: dwrite dc/de/d2a/d5c/d79/d87/d9a/fc7 [0,4194304] 0 2024-02-28T23:07:40.757 INFO:tasks.workunit.client.0.smithi159.stdout:2/898: creat d9/d50/d54/d84/d113/f130 x:0 0 0 2024-02-28T23:07:40.760 INFO:tasks.workunit.client.0.smithi159.stdout:5/952: chown d8/d19/d23/d35/d65/da3/df4/da5/d90/f10d 11078 1 2024-02-28T23:07:40.760 INFO:tasks.workunit.client.0.smithi159.stdout:9/940: creat d4/de4/d11a/f12b x:0 0 0 2024-02-28T23:07:40.762 INFO:tasks.workunit.client.0.smithi159.stdout:9/941: write d4/d76/f12a [41886,6039] 0 2024-02-28T23:07:40.763 INFO:tasks.workunit.client.1.smithi184.stdout:5/671: stat db/d12/d18/d2e/dc1/f9d 0 2024-02-28T23:07:40.766 INFO:tasks.workunit.client.0.smithi159.stdout:9/942: chown d4/d3d/d3e/d55/d37/d62/d8f 5075129 1 2024-02-28T23:07:40.766 INFO:tasks.workunit.client.1.smithi184.stdout:5/672: fdatasync db/d12/d1c/fc3 0 2024-02-28T23:07:40.767 INFO:tasks.workunit.client.1.smithi184.stdout:9/681: dread d5/d17/d43/f60 [0,4194304] 0 2024-02-28T23:07:40.771 INFO:tasks.workunit.client.0.smithi159.stdout:7/802: mkdir d5/d16/d1a/d27/dff 0 2024-02-28T23:07:40.785 INFO:tasks.workunit.client.1.smithi184.stdout:6/620: dwrite dc/f4f [0,4194304] 0 2024-02-28T23:07:40.786 INFO:tasks.workunit.client.0.smithi159.stdout:5/953: creat d8/d19/d23/d35/d41/d77/dfd/f14e x:0 0 0 2024-02-28T23:07:40.788 INFO:tasks.workunit.client.1.smithi184.stdout:6/621: truncate dc/de/d2a/f94 553656 0 2024-02-28T23:07:40.789 INFO:tasks.workunit.client.1.smithi184.stdout:0/717: symlink d0/d7c/d8a/lf3 0 2024-02-28T23:07:40.789 INFO:tasks.workunit.client.0.smithi159.stdout:3/909: dread d0/d2b/d55/f8a [0,4194304] 0 2024-02-28T23:07:40.790 INFO:tasks.workunit.client.1.smithi184.stdout:8/693: dread d1/da/dc/d16/d29/f72 [0,4194304] 0 2024-02-28T23:07:40.796 INFO:tasks.workunit.client.0.smithi159.stdout:2/899: symlink d9/d50/d54/d84/d37/l131 0 2024-02-28T23:07:40.798 INFO:tasks.workunit.client.1.smithi184.stdout:4/650: sync 2024-02-28T23:07:40.798 INFO:tasks.workunit.client.1.smithi184.stdout:1/723: sync 2024-02-28T23:07:40.800 INFO:tasks.workunit.client.1.smithi184.stdout:4/651: chown d1/d4/d43/d73/l69 459 1 2024-02-28T23:07:40.802 INFO:tasks.workunit.client.0.smithi159.stdout:3/910: mkdir d0/d2b/d55/d6e/d125 0 2024-02-28T23:07:40.803 INFO:tasks.workunit.client.1.smithi184.stdout:4/652: truncate d1/d4/d43/d73/fc5 413660 0 2024-02-28T23:07:40.807 INFO:tasks.workunit.client.0.smithi159.stdout:2/900: creat d9/d36/d59/f132 x:0 0 0 2024-02-28T23:07:40.814 INFO:tasks.workunit.client.1.smithi184.stdout:3/714: creat d1/d4/d1c/d62/d66/dab/fdf x:0 0 0 2024-02-28T23:07:40.816 INFO:tasks.workunit.client.1.smithi184.stdout:3/715: dread - d1/d4/d1c/d62/d66/dd3/d24/dd5/fda zero size 2024-02-28T23:07:40.818 INFO:tasks.workunit.client.1.smithi184.stdout:3/716: dread - d1/d4/d1c/d61/fc0 zero size 2024-02-28T23:07:40.818 INFO:tasks.workunit.client.1.smithi184.stdout:3/717: stat d1/d4/f42 0 2024-02-28T23:07:40.821 INFO:tasks.workunit.client.0.smithi159.stdout:2/901: fsync d9/d50/d54/d84/d37/d5c/ff4 0 2024-02-28T23:07:40.822 INFO:tasks.workunit.client.1.smithi184.stdout:0/718: creat d0/d1d/ff4 x:0 0 0 2024-02-28T23:07:40.826 INFO:tasks.workunit.client.1.smithi184.stdout:8/694: symlink d1/da/d10/d6b/lff 0 2024-02-28T23:07:40.828 INFO:tasks.workunit.client.1.smithi184.stdout:8/695: write d1/da/d10/d17/f9c [4042555,99207] 0 2024-02-28T23:07:40.830 INFO:tasks.workunit.client.1.smithi184.stdout:1/724: rmdir d20/d32/db0 39 2024-02-28T23:07:40.831 INFO:tasks.workunit.client.1.smithi184.stdout:8/696: dread - d1/da/dc/d16/fbc zero size 2024-02-28T23:07:40.832 INFO:tasks.workunit.client.0.smithi159.stdout:3/911: link d0/d2b/f29 d0/def/d79/f126 0 2024-02-28T23:07:40.832 INFO:tasks.workunit.client.1.smithi184.stdout:1/725: readlink d20/d46/l70 0 2024-02-28T23:07:40.836 INFO:tasks.workunit.client.1.smithi184.stdout:2/639: dwrite d10/d1f/d21/d6a/f84 [0,4194304] 0 2024-02-28T23:07:40.840 INFO:tasks.workunit.client.0.smithi159.stdout:3/912: creat d0/d47/d88/da5/f127 x:0 0 0 2024-02-28T23:07:40.842 INFO:tasks.workunit.client.0.smithi159.stdout:3/913: write d0/d6/d34/f41 [1749700,73975] 0 2024-02-28T23:07:40.846 INFO:tasks.workunit.client.1.smithi184.stdout:1/726: dwrite fb [0,4194304] 0 2024-02-28T23:07:40.847 INFO:tasks.workunit.client.0.smithi159.stdout:3/914: fdatasync d0/d2b/d55/df8/d2f/f4b 0 2024-02-28T23:07:40.847 INFO:tasks.workunit.client.0.smithi159.stdout:9/943: dread d4/f5 [0,4194304] 0 2024-02-28T23:07:40.853 INFO:tasks.workunit.client.1.smithi184.stdout:2/640: dwrite d10/d1f/d21/d5e/d15/fbe [0,4194304] 0 2024-02-28T23:07:40.854 INFO:tasks.workunit.client.1.smithi184.stdout:2/641: dread - d10/d1f/d21/d5e/d15/d60/f9a zero size 2024-02-28T23:07:40.857 INFO:tasks.workunit.client.1.smithi184.stdout:2/642: dread - d10/d1f/d21/d5e/d15/d60/d66/dc6/fb7 zero size 2024-02-28T23:07:40.860 INFO:tasks.workunit.client.0.smithi159.stdout:7/803: dread d5/d56/d50/f80 [0,4194304] 0 2024-02-28T23:07:40.861 INFO:tasks.workunit.client.1.smithi184.stdout:2/643: write d10/d1f/f8d [275725,128592] 0 2024-02-28T23:07:40.862 INFO:tasks.workunit.client.0.smithi159.stdout:5/954: dwrite d8/d59/fd9 [0,4194304] 0 2024-02-28T23:07:40.872 INFO:tasks.workunit.client.0.smithi159.stdout:2/902: write d9/d50/d54/fef [1644978,49847] 0 2024-02-28T23:07:40.883 INFO:tasks.workunit.client.0.smithi159.stdout:2/903: creat d9/d50/d54/d84/d113/d12b/f133 x:0 0 0 2024-02-28T23:07:40.883 INFO:tasks.workunit.client.1.smithi184.stdout:9/682: symlink d5/d47/d59/ld5 0 2024-02-28T23:07:40.886 INFO:tasks.workunit.client.1.smithi184.stdout:3/718: symlink d1/d4/d1c/d62/d66/dd3/d26/le0 0 2024-02-28T23:07:40.886 INFO:tasks.workunit.client.0.smithi159.stdout:9/944: dwrite d4/f25 [0,4194304] 0 2024-02-28T23:07:40.886 INFO:tasks.workunit.client.1.smithi184.stdout:3/719: readlink d1/d4/d6/l4c 0 2024-02-28T23:07:40.888 INFO:tasks.workunit.client.1.smithi184.stdout:5/673: creat db/fd8 x:0 0 0 2024-02-28T23:07:40.889 INFO:tasks.workunit.client.0.smithi159.stdout:9/945: chown d4/de4/d11a 0 1 2024-02-28T23:07:40.890 INFO:tasks.workunit.client.1.smithi184.stdout:5/674: write db/d12/d50/fb2 [528262,119197] 0 2024-02-28T23:07:40.890 INFO:tasks.workunit.client.0.smithi159.stdout:2/904: mknod d9/d50/dcc/d44/dc8/c134 0 2024-02-28T23:07:40.892 INFO:tasks.workunit.client.1.smithi184.stdout:8/697: read - d1/da/dc/d16/d32/fb4 zero size 2024-02-28T23:07:40.895 INFO:tasks.workunit.client.1.smithi184.stdout:4/653: symlink d1/dc/df/d27/lcb 0 2024-02-28T23:07:40.897 INFO:tasks.workunit.client.1.smithi184.stdout:0/719: mkdir d0/d1d/d3a/da9/df5 0 2024-02-28T23:07:40.903 INFO:tasks.workunit.client.0.smithi159.stdout:9/946: creat d4/d3d/d3e/d4a/f12c x:0 0 0 2024-02-28T23:07:40.904 INFO:tasks.workunit.client.1.smithi184.stdout:7/640: link d6/d9/d13/d1e/f21 d6/d9/d13/d3e/dad/d49/da6/daf/d47/fdf 0 2024-02-28T23:07:40.904 INFO:tasks.workunit.client.1.smithi184.stdout:1/727: mkdir d20/d32/db0/df7 0 2024-02-28T23:07:40.905 INFO:tasks.workunit.client.1.smithi184.stdout:4/654: symlink d1/lcc 0 2024-02-28T23:07:40.906 INFO:tasks.workunit.client.1.smithi184.stdout:8/698: rmdir d1/da/d10/d17 39 2024-02-28T23:07:40.909 INFO:tasks.workunit.client.1.smithi184.stdout:5/675: symlink db/d12/d1c/d9b/ld9 0 2024-02-28T23:07:40.912 INFO:tasks.workunit.client.1.smithi184.stdout:6/622: getdents dc/d60 0 2024-02-28T23:07:40.915 INFO:tasks.workunit.client.1.smithi184.stdout:8/699: dread d1/da/f5b [0,4194304] 0 2024-02-28T23:07:40.916 INFO:tasks.workunit.client.0.smithi159.stdout:2/905: dwrite d9/d50/d54/d84/f112 [0,4194304] 0 2024-02-28T23:07:40.916 INFO:tasks.workunit.client.0.smithi159.stdout:5/955: dread d8/d59/fe9 [0,4194304] 0 2024-02-28T23:07:40.917 INFO:tasks.workunit.client.1.smithi184.stdout:2/644: rename d10/f9e to d10/d1f/d21/fca 0 2024-02-28T23:07:40.917 INFO:tasks.workunit.client.1.smithi184.stdout:9/683: creat d5/d47/d59/fd6 x:0 0 0 2024-02-28T23:07:40.919 INFO:tasks.workunit.client.1.smithi184.stdout:7/641: mkdir d6/d9/d13/d3e/dad/d49/de0 0 2024-02-28T23:07:40.919 INFO:tasks.workunit.client.1.smithi184.stdout:8/700: readlink d1/da/dc/d16/d32/l36 0 2024-02-28T23:07:40.919 INFO:tasks.workunit.client.0.smithi159.stdout:5/956: stat d8/db4/de8/f10a 0 2024-02-28T23:07:40.922 INFO:tasks.workunit.client.1.smithi184.stdout:8/701: fsync d1/da/dc/d16/d29/f54 0 2024-02-28T23:07:40.924 INFO:tasks.workunit.client.1.smithi184.stdout:1/728: dwrite d20/d32/d3e/d91/fda [0,4194304] 0 2024-02-28T23:07:40.924 INFO:tasks.workunit.client.1.smithi184.stdout:1/729: fsync f19 0 2024-02-28T23:07:40.926 INFO:tasks.workunit.client.1.smithi184.stdout:6/623: creat dc/de/d2a/d8e/dad/d8a/da1/fc8 x:0 0 0 2024-02-28T23:07:40.926 INFO:tasks.workunit.client.0.smithi159.stdout:5/957: rmdir d8/d19/d23/d35/d65/da3/dd2/dd7 39 2024-02-28T23:07:40.927 INFO:tasks.workunit.client.1.smithi184.stdout:4/655: truncate d1/d8/d19/d67/d99/f64 819092 0 2024-02-28T23:07:40.927 INFO:tasks.workunit.client.1.smithi184.stdout:6/624: chown dc/de/d10/d3a 12 1 2024-02-28T23:07:40.930 INFO:tasks.workunit.client.0.smithi159.stdout:7/804: dread d5/d16/f5f [0,4194304] 0 2024-02-28T23:07:40.933 INFO:tasks.workunit.client.1.smithi184.stdout:5/676: creat db/d12/d18/d2e/fda x:0 0 0 2024-02-28T23:07:40.936 INFO:tasks.workunit.client.1.smithi184.stdout:5/677: chown db/d12/d18/d2e/d3c/d5d/cc6 1356 1 2024-02-28T23:07:40.938 INFO:tasks.workunit.client.1.smithi184.stdout:0/720: rename d0/df/d13/d27/d31/d5b/d8e/d91/l62 to d0/df/d13/d27/d31/d5b/d7b/lf6 0 2024-02-28T23:07:40.939 INFO:tasks.workunit.client.1.smithi184.stdout:5/678: chown db/d12/d1c/d21/d2f/f55 91 1 2024-02-28T23:07:40.944 INFO:tasks.workunit.client.1.smithi184.stdout:2/645: symlink d10/d1f/d21/d6a/lcb 0 2024-02-28T23:07:40.946 INFO:tasks.workunit.client.0.smithi159.stdout:7/805: mknod d5/d56/c100 0 2024-02-28T23:07:40.946 INFO:tasks.workunit.client.1.smithi184.stdout:4/656: dwrite d1/d8/d19/d56/d7a/faf [0,4194304] 0 2024-02-28T23:07:40.958 INFO:tasks.workunit.client.0.smithi159.stdout:7/806: rename d5/d16/d1a/d24 to d5/d16/d1a/d27/d46/d101 0 2024-02-28T23:07:40.963 INFO:tasks.workunit.client.0.smithi159.stdout:7/807: mkdir d5/d16/d1a/d27/d46/d101/d64/db4/dc8/d102 0 2024-02-28T23:07:40.967 INFO:tasks.workunit.client.1.smithi184.stdout:5/679: dwrite db/d12/d1c/d21/fbf [0,4194304] 0 2024-02-28T23:07:40.967 INFO:tasks.workunit.client.1.smithi184.stdout:1/730: rename d20/d32/d4b/f78 to d20/d32/ff8 0 2024-02-28T23:07:40.969 INFO:tasks.workunit.client.1.smithi184.stdout:0/721: getdents d0/df/d13/d27/d58 0 2024-02-28T23:07:40.971 INFO:tasks.workunit.client.0.smithi159.stdout:9/947: write d4/d3d/d3e/d55/d4c/d4e/dbe/fd1 [1524602,66350] 0 2024-02-28T23:07:40.973 INFO:tasks.workunit.client.1.smithi184.stdout:5/680: read - db/d12/d1c/fcc zero size 2024-02-28T23:07:40.975 INFO:tasks.workunit.client.1.smithi184.stdout:0/722: fdatasync d0/d1f/de3/fc9 0 2024-02-28T23:07:40.977 INFO:tasks.workunit.client.1.smithi184.stdout:1/731: chown d20/d32/d3e/d82/d85/d86/f96 100 1 2024-02-28T23:07:40.979 INFO:tasks.workunit.client.1.smithi184.stdout:6/625: rename dc/d42/f59 to dc/d60/d78/fc9 0 2024-02-28T23:07:40.980 INFO:tasks.workunit.client.0.smithi159.stdout:7/808: getdents d5/d16/d1a/d27/d46/d65/d81/d83/d9d 0 2024-02-28T23:07:40.980 INFO:tasks.workunit.client.1.smithi184.stdout:3/720: dwrite d1/d4/d1c/d62/fa3 [0,4194304] 0 2024-02-28T23:07:40.981 INFO:tasks.workunit.client.0.smithi159.stdout:2/906: write d9/d50/d54/fb8 [2069433,89601] 0 2024-02-28T23:07:40.983 INFO:tasks.workunit.client.0.smithi159.stdout:9/948: symlink d4/d3d/d3e/d55/d37/l12d 0 2024-02-28T23:07:40.984 INFO:tasks.workunit.client.0.smithi159.stdout:5/958: write d8/d16/d122/f3b [4248977,46906] 0 2024-02-28T23:07:40.985 INFO:tasks.workunit.client.1.smithi184.stdout:0/723: symlink d0/d7c/lf7 0 2024-02-28T23:07:40.985 INFO:tasks.workunit.client.1.smithi184.stdout:4/657: dread d1/dc/df/d38/d57/f71 [0,4194304] 0 2024-02-28T23:07:40.988 INFO:tasks.workunit.client.1.smithi184.stdout:1/732: creat d20/d32/d3e/d82/d85/d86/ff9 x:0 0 0 2024-02-28T23:07:40.988 INFO:tasks.workunit.client.1.smithi184.stdout:9/684: dread d5/d26/d50/f3b [0,4194304] 0 2024-02-28T23:07:40.990 INFO:tasks.workunit.client.0.smithi159.stdout:7/809: truncate d5/d16/d1a/d27/d3e/f76 5654507 0 2024-02-28T23:07:40.990 INFO:tasks.workunit.client.0.smithi159.stdout:2/907: truncate d9/d23/d2c/f91 752296 0 2024-02-28T23:07:40.993 INFO:tasks.workunit.client.1.smithi184.stdout:0/724: symlink d0/d1d/lf8 0 2024-02-28T23:07:40.996 INFO:tasks.workunit.client.1.smithi184.stdout:8/702: write d1/da/f89 [467151,78820] 0 2024-02-28T23:07:40.997 INFO:tasks.workunit.client.0.smithi159.stdout:5/959: creat d8/d19/d23/d35/d65/da3/dd2/def/d11f/f14f x:0 0 0 2024-02-28T23:07:41.006 INFO:tasks.workunit.client.0.smithi159.stdout:5/960: mkdir d8/d19/d23/d35/d65/db5/d150 0 2024-02-28T23:07:41.007 INFO:tasks.workunit.client.1.smithi184.stdout:4/658: write d1/d8/d35/fc0 [908756,32659] 0 2024-02-28T23:07:41.007 INFO:tasks.workunit.client.1.smithi184.stdout:5/681: dwrite db/d12/d1c/d21/d2f/f4e [0,4194304] 0 2024-02-28T23:07:41.007 INFO:tasks.workunit.client.1.smithi184.stdout:7/642: dwrite d6/d9/d13/d3e/dad/fa1 [0,4194304] 0 2024-02-28T23:07:41.009 INFO:tasks.workunit.client.0.smithi159.stdout:5/961: fdatasync d8/d19/d23/d35/d41/daa/d79/fa4 0 2024-02-28T23:07:41.012 INFO:tasks.workunit.client.0.smithi159.stdout:5/962: dread - d8/d16/d122/f32 zero size 2024-02-28T23:07:41.012 INFO:tasks.workunit.client.1.smithi184.stdout:2/646: rename d10/d1f/d38/d54/f69 to d10/d1f/fcc 0 2024-02-28T23:07:41.012 INFO:tasks.workunit.client.1.smithi184.stdout:9/685: dread - d5/d47/d59/f87 zero size 2024-02-28T23:07:41.017 INFO:tasks.workunit.client.0.smithi159.stdout:9/949: link d4/d3d/d3e/d55/d4c/db6/le9 d4/d3d/d3e/d55/d37/d62/d107/dd7/l12e 0 2024-02-28T23:07:41.018 INFO:tasks.workunit.client.0.smithi159.stdout:2/908: write f6 [916181,27989] 0 2024-02-28T23:07:41.020 INFO:tasks.workunit.client.1.smithi184.stdout:0/725: truncate d0/df/d13/d27/d31/d51/f8d 1733385 0 2024-02-28T23:07:41.022 INFO:tasks.workunit.client.1.smithi184.stdout:6/626: dread dc/d60/d62/f82 [0,4194304] 0 2024-02-28T23:07:41.023 INFO:tasks.workunit.client.1.smithi184.stdout:4/659: unlink d1/cc1 0 2024-02-28T23:07:41.024 INFO:tasks.workunit.client.1.smithi184.stdout:5/682: symlink db/d12/d1c/d21/d2f/dc4/ldb 0 2024-02-28T23:07:41.027 INFO:tasks.workunit.client.0.smithi159.stdout:2/909: creat d9/d23/d2c/d55/d13/d4f/f135 x:0 0 0 2024-02-28T23:07:41.029 INFO:tasks.workunit.client.0.smithi159.stdout:9/950: mkdir d4/d3d/d3e/d55/d4c/d4e/d12f 0 2024-02-28T23:07:41.032 INFO:tasks.workunit.client.1.smithi184.stdout:7/643: chown d6/d9/d13/d14/f7b 320391157 1 2024-02-28T23:07:41.033 INFO:tasks.workunit.client.0.smithi159.stdout:2/910: mkdir d9/d50/d62/dce/d136 0 2024-02-28T23:07:41.036 INFO:tasks.workunit.client.1.smithi184.stdout:8/703: mknod d1/da/d10/d43/da1/de0/c100 0 2024-02-28T23:07:41.036 INFO:tasks.workunit.client.1.smithi184.stdout:2/647: read d10/d33/f9b [1044162,37518] 0 2024-02-28T23:07:41.039 INFO:tasks.workunit.client.1.smithi184.stdout:0/726: readlink d0/df/d13/d27/d31/d5b/d7b/lf6 0 2024-02-28T23:07:41.039 INFO:tasks.workunit.client.1.smithi184.stdout:7/644: dread d6/f67 [0,4194304] 0 2024-02-28T23:07:41.040 INFO:tasks.workunit.client.0.smithi159.stdout:2/911: creat d9/d50/dcc/d44/f137 x:0 0 0 2024-02-28T23:07:41.041 INFO:tasks.workunit.client.1.smithi184.stdout:2/648: chown d10/d55 22191 1 2024-02-28T23:07:41.042 INFO:tasks.workunit.client.1.smithi184.stdout:9/686: getdents d5/d17/d43/db8 0 2024-02-28T23:07:41.043 INFO:tasks.workunit.client.0.smithi159.stdout:5/963: dwrite d8/d19/d23/d35/d38/d6d/f74 [0,4194304] 0 2024-02-28T23:07:41.044 INFO:tasks.workunit.client.1.smithi184.stdout:3/721: rename d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/f73 to d1/d4/d6/fe1 0 2024-02-28T23:07:41.049 INFO:tasks.workunit.client.0.smithi159.stdout:2/912: mknod d9/d50/d54/d84/c138 0 2024-02-28T23:07:41.053 INFO:tasks.workunit.client.1.smithi184.stdout:0/727: chown d0/fc 63927593 1 2024-02-28T23:07:41.054 INFO:tasks.workunit.client.1.smithi184.stdout:5/683: dwrite db/d12/d1c/d21/fb6 [0,4194304] 0 2024-02-28T23:07:41.056 INFO:tasks.workunit.client.1.smithi184.stdout:1/733: dwrite d20/d46/f69 [0,4194304] 0 2024-02-28T23:07:41.056 INFO:tasks.workunit.client.0.smithi159.stdout:5/964: symlink d8/d19/l151 0 2024-02-28T23:07:41.057 INFO:tasks.workunit.client.1.smithi184.stdout:8/704: fsync d1/da/dc/d16/d29/fb7 0 2024-02-28T23:07:41.058 INFO:tasks.workunit.client.1.smithi184.stdout:6/627: dwrite dc/d60/d7c/f9e [0,4194304] 0 2024-02-28T23:07:41.059 INFO:tasks.workunit.client.1.smithi184.stdout:9/687: write d5/d17/f3d [1634131,130576] 0 2024-02-28T23:07:41.060 INFO:tasks.workunit.client.0.smithi159.stdout:2/913: rename d9/d50/dcc/f122 to d9/d50/d62/f139 0 2024-02-28T23:07:41.069 INFO:tasks.workunit.client.1.smithi184.stdout:8/705: chown d1/da/dc/d18/l4a 88026556 1 2024-02-28T23:07:41.071 INFO:tasks.workunit.client.1.smithi184.stdout:8/706: readlink d1/da/dc/d16/d32/d42/l48 0 2024-02-28T23:07:41.072 INFO:tasks.workunit.client.0.smithi159.stdout:9/951: dread d4/d3d/d3e/d55/d37/d62/f74 [0,4194304] 0 2024-02-28T23:07:41.074 INFO:tasks.workunit.client.1.smithi184.stdout:8/707: chown d1/da/dc/cf9 2903824 1 2024-02-28T23:07:41.075 INFO:tasks.workunit.client.0.smithi159.stdout:9/952: chown d4/d3d/d3e/d55/l11b 0 1 2024-02-28T23:07:41.075 INFO:tasks.workunit.client.1.smithi184.stdout:4/660: dread d1/f12 [0,4194304] 0 2024-02-28T23:07:41.078 INFO:tasks.workunit.client.1.smithi184.stdout:4/661: chown d1/dc/df/d38/d57/f71 0 1 2024-02-28T23:07:41.079 INFO:tasks.workunit.client.1.smithi184.stdout:4/662: chown d1/dc/df/d5b/d6c 354581 1 2024-02-28T23:07:41.081 INFO:tasks.workunit.client.0.smithi159.stdout:5/965: dread d8/d19/f54 [0,4194304] 0 2024-02-28T23:07:41.083 INFO:tasks.workunit.client.0.smithi159.stdout:2/914: creat d9/d50/d54/f13a x:0 0 0 2024-02-28T23:07:41.086 INFO:tasks.workunit.client.1.smithi184.stdout:7/645: unlink d6/d9/d13/d3e/dad/f27 0 2024-02-28T23:07:41.086 INFO:tasks.workunit.client.1.smithi184.stdout:7/646: fsync d6/d68/f7a 0 2024-02-28T23:07:41.087 INFO:tasks.workunit.client.1.smithi184.stdout:3/722: mknod d1/d4/d1c/d62/d66/dd3/d26/d3a/ce2 0 2024-02-28T23:07:41.090 INFO:tasks.workunit.client.1.smithi184.stdout:0/728: dread - d0/df/d13/d27/d31/d5b/d8e/fb5 zero size 2024-02-28T23:07:41.090 INFO:tasks.workunit.client.1.smithi184.stdout:6/628: rmdir dc/de/d2a/d8e/dad 39 2024-02-28T23:07:41.095 INFO:tasks.workunit.client.0.smithi159.stdout:5/966: mknod d8/d19/d23/d35/d38/d6d/df8/d123/c152 0 2024-02-28T23:07:41.096 INFO:tasks.workunit.client.1.smithi184.stdout:5/684: unlink db/d12/d18/d2e/d3c/d5d/f3e 0 2024-02-28T23:07:41.096 INFO:tasks.workunit.client.1.smithi184.stdout:4/663: dwrite d1/d8/d35/fc0 [0,4194304] 0 2024-02-28T23:07:41.096 INFO:tasks.workunit.client.1.smithi184.stdout:8/708: mkdir d1/da/d10/d43/d101 0 2024-02-28T23:07:41.099 INFO:tasks.workunit.client.0.smithi159.stdout:5/967: mknod d8/d19/d23/d35/d38/d6d/c153 0 2024-02-28T23:07:41.104 INFO:tasks.workunit.client.0.smithi159.stdout:2/915: unlink d9/d50/d62/dba/d105/l111 0 2024-02-28T23:07:41.113 INFO:tasks.workunit.client.1.smithi184.stdout:3/723: creat d1/d4/d1c/d62/d66/dd3/d24/fe3 x:0 0 0 2024-02-28T23:07:41.115 INFO:tasks.workunit.client.0.smithi159.stdout:5/968: rename d8/db4/de8/f10a to d8/d19/d23/d35/d65/da3/dd2/def/d11f/d12b/f154 0 2024-02-28T23:07:41.116 INFO:tasks.workunit.client.1.smithi184.stdout:1/734: mkdir d20/d32/db0/df7/dfa 0 2024-02-28T23:07:41.118 INFO:tasks.workunit.client.0.smithi159.stdout:9/953: dread d4/d3d/d3e/d55/d37/d62/f69 [0,4194304] 0 2024-02-28T23:07:41.120 INFO:tasks.workunit.client.0.smithi159.stdout:5/969: write d8/d19/d23/d35/d41/daa/d79/fa4 [274753,113349] 0 2024-02-28T23:07:41.120 INFO:tasks.workunit.client.1.smithi184.stdout:9/688: symlink d5/db/d65/dc2/ld7 0 2024-02-28T23:07:41.121 INFO:tasks.workunit.client.0.smithi159.stdout:5/970: readlink d8/d16/l63 0 2024-02-28T23:07:41.121 INFO:tasks.workunit.client.1.smithi184.stdout:0/729: symlink d0/df/d13/d27/d31/d51/d85/lf9 0 2024-02-28T23:07:41.123 INFO:tasks.workunit.client.0.smithi159.stdout:5/971: chown d8/d19/d23/d35/d65/db5/cb6 57079 1 2024-02-28T23:07:41.124 INFO:tasks.workunit.client.1.smithi184.stdout:0/730: stat d0/df/d13/d27/d31/d51/f8c 0 2024-02-28T23:07:41.125 INFO:tasks.workunit.client.1.smithi184.stdout:0/731: chown d0/c2e 129908282 1 2024-02-28T23:07:41.129 INFO:tasks.workunit.client.1.smithi184.stdout:4/664: creat d1/dc/df/d38/d57/fcd x:0 0 0 2024-02-28T23:07:41.129 INFO:tasks.workunit.client.1.smithi184.stdout:1/735: dwrite d20/d32/d3e/d91/faa [0,4194304] 0 2024-02-28T23:07:41.132 INFO:tasks.workunit.client.1.smithi184.stdout:3/724: unlink d1/d4/d1c/c5b 0 2024-02-28T23:07:41.133 INFO:tasks.workunit.client.1.smithi184.stdout:1/736: write d20/d46/d90/da0/fbe [4474322,31923] 0 2024-02-28T23:07:41.135 INFO:tasks.workunit.client.1.smithi184.stdout:1/737: chown d20/d32/d4b/c5a 1 1 2024-02-28T23:07:41.139 INFO:tasks.workunit.client.1.smithi184.stdout:3/725: dread d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/fcb [0,4194304] 0 2024-02-28T23:07:41.147 INFO:tasks.workunit.client.1.smithi184.stdout:0/732: mknod d0/d1f/de3/d95/cfa 0 2024-02-28T23:07:41.149 INFO:tasks.workunit.client.1.smithi184.stdout:1/738: dwrite d20/d32/d4d/f7d [0,4194304] 0 2024-02-28T23:07:41.149 INFO:tasks.workunit.client.1.smithi184.stdout:2/649: getdents d10/d55/d89/db5 0 2024-02-28T23:07:41.154 INFO:tasks.workunit.client.1.smithi184.stdout:6/629: creat dc/fca x:0 0 0 2024-02-28T23:07:41.155 INFO:tasks.workunit.client.1.smithi184.stdout:5/685: write db/d12/d1c/d21/d4d/f56 [1469097,93222] 0 2024-02-28T23:07:41.165 INFO:tasks.workunit.client.1.smithi184.stdout:3/726: unlink d1/d4/d5/d40/c7e 0 2024-02-28T23:07:41.169 INFO:tasks.workunit.client.1.smithi184.stdout:3/727: chown d1/d4/d1c/d62/d66/dd3/d26/dd2 32280 1 2024-02-28T23:07:41.169 INFO:tasks.workunit.client.1.smithi184.stdout:8/709: mknod d1/da/d33/dac/dc5/c102 0 2024-02-28T23:07:41.175 INFO:tasks.workunit.client.1.smithi184.stdout:9/689: rename d5/d17/d8f/cca to d5/db/de/d10/d12/cd8 0 2024-02-28T23:07:41.176 INFO:tasks.workunit.client.1.smithi184.stdout:1/739: symlink d20/lfb 0 2024-02-28T23:07:41.178 INFO:tasks.workunit.client.1.smithi184.stdout:8/710: creat d1/da/dc/dc9/f103 x:0 0 0 2024-02-28T23:07:41.182 INFO:tasks.workunit.client.1.smithi184.stdout:4/665: creat d1/dc/df/d22/fce x:0 0 0 2024-02-28T23:07:41.184 INFO:tasks.workunit.client.1.smithi184.stdout:0/733: link d0/df/d13/d27/d31/d5b/d8e/d92/dac/fe9 d0/df/d13/d27/d31/d5b/d8e/d92/ffb 0 2024-02-28T23:07:41.186 INFO:tasks.workunit.client.1.smithi184.stdout:3/728: dwrite d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/f7d [4194304,4194304] 0 2024-02-28T23:07:41.190 INFO:tasks.workunit.client.1.smithi184.stdout:9/690: creat d5/db/de/d10/dc9/fd9 x:0 0 0 2024-02-28T23:07:41.190 INFO:tasks.workunit.client.0.smithi159.stdout:6/966: sync 2024-02-28T23:07:41.192 INFO:tasks.workunit.client.1.smithi184.stdout:1/740: read - d20/d32/d3e/f7a zero size 2024-02-28T23:07:41.194 INFO:tasks.workunit.client.1.smithi184.stdout:1/741: read - d20/d46/fcc zero size 2024-02-28T23:07:41.195 INFO:tasks.workunit.client.1.smithi184.stdout:8/711: symlink d1/da/dc/d16/d32/d42/d77/l104 0 2024-02-28T23:07:41.198 INFO:tasks.workunit.client.1.smithi184.stdout:7/647: sync 2024-02-28T23:07:41.202 INFO:tasks.workunit.client.1.smithi184.stdout:0/734: fdatasync d0/df/d13/d27/d31/db3/f66 0 2024-02-28T23:07:41.204 INFO:tasks.workunit.client.1.smithi184.stdout:0/735: readlink d0/d7c/d8a/lf3 0 2024-02-28T23:07:41.204 INFO:tasks.workunit.client.1.smithi184.stdout:3/729: rmdir d1/d4/d1c/d62/d66/dd3/d24 39 2024-02-28T23:07:41.208 INFO:tasks.workunit.client.1.smithi184.stdout:2/650: rename d10/d1f/d21/d5e/d15/d60/d66/dc6/cac to d10/d1f/d21/d5e/dad/dc7/ccd 0 2024-02-28T23:07:41.208 INFO:tasks.workunit.client.1.smithi184.stdout:9/691: dwrite d5/db/de/d10/d12/fb7 [0,4194304] 0 2024-02-28T23:07:41.208 INFO:tasks.workunit.client.1.smithi184.stdout:0/736: dread d0/df/d13/d27/f2c [0,4194304] 0 2024-02-28T23:07:41.212 INFO:tasks.workunit.client.0.smithi159.stdout:2/916: mknod d9/d50/d54/d84/d113/d12b/c13b 0 2024-02-28T23:07:41.213 INFO:tasks.workunit.client.1.smithi184.stdout:6/630: dwrite dc/de/d2a/d5c/d6e/fa4 [0,4194304] 0 2024-02-28T23:07:41.214 INFO:tasks.workunit.client.1.smithi184.stdout:2/651: truncate d10/d1f/d21/fbb 1023556 0 2024-02-28T23:07:41.215 INFO:tasks.workunit.client.0.smithi159.stdout:9/954: creat d4/d3d/d3e/dad/f130 x:0 0 0 2024-02-28T23:07:41.216 INFO:tasks.workunit.client.1.smithi184.stdout:6/631: dread - dc/de/d2a/d5c/d79/d87/fa7 zero size 2024-02-28T23:07:41.217 INFO:tasks.workunit.client.0.smithi159.stdout:9/955: stat d4/d3d/d3e/d6e/fd4 0 2024-02-28T23:07:41.217 INFO:tasks.workunit.client.1.smithi184.stdout:9/692: dread d5/db/de/f74 [0,4194304] 0 2024-02-28T23:07:41.224 INFO:tasks.workunit.client.0.smithi159.stdout:3/915: sync 2024-02-28T23:07:41.224 INFO:tasks.workunit.client.0.smithi159.stdout:7/810: sync 2024-02-28T23:07:41.226 INFO:tasks.workunit.client.0.smithi159.stdout:7/811: chown d5/d16/d1a/da0/cb0 17084 1 2024-02-28T23:07:41.230 INFO:tasks.workunit.client.1.smithi184.stdout:5/686: dwrite db/d12/d18/d2e/d3c/f83 [0,4194304] 0 2024-02-28T23:07:41.233 INFO:tasks.workunit.client.1.smithi184.stdout:4/666: write d1/dc/df/d27/f79 [1332852,105987] 0 2024-02-28T23:07:41.233 INFO:tasks.workunit.client.1.smithi184.stdout:1/742: mkdir d20/d32/d3e/d82/d85/dfc 0 2024-02-28T23:07:41.237 INFO:tasks.workunit.client.0.smithi159.stdout:6/967: rmdir d0/d1b/d33/d8c/d136 0 2024-02-28T23:07:41.237 INFO:tasks.workunit.client.1.smithi184.stdout:2/652: truncate d10/d1f/d21/d4d/f72 195926 0 2024-02-28T23:07:41.238 INFO:tasks.workunit.client.0.smithi159.stdout:9/956: truncate d4/d76/fa8 909668 0 2024-02-28T23:07:41.239 INFO:tasks.workunit.client.1.smithi184.stdout:8/712: fdatasync d1/da/dc/d16/d32/f9f 0 2024-02-28T23:07:41.243 INFO:tasks.workunit.client.1.smithi184.stdout:6/632: unlink dc/de/d2a/d5c/d79/d87/fa7 0 2024-02-28T23:07:41.244 INFO:tasks.workunit.client.1.smithi184.stdout:7/648: symlink d6/le1 0 2024-02-28T23:07:41.246 INFO:tasks.workunit.client.0.smithi159.stdout:6/968: fsync d0/d1b/d33/d11/d34/d9d/fee 0 2024-02-28T23:07:41.250 INFO:tasks.workunit.client.0.smithi159.stdout:6/969: write d0/d1b/d33/d11/d34/d9d/da2/dbf/f130 [361404,37824] 0 2024-02-28T23:07:41.250 INFO:tasks.workunit.client.1.smithi184.stdout:0/737: symlink d0/d1d/d3a/de5/lfc 0 2024-02-28T23:07:41.254 INFO:tasks.workunit.client.0.smithi159.stdout:7/812: creat d5/d16/d1a/d27/d46/f103 x:0 0 0 2024-02-28T23:07:41.254 INFO:tasks.workunit.client.1.smithi184.stdout:0/738: chown d0/df/d13/d27/d31/d5b/d8e/d92/fc1 1183444670 1 2024-02-28T23:07:41.255 INFO:tasks.workunit.client.0.smithi159.stdout:2/917: write d9/d50/faa [348533,122921] 0 2024-02-28T23:07:41.257 INFO:tasks.workunit.client.0.smithi159.stdout:7/813: read d5/d56/fe4 [486275,32918] 0 2024-02-28T23:07:41.260 INFO:tasks.workunit.client.0.smithi159.stdout:9/957: mkdir d4/d3d/d3e/d55/d10b/d131 0 2024-02-28T23:07:41.261 INFO:tasks.workunit.client.0.smithi159.stdout:5/972: dwrite d8/d19/d23/d35/d65/fc9 [0,4194304] 0 2024-02-28T23:07:41.264 INFO:tasks.workunit.client.1.smithi184.stdout:3/730: rename d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/f7d to d1/d4/d1c/d62/d66/dd3/d26/fe4 0 2024-02-28T23:07:41.266 INFO:tasks.workunit.client.1.smithi184.stdout:4/667: mknod d1/dc/df/d3b/d8f/ccf 0 2024-02-28T23:07:41.270 INFO:tasks.workunit.client.0.smithi159.stdout:2/918: mknod d9/d50/d62/dce/c13c 0 2024-02-28T23:07:41.271 INFO:tasks.workunit.client.1.smithi184.stdout:2/653: symlink d10/d55/lce 0 2024-02-28T23:07:41.272 INFO:tasks.workunit.client.1.smithi184.stdout:2/654: dread - d10/d33/fc9 zero size 2024-02-28T23:07:41.274 INFO:tasks.workunit.client.1.smithi184.stdout:2/655: chown d10/d1f/d21/d4d/d67/c78 3060058 1 2024-02-28T23:07:41.275 INFO:tasks.workunit.client.1.smithi184.stdout:8/713: rmdir d1/da/dc/d16/d32/d42 39 2024-02-28T23:07:41.279 INFO:tasks.workunit.client.1.smithi184.stdout:6/633: rmdir dc/d60/d62/d6f 39 2024-02-28T23:07:41.279 INFO:tasks.workunit.client.1.smithi184.stdout:8/714: write d1/da/dc/dc9/f103 [994117,105695] 0 2024-02-28T23:07:41.280 INFO:tasks.workunit.client.1.smithi184.stdout:0/739: truncate d0/df/d13/f97 4086137 0 2024-02-28T23:07:41.281 INFO:tasks.workunit.client.0.smithi159.stdout:7/814: truncate d5/d16/f5f 2786070 0 2024-02-28T23:07:41.281 INFO:tasks.workunit.client.0.smithi159.stdout:6/970: mkdir d0/d1b/d33/d11/d34/d9d/da2/dcf/d12a/d13c 0 2024-02-28T23:07:41.283 INFO:tasks.workunit.client.1.smithi184.stdout:5/687: mkdir db/d12/d50/ddc 0 2024-02-28T23:07:41.283 INFO:tasks.workunit.client.1.smithi184.stdout:0/740: read - d0/df/d13/d27/d31/d5b/d8e/d91/d71/fc6 zero size 2024-02-28T23:07:41.285 INFO:tasks.workunit.client.0.smithi159.stdout:7/815: write d5/d16/d40/f4e [3856869,28350] 0 2024-02-28T23:07:41.292 INFO:tasks.workunit.client.1.smithi184.stdout:1/743: mknod d20/d32/d3e/d61/d8b/cfd 0 2024-02-28T23:07:41.294 INFO:tasks.workunit.client.0.smithi159.stdout:2/919: creat d9/d50/d123/f13d x:0 0 0 2024-02-28T23:07:41.294 INFO:tasks.workunit.client.1.smithi184.stdout:9/693: creat d5/d47/fda x:0 0 0 2024-02-28T23:07:41.295 INFO:tasks.workunit.client.0.smithi159.stdout:9/958: dwrite d4/d3d/d3e/f113 [0,4194304] 0 2024-02-28T23:07:41.297 INFO:tasks.workunit.client.0.smithi159.stdout:6/971: rename d0/f7 to d0/d1b/d33/d11/d34/d9d/da2/db7/db1/f13d 0 2024-02-28T23:07:41.299 INFO:tasks.workunit.client.0.smithi159.stdout:2/920: chown d9/d50/d62/dce/c13c 14840 1 2024-02-28T23:07:41.300 INFO:tasks.workunit.client.0.smithi159.stdout:7/816: mknod d5/d16/d1a/d27/d46/d101/d64/db4/dc8/c104 0 2024-02-28T23:07:41.304 INFO:tasks.workunit.client.1.smithi184.stdout:2/656: mkdir d10/d1f/d21/d5e/d15/d60/d66/dc6/dcf 0 2024-02-28T23:07:41.304 INFO:tasks.workunit.client.1.smithi184.stdout:3/731: dwrite d1/d4/d1c/d62/d66/dd3/d24/d76/fc2 [0,4194304] 0 2024-02-28T23:07:41.305 INFO:tasks.workunit.client.1.smithi184.stdout:6/634: read - dc/de/d2a/f7b zero size 2024-02-28T23:07:41.307 INFO:tasks.workunit.client.1.smithi184.stdout:5/688: symlink db/d12/d1c/d21/d2f/dc4/ldd 0 2024-02-28T23:07:41.310 INFO:tasks.workunit.client.1.smithi184.stdout:0/741: mkdir d0/d1f/de3/dfd 0 2024-02-28T23:07:41.311 INFO:tasks.workunit.client.1.smithi184.stdout:2/657: dread d10/d1f/f8d [0,4194304] 0 2024-02-28T23:07:41.317 INFO:tasks.workunit.client.0.smithi159.stdout:7/817: read d5/d16/d1a/d27/d46/d65/d81/d83/f8a [1738905,69290] 0 2024-02-28T23:07:41.319 INFO:tasks.workunit.client.0.smithi159.stdout:2/921: dread d9/d50/d62/fdd [0,4194304] 0 2024-02-28T23:07:41.320 INFO:tasks.workunit.client.0.smithi159.stdout:7/818: chown d5/f9b 0 1 2024-02-28T23:07:41.320 INFO:tasks.workunit.client.0.smithi159.stdout:7/819: readlink d5/l8 0 2024-02-28T23:07:41.321 INFO:tasks.workunit.client.1.smithi184.stdout:1/744: chown d20/d32/c3d 45556061 1 2024-02-28T23:07:41.324 INFO:tasks.workunit.client.1.smithi184.stdout:1/745: write d20/d46/fcd [72810,70683] 0 2024-02-28T23:07:41.324 INFO:tasks.workunit.client.1.smithi184.stdout:9/694: fsync d5/d26/d50/f35 0 2024-02-28T23:07:41.325 INFO:tasks.workunit.client.1.smithi184.stdout:1/746: chown d20/d32/d3e/d61/d8b/c8d 452515854 1 2024-02-28T23:07:41.332 INFO:tasks.workunit.client.0.smithi159.stdout:5/973: dwrite d8/d19/d23/d35/d41/daa/d88/f10f [0,4194304] 0 2024-02-28T23:07:41.334 INFO:tasks.workunit.client.0.smithi159.stdout:5/974: fdatasync d8/d16/fb2 0 2024-02-28T23:07:41.336 INFO:tasks.workunit.client.1.smithi184.stdout:7/649: rename d6/d9/d13/d3e/dad/d7d/d6c/cb4 to d6/d9/d13/d3e/dad/d49/da6/daf/ce2 0 2024-02-28T23:07:41.338 INFO:tasks.workunit.client.1.smithi184.stdout:3/732: creat d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/dc1/fe5 x:0 0 0 2024-02-28T23:07:41.339 INFO:tasks.workunit.client.0.smithi159.stdout:2/922: creat d9/d50/d62/dce/d136/f13e x:0 0 0 2024-02-28T23:07:41.341 INFO:tasks.workunit.client.1.smithi184.stdout:1/747: dwrite f19 [0,4194304] 0 2024-02-28T23:07:41.342 INFO:tasks.workunit.client.1.smithi184.stdout:3/733: write d1/d4/d1c/d62/fa3 [2723985,6126] 0 2024-02-28T23:07:41.343 INFO:tasks.workunit.client.1.smithi184.stdout:1/748: readlink d20/d32/l77 0 2024-02-28T23:07:41.344 INFO:tasks.workunit.client.0.smithi159.stdout:9/959: write d4/d3d/d3e/d55/f2e [360846,52075] 0 2024-02-28T23:07:41.345 INFO:tasks.workunit.client.1.smithi184.stdout:3/734: chown d1/d4/c41 40077 1 2024-02-28T23:07:41.345 INFO:tasks.workunit.client.0.smithi159.stdout:6/972: write d0/d1b/d33/d3f/fe0 [2440812,45194] 0 2024-02-28T23:07:41.347 INFO:tasks.workunit.client.1.smithi184.stdout:3/735: fsync d1/d4/d5/da9/d74/fbd 0 2024-02-28T23:07:41.347 INFO:tasks.workunit.client.1.smithi184.stdout:2/658: mknod d10/d1f/d21/d5e/dad/dc7/cd0 0 2024-02-28T23:07:41.350 INFO:tasks.workunit.client.0.smithi159.stdout:6/973: write d0/d1b/d33/d11/d34/d9d/da2/d4d/f58 [1590544,6229] 0 2024-02-28T23:07:41.351 INFO:tasks.workunit.client.1.smithi184.stdout:2/659: truncate d10/d1f/d21/d5e/fbd 382794 0 2024-02-28T23:07:41.358 INFO:tasks.workunit.client.1.smithi184.stdout:8/715: mknod d1/da/d10/d17/d63/c105 0 2024-02-28T23:07:41.361 INFO:tasks.workunit.client.0.smithi159.stdout:6/974: creat d0/d1b/dc4/f13e x:0 0 0 2024-02-28T23:07:41.363 INFO:tasks.workunit.client.1.smithi184.stdout:7/650: creat d6/d9/d13/d3e/dad/d49/da6/fe3 x:0 0 0 2024-02-28T23:07:41.365 INFO:tasks.workunit.client.0.smithi159.stdout:6/975: mkdir d0/d1b/dc5/d13f 0 2024-02-28T23:07:41.366 INFO:tasks.workunit.client.1.smithi184.stdout:1/749: mknod d20/d32/d4d/cfe 0 2024-02-28T23:07:41.367 INFO:tasks.workunit.client.1.smithi184.stdout:3/736: creat d1/d4/d1c/d61/fe6 x:0 0 0 2024-02-28T23:07:41.369 INFO:tasks.workunit.client.1.smithi184.stdout:4/668: getdents d1/dc/df/d5b/db2/d9f 0 2024-02-28T23:07:41.371 INFO:tasks.workunit.client.0.smithi159.stdout:7/820: dwrite d5/d56/d2a/f4d [0,4194304] 0 2024-02-28T23:07:41.371 INFO:tasks.workunit.client.0.smithi159.stdout:6/976: unlink d0/d1b/d33/c13 0 2024-02-28T23:07:41.378 INFO:tasks.workunit.client.0.smithi159.stdout:9/960: write d4/d3d/d3e/d55/d37/d62/d77/fa9 [1381357,69735] 0 2024-02-28T23:07:41.380 INFO:tasks.workunit.client.0.smithi159.stdout:6/977: symlink d0/d6d/l140 0 2024-02-28T23:07:41.382 INFO:tasks.workunit.client.1.smithi184.stdout:9/695: dwrite d5/d17/d8f/f98 [0,4194304] 0 2024-02-28T23:07:41.385 INFO:tasks.workunit.client.0.smithi159.stdout:7/821: rmdir d5/d16/d1a/d27/deb 39 2024-02-28T23:07:41.388 INFO:tasks.workunit.client.1.smithi184.stdout:1/750: mkdir d20/d46/d90/dff 0 2024-02-28T23:07:41.388 INFO:tasks.workunit.client.1.smithi184.stdout:3/737: symlink d1/d4/d1c/d61/le7 0 2024-02-28T23:07:41.389 INFO:tasks.workunit.client.0.smithi159.stdout:5/975: dwrite d8/d19/d23/d35/fc2 [0,4194304] 0 2024-02-28T23:07:41.389 INFO:tasks.workunit.client.0.smithi159.stdout:9/961: dread - d4/d3d/d3e/d55/d4c/d4e/d6b/db5/fdb zero size 2024-02-28T23:07:41.390 INFO:tasks.workunit.client.1.smithi184.stdout:8/716: mknod d1/da/d10/c106 0 2024-02-28T23:07:41.390 INFO:tasks.workunit.client.0.smithi159.stdout:2/923: dread d9/d23/d2c/d55/fee [0,4194304] 0 2024-02-28T23:07:41.392 INFO:tasks.workunit.client.1.smithi184.stdout:8/717: chown d1/da/dc/d18/l75 1 1 2024-02-28T23:07:41.395 INFO:tasks.workunit.client.0.smithi159.stdout:6/978: creat d0/d1b/d33/d11/d34/d9d/da2/db7/db1/f141 x:0 0 0 2024-02-28T23:07:41.396 INFO:tasks.workunit.client.0.smithi159.stdout:2/924: read - d9/d50/dcc/d44/fe4 zero size 2024-02-28T23:07:41.398 INFO:tasks.workunit.client.0.smithi159.stdout:6/979: chown d0/d1b/d33/f18 51769 1 2024-02-28T23:07:41.398 INFO:tasks.workunit.client.1.smithi184.stdout:9/696: mknod d5/db/d65/dc2/cdb 0 2024-02-28T23:07:41.399 INFO:tasks.workunit.client.1.smithi184.stdout:6/635: dread dc/d60/d6d/f83 [0,4194304] 0 2024-02-28T23:07:41.403 INFO:tasks.workunit.client.1.smithi184.stdout:4/669: mkdir d1/d9a/dd0 0 2024-02-28T23:07:41.405 INFO:tasks.workunit.client.0.smithi159.stdout:5/976: truncate d8/d19/d23/d35/d38/fa7 887660 0 2024-02-28T23:07:41.407 INFO:tasks.workunit.client.1.smithi184.stdout:3/738: mkdir d1/d4/d1c/d62/de8 0 2024-02-28T23:07:41.415 INFO:tasks.workunit.client.1.smithi184.stdout:7/651: write d6/d9/d13/d1e/d2f/d33/d80/fa5 [527586,100716] 0 2024-02-28T23:07:41.415 INFO:tasks.workunit.client.0.smithi159.stdout:9/962: symlink d4/d3d/d3e/d55/d10b/d131/l132 0 2024-02-28T23:07:41.415 INFO:tasks.workunit.client.0.smithi159.stdout:9/963: chown d4/d3d 264 1 2024-02-28T23:07:41.416 INFO:tasks.workunit.client.1.smithi184.stdout:1/751: dread d20/d32/d4d/f81 [0,4194304] 0 2024-02-28T23:07:41.416 INFO:tasks.workunit.client.0.smithi159.stdout:2/925: symlink d9/d23/d2c/d55/l13f 0 2024-02-28T23:07:41.418 INFO:tasks.workunit.client.0.smithi159.stdout:5/977: mkdir d8/d19/d23/d35/d41/d77/dfd/d155 0 2024-02-28T23:07:41.419 INFO:tasks.workunit.client.1.smithi184.stdout:3/739: dread d1/d4/d5/f9c [0,4194304] 0 2024-02-28T23:07:41.420 INFO:tasks.workunit.client.1.smithi184.stdout:4/670: unlink d1/d8/d19/fad 0 2024-02-28T23:07:41.423 INFO:tasks.workunit.client.1.smithi184.stdout:7/652: dread d6/d9/d13/d3e/dad/d49/d50/f61 [0,4194304] 0 2024-02-28T23:07:41.428 INFO:tasks.workunit.client.0.smithi159.stdout:2/926: symlink d9/d80/l140 0 2024-02-28T23:07:41.429 INFO:tasks.workunit.client.1.smithi184.stdout:9/697: creat d5/d17/d43/db8/fdc x:0 0 0 2024-02-28T23:07:41.432 INFO:tasks.workunit.client.1.smithi184.stdout:9/698: chown d5/db/l56 0 1 2024-02-28T23:07:41.432 INFO:tasks.workunit.client.0.smithi159.stdout:6/980: write d0/d1b/d33/d11/d34/f12b [4022237,129651] 0 2024-02-28T23:07:41.433 INFO:tasks.workunit.client.1.smithi184.stdout:5/689: sync 2024-02-28T23:07:41.435 INFO:tasks.workunit.client.0.smithi159.stdout:5/978: mknod d8/d19/d23/d35/d65/da3/dd2/dd7/c156 0 2024-02-28T23:07:41.440 INFO:tasks.workunit.client.0.smithi159.stdout:7/822: dwrite d5/d16/d1a/d27/d46/d65/d81/d83/f8a [4194304,4194304] 0 2024-02-28T23:07:41.440 INFO:tasks.workunit.client.1.smithi184.stdout:6/636: symlink dc/d60/d62/lcb 0 2024-02-28T23:07:41.441 INFO:tasks.workunit.client.1.smithi184.stdout:4/671: creat d1/d8/d37/fd1 x:0 0 0 2024-02-28T23:07:41.441 INFO:tasks.workunit.client.0.smithi159.stdout:2/927: symlink d9/l141 0 2024-02-28T23:07:41.442 INFO:tasks.workunit.client.1.smithi184.stdout:3/740: write d1/d4/d1c/d62/d66/dd3/f2b [3110107,70933] 0 2024-02-28T23:07:41.448 INFO:tasks.workunit.client.1.smithi184.stdout:0/742: dread d0/df/d13/f29 [0,4194304] 0 2024-02-28T23:07:41.449 INFO:tasks.workunit.client.0.smithi159.stdout:9/964: dwrite d4/d3d/d3e/d55/d9e/dfc/dea/ffd [0,4194304] 0 2024-02-28T23:07:41.449 INFO:tasks.workunit.client.1.smithi184.stdout:7/653: mknod d6/d9/d13/d1e/d2f/d33/d80/ce4 0 2024-02-28T23:07:41.457 INFO:tasks.workunit.client.1.smithi184.stdout:1/752: symlink d20/l100 0 2024-02-28T23:07:41.457 INFO:tasks.workunit.client.1.smithi184.stdout:4/672: dwrite d1/f33 [0,4194304] 0 2024-02-28T23:07:41.458 INFO:tasks.workunit.client.0.smithi159.stdout:2/928: creat d9/d50/d62/dce/f142 x:0 0 0 2024-02-28T23:07:41.458 INFO:tasks.workunit.client.0.smithi159.stdout:5/979: truncate d8/d19/d23/d35/d65/da3/df4/da5/d90/fa8 512600 0 2024-02-28T23:07:41.459 INFO:tasks.workunit.client.0.smithi159.stdout:5/980: stat d8/d19/l2c 0 2024-02-28T23:07:41.468 INFO:tasks.workunit.client.0.smithi159.stdout:5/981: unlink d8/d19/d23/d35/d41/c14d 0 2024-02-28T23:07:41.471 INFO:tasks.workunit.client.0.smithi159.stdout:6/981: dwrite d0/d1b/d33/d3f/d44/fc0 [0,4194304] 0 2024-02-28T23:07:41.473 INFO:tasks.workunit.client.1.smithi184.stdout:3/741: rename d1/d4/l4e to d1/d4/d5/da9/d74/dcd/le9 0 2024-02-28T23:07:41.474 INFO:tasks.workunit.client.1.smithi184.stdout:3/742: dread - d1/d4/d1c/d62/d66/dd3/d24/dd5/fda zero size 2024-02-28T23:07:41.479 INFO:tasks.workunit.client.0.smithi159.stdout:5/982: chown d8/d19/d23/d35/d41/daa/fc5 5 1 2024-02-28T23:07:41.482 INFO:tasks.workunit.client.0.smithi159.stdout:2/929: rename d9/d23/d2c/d55/fcf to d9/d50/d54/d84/f143 0 2024-02-28T23:07:41.485 INFO:tasks.workunit.client.0.smithi159.stdout:7/823: write d5/d16/d1a/d27/d46/d101/d64/f79 [1833058,95646] 0 2024-02-28T23:07:41.485 INFO:tasks.workunit.client.0.smithi159.stdout:7/824: stat d5/d56/d50/d5b 0 2024-02-28T23:07:41.486 INFO:tasks.workunit.client.1.smithi184.stdout:3/743: dread d1/d4/d5/da9/f77 [0,4194304] 0 2024-02-28T23:07:41.488 INFO:tasks.workunit.client.1.smithi184.stdout:8/718: rmdir d1/da/dc/d16/d32/d42/d77/ddd/de9 0 2024-02-28T23:07:41.495 INFO:tasks.workunit.client.0.smithi159.stdout:2/930: dread d9/d36/dc3/fdb [0,4194304] 0 2024-02-28T23:07:41.495 INFO:tasks.workunit.client.1.smithi184.stdout:4/673: dread d1/d8/f5a [0,4194304] 0 2024-02-28T23:07:41.497 INFO:tasks.workunit.client.0.smithi159.stdout:2/931: dread - d9/d50/d62/dce/d136/f13e zero size 2024-02-28T23:07:41.497 INFO:tasks.workunit.client.0.smithi159.stdout:9/965: getdents d4/d3d/d3e/d55/d4c/dee 0 2024-02-28T23:07:41.498 INFO:tasks.workunit.client.1.smithi184.stdout:4/674: read - d1/dc/df/d3b/d5c/f7b zero size 2024-02-28T23:07:41.498 INFO:tasks.workunit.client.0.smithi159.stdout:9/966: chown d4/lf6 19 1 2024-02-28T23:07:41.500 INFO:tasks.workunit.client.1.smithi184.stdout:4/675: truncate d1/d4/d43/d73/fc6 413769 0 2024-02-28T23:07:41.500 INFO:tasks.workunit.client.1.smithi184.stdout:4/676: fdatasync d1/d8/d19/d67/d99/faa 0 2024-02-28T23:07:41.501 INFO:tasks.workunit.client.0.smithi159.stdout:7/825: rename d5/d56/fe4 to d5/d16/d1a/d27/d37/dcd/f105 0 2024-02-28T23:07:41.502 INFO:tasks.workunit.client.0.smithi159.stdout:7/826: chown d5/d16/d1a/d27/d75/cc1 1864523 1 2024-02-28T23:07:41.502 INFO:tasks.workunit.client.1.smithi184.stdout:5/690: unlink db/d12/d18/d2e/d3c/d5d/d66/l97 0 2024-02-28T23:07:41.503 INFO:tasks.workunit.client.1.smithi184.stdout:2/660: sync 2024-02-28T23:07:41.504 INFO:tasks.workunit.client.1.smithi184.stdout:6/637: symlink dc/de/d2a/d8e/dad/d8a/lcc 0 2024-02-28T23:07:41.505 INFO:tasks.workunit.client.1.smithi184.stdout:6/638: readlink dc/de/d2a/l5e 0 2024-02-28T23:07:41.506 INFO:tasks.workunit.client.1.smithi184.stdout:6/639: dread - dc/de/d2a/d5c/d79/d87/f9f zero size 2024-02-28T23:07:41.508 INFO:tasks.workunit.client.0.smithi159.stdout:9/967: unlink d4/d3d/f5b 0 2024-02-28T23:07:41.512 INFO:tasks.workunit.client.0.smithi159.stdout:2/932: read d9/d50/d54/d84/f3b [1232096,98160] 0 2024-02-28T23:07:41.522 INFO:tasks.workunit.client.1.smithi184.stdout:1/753: fsync d20/d32/ff8 0 2024-02-28T23:07:41.526 INFO:tasks.workunit.client.1.smithi184.stdout:7/654: write d6/d9/d13/d1e/f21 [145472,36847] 0 2024-02-28T23:07:41.527 INFO:tasks.workunit.client.0.smithi159.stdout:2/933: creat d9/d50/dcc/d44/dc0/f144 x:0 0 0 2024-02-28T23:07:41.528 INFO:tasks.workunit.client.1.smithi184.stdout:9/699: rmdir d5/db/de/d10/d12/d2f/d3f/dbe 0 2024-02-28T23:07:41.529 INFO:tasks.workunit.client.1.smithi184.stdout:7/655: chown d6/d9/d13/d3e/dad/d7d/d8d/ld9 1 1 2024-02-28T23:07:41.531 INFO:tasks.workunit.client.0.smithi159.stdout:5/983: getdents d8/d19/d23/d35/d65/da3/dd2/def/d11f 0 2024-02-28T23:07:41.535 INFO:tasks.workunit.client.1.smithi184.stdout:5/691: symlink db/d12/d1c/d9b/lde 0 2024-02-28T23:07:41.536 INFO:tasks.workunit.client.0.smithi159.stdout:9/968: getdents d4/d3d/d3e/d55/d4c/d4e/d6b/db5/d106 0 2024-02-28T23:07:41.538 INFO:tasks.workunit.client.1.smithi184.stdout:5/692: write db/d12/d1c/d21/d2f/f4e [2714312,24622] 0 2024-02-28T23:07:41.539 INFO:tasks.workunit.client.0.smithi159.stdout:2/934: symlink d9/d80/l145 0 2024-02-28T23:07:41.550 INFO:tasks.workunit.client.1.smithi184.stdout:2/661: dread d10/d1f/d21/d5e/d15/f2b [0,4194304] 0 2024-02-28T23:07:41.551 INFO:tasks.workunit.client.0.smithi159.stdout:5/984: dwrite d8/d19/d23/d35/fc2 [0,4194304] 0 2024-02-28T23:07:41.552 INFO:tasks.workunit.client.0.smithi159.stdout:9/969: rmdir d4/d3d 39 2024-02-28T23:07:41.555 INFO:tasks.workunit.client.0.smithi159.stdout:2/935: mknod d9/d50/d54/d84/d113/c146 0 2024-02-28T23:07:41.556 INFO:tasks.workunit.client.1.smithi184.stdout:6/640: write dc/d60/d7c/d90/fa6 [74335,62629] 0 2024-02-28T23:07:41.557 INFO:tasks.workunit.client.1.smithi184.stdout:3/744: mknod d1/d4/cea 0 2024-02-28T23:07:41.557 INFO:tasks.workunit.client.0.smithi159.stdout:2/936: readlink d9/d50/d62/l9b 0 2024-02-28T23:07:41.559 INFO:tasks.workunit.client.1.smithi184.stdout:1/754: truncate d20/d46/fbb 586335 0 2024-02-28T23:07:41.562 INFO:tasks.workunit.client.1.smithi184.stdout:6/641: write dc/d60/faa [729040,3182] 0 2024-02-28T23:07:41.564 INFO:tasks.workunit.client.1.smithi184.stdout:9/700: mknod d5/db/de/d10/d12/d2f/d3f/d8d/cdd 0 2024-02-28T23:07:41.566 INFO:tasks.workunit.client.1.smithi184.stdout:6/642: truncate dc/f75 750577 0 2024-02-28T23:07:41.570 INFO:tasks.workunit.client.0.smithi159.stdout:5/985: creat d8/d19/d23/d35/d41/d92/d10c/dff/d142/f157 x:0 0 0 2024-02-28T23:07:41.570 INFO:tasks.workunit.client.0.smithi159.stdout:9/970: write d4/d3d/d3e/d55/d4c/d4e/dbe/f112 [449241,106159] 0 2024-02-28T23:07:41.570 INFO:tasks.workunit.client.0.smithi159.stdout:7/827: dwrite d5/d16/d1a/d27/d37/dcd/f105 [0,4194304] 0 2024-02-28T23:07:41.571 INFO:tasks.workunit.client.1.smithi184.stdout:0/743: getdents d0/d1d/d3a 0 2024-02-28T23:07:41.588 INFO:tasks.workunit.client.1.smithi184.stdout:8/719: link d1/da/dc/d16/d32/d42/d77/f85 d1/da/dc/d16/f107 0 2024-02-28T23:07:41.591 INFO:tasks.workunit.client.0.smithi159.stdout:9/971: creat d4/d3d/d3e/d55/d37/d62/d77/db9/d121/f133 x:0 0 0 2024-02-28T23:07:41.592 INFO:tasks.workunit.client.1.smithi184.stdout:8/720: rename d1/da/dc/d16/d4d to d1/da/dc/d16/d4d/d8a/d108 22 2024-02-28T23:07:41.596 INFO:tasks.workunit.client.1.smithi184.stdout:4/677: getdents d1/d4 0 2024-02-28T23:07:41.596 INFO:tasks.workunit.client.1.smithi184.stdout:1/755: mkdir d20/d32/d3e/d61/d8b/d101 0 2024-02-28T23:07:41.596 INFO:tasks.workunit.client.1.smithi184.stdout:5/693: write db/d12/d18/d2e/d3c/d5d/f4b [5126667,24086] 0 2024-02-28T23:07:41.599 INFO:tasks.workunit.client.1.smithi184.stdout:8/721: fdatasync d1/da/dc/fb6 0 2024-02-28T23:07:41.599 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:41 smithi184 ceph-mon[36198]: pgmap v39: 65 pgs: 65 active+clean; 3.3 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 92 MiB/s rd, 232 MiB/s wr, 520 op/s 2024-02-28T23:07:41.602 INFO:tasks.workunit.client.1.smithi184.stdout:0/744: creat d0/df/d13/ffe x:0 0 0 2024-02-28T23:07:41.602 INFO:tasks.workunit.client.1.smithi184.stdout:8/722: chown d1/da/dc/d16/d29/d7d/dfa 0 1 2024-02-28T23:07:41.602 INFO:tasks.workunit.client.1.smithi184.stdout:7/656: write d6/d9/da/f37 [4508412,18942] 0 2024-02-28T23:07:41.603 INFO:tasks.workunit.client.1.smithi184.stdout:4/678: mknod d1/dc/df/d3b/d5c/cd2 0 2024-02-28T23:07:41.604 INFO:tasks.workunit.client.1.smithi184.stdout:9/701: write d5/db/f7f [3648004,67427] 0 2024-02-28T23:07:41.606 INFO:tasks.workunit.client.1.smithi184.stdout:3/745: getdents d1 0 2024-02-28T23:07:41.607 INFO:tasks.workunit.client.1.smithi184.stdout:6/643: getdents dc/de/d2a/d8e 0 2024-02-28T23:07:41.610 INFO:tasks.workunit.client.1.smithi184.stdout:0/745: creat d0/df/fff x:0 0 0 2024-02-28T23:07:41.610 INFO:tasks.workunit.client.1.smithi184.stdout:2/662: dwrite d10/f1d [0,4194304] 0 2024-02-28T23:07:41.616 INFO:tasks.workunit.client.1.smithi184.stdout:0/746: write d0/df/d13/d27/d31/d5b/d8e/d92/fcc [3213244,23561] 0 2024-02-28T23:07:41.616 INFO:tasks.workunit.client.1.smithi184.stdout:5/694: getdents db/d12/d1c/d21/d4d 0 2024-02-28T23:07:41.617 INFO:tasks.workunit.client.0.smithi159.stdout:7/828: dread d5/d16/d1a/d27/d3e/f48 [0,4194304] 0 2024-02-28T23:07:41.617 INFO:tasks.workunit.client.1.smithi184.stdout:1/756: dwrite d20/f35 [0,4194304] 0 2024-02-28T23:07:41.618 INFO:tasks.workunit.client.1.smithi184.stdout:0/747: write d0/d1f/ff0 [769329,16635] 0 2024-02-28T23:07:41.620 INFO:tasks.workunit.client.1.smithi184.stdout:7/657: creat d6/d9/d13/d3e/dad/d49/d50/fe5 x:0 0 0 2024-02-28T23:07:41.626 INFO:tasks.workunit.client.0.smithi159.stdout:7/829: readlink d5/d16/d1a/d27/d75/dac/dbe/lc0 0 2024-02-28T23:07:41.628 INFO:tasks.workunit.client.1.smithi184.stdout:4/679: dwrite d1/d8/d35/fc0 [0,4194304] 0 2024-02-28T23:07:41.631 INFO:tasks.workunit.client.1.smithi184.stdout:4/680: dread - d1/d4/d43/fc2 zero size 2024-02-28T23:07:41.632 INFO:tasks.workunit.client.1.smithi184.stdout:5/695: mkdir db/d44/da5/ddf 0 2024-02-28T23:07:41.634 INFO:tasks.workunit.client.1.smithi184.stdout:4/681: chown d1/dc/df/d22/fce 1 1 2024-02-28T23:07:41.635 INFO:tasks.workunit.client.0.smithi159.stdout:5/986: dread d8/d19/d23/fdb [0,4194304] 0 2024-02-28T23:07:41.635 INFO:tasks.workunit.client.0.smithi159.stdout:9/972: dread d4/d3d/fe1 [0,4194304] 0 2024-02-28T23:07:41.640 INFO:tasks.workunit.client.1.smithi184.stdout:1/757: symlink d20/d32/d3e/dc9/l102 0 2024-02-28T23:07:41.640 INFO:tasks.workunit.client.0.smithi159.stdout:5/987: readlink d8/d19/d23/d35/d41/daa/l85 0 2024-02-28T23:07:41.643 INFO:tasks.workunit.client.0.smithi159.stdout:7/830: mknod d5/c106 0 2024-02-28T23:07:41.646 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:41 smithi159 ceph-mon[28802]: pgmap v39: 65 pgs: 65 active+clean; 3.3 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 92 MiB/s rd, 232 MiB/s wr, 520 op/s 2024-02-28T23:07:41.648 INFO:tasks.workunit.client.0.smithi159.stdout:9/973: rename d4/d76 to d4/d3d/d3e/dad/d134 0 2024-02-28T23:07:41.651 INFO:tasks.workunit.client.1.smithi184.stdout:9/702: creat d5/d47/d68/fde x:0 0 0 2024-02-28T23:07:41.652 INFO:tasks.workunit.client.1.smithi184.stdout:8/723: dwrite d1/da/dc/d16/d29/d7d/fc3 [0,4194304] 0 2024-02-28T23:07:41.653 INFO:tasks.workunit.client.0.smithi159.stdout:9/974: chown d4/d3d/d3e/d55/c3a 144 1 2024-02-28T23:07:41.654 INFO:tasks.workunit.client.1.smithi184.stdout:2/663: mknod d10/d1f/d21/d5e/dad/da3/cd1 0 2024-02-28T23:07:41.657 INFO:tasks.workunit.client.1.smithi184.stdout:4/682: truncate d1/dc/df/d38/d57/f71 1445730 0 2024-02-28T23:07:41.657 INFO:tasks.workunit.client.1.smithi184.stdout:1/758: mkdir d20/d46/d90/db3/d103 0 2024-02-28T23:07:41.659 INFO:tasks.workunit.client.0.smithi159.stdout:5/988: getdents d8/d19/d23/d35/d38/d12d 0 2024-02-28T23:07:41.659 INFO:tasks.workunit.client.1.smithi184.stdout:5/696: read f8 [815161,92811] 0 2024-02-28T23:07:41.660 INFO:tasks.workunit.client.1.smithi184.stdout:3/746: rmdir d1/d4/d1c/d62/de8 0 2024-02-28T23:07:41.663 INFO:tasks.workunit.client.1.smithi184.stdout:5/697: stat db/d12/d1c/d80/l8b 0 2024-02-28T23:07:41.663 INFO:tasks.workunit.client.1.smithi184.stdout:5/698: truncate db/d12/d1c/d21/fb6 4564351 0 2024-02-28T23:07:41.667 INFO:tasks.workunit.client.0.smithi159.stdout:5/989: mknod d8/d19/d23/d12f/c158 0 2024-02-28T23:07:41.667 INFO:tasks.workunit.client.1.smithi184.stdout:9/703: fsync d5/d26/fb5 0 2024-02-28T23:07:41.667 INFO:tasks.workunit.client.1.smithi184.stdout:9/704: fsync d5/db/de/d10/d12/f2d 0 2024-02-28T23:07:41.670 INFO:tasks.workunit.client.0.smithi159.stdout:9/975: dread d4/d3d/d3e/d55/f46 [0,4194304] 0 2024-02-28T23:07:41.671 INFO:tasks.workunit.client.1.smithi184.stdout:2/664: mkdir d10/d1f/d38/d54/d96/dd2 0 2024-02-28T23:07:41.671 INFO:tasks.workunit.client.1.smithi184.stdout:0/748: creat d0/f100 x:0 0 0 2024-02-28T23:07:41.672 INFO:tasks.workunit.client.1.smithi184.stdout:2/665: chown d10/f18 897 1 2024-02-28T23:07:41.673 INFO:tasks.workunit.client.0.smithi159.stdout:5/990: fsync d8/f15 0 2024-02-28T23:07:41.674 INFO:tasks.workunit.client.1.smithi184.stdout:4/683: chown d1/d8/d19/d92/l61 1063208 1 2024-02-28T23:07:41.676 INFO:tasks.workunit.client.0.smithi159.stdout:9/976: read - d4/fae zero size 2024-02-28T23:07:41.678 INFO:tasks.workunit.client.1.smithi184.stdout:3/747: creat d1/d4/d1c/d62/d66/dd3/d26/feb x:0 0 0 2024-02-28T23:07:41.684 INFO:tasks.workunit.client.1.smithi184.stdout:5/699: creat db/d12/d18/fe0 x:0 0 0 2024-02-28T23:07:41.685 INFO:tasks.workunit.client.0.smithi159.stdout:5/991: truncate d8/d19/d23/d35/d41/fc6 964416 0 2024-02-28T23:07:41.685 INFO:tasks.workunit.client.1.smithi184.stdout:5/700: read - db/d12/d1c/d80/fb9 zero size 2024-02-28T23:07:41.686 INFO:tasks.workunit.client.1.smithi184.stdout:5/701: chown db/d12/l2d 34329764 1 2024-02-28T23:07:41.688 INFO:tasks.workunit.client.1.smithi184.stdout:5/702: chown db/d12/d18/d2e/f89 11497 1 2024-02-28T23:07:41.690 INFO:tasks.workunit.client.1.smithi184.stdout:6/644: getdents dc/de/d2a/d8e/dad/d8a 0 2024-02-28T23:07:41.691 INFO:tasks.workunit.client.0.smithi159.stdout:5/992: truncate d8/d16/d122/f32 579660 0 2024-02-28T23:07:41.691 INFO:tasks.workunit.client.1.smithi184.stdout:5/703: write db/d12/d18/d2e/fd2 [616874,6918] 0 2024-02-28T23:07:41.696 INFO:tasks.workunit.client.0.smithi159.stdout:9/977: rename d4/d3d/d3e/d55/d37/d62/lff to d4/de4/de3/l135 0 2024-02-28T23:07:41.696 INFO:tasks.workunit.client.1.smithi184.stdout:7/658: write d6/d9/d13/d3e/dad/d49/da6/daf/f69 [5547576,95522] 0 2024-02-28T23:07:41.722 INFO:tasks.workunit.client.1.smithi184.stdout:7/659: dread d6/d9/d13/d1e/d2f/d33/f36 [0,4194304] 0 2024-02-28T23:07:41.767 INFO:tasks.workunit.client.0.smithi159.stdout:3/916: sync 2024-02-28T23:07:41.784 INFO:tasks.workunit.client.1.smithi184.stdout:5/704: sync 2024-02-28T23:07:41.829 INFO:tasks.workunit.client.1.smithi184.stdout:5/705: dwrite db/d12/d18/d2e/fda [0,4194304] 0 2024-02-28T23:07:41.837 INFO:tasks.workunit.client.0.smithi159.stdout:6/982: sync 2024-02-28T23:07:41.847 INFO:tasks.workunit.client.0.smithi159.stdout:5/993: truncate d8/d19/d23/f56 4058752 0 2024-02-28T23:07:41.852 INFO:tasks.workunit.client.0.smithi159.stdout:6/983: dread d0/f8 [4194304,4194304] 0 2024-02-28T23:07:41.852 INFO:tasks.workunit.client.0.smithi159.stdout:9/978: creat d4/d3d/d3e/d55/d4c/db6/dd6/f136 x:0 0 0 2024-02-28T23:07:41.861 INFO:tasks.workunit.client.0.smithi159.stdout:6/984: stat d0/d6d/f6e 0 2024-02-28T23:07:41.864 INFO:tasks.workunit.client.0.smithi159.stdout:9/979: fsync d4/d3d/d3e/f72 0 2024-02-28T23:07:41.865 INFO:tasks.workunit.client.1.smithi184.stdout:4/684: symlink d1/d8/d19/d56/d7a/ld3 0 2024-02-28T23:07:41.868 INFO:tasks.workunit.client.0.smithi159.stdout:9/980: readlink d4/d3d/d3e/dad/d134/la5 0 2024-02-28T23:07:41.873 INFO:tasks.workunit.client.1.smithi184.stdout:3/748: symlink d1/d4/d5/da9/lec 0 2024-02-28T23:07:41.877 INFO:tasks.workunit.client.0.smithi159.stdout:3/917: creat d0/d3f/dd2/d63/f128 x:0 0 0 2024-02-28T23:07:41.879 INFO:tasks.workunit.client.0.smithi159.stdout:6/985: rmdir d0/d1b/d33/d11/d34/d9d/da2/d4e/d86 39 2024-02-28T23:07:41.882 INFO:tasks.workunit.client.1.smithi184.stdout:6/645: write dc/d60/d62/d6f/d99/d9d/fbb [626269,66392] 0 2024-02-28T23:07:41.882 INFO:tasks.workunit.client.1.smithi184.stdout:3/749: chown d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/ddc 334 1 2024-02-28T23:07:41.886 INFO:tasks.workunit.client.1.smithi184.stdout:7/660: symlink d6/d9/d13/d3e/d7e/le6 0 2024-02-28T23:07:41.886 INFO:tasks.workunit.client.0.smithi159.stdout:3/918: dread d0/d2b/f26 [0,4194304] 0 2024-02-28T23:07:41.895 INFO:tasks.workunit.client.1.smithi184.stdout:4/685: dread d1/f33 [0,4194304] 0 2024-02-28T23:07:41.896 INFO:tasks.workunit.client.0.smithi159.stdout:9/981: dwrite d4/d3d/d3e/f113 [0,4194304] 0 2024-02-28T23:07:41.965 INFO:tasks.workunit.client.0.smithi159.stdout:6/986: rename d0/d1b/d33/d11/f67 to d0/d1b/d33/d11/d34/d9d/da2/d4e/d86/d94/d12e/f142 0 2024-02-28T23:07:41.970 INFO:tasks.workunit.client.1.smithi184.stdout:3/750: creat d1/d4/d5/da9/d74/fed x:0 0 0 2024-02-28T23:07:41.973 INFO:tasks.workunit.client.0.smithi159.stdout:6/987: symlink d0/d1b/d33/d11/d34/d9d/da2/d96/l143 0 2024-02-28T23:07:41.976 INFO:tasks.workunit.client.1.smithi184.stdout:9/705: creat d5/db/de/fdf x:0 0 0 2024-02-28T23:07:41.977 INFO:tasks.workunit.client.0.smithi159.stdout:6/988: symlink d0/d1b/dc4/l144 0 2024-02-28T23:07:41.980 INFO:tasks.workunit.client.1.smithi184.stdout:8/724: getdents d1/da/dc/dc9 0 2024-02-28T23:07:41.981 INFO:tasks.workunit.client.1.smithi184.stdout:5/706: mkdir db/d90/de1 0 2024-02-28T23:07:41.982 INFO:tasks.workunit.client.1.smithi184.stdout:9/706: write d5/d47/d59/fd6 [344738,24769] 0 2024-02-28T23:07:41.984 INFO:tasks.workunit.client.1.smithi184.stdout:3/751: rmdir d1/d4/d1c 39 2024-02-28T23:07:41.985 INFO:tasks.workunit.client.0.smithi159.stdout:6/989: rename d0/d6d/c7d to d0/d1b/d33/d11/d34/d9d/da2/dcf/c145 0 2024-02-28T23:07:41.988 INFO:tasks.workunit.client.1.smithi184.stdout:5/707: stat db/d12/d1c/d21/d25/dd3/ca3 0 2024-02-28T23:07:41.988 INFO:tasks.workunit.client.0.smithi159.stdout:2/937: sync 2024-02-28T23:07:41.991 INFO:tasks.workunit.client.0.smithi159.stdout:7/831: sync 2024-02-28T23:07:41.991 INFO:tasks.workunit.client.0.smithi159.stdout:6/990: write d0/d1b/d33/d11/d34/d9d/da2/d96/dd2/d49/fde [1456002,11891] 0 2024-02-28T23:07:41.992 INFO:tasks.workunit.client.1.smithi184.stdout:0/749: getdents d0/d7c 0 2024-02-28T23:07:41.993 INFO:tasks.workunit.client.0.smithi159.stdout:2/938: mknod d9/d50/d62/dce/c147 0 2024-02-28T23:07:41.997 INFO:tasks.workunit.client.1.smithi184.stdout:6/646: creat dc/de/d2a/d8e/dad/d8a/fcd x:0 0 0 2024-02-28T23:07:41.997 INFO:tasks.workunit.client.1.smithi184.stdout:7/661: creat d6/d9/d13/d1e/d2f/fe7 x:0 0 0 2024-02-28T23:07:41.998 INFO:tasks.workunit.client.0.smithi159.stdout:7/832: symlink d5/d16/d1a/d27/d46/d65/d81/d83/l107 0 2024-02-28T23:07:42.002 INFO:tasks.workunit.client.1.smithi184.stdout:6/647: dread - dc/fbd zero size 2024-02-28T23:07:42.002 INFO:tasks.workunit.client.0.smithi159.stdout:2/939: readlink d9/d50/dcc/lae 0 2024-02-28T23:07:42.005 INFO:tasks.workunit.client.1.smithi184.stdout:8/725: truncate d1/da/dc/d16/d32/d42/f9b 275000 0 2024-02-28T23:07:42.007 INFO:tasks.workunit.client.0.smithi159.stdout:9/982: read d4/f36 [501301,7322] 0 2024-02-28T23:07:42.011 INFO:tasks.workunit.client.0.smithi159.stdout:6/991: mkdir d0/d1b/d33/d11/d34/d9d/da2/d4e/d146 0 2024-02-28T23:07:42.014 INFO:tasks.workunit.client.1.smithi184.stdout:8/726: write d1/da/dc/d16/d29/d92/fdb [48574,6682] 0 2024-02-28T23:07:42.018 INFO:tasks.workunit.client.0.smithi159.stdout:7/833: getdents d5/d16/d1a/d27/d3e/dee 0 2024-02-28T23:07:42.021 INFO:tasks.workunit.client.0.smithi159.stdout:7/834: stat d5/d16/d1a/d27/d46/d65/d81/d98/l9c 0 2024-02-28T23:07:42.023 INFO:tasks.workunit.client.0.smithi159.stdout:9/983: unlink d4/d3d/d3e/d55/d9e/dfc/cbd 0 2024-02-28T23:07:42.025 INFO:tasks.workunit.client.0.smithi159.stdout:9/984: stat d4/d3d/d3e/d55/d9e/dfc/lfb 0 2024-02-28T23:07:42.027 INFO:tasks.workunit.client.0.smithi159.stdout:9/985: stat d4/d3d/d3e/d55/f2a 0 2024-02-28T23:07:42.029 INFO:tasks.workunit.client.1.smithi184.stdout:3/752: mkdir d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/dee 0 2024-02-28T23:07:42.030 INFO:tasks.workunit.client.1.smithi184.stdout:5/708: dwrite db/d90/fba [0,4194304] 0 2024-02-28T23:07:42.034 INFO:tasks.workunit.client.1.smithi184.stdout:3/753: readlink d1/d4/d1c/d62/lde 0 2024-02-28T23:07:42.035 INFO:tasks.workunit.client.0.smithi159.stdout:2/940: dread d9/d50/d54/d84/d37/d5c/f7b [0,4194304] 0 2024-02-28T23:07:42.037 INFO:tasks.workunit.client.0.smithi159.stdout:2/941: fsync d9/d50/faa 0 2024-02-28T23:07:42.040 INFO:tasks.workunit.client.0.smithi159.stdout:6/992: dwrite d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dac/dd9/feb [0,4194304] 0 2024-02-28T23:07:42.045 INFO:tasks.workunit.client.0.smithi159.stdout:9/986: creat d4/d3d/d3e/d55/d37/d62/d77/db9/f137 x:0 0 0 2024-02-28T23:07:42.047 INFO:tasks.workunit.client.0.smithi159.stdout:9/987: chown d4/d3d/d3e/d55/d4c/d4e/d6b 1428 1 2024-02-28T23:07:42.051 INFO:tasks.workunit.client.1.smithi184.stdout:7/662: symlink d6/d9/d13/d3e/dad/d49/da6/daf/d65/le8 0 2024-02-28T23:07:42.057 INFO:tasks.workunit.client.1.smithi184.stdout:1/759: creat d20/d32/d3e/d61/d8b/f104 x:0 0 0 2024-02-28T23:07:42.058 INFO:tasks.workunit.client.1.smithi184.stdout:6/648: symlink dc/de/d2a/d5c/d79/db9/lce 0 2024-02-28T23:07:42.063 INFO:tasks.workunit.client.1.smithi184.stdout:1/760: chown d20/d32/d3e/d91 6063 1 2024-02-28T23:07:42.063 INFO:tasks.workunit.client.0.smithi159.stdout:7/835: mknod d5/d16/d1a/c108 0 2024-02-28T23:07:42.069 INFO:tasks.workunit.client.1.smithi184.stdout:1/761: dread - d20/d32/d3e/d61/fe3 zero size 2024-02-28T23:07:42.078 INFO:tasks.workunit.client.1.smithi184.stdout:5/709: dwrite db/d12/d50/d9e/fd7 [0,4194304] 0 2024-02-28T23:07:42.080 INFO:tasks.workunit.client.1.smithi184.stdout:5/710: readlink db/d12/d18/d2e/d3c/d5d/d66/l8c 0 2024-02-28T23:07:42.083 INFO:tasks.workunit.client.1.smithi184.stdout:8/727: dread d1/da/d10/d17/d63/f68 [0,4194304] 0 2024-02-28T23:07:42.089 INFO:tasks.workunit.client.1.smithi184.stdout:6/649: truncate dc/de/d10/f4c 5230400 0 2024-02-28T23:07:42.089 INFO:tasks.workunit.client.1.smithi184.stdout:1/762: mkdir d20/d32/d3e/d91/d105 0 2024-02-28T23:07:42.093 INFO:tasks.workunit.client.1.smithi184.stdout:1/763: read - d20/d32/d3e/d82/d85/d86/fd7 zero size 2024-02-28T23:07:42.094 INFO:tasks.workunit.client.0.smithi159.stdout:2/942: creat d9/d50/d54/d84/d37/f148 x:0 0 0 2024-02-28T23:07:42.097 INFO:tasks.workunit.client.1.smithi184.stdout:8/728: dread - d1/da/dc/d16/d32/d42/d77/f85 zero size 2024-02-28T23:07:42.100 INFO:tasks.workunit.client.1.smithi184.stdout:8/729: chown d1/da/dc/d16/d32/d42/f6f 200375771 1 2024-02-28T23:07:42.102 INFO:tasks.workunit.client.1.smithi184.stdout:5/711: unlink db/d12/d1c/f8f 0 2024-02-28T23:07:42.104 INFO:tasks.workunit.client.0.smithi159.stdout:9/988: getdents d4/d3d/d3e/d55/d4c/db6 0 2024-02-28T23:07:42.109 INFO:tasks.workunit.client.0.smithi159.stdout:5/994: symlink d8/d19/d23/d35/d41/d77/l159 0 2024-02-28T23:07:42.109 INFO:tasks.workunit.client.1.smithi184.stdout:7/663: dwrite d6/d9/d13/d3e/dad/d7d/d8d/fd7 [0,4194304] 0 2024-02-28T23:07:42.109 INFO:tasks.workunit.client.1.smithi184.stdout:7/664: truncate d6/d68/fd6 1039583 0 2024-02-28T23:07:42.110 INFO:tasks.workunit.client.1.smithi184.stdout:0/750: creat d0/df/d13/d27/d31/d5b/d8e/d92/f101 x:0 0 0 2024-02-28T23:07:42.112 INFO:tasks.workunit.client.1.smithi184.stdout:4/686: mknod d1/dc/df/d27/cd4 0 2024-02-28T23:07:42.112 INFO:tasks.workunit.client.1.smithi184.stdout:0/751: chown d0/d1f/f25 111 1 2024-02-28T23:07:42.116 INFO:tasks.workunit.client.1.smithi184.stdout:7/665: truncate d6/d9/d13/d3e/dad/d7d/d6c/fd8 716967 0 2024-02-28T23:07:42.120 INFO:tasks.workunit.client.1.smithi184.stdout:6/650: dread f8 [0,4194304] 0 2024-02-28T23:07:42.120 INFO:tasks.workunit.client.1.smithi184.stdout:6/651: readlink dc/d60/d7c/l5f 0 2024-02-28T23:07:42.128 INFO:tasks.workunit.client.0.smithi159.stdout:2/943: dwrite d9/d50/dcc/d44/f137 [0,4194304] 0 2024-02-28T23:07:42.129 INFO:tasks.workunit.client.0.smithi159.stdout:7/836: dread d5/d56/d50/d88/fcc [0,4194304] 0 2024-02-28T23:07:42.133 INFO:tasks.workunit.client.1.smithi184.stdout:0/752: symlink d0/d1f/l102 0 2024-02-28T23:07:42.136 INFO:tasks.workunit.client.1.smithi184.stdout:0/753: chown d0/df/d13/d27/d31/d5b/d8e/d92/l98 161258 1 2024-02-28T23:07:42.138 INFO:tasks.workunit.client.1.smithi184.stdout:4/687: mknod d1/dc/df/d5b/cd5 0 2024-02-28T23:07:42.151 INFO:tasks.workunit.client.1.smithi184.stdout:0/754: dread - d0/df/f7a zero size 2024-02-28T23:07:42.155 INFO:tasks.workunit.client.1.smithi184.stdout:4/688: mkdir d1/dc/df/d38/d57/dd6 0 2024-02-28T23:07:42.159 INFO:tasks.workunit.client.1.smithi184.stdout:8/730: link d1/da/dc/d18/ld2 d1/da/dc/d16/d32/d80/l109 0 2024-02-28T23:07:42.165 INFO:tasks.workunit.client.1.smithi184.stdout:6/652: link dc/de/d2a/c3e dc/de/db6/ccf 0 2024-02-28T23:07:42.167 INFO:tasks.workunit.client.1.smithi184.stdout:4/689: mknod d1/dc/df/d27/d34/cd7 0 2024-02-28T23:07:42.170 INFO:tasks.workunit.client.1.smithi184.stdout:1/764: dread d20/d46/d90/da0/fbe [0,4194304] 0 2024-02-28T23:07:42.173 INFO:tasks.workunit.client.1.smithi184.stdout:8/731: mknod d1/da/d10/d6b/c10a 0 2024-02-28T23:07:42.174 INFO:tasks.workunit.client.1.smithi184.stdout:4/690: read d1/dc/df/f16 [2306713,29857] 0 2024-02-28T23:07:42.175 INFO:tasks.workunit.client.1.smithi184.stdout:0/755: mknod d0/c103 0 2024-02-28T23:07:42.184 INFO:tasks.workunit.client.1.smithi184.stdout:8/732: symlink d1/da/dc/d16/d4d/l10b 0 2024-02-28T23:07:42.186 INFO:tasks.workunit.client.1.smithi184.stdout:0/756: mknod d0/d1d/d3a/c104 0 2024-02-28T23:07:42.192 INFO:tasks.workunit.client.1.smithi184.stdout:7/666: sync 2024-02-28T23:07:42.196 INFO:tasks.workunit.client.1.smithi184.stdout:7/667: chown d6/d9/d13/d3e/d7e/le6 6824 1 2024-02-28T23:07:42.202 INFO:tasks.workunit.client.0.smithi159.stdout:5/995: fdatasync d8/d19/d23/d35/d65/da3/df4/feb 0 2024-02-28T23:07:42.206 INFO:tasks.workunit.client.1.smithi184.stdout:7/668: creat d6/d9/d13/d3e/dad/d7d/d8d/fe9 x:0 0 0 2024-02-28T23:07:42.211 INFO:tasks.workunit.client.0.smithi159.stdout:7/837: rename d5/d16/d1a/d27/d46/f61 to d5/d16/d1a/d27/d37/f109 0 2024-02-28T23:07:42.215 INFO:tasks.workunit.client.0.smithi159.stdout:9/989: link d4/d3d/fe1 d4/d3d/d3e/d4a/d109/f138 0 2024-02-28T23:07:42.218 INFO:tasks.workunit.client.0.smithi159.stdout:7/838: read - d5/d56/d2a/fdf zero size 2024-02-28T23:07:42.220 INFO:tasks.workunit.client.0.smithi159.stdout:9/990: read - d4/d3d/d3e/d55/d4c/d4e/d6b/db5/fd9 zero size 2024-02-28T23:07:42.225 INFO:tasks.workunit.client.1.smithi184.stdout:7/669: dread d6/d9/d13/d3e/dad/d49/d50/f61 [0,4194304] 0 2024-02-28T23:07:42.328 INFO:tasks.workunit.client.0.smithi159.stdout:9/991: rename d4/f11 to d4/d3d/d3e/d55/d37/d62/d107/f139 0 2024-02-28T23:07:42.347 INFO:tasks.workunit.client.0.smithi159.stdout:9/992: dwrite d4/d3d/d3e/d55/d37/d62/da6/ffa [0,4194304] 0 2024-02-28T23:07:42.361 INFO:tasks.workunit.client.1.smithi184.stdout:2/666: dwrite d10/d1f/d21/d5e/f47 [0,4194304] 0 2024-02-28T23:07:42.362 INFO:tasks.workunit.client.1.smithi184.stdout:3/754: rename d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/cb1 to d1/d4/d1c/cef 0 2024-02-28T23:07:42.364 INFO:tasks.workunit.client.1.smithi184.stdout:9/707: truncate d5/d47/d59/d92/fb4 1058934 0 2024-02-28T23:07:42.367 INFO:tasks.workunit.client.0.smithi159.stdout:6/993: write d0/d1b/d33/d11/d34/d9d/da2/db7/f27 [1311137,54814] 0 2024-02-28T23:07:42.373 INFO:tasks.workunit.client.0.smithi159.stdout:6/994: rmdir d0/d1b/d33/d11/d34/d9d/da2/d4e/d126 39 2024-02-28T23:07:42.379 INFO:tasks.workunit.client.1.smithi184.stdout:5/712: symlink db/d12/d18/d2e/le2 0 2024-02-28T23:07:42.380 INFO:tasks.workunit.client.1.smithi184.stdout:6/653: rename dc/d42/c6c to dc/de/d2a/d5c/d79/db9/cd0 0 2024-02-28T23:07:42.386 INFO:tasks.workunit.client.1.smithi184.stdout:8/733: link d1/da/f1a d1/f10c 0 2024-02-28T23:07:42.387 INFO:tasks.workunit.client.0.smithi159.stdout:6/995: fsync d0/d1b/d33/d11/d34/d9d/da2/db7/f27 0 2024-02-28T23:07:42.388 INFO:tasks.workunit.client.1.smithi184.stdout:2/667: creat d10/d1f/d21/d5e/d15/dc8/fd3 x:0 0 0 2024-02-28T23:07:42.389 INFO:tasks.workunit.client.1.smithi184.stdout:8/734: chown d1/fe1 1 1 2024-02-28T23:07:42.396 INFO:tasks.workunit.client.1.smithi184.stdout:2/668: stat d10/d1f/d21/d5e/d15/l25 0 2024-02-28T23:07:42.396 INFO:tasks.workunit.client.1.smithi184.stdout:3/755: truncate d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/fcb 1005201 0 2024-02-28T23:07:42.397 INFO:tasks.workunit.client.1.smithi184.stdout:8/735: mkdir d1/da/d10/d10d 0 2024-02-28T23:07:42.400 INFO:tasks.workunit.client.1.smithi184.stdout:9/708: dread d5/d17/d8f/f98 [0,4194304] 0 2024-02-28T23:07:42.401 INFO:tasks.workunit.client.1.smithi184.stdout:3/756: rmdir d1/d4/d6/d1e/d72 39 2024-02-28T23:07:42.404 INFO:tasks.workunit.client.1.smithi184.stdout:1/765: write d20/d32/d4b/fa1 [194097,72696] 0 2024-02-28T23:07:42.407 INFO:tasks.workunit.client.1.smithi184.stdout:2/669: getdents d10/d1f/d21/d5e/dad/dc7 0 2024-02-28T23:07:42.407 INFO:tasks.workunit.client.1.smithi184.stdout:5/713: dwrite db/d1f/f42 [4194304,4194304] 0 2024-02-28T23:07:42.409 INFO:tasks.workunit.client.1.smithi184.stdout:3/757: creat d1/d4/d1c/ff0 x:0 0 0 2024-02-28T23:07:42.412 INFO:tasks.workunit.client.1.smithi184.stdout:4/691: write d1/dc/df/f82 [1233979,101103] 0 2024-02-28T23:07:42.412 INFO:tasks.workunit.client.1.smithi184.stdout:8/736: getdents d1/da/df/d20/dc7 0 2024-02-28T23:07:42.413 INFO:tasks.workunit.client.1.smithi184.stdout:5/714: fdatasync db/d12/d18/d2e/f89 0 2024-02-28T23:07:42.415 INFO:tasks.workunit.client.1.smithi184.stdout:1/766: mkdir d20/d32/d3e/d82/d106 0 2024-02-28T23:07:42.420 INFO:tasks.workunit.client.0.smithi159.stdout:2/944: write d9/f76 [963559,68118] 0 2024-02-28T23:07:42.421 INFO:tasks.workunit.client.1.smithi184.stdout:4/692: rmdir d1/d8/d19/d92/db3 39 2024-02-28T23:07:42.422 INFO:tasks.workunit.client.1.smithi184.stdout:8/737: readlink d1/da/dc/d18/ld2 0 2024-02-28T23:07:42.423 INFO:tasks.workunit.client.1.smithi184.stdout:2/670: truncate d10/d1f/d21/d5e/d15/f1b 1602250 0 2024-02-28T23:07:42.425 INFO:tasks.workunit.client.1.smithi184.stdout:5/715: creat db/d12/d1c/d21/d25/fe3 x:0 0 0 2024-02-28T23:07:42.426 INFO:tasks.workunit.client.0.smithi159.stdout:2/945: mknod d9/d50/dcc/d44/dc0/dda/c149 0 2024-02-28T23:07:42.429 INFO:tasks.workunit.client.1.smithi184.stdout:1/767: mkdir d20/d32/d3e/d82/d85/dfc/d107 0 2024-02-28T23:07:42.430 INFO:tasks.workunit.client.1.smithi184.stdout:0/757: dwrite d0/df/d13/d27/d31/d5b/d8e/fa5 [0,4194304] 0 2024-02-28T23:07:42.430 INFO:tasks.workunit.client.1.smithi184.stdout:4/693: creat d1/fd8 x:0 0 0 2024-02-28T23:07:42.431 INFO:tasks.workunit.client.0.smithi159.stdout:2/946: dread - d9/d36/d59/f10f zero size 2024-02-28T23:07:42.431 INFO:tasks.workunit.client.1.smithi184.stdout:5/716: write db/d12/d1c/d21/d4d/fbc [703010,119421] 0 2024-02-28T23:07:42.435 INFO:tasks.workunit.client.1.smithi184.stdout:0/758: fdatasync d0/df/d13/ffe 0 2024-02-28T23:07:42.436 INFO:tasks.workunit.client.1.smithi184.stdout:5/717: fsync db/d12/d1c/fd1 0 2024-02-28T23:07:42.440 INFO:tasks.workunit.client.1.smithi184.stdout:1/768: unlink d20/d46/d90/f55 0 2024-02-28T23:07:42.441 INFO:tasks.workunit.client.0.smithi159.stdout:9/993: write d4/f36 [588487,113140] 0 2024-02-28T23:07:42.441 INFO:tasks.workunit.client.1.smithi184.stdout:4/694: unlink d1/d8/d35/l40 0 2024-02-28T23:07:42.444 INFO:tasks.workunit.client.1.smithi184.stdout:3/758: dwrite d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/dc1/fe5 [0,4194304] 0 2024-02-28T23:07:42.447 INFO:tasks.workunit.client.1.smithi184.stdout:9/709: dread d5/d73/fb3 [4194304,4194304] 0 2024-02-28T23:07:42.448 INFO:tasks.workunit.client.1.smithi184.stdout:9/710: readlink d5/d26/l3a 0 2024-02-28T23:07:42.449 INFO:tasks.workunit.client.1.smithi184.stdout:3/759: write d1/d4/fb [7624583,116350] 0 2024-02-28T23:07:42.450 INFO:tasks.workunit.client.0.smithi159.stdout:9/994: symlink d4/d3d/d3e/d6e/l13a 0 2024-02-28T23:07:42.450 INFO:tasks.workunit.client.1.smithi184.stdout:5/718: creat db/d44/da5/fe4 x:0 0 0 2024-02-28T23:07:42.452 INFO:tasks.workunit.client.1.smithi184.stdout:0/759: unlink d0/df/d13/d27/d31/d51/f59 0 2024-02-28T23:07:42.452 INFO:tasks.workunit.client.1.smithi184.stdout:7/670: dwrite d6/d9/d13/d3e/d7e/f8a [0,4194304] 0 2024-02-28T23:07:42.457 INFO:tasks.workunit.client.1.smithi184.stdout:0/760: write d0/df/fff [747208,83652] 0 2024-02-28T23:07:42.457 INFO:tasks.workunit.client.1.smithi184.stdout:4/695: unlink d1/d8/f4a 0 2024-02-28T23:07:42.457 INFO:tasks.workunit.client.0.smithi159.stdout:6/996: write d0/d1b/d33/d11/d34/d9d/da2/db7/db1/dac/dd9/ff9 [579265,113883] 0 2024-02-28T23:07:42.461 INFO:tasks.workunit.client.1.smithi184.stdout:6/654: sync 2024-02-28T23:07:42.464 INFO:tasks.workunit.client.1.smithi184.stdout:3/760: creat d1/d4/d5/da9/d74/ff1 x:0 0 0 2024-02-28T23:07:42.465 INFO:tasks.workunit.client.0.smithi159.stdout:6/997: creat d0/d1b/dc4/ddd/d109/f147 x:0 0 0 2024-02-28T23:07:42.467 INFO:tasks.workunit.client.1.smithi184.stdout:0/761: write d0/df/d13/d27/d31/d5b/d8e/d92/f101 [791317,99501] 0 2024-02-28T23:07:42.468 INFO:tasks.workunit.client.1.smithi184.stdout:9/711: dread d5/d47/fc3 [0,4194304] 0 2024-02-28T23:07:42.470 INFO:tasks.workunit.client.1.smithi184.stdout:0/762: stat d0/d1f/de3/fea 0 2024-02-28T23:07:42.474 INFO:tasks.workunit.client.1.smithi184.stdout:6/655: unlink dc/de/d2a/f65 0 2024-02-28T23:07:42.475 INFO:tasks.workunit.client.1.smithi184.stdout:8/738: write d1/da/d10/d17/f47 [4781283,88868] 0 2024-02-28T23:07:42.476 INFO:tasks.workunit.client.1.smithi184.stdout:7/671: mkdir d6/dea 0 2024-02-28T23:07:42.477 INFO:tasks.workunit.client.1.smithi184.stdout:4/696: truncate d1/dc/f23 2041982 0 2024-02-28T23:07:42.478 INFO:tasks.workunit.client.1.smithi184.stdout:2/671: write d10/d1f/d21/d5e/d15/d60/fc3 [1732049,2713] 0 2024-02-28T23:07:42.480 INFO:tasks.workunit.client.1.smithi184.stdout:3/761: creat d1/d4/d1c/d62/d66/dab/ff2 x:0 0 0 2024-02-28T23:07:42.482 INFO:tasks.workunit.client.1.smithi184.stdout:3/762: chown d1/d4/d1c/d62/d66/dd3/f2c 1419083 1 2024-02-28T23:07:42.483 INFO:tasks.workunit.client.1.smithi184.stdout:9/712: rename d5/db/de/f23 to d5/d17/d57/fe0 0 2024-02-28T23:07:42.483 INFO:tasks.workunit.client.1.smithi184.stdout:3/763: stat d1/d4/d1c/d62/d66/dd3/f2c 0 2024-02-28T23:07:42.484 INFO:tasks.workunit.client.1.smithi184.stdout:0/763: symlink d0/df/d13/d27/d31/d51/d85/l105 0 2024-02-28T23:07:42.486 INFO:tasks.workunit.client.0.smithi159.stdout:9/995: dread d4/f13 [4194304,4194304] 0 2024-02-28T23:07:42.486 INFO:tasks.workunit.client.1.smithi184.stdout:0/764: write d0/df/f11 [2242459,107265] 0 2024-02-28T23:07:42.492 INFO:tasks.workunit.client.1.smithi184.stdout:5/719: creat db/d12/d18/d2e/fe5 x:0 0 0 2024-02-28T23:07:42.495 INFO:tasks.workunit.client.1.smithi184.stdout:8/739: dread - d1/da/dc/d16/d4d/d82/fdf zero size 2024-02-28T23:07:42.495 INFO:tasks.workunit.client.1.smithi184.stdout:5/720: write db/d12/d18/d2e/fc8 [344754,76101] 0 2024-02-28T23:07:42.497 INFO:tasks.workunit.client.1.smithi184.stdout:5/721: read - db/d12/d18/d2e/fe5 zero size 2024-02-28T23:07:42.497 INFO:tasks.workunit.client.0.smithi159.stdout:2/947: dwrite d9/f33 [0,4194304] 0 2024-02-28T23:07:42.500 INFO:tasks.workunit.client.1.smithi184.stdout:2/672: rmdir d10 39 2024-02-28T23:07:42.500 INFO:tasks.workunit.client.1.smithi184.stdout:3/764: dread d1/d4/d1c/f31 [0,4194304] 0 2024-02-28T23:07:42.501 INFO:tasks.workunit.client.1.smithi184.stdout:3/765: stat d1/d4/d1c/d62/d66/dd3/f68 0 2024-02-28T23:07:42.502 INFO:tasks.workunit.client.1.smithi184.stdout:1/769: truncate d20/d32/d3e/d91/fda 2855477 0 2024-02-28T23:07:42.503 INFO:tasks.workunit.client.1.smithi184.stdout:6/656: symlink dc/de/ld1 0 2024-02-28T23:07:42.513 INFO:tasks.workunit.client.1.smithi184.stdout:0/765: rmdir d0/df/d13/d27/d31/d5b/d8e/d92/dac 39 2024-02-28T23:07:42.513 INFO:tasks.workunit.client.1.smithi184.stdout:0/766: fsync d0/df/d13/d27/d31/d51/d85/fc0 0 2024-02-28T23:07:42.514 INFO:tasks.workunit.client.1.smithi184.stdout:0/767: dread - d0/df/f7a zero size 2024-02-28T23:07:42.514 INFO:tasks.workunit.client.1.smithi184.stdout:8/740: fsync d1/da/dc/d16/d32/d42/d77/f90 0 2024-02-28T23:07:42.515 INFO:tasks.workunit.client.0.smithi159.stdout:6/998: dwrite d0/d1b/d33/d11/d34/f127 [0,4194304] 0 2024-02-28T23:07:42.518 INFO:tasks.workunit.client.1.smithi184.stdout:4/697: unlink d1/d8/d35/lb9 0 2024-02-28T23:07:42.522 INFO:tasks.workunit.client.1.smithi184.stdout:5/722: rename db/f61 to db/d12/d18/d2e/d3c/d5d/fe6 0 2024-02-28T23:07:42.530 INFO:tasks.workunit.client.0.smithi159.stdout:6/999: rename d0/d1b/dc4/f13e to d0/d1b/d33/d11/d34/f148 0 2024-02-28T23:07:42.530 INFO:tasks.workunit.client.1.smithi184.stdout:7/672: write d6/d9/fb3 [1016482,67964] 0 2024-02-28T23:07:42.531 INFO:tasks.workunit.client.1.smithi184.stdout:8/741: dwrite d1/da/dc/d16/d4d/f87 [4194304,4194304] 0 2024-02-28T23:07:42.538 INFO:tasks.workunit.client.1.smithi184.stdout:3/766: fdatasync d1/d4/d1c/f31 0 2024-02-28T23:07:42.541 INFO:tasks.workunit.client.1.smithi184.stdout:1/770: creat d20/d46/d90/da0/f108 x:0 0 0 2024-02-28T23:07:42.544 INFO:tasks.workunit.client.0.smithi159.stdout:2/948: dread d9/f25 [0,4194304] 0 2024-02-28T23:07:42.550 INFO:tasks.workunit.client.0.smithi159.stdout:9/996: dwrite d4/d3d/d3e/d55/f2a [0,4194304] 0 2024-02-28T23:07:42.554 INFO:tasks.workunit.client.0.smithi159.stdout:2/949: symlink d9/d50/d54/d84/d113/l14a 0 2024-02-28T23:07:42.561 INFO:tasks.workunit.client.1.smithi184.stdout:4/698: rename d1/d8/d3d/d44 to d1/d8/d35/dd9 0 2024-02-28T23:07:42.563 INFO:tasks.workunit.client.0.smithi159.stdout:2/950: unlink d9/d36/f3f 0 2024-02-28T23:07:42.567 INFO:tasks.workunit.client.1.smithi184.stdout:2/673: symlink d10/d1f/d21/d5e/d15/d60/ld4 0 2024-02-28T23:07:42.571 INFO:tasks.workunit.client.1.smithi184.stdout:2/674: write d10/d1f/d21/d5e/d15/fbe [1551652,125141] 0 2024-02-28T23:07:42.579 INFO:tasks.workunit.client.1.smithi184.stdout:3/767: rmdir d1/d4/d1c/d61/d87 39 2024-02-28T23:07:42.580 INFO:tasks.workunit.client.0.smithi159.stdout:9/997: getdents d4/d3d/d3e/dad/d10f 0 2024-02-28T23:07:42.585 INFO:tasks.workunit.client.0.smithi159.stdout:2/951: dwrite d9/f76 [0,4194304] 0 2024-02-28T23:07:42.585 INFO:tasks.workunit.client.0.smithi159.stdout:9/998: rmdir d4/d3d/d3e/d4a/d109 39 2024-02-28T23:07:42.586 INFO:tasks.workunit.client.1.smithi184.stdout:0/768: write d0/df/d13/d27/d31/d5b/d8e/fb5 [810302,82744] 0 2024-02-28T23:07:42.588 INFO:tasks.workunit.client.1.smithi184.stdout:5/723: creat db/da4/fe7 x:0 0 0 2024-02-28T23:07:42.592 INFO:tasks.workunit.client.1.smithi184.stdout:7/673: mkdir d6/d9/d13/d3e/dad/d7d/dc9/deb 0 2024-02-28T23:07:42.597 INFO:tasks.workunit.client.1.smithi184.stdout:2/675: creat d10/d1f/d21/d5e/d15/d60/fd5 x:0 0 0 2024-02-28T23:07:42.598 INFO:tasks.workunit.client.1.smithi184.stdout:6/657: truncate dc/f75 208750 0 2024-02-28T23:07:42.603 INFO:tasks.workunit.client.1.smithi184.stdout:6/658: write dc/d60/d7c/f6b [4295275,35453] 0 2024-02-28T23:07:42.603 INFO:tasks.workunit.client.1.smithi184.stdout:4/699: write d1/d8/d37/d49/f80 [1648658,56474] 0 2024-02-28T23:07:42.604 INFO:tasks.workunit.client.0.smithi159.stdout:9/999: creat d4/d3d/d3e/d4a/f13b x:0 0 0 2024-02-28T23:07:42.605 INFO:tasks.workunit.client.1.smithi184.stdout:3/768: fdatasync d1/d4/d5/da9/f77 0 2024-02-28T23:07:42.608 INFO:tasks.workunit.client.1.smithi184.stdout:9/713: sync 2024-02-28T23:07:42.610 INFO:tasks.workunit.client.0.smithi159.stdout:2/952: getdents d9/d80 0 2024-02-28T23:07:42.617 INFO:tasks.workunit.client.1.smithi184.stdout:8/742: dwrite d1/da/dc/d16/d29/d92/fb5 [0,4194304] 0 2024-02-28T23:07:42.617 INFO:tasks.workunit.client.1.smithi184.stdout:2/676: rmdir d10/d1f/d21/d5e/d15 39 2024-02-28T23:07:42.617 INFO:tasks.workunit.client.1.smithi184.stdout:1/771: dwrite d20/d32/f44 [0,4194304] 0 2024-02-28T23:07:42.618 INFO:tasks.workunit.client.1.smithi184.stdout:4/700: truncate d1/f12 128224 0 2024-02-28T23:07:42.620 INFO:tasks.workunit.client.1.smithi184.stdout:6/659: mkdir dc/d60/d7c/d61/dd2 0 2024-02-28T23:07:42.622 INFO:tasks.workunit.client.1.smithi184.stdout:0/769: mkdir d0/df/d13/d27/d31/d5b/d8e/d92/d106 0 2024-02-28T23:07:42.623 INFO:tasks.workunit.client.1.smithi184.stdout:7/674: mknod d6/dea/cec 0 2024-02-28T23:07:42.629 INFO:tasks.workunit.client.1.smithi184.stdout:3/769: rmdir d1/d4/d1c/d62/d66/da6 39 2024-02-28T23:07:42.629 INFO:tasks.workunit.client.1.smithi184.stdout:7/675: write d6/d9/d13/d14/f7b [2905141,32011] 0 2024-02-28T23:07:42.629 INFO:tasks.workunit.client.0.smithi159.stdout:5/996: sync 2024-02-28T23:07:42.630 INFO:tasks.workunit.client.0.smithi159.stdout:7/839: sync 2024-02-28T23:07:42.630 INFO:tasks.workunit.client.0.smithi159.stdout:3/919: sync 2024-02-28T23:07:42.630 INFO:tasks.workunit.client.1.smithi184.stdout:6/660: mkdir dc/d60/d7c/d61/dd3 0 2024-02-28T23:07:42.630 INFO:tasks.workunit.client.1.smithi184.stdout:9/714: mkdir d5/db/de/de1 0 2024-02-28T23:07:42.633 INFO:tasks.workunit.client.1.smithi184.stdout:1/772: chown f17 2337444 1 2024-02-28T23:07:42.633 INFO:tasks.workunit.client.1.smithi184.stdout:7/676: chown d6/f16 31610 1 2024-02-28T23:07:42.633 INFO:tasks.workunit.client.1.smithi184.stdout:5/724: dwrite db/f7c [0,4194304] 0 2024-02-28T23:07:42.633 INFO:tasks.workunit.client.0.smithi159.stdout:2/953: dwrite d9/d50/dcc/d44/f137 [4194304,4194304] 0 2024-02-28T23:07:42.634 INFO:tasks.workunit.client.1.smithi184.stdout:0/770: rmdir d0/d1d/d3a/de5 39 2024-02-28T23:07:42.635 INFO:tasks.workunit.client.0.smithi159.stdout:7/840: symlink d5/l10a 0 2024-02-28T23:07:42.636 INFO:tasks.workunit.client.1.smithi184.stdout:8/743: mkdir d1/da/df/d10e 0 2024-02-28T23:07:42.637 INFO:tasks.workunit.client.0.smithi159.stdout:3/920: rmdir d0/d2b/d55/df8/da9/d103 39 2024-02-28T23:07:42.639 INFO:tasks.workunit.client.1.smithi184.stdout:3/770: write d1/d4/d1c/d62/d66/dd3/d24/f3e [2513085,116958] 0 2024-02-28T23:07:42.640 INFO:tasks.workunit.client.1.smithi184.stdout:6/661: rmdir dc/de/d2a/d5c 39 2024-02-28T23:07:42.642 INFO:tasks.workunit.client.0.smithi159.stdout:5/997: rmdir d8/d19/d23/d35/d65/da3/df4/da5/df3 39 2024-02-28T23:07:42.644 INFO:tasks.workunit.client.1.smithi184.stdout:5/725: truncate db/d12/d18/db5/fd5 260332 0 2024-02-28T23:07:42.647 INFO:tasks.workunit.client.1.smithi184.stdout:9/715: fsync d5/db/de/d10/f7e 0 2024-02-28T23:07:42.648 INFO:tasks.workunit.client.1.smithi184.stdout:2/677: dwrite d10/d1f/d21/d6a/f84 [4194304,4194304] 0 2024-02-28T23:07:42.654 INFO:tasks.workunit.client.0.smithi159.stdout:2/954: mknod d9/d36/c14b 0 2024-02-28T23:07:42.663 INFO:tasks.workunit.client.0.smithi159.stdout:2/955: link d9/d50/dcc/cb0 d9/d36/dc3/c14c 0 2024-02-28T23:07:42.664 INFO:tasks.workunit.client.1.smithi184.stdout:6/662: dread dc/d60/d7c/fc2 [0,4194304] 0 2024-02-28T23:07:42.664 INFO:tasks.workunit.client.1.smithi184.stdout:4/701: link d1/d8/d19/d92/l94 d1/dc/df/lda 0 2024-02-28T23:07:42.666 INFO:tasks.workunit.client.1.smithi184.stdout:3/771: unlink d1/d4/d1c/d61/fe6 0 2024-02-28T23:07:42.666 INFO:tasks.workunit.client.1.smithi184.stdout:7/677: truncate d6/d9/d13/d3e/dad/f3c 2743886 0 2024-02-28T23:07:42.669 INFO:tasks.workunit.client.1.smithi184.stdout:6/663: fdatasync dc/de/d10/d16/f2d 0 2024-02-28T23:07:42.670 INFO:tasks.workunit.client.1.smithi184.stdout:3/772: readlink d1/d4/d5/d40/l4b 0 2024-02-28T23:07:42.673 INFO:tasks.workunit.client.1.smithi184.stdout:7/678: truncate d6/f46 435182 0 2024-02-28T23:07:42.675 INFO:tasks.workunit.client.1.smithi184.stdout:9/716: creat d5/d47/d68/fe2 x:0 0 0 2024-02-28T23:07:42.676 INFO:tasks.workunit.client.1.smithi184.stdout:7/679: readlink d6/d9/d13/d3e/l60 0 2024-02-28T23:07:42.676 INFO:tasks.workunit.client.0.smithi159.stdout:2/956: getdents d9/d50/d54/d84/df2 0 2024-02-28T23:07:42.677 INFO:tasks.workunit.client.1.smithi184.stdout:7/680: dread - d6/d9/f5e zero size 2024-02-28T23:07:42.677 INFO:tasks.workunit.client.1.smithi184.stdout:2/678: dwrite d10/d1f/d21/d5e/f2c [0,4194304] 0 2024-02-28T23:07:42.679 INFO:tasks.workunit.client.1.smithi184.stdout:4/702: mknod d1/dc/df/d27/d34/cdb 0 2024-02-28T23:07:42.680 INFO:tasks.workunit.client.0.smithi159.stdout:2/957: fsync d9/d50/d54/d84/f143 0 2024-02-28T23:07:42.681 INFO:tasks.workunit.client.1.smithi184.stdout:7/681: write d6/f48 [283656,18772] 0 2024-02-28T23:07:42.681 INFO:tasks.workunit.client.1.smithi184.stdout:4/703: dread - d1/d4/d43/fc2 zero size 2024-02-28T23:07:42.681 INFO:tasks.workunit.client.1.smithi184.stdout:9/717: write d5/db/de/d10/dc9/fd9 [756088,61347] 0 2024-02-28T23:07:42.681 INFO:tasks.workunit.client.1.smithi184.stdout:3/773: rmdir d1/d4/d1c/d62/d66/dd3/d24 39 2024-02-28T23:07:42.685 INFO:tasks.workunit.client.1.smithi184.stdout:4/704: chown d1/d4/d43/d73/l63 1722692 1 2024-02-28T23:07:42.686 INFO:tasks.workunit.client.1.smithi184.stdout:6/664: unlink dc/de/d2a/d8e/dad/l6a 0 2024-02-28T23:07:42.689 INFO:tasks.workunit.client.1.smithi184.stdout:1/773: write d20/d46/f89 [366950,87223] 0 2024-02-28T23:07:42.692 INFO:tasks.workunit.client.0.smithi159.stdout:2/958: truncate d9/d50/d54/d84/f6d 123960 0 2024-02-28T23:07:42.693 INFO:tasks.workunit.client.1.smithi184.stdout:6/665: read - dc/de/d10/f21 zero size 2024-02-28T23:07:42.694 INFO:tasks.workunit.client.0.smithi159.stdout:5/998: dread d8/d16/d122/f102 [0,4194304] 0 2024-02-28T23:07:42.695 INFO:tasks.workunit.client.0.smithi159.stdout:3/921: write d0/def/f7b [649504,108044] 0 2024-02-28T23:07:42.696 INFO:tasks.workunit.client.1.smithi184.stdout:6/666: write f8 [2171292,63532] 0 2024-02-28T23:07:42.696 INFO:tasks.workunit.client.1.smithi184.stdout:4/705: mknod d1/d8/d19/d67/d99/cdc 0 2024-02-28T23:07:42.696 INFO:tasks.workunit.client.1.smithi184.stdout:7/682: truncate d6/d9/d13/d1e/d2f/f89 737004 0 2024-02-28T23:07:42.697 INFO:tasks.workunit.client.1.smithi184.stdout:7/683: chown d6 72 1 2024-02-28T23:07:42.699 INFO:tasks.workunit.client.0.smithi159.stdout:2/959: creat d9/d50/d54/f14d x:0 0 0 2024-02-28T23:07:42.699 INFO:tasks.workunit.client.0.smithi159.stdout:3/922: stat d0/fac 0 2024-02-28T23:07:42.702 INFO:tasks.workunit.client.1.smithi184.stdout:9/718: creat d5/d47/fe3 x:0 0 0 2024-02-28T23:07:42.706 INFO:tasks.workunit.client.0.smithi159.stdout:5/999: unlink d8/d19/d23/d35/d41/d92/d10c/dff/f118 0 2024-02-28T23:07:42.706 INFO:tasks.workunit.client.0.smithi159.stdout:7/841: dwrite d5/d16/d1a/d27/d75/fc7 [0,4194304] 0 2024-02-28T23:07:42.707 INFO:tasks.workunit.client.1.smithi184.stdout:0/771: dread d0/df/d13/d27/f8b [0,4194304] 0 2024-02-28T23:07:42.708 INFO:tasks.workunit.client.1.smithi184.stdout:7/684: rmdir d6/d9/d13/d3e/dad/d49/da6 39 2024-02-28T23:07:42.709 INFO:tasks.workunit.client.1.smithi184.stdout:8/744: dwrite d1/da/df/d20/f3e [0,4194304] 0 2024-02-28T23:07:42.713 INFO:tasks.workunit.client.0.smithi159.stdout:2/960: truncate d9/d36/d59/f7d 728650 0 2024-02-28T23:07:42.714 INFO:tasks.workunit.client.1.smithi184.stdout:8/745: fsync d1/da/dc/d16/d29/d92/fb5 0 2024-02-28T23:07:42.714 INFO:tasks.workunit.client.1.smithi184.stdout:3/774: creat d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/ff3 x:0 0 0 2024-02-28T23:07:42.718 INFO:tasks.workunit.client.1.smithi184.stdout:5/726: dwrite f8 [0,4194304] 0 2024-02-28T23:07:42.719 INFO:tasks.workunit.client.0.smithi159.stdout:3/923: rename d0/def/d79/d9b/ff3 to d0/d3f/dd2/d6a/de7/f129 0 2024-02-28T23:07:42.720 INFO:tasks.workunit.client.1.smithi184.stdout:0/772: dread d0/df/f11 [0,4194304] 0 2024-02-28T23:07:42.720 INFO:tasks.workunit.client.1.smithi184.stdout:5/727: dread - db/d44/da5/faa zero size 2024-02-28T23:07:42.721 INFO:tasks.workunit.client.1.smithi184.stdout:9/719: unlink c1 0 2024-02-28T23:07:42.722 INFO:tasks.workunit.client.1.smithi184.stdout:4/706: mkdir d1/dc/df/d38/d57/dd6/ddd 0 2024-02-28T23:07:42.723 INFO:tasks.workunit.client.1.smithi184.stdout:5/728: fsync db/d12/d1c/d21/fb6 0 2024-02-28T23:07:42.731 INFO:tasks.workunit.client.0.smithi159.stdout:3/924: creat d0/d2b/d55/df8/da9/d124/f12a x:0 0 0 2024-02-28T23:07:42.736 INFO:tasks.workunit.client.1.smithi184.stdout:1/774: getdents d20/d46/d90 0 2024-02-28T23:07:42.738 INFO:tasks.workunit.client.1.smithi184.stdout:6/667: rename dc/de/d2a/d5c/lc0 to dc/d60/d62/d6f/d99/d9d/ld4 0 2024-02-28T23:07:42.740 INFO:tasks.workunit.client.0.smithi159.stdout:3/925: symlink d0/d2b/d55/d75/l12b 0 2024-02-28T23:07:42.740 INFO:tasks.workunit.client.0.smithi159.stdout:2/961: dwrite d9/d23/d2c/d55/fb7 [0,4194304] 0 2024-02-28T23:07:42.740 INFO:tasks.workunit.client.1.smithi184.stdout:6/668: write dc/de/f1e [2087334,120341] 0 2024-02-28T23:07:42.742 INFO:tasks.workunit.client.1.smithi184.stdout:9/720: dread - d5/db/de/d10/d6a/f9b zero size 2024-02-28T23:07:42.745 INFO:tasks.workunit.client.1.smithi184.stdout:9/721: dread - d5/db/de/fdf zero size 2024-02-28T23:07:42.749 INFO:tasks.workunit.client.1.smithi184.stdout:1/775: dread d20/d32/d3e/d91/faa [0,4194304] 0 2024-02-28T23:07:42.764 INFO:tasks.workunit.client.1.smithi184.stdout:1/776: dread d20/f35 [0,4194304] 0 2024-02-28T23:07:42.772 INFO:tasks.workunit.client.1.smithi184.stdout:5/729: creat db/d90/de1/fe8 x:0 0 0 2024-02-28T23:07:42.774 INFO:tasks.workunit.client.1.smithi184.stdout:7/685: symlink d6/d9/d13/d3e/dad/d49/da6/daf/ddc/led 0 2024-02-28T23:07:42.774 INFO:tasks.workunit.client.1.smithi184.stdout:0/773: dread d0/d1f/f4b [0,4194304] 0 2024-02-28T23:07:42.776 INFO:tasks.workunit.client.1.smithi184.stdout:6/669: truncate dc/d60/d6d/f83 3716509 0 2024-02-28T23:07:42.778 INFO:tasks.workunit.client.1.smithi184.stdout:7/686: write d6/d9/d13/d1e/d2f/fdb [594881,4409] 0 2024-02-28T23:07:42.781 INFO:tasks.workunit.client.1.smithi184.stdout:9/722: dread d5/d47/d68/d7c/fa8 [0,4194304] 0 2024-02-28T23:07:42.782 INFO:tasks.workunit.client.1.smithi184.stdout:2/679: dwrite d10/d55/d89/db5/f9f [0,4194304] 0 2024-02-28T23:07:42.787 INFO:tasks.workunit.client.1.smithi184.stdout:4/707: link d1/dc/df/d38/l90 d1/d8/d3d/lde 0 2024-02-28T23:07:42.788 INFO:tasks.workunit.client.1.smithi184.stdout:4/708: chown d1/d4 187140 1 2024-02-28T23:07:42.791 INFO:tasks.workunit.client.1.smithi184.stdout:8/746: dread d1/da/f31 [4194304,4194304] 0 2024-02-28T23:07:42.792 INFO:tasks.workunit.client.0.smithi159.stdout:7/842: write d5/d16/d1a/d27/d3e/f4a [167563,51842] 0 2024-02-28T23:07:42.793 INFO:tasks.workunit.client.1.smithi184.stdout:7/687: symlink d6/d9/d13/d1e/d2f/d98/lee 0 2024-02-28T23:07:42.794 INFO:tasks.workunit.client.1.smithi184.stdout:4/709: write d1/d8/d19/d67/d99/f72 [1061800,71337] 0 2024-02-28T23:07:42.799 INFO:tasks.workunit.client.1.smithi184.stdout:6/670: dwrite f8 [4194304,4194304] 0 2024-02-28T23:07:42.802 INFO:tasks.workunit.client.1.smithi184.stdout:2/680: rename d10/d1f/d38/d54/d96 to d10/d1f/d21/d5e/dad/da3/dd6 0 2024-02-28T23:07:42.804 INFO:tasks.workunit.client.1.smithi184.stdout:0/774: link d0/df/d13/d27/d31/f8f d0/d7c/f107 0 2024-02-28T23:07:42.806 INFO:tasks.workunit.client.1.smithi184.stdout:1/777: link d20/d46/f6c d20/d32/dc0/f109 0 2024-02-28T23:07:42.808 INFO:tasks.workunit.client.1.smithi184.stdout:3/775: write d1/d4/d1c/d62/d66/dd3/d26/fe4 [2380809,79516] 0 2024-02-28T23:07:42.809 INFO:tasks.workunit.client.1.smithi184.stdout:5/730: creat db/d12/d1c/fe9 x:0 0 0 2024-02-28T23:07:42.809 INFO:tasks.workunit.client.1.smithi184.stdout:7/688: creat d6/d9/d13/d3e/dad/d49/d50/db2/fef x:0 0 0 2024-02-28T23:07:42.811 INFO:tasks.workunit.client.1.smithi184.stdout:6/671: mknod dc/d60/cd5 0 2024-02-28T23:07:42.812 INFO:tasks.workunit.client.1.smithi184.stdout:1/778: read d20/d32/f48 [7906802,42358] 0 2024-02-28T23:07:42.814 INFO:tasks.workunit.client.1.smithi184.stdout:3/776: write d1/d4/d1c/d62/d66/dd3/d26/feb [1032698,119087] 0 2024-02-28T23:07:42.816 INFO:tasks.workunit.client.1.smithi184.stdout:0/775: read - d0/df/f96 zero size 2024-02-28T23:07:42.821 INFO:tasks.workunit.client.1.smithi184.stdout:5/731: creat db/d90/de1/fea x:0 0 0 2024-02-28T23:07:42.822 INFO:tasks.workunit.client.1.smithi184.stdout:8/747: dread d1/da/dc/d16/d29/f2a [0,4194304] 0 2024-02-28T23:07:42.823 INFO:tasks.workunit.client.1.smithi184.stdout:6/672: mknod dc/de/d2a/d8e/cd6 0 2024-02-28T23:07:42.830 INFO:tasks.workunit.client.1.smithi184.stdout:1/779: write d20/d32/d3e/d91/faa [4522258,127785] 0 2024-02-28T23:07:42.831 INFO:tasks.workunit.client.0.smithi159.stdout:2/962: dwrite d9/d50/d54/d84/f114 [0,4194304] 0 2024-02-28T23:07:42.832 INFO:tasks.workunit.client.0.smithi159.stdout:2/963: readlink d9/l141 0 2024-02-28T23:07:42.839 INFO:tasks.workunit.client.1.smithi184.stdout:0/776: rename d0/df/d13/d27/d31/db3/db4 to d0/d1f/de3/d95/d108 0 2024-02-28T23:07:42.840 INFO:tasks.workunit.client.1.smithi184.stdout:0/777: chown d0/d1d/d3a/f60 212816 1 2024-02-28T23:07:42.842 INFO:tasks.workunit.client.1.smithi184.stdout:0/778: chown d0/df/d13/l3c 157556 1 2024-02-28T23:07:42.843 INFO:tasks.workunit.client.0.smithi159.stdout:7/843: dread d5/d56/d50/d88/fd0 [0,4194304] 0 2024-02-28T23:07:42.854 INFO:tasks.workunit.client.1.smithi184.stdout:9/723: dwrite d5/d47/f88 [0,4194304] 0 2024-02-28T23:07:42.856 INFO:tasks.workunit.client.1.smithi184.stdout:9/724: chown d5/db/de/d10/d12/f9e 20590 1 2024-02-28T23:07:42.857 INFO:tasks.workunit.client.1.smithi184.stdout:9/725: chown d5/d26/d50/c34 370 1 2024-02-28T23:07:42.859 INFO:tasks.workunit.client.1.smithi184.stdout:9/726: chown d5/db/de/d10/d12 2 1 2024-02-28T23:07:42.860 INFO:tasks.workunit.client.1.smithi184.stdout:4/710: write d1/d8/d19/d92/f65 [546511,4829] 0 2024-02-28T23:07:42.861 INFO:tasks.workunit.client.1.smithi184.stdout:9/727: dread - d5/db/de/d10/d6a/f9b zero size 2024-02-28T23:07:42.871 INFO:tasks.workunit.client.1.smithi184.stdout:2/681: dwrite d10/d1f/d21/d5e/f58 [4194304,4194304] 0 2024-02-28T23:07:42.874 INFO:tasks.workunit.client.1.smithi184.stdout:2/682: chown d10/d1f/d21 14926 1 2024-02-28T23:07:42.874 INFO:tasks.workunit.client.1.smithi184.stdout:5/732: dread db/d44/f84 [0,4194304] 0 2024-02-28T23:07:42.877 INFO:tasks.workunit.client.1.smithi184.stdout:3/777: dwrite d1/d4/f89 [0,4194304] 0 2024-02-28T23:07:42.880 INFO:tasks.workunit.client.0.smithi159.stdout:2/964: dwrite d9/f25 [4194304,4194304] 0 2024-02-28T23:07:42.885 INFO:tasks.workunit.client.1.smithi184.stdout:7/689: dwrite d6/d9/d13/d1e/d2f/f89 [0,4194304] 0 2024-02-28T23:07:42.888 INFO:tasks.workunit.client.0.smithi159.stdout:7/844: dwrite d5/f12 [4194304,4194304] 0 2024-02-28T23:07:42.895 INFO:tasks.workunit.client.1.smithi184.stdout:0/779: truncate d0/df/d13/d27/d31/d51/f73 798815 0 2024-02-28T23:07:42.895 INFO:tasks.workunit.client.1.smithi184.stdout:3/778: dread - d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d82/dc8/fdd zero size 2024-02-28T23:07:42.895 INFO:tasks.workunit.client.0.smithi159.stdout:2/965: link d9/la d9/d50/dcc/d44/l14e 0 2024-02-28T23:07:42.896 INFO:tasks.workunit.client.1.smithi184.stdout:8/748: dwrite d1/da/f5b [0,4194304] 0 2024-02-28T23:07:42.897 INFO:tasks.workunit.client.1.smithi184.stdout:4/711: write d1/dc/df/d5b/fa9 [938725,109485] 0 2024-02-28T23:07:42.900 INFO:tasks.workunit.client.1.smithi184.stdout:2/683: creat d10/d1f/d21/d5e/dad/dc7/fd7 x:0 0 0 2024-02-28T23:07:42.900 INFO:tasks.workunit.client.1.smithi184.stdout:9/728: creat d5/db/de/d10/dc9/fe4 x:0 0 0 2024-02-28T23:07:42.900 INFO:tasks.workunit.client.0.smithi159.stdout:2/966: fsync d9/d50/d54/d84/d37/d5c/f7b 0 2024-02-28T23:07:42.902 INFO:tasks.workunit.client.1.smithi184.stdout:2/684: readlink d10/d55/lce 0 2024-02-28T23:07:42.906 INFO:tasks.workunit.client.1.smithi184.stdout:7/690: creat d6/d9/d13/d3e/ff0 x:0 0 0 2024-02-28T23:07:42.907 INFO:tasks.workunit.client.1.smithi184.stdout:1/780: mkdir d20/d32/d3e/d61/d8b/d9c/d10a 0 2024-02-28T23:07:42.909 INFO:tasks.workunit.client.0.smithi159.stdout:2/967: rmdir d9/d50/d54/d84/d37/d5c 39 2024-02-28T23:07:42.909 INFO:tasks.workunit.client.1.smithi184.stdout:3/779: stat d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/caf 0 2024-02-28T23:07:42.911 INFO:tasks.workunit.client.1.smithi184.stdout:5/733: dread db/f7c [0,4194304] 0 2024-02-28T23:07:42.911 INFO:tasks.workunit.client.1.smithi184.stdout:8/749: creat d1/da/dc/d18/f10f x:0 0 0 2024-02-28T23:07:42.913 INFO:tasks.workunit.client.1.smithi184.stdout:6/673: mknod dc/de/d2a/d8e/dad/d8a/da1/cd7 0 2024-02-28T23:07:42.914 INFO:tasks.workunit.client.1.smithi184.stdout:2/685: unlink d10/d1f/d21/d5e/dad/dc7/ccd 0 2024-02-28T23:07:42.916 INFO:tasks.workunit.client.0.smithi159.stdout:2/968: creat d9/d50/d54/d84/d113/d12b/f14f x:0 0 0 2024-02-28T23:07:42.919 INFO:tasks.workunit.client.0.smithi159.stdout:2/969: chown d9/d23/d2c/d55/d13/f40 127 1 2024-02-28T23:07:42.920 INFO:tasks.workunit.client.1.smithi184.stdout:4/712: creat d1/d8/d19/d92/db3/fdf x:0 0 0 2024-02-28T23:07:42.922 INFO:tasks.workunit.client.1.smithi184.stdout:1/781: symlink d20/d32/d3e/d82/d85/d8c/l10b 0 2024-02-28T23:07:42.922 INFO:tasks.workunit.client.1.smithi184.stdout:6/674: stat dc/de/d2a/d5c/d79/d87/d9a/fc7 0 2024-02-28T23:07:42.923 INFO:tasks.workunit.client.1.smithi184.stdout:4/713: readlink d1/d8/d19/d56/d7a/ld3 0 2024-02-28T23:07:42.925 INFO:tasks.workunit.client.1.smithi184.stdout:1/782: write d20/d46/fcd [389320,35703] 0 2024-02-28T23:07:42.927 INFO:tasks.workunit.client.1.smithi184.stdout:8/750: truncate d1/da/d10/fca 941064 0 2024-02-28T23:07:42.932 INFO:tasks.workunit.client.1.smithi184.stdout:2/686: creat d10/d1f/d21/d4d/d67/d65/fd8 x:0 0 0 2024-02-28T23:07:42.935 INFO:tasks.workunit.client.1.smithi184.stdout:9/729: dwrite d5/d17/d43/f48 [0,4194304] 0 2024-02-28T23:07:42.940 INFO:tasks.workunit.client.1.smithi184.stdout:8/751: symlink d1/da/d10/d17/l110 0 2024-02-28T23:07:42.945 INFO:tasks.workunit.client.1.smithi184.stdout:0/780: dread d0/d1f/f25 [0,4194304] 0 2024-02-28T23:07:42.945 INFO:tasks.workunit.client.1.smithi184.stdout:4/714: dread d1/dc/df/d5b/fa6 [0,4194304] 0 2024-02-28T23:07:42.948 INFO:tasks.workunit.client.0.smithi159.stdout:7/845: write d5/d56/d2a/fdf [679855,336] 0 2024-02-28T23:07:42.949 INFO:tasks.workunit.client.1.smithi184.stdout:9/730: dread - d5/d17/d43/f99 zero size 2024-02-28T23:07:42.950 INFO:tasks.workunit.client.0.smithi159.stdout:7/846: stat d5/d16/d1a/d27/d3e 0 2024-02-28T23:07:42.951 INFO:tasks.workunit.client.1.smithi184.stdout:2/687: rename d10/d1f/d21/d4d/f50 to d10/d1f/d21/d5e/dad/da3/dd6/dab/fd9 0 2024-02-28T23:07:42.952 INFO:tasks.workunit.client.1.smithi184.stdout:9/731: chown d5/db/de/d10/f7a 51587157 1 2024-02-28T23:07:42.953 INFO:tasks.workunit.client.1.smithi184.stdout:8/752: symlink d1/da/dc/d16/d32/d80/l111 0 2024-02-28T23:07:42.953 INFO:tasks.workunit.client.1.smithi184.stdout:9/732: fsync d5/fc 0 2024-02-28T23:07:42.954 INFO:tasks.workunit.client.1.smithi184.stdout:8/753: readlink d1/da/d10/d17/l49 0 2024-02-28T23:07:42.956 INFO:tasks.workunit.client.1.smithi184.stdout:7/691: getdents d6/d9/d13/d3e/dad/d49/da6 0 2024-02-28T23:07:42.959 INFO:tasks.workunit.client.1.smithi184.stdout:0/781: dread d0/d1f/f43 [0,4194304] 0 2024-02-28T23:07:42.960 INFO:tasks.workunit.client.1.smithi184.stdout:6/675: symlink dc/d60/d6d/ld8 0 2024-02-28T23:07:42.960 INFO:tasks.workunit.client.1.smithi184.stdout:2/688: readlink d10/l81 0 2024-02-28T23:07:42.962 INFO:tasks.workunit.client.1.smithi184.stdout:2/689: readlink d10/d1f/d21/d5e/dad/l7b 0 2024-02-28T23:07:42.962 INFO:tasks.workunit.client.1.smithi184.stdout:4/715: mknod d1/d9a/dd0/ce0 0 2024-02-28T23:07:42.964 INFO:tasks.workunit.client.1.smithi184.stdout:8/754: mknod d1/da/dc/d16/d32/d42/d77/c112 0 2024-02-28T23:07:42.965 INFO:tasks.workunit.client.1.smithi184.stdout:1/783: link d20/d32/l95 d20/d32/d3e/d61/d8b/d9c/l10c 0 2024-02-28T23:07:42.969 INFO:tasks.workunit.client.1.smithi184.stdout:1/784: stat d20/d32/d3e/d82/fa8 0 2024-02-28T23:07:42.972 INFO:tasks.workunit.client.1.smithi184.stdout:0/782: rename d0/df/d13/d27/d31/d5b/d8e/d91 to d0/d1f/d109 0 2024-02-28T23:07:42.973 INFO:tasks.workunit.client.1.smithi184.stdout:3/780: dwrite d1/d4/d1c/d61/f90 [0,4194304] 0 2024-02-28T23:07:42.975 INFO:tasks.workunit.client.1.smithi184.stdout:7/692: dwrite d6/d9/d13/d3e/d7e/fa3 [0,4194304] 0 2024-02-28T23:07:42.975 INFO:tasks.workunit.client.1.smithi184.stdout:5/734: truncate db/d12/d18/d2e/fd2 95865 0 2024-02-28T23:07:42.976 INFO:tasks.workunit.client.0.smithi159.stdout:2/970: dwrite d9/d23/d2c/d55/f2f [0,4194304] 0 2024-02-28T23:07:42.981 INFO:tasks.workunit.client.1.smithi184.stdout:6/676: unlink dc/d60/d7c/d90/fa6 0 2024-02-28T23:07:42.983 INFO:tasks.workunit.client.0.smithi159.stdout:7/847: write d5/d16/d1a/d27/d37/f42 [950007,106055] 0 2024-02-28T23:07:42.993 INFO:tasks.workunit.client.1.smithi184.stdout:2/690: creat d10/d1f/d21/d5e/d15/d60/fda x:0 0 0 2024-02-28T23:07:42.995 INFO:tasks.workunit.client.1.smithi184.stdout:2/691: dread - d10/d1f/d38/d54/fbc zero size 2024-02-28T23:07:42.995 INFO:tasks.workunit.client.0.smithi159.stdout:3/926: sync 2024-02-28T23:07:42.996 INFO:tasks.workunit.client.1.smithi184.stdout:0/783: creat d0/df/d13/d27/d58/f10a x:0 0 0 2024-02-28T23:07:42.999 INFO:tasks.workunit.client.1.smithi184.stdout:9/733: truncate d5/db/de/d10/f7a 107693 0 2024-02-28T23:07:43.003 INFO:tasks.workunit.client.0.smithi159.stdout:7/848: symlink d5/d16/d1a/d27/l10b 0 2024-02-28T23:07:43.009 INFO:tasks.workunit.client.0.smithi159.stdout:7/849: truncate d5/d16/d1a/d27/d3e/f3f 3700465 0 2024-02-28T23:07:43.015 INFO:tasks.workunit.client.1.smithi184.stdout:5/735: rmdir db/d12/d18/db5 39 2024-02-28T23:07:43.015 INFO:tasks.workunit.client.1.smithi184.stdout:8/755: mknod d1/da/df/d10e/c113 0 2024-02-28T23:07:43.016 INFO:tasks.workunit.client.1.smithi184.stdout:0/784: creat d0/d1f/d109/dcb/f10b x:0 0 0 2024-02-28T23:07:43.017 INFO:tasks.workunit.client.0.smithi159.stdout:7/850: write d5/d16/d1a/d27/d75/dac/ff4 [2403017,24267] 0 2024-02-28T23:07:43.021 INFO:tasks.workunit.client.0.smithi159.stdout:2/971: dwrite d9/d36/dc3/f104 [0,4194304] 0 2024-02-28T23:07:43.021 INFO:tasks.workunit.client.1.smithi184.stdout:9/734: unlink d5/d47/f88 0 2024-02-28T23:07:43.023 INFO:tasks.workunit.client.1.smithi184.stdout:9/735: truncate d5/d47/fc3 1153853 0 2024-02-28T23:07:43.023 INFO:tasks.workunit.client.0.smithi159.stdout:3/927: write d0/d3f/dd2/d6a/fa0 [708018,81083] 0 2024-02-28T23:07:43.024 INFO:tasks.workunit.client.1.smithi184.stdout:3/781: link d1/d4/d1c/d62/d66/dd3/d26/fe4 d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/dee/ff4 0 2024-02-28T23:07:43.028 INFO:tasks.workunit.client.1.smithi184.stdout:1/785: link d20/d46/c56 d20/d32/d4b/c10d 0 2024-02-28T23:07:43.028 INFO:tasks.workunit.client.1.smithi184.stdout:6/677: creat dc/d60/d7c/d61/dd3/fd9 x:0 0 0 2024-02-28T23:07:43.030 INFO:tasks.workunit.client.1.smithi184.stdout:1/786: write d20/d32/f44 [3710617,80457] 0 2024-02-28T23:07:43.036 INFO:tasks.workunit.client.0.smithi159.stdout:7/851: mkdir d5/d16/d1a/d27/dff/d10c 0 2024-02-28T23:07:43.038 INFO:tasks.workunit.client.1.smithi184.stdout:2/692: rename l6 to d10/d1f/d21/d5e/d15/d24/d94/ldb 0 2024-02-28T23:07:43.047 INFO:tasks.workunit.client.0.smithi159.stdout:7/852: rename d5/d16/d1a/d27/dff/d10c to d5/d16/d1a/d27/d46/d65/d81/d98/de5/d10d 0 2024-02-28T23:07:43.050 INFO:tasks.workunit.client.1.smithi184.stdout:3/782: unlink d1/d4/d1c/d61/le7 0 2024-02-28T23:07:43.054 INFO:tasks.workunit.client.0.smithi159.stdout:2/972: getdents d9/d50/d62 0 2024-02-28T23:07:43.056 INFO:tasks.workunit.client.0.smithi159.stdout:7/853: mkdir d5/d16/d1a/d27/d46/d101/d64/db4/d10e 0 2024-02-28T23:07:43.059 INFO:tasks.workunit.client.1.smithi184.stdout:0/785: write d0/fad [634404,43161] 0 2024-02-28T23:07:43.062 INFO:tasks.workunit.client.1.smithi184.stdout:2/693: stat d10/d33/l4e 0 2024-02-28T23:07:43.063 INFO:tasks.workunit.client.0.smithi159.stdout:3/928: dread d0/d2b/fba [0,4194304] 0 2024-02-28T23:07:43.064 INFO:tasks.workunit.client.0.smithi159.stdout:2/973: rename d9/d50/d62/fc2 to d9/d50/d54/d84/f150 0 2024-02-28T23:07:43.074 INFO:tasks.workunit.client.0.smithi159.stdout:7/854: creat d5/d16/d1a/d27/deb/f10f x:0 0 0 2024-02-28T23:07:43.075 INFO:tasks.workunit.client.0.smithi159.stdout:2/974: rename d9/d50/d54/d84/f143 to d9/d80/f151 0 2024-02-28T23:07:43.083 INFO:tasks.workunit.client.1.smithi184.stdout:8/756: link d1/da/d10/d17/d63/fa4 d1/da/df/f114 0 2024-02-28T23:07:43.085 INFO:tasks.workunit.client.1.smithi184.stdout:9/736: link d5/d17/d8f/la4 d5/d26/le5 0 2024-02-28T23:07:43.085 INFO:tasks.workunit.client.0.smithi159.stdout:2/975: truncate d9/d50/dcc/d44/dc0/feb 5296410 0 2024-02-28T23:07:43.086 INFO:tasks.workunit.client.0.smithi159.stdout:7/855: creat d5/d16/d1a/d27/d3e/dee/f110 x:0 0 0 2024-02-28T23:07:43.088 INFO:tasks.workunit.client.1.smithi184.stdout:3/783: mkdir d1/d4/d1c/d62/d66/da6/df5 0 2024-02-28T23:07:43.088 INFO:tasks.workunit.client.1.smithi184.stdout:8/757: stat d1/da/df/d10e/c113 0 2024-02-28T23:07:43.089 INFO:tasks.workunit.client.0.smithi159.stdout:3/929: dwrite d0/def/d79/d9b/fb2 [0,4194304] 0 2024-02-28T23:07:43.091 INFO:tasks.workunit.client.0.smithi159.stdout:2/976: mknod d9/d50/dcc/d44/dc0/c152 0 2024-02-28T23:07:43.093 INFO:tasks.workunit.client.0.smithi159.stdout:3/930: fsync d0/d2b/d55/df8/da9/fe5 0 2024-02-28T23:07:43.093 INFO:tasks.workunit.client.0.smithi159.stdout:7/856: fdatasync d5/d16/d1a/d27/d46/d65/fb7 0 2024-02-28T23:07:43.094 INFO:tasks.workunit.client.1.smithi184.stdout:0/786: fdatasync d0/df/d13/d27/d31/d51/f73 0 2024-02-28T23:07:43.099 INFO:tasks.workunit.client.0.smithi159.stdout:3/931: truncate d0/d2b/d55/df8/d2f/d78/fc7 1168645 0 2024-02-28T23:07:43.100 INFO:tasks.workunit.client.1.smithi184.stdout:1/787: getdents d20/d32/d4b 0 2024-02-28T23:07:43.102 INFO:tasks.workunit.client.1.smithi184.stdout:9/737: creat d5/d47/d68/d7c/fe6 x:0 0 0 2024-02-28T23:07:43.104 INFO:tasks.workunit.client.1.smithi184.stdout:8/758: creat d1/da/dc/d16/f115 x:0 0 0 2024-02-28T23:07:43.104 INFO:tasks.workunit.client.1.smithi184.stdout:3/784: write d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d82/fc7 [730391,96979] 0 2024-02-28T23:07:43.104 INFO:tasks.workunit.client.0.smithi159.stdout:7/857: mkdir d5/d16/d1a/d27/d46/d101/d64/db4/d10e/d111 0 2024-02-28T23:07:43.105 INFO:tasks.workunit.client.1.smithi184.stdout:2/694: dread d10/d1f/d21/d5e/d15/f1b [0,4194304] 0 2024-02-28T23:07:43.106 INFO:tasks.workunit.client.0.smithi159.stdout:7/858: chown d5/d16/d40/dce 35 1 2024-02-28T23:07:43.106 INFO:tasks.workunit.client.0.smithi159.stdout:2/977: link d9/d36/d59/ld7 d9/d50/d62/dba/l153 0 2024-02-28T23:07:43.107 INFO:tasks.workunit.client.1.smithi184.stdout:6/678: dwrite dc/d60/d62/f82 [0,4194304] 0 2024-02-28T23:07:43.108 INFO:tasks.workunit.client.1.smithi184.stdout:0/787: creat d0/df/d13/d27/d58/de1/f10c x:0 0 0 2024-02-28T23:07:43.108 INFO:tasks.workunit.client.1.smithi184.stdout:2/695: fsync d10/d1f/d38/d54/fbc 0 2024-02-28T23:07:43.109 INFO:tasks.workunit.client.1.smithi184.stdout:8/759: write d1/da/df/ffb [538630,77691] 0 2024-02-28T23:07:43.113 INFO:tasks.workunit.client.1.smithi184.stdout:1/788: write d20/d32/d3e/d82/d85/fdf [767998,56761] 0 2024-02-28T23:07:43.113 INFO:tasks.workunit.client.0.smithi159.stdout:2/978: mkdir d9/d50/d54/d84/d113/d12b/d154 0 2024-02-28T23:07:43.115 INFO:tasks.workunit.client.1.smithi184.stdout:0/788: dread - d0/df/d13/d27/d58/de1/f10c zero size 2024-02-28T23:07:43.115 INFO:tasks.workunit.client.0.smithi159.stdout:3/932: dwrite d0/d47/d88/da5/f127 [0,4194304] 0 2024-02-28T23:07:43.115 INFO:tasks.workunit.client.0.smithi159.stdout:7/859: getdents d5/d16/d1a/d27/d75/dac 0 2024-02-28T23:07:43.116 INFO:tasks.workunit.client.0.smithi159.stdout:2/979: chown d9/d50/d62/dba/d105/f10e 488192 1 2024-02-28T23:07:43.120 INFO:tasks.workunit.client.0.smithi159.stdout:7/860: fdatasync d5/d16/d1a/d27/d46/f103 0 2024-02-28T23:07:43.120 INFO:tasks.workunit.client.1.smithi184.stdout:4/716: sync 2024-02-28T23:07:43.121 INFO:tasks.workunit.client.1.smithi184.stdout:9/738: dread d5/d26/d50/f35 [0,4194304] 0 2024-02-28T23:07:43.121 INFO:tasks.workunit.client.1.smithi184.stdout:3/785: creat d1/d4/d5/ff6 x:0 0 0 2024-02-28T23:07:43.122 INFO:tasks.workunit.client.1.smithi184.stdout:4/717: write d1/d8/d35/fc0 [1831093,117901] 0 2024-02-28T23:07:43.124 INFO:tasks.workunit.client.0.smithi159.stdout:7/861: fdatasync d5/d16/d1a/d27/d46/d65/d81/d98/de5/ff6 0 2024-02-28T23:07:43.125 INFO:tasks.workunit.client.1.smithi184.stdout:3/786: read - d1/d4/d1c/d62/d66/dd3/d26/d3a/fd7 zero size 2024-02-28T23:07:43.126 INFO:tasks.workunit.client.1.smithi184.stdout:4/718: fsync d1/dc/df/f59 0 2024-02-28T23:07:43.129 INFO:tasks.workunit.client.0.smithi159.stdout:7/862: write d5/d16/d1a/d27/d75/dac/ff4 [2024256,43693] 0 2024-02-28T23:07:43.129 INFO:tasks.workunit.client.1.smithi184.stdout:3/787: dread - d1/d4/d1c/d61/fc0 zero size 2024-02-28T23:07:43.138 INFO:tasks.workunit.client.1.smithi184.stdout:1/789: dwrite d20/d32/d4b/fa1 [0,4194304] 0 2024-02-28T23:07:43.138 INFO:tasks.workunit.client.1.smithi184.stdout:2/696: creat d10/fdc x:0 0 0 2024-02-28T23:07:43.146 INFO:tasks.workunit.client.1.smithi184.stdout:4/719: chown d1/dc/df/d27/c2e 119330820 1 2024-02-28T23:07:43.146 INFO:tasks.workunit.client.1.smithi184.stdout:4/720: readlink d1/d8/l2b 0 2024-02-28T23:07:43.151 INFO:tasks.workunit.client.0.smithi159.stdout:7/863: dwrite d5/d16/d1a/d27/d3e/dee/f110 [0,4194304] 0 2024-02-28T23:07:43.153 INFO:tasks.workunit.client.1.smithi184.stdout:6/679: link dc/d42/c72 dc/d60/d62/d6f/d99/d9d/cda 0 2024-02-28T23:07:43.155 INFO:tasks.workunit.client.1.smithi184.stdout:6/680: dread - dc/de/d2a/d8e/dad/d8a/da1/fc8 zero size 2024-02-28T23:07:43.156 INFO:tasks.workunit.client.1.smithi184.stdout:6/681: readlink dc/de/d10/d16/l3f 0 2024-02-28T23:07:43.160 INFO:tasks.workunit.client.1.smithi184.stdout:0/789: rename d0/df/d13/d27/d31/db3 to d0/d1d/d3a/d10d 0 2024-02-28T23:07:43.167 INFO:tasks.workunit.client.1.smithi184.stdout:1/790: symlink d20/d32/dc0/l10e 0 2024-02-28T23:07:43.170 INFO:tasks.workunit.client.1.smithi184.stdout:2/697: symlink d10/d1f/d21/d5e/d15/dc8/ldd 0 2024-02-28T23:07:43.175 INFO:tasks.workunit.client.1.smithi184.stdout:5/736: sync 2024-02-28T23:07:43.176 INFO:tasks.workunit.client.1.smithi184.stdout:7/693: sync 2024-02-28T23:07:43.176 INFO:tasks.workunit.client.1.smithi184.stdout:4/721: mknod d1/d8/d19/d92/db3/ce1 0 2024-02-28T23:07:43.176 INFO:tasks.workunit.client.1.smithi184.stdout:5/737: fdatasync db/fb3 0 2024-02-28T23:07:43.188 INFO:tasks.workunit.client.1.smithi184.stdout:2/698: fdatasync d10/f14 0 2024-02-28T23:07:43.190 INFO:tasks.workunit.client.1.smithi184.stdout:8/760: dwrite d1/da/dc/d16/d4d/f5a [0,4194304] 0 2024-02-28T23:07:43.191 INFO:tasks.workunit.client.1.smithi184.stdout:9/739: write d5/d26/d50/f3b [5036129,92447] 0 2024-02-28T23:07:43.193 INFO:tasks.workunit.client.1.smithi184.stdout:3/788: creat d1/d4/d6/ff7 x:0 0 0 2024-02-28T23:07:43.195 INFO:tasks.workunit.client.0.smithi159.stdout:7/864: fsync d5/d16/d1a/d27/f31 0 2024-02-28T23:07:43.204 INFO:tasks.workunit.client.1.smithi184.stdout:5/738: rename db/d12/d1c/d80/fb9 to db/d44/da5/feb 0 2024-02-28T23:07:43.204 INFO:tasks.workunit.client.1.smithi184.stdout:8/761: dread d1/da/f31 [4194304,4194304] 0 2024-02-28T23:07:43.210 INFO:tasks.workunit.client.0.smithi159.stdout:7/865: rename d5/d56/d2a/cc5 to d5/d16/d1a/d27/d46/d65/d81/d98/c112 0 2024-02-28T23:07:43.211 INFO:tasks.workunit.client.0.smithi159.stdout:2/980: link d9/d50/d54/l89 d9/d50/l155 0 2024-02-28T23:07:43.214 INFO:tasks.workunit.client.0.smithi159.stdout:3/933: creat d0/d2b/d55/df8/da9/f12c x:0 0 0 2024-02-28T23:07:43.215 INFO:tasks.workunit.client.1.smithi184.stdout:2/699: symlink d10/d1f/d21/d5e/d15/d24/d5f/lde 0 2024-02-28T23:07:43.217 INFO:tasks.workunit.client.0.smithi159.stdout:2/981: mkdir d9/d50/d54/d84/d113/d12b/d156 0 2024-02-28T23:07:43.218 INFO:tasks.workunit.client.1.smithi184.stdout:2/700: write d10/d1f/d21/d5e/d15/dc8/fd3 [73006,47860] 0 2024-02-28T23:07:43.224 INFO:tasks.workunit.client.0.smithi159.stdout:7/866: symlink d5/d16/d1a/d27/d46/l113 0 2024-02-28T23:07:43.225 INFO:tasks.workunit.client.1.smithi184.stdout:0/790: write d0/df/d13/f49 [661290,67758] 0 2024-02-28T23:07:43.225 INFO:tasks.workunit.client.1.smithi184.stdout:4/722: symlink d1/dc/df/d5b/db2/d9f/da0/le2 0 2024-02-28T23:07:43.228 INFO:tasks.workunit.client.0.smithi159.stdout:2/982: rmdir d9/d50 39 2024-02-28T23:07:43.228 INFO:tasks.workunit.client.1.smithi184.stdout:4/723: read d1/dc/df/f59 [605222,54263] 0 2024-02-28T23:07:43.230 INFO:tasks.workunit.client.1.smithi184.stdout:7/694: rename d6/d9/d13/d3e/dad/d49/de0 to d6/d9/d13/d1e/d2f/d98/dc4/df1 0 2024-02-28T23:07:43.232 INFO:tasks.workunit.client.1.smithi184.stdout:7/695: fsync d6/d9/d13/d14/f7b 0 2024-02-28T23:07:43.236 INFO:tasks.workunit.client.1.smithi184.stdout:6/682: write dc/d60/d6d/f83 [2904973,33034] 0 2024-02-28T23:07:43.239 INFO:tasks.workunit.client.1.smithi184.stdout:8/762: read d1/da/dc/d16/d32/f98 [877501,74623] 0 2024-02-28T23:07:43.240 INFO:tasks.workunit.client.1.smithi184.stdout:1/791: link d20/d32/d3e/da2/cf3 d20/d32/db0/c10f 0 2024-02-28T23:07:43.243 INFO:tasks.workunit.client.1.smithi184.stdout:1/792: write d20/d32/db0/fae [1630075,87568] 0 2024-02-28T23:07:43.252 INFO:tasks.workunit.client.1.smithi184.stdout:9/740: symlink d5/db/de/d10/d12/le7 0 2024-02-28T23:07:43.254 INFO:tasks.workunit.client.1.smithi184.stdout:3/789: creat d1/d4/d1c/d62/d66/dd3/d24/d76/ff8 x:0 0 0 2024-02-28T23:07:43.256 INFO:tasks.workunit.client.1.smithi184.stdout:6/683: dwrite dc/de/d10/fb8 [0,4194304] 0 2024-02-28T23:07:43.257 INFO:tasks.workunit.client.0.smithi159.stdout:3/934: write d0/d47/d88/f99 [559956,114364] 0 2024-02-28T23:07:43.258 INFO:tasks.workunit.client.1.smithi184.stdout:3/790: chown d1/d4/d1c/d62/d66/dd3/fa5 0 1 2024-02-28T23:07:43.258 INFO:tasks.workunit.client.0.smithi159.stdout:7/867: dwrite d5/d16/d40/f4e [4194304,4194304] 0 2024-02-28T23:07:43.261 INFO:tasks.workunit.client.1.smithi184.stdout:0/791: mkdir d0/df/d13/d27/d58/de1/d10e 0 2024-02-28T23:07:43.264 INFO:tasks.workunit.client.1.smithi184.stdout:0/792: chown d0/df/d13/d27/d31/d5b/d8e/d92/cd0 29022 1 2024-02-28T23:07:43.267 INFO:tasks.workunit.client.0.smithi159.stdout:2/983: dread f6 [0,4194304] 0 2024-02-28T23:07:43.271 INFO:tasks.workunit.client.1.smithi184.stdout:0/793: dread d0/df/d13/d27/f2c [0,4194304] 0 2024-02-28T23:07:43.275 INFO:tasks.workunit.client.0.smithi159.stdout:7/868: fdatasync d5/d56/d50/daa/fa4 0 2024-02-28T23:07:43.278 INFO:tasks.workunit.client.1.smithi184.stdout:7/696: mkdir d6/d9/d13/d3e/dad/d7d/d8d/df2 0 2024-02-28T23:07:43.282 INFO:tasks.workunit.client.0.smithi159.stdout:3/935: dread d0/d47/d88/f99 [0,4194304] 0 2024-02-28T23:07:43.302 INFO:tasks.workunit.client.1.smithi184.stdout:9/741: symlink d5/db/de/d10/d12/d2f/d3f/le8 0 2024-02-28T23:07:43.307 INFO:tasks.workunit.client.1.smithi184.stdout:0/794: creat d0/df/d13/d27/d31/d5b/d8e/da3/f10f x:0 0 0 2024-02-28T23:07:43.311 INFO:tasks.workunit.client.1.smithi184.stdout:5/739: sync 2024-02-28T23:07:43.312 INFO:tasks.workunit.client.1.smithi184.stdout:6/684: link dc/d60/d62/f82 dc/d42/fdb 0 2024-02-28T23:07:43.312 INFO:tasks.workunit.client.0.smithi159.stdout:3/936: mkdir d0/d2b/d55/df8/d10c/d12d 0 2024-02-28T23:07:43.316 INFO:tasks.workunit.client.0.smithi159.stdout:7/869: dwrite d5/f3d [0,4194304] 0 2024-02-28T23:07:43.316 INFO:tasks.workunit.client.0.smithi159.stdout:2/984: getdents d9/d50/d54/d84/d113/d12b 0 2024-02-28T23:07:43.317 INFO:tasks.workunit.client.1.smithi184.stdout:9/742: rename d5/db/de/dc5 to d5/db/de/d10/dc9/de9 0 2024-02-28T23:07:43.320 INFO:tasks.workunit.client.1.smithi184.stdout:1/793: dread d20/d32/db0/fd3 [0,4194304] 0 2024-02-28T23:07:43.320 INFO:tasks.workunit.client.1.smithi184.stdout:7/697: mkdir d6/d9/d13/d14/d45/df3 0 2024-02-28T23:07:43.323 INFO:tasks.workunit.client.1.smithi184.stdout:3/791: creat d1/d4/d6/d1e/ff9 x:0 0 0 2024-02-28T23:07:43.323 INFO:tasks.workunit.client.0.smithi159.stdout:2/985: mknod d9/d50/d62/dce/d136/c157 0 2024-02-28T23:07:43.324 INFO:tasks.workunit.client.1.smithi184.stdout:7/698: readlink d6/d9/d13/d1e/d2f/d33/lc8 0 2024-02-28T23:07:43.324 INFO:tasks.workunit.client.1.smithi184.stdout:0/795: mknod d0/df/d13/d27/d58/de1/c110 0 2024-02-28T23:07:43.326 INFO:tasks.workunit.client.0.smithi159.stdout:7/870: unlink d5/d56/f5a 0 2024-02-28T23:07:43.327 INFO:tasks.workunit.client.0.smithi159.stdout:2/986: creat d9/d50/dcc/f158 x:0 0 0 2024-02-28T23:07:43.327 INFO:tasks.workunit.client.1.smithi184.stdout:3/792: chown d1/d4/d6/d1e/l38 6422091 1 2024-02-28T23:07:43.327 INFO:tasks.workunit.client.1.smithi184.stdout:4/724: sync 2024-02-28T23:07:43.327 INFO:tasks.workunit.client.1.smithi184.stdout:8/763: sync 2024-02-28T23:07:43.328 INFO:tasks.workunit.client.1.smithi184.stdout:2/701: sync 2024-02-28T23:07:43.331 INFO:tasks.workunit.client.0.smithi159.stdout:2/987: mknod d9/d50/d54/d84/df2/c159 0 2024-02-28T23:07:43.333 INFO:tasks.workunit.client.1.smithi184.stdout:1/794: read d20/f72 [3125938,27993] 0 2024-02-28T23:07:43.335 INFO:tasks.workunit.client.1.smithi184.stdout:1/795: fdatasync d20/d32/d4b/fe6 0 2024-02-28T23:07:43.336 INFO:tasks.workunit.client.1.smithi184.stdout:6/685: creat dc/d60/d62/fdc x:0 0 0 2024-02-28T23:07:43.337 INFO:tasks.workunit.client.0.smithi159.stdout:2/988: symlink d9/d50/dcc/d44/dc0/l15a 0 2024-02-28T23:07:43.340 INFO:tasks.workunit.client.1.smithi184.stdout:9/743: creat d5/fea x:0 0 0 2024-02-28T23:07:43.341 INFO:tasks.workunit.client.0.smithi159.stdout:7/871: link d5/d16/d1a/lc6 d5/d56/d50/l114 0 2024-02-28T23:07:43.343 INFO:tasks.workunit.client.1.smithi184.stdout:8/764: creat d1/da/d33/dac/dc5/f116 x:0 0 0 2024-02-28T23:07:43.343 INFO:tasks.workunit.client.1.smithi184.stdout:9/744: chown d5/db/de/d10/d6a/lc8 1072614564 1 2024-02-28T23:07:43.348 INFO:tasks.workunit.client.1.smithi184.stdout:9/745: dread - d5/d47/d68/fde zero size 2024-02-28T23:07:43.348 INFO:tasks.workunit.client.0.smithi159.stdout:2/989: creat d9/d36/dfa/f15b x:0 0 0 2024-02-28T23:07:43.348 INFO:tasks.workunit.client.1.smithi184.stdout:7/699: fsync d6/d9/d13/d3e/dad/d49/da6/daf/d47/f55 0 2024-02-28T23:07:43.349 INFO:tasks.workunit.client.0.smithi159.stdout:3/937: dread d0/d2b/d55/df8/da9/fe5 [0,4194304] 0 2024-02-28T23:07:43.351 INFO:tasks.workunit.client.1.smithi184.stdout:1/796: dwrite d20/d32/d4d/f6e [0,4194304] 0 2024-02-28T23:07:43.351 INFO:tasks.workunit.client.0.smithi159.stdout:7/872: readlink d5/d16/l20 0 2024-02-28T23:07:43.353 INFO:tasks.workunit.client.1.smithi184.stdout:1/797: fsync d20/d32/d4d/fa9 0 2024-02-28T23:07:43.354 INFO:tasks.workunit.client.0.smithi159.stdout:2/990: creat d9/d50/d62/f15c x:0 0 0 2024-02-28T23:07:43.357 INFO:tasks.workunit.client.1.smithi184.stdout:6/686: rmdir dc/d60 39 2024-02-28T23:07:43.358 INFO:tasks.workunit.client.0.smithi159.stdout:7/873: unlink d5/d16/d1a/d27/d46/d65/d81/d98/l9c 0 2024-02-28T23:07:43.362 INFO:tasks.workunit.client.1.smithi184.stdout:5/740: dwrite db/d12/f77 [4194304,4194304] 0 2024-02-28T23:07:43.362 INFO:tasks.workunit.client.1.smithi184.stdout:2/702: symlink d10/d1f/d38/ldf 0 2024-02-28T23:07:43.362 INFO:tasks.workunit.client.1.smithi184.stdout:0/796: write d0/d1f/f9a [67058,5140] 0 2024-02-28T23:07:43.362 INFO:tasks.workunit.client.0.smithi159.stdout:2/991: dread - d9/d50/d54/d84/d37/f10b zero size 2024-02-28T23:07:43.365 INFO:tasks.workunit.client.1.smithi184.stdout:5/741: readlink db/d12/d1c/d21/d25/lae 0 2024-02-28T23:07:43.377 INFO:tasks.workunit.client.1.smithi184.stdout:3/793: dwrite d1/d4/d5/d40/d8f/f91 [0,4194304] 0 2024-02-28T23:07:43.379 INFO:tasks.workunit.client.1.smithi184.stdout:3/794: readlink d1/d4/d5/da9/d74/l95 0 2024-02-28T23:07:43.379 INFO:tasks.workunit.client.1.smithi184.stdout:3/795: chown d1/d4 212520 1 2024-02-28T23:07:43.380 INFO:tasks.workunit.client.0.smithi159.stdout:2/992: fdatasync d9/d23/d2c/f67 0 2024-02-28T23:07:43.383 INFO:tasks.workunit.client.1.smithi184.stdout:3/796: write d1/d4/d1c/d62/d66/dd3/d26/dd2/fd9 [191327,34421] 0 2024-02-28T23:07:43.386 INFO:tasks.workunit.client.1.smithi184.stdout:7/700: creat d6/d9/d13/d3e/dad/d7d/dc9/ff4 x:0 0 0 2024-02-28T23:07:43.389 INFO:tasks.workunit.client.1.smithi184.stdout:4/725: dread d1/d8/d35/fa7 [0,4194304] 0 2024-02-28T23:07:43.391 INFO:tasks.workunit.client.0.smithi159.stdout:7/874: mknod d5/d56/d50/d88/df5/c115 0 2024-02-28T23:07:43.394 INFO:tasks.workunit.client.0.smithi159.stdout:7/875: chown d5/d56/d50/d5b/lcf 1962562 1 2024-02-28T23:07:43.394 INFO:tasks.workunit.client.0.smithi159.stdout:3/938: write d0/d2b/d55/df8/fbb [909024,74610] 0 2024-02-28T23:07:43.399 INFO:tasks.workunit.client.1.smithi184.stdout:1/798: rename d20/d32/d3e/d82/d85/dfc/d107 to d20/d46/d90/db3/d103/d110 0 2024-02-28T23:07:43.401 INFO:tasks.workunit.client.1.smithi184.stdout:9/746: dwrite d5/db/f79 [0,4194304] 0 2024-02-28T23:07:43.403 INFO:tasks.workunit.client.1.smithi184.stdout:9/747: stat d5/db/de/d10/d12/d2f/d3f/d8d 0 2024-02-28T23:07:43.404 INFO:tasks.workunit.client.0.smithi159.stdout:2/993: rename d9/d50/d62/dba/f12a to d9/d23/d2c/d55/d13/f15d 0 2024-02-28T23:07:43.404 INFO:tasks.workunit.client.0.smithi159.stdout:7/876: symlink d5/d16/d1a/d27/d3e/l116 0 2024-02-28T23:07:43.405 INFO:tasks.workunit.client.1.smithi184.stdout:5/742: rmdir db/d12/d18/d2e/dc1 39 2024-02-28T23:07:43.408 INFO:tasks.workunit.client.1.smithi184.stdout:8/765: link d1/da/dc/d16/f115 d1/da/dc/d16/d32/d42/d77/ddd/f117 0 2024-02-28T23:07:43.409 INFO:tasks.workunit.client.0.smithi159.stdout:2/994: dread - d9/d23/d2c/d55/d13/ff9 zero size 2024-02-28T23:07:43.410 INFO:tasks.workunit.client.1.smithi184.stdout:8/766: dread - d1/da/dc/d16/d32/d42/d77/ddd/f117 zero size 2024-02-28T23:07:43.412 INFO:tasks.workunit.client.0.smithi159.stdout:7/877: getdents d5/d16/d1a/d27/d46/d101/d64/db4/dc8/d102 0 2024-02-28T23:07:43.414 INFO:tasks.workunit.client.1.smithi184.stdout:7/701: truncate d6/d9/d13/d1e/fbc 1561514 0 2024-02-28T23:07:43.415 INFO:tasks.workunit.client.1.smithi184.stdout:1/799: fdatasync d20/f35 0 2024-02-28T23:07:43.418 INFO:tasks.workunit.client.1.smithi184.stdout:6/687: rename dc/d60/d62/d6f/ca8 to dc/d60/d62/d6f/d99/cdd 0 2024-02-28T23:07:43.419 INFO:tasks.workunit.client.1.smithi184.stdout:9/748: mknod d5/d17/ceb 0 2024-02-28T23:07:43.421 INFO:tasks.workunit.client.0.smithi159.stdout:7/878: write d5/d16/d1a/d27/d3e/dee/f110 [4445704,41201] 0 2024-02-28T23:07:43.422 INFO:tasks.workunit.client.1.smithi184.stdout:4/726: symlink d1/dc/df/d27/le3 0 2024-02-28T23:07:43.423 INFO:tasks.workunit.client.1.smithi184.stdout:8/767: truncate d1/da/d10/f2f 1135925 0 2024-02-28T23:07:43.428 INFO:tasks.workunit.client.1.smithi184.stdout:7/702: dread d6/d9/d13/d3e/d7e/f8a [0,4194304] 0 2024-02-28T23:07:43.428 INFO:tasks.workunit.client.1.smithi184.stdout:2/703: dread d10/d1f/d21/d4d/d67/f95 [0,4194304] 0 2024-02-28T23:07:43.431 INFO:tasks.workunit.client.0.smithi159.stdout:3/939: dread d0/d2b/d55/df8/fbb [0,4194304] 0 2024-02-28T23:07:43.431 INFO:tasks.workunit.client.0.smithi159.stdout:7/879: creat d5/d16/d1a/d27/d46/d65/d81/d98/de5/d10d/f117 x:0 0 0 2024-02-28T23:07:43.437 INFO:tasks.workunit.client.1.smithi184.stdout:9/749: rename d5/db/de/d10/d12/dbb/cd2 to d5/db/de/de1/cec 0 2024-02-28T23:07:43.439 INFO:tasks.workunit.client.1.smithi184.stdout:5/743: dread db/d12/f47 [0,4194304] 0 2024-02-28T23:07:43.441 INFO:tasks.workunit.client.1.smithi184.stdout:7/703: mknod d6/d9/d13/d3e/dad/d49/da6/daf/ddc/cf5 0 2024-02-28T23:07:43.445 INFO:tasks.workunit.client.0.smithi159.stdout:2/995: dwrite d9/d50/d54/d84/d113/d12b/f14f [0,4194304] 0 2024-02-28T23:07:43.446 INFO:tasks.workunit.client.1.smithi184.stdout:3/797: write d1/d4/d6/d1e/f6c [1421837,100854] 0 2024-02-28T23:07:43.449 INFO:tasks.workunit.client.1.smithi184.stdout:0/797: truncate d0/df/d13/d27/d31/d5b/d8e/d92/f101 204781 0 2024-02-28T23:07:43.455 INFO:tasks.workunit.client.0.smithi159.stdout:3/940: truncate d0/d3f/dd2/f61 823430 0 2024-02-28T23:07:43.460 INFO:tasks.workunit.client.0.smithi159.stdout:2/996: unlink d9/d23/d2c/d55/l12f 0 2024-02-28T23:07:43.461 INFO:tasks.workunit.client.1.smithi184.stdout:2/704: rename d10/d55/f70 to d10/d1f/d21/d4d/d67/d65/fe0 0 2024-02-28T23:07:43.461 INFO:tasks.workunit.client.1.smithi184.stdout:2/705: read - d10/d1f/d21/d5e/fb4 zero size 2024-02-28T23:07:43.461 INFO:tasks.workunit.client.1.smithi184.stdout:3/798: dwrite d1/d4/d5/fc6 [0,4194304] 0 2024-02-28T23:07:43.469 INFO:tasks.workunit.client.1.smithi184.stdout:9/750: unlink d5/d26/d50/l41 0 2024-02-28T23:07:43.469 INFO:tasks.workunit.client.1.smithi184.stdout:9/751: write d5/d47/d68/d7c/fe6 [77175,43078] 0 2024-02-28T23:07:43.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:43 smithi159 ceph-mon[28802]: pgmap v40: 65 pgs: 65 active+clean; 3.3 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 63 MiB/s rd, 153 MiB/s wr, 349 op/s 2024-02-28T23:07:43.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:43 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:07:43.473 INFO:tasks.workunit.client.1.smithi184.stdout:8/768: write d1/da/d10/d43/f5e [655472,64928] 0 2024-02-28T23:07:43.476 INFO:tasks.workunit.client.1.smithi184.stdout:8/769: chown d1/da/df/d20 1 1 2024-02-28T23:07:43.477 INFO:tasks.workunit.client.0.smithi159.stdout:3/941: mkdir d0/d12e 0 2024-02-28T23:07:43.480 INFO:tasks.workunit.client.1.smithi184.stdout:1/800: dwrite d20/f76 [0,4194304] 0 2024-02-28T23:07:43.480 INFO:tasks.workunit.client.1.smithi184.stdout:5/744: unlink db/d12/d1c/d21/d25/dd3/fb4 0 2024-02-28T23:07:43.481 INFO:tasks.workunit.client.0.smithi159.stdout:2/997: mknod d9/d50/d54/d84/df2/d117/c15e 0 2024-02-28T23:07:43.483 INFO:tasks.workunit.client.0.smithi159.stdout:7/880: write d5/d16/d1a/d27/d46/d65/fb7 [874891,34858] 0 2024-02-28T23:07:43.486 INFO:tasks.workunit.client.1.smithi184.stdout:6/688: write dc/f75 [870200,37195] 0 2024-02-28T23:07:43.487 INFO:tasks.workunit.client.1.smithi184.stdout:9/752: dread d5/f24 [4194304,4194304] 0 2024-02-28T23:07:43.492 INFO:tasks.workunit.client.1.smithi184.stdout:2/706: fsync d10/d1f/d21/d5e/d15/f1b 0 2024-02-28T23:07:43.494 INFO:tasks.workunit.client.1.smithi184.stdout:4/727: sync 2024-02-28T23:07:43.496 INFO:tasks.workunit.client.1.smithi184.stdout:4/728: chown d1/dc/df/d3b/d5c/f7b 724446 1 2024-02-28T23:07:43.496 INFO:tasks.workunit.client.1.smithi184.stdout:5/745: dread f8 [0,4194304] 0 2024-02-28T23:07:43.497 INFO:tasks.workunit.client.1.smithi184.stdout:4/729: chown d1/dc/df/d38/d57/dd6 736022 1 2024-02-28T23:07:43.498 INFO:tasks.workunit.client.0.smithi159.stdout:2/998: rename d9/d50/d62 to d9/d50/d54/d84/df2/d15f 0 2024-02-28T23:07:43.499 INFO:tasks.workunit.client.1.smithi184.stdout:4/730: chown d1/dc/df/d3b/d5c/f7b 650857 1 2024-02-28T23:07:43.501 INFO:tasks.workunit.client.1.smithi184.stdout:9/753: dread d5/db/de/d10/dc9/fce [0,4194304] 0 2024-02-28T23:07:43.503 INFO:tasks.workunit.client.1.smithi184.stdout:8/770: symlink d1/da/dc/d16/d32/d42/d77/ddd/l118 0 2024-02-28T23:07:43.507 INFO:tasks.workunit.client.1.smithi184.stdout:1/801: fdatasync d20/f72 0 2024-02-28T23:07:43.517 INFO:tasks.workunit.client.0.smithi159.stdout:2/999: unlink d9/d50/d54/d84/d37/d5c/c86 0 2024-02-28T23:07:43.522 INFO:tasks.workunit.client.1.smithi184.stdout:6/689: stat dc/d60/d62/d6f/d99/lb4 0 2024-02-28T23:07:43.523 INFO:tasks.workunit.client.0.smithi159.stdout:3/942: write d0/d2b/d55/df8/f1e [553939,126867] 0 2024-02-28T23:07:43.525 INFO:tasks.workunit.client.1.smithi184.stdout:6/690: read dc/d42/fdb [5074264,35464] 0 2024-02-28T23:07:43.529 INFO:tasks.workunit.client.1.smithi184.stdout:2/707: creat d10/d1f/d21/d5e/d15/d24/d94/fe1 x:0 0 0 2024-02-28T23:07:43.529 INFO:tasks.workunit.client.0.smithi159.stdout:7/881: dread d5/d16/d1a/d27/d46/f8d [0,4194304] 0 2024-02-28T23:07:43.534 INFO:tasks.workunit.client.1.smithi184.stdout:4/731: truncate d1/d8/d37/f9c 1018540 0 2024-02-28T23:07:43.534 INFO:tasks.workunit.client.0.smithi159.stdout:7/882: dread - d5/d16/d1a/d27/fd5 zero size 2024-02-28T23:07:43.536 INFO:tasks.workunit.client.0.smithi159.stdout:3/943: creat d0/d2b/d55/df8/da9/f12f x:0 0 0 2024-02-28T23:07:43.537 INFO:tasks.workunit.client.1.smithi184.stdout:4/732: write d1/d4/d43/d73/fc6 [152936,8816] 0 2024-02-28T23:07:43.537 INFO:tasks.workunit.client.1.smithi184.stdout:9/754: creat d5/d17/d43/db8/fed x:0 0 0 2024-02-28T23:07:43.537 INFO:tasks.workunit.client.0.smithi159.stdout:7/883: fdatasync d5/f1e 0 2024-02-28T23:07:43.541 INFO:tasks.workunit.client.1.smithi184.stdout:4/733: write d1/fd8 [60951,108209] 0 2024-02-28T23:07:43.542 INFO:tasks.workunit.client.1.smithi184.stdout:9/755: write d5/db/f79 [1976234,124704] 0 2024-02-28T23:07:43.548 INFO:tasks.workunit.client.1.smithi184.stdout:7/704: dwrite d6/d9/d13/d1e/fbc [0,4194304] 0 2024-02-28T23:07:43.550 INFO:tasks.workunit.client.0.smithi159.stdout:7/884: unlink d5/d16/d1a/d27/d46/d65/d81/d83/ff7 0 2024-02-28T23:07:43.551 INFO:tasks.workunit.client.0.smithi159.stdout:7/885: chown d5/d56/d2a 260636 1 2024-02-28T23:07:43.562 INFO:tasks.workunit.client.1.smithi184.stdout:1/802: dwrite d20/d32/d4b/f99 [0,4194304] 0 2024-02-28T23:07:43.565 INFO:tasks.workunit.client.1.smithi184.stdout:3/799: rmdir d1/d4/d1c/d62/d92/dd8 0 2024-02-28T23:07:43.571 INFO:tasks.workunit.client.1.smithi184.stdout:8/771: truncate d1/da/d10/fca 322817 0 2024-02-28T23:07:43.572 INFO:tasks.workunit.client.0.smithi159.stdout:3/944: rename d0/d2b/d55/df8/l17 to d0/d2b/d55/df8/da9/d103/d106/l130 0 2024-02-28T23:07:43.579 INFO:tasks.workunit.client.0.smithi159.stdout:7/886: rename d5/d16/d1a/d27/d3e/cb6 to d5/d56/d50/daa/c118 0 2024-02-28T23:07:43.581 INFO:tasks.workunit.client.1.smithi184.stdout:7/705: creat d6/d9/d13/d3e/d7e/ff6 x:0 0 0 2024-02-28T23:07:43.583 INFO:tasks.workunit.client.1.smithi184.stdout:7/706: fsync d6/d9/d13/d3e/d7e/fa3 0 2024-02-28T23:07:43.588 INFO:tasks.workunit.client.1.smithi184.stdout:6/691: mknod dc/de/db6/cde 0 2024-02-28T23:07:43.589 INFO:tasks.workunit.client.0.smithi159.stdout:7/887: rename d5/d56/d50/d88/fd0 to d5/d16/d1a/d27/deb/d60/f119 0 2024-02-28T23:07:43.592 INFO:tasks.workunit.client.1.smithi184.stdout:8/772: symlink d1/da/dc/d18/l119 0 2024-02-28T23:07:43.594 INFO:tasks.workunit.client.1.smithi184.stdout:9/756: symlink d5/d47/d59/lee 0 2024-02-28T23:07:43.595 INFO:tasks.workunit.client.1.smithi184.stdout:0/798: link d0/df/fcf d0/df/d13/f111 0 2024-02-28T23:07:43.596 INFO:tasks.workunit.client.0.smithi159.stdout:7/888: symlink d5/d16/d1a/d27/d46/d101/d64/db4/dc8/d102/l11a 0 2024-02-28T23:07:43.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:43 smithi184 ceph-mon[36198]: pgmap v40: 65 pgs: 65 active+clean; 3.3 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 63 MiB/s rd, 153 MiB/s wr, 349 op/s 2024-02-28T23:07:43.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:43 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:07:43.602 INFO:tasks.workunit.client.1.smithi184.stdout:7/707: read d6/d68/f75 [2912829,45863] 0 2024-02-28T23:07:43.603 INFO:tasks.workunit.client.1.smithi184.stdout:1/803: unlink d20/l65 0 2024-02-28T23:07:43.605 INFO:tasks.workunit.client.1.smithi184.stdout:6/692: creat dc/d60/d6d/fdf x:0 0 0 2024-02-28T23:07:43.606 INFO:tasks.workunit.client.1.smithi184.stdout:1/804: write d20/d46/f69 [3907506,41242] 0 2024-02-28T23:07:43.607 INFO:tasks.workunit.client.0.smithi159.stdout:3/945: truncate d0/d3f/fad 1608881 0 2024-02-28T23:07:43.607 INFO:tasks.workunit.client.1.smithi184.stdout:3/800: mkdir d1/d4/d6/d1e/dfa 0 2024-02-28T23:07:43.608 INFO:tasks.workunit.client.0.smithi159.stdout:3/946: write d0/def/f7b [1980413,91821] 0 2024-02-28T23:07:43.609 INFO:tasks.workunit.client.1.smithi184.stdout:6/693: fdatasync dc/de/d2a/d8e/dad/d8a/da1/fc8 0 2024-02-28T23:07:43.612 INFO:tasks.workunit.client.1.smithi184.stdout:6/694: fdatasync dc/d60/d62/fdc 0 2024-02-28T23:07:43.613 INFO:tasks.workunit.client.1.smithi184.stdout:6/695: stat dc/de/f1e 0 2024-02-28T23:07:43.614 INFO:tasks.workunit.client.1.smithi184.stdout:6/696: chown dc/d60/d7c/d61/dd3 21 1 2024-02-28T23:07:43.617 INFO:tasks.workunit.client.1.smithi184.stdout:7/708: mkdir d6/d9/d13/d3e/dad/d7d/d6c/df7 0 2024-02-28T23:07:43.619 INFO:tasks.workunit.client.1.smithi184.stdout:4/734: truncate d1/d4/d43/d73/f91 3094171 0 2024-02-28T23:07:43.621 INFO:tasks.workunit.client.0.smithi159.stdout:3/947: creat d0/d2b/d55/d75/f131 x:0 0 0 2024-02-28T23:07:43.622 INFO:tasks.workunit.client.0.smithi159.stdout:3/948: chown d0/d6/c120 2736 1 2024-02-28T23:07:43.622 INFO:tasks.workunit.client.1.smithi184.stdout:8/773: symlink d1/da/dc/d16/d29/l11a 0 2024-02-28T23:07:43.624 INFO:tasks.workunit.client.0.smithi159.stdout:3/949: fsync d0/d3f/feb 0 2024-02-28T23:07:43.625 INFO:tasks.workunit.client.1.smithi184.stdout:1/805: chown d20/d32/d3e/d91/fda 553 1 2024-02-28T23:07:43.626 INFO:tasks.workunit.client.1.smithi184.stdout:8/774: dread - d1/da/dc/d16/f107 zero size 2024-02-28T23:07:43.628 INFO:tasks.workunit.client.1.smithi184.stdout:5/746: sync 2024-02-28T23:07:43.629 INFO:tasks.workunit.client.1.smithi184.stdout:8/775: stat d1/da/dc/d18/f38 0 2024-02-28T23:07:43.630 INFO:tasks.workunit.client.1.smithi184.stdout:3/801: creat d1/d4/d1c/d62/d66/dd3/d24/d76/ffb x:0 0 0 2024-02-28T23:07:43.632 INFO:tasks.workunit.client.1.smithi184.stdout:8/776: chown d1/da/dc/d16/d4d/c7a 126102 1 2024-02-28T23:07:43.633 INFO:tasks.workunit.client.0.smithi159.stdout:7/889: truncate d5/d16/d1a/d27/d46/d101/d64/f79 775680 0 2024-02-28T23:07:43.634 INFO:tasks.workunit.client.1.smithi184.stdout:8/777: chown d1/da/d10/d17/d63 372 1 2024-02-28T23:07:43.637 INFO:tasks.workunit.client.1.smithi184.stdout:7/709: rename d6/d9/d13/d1e/d2f to d6/d9/d13/d3e/dad/d49/d50/df8 0 2024-02-28T23:07:43.641 INFO:tasks.workunit.client.1.smithi184.stdout:4/735: symlink d1/dc/df/d5b/db2/d9f/da0/le4 0 2024-02-28T23:07:43.641 INFO:tasks.workunit.client.1.smithi184.stdout:7/710: write d6/d9/d13/d3e/d7e/fa3 [2213986,117675] 0 2024-02-28T23:07:43.643 INFO:tasks.workunit.client.1.smithi184.stdout:9/757: creat d5/db/de/d10/fef x:0 0 0 2024-02-28T23:07:43.645 INFO:tasks.workunit.client.0.smithi159.stdout:7/890: mknod d5/d16/d1a/d27/d46/d65/d81/d98/de5/d10d/c11b 0 2024-02-28T23:07:43.651 INFO:tasks.workunit.client.1.smithi184.stdout:1/806: creat d20/d32/dc0/f111 x:0 0 0 2024-02-28T23:07:43.652 INFO:tasks.workunit.client.1.smithi184.stdout:1/807: readlink d20/lfb 0 2024-02-28T23:07:43.653 INFO:tasks.workunit.client.0.smithi159.stdout:7/891: mknod d5/d16/d1a/d27/d95/c11c 0 2024-02-28T23:07:43.658 INFO:tasks.workunit.client.1.smithi184.stdout:4/736: creat d1/d9a/dd0/fe5 x:0 0 0 2024-02-28T23:07:43.662 INFO:tasks.workunit.client.1.smithi184.stdout:2/708: sync 2024-02-28T23:07:43.664 INFO:tasks.workunit.client.1.smithi184.stdout:0/799: link d0/df/d13/d27/d31/d51/f73 d0/d1d/d3a/f112 0 2024-02-28T23:07:43.666 INFO:tasks.workunit.client.1.smithi184.stdout:9/758: rename d5/d26/f78 to d5/d17/d43/db8/ff0 0 2024-02-28T23:07:43.668 INFO:tasks.workunit.client.1.smithi184.stdout:5/747: mkdir db/d12/d50/ddc/dec 0 2024-02-28T23:07:43.669 INFO:tasks.workunit.client.1.smithi184.stdout:3/802: mkdir d1/d4/d1c/d62/d66/da6/df5/dfc 0 2024-02-28T23:07:43.671 INFO:tasks.workunit.client.1.smithi184.stdout:6/697: dread dc/d60/d62/d6f/f77 [0,4194304] 0 2024-02-28T23:07:43.673 INFO:tasks.workunit.client.1.smithi184.stdout:4/737: rename d1/d8/d37/d49/f80 to d1/d8/d37/d6d/fe6 0 2024-02-28T23:07:43.674 INFO:tasks.workunit.client.1.smithi184.stdout:3/803: write d1/d4/f89 [661920,51577] 0 2024-02-28T23:07:43.674 INFO:tasks.workunit.client.1.smithi184.stdout:4/738: chown d1/d8/d19 994368 1 2024-02-28T23:07:43.679 INFO:tasks.workunit.client.1.smithi184.stdout:6/698: creat dc/de/d2a/d8e/fe0 x:0 0 0 2024-02-28T23:07:43.683 INFO:tasks.workunit.client.1.smithi184.stdout:4/739: creat d1/dc/df/d38/d57/dd6/ddd/fe7 x:0 0 0 2024-02-28T23:07:43.683 INFO:tasks.workunit.client.1.smithi184.stdout:3/804: chown d1/d4/d1c/d62/d66/dd3/d24/d76/cb4 1614030284 1 2024-02-28T23:07:43.686 INFO:tasks.workunit.client.1.smithi184.stdout:6/699: fdatasync f3 0 2024-02-28T23:07:43.688 INFO:tasks.workunit.client.1.smithi184.stdout:4/740: stat d1/d8/la 0 2024-02-28T23:07:43.689 INFO:tasks.workunit.client.0.smithi159.stdout:7/892: dwrite d5/d16/d1a/d27/deb/d60/f119 [0,4194304] 0 2024-02-28T23:07:43.690 INFO:tasks.workunit.client.1.smithi184.stdout:2/709: dwrite d10/d1f/d21/d5e/d15/d60/f9a [0,4194304] 0 2024-02-28T23:07:43.696 INFO:tasks.workunit.client.1.smithi184.stdout:9/759: dwrite d5/d26/d50/f3b [4194304,4194304] 0 2024-02-28T23:07:43.696 INFO:tasks.workunit.client.1.smithi184.stdout:8/778: write d1/da/dc/d16/f97 [3739623,18050] 0 2024-02-28T23:07:43.696 INFO:tasks.workunit.client.1.smithi184.stdout:7/711: write d6/d9/d13/d3e/f64 [166303,27884] 0 2024-02-28T23:07:43.696 INFO:tasks.workunit.client.1.smithi184.stdout:1/808: write d20/d32/d3e/d61/d8b/fac [395682,126655] 0 2024-02-28T23:07:43.702 INFO:tasks.workunit.client.1.smithi184.stdout:7/712: write d6/d9/d13/d1e/f22 [228329,35305] 0 2024-02-28T23:07:43.702 INFO:tasks.workunit.client.1.smithi184.stdout:8/779: chown d1/da/d10/d17/ccb 39504 1 2024-02-28T23:07:43.702 INFO:tasks.workunit.client.1.smithi184.stdout:6/700: creat dc/de/d2a/d5c/d79/da2/fe1 x:0 0 0 2024-02-28T23:07:43.702 INFO:tasks.workunit.client.1.smithi184.stdout:0/800: dread d0/df/d13/f29 [0,4194304] 0 2024-02-28T23:07:43.702 INFO:tasks.workunit.client.1.smithi184.stdout:2/710: creat d10/d1f/d21/d5e/d15/d24/d5f/fe2 x:0 0 0 2024-02-28T23:07:43.703 INFO:tasks.workunit.client.1.smithi184.stdout:3/805: creat d1/d4/d6/d1e/dfa/ffd x:0 0 0 2024-02-28T23:07:43.704 INFO:tasks.workunit.client.1.smithi184.stdout:1/809: chown d20/d32/d3e/d9a/la5 428514 1 2024-02-28T23:07:43.707 INFO:tasks.workunit.client.1.smithi184.stdout:9/760: write d5/db/de/d10/d12/f54 [3181462,114916] 0 2024-02-28T23:07:43.710 INFO:tasks.workunit.client.1.smithi184.stdout:8/780: creat d1/da/dd7/f11b x:0 0 0 2024-02-28T23:07:43.710 INFO:tasks.workunit.client.1.smithi184.stdout:6/701: dread - dc/d60/d7c/d61/fc4 zero size 2024-02-28T23:07:43.711 INFO:tasks.workunit.client.1.smithi184.stdout:7/713: creat d6/d9/d13/d3e/d7e/ff9 x:0 0 0 2024-02-28T23:07:43.715 INFO:tasks.workunit.client.1.smithi184.stdout:3/806: write d1/d4/d1c/f27 [658490,127057] 0 2024-02-28T23:07:43.718 INFO:tasks.workunit.client.1.smithi184.stdout:2/711: read d10/d1f/d21/d5e/d15/f2b [1598503,74483] 0 2024-02-28T23:07:43.719 INFO:tasks.workunit.client.1.smithi184.stdout:8/781: mkdir d1/da/d10/d17/d11c 0 2024-02-28T23:07:43.720 INFO:tasks.workunit.client.1.smithi184.stdout:1/810: creat d20/d32/d3e/d82/d85/d86/f112 x:0 0 0 2024-02-28T23:07:43.723 INFO:tasks.workunit.client.1.smithi184.stdout:6/702: write dc/de/f29 [676023,40833] 0 2024-02-28T23:07:43.726 INFO:tasks.workunit.client.1.smithi184.stdout:3/807: rmdir d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67 39 2024-02-28T23:07:43.729 INFO:tasks.workunit.client.1.smithi184.stdout:1/811: mknod d20/d32/dc0/c113 0 2024-02-28T23:07:43.731 INFO:tasks.workunit.client.1.smithi184.stdout:6/703: read dc/d60/d7c/f9e [1260963,69795] 0 2024-02-28T23:07:43.732 INFO:tasks.workunit.client.1.smithi184.stdout:1/812: chown d20/d46/d90/l8a 12534087 1 2024-02-28T23:07:43.732 INFO:tasks.workunit.client.1.smithi184.stdout:9/761: creat d5/db/ff1 x:0 0 0 2024-02-28T23:07:43.734 INFO:tasks.workunit.client.1.smithi184.stdout:4/741: dwrite d1/f33 [0,4194304] 0 2024-02-28T23:07:43.737 INFO:tasks.workunit.client.1.smithi184.stdout:6/704: truncate dc/d60/d7c/d61/fc5 248915 0 2024-02-28T23:07:43.738 INFO:tasks.workunit.client.1.smithi184.stdout:2/712: link d10/d1f/d21/d6a/fae d10/d1f/d21/d5e/dad/da3/fe3 0 2024-02-28T23:07:43.738 INFO:tasks.workunit.client.1.smithi184.stdout:6/705: stat dc/de/d10/f43 0 2024-02-28T23:07:43.744 INFO:tasks.workunit.client.1.smithi184.stdout:8/782: write d1/da/dc/d16/d32/f98 [1681739,116390] 0 2024-02-28T23:07:43.745 INFO:tasks.workunit.client.1.smithi184.stdout:7/714: truncate d6/d9/fb3 1207443 0 2024-02-28T23:07:43.791 INFO:tasks.workunit.client.1.smithi184.stdout:7/715: fdatasync d6/d9/d13/d3e/dad/fa1 0 2024-02-28T23:07:43.794 INFO:tasks.workunit.client.1.smithi184.stdout:0/801: dread d0/df/f30 [0,4194304] 0 2024-02-28T23:07:43.795 INFO:tasks.workunit.client.1.smithi184.stdout:9/762: dwrite d5/d26/d50/f3b [0,4194304] 0 2024-02-28T23:07:43.796 INFO:tasks.workunit.client.1.smithi184.stdout:2/713: rename d10/f51 to d10/d1f/d21/fe4 0 2024-02-28T23:07:43.797 INFO:tasks.workunit.client.1.smithi184.stdout:4/742: getdents d1/dc/df/d38/d57/dd6/ddd 0 2024-02-28T23:07:43.803 INFO:tasks.workunit.client.1.smithi184.stdout:8/783: link d1/da/dc/d16/d32/d42/f9b d1/da/dc/d16/d32/d42/f11d 0 2024-02-28T23:07:43.804 INFO:tasks.workunit.client.1.smithi184.stdout:0/802: creat d0/df/d13/d27/d31/d51/d85/f113 x:0 0 0 2024-02-28T23:07:43.806 INFO:tasks.workunit.client.1.smithi184.stdout:3/808: dwrite d1/d4/d6/f51 [4194304,4194304] 0 2024-02-28T23:07:43.807 INFO:tasks.workunit.client.1.smithi184.stdout:4/743: mknod d1/d8/d19/d67/d99/ce8 0 2024-02-28T23:07:43.809 INFO:tasks.workunit.client.1.smithi184.stdout:3/809: stat d1/d4/d1c 0 2024-02-28T23:07:43.810 INFO:tasks.workunit.client.1.smithi184.stdout:4/744: stat d1/dc/df/l13 0 2024-02-28T23:07:43.813 INFO:tasks.workunit.client.1.smithi184.stdout:0/803: mkdir d0/db2/d114 0 2024-02-28T23:07:43.818 INFO:tasks.workunit.client.1.smithi184.stdout:4/745: fsync d1/d8/d19/d67/fb6 0 2024-02-28T23:07:43.818 INFO:tasks.workunit.client.1.smithi184.stdout:3/810: write d1/d4/d1c/ff0 [681807,24608] 0 2024-02-28T23:07:43.820 INFO:tasks.workunit.client.1.smithi184.stdout:0/804: mknod d0/db2/c115 0 2024-02-28T23:07:43.822 INFO:tasks.workunit.client.1.smithi184.stdout:7/716: write d6/d9/d13/d3e/dad/d49/d50/df8/f38 [2811305,70281] 0 2024-02-28T23:07:43.823 INFO:tasks.workunit.client.1.smithi184.stdout:5/748: sync 2024-02-28T23:07:43.824 INFO:tasks.workunit.client.1.smithi184.stdout:8/784: write d1/da/dc/d16/dbd/ff6 [2773844,78692] 0 2024-02-28T23:07:43.827 INFO:tasks.workunit.client.1.smithi184.stdout:2/714: dwrite d10/f11 [0,4194304] 0 2024-02-28T23:07:43.835 INFO:tasks.workunit.client.1.smithi184.stdout:3/811: dread - d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/ff3 zero size 2024-02-28T23:07:43.837 INFO:tasks.workunit.client.1.smithi184.stdout:9/763: dwrite d5/db/de/d10/d12/d2f/f7b [0,4194304] 0 2024-02-28T23:07:43.845 INFO:tasks.workunit.client.1.smithi184.stdout:3/812: write d1/d4/d1c/d62/d66/dd3/f2b [1184142,116627] 0 2024-02-28T23:07:43.846 INFO:tasks.workunit.client.1.smithi184.stdout:3/813: write d1/d4/d5/da9/d74/ff1 [993990,128785] 0 2024-02-28T23:07:43.849 INFO:tasks.workunit.client.1.smithi184.stdout:4/746: dread d1/dc/df/d5b/d6c/f9d [0,4194304] 0 2024-02-28T23:07:43.852 INFO:tasks.workunit.client.1.smithi184.stdout:4/747: chown d1/dc/df/d3b/d5c/l6a 3632320 1 2024-02-28T23:07:43.854 INFO:tasks.workunit.client.1.smithi184.stdout:4/748: fdatasync d1/fd8 0 2024-02-28T23:07:43.858 INFO:tasks.workunit.client.1.smithi184.stdout:7/717: dwrite d6/d9/d13/d1e/f22 [0,4194304] 0 2024-02-28T23:07:43.864 INFO:tasks.workunit.client.1.smithi184.stdout:5/749: truncate db/d12/f47 2230650 0 2024-02-28T23:07:43.864 INFO:tasks.workunit.client.1.smithi184.stdout:0/805: symlink d0/df/d13/d27/d31/d51/l116 0 2024-02-28T23:07:43.864 INFO:tasks.workunit.client.1.smithi184.stdout:2/715: mkdir d10/d1f/d21/d5e/dad/da3/dd6/de5 0 2024-02-28T23:07:43.866 INFO:tasks.workunit.client.1.smithi184.stdout:9/764: symlink d5/d17/d43/db8/lf2 0 2024-02-28T23:07:43.868 INFO:tasks.workunit.client.1.smithi184.stdout:4/749: mkdir d1/dc/df/d38/d57/de9 0 2024-02-28T23:07:43.870 INFO:tasks.workunit.client.1.smithi184.stdout:4/750: write d1/d4/d43/d73/fc5 [697507,114277] 0 2024-02-28T23:07:43.872 INFO:tasks.workunit.client.1.smithi184.stdout:5/750: creat db/d12/d1c/d21/d25/fed x:0 0 0 2024-02-28T23:07:43.874 INFO:tasks.workunit.client.1.smithi184.stdout:8/785: creat d1/da/dc/d16/d32/f11e x:0 0 0 2024-02-28T23:07:43.876 INFO:tasks.workunit.client.1.smithi184.stdout:9/765: creat d5/db/de/d10/d12/d2f/d3f/d8d/ff3 x:0 0 0 2024-02-28T23:07:43.877 INFO:tasks.workunit.client.1.smithi184.stdout:9/766: dread - d5/db/ff1 zero size 2024-02-28T23:07:43.880 INFO:tasks.workunit.client.1.smithi184.stdout:2/716: mknod d10/d1f/d38/d54/ce6 0 2024-02-28T23:07:43.880 INFO:tasks.workunit.client.1.smithi184.stdout:9/767: write d5/db/de/d10/d12/d2f/d3f/d8d/ff3 [433283,92316] 0 2024-02-28T23:07:43.881 INFO:tasks.workunit.client.1.smithi184.stdout:5/751: fsync db/d12/d18/d2e/f89 0 2024-02-28T23:07:43.883 INFO:tasks.workunit.client.1.smithi184.stdout:8/786: truncate d1/da/dc/fb6 334213 0 2024-02-28T23:07:43.885 INFO:tasks.workunit.client.1.smithi184.stdout:7/718: link d6/d9/d13/d3e/dad/d49/da6/daf/d47/f55 d6/d9/d13/d14/d45/ffa 0 2024-02-28T23:07:43.887 INFO:tasks.workunit.client.1.smithi184.stdout:7/719: fdatasync d6/d9/d13/d3e/dad/d49/d50/fe5 0 2024-02-28T23:07:43.888 INFO:tasks.workunit.client.1.smithi184.stdout:9/768: mkdir d5/d47/d68/d7c/df4 0 2024-02-28T23:07:43.890 INFO:tasks.workunit.client.1.smithi184.stdout:2/717: truncate d10/d1f/d21/d5e/d15/d60/d66/f6b 1672445 0 2024-02-28T23:07:43.892 INFO:tasks.workunit.client.1.smithi184.stdout:4/751: dwrite d1/d8/d19/f1a [0,4194304] 0 2024-02-28T23:07:43.894 INFO:tasks.workunit.client.1.smithi184.stdout:4/752: fdatasync d1/dc/df/f82 0 2024-02-28T23:07:43.897 INFO:tasks.workunit.client.1.smithi184.stdout:2/718: mkdir d10/d55/d89/db5/de7 0 2024-02-28T23:07:43.900 INFO:tasks.workunit.client.1.smithi184.stdout:9/769: mkdir d5/db/de/df5 0 2024-02-28T23:07:43.904 INFO:tasks.workunit.client.1.smithi184.stdout:1/813: sync 2024-02-28T23:07:43.905 INFO:tasks.workunit.client.1.smithi184.stdout:4/753: truncate d1/f12 404688 0 2024-02-28T23:07:43.914 INFO:tasks.workunit.client.1.smithi184.stdout:1/814: dread d20/d32/d4d/fa9 [0,4194304] 0 2024-02-28T23:07:43.917 INFO:tasks.workunit.client.1.smithi184.stdout:9/770: dread d5/db/de/d10/d12/fb7 [0,4194304] 0 2024-02-28T23:07:43.919 INFO:tasks.workunit.client.1.smithi184.stdout:9/771: chown d5/d26/f55 6 1 2024-02-28T23:07:43.920 INFO:tasks.workunit.client.1.smithi184.stdout:3/814: sync 2024-02-28T23:07:43.920 INFO:tasks.workunit.client.1.smithi184.stdout:6/706: sync 2024-02-28T23:07:43.920 INFO:tasks.workunit.client.1.smithi184.stdout:2/719: dwrite d10/d1f/d21/d5e/dad/dc7/fd7 [0,4194304] 0 2024-02-28T23:07:43.920 INFO:tasks.workunit.client.1.smithi184.stdout:1/815: unlink d20/d46/f89 0 2024-02-28T23:07:43.925 INFO:tasks.workunit.client.1.smithi184.stdout:0/806: dwrite d0/f37 [4194304,4194304] 0 2024-02-28T23:07:43.927 INFO:tasks.workunit.client.1.smithi184.stdout:5/752: write db/d12/d18/d2e/d3c/d5d/d66/f6a [489523,117935] 0 2024-02-28T23:07:43.930 INFO:tasks.workunit.client.1.smithi184.stdout:6/707: mkdir dc/d60/d7c/d90/de2 0 2024-02-28T23:07:43.937 INFO:tasks.workunit.client.1.smithi184.stdout:9/772: mknod d5/db/de/d10/d12/d2f/d3f/d8d/cf6 0 2024-02-28T23:07:43.939 INFO:tasks.workunit.client.1.smithi184.stdout:1/816: rename c1b to d20/c114 0 2024-02-28T23:07:43.943 INFO:tasks.workunit.client.1.smithi184.stdout:9/773: chown d5/d47/d68/d7c/fe6 35941068 1 2024-02-28T23:07:43.944 INFO:tasks.workunit.client.1.smithi184.stdout:8/787: dwrite d1/da/dc/d16/d32/d42/f11d [0,4194304] 0 2024-02-28T23:07:43.949 INFO:tasks.workunit.client.1.smithi184.stdout:0/807: rename d0/df/d13/d27/d58/de1 to d0/df/d13/d27/d31/d51/d117 0 2024-02-28T23:07:43.951 INFO:tasks.workunit.client.1.smithi184.stdout:8/788: read d1/da/dc/d16/d32/d42/f11d [522732,57436] 0 2024-02-28T23:07:43.952 INFO:tasks.workunit.client.1.smithi184.stdout:7/720: dwrite d6/d9/d13/d14/d45/ffa [0,4194304] 0 2024-02-28T23:07:43.955 INFO:tasks.workunit.client.1.smithi184.stdout:6/708: link dc/c2e dc/d60/d7c/d90/de2/ce3 0 2024-02-28T23:07:43.960 INFO:tasks.workunit.client.1.smithi184.stdout:8/789: stat d1/da/dd7 0 2024-02-28T23:07:43.960 INFO:tasks.workunit.client.1.smithi184.stdout:2/720: write d10/d1f/d21/d5e/f3d [977873,87131] 0 2024-02-28T23:07:43.962 INFO:tasks.workunit.client.1.smithi184.stdout:9/774: mkdir d5/db/de/d10/d12/df7 0 2024-02-28T23:07:43.962 INFO:tasks.workunit.client.1.smithi184.stdout:7/721: chown d6/d9/d13/d3e/dad/d49/d50/cc2 3908868 1 2024-02-28T23:07:43.965 INFO:tasks.workunit.client.1.smithi184.stdout:4/754: dwrite d1/dc/df/f16 [0,4194304] 0 2024-02-28T23:07:43.969 INFO:tasks.workunit.client.1.smithi184.stdout:8/790: read - d1/da/dc/d16/d4d/d82/fdf zero size 2024-02-28T23:07:43.972 INFO:tasks.workunit.client.1.smithi184.stdout:7/722: write d6/d9/d13/d3e/d7e/ff6 [330657,66312] 0 2024-02-28T23:07:43.972 INFO:tasks.workunit.client.1.smithi184.stdout:3/815: dwrite d1/d4/d5/da9/f77 [0,4194304] 0 2024-02-28T23:07:43.972 INFO:tasks.workunit.client.1.smithi184.stdout:5/753: rename db/c10 to db/d12/d50/d9e/cee 0 2024-02-28T23:07:43.976 INFO:tasks.workunit.client.1.smithi184.stdout:9/775: mkdir d5/d17/d57/df8 0 2024-02-28T23:07:43.978 INFO:tasks.workunit.client.1.smithi184.stdout:2/721: rename d10/fa0 to d10/d1f/d21/d5e/dad/da3/dd6/fe8 0 2024-02-28T23:07:43.982 INFO:tasks.workunit.client.1.smithi184.stdout:5/754: read db/d12/d18/d2e/fc8 [18735,90134] 0 2024-02-28T23:07:43.983 INFO:tasks.workunit.client.1.smithi184.stdout:8/791: truncate d1/da/dc/d18/f51 93740 0 2024-02-28T23:07:43.984 INFO:tasks.workunit.client.1.smithi184.stdout:3/816: fdatasync d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/f6d 0 2024-02-28T23:07:43.986 INFO:tasks.workunit.client.1.smithi184.stdout:4/755: read d1/d8/f9b [4691853,43361] 0 2024-02-28T23:07:43.986 INFO:tasks.workunit.client.1.smithi184.stdout:2/722: chown d10/d1f/d21/d5e/d15/c87 22 1 2024-02-28T23:07:43.989 INFO:tasks.workunit.client.1.smithi184.stdout:6/709: dwrite dc/f4f [0,4194304] 0 2024-02-28T23:07:43.990 INFO:tasks.workunit.client.1.smithi184.stdout:8/792: readlink d1/da/dc/d16/d4d/d82/la2 0 2024-02-28T23:07:43.991 INFO:tasks.workunit.client.1.smithi184.stdout:5/755: read db/d12/d50/d9e/fbb [538987,30319] 0 2024-02-28T23:07:43.994 INFO:tasks.workunit.client.1.smithi184.stdout:3/817: write d1/d4/d1c/d61/f9a [980833,49991] 0 2024-02-28T23:07:43.998 INFO:tasks.workunit.client.1.smithi184.stdout:1/817: dread d20/d46/d90/de1/fe7 [0,4194304] 0 2024-02-28T23:07:44.006 INFO:tasks.workunit.client.1.smithi184.stdout:1/818: dread - d20/d32/d3e/d61/d8b/f104 zero size 2024-02-28T23:07:44.006 INFO:tasks.workunit.client.1.smithi184.stdout:4/756: rmdir d1/dc/df/d22 39 2024-02-28T23:07:44.007 INFO:tasks.workunit.client.1.smithi184.stdout:6/710: fdatasync dc/de/d10/d16/f37 0 2024-02-28T23:07:44.008 INFO:tasks.workunit.client.1.smithi184.stdout:5/756: creat db/d12/d1c/d9b/fef x:0 0 0 2024-02-28T23:07:44.008 INFO:tasks.workunit.client.1.smithi184.stdout:7/723: dwrite d6/d9/d13/d3e/dad/d49/f88 [0,4194304] 0 2024-02-28T23:07:44.012 INFO:tasks.workunit.client.1.smithi184.stdout:5/757: chown db/d12 617006377 1 2024-02-28T23:07:44.012 INFO:tasks.workunit.client.1.smithi184.stdout:9/776: link d5/db/de/d10/d12/f2d d5/db/de/df5/ff9 0 2024-02-28T23:07:44.018 INFO:tasks.workunit.client.1.smithi184.stdout:8/793: write d1/da/df/d20/dc7/fcf [817800,1249] 0 2024-02-28T23:07:44.019 INFO:tasks.workunit.client.1.smithi184.stdout:7/724: fsync d6/d9/d13/d3e/dad/d49/d50/f6d 0 2024-02-28T23:07:44.021 INFO:tasks.workunit.client.1.smithi184.stdout:1/819: mknod d20/d32/c115 0 2024-02-28T23:07:44.022 INFO:tasks.workunit.client.1.smithi184.stdout:8/794: chown d1/da/df 28 1 2024-02-28T23:07:44.023 INFO:tasks.workunit.client.1.smithi184.stdout:6/711: dread dc/d60/d62/d6f/d99/d9d/fbb [0,4194304] 0 2024-02-28T23:07:44.026 INFO:tasks.workunit.client.1.smithi184.stdout:5/758: rename db/d12/d1c/d9b/dd6 to db/d12/df0 0 2024-02-28T23:07:44.027 INFO:tasks.workunit.client.1.smithi184.stdout:1/820: dread - d20/d46/d90/da0/f108 zero size 2024-02-28T23:07:44.030 INFO:tasks.workunit.client.1.smithi184.stdout:6/712: dread - dc/de/d2a/d8e/dad/d8a/fcd zero size 2024-02-28T23:07:44.030 INFO:tasks.workunit.client.1.smithi184.stdout:4/757: dread d1/d8/d35/fa7 [0,4194304] 0 2024-02-28T23:07:44.031 INFO:tasks.workunit.client.1.smithi184.stdout:1/821: chown d20/d46/d90/db3/fc4 9 1 2024-02-28T23:07:44.032 INFO:tasks.workunit.client.1.smithi184.stdout:5/759: mkdir db/d12/d1c/d21/d25/dd3/df1 0 2024-02-28T23:07:44.033 INFO:tasks.workunit.client.1.smithi184.stdout:9/777: link d5/db/de/d10/d12/d2f/d3f/d8d/cdd d5/db/de/d10/d12/d2f/d7d/cfa 0 2024-02-28T23:07:44.036 INFO:tasks.workunit.client.1.smithi184.stdout:0/808: sync 2024-02-28T23:07:44.037 INFO:tasks.workunit.client.1.smithi184.stdout:2/723: dread d10/d1f/d21/d5e/d15/d24/fa5 [0,4194304] 0 2024-02-28T23:07:44.038 INFO:tasks.workunit.client.1.smithi184.stdout:7/725: getdents d6/d9/d13/d3e/dad/d49/d50/df8/d98 0 2024-02-28T23:07:44.039 INFO:tasks.workunit.client.1.smithi184.stdout:1/822: fsync d20/d46/d90/de1/fe7 0 2024-02-28T23:07:44.039 INFO:tasks.workunit.client.1.smithi184.stdout:4/758: creat d1/d8/d19/d56/fea x:0 0 0 2024-02-28T23:07:44.041 INFO:tasks.workunit.client.1.smithi184.stdout:5/760: read - db/d12/d18/d2e/f89 zero size 2024-02-28T23:07:44.041 INFO:tasks.workunit.client.1.smithi184.stdout:6/713: creat dc/d60/d6d/fe4 x:0 0 0 2024-02-28T23:07:44.043 INFO:tasks.workunit.client.1.smithi184.stdout:9/778: creat d5/db/de/d10/d6a/ffb x:0 0 0 2024-02-28T23:07:44.044 INFO:tasks.workunit.client.1.smithi184.stdout:2/724: chown d10/d1f/d38/f5c 4 1 2024-02-28T23:07:44.045 INFO:tasks.workunit.client.1.smithi184.stdout:4/759: write d1/d8/d19/d67/d99/fb8 [563695,4597] 0 2024-02-28T23:07:44.046 INFO:tasks.workunit.client.1.smithi184.stdout:3/818: dwrite d1/d4/d1c/d62/fb7 [0,4194304] 0 2024-02-28T23:07:44.047 INFO:tasks.workunit.client.1.smithi184.stdout:0/809: rmdir d0/df/d13/d27/d31/d51 39 2024-02-28T23:07:44.048 INFO:tasks.workunit.client.1.smithi184.stdout:0/810: stat d0/d1d/f4d 0 2024-02-28T23:07:44.050 INFO:tasks.workunit.client.1.smithi184.stdout:1/823: write d20/d32/d3e/d82/d85/d8c/fc6 [4405632,58282] 0 2024-02-28T23:07:44.052 INFO:tasks.workunit.client.1.smithi184.stdout:9/779: symlink d5/d17/d57/lfc 0 2024-02-28T23:07:44.053 INFO:tasks.workunit.client.1.smithi184.stdout:1/824: dread - d20/d46/fcc zero size 2024-02-28T23:07:44.055 INFO:tasks.workunit.client.1.smithi184.stdout:5/761: unlink db/d12/d1c/d9b/fca 0 2024-02-28T23:07:44.057 INFO:tasks.workunit.client.1.smithi184.stdout:1/825: read d20/d32/d4b/fa1 [1754110,92983] 0 2024-02-28T23:07:44.058 INFO:tasks.workunit.client.1.smithi184.stdout:4/760: truncate d1/d4/d43/d73/f5e 1916557 0 2024-02-28T23:07:44.061 INFO:tasks.workunit.client.1.smithi184.stdout:4/761: dread - d1/dc/df/d3b/d5c/f7b zero size 2024-02-28T23:07:44.062 INFO:tasks.workunit.client.1.smithi184.stdout:7/726: write d6/d9/d13/d3e/d7e/fa3 [1485763,127638] 0 2024-02-28T23:07:44.062 INFO:tasks.workunit.client.1.smithi184.stdout:8/795: dread d1/f86 [0,4194304] 0 2024-02-28T23:07:44.063 INFO:tasks.workunit.client.1.smithi184.stdout:0/811: symlink d0/db2/d114/l118 0 2024-02-28T23:07:44.063 INFO:tasks.workunit.client.1.smithi184.stdout:3/819: chown d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/f86 1641264392 1 2024-02-28T23:07:44.065 INFO:tasks.workunit.client.1.smithi184.stdout:7/727: dread - d6/d9/d13/d14/d45/f8c zero size 2024-02-28T23:07:44.067 INFO:tasks.workunit.client.1.smithi184.stdout:2/725: link d10/d1f/d21/d5e/d15/d24/d5f/fe2 d10/d1f/d21/d6a/dc2/fe9 0 2024-02-28T23:07:44.138 INFO:tasks.workunit.client.1.smithi184.stdout:1/826: creat d20/d32/d3e/d61/d8b/d101/f116 x:0 0 0 2024-02-28T23:07:44.141 INFO:tasks.workunit.client.1.smithi184.stdout:5/762: link db/d12/d1c/d21/f2a db/d12/d1c/d21/d25/dd3/ff2 0 2024-02-28T23:07:44.144 INFO:tasks.workunit.client.1.smithi184.stdout:0/812: write d0/df/d13/d27/d31/d5b/d8e/d92/fe0 [1411697,10406] 0 2024-02-28T23:07:44.146 INFO:tasks.workunit.client.1.smithi184.stdout:3/820: dread d1/d4/d1c/f31 [0,4194304] 0 2024-02-28T23:07:44.148 INFO:tasks.workunit.client.1.smithi184.stdout:4/762: creat d1/d8/d19/d92/feb x:0 0 0 2024-02-28T23:07:44.150 INFO:tasks.workunit.client.1.smithi184.stdout:9/780: dwrite d5/db/d65/f6c [0,4194304] 0 2024-02-28T23:07:44.158 INFO:tasks.workunit.client.1.smithi184.stdout:0/813: mknod d0/d1f/c119 0 2024-02-28T23:07:44.163 INFO:tasks.workunit.client.1.smithi184.stdout:7/728: dwrite d6/d9/d13/d3e/dad/d49/d50/db2/fba [0,4194304] 0 2024-02-28T23:07:44.166 INFO:tasks.workunit.client.1.smithi184.stdout:4/763: fdatasync d1/d8/f5a 0 2024-02-28T23:07:44.167 INFO:tasks.workunit.client.1.smithi184.stdout:3/821: dwrite d1/d4/d5/d9f/fd4 [0,4194304] 0 2024-02-28T23:07:44.170 INFO:tasks.workunit.client.1.smithi184.stdout:5/763: creat db/ff3 x:0 0 0 2024-02-28T23:07:44.170 INFO:tasks.workunit.client.1.smithi184.stdout:3/822: chown d1/d4/d5/c19 364627266 1 2024-02-28T23:07:44.171 INFO:tasks.workunit.client.1.smithi184.stdout:5/764: fdatasync db/d90/de1/fea 0 2024-02-28T23:07:44.172 INFO:tasks.workunit.client.1.smithi184.stdout:5/765: stat db/f7c 0 2024-02-28T23:07:44.177 INFO:tasks.workunit.client.1.smithi184.stdout:3/823: write d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/ff3 [945835,76509] 0 2024-02-28T23:07:44.177 INFO:tasks.workunit.client.1.smithi184.stdout:1/827: creat d20/d32/d3e/f117 x:0 0 0 2024-02-28T23:07:44.178 INFO:tasks.workunit.client.1.smithi184.stdout:0/814: symlink d0/db2/d114/l11a 0 2024-02-28T23:07:44.180 INFO:tasks.workunit.client.1.smithi184.stdout:2/726: write d10/d1f/d21/d5e/d15/d60/d66/f6b [65035,36575] 0 2024-02-28T23:07:44.180 INFO:tasks.workunit.client.1.smithi184.stdout:9/781: dread d5/d17/d57/fe0 [0,4194304] 0 2024-02-28T23:07:44.182 INFO:tasks.workunit.client.1.smithi184.stdout:2/727: write d10/d55/d89/fa1 [1747424,56261] 0 2024-02-28T23:07:44.183 INFO:tasks.workunit.client.1.smithi184.stdout:7/729: creat d6/d9/d13/d3e/dad/d49/d9c/ffb x:0 0 0 2024-02-28T23:07:44.185 INFO:tasks.workunit.client.1.smithi184.stdout:4/764: fsync d1/d8/d35/f42 0 2024-02-28T23:07:44.186 INFO:tasks.workunit.client.1.smithi184.stdout:5/766: mkdir db/d12/df0/df4 0 2024-02-28T23:07:44.187 INFO:tasks.workunit.client.1.smithi184.stdout:2/728: dread d10/d1f/d21/d5e/dad/da3/fe3 [0,4194304] 0 2024-02-28T23:07:44.189 INFO:tasks.workunit.client.1.smithi184.stdout:5/767: chown db/d12/d18/d2e/d3c/d5d/d66 862 1 2024-02-28T23:07:44.192 INFO:tasks.workunit.client.1.smithi184.stdout:9/782: symlink d5/d17/lfd 0 2024-02-28T23:07:44.192 INFO:tasks.workunit.client.1.smithi184.stdout:5/768: readlink db/d12/d1c/d80/l8b 0 2024-02-28T23:07:44.192 INFO:tasks.workunit.client.1.smithi184.stdout:2/729: chown d10/d1f/d21/d5e/d15/d60/d66/dc6/c85 36 1 2024-02-28T23:07:44.193 INFO:tasks.workunit.client.1.smithi184.stdout:1/828: dread d20/d46/f6c [0,4194304] 0 2024-02-28T23:07:44.194 INFO:tasks.workunit.client.1.smithi184.stdout:6/714: sync 2024-02-28T23:07:44.195 INFO:tasks.workunit.client.1.smithi184.stdout:0/815: rename d0/df/d13 to d0/d1d/d3a/da9/d11b 0 2024-02-28T23:07:44.199 INFO:tasks.workunit.client.1.smithi184.stdout:3/824: mknod d1/d4/d5/cfe 0 2024-02-28T23:07:44.199 INFO:tasks.workunit.client.1.smithi184.stdout:1/829: truncate d20/d32/d3e/d61/f79 377816 0 2024-02-28T23:07:44.200 INFO:tasks.workunit.client.1.smithi184.stdout:9/783: truncate d5/d47/d59/fb2 3286254 0 2024-02-28T23:07:44.202 INFO:tasks.workunit.client.1.smithi184.stdout:7/730: rename d6/l25 to d6/d9/d13/d3e/dad/d49/d50/df8/d98/dc4/df1/lfc 0 2024-02-28T23:07:44.206 INFO:tasks.workunit.client.1.smithi184.stdout:7/731: read d6/d9/d13/d1e/f21 [2040869,20093] 0 2024-02-28T23:07:44.207 INFO:tasks.workunit.client.1.smithi184.stdout:3/825: rmdir d1/d4/d6/d1e/dfa 39 2024-02-28T23:07:44.210 INFO:tasks.workunit.client.1.smithi184.stdout:4/765: dread d1/d8/d35/fc0 [0,4194304] 0 2024-02-28T23:07:44.213 INFO:tasks.workunit.client.1.smithi184.stdout:6/715: link dc/d60/d7c/d61/fc4 dc/d60/d7c/d90/fe5 0 2024-02-28T23:07:44.214 INFO:tasks.workunit.client.1.smithi184.stdout:3/826: rmdir d1/d4/d1c/d62 39 2024-02-28T23:07:44.216 INFO:tasks.workunit.client.1.smithi184.stdout:4/766: mknod d1/d9a/dd0/cec 0 2024-02-28T23:07:44.216 INFO:tasks.workunit.client.0.smithi159.stdout:7/893: sync 2024-02-28T23:07:44.216 INFO:tasks.workunit.client.0.smithi159.stdout:3/950: sync 2024-02-28T23:07:44.218 INFO:tasks.workunit.client.0.smithi159.stdout:7/894: chown d5/d16/d1a/d27/d46/l5c 322262 1 2024-02-28T23:07:44.218 INFO:tasks.workunit.client.1.smithi184.stdout:1/830: creat d20/d46/f118 x:0 0 0 2024-02-28T23:07:44.220 INFO:tasks.workunit.client.0.smithi159.stdout:3/951: symlink d0/d2b/d4f/dc3/l132 0 2024-02-28T23:07:44.221 INFO:tasks.workunit.client.1.smithi184.stdout:5/769: dread db/d12/d1c/d21/d2f/f4e [0,4194304] 0 2024-02-28T23:07:44.222 INFO:tasks.workunit.client.1.smithi184.stdout:6/716: unlink dc/de/d2a/d8e/dad/c7f 0 2024-02-28T23:07:44.222 INFO:tasks.workunit.client.1.smithi184.stdout:5/770: chown db/d12/d18/d2e 4852962 1 2024-02-28T23:07:44.223 INFO:tasks.workunit.client.1.smithi184.stdout:7/732: dwrite d6/d9/d13/d3e/dad/d49/d50/fe5 [0,4194304] 0 2024-02-28T23:07:44.224 INFO:tasks.workunit.client.0.smithi159.stdout:7/895: creat d5/d16/d40/dce/f11d x:0 0 0 2024-02-28T23:07:44.226 INFO:tasks.workunit.client.1.smithi184.stdout:7/733: chown d6/d9/d13/d3e/dad/d49/d50/df8/d33/c51 1 1 2024-02-28T23:07:44.226 INFO:tasks.workunit.client.0.smithi159.stdout:3/952: mknod d0/d2b/d55/df8/d2f/ddf/c133 0 2024-02-28T23:07:44.231 INFO:tasks.workunit.client.1.smithi184.stdout:4/767: fdatasync d1/d8/d35/dd9/fa4 0 2024-02-28T23:07:44.231 INFO:tasks.workunit.client.1.smithi184.stdout:9/784: link d5/db/de/d10/d12/d2f/d7d/ld1 d5/d17/lfe 0 2024-02-28T23:07:44.234 INFO:tasks.workunit.client.1.smithi184.stdout:0/816: write d0/d7c/d8a/fbf [141600,11951] 0 2024-02-28T23:07:44.235 INFO:tasks.workunit.client.1.smithi184.stdout:1/831: fdatasync d20/d32/f48 0 2024-02-28T23:07:44.238 INFO:tasks.workunit.client.1.smithi184.stdout:1/832: dread - d20/d32/d3e/f7a zero size 2024-02-28T23:07:44.239 INFO:tasks.workunit.client.0.smithi159.stdout:7/896: rename d5/d16/d1a/c108 to d5/d16/d1a/d27/deb/c11e 0 2024-02-28T23:07:44.239 INFO:tasks.workunit.client.1.smithi184.stdout:5/771: mkdir db/d12/d1c/d21/d2f/dc4/df5 0 2024-02-28T23:07:44.240 INFO:tasks.workunit.client.1.smithi184.stdout:3/827: mknod d1/d4/d6/d1e/cff 0 2024-02-28T23:07:44.240 INFO:tasks.workunit.client.1.smithi184.stdout:1/833: chown d20/d32/d3e/d82/d85/fa3 2791255 1 2024-02-28T23:07:44.241 INFO:tasks.workunit.client.1.smithi184.stdout:5/772: dread - db/da4/fe7 zero size 2024-02-28T23:07:44.243 INFO:tasks.workunit.client.1.smithi184.stdout:7/734: rename d6/d9/d13/d3e/dad/d49/da6/daf/ddc to d6/d9/d13/d3e/dad/d49/da6/dfd 0 2024-02-28T23:07:44.244 INFO:tasks.workunit.client.1.smithi184.stdout:2/730: dwrite d10/d1f/d21/d5e/dad/da3/dd6/dab/fd9 [0,4194304] 0 2024-02-28T23:07:44.248 INFO:tasks.workunit.client.1.smithi184.stdout:2/731: fsync d10/d1f/d21/d5e/d15/d60/d66/f6b 0 2024-02-28T23:07:44.251 INFO:tasks.workunit.client.1.smithi184.stdout:1/834: creat d20/d32/d3e/d82/d85/dfc/f119 x:0 0 0 2024-02-28T23:07:44.252 INFO:tasks.workunit.client.1.smithi184.stdout:0/817: dread - d0/d1d/d3a/da9/d11b/d27/d31/d51/faf zero size 2024-02-28T23:07:44.253 INFO:tasks.workunit.client.1.smithi184.stdout:5/773: read db/d12/d18/d2e/fd2 [57823,24161] 0 2024-02-28T23:07:44.266 INFO:tasks.workunit.client.1.smithi184.stdout:0/818: mkdir d0/d1f/de3/d95/d108/d11c 0 2024-02-28T23:07:44.266 INFO:tasks.workunit.client.1.smithi184.stdout:2/732: dread d10/d1f/d21/d5e/d15/d60/f9a [0,4194304] 0 2024-02-28T23:07:44.266 INFO:tasks.workunit.client.0.smithi159.stdout:7/897: dwrite d5/d16/d1a/d27/d37/dcd/f105 [0,4194304] 0 2024-02-28T23:07:44.268 INFO:tasks.workunit.client.1.smithi184.stdout:3/828: dwrite d1/d4/d1c/d62/d66/dd3/d26/dd2/fd9 [0,4194304] 0 2024-02-28T23:07:44.269 INFO:tasks.workunit.client.1.smithi184.stdout:1/835: truncate d20/d32/d3e/d61/d8b/d9c/db8/fed 902878 0 2024-02-28T23:07:44.270 INFO:tasks.workunit.client.1.smithi184.stdout:0/819: write d0/d1f/f9a [482480,85001] 0 2024-02-28T23:07:44.276 INFO:tasks.workunit.client.1.smithi184.stdout:7/735: getdents d6/d9/d13/d14/d45 0 2024-02-28T23:07:44.283 INFO:tasks.workunit.client.1.smithi184.stdout:5/774: link db/d12/d1c/d21/d4d/f56 db/d12/d18/d2e/d3c/d5d/ff6 0 2024-02-28T23:07:44.286 INFO:tasks.workunit.client.1.smithi184.stdout:4/768: dread d1/d8/d37/f4c [0,4194304] 0 2024-02-28T23:07:44.287 INFO:tasks.workunit.client.0.smithi159.stdout:3/953: dread d0/d3f/dd2/d6a/ddd/ffe [0,4194304] 0 2024-02-28T23:07:44.288 INFO:tasks.workunit.client.0.smithi159.stdout:7/898: rename d5/d16/d1a/d27/deb/f85 to d5/d16/d1a/d27/f11f 0 2024-02-28T23:07:44.291 INFO:tasks.workunit.client.1.smithi184.stdout:1/836: truncate d20/d46/d90/f60 6759198 0 2024-02-28T23:07:44.291 INFO:tasks.workunit.client.0.smithi159.stdout:7/899: chown d5/d56/d2a/fdf 177709679 1 2024-02-28T23:07:44.292 INFO:tasks.workunit.client.1.smithi184.stdout:5/775: dread db/d12/d1c/d21/d2f/f5a [0,4194304] 0 2024-02-28T23:07:44.293 INFO:tasks.workunit.client.1.smithi184.stdout:2/733: mknod d10/d1f/d21/d5e/cea 0 2024-02-28T23:07:44.294 INFO:tasks.workunit.client.1.smithi184.stdout:0/820: dread d0/d1d/d4c/f69 [0,4194304] 0 2024-02-28T23:07:44.294 INFO:tasks.workunit.client.1.smithi184.stdout:7/736: readlink d6/d9/d13/d3e/dad/d49/da6/daf/d47/lb0 0 2024-02-28T23:07:44.294 INFO:tasks.workunit.client.1.smithi184.stdout:2/734: read - d10/fdc zero size 2024-02-28T23:07:44.297 INFO:tasks.workunit.client.1.smithi184.stdout:0/821: fsync d0/d1d/d3a/da9/d11b/d27/d31/d51/d85/fc0 0 2024-02-28T23:07:44.301 INFO:tasks.workunit.client.0.smithi159.stdout:7/900: getdents d5/d16/d1a/d27/d46/d101/d64/db4 0 2024-02-28T23:07:44.303 INFO:tasks.workunit.client.1.smithi184.stdout:5/776: rename db/d12/d1c/fd1 to db/d12/d1c/d21/d25/dd3/df1/ff7 0 2024-02-28T23:07:44.305 INFO:tasks.workunit.client.1.smithi184.stdout:5/777: chown db/d12/d1c/d21/d2f/dc4 1332797916 1 2024-02-28T23:07:44.305 INFO:tasks.workunit.client.1.smithi184.stdout:0/822: unlink d0/d1f/f28 0 2024-02-28T23:07:44.306 INFO:tasks.workunit.client.1.smithi184.stdout:5/778: stat db/d12/d18/d2e/fd2 0 2024-02-28T23:07:44.307 INFO:tasks.workunit.client.1.smithi184.stdout:4/769: creat d1/d4/d43/d73/db7/fed x:0 0 0 2024-02-28T23:07:44.308 INFO:tasks.workunit.client.1.smithi184.stdout:5/779: fsync db/d12/d50/d9e/fbb 0 2024-02-28T23:07:44.308 INFO:tasks.workunit.client.0.smithi159.stdout:7/901: truncate d5/d56/d50/daa/fa4 5312529 0 2024-02-28T23:07:44.309 INFO:tasks.workunit.client.1.smithi184.stdout:1/837: creat d20/d46/d90/dff/f11a x:0 0 0 2024-02-28T23:07:44.313 INFO:tasks.workunit.client.1.smithi184.stdout:2/735: creat d10/d1f/d21/d5e/dad/da3/dd6/de5/feb x:0 0 0 2024-02-28T23:07:44.314 INFO:tasks.workunit.client.1.smithi184.stdout:8/796: sync 2024-02-28T23:07:44.316 INFO:tasks.workunit.client.1.smithi184.stdout:3/829: getdents d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/dee 0 2024-02-28T23:07:44.316 INFO:tasks.workunit.client.1.smithi184.stdout:9/785: write d5/d47/d59/fb2 [3170953,52358] 0 2024-02-28T23:07:44.318 INFO:tasks.workunit.client.0.smithi159.stdout:7/902: rename d5/d16/d40/dce/cd2 to d5/d16/d1a/d27/d46/d101/c120 0 2024-02-28T23:07:44.320 INFO:tasks.workunit.client.1.smithi184.stdout:4/770: creat d1/dc/df/d5b/db2/fee x:0 0 0 2024-02-28T23:07:44.320 INFO:tasks.workunit.client.1.smithi184.stdout:5/780: creat db/da4/ff8 x:0 0 0 2024-02-28T23:07:44.322 INFO:tasks.workunit.client.1.smithi184.stdout:1/838: mkdir d20/d32/d3e/d82/d85/d8c/d11b 0 2024-02-28T23:07:44.323 INFO:tasks.workunit.client.0.smithi159.stdout:7/903: dread - d5/d16/d1a/d27/d37/dcd/fe3 zero size 2024-02-28T23:07:44.326 INFO:tasks.workunit.client.1.smithi184.stdout:8/797: rmdir d1/da/d10/d43/da1 39 2024-02-28T23:07:44.329 INFO:tasks.workunit.client.1.smithi184.stdout:7/737: rename d6/d9/d13/d3e/dad/d49/d50/df8/d33/d80/lc6 to d6/lfe 0 2024-02-28T23:07:44.330 INFO:tasks.workunit.client.0.smithi159.stdout:3/954: dread d0/d47/fc5 [0,4194304] 0 2024-02-28T23:07:44.332 INFO:tasks.workunit.client.0.smithi159.stdout:7/904: creat d5/d16/d1a/d27/d46/d101/f121 x:0 0 0 2024-02-28T23:07:44.333 INFO:tasks.workunit.client.0.smithi159.stdout:3/955: chown d0/d3f/dd2/d63/c100 514663739 1 2024-02-28T23:07:44.338 INFO:tasks.workunit.client.0.smithi159.stdout:7/905: creat d5/d16/d1a/d27/d3e/dee/f122 x:0 0 0 2024-02-28T23:07:44.342 INFO:tasks.workunit.client.0.smithi159.stdout:7/906: dread - d5/d16/d1a/d27/d37/dcd/fe3 zero size 2024-02-28T23:07:44.345 INFO:tasks.workunit.client.1.smithi184.stdout:2/736: write d10/d1f/d21/d5e/d15/f1b [1514817,92634] 0 2024-02-28T23:07:44.346 INFO:tasks.workunit.client.1.smithi184.stdout:7/738: creat d6/d9/d13/d3e/dad/fff x:0 0 0 2024-02-28T23:07:44.347 INFO:tasks.workunit.client.1.smithi184.stdout:6/717: sync 2024-02-28T23:07:44.348 INFO:tasks.workunit.client.1.smithi184.stdout:5/781: write db/d12/d18/d2e/d3c/d5d/d66/f74 [3501487,47624] 0 2024-02-28T23:07:44.349 INFO:tasks.workunit.client.0.smithi159.stdout:7/907: symlink d5/d16/d1a/d27/d46/d65/d81/d83/l123 0 2024-02-28T23:07:44.350 INFO:tasks.workunit.client.1.smithi184.stdout:1/839: mknod d20/d32/d3e/d82/d106/c11c 0 2024-02-28T23:07:44.351 INFO:tasks.workunit.client.1.smithi184.stdout:2/737: read d10/d1f/d21/d4d/d67/f95 [2444439,73202] 0 2024-02-28T23:07:44.351 INFO:tasks.workunit.client.1.smithi184.stdout:7/739: chown d6/d9/d13/l74 1062528209 1 2024-02-28T23:07:44.352 INFO:tasks.workunit.client.1.smithi184.stdout:4/771: write d1/d8/d35/dd9/f66 [2600044,60783] 0 2024-02-28T23:07:44.354 INFO:tasks.workunit.client.1.smithi184.stdout:9/786: creat d5/d47/d68/fff x:0 0 0 2024-02-28T23:07:44.356 INFO:tasks.workunit.client.0.smithi159.stdout:7/908: rmdir d5/d16/d1a/d27/d3e 39 2024-02-28T23:07:44.357 INFO:tasks.workunit.client.1.smithi184.stdout:5/782: truncate db/d12/d1c/d21/d25/fe3 806497 0 2024-02-28T23:07:44.359 INFO:tasks.workunit.client.1.smithi184.stdout:6/718: mkdir dc/de/d2a/d5c/d79/db9/de6 0 2024-02-28T23:07:44.360 INFO:tasks.workunit.client.1.smithi184.stdout:7/740: fsync f0 0 2024-02-28T23:07:44.362 INFO:tasks.workunit.client.1.smithi184.stdout:3/830: dread d1/f8d [0,4194304] 0 2024-02-28T23:07:44.362 INFO:tasks.workunit.client.1.smithi184.stdout:2/738: creat d10/d1f/d21/d5e/dad/da3/fec x:0 0 0 2024-02-28T23:07:44.366 INFO:tasks.workunit.client.1.smithi184.stdout:8/798: creat d1/da/dc/d16/d29/f11f x:0 0 0 2024-02-28T23:07:44.366 INFO:tasks.workunit.client.0.smithi159.stdout:7/909: creat d5/d16/d40/dce/f124 x:0 0 0 2024-02-28T23:07:44.372 INFO:tasks.workunit.client.0.smithi159.stdout:3/956: dread d0/d6/d34/f62 [4194304,4194304] 0 2024-02-28T23:07:44.372 INFO:tasks.workunit.client.1.smithi184.stdout:0/823: rename d0/d1f/de3/d95 to d0/d11d 0 2024-02-28T23:07:44.373 INFO:tasks.workunit.client.1.smithi184.stdout:9/787: creat d5/db/de/d10/d6a/f100 x:0 0 0 2024-02-28T23:07:44.373 INFO:tasks.workunit.client.0.smithi159.stdout:7/910: mkdir d5/d16/d1a/d27/d46/d101/d64/db4/dc8/d102/d125 0 2024-02-28T23:07:44.375 INFO:tasks.workunit.client.1.smithi184.stdout:4/772: dread d1/d8/d19/d56/d7a/faf [0,4194304] 0 2024-02-28T23:07:44.378 INFO:tasks.workunit.client.1.smithi184.stdout:2/739: creat d10/d1f/d21/d6a/fed x:0 0 0 2024-02-28T23:07:44.379 INFO:tasks.workunit.client.0.smithi159.stdout:7/911: read d5/f9b [402147,11325] 0 2024-02-28T23:07:44.382 INFO:tasks.workunit.client.1.smithi184.stdout:6/719: write dc/d60/d7c/fc2 [2123482,59890] 0 2024-02-28T23:07:44.384 INFO:tasks.workunit.client.0.smithi159.stdout:3/957: rename d0/d2b/d55/df8/da9/fe0 to d0/d2b/d55/df8/f134 0 2024-02-28T23:07:44.384 INFO:tasks.workunit.client.1.smithi184.stdout:6/720: dread - dc/d60/d7c/d61/fc4 zero size 2024-02-28T23:07:44.385 INFO:tasks.workunit.client.0.smithi159.stdout:7/912: rename d5/d16/d1a/d27/d46 to d5/d16/d1a/d27/d46/d101/d126 22 2024-02-28T23:07:44.387 INFO:tasks.workunit.client.1.smithi184.stdout:1/840: rename d20/d32/d3e/d61/d8b/d9c/db8/fe4 to d20/d32/d3e/d91/df2/f11d 0 2024-02-28T23:07:44.387 INFO:tasks.workunit.client.0.smithi159.stdout:7/913: dread - d5/d16/d40/dce/f11d zero size 2024-02-28T23:07:44.387 INFO:tasks.workunit.client.1.smithi184.stdout:9/788: dwrite d5/fea [0,4194304] 0 2024-02-28T23:07:44.389 INFO:tasks.workunit.client.1.smithi184.stdout:5/783: symlink db/d44/da5/ddf/lf9 0 2024-02-28T23:07:44.390 INFO:tasks.workunit.client.0.smithi159.stdout:3/958: creat d0/d2b/d55/d75/f135 x:0 0 0 2024-02-28T23:07:44.397 INFO:tasks.workunit.client.1.smithi184.stdout:8/799: mkdir d1/da/d120 0 2024-02-28T23:07:44.399 INFO:tasks.workunit.client.1.smithi184.stdout:8/800: dread - d1/da/dc/d16/d29/f11f zero size 2024-02-28T23:07:44.404 INFO:tasks.workunit.client.0.smithi159.stdout:7/914: rename d5/d56/d50/daa/fa4 to d5/d16/d1a/d27/dff/f127 0 2024-02-28T23:07:44.412 INFO:tasks.workunit.client.1.smithi184.stdout:0/824: symlink d0/d11d/d108/d11c/l11e 0 2024-02-28T23:07:44.413 INFO:tasks.workunit.client.0.smithi159.stdout:7/915: fsync d5/d16/d1a/d27/d46/d65/d81/d83/d9d/ffc 0 2024-02-28T23:07:44.414 INFO:tasks.workunit.client.1.smithi184.stdout:0/825: readlink d0/d1f/d109/dcb/ld9 0 2024-02-28T23:07:44.416 INFO:tasks.workunit.client.1.smithi184.stdout:8/801: dwrite d1/da/dc/d16/dbd/ff6 [4194304,4194304] 0 2024-02-28T23:07:44.417 INFO:tasks.workunit.client.1.smithi184.stdout:7/741: rename d6/d9/d13/d14/f7b to d6/d9/d13/d3e/dad/f100 0 2024-02-28T23:07:44.421 INFO:tasks.workunit.client.1.smithi184.stdout:7/742: chown d6/d9/d13/d3e/dad/d49/da6/daf/fde 1406 1 2024-02-28T23:07:44.421 INFO:tasks.workunit.client.1.smithi184.stdout:6/721: dread dc/d60/d7c/f6b [0,4194304] 0 2024-02-28T23:07:44.421 INFO:tasks.workunit.client.1.smithi184.stdout:1/841: mkdir d20/d32/d3e/dc9/d11e 0 2024-02-28T23:07:44.422 INFO:tasks.workunit.client.0.smithi159.stdout:7/916: stat d5/d16/d1a/d27/d46/d65/d81/cda 0 2024-02-28T23:07:44.423 INFO:tasks.workunit.client.0.smithi159.stdout:3/959: dwrite d0/d47/dc2/fc8 [0,4194304] 0 2024-02-28T23:07:44.423 INFO:tasks.workunit.client.1.smithi184.stdout:7/743: fsync d6/d9/d13/d14/f42 0 2024-02-28T23:07:44.423 INFO:tasks.workunit.client.1.smithi184.stdout:4/773: mknod d1/dc/df/cef 0 2024-02-28T23:07:44.426 INFO:tasks.workunit.client.1.smithi184.stdout:3/831: link d1/d4/d6/l4c d1/d4/d1c/d62/d92/l100 0 2024-02-28T23:07:44.427 INFO:tasks.workunit.client.0.smithi159.stdout:7/917: readlink d5/d16/d1a/d27/d95/lf0 0 2024-02-28T23:07:44.431 INFO:tasks.workunit.client.1.smithi184.stdout:0/826: dread - d0/d1d/d3a/fe7 zero size 2024-02-28T23:07:44.434 INFO:tasks.workunit.client.0.smithi159.stdout:7/918: mkdir d5/d16/d1a/d27/d46/d101/d128 0 2024-02-28T23:07:44.437 INFO:tasks.workunit.client.0.smithi159.stdout:7/919: fdatasync d5/d16/d1a/d27/d46/d101/f121 0 2024-02-28T23:07:44.437 INFO:tasks.workunit.client.1.smithi184.stdout:9/789: write d5/d47/d59/f87 [675847,87583] 0 2024-02-28T23:07:44.437 INFO:tasks.workunit.client.1.smithi184.stdout:2/740: rename d10/d1f/d21/d5e/d15/l4a to d10/d1f/d21/d5e/d15/d60/d66/lee 0 2024-02-28T23:07:44.440 INFO:tasks.workunit.client.1.smithi184.stdout:9/790: chown c3 1671235979 1 2024-02-28T23:07:44.443 INFO:tasks.workunit.client.1.smithi184.stdout:2/741: write d10/d33/fc9 [255627,119382] 0 2024-02-28T23:07:44.444 INFO:tasks.workunit.client.1.smithi184.stdout:4/774: unlink d1/l2f 0 2024-02-28T23:07:44.445 INFO:tasks.workunit.client.1.smithi184.stdout:6/722: dwrite dc/de/d2a/d5c/d6e/fc3 [0,4194304] 0 2024-02-28T23:07:44.448 INFO:tasks.workunit.client.1.smithi184.stdout:1/842: unlink d20/d32/db0/fcb 0 2024-02-28T23:07:44.448 INFO:tasks.workunit.client.1.smithi184.stdout:3/832: mkdir d1/d4/d1c/d62/d66/dab/d101 0 2024-02-28T23:07:44.448 INFO:tasks.workunit.client.1.smithi184.stdout:7/744: dwrite d6/d68/f7a [0,4194304] 0 2024-02-28T23:07:44.448 INFO:tasks.workunit.client.1.smithi184.stdout:4/775: chown d1/d8/d3d/f74 1251065 1 2024-02-28T23:07:44.452 INFO:tasks.workunit.client.1.smithi184.stdout:0/827: symlink d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/da3/l11f 0 2024-02-28T23:07:44.454 INFO:tasks.workunit.client.0.smithi159.stdout:3/960: dwrite d0/fac [0,4194304] 0 2024-02-28T23:07:44.455 INFO:tasks.workunit.client.1.smithi184.stdout:0/828: chown d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92 3 1 2024-02-28T23:07:44.455 INFO:tasks.workunit.client.1.smithi184.stdout:4/776: chown d1/d8/d19/d56/d7a/ld3 12 1 2024-02-28T23:07:44.455 INFO:tasks.workunit.client.1.smithi184.stdout:5/784: link db/fb3 db/d12/d18/d2e/ffa 0 2024-02-28T23:07:44.456 INFO:tasks.workunit.client.1.smithi184.stdout:9/791: mknod d5/d73/c101 0 2024-02-28T23:07:44.456 INFO:tasks.workunit.client.1.smithi184.stdout:2/742: mknod d10/d1f/d21/d5e/dad/cef 0 2024-02-28T23:07:44.458 INFO:tasks.workunit.client.1.smithi184.stdout:7/745: dread - d6/d9/d13/d3e/dad/d49/da6/daf/fde zero size 2024-02-28T23:07:44.459 INFO:tasks.workunit.client.1.smithi184.stdout:5/785: readlink db/d12/d18/d2e/le2 0 2024-02-28T23:07:44.461 INFO:tasks.workunit.client.1.smithi184.stdout:6/723: fsync dc/de/d10/f43 0 2024-02-28T23:07:44.461 INFO:tasks.workunit.client.1.smithi184.stdout:8/802: creat d1/da/df/f121 x:0 0 0 2024-02-28T23:07:44.461 INFO:tasks.workunit.client.1.smithi184.stdout:1/843: creat d20/d46/d90/db3/f11f x:0 0 0 2024-02-28T23:07:44.463 INFO:tasks.workunit.client.0.smithi159.stdout:7/920: dwrite d5/d16/d40/dce/fe9 [0,4194304] 0 2024-02-28T23:07:44.463 INFO:tasks.workunit.client.1.smithi184.stdout:5/786: readlink db/d12/l2d 0 2024-02-28T23:07:44.463 INFO:tasks.workunit.client.1.smithi184.stdout:3/833: creat d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/ddc/f102 x:0 0 0 2024-02-28T23:07:44.473 INFO:tasks.workunit.client.1.smithi184.stdout:8/803: chown d1/da/df/d20/c70 5 1 2024-02-28T23:07:44.475 INFO:tasks.workunit.client.1.smithi184.stdout:6/724: mknod dc/de/d2a/d5c/d79/ce7 0 2024-02-28T23:07:44.476 INFO:tasks.workunit.client.0.smithi159.stdout:7/921: symlink d5/d16/d1a/d27/d46/d65/d81/d98/de5/l129 0 2024-02-28T23:07:44.478 INFO:tasks.workunit.client.1.smithi184.stdout:0/829: dread d0/d1d/d3a/da9/d11b/d27/d31/d51/f73 [0,4194304] 0 2024-02-28T23:07:44.480 INFO:tasks.workunit.client.1.smithi184.stdout:8/804: readlink d1/da/dc/d16/d29/ld9 0 2024-02-28T23:07:44.483 INFO:tasks.workunit.client.1.smithi184.stdout:9/792: truncate d5/db/de/f21 2105737 0 2024-02-28T23:07:44.486 INFO:tasks.workunit.client.0.smithi159.stdout:3/961: getdents d0/d2b 0 2024-02-28T23:07:44.486 INFO:tasks.workunit.client.1.smithi184.stdout:7/746: write d6/d68/f7a [4498756,128413] 0 2024-02-28T23:07:44.489 INFO:tasks.workunit.client.1.smithi184.stdout:4/777: dwrite d1/d8/d19/d92/db3/fdf [0,4194304] 0 2024-02-28T23:07:44.489 INFO:tasks.workunit.client.1.smithi184.stdout:5/787: rename db/fb3 to db/d12/d50/ddc/ffb 0 2024-02-28T23:07:44.492 INFO:tasks.workunit.client.1.smithi184.stdout:2/743: dwrite d10/d1f/d21/d5e/dad/f82 [0,4194304] 0 2024-02-28T23:07:44.494 INFO:tasks.workunit.client.1.smithi184.stdout:4/778: write d1/d8/d3d/f74 [231560,117697] 0 2024-02-28T23:07:44.495 INFO:tasks.workunit.client.1.smithi184.stdout:5/788: chown db/d12/d1c/d21/d25/fe3 6133 1 2024-02-28T23:07:44.497 INFO:tasks.workunit.client.1.smithi184.stdout:5/789: chown db/d12/d1c/d21/f5e 13 1 2024-02-28T23:07:44.500 INFO:tasks.workunit.client.1.smithi184.stdout:5/790: write db/d12/d1c/d21/d25/fed [303398,35445] 0 2024-02-28T23:07:44.501 INFO:tasks.workunit.client.0.smithi159.stdout:7/922: dwrite d5/d56/d2a/f4d [0,4194304] 0 2024-02-28T23:07:44.505 INFO:tasks.workunit.client.0.smithi159.stdout:3/962: rename d0/d6/f102 to d0/d2b/d55/df8/d2f/ddf/f136 0 2024-02-28T23:07:44.507 INFO:tasks.workunit.client.0.smithi159.stdout:7/923: readlink d5/d16/l8e 0 2024-02-28T23:07:44.516 INFO:tasks.workunit.client.1.smithi184.stdout:7/747: mkdir d6/d9/d13/d3e/dad/d49/d9c/d101 0 2024-02-28T23:07:44.519 INFO:tasks.workunit.client.0.smithi159.stdout:7/924: getdents d5/d16/d1a/d27/d46/df2 0 2024-02-28T23:07:44.523 INFO:tasks.workunit.client.1.smithi184.stdout:1/844: getdents d20/d32/d3e/d82/d106 0 2024-02-28T23:07:44.524 INFO:tasks.workunit.client.1.smithi184.stdout:1/845: stat d20/d46/lf5 0 2024-02-28T23:07:44.525 INFO:tasks.workunit.client.1.smithi184.stdout:4/779: read d1/d4/d43/d73/f91 [2926146,42646] 0 2024-02-28T23:07:44.527 INFO:tasks.workunit.client.1.smithi184.stdout:3/834: write d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d82/f9e [1039626,124334] 0 2024-02-28T23:07:44.527 INFO:tasks.workunit.client.1.smithi184.stdout:8/805: creat d1/da/d10/d43/d101/f122 x:0 0 0 2024-02-28T23:07:44.530 INFO:tasks.workunit.client.1.smithi184.stdout:9/793: fsync d5/db/de/d10/f30 0 2024-02-28T23:07:44.533 INFO:tasks.workunit.client.1.smithi184.stdout:5/791: mkdir db/d12/d18/db5/dfc 0 2024-02-28T23:07:44.535 INFO:tasks.workunit.client.0.smithi159.stdout:7/925: link d5/d16/d1a/d27/d46/d65/d81/d83/l123 d5/d16/d1a/d27/d37/dcd/l12a 0 2024-02-28T23:07:44.535 INFO:tasks.workunit.client.1.smithi184.stdout:5/792: dread - db/d12/d18/d2e/ffa zero size 2024-02-28T23:07:44.538 INFO:tasks.workunit.client.1.smithi184.stdout:5/793: truncate db/d12/d18/d2e/d3c/d5d/fe6 1008023 0 2024-02-28T23:07:44.546 INFO:tasks.workunit.client.1.smithi184.stdout:7/748: symlink d6/d9/d13/d1e/l102 0 2024-02-28T23:07:44.550 INFO:tasks.workunit.client.0.smithi159.stdout:7/926: truncate d5/d56/d50/f80 5184889 0 2024-02-28T23:07:44.554 INFO:tasks.workunit.client.1.smithi184.stdout:6/725: getdents dc/d60/d78 0 2024-02-28T23:07:44.555 INFO:tasks.workunit.client.1.smithi184.stdout:2/744: dwrite d10/d1f/d38/d54/f76 [0,4194304] 0 2024-02-28T23:07:44.558 INFO:tasks.workunit.client.0.smithi159.stdout:7/927: mkdir d5/d16/d1a/d27/d37/dcd/d12b 0 2024-02-28T23:07:44.558 INFO:tasks.workunit.client.0.smithi159.stdout:3/963: dread d0/d3f/dd2/d63/fec [0,4194304] 0 2024-02-28T23:07:44.565 INFO:tasks.workunit.client.1.smithi184.stdout:1/846: dread - d20/d32/d3e/d82/d85/d86/fd7 zero size 2024-02-28T23:07:44.566 INFO:tasks.workunit.client.1.smithi184.stdout:6/726: rmdir dc/de/d10 39 2024-02-28T23:07:44.566 INFO:tasks.workunit.client.1.smithi184.stdout:8/806: dwrite d1/da/dd7/fe2 [0,4194304] 0 2024-02-28T23:07:44.568 INFO:tasks.workunit.client.1.smithi184.stdout:3/835: creat d1/d4/f103 x:0 0 0 2024-02-28T23:07:44.568 INFO:tasks.workunit.client.1.smithi184.stdout:6/727: readlink dc/d60/d62/lcb 0 2024-02-28T23:07:44.576 INFO:tasks.workunit.client.1.smithi184.stdout:0/830: sync 2024-02-28T23:07:44.576 INFO:tasks.workunit.client.1.smithi184.stdout:0/831: readlink d0/l10 0 2024-02-28T23:07:44.576 INFO:tasks.workunit.client.1.smithi184.stdout:9/794: rmdir d5/db/de/d10/d12/df7 0 2024-02-28T23:07:44.576 INFO:tasks.workunit.client.1.smithi184.stdout:0/832: truncate d0/f37 8685670 0 2024-02-28T23:07:44.577 INFO:tasks.workunit.client.1.smithi184.stdout:8/807: mkdir d1/da/df/d20/dc7/d123 0 2024-02-28T23:07:44.578 INFO:tasks.workunit.client.1.smithi184.stdout:9/795: dread - d5/d47/d68/fff zero size 2024-02-28T23:07:44.578 INFO:tasks.workunit.client.0.smithi159.stdout:7/928: unlink d5/d16/d1a/lc6 0 2024-02-28T23:07:44.580 INFO:tasks.workunit.client.1.smithi184.stdout:5/794: dread db/d12/d50/d9e/fd7 [0,4194304] 0 2024-02-28T23:07:44.584 INFO:tasks.workunit.client.1.smithi184.stdout:7/749: creat d6/d9/f103 x:0 0 0 2024-02-28T23:07:44.585 INFO:tasks.workunit.client.1.smithi184.stdout:3/836: dread d1/d4/d6/f51 [4194304,4194304] 0 2024-02-28T23:07:44.585 INFO:tasks.workunit.client.1.smithi184.stdout:7/750: fdatasync d6/f48 0 2024-02-28T23:07:44.590 INFO:tasks.workunit.client.1.smithi184.stdout:8/808: read d1/da/dc/fb6 [122446,18164] 0 2024-02-28T23:07:44.590 INFO:tasks.workunit.client.1.smithi184.stdout:4/780: truncate d1/d4/d43/d73/fc5 604542 0 2024-02-28T23:07:44.593 INFO:tasks.workunit.client.1.smithi184.stdout:8/809: write d1/da/d10/d17/d63/f68 [6604900,124549] 0 2024-02-28T23:07:44.595 INFO:tasks.workunit.client.1.smithi184.stdout:5/795: symlink db/d12/d18/d2e/d3c/d5d/d66/lfd 0 2024-02-28T23:07:44.599 INFO:tasks.workunit.client.0.smithi159.stdout:7/929: dwrite d5/d16/d40/dce/fe9 [0,4194304] 0 2024-02-28T23:07:44.599 INFO:tasks.workunit.client.1.smithi184.stdout:3/837: unlink d1/d4/d6/f51 0 2024-02-28T23:07:44.602 INFO:tasks.workunit.client.0.smithi159.stdout:3/964: truncate d0/d47/dc2/fc8 3904909 0 2024-02-28T23:07:44.602 INFO:tasks.workunit.client.0.smithi159.stdout:7/930: stat d5/d16/d40/l4f 0 2024-02-28T23:07:44.608 INFO:tasks.workunit.client.0.smithi159.stdout:3/965: truncate d0/d2b/d55/d75/d6d/ff5 1407750 0 2024-02-28T23:07:44.609 INFO:tasks.workunit.client.1.smithi184.stdout:4/781: mknod d1/dc/df/d38/d57/cf0 0 2024-02-28T23:07:44.609 INFO:tasks.workunit.client.1.smithi184.stdout:2/745: write d10/d1f/d21/d4d/d67/d65/fe0 [3349619,109065] 0 2024-02-28T23:07:44.611 INFO:tasks.workunit.client.1.smithi184.stdout:4/782: write d1/d8/d19/d67/d99/faa [4977902,10879] 0 2024-02-28T23:07:44.612 INFO:tasks.workunit.client.1.smithi184.stdout:2/746: write d10/d1f/d21/d6a/f84 [4405939,86750] 0 2024-02-28T23:07:44.613 INFO:tasks.workunit.client.1.smithi184.stdout:0/833: creat d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/dac/f120 x:0 0 0 2024-02-28T23:07:44.614 INFO:tasks.workunit.client.0.smithi159.stdout:3/966: creat d0/d47/d88/da5/f137 x:0 0 0 2024-02-28T23:07:44.616 INFO:tasks.workunit.client.1.smithi184.stdout:4/783: read d1/dc/df/d5b/db2/fb4 [733867,46933] 0 2024-02-28T23:07:44.617 INFO:tasks.workunit.client.1.smithi184.stdout:4/784: readlink d1/dc/df/l62 0 2024-02-28T23:07:44.621 INFO:tasks.workunit.client.1.smithi184.stdout:9/796: rename d5/d17/d43/f60 to d5/db/f102 0 2024-02-28T23:07:44.627 INFO:tasks.workunit.client.1.smithi184.stdout:1/847: dread d20/d46/d90/f60 [0,4194304] 0 2024-02-28T23:07:44.627 INFO:tasks.workunit.client.0.smithi159.stdout:7/931: getdents d5/d16/d1a/d27/d46/d101 0 2024-02-28T23:07:44.628 INFO:tasks.workunit.client.1.smithi184.stdout:4/785: mknod d1/dc/df/d5b/d6c/cf1 0 2024-02-28T23:07:44.629 INFO:tasks.workunit.client.1.smithi184.stdout:4/786: fsync d1/d4/f95 0 2024-02-28T23:07:44.629 INFO:tasks.workunit.client.1.smithi184.stdout:2/747: dwrite d10/fdc [0,4194304] 0 2024-02-28T23:07:44.632 INFO:tasks.workunit.client.0.smithi159.stdout:7/932: write d5/d16/d1a/d27/d75/fc7 [2152077,59229] 0 2024-02-28T23:07:44.632 INFO:tasks.workunit.client.1.smithi184.stdout:4/787: write d1/dc/df/d38/d57/dd6/ddd/fe7 [766381,61796] 0 2024-02-28T23:07:44.632 INFO:tasks.workunit.client.1.smithi184.stdout:7/751: rename d6/d9/d13/d3e/dad/d49/d50/db2/fef to d6/d68/f104 0 2024-02-28T23:07:44.638 INFO:tasks.workunit.client.1.smithi184.stdout:9/797: symlink d5/db/de/d10/dc9/l103 0 2024-02-28T23:07:44.645 INFO:tasks.workunit.client.1.smithi184.stdout:5/796: rmdir db/d12/d18/d2e/d3c/d5d/d66 39 2024-02-28T23:07:44.659 INFO:tasks.workunit.client.1.smithi184.stdout:8/810: getdents d1/da/dc/d16/d32/d42/d77/ddd 0 2024-02-28T23:07:44.660 INFO:tasks.workunit.client.0.smithi159.stdout:3/967: write d0/d6/f13 [683505,104288] 0 2024-02-28T23:07:44.663 INFO:tasks.workunit.client.0.smithi159.stdout:3/968: stat d0/d3f/dd2/d63/f128 0 2024-02-28T23:07:44.663 INFO:tasks.workunit.client.1.smithi184.stdout:6/728: sync 2024-02-28T23:07:44.664 INFO:tasks.workunit.client.0.smithi159.stdout:3/969: stat d0/d6/ce1 0 2024-02-28T23:07:44.669 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:44 smithi159 ceph-mon[28802]: pgmap v41: 65 pgs: 65 active+clean; 3.6 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 78 MiB/s rd, 188 MiB/s wr, 400 op/s 2024-02-28T23:07:44.671 INFO:tasks.workunit.client.1.smithi184.stdout:0/834: creat d0/d1d/d3a/da9/d11b/d27/f121 x:0 0 0 2024-02-28T23:07:44.673 INFO:tasks.workunit.client.0.smithi159.stdout:3/970: mknod d0/d2b/d55/df8/d2f/c138 0 2024-02-28T23:07:44.675 INFO:tasks.workunit.client.0.smithi159.stdout:3/971: write d0/d2b/fb9 [219221,124585] 0 2024-02-28T23:07:44.677 INFO:tasks.workunit.client.1.smithi184.stdout:7/752: creat d6/d9/d13/d3e/dad/d7d/dc9/f105 x:0 0 0 2024-02-28T23:07:44.685 INFO:tasks.workunit.client.1.smithi184.stdout:5/797: truncate db/d12/d18/d2e/f79 1435870 0 2024-02-28T23:07:44.686 INFO:tasks.workunit.client.0.smithi159.stdout:7/933: truncate d5/d16/d1a/d27/d3e/fab 1091676 0 2024-02-28T23:07:44.689 INFO:tasks.workunit.client.1.smithi184.stdout:1/848: dwrite f9 [4194304,4194304] 0 2024-02-28T23:07:44.689 INFO:tasks.workunit.client.1.smithi184.stdout:6/729: fdatasync dc/d60/d7c/d61/fc4 0 2024-02-28T23:07:44.694 INFO:tasks.workunit.client.1.smithi184.stdout:2/748: unlink d10/d1f/d21/d6a/f84 0 2024-02-28T23:07:44.698 INFO:tasks.workunit.client.1.smithi184.stdout:2/749: dread - d10/d1f/d21/d4d/d67/d65/fd8 zero size 2024-02-28T23:07:44.699 INFO:tasks.workunit.client.0.smithi159.stdout:3/972: rmdir d0/d2b/d55/df8/d57/d110 0 2024-02-28T23:07:44.700 INFO:tasks.workunit.client.1.smithi184.stdout:0/835: fsync d0/fa4 0 2024-02-28T23:07:44.703 INFO:tasks.workunit.client.0.smithi159.stdout:7/934: mkdir d5/d16/d1a/d27/d46/d101/d64/db4/d10e/d111/d12c 0 2024-02-28T23:07:44.704 INFO:tasks.workunit.client.1.smithi184.stdout:0/836: dread d0/d1d/d4c/f69 [0,4194304] 0 2024-02-28T23:07:44.705 INFO:tasks.workunit.client.0.smithi159.stdout:7/935: readlink d5/d16/d1a/d27/d75/dac/dbe/lc2 0 2024-02-28T23:07:44.706 INFO:tasks.workunit.client.0.smithi159.stdout:3/973: creat d0/d47/dc2/f139 x:0 0 0 2024-02-28T23:07:44.706 INFO:tasks.workunit.client.1.smithi184.stdout:9/798: dread d5/d17/d43/db8/ff0 [0,4194304] 0 2024-02-28T23:07:44.708 INFO:tasks.workunit.client.0.smithi159.stdout:3/974: read - d0/d47/dc2/f139 zero size 2024-02-28T23:07:44.710 INFO:tasks.workunit.client.1.smithi184.stdout:2/750: creat d10/d55/ff0 x:0 0 0 2024-02-28T23:07:44.712 INFO:tasks.workunit.client.1.smithi184.stdout:3/838: rename d1/d4/d6/d1e/l44 to d1/d4/d1c/l104 0 2024-02-28T23:07:44.714 INFO:tasks.workunit.client.0.smithi159.stdout:3/975: mkdir d0/d2b/d55/df8/d10c/d13a 0 2024-02-28T23:07:44.716 INFO:tasks.workunit.client.1.smithi184.stdout:7/753: mkdir d6/d9/d13/d14/d106 0 2024-02-28T23:07:44.718 INFO:tasks.workunit.client.1.smithi184.stdout:9/799: symlink d5/d17/d43/db8/l104 0 2024-02-28T23:07:44.723 INFO:tasks.workunit.client.0.smithi159.stdout:3/976: rename d0/def to d0/d2b/d4f/dc3/d13b 0 2024-02-28T23:07:44.724 INFO:tasks.workunit.client.1.smithi184.stdout:2/751: creat d10/d1f/d21/d5e/d15/d24/d5f/ff1 x:0 0 0 2024-02-28T23:07:44.726 INFO:tasks.workunit.client.0.smithi159.stdout:7/936: dwrite d5/d16/d1a/d27/d37/dcd/f105 [4194304,4194304] 0 2024-02-28T23:07:44.730 INFO:tasks.workunit.client.1.smithi184.stdout:4/788: getdents d1 0 2024-02-28T23:07:44.736 INFO:tasks.workunit.client.1.smithi184.stdout:5/798: write db/d44/f4c [3346496,75840] 0 2024-02-28T23:07:44.745 INFO:tasks.workunit.client.1.smithi184.stdout:1/849: mkdir d20/d32/d3e/d82/d85/d120 0 2024-02-28T23:07:44.746 INFO:tasks.workunit.client.0.smithi159.stdout:7/937: symlink d5/d16/d1a/d27/d46/l12d 0 2024-02-28T23:07:44.753 INFO:tasks.workunit.client.1.smithi184.stdout:7/754: getdents d6/d9/d13/d14/d45/df3 0 2024-02-28T23:07:44.754 INFO:tasks.workunit.client.1.smithi184.stdout:5/799: creat db/d12/d1c/d80/ffe x:0 0 0 2024-02-28T23:07:44.756 INFO:tasks.workunit.client.1.smithi184.stdout:7/755: fdatasync d6/d9/d13/d3e/dad/fa1 0 2024-02-28T23:07:44.757 INFO:tasks.workunit.client.1.smithi184.stdout:8/811: rename d1/da/d33 to d1/da/d10/d43/d124 0 2024-02-28T23:07:44.759 INFO:tasks.workunit.client.1.smithi184.stdout:4/789: symlink d1/dc/df/d5b/d97/lf2 0 2024-02-28T23:07:44.762 INFO:tasks.workunit.client.0.smithi159.stdout:3/977: dwrite d0/d2b/d4f/dc3/d13b/d79/f98 [0,4194304] 0 2024-02-28T23:07:44.763 INFO:tasks.workunit.client.1.smithi184.stdout:4/790: stat d1/d8/d37/d49/lca 0 2024-02-28T23:07:44.763 INFO:tasks.workunit.client.1.smithi184.stdout:2/752: dread f8 [0,4194304] 0 2024-02-28T23:07:44.768 INFO:tasks.workunit.client.1.smithi184.stdout:1/850: dwrite d20/d46/d90/da0/f108 [0,4194304] 0 2024-02-28T23:07:44.769 INFO:tasks.workunit.client.1.smithi184.stdout:3/839: truncate d1/d4/d1c/d61/f90 896083 0 2024-02-28T23:07:44.773 INFO:tasks.workunit.client.0.smithi159.stdout:3/978: creat d0/d2b/d55/df8/da9/d103/f13c x:0 0 0 2024-02-28T23:07:44.777 INFO:tasks.workunit.client.1.smithi184.stdout:4/791: mknod d1/d9a/cf3 0 2024-02-28T23:07:44.778 INFO:tasks.workunit.client.1.smithi184.stdout:9/800: dwrite d5/d17/d43/f48 [4194304,4194304] 0 2024-02-28T23:07:44.784 INFO:tasks.workunit.client.1.smithi184.stdout:9/801: chown d5/db/de/d10/dc9/de9 302 1 2024-02-28T23:07:44.784 INFO:tasks.workunit.client.1.smithi184.stdout:6/730: rename dc/d60/d7c/d61/cab to dc/de/d2a/d5c/d79/db9/ce8 0 2024-02-28T23:07:44.785 INFO:tasks.workunit.client.0.smithi159.stdout:3/979: rmdir d0/d2b/d55/df8 39 2024-02-28T23:07:44.785 INFO:tasks.workunit.client.1.smithi184.stdout:7/756: creat d6/d9/d13/d3e/dad/d49/d9c/d101/f107 x:0 0 0 2024-02-28T23:07:44.787 INFO:tasks.workunit.client.1.smithi184.stdout:3/840: rmdir d1/d4/d1c/d62/d66/dd3/d26 39 2024-02-28T23:07:44.788 INFO:tasks.workunit.client.1.smithi184.stdout:7/757: fsync d6/d9/d13/d3e/fa0 0 2024-02-28T23:07:44.788 INFO:tasks.workunit.client.0.smithi159.stdout:7/938: link d5/d56/d50/d88/fd4 d5/d16/d1a/d27/d46/d65/d81/f12e 0 2024-02-28T23:07:44.789 INFO:tasks.workunit.client.1.smithi184.stdout:0/837: link d0/d1d/d3a/d10d/c32 d0/d1d/d3a/c122 0 2024-02-28T23:07:44.789 INFO:tasks.workunit.client.1.smithi184.stdout:3/841: read d1/d4/d1c/f31 [2775987,63075] 0 2024-02-28T23:07:44.792 INFO:tasks.workunit.client.1.smithi184.stdout:2/753: dwrite d10/d1f/d21/d4d/d67/f95 [0,4194304] 0 2024-02-28T23:07:44.792 INFO:tasks.workunit.client.0.smithi159.stdout:3/980: dread d0/d47/d88/f99 [0,4194304] 0 2024-02-28T23:07:44.793 INFO:tasks.workunit.client.1.smithi184.stdout:4/792: creat d1/dc/df/d5b/db2/ff4 x:0 0 0 2024-02-28T23:07:44.798 INFO:tasks.workunit.client.1.smithi184.stdout:9/802: rmdir d5/d17/d57 39 2024-02-28T23:07:44.798 INFO:tasks.workunit.client.1.smithi184.stdout:2/754: write d10/d1f/d38/d54/fbc [964958,120007] 0 2024-02-28T23:07:44.798 INFO:tasks.workunit.client.1.smithi184.stdout:9/803: dread - d5/db/fd4 zero size 2024-02-28T23:07:44.799 INFO:tasks.workunit.client.0.smithi159.stdout:3/981: fdatasync d0/d2b/d4f/dc3/d13b/d79/d9b/fa7 0 2024-02-28T23:07:44.800 INFO:tasks.workunit.client.1.smithi184.stdout:9/804: chown d5/d17/lfd 264574115 1 2024-02-28T23:07:44.800 INFO:tasks.workunit.client.1.smithi184.stdout:6/731: mknod dc/de/d2a/d8e/dad/d8a/ce9 0 2024-02-28T23:07:44.802 INFO:tasks.workunit.client.0.smithi159.stdout:3/982: chown d0/d47/cb3 4 1 2024-02-28T23:07:44.804 INFO:tasks.workunit.client.0.smithi159.stdout:7/939: mkdir d5/d56/d50/d12f 0 2024-02-28T23:07:44.806 INFO:tasks.workunit.client.1.smithi184.stdout:5/800: dread db/d12/d1c/d21/d2f/f71 [0,4194304] 0 2024-02-28T23:07:44.807 INFO:tasks.workunit.client.1.smithi184.stdout:5/801: read - db/fd8 zero size 2024-02-28T23:07:44.809 INFO:tasks.workunit.client.1.smithi184.stdout:5/802: truncate db/fcd 10109 0 2024-02-28T23:07:44.812 INFO:tasks.workunit.client.1.smithi184.stdout:3/842: rename d1/d4/d5/cc4 to d1/d4/d1c/d62/d66/dab/c105 0 2024-02-28T23:07:44.813 INFO:tasks.workunit.client.1.smithi184.stdout:4/793: symlink d1/dc/df/d38/d57/dd6/lf5 0 2024-02-28T23:07:44.815 INFO:tasks.workunit.client.0.smithi159.stdout:3/983: mknod d0/d3f/dd2/d63/c13d 0 2024-02-28T23:07:44.817 INFO:tasks.workunit.client.0.smithi159.stdout:7/940: fdatasync d5/d16/d1a/d27/d37/f109 0 2024-02-28T23:07:44.819 INFO:tasks.workunit.client.1.smithi184.stdout:2/755: creat d10/d1f/d21/d5e/d15/dc8/ff2 x:0 0 0 2024-02-28T23:07:44.820 INFO:tasks.workunit.client.1.smithi184.stdout:0/838: dread d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/f101 [0,4194304] 0 2024-02-28T23:07:44.821 INFO:tasks.workunit.client.1.smithi184.stdout:8/812: sync 2024-02-28T23:07:44.823 INFO:tasks.workunit.client.1.smithi184.stdout:4/794: rmdir d1/d8/d19/d92 39 2024-02-28T23:07:44.823 INFO:tasks.workunit.client.1.smithi184.stdout:0/839: chown d0/d7c/fec 22723882 1 2024-02-28T23:07:44.825 INFO:tasks.workunit.client.0.smithi159.stdout:3/984: symlink d0/d2b/d4f/dc3/d13b/d79/d9b/l13e 0 2024-02-28T23:07:44.827 INFO:tasks.workunit.client.1.smithi184.stdout:2/756: write d10/d1f/d21/d5e/d15/d60/d66/dc6/f8c [1758450,15445] 0 2024-02-28T23:07:44.827 INFO:tasks.workunit.client.1.smithi184.stdout:8/813: chown d1/da/df/f28 0 1 2024-02-28T23:07:44.832 INFO:tasks.workunit.client.0.smithi159.stdout:3/985: symlink d0/d3f/dd2/d6a/de7/l13f 0 2024-02-28T23:07:44.832 INFO:tasks.workunit.client.1.smithi184.stdout:9/805: mknod d5/d47/d68/c105 0 2024-02-28T23:07:44.835 INFO:tasks.workunit.client.0.smithi159.stdout:7/941: dread d5/d16/d1a/d27/d46/d65/d81/f92 [0,4194304] 0 2024-02-28T23:07:44.838 INFO:tasks.workunit.client.0.smithi159.stdout:7/942: chown d5/d16/d1a/d27/d46/d65/f6f 188 1 2024-02-28T23:07:44.840 INFO:tasks.workunit.client.1.smithi184.stdout:8/814: write d1/da/dc/d16/d32/f98 [147010,91591] 0 2024-02-28T23:07:44.840 INFO:tasks.workunit.client.1.smithi184.stdout:2/757: dread d10/d1f/d21/fbb [0,4194304] 0 2024-02-28T23:07:44.841 INFO:tasks.workunit.client.1.smithi184.stdout:3/843: dwrite d1/d4/d6/d1e/f6c [0,4194304] 0 2024-02-28T23:07:44.841 INFO:tasks.workunit.client.1.smithi184.stdout:4/795: creat d1/d8/d19/d67/ff6 x:0 0 0 2024-02-28T23:07:44.844 INFO:tasks.workunit.client.1.smithi184.stdout:7/758: write d6/f67 [700805,59121] 0 2024-02-28T23:07:44.847 INFO:tasks.workunit.client.0.smithi159.stdout:3/986: creat d0/d2b/d55/df8/da9/d103/f140 x:0 0 0 2024-02-28T23:07:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:44 smithi184 ceph-mon[36198]: pgmap v41: 65 pgs: 65 active+clean; 3.6 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 78 MiB/s rd, 188 MiB/s wr, 400 op/s 2024-02-28T23:07:44.850 INFO:tasks.workunit.client.1.smithi184.stdout:5/803: dread db/d1f/f42 [0,4194304] 0 2024-02-28T23:07:44.851 INFO:tasks.workunit.client.1.smithi184.stdout:4/796: fsync d1/dc/df/d38/d57/fcd 0 2024-02-28T23:07:44.856 INFO:tasks.workunit.client.1.smithi184.stdout:1/851: dread d20/d32/d3e/d61/d8b/f8e [0,4194304] 0 2024-02-28T23:07:44.856 INFO:tasks.workunit.client.1.smithi184.stdout:5/804: write db/d12/f77 [6684994,59473] 0 2024-02-28T23:07:44.859 INFO:tasks.workunit.client.0.smithi159.stdout:3/987: rename d0/d3f/f8d to d0/d2b/d55/df8/f141 0 2024-02-28T23:07:44.859 INFO:tasks.workunit.client.0.smithi159.stdout:7/943: dwrite d5/d16/d1a/d27/deb/f10f [0,4194304] 0 2024-02-28T23:07:44.860 INFO:tasks.workunit.client.0.smithi159.stdout:7/944: chown d5/d56/d2a 171 1 2024-02-28T23:07:44.865 INFO:tasks.workunit.client.0.smithi159.stdout:3/988: mknod d0/d2b/d55/df8/d2f/c142 0 2024-02-28T23:07:44.869 INFO:tasks.workunit.client.0.smithi159.stdout:7/945: creat d5/d16/d1a/d27/d46/d65/d81/d98/de5/f130 x:0 0 0 2024-02-28T23:07:44.873 INFO:tasks.workunit.client.1.smithi184.stdout:6/732: dread dc/d60/f58 [0,4194304] 0 2024-02-28T23:07:44.874 INFO:tasks.workunit.client.0.smithi159.stdout:3/989: dread - d0/d2b/d55/df8/d2f/ddf/f10d zero size 2024-02-28T23:07:44.881 INFO:tasks.workunit.client.0.smithi159.stdout:3/990: creat d0/d2b/d55/df8/da9/d103/d106/f143 x:0 0 0 2024-02-28T23:07:44.883 INFO:tasks.workunit.client.0.smithi159.stdout:7/946: getdents d5/d16/d1a/d27/d46/d101/d64/db4/dc8 0 2024-02-28T23:07:44.885 INFO:tasks.workunit.client.0.smithi159.stdout:7/947: readlink d5/d16/d1a/d27/d95/lf0 0 2024-02-28T23:07:44.887 INFO:tasks.workunit.client.0.smithi159.stdout:7/948: chown d5/d16/d1a/d27/d75/dac/dbe/lc0 3539146 1 2024-02-28T23:07:44.889 INFO:tasks.workunit.client.1.smithi184.stdout:0/840: mknod d0/d1d/d3a/d10d/c123 0 2024-02-28T23:07:44.890 INFO:tasks.workunit.client.1.smithi184.stdout:3/844: read - d1/d4/d6/fe1 zero size 2024-02-28T23:07:44.891 INFO:tasks.workunit.client.1.smithi184.stdout:9/806: creat d5/db/de/d10/d12/d2f/d3f/d8d/f106 x:0 0 0 2024-02-28T23:07:44.892 INFO:tasks.workunit.client.1.smithi184.stdout:2/758: unlink d10/d1f/d38/d54/ce6 0 2024-02-28T23:07:44.893 INFO:tasks.workunit.client.1.smithi184.stdout:9/807: chown d5/db/de/d10/d6a/f100 14500802 1 2024-02-28T23:07:44.894 INFO:tasks.workunit.client.1.smithi184.stdout:8/815: mkdir d1/da/d10/d17/d125 0 2024-02-28T23:07:44.895 INFO:tasks.workunit.client.1.smithi184.stdout:8/816: readlink d1/l14 0 2024-02-28T23:07:44.896 INFO:tasks.workunit.client.1.smithi184.stdout:8/817: dread - d1/da/dc/d16/d4d/d82/fdf zero size 2024-02-28T23:07:44.897 INFO:tasks.workunit.client.0.smithi159.stdout:3/991: dread d0/d3f/fad [0,4194304] 0 2024-02-28T23:07:44.898 INFO:tasks.workunit.client.1.smithi184.stdout:7/759: truncate d6/d9/d13/d3e/dad/d49/da6/daf/d47/fdf 4829970 0 2024-02-28T23:07:44.899 INFO:tasks.workunit.client.0.smithi159.stdout:7/949: dread d5/d56/f2f [0,4194304] 0 2024-02-28T23:07:44.900 INFO:tasks.workunit.client.1.smithi184.stdout:8/818: read d1/da/dc/d16/d29/d7d/fc3 [2031576,66716] 0 2024-02-28T23:07:44.902 INFO:tasks.workunit.client.0.smithi159.stdout:3/992: rmdir d0/d2b/d4f/dc3/d13b/d79/d9b 39 2024-02-28T23:07:44.902 INFO:tasks.workunit.client.0.smithi159.stdout:7/950: read d5/d16/d1a/d27/d46/d101/f59 [2111102,94632] 0 2024-02-28T23:07:44.903 INFO:tasks.workunit.client.1.smithi184.stdout:7/760: write d6/d9/d13/d3e/dad/d49/da6/daf/f69 [780958,24169] 0 2024-02-28T23:07:44.906 INFO:tasks.workunit.client.1.smithi184.stdout:1/852: unlink d20/c2f 0 2024-02-28T23:07:44.907 INFO:tasks.workunit.client.1.smithi184.stdout:5/805: creat db/d12/d18/d2e/dc1/fff x:0 0 0 2024-02-28T23:07:44.909 INFO:tasks.workunit.client.0.smithi159.stdout:7/951: mkdir d5/d16/d40/dce/d131 0 2024-02-28T23:07:44.913 INFO:tasks.workunit.client.1.smithi184.stdout:0/841: creat d0/d1d/d3a/de5/f124 x:0 0 0 2024-02-28T23:07:44.915 INFO:tasks.workunit.client.1.smithi184.stdout:0/842: write d0/d1f/f9a [611807,28500] 0 2024-02-28T23:07:44.916 INFO:tasks.workunit.client.1.smithi184.stdout:3/845: mkdir d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/d106 0 2024-02-28T23:07:44.919 INFO:tasks.workunit.client.1.smithi184.stdout:1/853: dread d20/d32/d3e/d61/d8b/f8e [0,4194304] 0 2024-02-28T23:07:44.922 INFO:tasks.workunit.client.1.smithi184.stdout:9/808: symlink d5/d47/d68/d7c/df4/l107 0 2024-02-28T23:07:44.924 INFO:tasks.workunit.client.1.smithi184.stdout:4/797: creat d1/dc/df/d27/ff7 x:0 0 0 2024-02-28T23:07:44.927 INFO:tasks.workunit.client.1.smithi184.stdout:8/819: mknod d1/da/d10/d17/d63/c126 0 2024-02-28T23:07:44.932 INFO:tasks.workunit.client.1.smithi184.stdout:2/759: creat d10/d1f/ff3 x:0 0 0 2024-02-28T23:07:44.932 INFO:tasks.workunit.client.1.smithi184.stdout:3/846: symlink d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/dc1/l107 0 2024-02-28T23:07:44.939 INFO:tasks.workunit.client.1.smithi184.stdout:8/820: dread - d1/fed zero size 2024-02-28T23:07:44.940 INFO:tasks.workunit.client.1.smithi184.stdout:1/854: dread d20/d32/d3e/fc7 [0,4194304] 0 2024-02-28T23:07:44.945 INFO:tasks.workunit.client.1.smithi184.stdout:8/821: write d1/da/dc/d16/dbd/ff6 [7504248,119198] 0 2024-02-28T23:07:44.948 INFO:tasks.workunit.client.1.smithi184.stdout:3/847: rename d1/d4/d1c/d62/d92/l100 to d1/d4/d6/d1e/d72/l108 0 2024-02-28T23:07:44.954 INFO:tasks.workunit.client.1.smithi184.stdout:2/760: dwrite d10/d1f/d21/d5e/f47 [0,4194304] 0 2024-02-28T23:07:44.954 INFO:tasks.workunit.client.1.smithi184.stdout:4/798: link d1/d4/cba d1/d8/d37/cf8 0 2024-02-28T23:07:44.957 INFO:tasks.workunit.client.0.smithi159.stdout:3/993: dwrite d0/d2b/d55/df8/d57/f6c [0,4194304] 0 2024-02-28T23:07:44.958 INFO:tasks.workunit.client.1.smithi184.stdout:9/809: dread d5/db/de/f21 [0,4194304] 0 2024-02-28T23:07:44.958 INFO:tasks.workunit.client.1.smithi184.stdout:8/822: dread d1/da/d10/d17/d63/fa4 [0,4194304] 0 2024-02-28T23:07:44.959 INFO:tasks.workunit.client.0.smithi159.stdout:7/952: dwrite d5/d16/d1a/d27/d3e/f3f [0,4194304] 0 2024-02-28T23:07:44.960 INFO:tasks.workunit.client.1.smithi184.stdout:4/799: readlink d1/d8/d35/dd9/l58 0 2024-02-28T23:07:44.963 INFO:tasks.workunit.client.1.smithi184.stdout:3/848: symlink d1/d4/d1c/d62/d66/dd3/d26/d3a/l109 0 2024-02-28T23:07:44.965 INFO:tasks.workunit.client.1.smithi184.stdout:5/806: dread db/d12/d18/d2e/d3c/d5d/f54 [0,4194304] 0 2024-02-28T23:07:44.965 INFO:tasks.workunit.client.0.smithi159.stdout:3/994: symlink d0/d2b/d55/df8/da9/d103/l144 0 2024-02-28T23:07:44.968 INFO:tasks.workunit.client.1.smithi184.stdout:2/761: truncate d10/d1f/d38/d54/f90 191639 0 2024-02-28T23:07:44.970 INFO:tasks.workunit.client.1.smithi184.stdout:6/733: dwrite dc/de/d10/d16/f37 [0,4194304] 0 2024-02-28T23:07:44.974 INFO:tasks.workunit.client.1.smithi184.stdout:9/810: mkdir d5/d47/d68/d7c/df4/d108 0 2024-02-28T23:07:44.976 INFO:tasks.workunit.client.1.smithi184.stdout:4/800: dread - d1/dc/df/d22/fce zero size 2024-02-28T23:07:44.977 INFO:tasks.workunit.client.1.smithi184.stdout:7/761: dwrite d6/d68/fb9 [0,4194304] 0 2024-02-28T23:07:44.978 INFO:tasks.workunit.client.0.smithi159.stdout:7/953: creat d5/d16/d1a/d27/d46/d101/d64/db4/dc8/d102/d125/f132 x:0 0 0 2024-02-28T23:07:44.980 INFO:tasks.workunit.client.1.smithi184.stdout:0/843: dwrite d0/d1d/d3a/da9/d11b/d27/d31/d51/fdc [0,4194304] 0 2024-02-28T23:07:44.982 INFO:tasks.workunit.client.1.smithi184.stdout:4/801: fdatasync d1/dc/df/f16 0 2024-02-28T23:07:44.983 INFO:tasks.workunit.client.0.smithi159.stdout:3/995: dread d0/d2b/d55/d75/d6d/ff5 [0,4194304] 0 2024-02-28T23:07:44.984 INFO:tasks.workunit.client.1.smithi184.stdout:3/849: mkdir d1/d4/d1c/d62/d66/da6/df5/d10a 0 2024-02-28T23:07:44.988 INFO:tasks.workunit.client.1.smithi184.stdout:9/811: unlink d5/d47/d59/ld5 0 2024-02-28T23:07:44.988 INFO:tasks.workunit.client.1.smithi184.stdout:9/812: stat d5/d47/fc3 0 2024-02-28T23:07:44.989 INFO:tasks.workunit.client.1.smithi184.stdout:9/813: chown d5/db/de/de1 5807494 1 2024-02-28T23:07:44.991 INFO:tasks.workunit.client.1.smithi184.stdout:9/814: write d5/f6 [6150831,84929] 0 2024-02-28T23:07:44.992 INFO:tasks.workunit.client.0.smithi159.stdout:7/954: rename d5/d56/d2a/f97 to d5/d16/d1a/d27/d46/d101/d64/db4/dc8/d102/f133 0 2024-02-28T23:07:44.993 INFO:tasks.workunit.client.1.smithi184.stdout:4/802: read d1/d4/f11 [403686,17221] 0 2024-02-28T23:07:44.993 INFO:tasks.workunit.client.1.smithi184.stdout:1/855: dread d20/f72 [0,4194304] 0 2024-02-28T23:07:44.995 INFO:tasks.workunit.client.1.smithi184.stdout:4/803: chown d1/d4/d43/d73/db7 42472801 1 2024-02-28T23:07:44.998 INFO:tasks.workunit.client.1.smithi184.stdout:1/856: write d20/d32/d3e/d61/d8b/d101/f116 [155931,85536] 0 2024-02-28T23:07:45.000 INFO:tasks.workunit.client.1.smithi184.stdout:7/762: unlink d6/d9/d13/d3e/dad/d49/da6/dfd/led 0 2024-02-28T23:07:45.002 INFO:tasks.workunit.client.1.smithi184.stdout:3/850: mkdir d1/d4/d5/da9/d6e/d10b 0 2024-02-28T23:07:45.003 INFO:tasks.workunit.client.1.smithi184.stdout:9/815: dread d5/d26/d50/f35 [0,4194304] 0 2024-02-28T23:07:45.006 INFO:tasks.workunit.client.1.smithi184.stdout:7/763: write d6/d9/d13/d1e/fbc [1586892,20390] 0 2024-02-28T23:07:45.006 INFO:tasks.workunit.client.0.smithi159.stdout:3/996: link d0/d2b/d55/d75/d6d/fca d0/d2b/d55/df8/d2f/d78/f145 0 2024-02-28T23:07:45.007 INFO:tasks.workunit.client.1.smithi184.stdout:4/804: truncate d1/dc/df/f59 1319696 0 2024-02-28T23:07:45.008 INFO:tasks.workunit.client.1.smithi184.stdout:6/734: creat dc/de/d2a/d5c/d79/db9/de6/fea x:0 0 0 2024-02-28T23:07:45.010 INFO:tasks.workunit.client.1.smithi184.stdout:6/735: readlink dc/d60/d6d/ld8 0 2024-02-28T23:07:45.011 INFO:tasks.workunit.client.1.smithi184.stdout:8/823: dwrite d1/da/d10/f8d [0,4194304] 0 2024-02-28T23:07:45.011 INFO:tasks.workunit.client.0.smithi159.stdout:7/955: creat d5/d16/d1a/d27/d3e/dee/f134 x:0 0 0 2024-02-28T23:07:45.012 INFO:tasks.workunit.client.0.smithi159.stdout:7/956: chown d5/d56/d50/d88/df5 684 1 2024-02-28T23:07:45.016 INFO:tasks.workunit.client.0.smithi159.stdout:3/997: read d0/d2b/d4f/dc3/d13b/f114 [1027898,118454] 0 2024-02-28T23:07:45.017 INFO:tasks.workunit.client.1.smithi184.stdout:2/762: creat d10/d55/d89/db5/de7/ff4 x:0 0 0 2024-02-28T23:07:45.022 INFO:tasks.workunit.client.1.smithi184.stdout:7/764: dwrite d6/d9/d13/d3e/dad/d49/da6/daf/f69 [0,4194304] 0 2024-02-28T23:07:45.028 INFO:tasks.workunit.client.1.smithi184.stdout:5/807: dwrite db/d12/d18/d2e/d3c/d5d/f54 [0,4194304] 0 2024-02-28T23:07:45.028 INFO:tasks.workunit.client.1.smithi184.stdout:0/844: write d0/d1d/d3a/da9/d11b/f29 [3233364,12113] 0 2024-02-28T23:07:45.030 INFO:tasks.workunit.client.0.smithi159.stdout:3/998: chown d0/d47/dc2/fc8 12 1 2024-02-28T23:07:45.032 INFO:tasks.workunit.client.1.smithi184.stdout:3/851: creat d1/d4/d1c/d62/d92/f10c x:0 0 0 2024-02-28T23:07:45.041 INFO:tasks.workunit.client.1.smithi184.stdout:4/805: creat d1/dc/df/d38/d57/dd6/ddd/ff9 x:0 0 0 2024-02-28T23:07:45.042 INFO:tasks.workunit.client.1.smithi184.stdout:7/765: dwrite d6/d9/d13/d3e/f64 [0,4194304] 0 2024-02-28T23:07:45.046 INFO:tasks.workunit.client.0.smithi159.stdout:7/957: dwrite d5/d16/d1a/d27/f11f [0,4194304] 0 2024-02-28T23:07:45.046 INFO:tasks.workunit.client.1.smithi184.stdout:8/824: creat d1/da/dc/d16/d32/d42/d77/ddd/f127 x:0 0 0 2024-02-28T23:07:45.049 INFO:tasks.workunit.client.1.smithi184.stdout:2/763: write d10/d1f/d38/d54/f90 [502300,99989] 0 2024-02-28T23:07:45.050 INFO:tasks.workunit.client.1.smithi184.stdout:8/825: chown d1/da/dc/d16/d32/d42/l48 821 1 2024-02-28T23:07:45.077 INFO:tasks.workunit.client.1.smithi184.stdout:4/806: unlink d1/d8/d35/dd9/f66 0 2024-02-28T23:07:45.080 INFO:tasks.workunit.client.1.smithi184.stdout:7/766: creat d6/d9/d13/d3e/dad/d49/da6/daf/d65/f108 x:0 0 0 2024-02-28T23:07:45.084 INFO:tasks.workunit.client.1.smithi184.stdout:8/826: fsync d1/da/dc/d16/d29/f2a 0 2024-02-28T23:07:45.087 INFO:tasks.workunit.client.1.smithi184.stdout:6/736: write dc/d60/d78/fb2 [2312371,47060] 0 2024-02-28T23:07:45.090 INFO:tasks.workunit.client.1.smithi184.stdout:6/737: dread - dc/de/d2a/d8e/dad/d8a/fcd zero size 2024-02-28T23:07:45.094 INFO:tasks.workunit.client.1.smithi184.stdout:4/807: write d1/d8/d19/d92/feb [949190,56370] 0 2024-02-28T23:07:45.094 INFO:tasks.workunit.client.1.smithi184.stdout:9/816: dwrite d5/db/de/d10/d12/d2f/d3f/d8d/fa9 [0,4194304] 0 2024-02-28T23:07:45.096 INFO:tasks.workunit.client.1.smithi184.stdout:6/738: read dc/de/f29 [3759690,114759] 0 2024-02-28T23:07:45.099 INFO:tasks.workunit.client.1.smithi184.stdout:1/857: getdents d20/d32/d3e/d91 0 2024-02-28T23:07:45.101 INFO:tasks.workunit.client.1.smithi184.stdout:3/852: creat d1/d4/d1c/f10d x:0 0 0 2024-02-28T23:07:45.102 INFO:tasks.workunit.client.1.smithi184.stdout:9/817: mknod d5/d47/d68/d7c/c109 0 2024-02-28T23:07:45.102 INFO:tasks.workunit.client.1.smithi184.stdout:2/764: write d10/d1f/d21/d5e/d15/d60/faf [153328,87704] 0 2024-02-28T23:07:45.104 INFO:tasks.workunit.client.1.smithi184.stdout:4/808: rename d1/dc/df/d27/lcb to d1/d8/d19/d92/db3/lfa 0 2024-02-28T23:07:45.107 INFO:tasks.workunit.client.1.smithi184.stdout:6/739: symlink dc/de/leb 0 2024-02-28T23:07:45.107 INFO:tasks.workunit.client.0.smithi159.stdout:3/999: dwrite d0/d2b/d55/df8/d2f/ddf/f136 [0,4194304] 0 2024-02-28T23:07:45.111 INFO:tasks.workunit.client.1.smithi184.stdout:4/809: chown d1/dc/df/d5b/db2/ff4 301399822 1 2024-02-28T23:07:45.112 INFO:tasks.workunit.client.1.smithi184.stdout:9/818: fsync d5/db/f42 0 2024-02-28T23:07:45.114 INFO:tasks.workunit.client.1.smithi184.stdout:8/827: rmdir d1/da/d10/d43/da1/df3 0 2024-02-28T23:07:45.114 INFO:tasks.workunit.client.1.smithi184.stdout:0/845: dwrite d0/d1d/f3d [0,4194304] 0 2024-02-28T23:07:45.116 INFO:tasks.workunit.client.1.smithi184.stdout:8/828: stat d1/l14 0 2024-02-28T23:07:45.117 INFO:tasks.workunit.client.1.smithi184.stdout:3/853: mkdir d1/d4/d1c/d62/d66/dd3/d24/d10e 0 2024-02-28T23:07:45.118 INFO:tasks.workunit.client.1.smithi184.stdout:5/808: dwrite db/d12/f85 [0,4194304] 0 2024-02-28T23:07:45.120 INFO:tasks.workunit.client.1.smithi184.stdout:9/819: rename d5/db to d5/db/de/d10/dc9/de9/d10a 22 2024-02-28T23:07:45.122 INFO:tasks.workunit.client.1.smithi184.stdout:2/765: link d10/d1f/d21/d5e/d15/d24/d5f/ff1 d10/d1f/d21/d6a/ff5 0 2024-02-28T23:07:45.133 INFO:tasks.workunit.client.1.smithi184.stdout:2/766: write d10/d1f/d21/d5e/d15/dc8/ff2 [599685,109843] 0 2024-02-28T23:07:45.138 INFO:tasks.workunit.client.1.smithi184.stdout:6/740: dwrite dc/de/f36 [4194304,4194304] 0 2024-02-28T23:07:45.138 INFO:tasks.workunit.client.1.smithi184.stdout:7/767: dwrite d6/d68/f75 [4194304,4194304] 0 2024-02-28T23:07:45.142 INFO:tasks.workunit.client.1.smithi184.stdout:7/768: truncate d6/d9/d13/d3e/f64 4771794 0 2024-02-28T23:07:45.144 INFO:tasks.workunit.client.1.smithi184.stdout:3/854: dwrite d1/d4/d1c/f10d [0,4194304] 0 2024-02-28T23:07:45.149 INFO:tasks.workunit.client.1.smithi184.stdout:7/769: stat d6/d9/d13/d3e/dad/d49/da6/daf/f69 0 2024-02-28T23:07:45.150 INFO:tasks.workunit.client.1.smithi184.stdout:5/809: symlink db/d12/d1c/d21/d2f/dc4/l100 0 2024-02-28T23:07:45.154 INFO:tasks.workunit.client.1.smithi184.stdout:9/820: write d5/d47/fc3 [1986190,49967] 0 2024-02-28T23:07:45.155 INFO:tasks.workunit.client.1.smithi184.stdout:0/846: truncate d0/d1f/de3/fc9 113158 0 2024-02-28T23:07:45.156 INFO:tasks.workunit.client.1.smithi184.stdout:1/858: link d20/d32/d3e/da2/cf3 d20/d32/d3e/d61/d8b/c121 0 2024-02-28T23:07:45.164 INFO:tasks.workunit.client.1.smithi184.stdout:2/767: dwrite d10/d1f/d21/d5e/f2c [0,4194304] 0 2024-02-28T23:07:45.166 INFO:tasks.workunit.client.1.smithi184.stdout:4/810: getdents d1/dc 0 2024-02-28T23:07:45.184 INFO:tasks.workunit.client.1.smithi184.stdout:3/855: mknod d1/d4/d5/da9/d6e/c10f 0 2024-02-28T23:07:45.188 INFO:tasks.workunit.client.1.smithi184.stdout:7/770: symlink d6/d9/d13/d3e/dad/d49/d50/df8/d98/l109 0 2024-02-28T23:07:45.191 INFO:tasks.workunit.client.1.smithi184.stdout:5/810: mknod db/d12/d1c/d21/d25/dd3/c101 0 2024-02-28T23:07:45.193 INFO:tasks.workunit.client.1.smithi184.stdout:8/829: dread d1/f10c [0,4194304] 0 2024-02-28T23:07:45.199 INFO:tasks.workunit.client.1.smithi184.stdout:3/856: dwrite d1/d4/d6/ff7 [0,4194304] 0 2024-02-28T23:07:45.201 INFO:tasks.workunit.client.1.smithi184.stdout:9/821: rename d5/db/de/d10/dc9/fce to d5/db/de/d10/d6a/f10b 0 2024-02-28T23:07:45.206 INFO:tasks.workunit.client.1.smithi184.stdout:6/741: symlink dc/d60/lec 0 2024-02-28T23:07:45.209 INFO:tasks.workunit.client.1.smithi184.stdout:7/771: rmdir d6/d9/d13/d3e/dad/d49/da6/dfd 39 2024-02-28T23:07:45.216 INFO:tasks.workunit.client.1.smithi184.stdout:3/857: dwrite d1/d4/d1c/d62/d66/dd3/d26/d3a/fd1 [0,4194304] 0 2024-02-28T23:07:45.232 INFO:tasks.workunit.client.1.smithi184.stdout:2/768: rename d10/d1f/d21/d5e/c74 to d10/d55/d89/db5/cf6 0 2024-02-28T23:07:45.238 INFO:tasks.workunit.client.1.smithi184.stdout:7/772: creat d6/d9/d13/d14/d45/f10a x:0 0 0 2024-02-28T23:07:45.241 INFO:tasks.workunit.client.1.smithi184.stdout:1/859: creat d20/d32/d3e/d82/f122 x:0 0 0 2024-02-28T23:07:45.242 INFO:tasks.workunit.client.1.smithi184.stdout:5/811: write db/d12/d1c/d21/d2f/f5a [1213751,15589] 0 2024-02-28T23:07:45.244 INFO:tasks.workunit.client.1.smithi184.stdout:5/812: dread - db/d12/d18/fe0 zero size 2024-02-28T23:07:45.247 INFO:tasks.workunit.client.1.smithi184.stdout:8/830: write d1/da/dc/d16/d32/f4b [2155957,36187] 0 2024-02-28T23:07:45.247 INFO:tasks.workunit.client.1.smithi184.stdout:0/847: link d0/d1d/d3a/da9/d11b/d27/d58/f87 d0/d1f/d109/d71/f125 0 2024-02-28T23:07:45.249 INFO:tasks.workunit.client.1.smithi184.stdout:0/848: stat d0/d1f/d109/dcb/ld9 0 2024-02-28T23:07:45.253 INFO:tasks.workunit.client.1.smithi184.stdout:3/858: rmdir d1/d4/d1c/d62/d66 39 2024-02-28T23:07:45.255 INFO:tasks.workunit.client.1.smithi184.stdout:9/822: rename d5/d47/fe3 to d5/d73/f10c 0 2024-02-28T23:07:45.256 INFO:tasks.workunit.client.1.smithi184.stdout:6/742: rename dc/d42 to dc/d42/ded 22 2024-02-28T23:07:45.260 INFO:tasks.workunit.client.1.smithi184.stdout:6/743: write dc/de/d2a/d8e/dad/d8a/fcd [1011505,118486] 0 2024-02-28T23:07:45.264 INFO:tasks.workunit.client.1.smithi184.stdout:8/831: symlink d1/da/dc/d16/d32/d42/l128 0 2024-02-28T23:07:45.266 INFO:tasks.workunit.client.1.smithi184.stdout:0/849: creat d0/d7c/f126 x:0 0 0 2024-02-28T23:07:45.267 INFO:tasks.workunit.client.1.smithi184.stdout:0/850: readlink d0/d1d/l94 0 2024-02-28T23:07:45.270 INFO:tasks.workunit.client.1.smithi184.stdout:2/769: symlink d10/d33/lf7 0 2024-02-28T23:07:45.271 INFO:tasks.workunit.client.1.smithi184.stdout:3/859: chown d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/dc1/l107 4266474 1 2024-02-28T23:07:45.272 INFO:tasks.workunit.client.1.smithi184.stdout:4/811: link d1/l18 d1/d8/d35/dd9/lfb 0 2024-02-28T23:07:45.275 INFO:tasks.workunit.client.1.smithi184.stdout:8/832: fdatasync d1/da/dc/d16/d29/d7d/fb8 0 2024-02-28T23:07:45.276 INFO:tasks.workunit.client.1.smithi184.stdout:0/851: unlink d0/d1d/d3a/da9/d11b/lc2 0 2024-02-28T23:07:45.280 INFO:tasks.workunit.client.1.smithi184.stdout:5/813: creat db/f102 x:0 0 0 2024-02-28T23:07:45.281 INFO:tasks.workunit.client.1.smithi184.stdout:1/860: write d20/d46/d90/fd1 [384415,106761] 0 2024-02-28T23:07:45.283 INFO:tasks.workunit.client.1.smithi184.stdout:4/812: creat d1/d8/d19/d92/db3/ffc x:0 0 0 2024-02-28T23:07:45.285 INFO:tasks.workunit.client.1.smithi184.stdout:3/860: mkdir d1/d4/d1c/d62/d66/dd3/d26/dd2/d110 0 2024-02-28T23:07:45.285 INFO:tasks.workunit.client.1.smithi184.stdout:8/833: rmdir d1/da/dc/d16/d29/d7d 39 2024-02-28T23:07:45.286 INFO:tasks.workunit.client.1.smithi184.stdout:7/773: rename d6/d9/d13/d3e/dad/d49/d50/df8/l94 to d6/d9/d13/d3e/dad/d49/da6/daf/l10b 0 2024-02-28T23:07:45.287 INFO:tasks.workunit.client.1.smithi184.stdout:4/813: read d1/d8/d35/f42 [59592,54481] 0 2024-02-28T23:07:45.289 INFO:tasks.workunit.client.1.smithi184.stdout:1/861: truncate d20/d46/d90/f71 671303 0 2024-02-28T23:07:45.289 INFO:tasks.workunit.client.1.smithi184.stdout:5/814: write f8 [1461221,111546] 0 2024-02-28T23:07:45.291 INFO:tasks.workunit.client.1.smithi184.stdout:3/861: fsync d1/d4/d1c/d62/d66/dd3/d24/dd5/fda 0 2024-02-28T23:07:45.291 INFO:tasks.workunit.client.1.smithi184.stdout:2/770: rename d10/d1f/d21/d5e/d15/d60/ld4 to d10/d1f/d21/d5e/dad/da3/dd6/dab/lf8 0 2024-02-28T23:07:45.293 INFO:tasks.workunit.client.1.smithi184.stdout:1/862: write f9 [1969183,120382] 0 2024-02-28T23:07:45.293 INFO:tasks.workunit.client.1.smithi184.stdout:6/744: rename dc/de/d2a/d5c/lb5 to dc/de/d2a/d5c/lee 0 2024-02-28T23:07:45.295 INFO:tasks.workunit.client.1.smithi184.stdout:8/834: creat d1/da/dc/dc9/f129 x:0 0 0 2024-02-28T23:07:45.298 INFO:tasks.workunit.client.1.smithi184.stdout:3/862: chown d1/d4/d5/da9/d6e/l7b 1104440 1 2024-02-28T23:07:45.298 INFO:tasks.workunit.client.1.smithi184.stdout:0/852: rename d0/d1d/ldb to d0/d11d/l127 0 2024-02-28T23:07:45.299 INFO:tasks.workunit.client.1.smithi184.stdout:4/814: chown d1/d8/d37/fab 116061191 1 2024-02-28T23:07:45.301 INFO:tasks.workunit.client.1.smithi184.stdout:7/774: creat d6/f10c x:0 0 0 2024-02-28T23:07:45.301 INFO:tasks.workunit.client.1.smithi184.stdout:9/823: dwrite d5/db/f20 [0,4194304] 0 2024-02-28T23:07:45.303 INFO:tasks.workunit.client.1.smithi184.stdout:3/863: stat d1/d4/d1c/d62/d66/dd3/d26/dd2/fd9 0 2024-02-28T23:07:45.303 INFO:tasks.workunit.client.1.smithi184.stdout:6/745: fdatasync dc/de/d2a/d8e/dad/f7d 0 2024-02-28T23:07:45.303 INFO:tasks.workunit.client.1.smithi184.stdout:2/771: mkdir d10/d1f/df9 0 2024-02-28T23:07:45.309 INFO:tasks.workunit.client.1.smithi184.stdout:7/775: readlink d6/d9/d13/d3e/dad/laa 0 2024-02-28T23:07:45.309 INFO:tasks.workunit.client.1.smithi184.stdout:8/835: creat d1/da/dc/d16/dbd/f12a x:0 0 0 2024-02-28T23:07:45.309 INFO:tasks.workunit.client.1.smithi184.stdout:1/863: mkdir d20/d32/db0/df7/d123 0 2024-02-28T23:07:45.309 INFO:tasks.workunit.client.1.smithi184.stdout:4/815: rmdir d1/d8/d19/d67/d87 39 2024-02-28T23:07:45.309 INFO:tasks.workunit.client.1.smithi184.stdout:8/836: read - d1/da/dd7/f11b zero size 2024-02-28T23:07:45.309 INFO:tasks.workunit.client.1.smithi184.stdout:6/746: write dc/d60/d7c/d61/dd3/fd9 [160104,30202] 0 2024-02-28T23:07:45.310 INFO:tasks.workunit.client.1.smithi184.stdout:7/776: dread d6/f16 [4194304,4194304] 0 2024-02-28T23:07:45.311 INFO:tasks.workunit.client.1.smithi184.stdout:8/837: chown d1/da/dc/d18/l75 370 1 2024-02-28T23:07:45.313 INFO:tasks.workunit.client.1.smithi184.stdout:8/838: write d1/da/d10/d17/d63/f68 [5031983,42416] 0 2024-02-28T23:07:45.316 INFO:tasks.workunit.client.1.smithi184.stdout:8/839: chown d1/fe1 71 1 2024-02-28T23:07:45.320 INFO:tasks.workunit.client.1.smithi184.stdout:5/815: getdents db/d12/d18 0 2024-02-28T23:07:45.323 INFO:tasks.workunit.client.1.smithi184.stdout:1/864: creat d20/d46/d90/db3/d103/d110/f124 x:0 0 0 2024-02-28T23:07:45.333 INFO:tasks.workunit.client.1.smithi184.stdout:7/777: creat d6/d9/d13/d3e/dad/d49/d50/df8/d98/dc4/f10d x:0 0 0 2024-02-28T23:07:45.334 INFO:tasks.workunit.client.1.smithi184.stdout:9/824: rename d5/d17/d43/c90 to d5/d47/d68/d7c/c10d 0 2024-02-28T23:07:45.336 INFO:tasks.workunit.client.1.smithi184.stdout:7/778: write d6/d9/da/f31 [6586089,20964] 0 2024-02-28T23:07:45.336 INFO:tasks.workunit.client.1.smithi184.stdout:0/853: creat d0/d1d/d3a/da9/d11b/d27/d31/f128 x:0 0 0 2024-02-28T23:07:45.338 INFO:tasks.workunit.client.1.smithi184.stdout:1/865: unlink d20/d32/d3e/d61/cf6 0 2024-02-28T23:07:45.339 INFO:tasks.workunit.client.1.smithi184.stdout:6/747: symlink dc/de/d2a/d8e/lef 0 2024-02-28T23:07:45.341 INFO:tasks.workunit.client.1.smithi184.stdout:3/864: creat d1/d4/d5/f111 x:0 0 0 2024-02-28T23:07:45.343 INFO:tasks.workunit.client.1.smithi184.stdout:4/816: creat d1/dc/df/d27/ffd x:0 0 0 2024-02-28T23:07:45.345 INFO:tasks.workunit.client.1.smithi184.stdout:5/816: link db/d12/d1c/fcc db/d12/d1c/d21/d2f/dc4/f103 0 2024-02-28T23:07:45.346 INFO:tasks.workunit.client.1.smithi184.stdout:1/866: dread d20/d32/d3e/d82/d85/d8c/fc6 [4194304,4194304] 0 2024-02-28T23:07:45.348 INFO:tasks.workunit.client.1.smithi184.stdout:4/817: chown d1/dc/df/d27/ff7 202677 1 2024-02-28T23:07:45.349 INFO:tasks.workunit.client.1.smithi184.stdout:3/865: unlink d1/d4/d5/c56 0 2024-02-28T23:07:45.351 INFO:tasks.workunit.client.1.smithi184.stdout:2/772: dread d10/d55/d89/fa1 [0,4194304] 0 2024-02-28T23:07:45.356 INFO:tasks.workunit.client.1.smithi184.stdout:6/748: mknod dc/cf0 0 2024-02-28T23:07:45.356 INFO:tasks.workunit.client.1.smithi184.stdout:1/867: creat d20/d32/db0/f125 x:0 0 0 2024-02-28T23:07:45.357 INFO:tasks.workunit.client.1.smithi184.stdout:6/749: chown dc/d60/d62/d6f/d99 913 1 2024-02-28T23:07:45.359 INFO:tasks.workunit.client.1.smithi184.stdout:4/818: rename d1/d8/d37 to d1/dc/df/d38/d57/dd6/ddd/dfe 0 2024-02-28T23:07:45.360 INFO:tasks.workunit.client.1.smithi184.stdout:9/825: rmdir d5/d17 39 2024-02-28T23:07:45.362 INFO:tasks.workunit.client.1.smithi184.stdout:8/840: dread d1/da/dc/d18/f57 [0,4194304] 0 2024-02-28T23:07:45.364 INFO:tasks.workunit.client.1.smithi184.stdout:8/841: stat d1/da/dc/d16/d29/ld9 0 2024-02-28T23:07:45.364 INFO:tasks.workunit.client.1.smithi184.stdout:0/854: dread d0/d1f/f26 [0,4194304] 0 2024-02-28T23:07:45.364 INFO:tasks.workunit.client.1.smithi184.stdout:1/868: readlink d20/d32/l84 0 2024-02-28T23:07:45.366 INFO:tasks.workunit.client.1.smithi184.stdout:2/773: rename d10/d1f/d21/d5e/d15/d60/d66/dc6/dcf to d10/d1f/d21/d5e/dad/da3/dfa 0 2024-02-28T23:07:45.367 INFO:tasks.workunit.client.1.smithi184.stdout:0/855: chown d0/d1d/d3a/da9/d11b/d27/d31/c90 2070890 1 2024-02-28T23:07:45.373 INFO:tasks.workunit.client.1.smithi184.stdout:4/819: fdatasync d1/d4/f1f 0 2024-02-28T23:07:45.374 INFO:tasks.workunit.client.1.smithi184.stdout:5/817: write db/d12/d18/faf [512773,36695] 0 2024-02-28T23:07:45.375 INFO:tasks.workunit.client.1.smithi184.stdout:8/842: fdatasync d1/da/dc/f73 0 2024-02-28T23:07:45.375 INFO:tasks.workunit.client.1.smithi184.stdout:2/774: creat d10/d55/ffb x:0 0 0 2024-02-28T23:07:45.375 INFO:tasks.workunit.client.1.smithi184.stdout:0/856: mkdir d0/d1d/d3a/da9/d129 0 2024-02-28T23:07:45.377 INFO:tasks.workunit.client.1.smithi184.stdout:6/750: mknod dc/d60/d7c/d61/dd2/cf1 0 2024-02-28T23:07:45.377 INFO:tasks.workunit.client.1.smithi184.stdout:5/818: chown db/d12/d18/d2e/c4f 87604 1 2024-02-28T23:07:45.378 INFO:tasks.workunit.client.1.smithi184.stdout:7/779: getdents d6/d9/d13/d14/dac 0 2024-02-28T23:07:45.381 INFO:tasks.workunit.client.1.smithi184.stdout:7/780: write d6/d9/d13/d3e/dad/d49/d50/db2/fba [4815203,122148] 0 2024-02-28T23:07:45.382 INFO:tasks.workunit.client.1.smithi184.stdout:2/775: creat d10/d55/d89/ffc x:0 0 0 2024-02-28T23:07:45.384 INFO:tasks.workunit.client.1.smithi184.stdout:4/820: creat d1/dc/df/d5b/db2/fff x:0 0 0 2024-02-28T23:07:45.384 INFO:tasks.workunit.client.1.smithi184.stdout:0/857: symlink d0/d1d/d3a/da9/l12a 0 2024-02-28T23:07:45.387 INFO:tasks.workunit.client.1.smithi184.stdout:5/819: creat db/d12/d50/d9e/f104 x:0 0 0 2024-02-28T23:07:45.388 INFO:tasks.workunit.client.1.smithi184.stdout:7/781: dread d6/d68/fd6 [0,4194304] 0 2024-02-28T23:07:45.391 INFO:tasks.workunit.client.1.smithi184.stdout:4/821: mkdir d1/d8/d19/d92/db3/d100 0 2024-02-28T23:07:45.395 INFO:tasks.workunit.client.1.smithi184.stdout:5/820: read db/d12/d18/d2e/d3c/d5d/f33 [2983168,55143] 0 2024-02-28T23:07:45.395 INFO:tasks.workunit.client.1.smithi184.stdout:2/776: creat d10/d33/ffd x:0 0 0 2024-02-28T23:07:45.400 INFO:tasks.workunit.client.1.smithi184.stdout:6/751: rename dc/de/d10/f4c to dc/d60/d62/ff2 0 2024-02-28T23:07:45.400 INFO:tasks.workunit.client.1.smithi184.stdout:4/822: stat d1/dc/df/d38/d57/dd6/ddd/dfe/d6d/dbd 0 2024-02-28T23:07:45.400 INFO:tasks.workunit.client.1.smithi184.stdout:8/843: dwrite d1/da/dc/d16/d29/fee [0,4194304] 0 2024-02-28T23:07:45.400 INFO:tasks.workunit.client.1.smithi184.stdout:7/782: mknod d6/d9/d13/d3e/dad/d49/d50/df8/d98/c10e 0 2024-02-28T23:07:45.402 INFO:tasks.workunit.client.1.smithi184.stdout:5/821: stat db/d12/d50/l94 0 2024-02-28T23:07:45.403 INFO:tasks.workunit.client.1.smithi184.stdout:9/826: dwrite d5/db/de/d10/f2b [0,4194304] 0 2024-02-28T23:07:45.404 INFO:tasks.workunit.client.1.smithi184.stdout:4/823: chown d1/dc/df/d38/d57/dd6/ddd/dfe/d6d 31560 1 2024-02-28T23:07:45.405 INFO:tasks.workunit.client.1.smithi184.stdout:2/777: fsync d10/d1f/d21/d5e/d15/d60/d66/dc6/f8c 0 2024-02-28T23:07:45.406 INFO:tasks.workunit.client.1.smithi184.stdout:6/752: readlink dc/de/d2a/d8e/dad/d8a/lcc 0 2024-02-28T23:07:45.409 INFO:tasks.workunit.client.1.smithi184.stdout:6/753: readlink dc/d60/lec 0 2024-02-28T23:07:45.417 INFO:tasks.workunit.client.1.smithi184.stdout:0/858: dwrite d0/d1d/d3a/da9/d11b/d27/d31/d5b/f6c [0,4194304] 0 2024-02-28T23:07:45.418 INFO:tasks.workunit.client.1.smithi184.stdout:7/783: creat d6/d9/d13/d3e/dad/d49/da6/f10f x:0 0 0 2024-02-28T23:07:45.420 INFO:tasks.workunit.client.1.smithi184.stdout:0/859: fdatasync d0/d1f/d109/dcb/f10b 0 2024-02-28T23:07:45.423 INFO:tasks.workunit.client.1.smithi184.stdout:2/778: creat d10/d1f/d21/d5e/d15/d24/d94/ffe x:0 0 0 2024-02-28T23:07:45.424 INFO:tasks.workunit.client.1.smithi184.stdout:6/754: mknod dc/de/d2a/d5c/d79/d87/d9a/cf3 0 2024-02-28T23:07:45.428 INFO:tasks.workunit.client.1.smithi184.stdout:7/784: read - d6/d9/fce zero size 2024-02-28T23:07:45.429 INFO:tasks.workunit.client.1.smithi184.stdout:4/824: dwrite d1/dc/df/f16 [4194304,4194304] 0 2024-02-28T23:07:45.431 INFO:tasks.workunit.client.1.smithi184.stdout:5/822: creat db/d12/d50/f105 x:0 0 0 2024-02-28T23:07:45.436 INFO:tasks.workunit.client.1.smithi184.stdout:8/844: truncate d1/da/f5b 2272006 0 2024-02-28T23:07:45.436 INFO:tasks.workunit.client.1.smithi184.stdout:5/823: chown db/d12/d1c/d21/d25/f69 68645 1 2024-02-28T23:07:45.438 INFO:tasks.workunit.client.1.smithi184.stdout:7/785: chown d6/d9/d13/d14/l24 9237707 1 2024-02-28T23:07:45.439 INFO:tasks.workunit.client.1.smithi184.stdout:5/824: stat db/d12/d50/d9e/fd7 0 2024-02-28T23:07:45.441 INFO:tasks.workunit.client.1.smithi184.stdout:7/786: write d6/d9/d13/d3e/fa0 [667869,103636] 0 2024-02-28T23:07:45.442 INFO:tasks.workunit.client.1.smithi184.stdout:6/755: dread dc/d60/f92 [0,4194304] 0 2024-02-28T23:07:45.443 INFO:tasks.workunit.client.1.smithi184.stdout:2/779: creat d10/d1f/d21/d6a/dc2/fff x:0 0 0 2024-02-28T23:07:45.444 INFO:tasks.workunit.client.1.smithi184.stdout:5/825: mkdir db/d12/d50/ddc/d106 0 2024-02-28T23:07:45.446 INFO:tasks.workunit.client.1.smithi184.stdout:4/825: creat d1/d8/d19/d56/dbf/f101 x:0 0 0 2024-02-28T23:07:45.446 INFO:tasks.workunit.client.1.smithi184.stdout:6/756: read dc/d60/d78/fb2 [734349,45527] 0 2024-02-28T23:07:45.451 INFO:tasks.workunit.client.1.smithi184.stdout:7/787: rmdir d6/d9/d13/d14/dac 39 2024-02-28T23:07:45.455 INFO:tasks.workunit.client.1.smithi184.stdout:8/845: rename d1/da/df/d10e to d1/d12b 0 2024-02-28T23:07:45.456 INFO:tasks.workunit.client.1.smithi184.stdout:9/827: dwrite d5/d26/d50/f38 [0,4194304] 0 2024-02-28T23:07:45.456 INFO:tasks.workunit.client.1.smithi184.stdout:7/788: truncate d6/f9e 363154 0 2024-02-28T23:07:45.461 INFO:tasks.workunit.client.1.smithi184.stdout:8/846: chown d1/da/df/d20/f30 239449185 1 2024-02-28T23:07:45.461 INFO:tasks.workunit.client.1.smithi184.stdout:0/860: dwrite d0/d1d/d3a/d10d/f68 [0,4194304] 0 2024-02-28T23:07:45.464 INFO:tasks.workunit.client.1.smithi184.stdout:2/780: write d10/f18 [730481,86738] 0 2024-02-28T23:07:45.469 INFO:tasks.workunit.client.1.smithi184.stdout:6/757: getdents dc/d60/d62/d6f 0 2024-02-28T23:07:45.474 INFO:tasks.workunit.client.1.smithi184.stdout:0/861: rename d0/d1d/d4c/f69 to d0/db2/d114/f12b 0 2024-02-28T23:07:45.475 INFO:tasks.workunit.client.1.smithi184.stdout:0/862: stat d0/d7c/d8a/lf3 0 2024-02-28T23:07:45.476 INFO:tasks.workunit.client.1.smithi184.stdout:6/758: truncate dc/de/d2a/d8e/dad/f7d 1942736 0 2024-02-28T23:07:45.477 INFO:tasks.workunit.client.1.smithi184.stdout:9/828: write d5/d26/fb5 [94468,29133] 0 2024-02-28T23:07:45.477 INFO:tasks.workunit.client.1.smithi184.stdout:4/826: truncate d1/dc/df/d38/d57/dd6/ddd/fe7 547644 0 2024-02-28T23:07:45.479 INFO:tasks.workunit.client.1.smithi184.stdout:7/789: creat d6/d9/d13/d14/f110 x:0 0 0 2024-02-28T23:07:45.479 INFO:tasks.workunit.client.1.smithi184.stdout:8/847: creat d1/f12c x:0 0 0 2024-02-28T23:07:45.481 INFO:tasks.workunit.client.1.smithi184.stdout:2/781: mknod d10/d55/d89/db5/dc0/c100 0 2024-02-28T23:07:45.483 INFO:tasks.workunit.client.1.smithi184.stdout:7/790: truncate d6/d9/fce 108149 0 2024-02-28T23:07:45.535 INFO:tasks.workunit.client.1.smithi184.stdout:2/782: fsync d10/d1f/d21/d5e/d15/d60/d66/f6b 0 2024-02-28T23:07:45.540 INFO:tasks.workunit.client.1.smithi184.stdout:4/827: dread d1/dc/df/d38/d57/dd6/ddd/dfe/f9c [0,4194304] 0 2024-02-28T23:07:45.540 INFO:tasks.workunit.client.1.smithi184.stdout:7/791: chown d6/d9/d13/d3e/dad/d49/d50/df8/d98/l109 23731 1 2024-02-28T23:07:45.542 INFO:tasks.workunit.client.1.smithi184.stdout:2/783: mknod d10/d1f/d21/d4d/d67/d65/c101 0 2024-02-28T23:07:45.544 INFO:tasks.workunit.client.1.smithi184.stdout:7/792: mkdir d6/d68/d111 0 2024-02-28T23:07:45.544 INFO:tasks.workunit.client.1.smithi184.stdout:6/759: dread dc/d60/d78/fc9 [0,4194304] 0 2024-02-28T23:07:45.553 INFO:tasks.workunit.client.1.smithi184.stdout:8/848: truncate d1/da/df/d20/dc7/fcf 248982 0 2024-02-28T23:07:45.553 INFO:tasks.workunit.client.1.smithi184.stdout:6/760: fdatasync dc/d60/d7c/d90/fe5 0 2024-02-28T23:07:45.557 INFO:tasks.workunit.client.1.smithi184.stdout:2/784: getdents d10/d1f/d21/d5e 0 2024-02-28T23:07:45.557 INFO:tasks.workunit.client.1.smithi184.stdout:6/761: write dc/d60/d7c/d61/dd3/fd9 [244052,37083] 0 2024-02-28T23:07:45.558 INFO:tasks.workunit.client.1.smithi184.stdout:7/793: mknod d6/d9/d13/d3e/dad/d49/da6/daf/d47/c112 0 2024-02-28T23:07:45.560 INFO:tasks.workunit.client.1.smithi184.stdout:5/826: dread db/d12/d18/f20 [0,4194304] 0 2024-02-28T23:07:45.563 INFO:tasks.workunit.client.1.smithi184.stdout:4/828: dread d1/dc/f23 [0,4194304] 0 2024-02-28T23:07:45.572 INFO:tasks.workunit.client.1.smithi184.stdout:7/794: symlink d6/d9/d13/d3e/dad/d7d/d8d/l113 0 2024-02-28T23:07:45.575 INFO:tasks.workunit.client.1.smithi184.stdout:7/795: dread - d6/d9/d13/d3e/dad/fff zero size 2024-02-28T23:07:45.576 INFO:tasks.workunit.client.1.smithi184.stdout:3/866: sync 2024-02-28T23:07:45.586 INFO:tasks.workunit.client.1.smithi184.stdout:8/849: dread d1/da/d10/d17/f47 [0,4194304] 0 2024-02-28T23:07:45.590 INFO:tasks.workunit.client.1.smithi184.stdout:2/785: dread d10/d1f/d21/d4d/d67/d65/fe0 [0,4194304] 0 2024-02-28T23:07:45.590 INFO:tasks.workunit.client.1.smithi184.stdout:6/762: dwrite dc/d60/d7c/d61/fc4 [0,4194304] 0 2024-02-28T23:07:45.593 INFO:tasks.workunit.client.1.smithi184.stdout:5/827: dread db/d12/f47 [0,4194304] 0 2024-02-28T23:07:45.595 INFO:tasks.workunit.client.1.smithi184.stdout:2/786: fdatasync d10/d1f/f93 0 2024-02-28T23:07:45.600 INFO:tasks.workunit.client.1.smithi184.stdout:6/763: creat dc/d60/d7c/ff4 x:0 0 0 2024-02-28T23:07:45.601 INFO:tasks.workunit.client.1.smithi184.stdout:8/850: write d1/da/dc/d16/d32/f39 [1210214,26988] 0 2024-02-28T23:07:45.603 INFO:tasks.workunit.client.1.smithi184.stdout:2/787: mknod d10/d1f/d21/d4d/c102 0 2024-02-28T23:07:45.608 INFO:tasks.workunit.client.1.smithi184.stdout:7/796: dwrite d6/d9/d13/d3e/dad/d49/d50/f61 [0,4194304] 0 2024-02-28T23:07:45.608 INFO:tasks.workunit.client.1.smithi184.stdout:5/828: creat db/d12/d1c/d21/d2f/f107 x:0 0 0 2024-02-28T23:07:45.609 INFO:tasks.workunit.client.1.smithi184.stdout:6/764: symlink dc/de/d2a/d5c/d79/lf5 0 2024-02-28T23:07:45.609 INFO:tasks.workunit.client.1.smithi184.stdout:3/867: dwrite d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/ddc/fbc [0,4194304] 0 2024-02-28T23:07:45.609 INFO:tasks.workunit.client.1.smithi184.stdout:4/829: dread d1/dc/df/d27/f79 [0,4194304] 0 2024-02-28T23:07:45.614 INFO:tasks.workunit.client.1.smithi184.stdout:4/830: write d1/dc/df/d38/d57/dd6/ddd/dfe/fc3 [553964,34] 0 2024-02-28T23:07:45.622 INFO:tasks.workunit.client.1.smithi184.stdout:8/851: dread - d1/da/dc/d16/d29/d7d/fbf zero size 2024-02-28T23:07:45.630 INFO:tasks.workunit.client.1.smithi184.stdout:5/829: dwrite db/d12/d1c/d21/d25/fed [0,4194304] 0 2024-02-28T23:07:45.632 INFO:tasks.workunit.client.1.smithi184.stdout:2/788: truncate d10/d1f/f41 3004951 0 2024-02-28T23:07:45.633 INFO:tasks.workunit.client.1.smithi184.stdout:5/830: stat db/da4/ff8 0 2024-02-28T23:07:45.637 INFO:tasks.workunit.client.1.smithi184.stdout:5/831: symlink db/d1f/l108 0 2024-02-28T23:07:45.637 INFO:tasks.workunit.client.1.smithi184.stdout:5/832: chown db 907 1 2024-02-28T23:07:45.639 INFO:tasks.workunit.client.1.smithi184.stdout:5/833: chown db/d12/df0 9 1 2024-02-28T23:07:45.640 INFO:tasks.workunit.client.1.smithi184.stdout:7/797: truncate d6/d9/d13/d3e/dad/d49/da6/daf/d47/fdf 4459992 0 2024-02-28T23:07:45.644 INFO:tasks.workunit.client.1.smithi184.stdout:5/834: write db/d12/d1c/d21/d4d/f93 [5125706,122125] 0 2024-02-28T23:07:45.645 INFO:tasks.workunit.client.1.smithi184.stdout:7/798: fdatasync d6/d9/d13/d3e/dad/d49/d9c/ffb 0 2024-02-28T23:07:45.646 INFO:tasks.workunit.client.1.smithi184.stdout:6/765: write dc/de/d10/f21 [395242,16258] 0 2024-02-28T23:07:45.649 INFO:tasks.workunit.client.1.smithi184.stdout:3/868: dwrite d1/d4/d1c/d62/d66/dd3/f68 [4194304,4194304] 0 2024-02-28T23:07:45.653 INFO:tasks.workunit.client.1.smithi184.stdout:8/852: write d1/da/fe4 [97216,10394] 0 2024-02-28T23:07:45.654 INFO:tasks.workunit.client.1.smithi184.stdout:2/789: write d10/d1f/fa8 [324813,89953] 0 2024-02-28T23:07:45.655 INFO:tasks.workunit.client.1.smithi184.stdout:6/766: write dc/de/d10/f1b [2706575,51564] 0 2024-02-28T23:07:45.658 INFO:tasks.workunit.client.1.smithi184.stdout:8/853: dread - d1/da/dc/d16/d32/d42/d77/f90 zero size 2024-02-28T23:07:45.658 INFO:tasks.workunit.client.1.smithi184.stdout:5/835: mknod db/d12/d50/ddc/d106/c109 0 2024-02-28T23:07:45.662 INFO:tasks.workunit.client.1.smithi184.stdout:2/790: creat d10/d1f/d21/d5e/d15/d60/d6f/f103 x:0 0 0 2024-02-28T23:07:45.664 INFO:tasks.workunit.client.1.smithi184.stdout:7/799: write d6/d9/f4e [97412,110085] 0 2024-02-28T23:07:45.664 INFO:tasks.workunit.client.1.smithi184.stdout:1/869: sync 2024-02-28T23:07:45.667 INFO:tasks.workunit.client.1.smithi184.stdout:3/869: write d1/d4/d6/f46 [955367,31767] 0 2024-02-28T23:07:45.669 INFO:tasks.workunit.client.1.smithi184.stdout:4/831: dread d1/d4/f11 [0,4194304] 0 2024-02-28T23:07:45.670 INFO:tasks.workunit.client.1.smithi184.stdout:5/836: mkdir db/d12/d18/d2e/d3c/d5d/d10a 0 2024-02-28T23:07:45.671 INFO:tasks.workunit.client.1.smithi184.stdout:2/791: fsync d10/d1f/d21/d5e/d15/d60/d66/f6b 0 2024-02-28T23:07:45.671 INFO:tasks.workunit.client.1.smithi184.stdout:1/870: fdatasync d20/d32/d3e/d91/ff4 0 2024-02-28T23:07:45.672 INFO:tasks.workunit.client.1.smithi184.stdout:8/854: mkdir d1/da/df/d20/dc7/d123/d12d 0 2024-02-28T23:07:45.675 INFO:tasks.workunit.client.1.smithi184.stdout:7/800: symlink d6/d9/d13/d3e/dad/d49/d50/df8/d98/dc4/l114 0 2024-02-28T23:07:45.678 INFO:tasks.workunit.client.1.smithi184.stdout:4/832: truncate d1/d4/d43/fc2 628774 0 2024-02-28T23:07:45.681 INFO:tasks.workunit.client.1.smithi184.stdout:5/837: chown db/d12/d1c/d21/d2f/dc4/l100 1 1 2024-02-28T23:07:45.682 INFO:tasks.workunit.client.1.smithi184.stdout:1/871: rename d20/d32/d3e/f117 to d20/d46/d90/da0/f126 0 2024-02-28T23:07:45.684 INFO:tasks.workunit.client.1.smithi184.stdout:5/838: stat db/d12/d18 0 2024-02-28T23:07:45.686 INFO:tasks.workunit.client.1.smithi184.stdout:4/833: rmdir d1/d8/d19/d67 39 2024-02-28T23:07:45.688 INFO:tasks.workunit.client.1.smithi184.stdout:6/767: dwrite dc/de/d10/f9b [0,4194304] 0 2024-02-28T23:07:45.688 INFO:tasks.workunit.client.1.smithi184.stdout:7/801: rmdir d6/d9/d13/d3e/dad/d7d/d6c 39 2024-02-28T23:07:45.688 INFO:tasks.workunit.client.1.smithi184.stdout:8/855: dread d1/da/dc/dc9/f103 [0,4194304] 0 2024-02-28T23:07:45.688 INFO:tasks.workunit.client.1.smithi184.stdout:1/872: mkdir d20/d127 0 2024-02-28T23:07:45.689 INFO:tasks.workunit.client.1.smithi184.stdout:3/870: write d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/dc1/fc5 [605726,107023] 0 2024-02-28T23:07:45.694 INFO:tasks.workunit.client.1.smithi184.stdout:3/871: chown d1/f8d 644 1 2024-02-28T23:07:45.697 INFO:tasks.workunit.client.1.smithi184.stdout:8/856: symlink d1/da/d10/d43/d124/dac/l12e 0 2024-02-28T23:07:45.700 INFO:tasks.workunit.client.1.smithi184.stdout:1/873: rename d20/d46/d90/fe9 to d20/d32/d3e/d91/df2/f128 0 2024-02-28T23:07:45.702 INFO:tasks.workunit.client.1.smithi184.stdout:5/839: rmdir db/d12/d18/d2e/d3c/d5d/d10a 0 2024-02-28T23:07:45.703 INFO:tasks.workunit.client.1.smithi184.stdout:4/834: mknod d1/d8/d19/d67/d87/c102 0 2024-02-28T23:07:45.705 INFO:tasks.workunit.client.1.smithi184.stdout:6/768: creat dc/d60/ff6 x:0 0 0 2024-02-28T23:07:45.705 INFO:tasks.workunit.client.1.smithi184.stdout:7/802: mknod d6/d9/d13/d3e/dad/d7d/d6c/df7/c115 0 2024-02-28T23:07:45.706 INFO:tasks.workunit.client.1.smithi184.stdout:0/863: sync 2024-02-28T23:07:45.706 INFO:tasks.workunit.client.1.smithi184.stdout:9/829: sync 2024-02-28T23:07:45.708 INFO:tasks.workunit.client.1.smithi184.stdout:5/840: write db/d12/d1c/d21/d2f/f107 [747867,128485] 0 2024-02-28T23:07:45.708 INFO:tasks.workunit.client.1.smithi184.stdout:2/792: dread fa [0,4194304] 0 2024-02-28T23:07:45.709 INFO:tasks.workunit.client.1.smithi184.stdout:7/803: unlink d6/d68/fbe 0 2024-02-28T23:07:45.710 INFO:tasks.workunit.client.0.smithi159.stdout:7/958: sync 2024-02-28T23:07:45.711 INFO:tasks.workunit.client.1.smithi184.stdout:6/769: unlink dc/de/d2a/d5c/d6e/fc3 0 2024-02-28T23:07:45.711 INFO:tasks.workunit.client.1.smithi184.stdout:7/804: stat d6/d9/lb5 0 2024-02-28T23:07:45.714 INFO:tasks.workunit.client.1.smithi184.stdout:6/770: write dc/de/f1e [4665991,8671] 0 2024-02-28T23:07:45.715 INFO:tasks.workunit.client.1.smithi184.stdout:0/864: mknod d0/d1d/c12c 0 2024-02-28T23:07:45.717 INFO:tasks.workunit.client.0.smithi159.stdout:7/959: symlink d5/d16/d1a/d27/dff/l135 0 2024-02-28T23:07:45.719 INFO:tasks.workunit.client.0.smithi159.stdout:7/960: stat d5/d16/d1a/d27/deb/d60/f119 0 2024-02-28T23:07:45.720 INFO:tasks.workunit.client.1.smithi184.stdout:2/793: symlink d10/d1f/d21/d4d/l104 0 2024-02-28T23:07:45.722 INFO:tasks.workunit.client.1.smithi184.stdout:5/841: creat db/d12/d1c/d21/d25/dd3/df1/f10b x:0 0 0 2024-02-28T23:07:45.724 INFO:tasks.workunit.client.0.smithi159.stdout:7/961: creat d5/d16/d40/f136 x:0 0 0 2024-02-28T23:07:45.726 INFO:tasks.workunit.client.1.smithi184.stdout:0/865: fsync d0/d1d/d4c/f6b 0 2024-02-28T23:07:45.730 INFO:tasks.workunit.client.1.smithi184.stdout:9/830: rename d5/c4b to d5/db/d5c/d5e/c10e 0 2024-02-28T23:07:45.730 INFO:tasks.workunit.client.0.smithi159.stdout:7/962: symlink d5/d16/d1a/d27/d37/l137 0 2024-02-28T23:07:45.731 INFO:tasks.workunit.client.1.smithi184.stdout:3/872: dwrite d1/d4/d1c/d62/d66/f6f [0,4194304] 0 2024-02-28T23:07:45.731 INFO:tasks.workunit.client.1.smithi184.stdout:4/835: link d1/d8/d19/d67/d99/faa d1/d8/d19/d92/db3/d100/f103 0 2024-02-28T23:07:45.731 INFO:tasks.workunit.client.1.smithi184.stdout:1/874: dwrite f1c [4194304,4194304] 0 2024-02-28T23:07:45.732 INFO:tasks.workunit.client.1.smithi184.stdout:8/857: dread d1/da/f31 [4194304,4194304] 0 2024-02-28T23:07:45.732 INFO:tasks.workunit.client.1.smithi184.stdout:5/842: symlink db/d90/l10c 0 2024-02-28T23:07:45.736 INFO:tasks.workunit.client.1.smithi184.stdout:2/794: mknod d10/d1f/d21/d5e/dad/da3/dd6/c105 0 2024-02-28T23:07:45.737 INFO:tasks.workunit.client.1.smithi184.stdout:7/805: truncate d6/d9/d13/f57 946651 0 2024-02-28T23:07:45.749 INFO:tasks.workunit.client.1.smithi184.stdout:8/858: creat d1/da/dc/d16/d4d/f12f x:0 0 0 2024-02-28T23:07:45.753 INFO:tasks.workunit.client.1.smithi184.stdout:2/795: rename d10/d33/l62 to d10/d1f/d21/d6a/l106 0 2024-02-28T23:07:45.753 INFO:tasks.workunit.client.1.smithi184.stdout:1/875: symlink d20/d32/d3e/d82/d106/l129 0 2024-02-28T23:07:45.753 INFO:tasks.workunit.client.1.smithi184.stdout:5/843: mknod db/d1f/c10d 0 2024-02-28T23:07:45.754 INFO:tasks.workunit.client.1.smithi184.stdout:6/771: dread dc/de/d2a/d5c/d79/d87/d9a/fc7 [0,4194304] 0 2024-02-28T23:07:45.755 INFO:tasks.workunit.client.1.smithi184.stdout:6/772: read - dc/d60/ff6 zero size 2024-02-28T23:07:45.756 INFO:tasks.workunit.client.1.smithi184.stdout:2/796: read d10/d1f/d38/d54/f90 [115518,54444] 0 2024-02-28T23:07:45.757 INFO:tasks.workunit.client.1.smithi184.stdout:3/873: creat d1/d4/d1c/d62/d66/da6/df5/d10a/f112 x:0 0 0 2024-02-28T23:07:45.760 INFO:tasks.workunit.client.1.smithi184.stdout:2/797: write d10/d1f/d21/d5e/f58 [2155219,57510] 0 2024-02-28T23:07:45.763 INFO:tasks.workunit.client.1.smithi184.stdout:8/859: mkdir d1/da/d120/d130 0 2024-02-28T23:07:45.764 INFO:tasks.workunit.client.1.smithi184.stdout:6/773: mknod dc/d60/d7c/d61/dd2/cf7 0 2024-02-28T23:07:45.766 INFO:tasks.workunit.client.1.smithi184.stdout:4/836: getdents d1/d8/d19/d92/db3 0 2024-02-28T23:07:45.768 INFO:tasks.workunit.client.1.smithi184.stdout:1/876: rename d20/d32/d3e/d91/df2/f128 to d20/d46/d90/de1/f12a 0 2024-02-28T23:07:45.770 INFO:tasks.workunit.client.1.smithi184.stdout:8/860: creat d1/da/dc/d16/d4d/f131 x:0 0 0 2024-02-28T23:07:45.770 INFO:tasks.workunit.client.1.smithi184.stdout:0/866: dread d0/d1d/d3a/da9/d11b/d27/d31/f8f [4194304,4194304] 0 2024-02-28T23:07:45.771 INFO:tasks.workunit.client.1.smithi184.stdout:6/774: mknod dc/d60/d62/d6f/d99/cf8 0 2024-02-28T23:07:45.772 INFO:tasks.workunit.client.1.smithi184.stdout:2/798: dread d10/d1f/f8d [0,4194304] 0 2024-02-28T23:07:45.778 INFO:tasks.workunit.client.1.smithi184.stdout:3/874: creat d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/f113 x:0 0 0 2024-02-28T23:07:45.779 INFO:tasks.workunit.client.1.smithi184.stdout:8/861: write d1/da/dc/f73 [847110,40398] 0 2024-02-28T23:07:45.784 INFO:tasks.workunit.client.1.smithi184.stdout:3/875: stat d1/d4/d1c/l2d 0 2024-02-28T23:07:45.786 INFO:tasks.workunit.client.1.smithi184.stdout:7/806: dwrite d6/f59 [0,4194304] 0 2024-02-28T23:07:45.786 INFO:tasks.workunit.client.1.smithi184.stdout:8/862: unlink d1/da/f31 0 2024-02-28T23:07:45.791 INFO:tasks.workunit.client.1.smithi184.stdout:7/807: mknod d6/d68/c116 0 2024-02-28T23:07:45.794 INFO:tasks.workunit.client.1.smithi184.stdout:3/876: dread - d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/f113 zero size 2024-02-28T23:07:45.794 INFO:tasks.workunit.client.1.smithi184.stdout:9/831: dwrite d5/db/de/d10/f7a [0,4194304] 0 2024-02-28T23:07:45.795 INFO:tasks.workunit.client.1.smithi184.stdout:2/799: write d10/d1f/d21/d5e/d15/d24/f56 [3042593,49441] 0 2024-02-28T23:07:45.799 INFO:tasks.workunit.client.1.smithi184.stdout:0/867: rename d0/d1d/d3a/da9/d11b/d27/f8b to d0/d1d/d3a/da9/d11b/d27/f12d 0 2024-02-28T23:07:45.800 INFO:tasks.workunit.client.1.smithi184.stdout:1/877: dread f15 [0,4194304] 0 2024-02-28T23:07:45.800 INFO:tasks.workunit.client.1.smithi184.stdout:8/863: mknod d1/da/dc/d16/d32/d42/d77/ddd/c132 0 2024-02-28T23:07:45.800 INFO:tasks.workunit.client.1.smithi184.stdout:3/877: chown d1/d4/d6/d1e/d72/f7a 94800036 1 2024-02-28T23:07:45.800 INFO:tasks.workunit.client.1.smithi184.stdout:4/837: dread d1/dc/df/f16 [8388608,4194304] 0 2024-02-28T23:07:45.802 INFO:tasks.workunit.client.1.smithi184.stdout:7/808: creat d6/d9/d13/d3e/dad/d49/da6/daf/d65/f117 x:0 0 0 2024-02-28T23:07:45.806 INFO:tasks.workunit.client.1.smithi184.stdout:0/868: chown d0/d1d/d3a/da9/d11b/d27/d31/d51/d117/f10c 88148353 1 2024-02-28T23:07:45.808 INFO:tasks.workunit.client.1.smithi184.stdout:1/878: symlink d20/d46/l12b 0 2024-02-28T23:07:45.810 INFO:tasks.workunit.client.1.smithi184.stdout:4/838: symlink d1/d8/d19/d92/db3/d100/l104 0 2024-02-28T23:07:45.818 INFO:tasks.workunit.client.1.smithi184.stdout:1/879: mknod d20/d32/d3e/d82/d85/dfc/c12c 0 2024-02-28T23:07:45.819 INFO:tasks.workunit.client.1.smithi184.stdout:0/869: dread d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/f101 [0,4194304] 0 2024-02-28T23:07:45.823 INFO:tasks.workunit.client.1.smithi184.stdout:4/839: symlink d1/dc/df/d38/d57/dd6/l105 0 2024-02-28T23:07:45.823 INFO:tasks.workunit.client.1.smithi184.stdout:1/880: symlink d20/d46/d90/de1/l12d 0 2024-02-28T23:07:45.824 INFO:tasks.workunit.client.1.smithi184.stdout:3/878: dwrite d1/d4/f23 [0,4194304] 0 2024-02-28T23:07:45.827 INFO:tasks.workunit.client.1.smithi184.stdout:4/840: write d1/dc/df/d27/ff7 [668185,56687] 0 2024-02-28T23:07:45.829 INFO:tasks.workunit.client.1.smithi184.stdout:0/870: rename d0/d1d/c24 to d0/d1d/d3a/da9/d11b/d27/d31/d51/d85/c12e 0 2024-02-28T23:07:45.835 INFO:tasks.workunit.client.1.smithi184.stdout:6/775: dread dc/de/d10/d16/f2d [0,4194304] 0 2024-02-28T23:07:45.837 INFO:tasks.workunit.client.1.smithi184.stdout:0/871: chown d0/d1d/d3a/de5/f124 402 1 2024-02-28T23:07:45.849 INFO:tasks.workunit.client.1.smithi184.stdout:4/841: write d1/d4/d43/d73/f5e [501594,105513] 0 2024-02-28T23:07:45.853 INFO:tasks.workunit.client.1.smithi184.stdout:7/809: dwrite d6/d9/d13/d3e/dad/fd1 [0,4194304] 0 2024-02-28T23:07:45.853 INFO:tasks.workunit.client.1.smithi184.stdout:8/864: dwrite d1/da/dc/d16/d32/d42/f61 [0,4194304] 0 2024-02-28T23:07:45.853 INFO:tasks.workunit.client.1.smithi184.stdout:2/800: dwrite d10/d1f/d21/fe4 [0,4194304] 0 2024-02-28T23:07:45.854 INFO:tasks.workunit.client.1.smithi184.stdout:9/832: dread d5/d47/d59/d92/fc0 [0,4194304] 0 2024-02-28T23:07:45.858 INFO:tasks.workunit.client.1.smithi184.stdout:2/801: dread - d10/d55/ff0 zero size 2024-02-28T23:07:45.858 INFO:tasks.workunit.client.1.smithi184.stdout:9/833: chown d5/d47/f67 0 1 2024-02-28T23:07:45.860 INFO:tasks.workunit.client.1.smithi184.stdout:1/881: dwrite d20/d32/d3e/d61/fd9 [0,4194304] 0 2024-02-28T23:07:45.866 INFO:tasks.workunit.client.1.smithi184.stdout:5/844: sync 2024-02-28T23:07:45.874 INFO:tasks.workunit.client.1.smithi184.stdout:0/872: fdatasync d0/d1d/d3a/da9/d11b/f18 0 2024-02-28T23:07:45.880 INFO:tasks.workunit.client.1.smithi184.stdout:8/865: rmdir d1/da 39 2024-02-28T23:07:45.884 INFO:tasks.workunit.client.1.smithi184.stdout:7/810: creat d6/d9/d13/d14/d45/f118 x:0 0 0 2024-02-28T23:07:45.887 INFO:tasks.workunit.client.1.smithi184.stdout:7/811: fdatasync d6/d9/d13/d3e/dad/d49/d50/fe5 0 2024-02-28T23:07:45.889 INFO:tasks.workunit.client.1.smithi184.stdout:5/845: rename db/d12/d18/d2e/d3c to db/d12/d1c/d21/d4d/d10e 0 2024-02-28T23:07:45.896 INFO:tasks.workunit.client.1.smithi184.stdout:1/882: unlink d20/d32/d3e/d61/d8b/d9c/l10c 0 2024-02-28T23:07:45.899 INFO:tasks.workunit.client.1.smithi184.stdout:7/812: rename d6/d9/f4e to d6/d9/dc5/f119 0 2024-02-28T23:07:45.902 INFO:tasks.workunit.client.1.smithi184.stdout:5/846: read db/d12/d1c/d21/d2f/f7a [584424,119774] 0 2024-02-28T23:07:45.902 INFO:tasks.workunit.client.1.smithi184.stdout:7/813: write d6/d9/d13/d1e/f22 [1666304,44747] 0 2024-02-28T23:07:45.902 INFO:tasks.workunit.client.1.smithi184.stdout:8/866: fsync d1/da/dc/d16/d29/d7d/fb8 0 2024-02-28T23:07:45.903 INFO:tasks.workunit.client.1.smithi184.stdout:4/842: link d1/dc/df/d27/d34/cdb d1/d8/d19/d67/d99/c106 0 2024-02-28T23:07:45.906 INFO:tasks.workunit.client.1.smithi184.stdout:8/867: write d1/da/df/f114 [974107,15695] 0 2024-02-28T23:07:45.908 INFO:tasks.workunit.client.1.smithi184.stdout:2/802: getdents d10 0 2024-02-28T23:07:45.910 INFO:tasks.workunit.client.1.smithi184.stdout:5/847: rmdir db/d12/df0 39 2024-02-28T23:07:45.915 INFO:tasks.workunit.client.1.smithi184.stdout:1/883: truncate d20/d46/d90/de1/f12a 946956 0 2024-02-28T23:07:45.916 INFO:tasks.workunit.client.1.smithi184.stdout:1/884: readlink d20/d32/d3e/l5b 0 2024-02-28T23:07:45.918 INFO:tasks.workunit.client.1.smithi184.stdout:2/803: dread d10/d1f/d21/fe4 [0,4194304] 0 2024-02-28T23:07:45.921 INFO:tasks.workunit.client.1.smithi184.stdout:5/848: unlink db/d12/d18/faf 0 2024-02-28T23:07:45.922 INFO:tasks.workunit.client.1.smithi184.stdout:4/843: symlink d1/d8/d19/d67/l107 0 2024-02-28T23:07:45.924 INFO:tasks.workunit.client.1.smithi184.stdout:7/814: creat d6/d9/d13/d3e/dad/d49/f11a x:0 0 0 2024-02-28T23:07:45.927 INFO:tasks.workunit.client.1.smithi184.stdout:3/879: truncate d1/d4/d5/d40/d8f/f91 1655060 0 2024-02-28T23:07:45.929 INFO:tasks.workunit.client.1.smithi184.stdout:5/849: creat db/d44/da5/ddf/f10f x:0 0 0 2024-02-28T23:07:45.929 INFO:tasks.workunit.client.1.smithi184.stdout:6/776: write dc/de/d2a/d8e/dad/f7d [1317837,52055] 0 2024-02-28T23:07:45.931 INFO:tasks.workunit.client.1.smithi184.stdout:5/850: chown db/d12/d1c/d21 16562171 1 2024-02-28T23:07:45.931 INFO:tasks.workunit.client.1.smithi184.stdout:4/844: rename l0 to d1/dc/df/d38/d57/dd6/l108 0 2024-02-28T23:07:45.932 INFO:tasks.workunit.client.1.smithi184.stdout:3/880: fdatasync d1/d4/d1c/d62/d66/da6/df5/d10a/f112 0 2024-02-28T23:07:45.933 INFO:tasks.workunit.client.1.smithi184.stdout:5/851: stat db/d12/d1c 0 2024-02-28T23:07:45.933 INFO:tasks.workunit.client.1.smithi184.stdout:0/873: write d0/d1f/d109/d71/fc8 [510027,100795] 0 2024-02-28T23:07:45.937 INFO:tasks.workunit.client.1.smithi184.stdout:4/845: dread - d1/d8/d19/d56/dbf/f101 zero size 2024-02-28T23:07:45.938 INFO:tasks.workunit.client.1.smithi184.stdout:5/852: creat db/da4/f110 x:0 0 0 2024-02-28T23:07:45.945 INFO:tasks.workunit.client.1.smithi184.stdout:1/885: dwrite d20/d32/d4d/fa9 [0,4194304] 0 2024-02-28T23:07:45.946 INFO:tasks.workunit.client.1.smithi184.stdout:3/881: creat d1/d4/d1c/d62/d66/dd3/d26/dd2/f114 x:0 0 0 2024-02-28T23:07:45.947 INFO:tasks.workunit.client.1.smithi184.stdout:5/853: fdatasync db/f7b 0 2024-02-28T23:07:45.956 INFO:tasks.workunit.client.1.smithi184.stdout:1/886: truncate d20/d32/d4b/fe6 479835 0 2024-02-28T23:07:45.956 INFO:tasks.workunit.client.1.smithi184.stdout:7/815: dread d6/d68/fb9 [0,4194304] 0 2024-02-28T23:07:45.957 INFO:tasks.workunit.client.1.smithi184.stdout:9/834: sync 2024-02-28T23:07:45.960 INFO:tasks.workunit.client.1.smithi184.stdout:0/874: write d0/d1f/d109/d71/f125 [1455134,17468] 0 2024-02-28T23:07:45.960 INFO:tasks.workunit.client.1.smithi184.stdout:6/777: truncate dc/d60/d6d/f83 257758 0 2024-02-28T23:07:45.967 INFO:tasks.workunit.client.1.smithi184.stdout:8/868: dwrite d1/da/dc/d16/d29/f72 [0,4194304] 0 2024-02-28T23:07:45.968 INFO:tasks.workunit.client.1.smithi184.stdout:1/887: creat d20/d32/db0/df7/dfa/f12e x:0 0 0 2024-02-28T23:07:45.969 INFO:tasks.workunit.client.1.smithi184.stdout:2/804: dwrite d10/d1f/d21/fbb [0,4194304] 0 2024-02-28T23:07:45.972 INFO:tasks.workunit.client.1.smithi184.stdout:2/805: read - d10/d33/ffd zero size 2024-02-28T23:07:45.974 INFO:tasks.workunit.client.1.smithi184.stdout:6/778: mkdir dc/d60/d7c/df9 0 2024-02-28T23:07:45.977 INFO:tasks.workunit.client.1.smithi184.stdout:1/888: mkdir d20/d46/d90/dff/d12f 0 2024-02-28T23:07:45.981 INFO:tasks.workunit.client.1.smithi184.stdout:9/835: getdents d5/d17/d8f 0 2024-02-28T23:07:45.990 INFO:tasks.workunit.client.1.smithi184.stdout:1/889: unlink d20/d32/d3e/d82/d85/lf0 0 2024-02-28T23:07:45.992 INFO:tasks.workunit.client.1.smithi184.stdout:8/869: link d1/da/df/f121 d1/da/df/d20/dc7/d123/d12d/f133 0 2024-02-28T23:07:45.992 INFO:tasks.workunit.client.1.smithi184.stdout:3/882: dwrite d1/d4/d1c/d62/d66/dd3/d26/dd2/f114 [0,4194304] 0 2024-02-28T23:07:45.993 INFO:tasks.workunit.client.1.smithi184.stdout:4/846: dread d1/dc/df/f16 [0,4194304] 0 2024-02-28T23:07:45.995 INFO:tasks.workunit.client.1.smithi184.stdout:9/836: fdatasync d5/d17/f5a 0 2024-02-28T23:07:45.999 INFO:tasks.workunit.client.1.smithi184.stdout:6/779: getdents dc/d60/d7c 0 2024-02-28T23:07:46.003 INFO:tasks.workunit.client.1.smithi184.stdout:1/890: dread - d20/d32/d3e/d82/d85/fa3 zero size 2024-02-28T23:07:46.003 INFO:tasks.workunit.client.1.smithi184.stdout:5/854: dwrite db/d12/d1c/f2b [0,4194304] 0 2024-02-28T23:07:46.004 INFO:tasks.workunit.client.1.smithi184.stdout:2/806: truncate d10/d33/fc9 352828 0 2024-02-28T23:07:46.005 INFO:tasks.workunit.client.1.smithi184.stdout:0/875: dwrite d0/df/f7a [0,4194304] 0 2024-02-28T23:07:46.009 INFO:tasks.workunit.client.1.smithi184.stdout:3/883: mkdir d1/d4/d5/da9/d115 0 2024-02-28T23:07:46.018 INFO:tasks.workunit.client.1.smithi184.stdout:1/891: read d20/d32/d4d/f53 [2424115,18030] 0 2024-02-28T23:07:46.018 INFO:tasks.workunit.client.1.smithi184.stdout:9/837: creat d5/db/f10f x:0 0 0 2024-02-28T23:07:46.027 INFO:tasks.workunit.client.1.smithi184.stdout:7/816: dread d6/d9/d13/d3e/dad/d7d/d8d/fd7 [0,4194304] 0 2024-02-28T23:07:46.027 INFO:tasks.workunit.client.1.smithi184.stdout:1/892: mknod d20/d32/d3e/d91/d105/c130 0 2024-02-28T23:07:46.031 INFO:tasks.workunit.client.1.smithi184.stdout:6/780: write dc/de/d2a/d5c/f95 [927003,51254] 0 2024-02-28T23:07:46.031 INFO:tasks.workunit.client.1.smithi184.stdout:9/838: dread d5/db/de/d10/d6a/faa [0,4194304] 0 2024-02-28T23:07:46.037 INFO:tasks.workunit.client.1.smithi184.stdout:9/839: creat d5/f110 x:0 0 0 2024-02-28T23:07:46.038 INFO:tasks.workunit.client.1.smithi184.stdout:6/781: read dc/de/d10/f9b [3786823,106265] 0 2024-02-28T23:07:46.040 INFO:tasks.workunit.client.1.smithi184.stdout:4/847: dread d1/dc/df/d38/d57/dd6/ddd/dfe/f60 [0,4194304] 0 2024-02-28T23:07:46.042 INFO:tasks.workunit.client.1.smithi184.stdout:8/870: dwrite d1/da/d10/f2d [0,4194304] 0 2024-02-28T23:07:46.044 INFO:tasks.workunit.client.1.smithi184.stdout:4/848: chown d1/dc/f23 104 1 2024-02-28T23:07:46.048 INFO:tasks.workunit.client.1.smithi184.stdout:4/849: truncate d1/d8/d3d/f74 1682105 0 2024-02-28T23:07:46.049 INFO:tasks.workunit.client.1.smithi184.stdout:1/893: mknod d20/d46/d90/db3/d103/d110/c131 0 2024-02-28T23:07:46.052 INFO:tasks.workunit.client.1.smithi184.stdout:0/876: write d0/d1d/d3a/da9/d11b/d27/f12d [914058,53052] 0 2024-02-28T23:07:46.055 INFO:tasks.workunit.client.1.smithi184.stdout:6/782: rename dc/d60/d7c/l5f to dc/d60/d7c/d61/dd2/lfa 0 2024-02-28T23:07:46.056 INFO:tasks.workunit.client.1.smithi184.stdout:7/817: write d6/d9/d13/d3e/dad/d7d/d6c/f81 [1216509,121778] 0 2024-02-28T23:07:46.060 INFO:tasks.workunit.client.1.smithi184.stdout:8/871: mkdir d1/da/dc/d16/d32/d134 0 2024-02-28T23:07:46.063 INFO:tasks.workunit.client.1.smithi184.stdout:0/877: read d0/f17 [658494,92510] 0 2024-02-28T23:07:46.065 INFO:tasks.workunit.client.1.smithi184.stdout:3/884: dwrite d1/d4/d1c/d62/d66/dd3/f60 [0,4194304] 0 2024-02-28T23:07:46.065 INFO:tasks.workunit.client.1.smithi184.stdout:6/783: mknod dc/de/d2a/d5c/d79/d87/d9a/cfb 0 2024-02-28T23:07:46.068 INFO:tasks.workunit.client.1.smithi184.stdout:3/885: readlink d1/l1d 0 2024-02-28T23:07:46.068 INFO:tasks.workunit.client.1.smithi184.stdout:1/894: write d20/d32/ff8 [674178,16367] 0 2024-02-28T23:07:46.070 INFO:tasks.workunit.client.1.smithi184.stdout:6/784: fsync dc/f97 0 2024-02-28T23:07:46.076 INFO:tasks.workunit.client.1.smithi184.stdout:4/850: dwrite d1/fd8 [0,4194304] 0 2024-02-28T23:07:46.080 INFO:tasks.workunit.client.1.smithi184.stdout:6/785: stat dc/de/d10/d16/f96 0 2024-02-28T23:07:46.080 INFO:tasks.workunit.client.1.smithi184.stdout:5/855: dread db/d12/d1c/d21/d2f/f4e [0,4194304] 0 2024-02-28T23:07:46.080 INFO:tasks.workunit.client.1.smithi184.stdout:4/851: fsync d1/d8/d19/d92/feb 0 2024-02-28T23:07:46.083 INFO:tasks.workunit.client.1.smithi184.stdout:8/872: rename d1/da/df/d20/f26 to d1/f135 0 2024-02-28T23:07:46.088 INFO:tasks.workunit.client.1.smithi184.stdout:6/786: fsync dc/de/d2a/d5c/d79/d87/f9f 0 2024-02-28T23:07:46.088 INFO:tasks.workunit.client.1.smithi184.stdout:1/895: mknod d20/d32/d3e/da2/c132 0 2024-02-28T23:07:46.088 INFO:tasks.workunit.client.1.smithi184.stdout:3/886: mknod d1/d4/d6/d83/c116 0 2024-02-28T23:07:46.088 INFO:tasks.workunit.client.1.smithi184.stdout:0/878: creat d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/dac/f12f x:0 0 0 2024-02-28T23:07:46.088 INFO:tasks.workunit.client.1.smithi184.stdout:5/856: unlink db/l98 0 2024-02-28T23:07:46.089 INFO:tasks.workunit.client.1.smithi184.stdout:7/818: dread d6/d9/d13/d3e/dad/d49/d50/df8/d33/d80/fa5 [0,4194304] 0 2024-02-28T23:07:46.090 INFO:tasks.workunit.client.1.smithi184.stdout:9/840: dread d5/db/de/d10/d12/d2f/f7b [0,4194304] 0 2024-02-28T23:07:46.091 INFO:tasks.workunit.client.1.smithi184.stdout:8/873: symlink d1/da/d10/d43/d124/dac/l136 0 2024-02-28T23:07:46.091 INFO:tasks.workunit.client.1.smithi184.stdout:2/807: sync 2024-02-28T23:07:46.093 INFO:tasks.workunit.client.1.smithi184.stdout:7/819: chown d6/dea/cec 1273 1 2024-02-28T23:07:46.094 INFO:tasks.workunit.client.1.smithi184.stdout:3/887: chown d1/d4/d5/d40/d8f/f91 581675458 1 2024-02-28T23:07:46.094 INFO:tasks.workunit.client.1.smithi184.stdout:6/787: symlink dc/d60/lfc 0 2024-02-28T23:07:46.095 INFO:tasks.workunit.client.1.smithi184.stdout:9/841: chown d5/f24 849054 1 2024-02-28T23:07:46.097 INFO:tasks.workunit.client.1.smithi184.stdout:4/852: creat d1/dc/df/d27/f109 x:0 0 0 2024-02-28T23:07:46.101 INFO:tasks.workunit.client.1.smithi184.stdout:1/896: rmdir d20/d46/d90/dff/d12f 0 2024-02-28T23:07:46.102 INFO:tasks.workunit.client.0.smithi159.stdout:7/963: sync 2024-02-28T23:07:46.103 INFO:tasks.workunit.client.1.smithi184.stdout:7/820: creat d6/d9/d13/d3e/dad/d49/d50/df8/d33/f11b x:0 0 0 2024-02-28T23:07:46.105 INFO:tasks.workunit.client.1.smithi184.stdout:9/842: creat d5/db/d5c/d5e/f111 x:0 0 0 2024-02-28T23:07:46.106 INFO:tasks.workunit.client.1.smithi184.stdout:1/897: stat d20/d32/d3e/d61/d8b/fac 0 2024-02-28T23:07:46.106 INFO:tasks.workunit.client.1.smithi184.stdout:2/808: read d10/d1f/d21/d5e/d15/f2e [160446,68078] 0 2024-02-28T23:07:46.106 INFO:tasks.workunit.client.0.smithi159.stdout:7/964: creat d5/d16/d1a/d27/d75/f138 x:0 0 0 2024-02-28T23:07:46.107 INFO:tasks.workunit.client.1.smithi184.stdout:5/857: truncate db/d12/d1c/d21/f5e 3267960 0 2024-02-28T23:07:46.112 INFO:tasks.workunit.client.1.smithi184.stdout:1/898: symlink d20/d46/d90/db3/l133 0 2024-02-28T23:07:46.115 INFO:tasks.workunit.client.1.smithi184.stdout:4/853: link d1/dc/df/d27/fae d1/d4/f10a 0 2024-02-28T23:07:46.116 INFO:tasks.workunit.client.1.smithi184.stdout:7/821: rename d6/d9/d13/d3e/dad/d49/da6/daf/d47/l73 to d6/d9/da/l11c 0 2024-02-28T23:07:46.116 INFO:tasks.workunit.client.1.smithi184.stdout:5/858: write db/f7c [1090576,76251] 0 2024-02-28T23:07:46.119 INFO:tasks.workunit.client.1.smithi184.stdout:1/899: unlink d20/c9b 0 2024-02-28T23:07:46.119 INFO:tasks.workunit.client.0.smithi159.stdout:7/965: dread d5/d16/d1a/d27/d46/f8d [0,4194304] 0 2024-02-28T23:07:46.123 INFO:tasks.workunit.client.1.smithi184.stdout:0/879: write d0/d1d/d3a/da9/d11b/f64 [339627,55384] 0 2024-02-28T23:07:46.124 INFO:tasks.workunit.client.0.smithi159.stdout:7/966: creat d5/d16/d1a/d27/d46/d101/d64/f139 x:0 0 0 2024-02-28T23:07:46.125 INFO:tasks.workunit.client.1.smithi184.stdout:5/859: fsync db/d12/f47 0 2024-02-28T23:07:46.126 INFO:tasks.workunit.client.1.smithi184.stdout:6/788: dwrite dc/d60/d62/d6f/d99/d9d/fbb [0,4194304] 0 2024-02-28T23:07:46.133 INFO:tasks.workunit.client.1.smithi184.stdout:0/880: write d0/f37 [64640,116002] 0 2024-02-28T23:07:46.134 INFO:tasks.workunit.client.1.smithi184.stdout:3/888: dwrite d1/d4/d1c/d62/d66/f6f [0,4194304] 0 2024-02-28T23:07:46.136 INFO:tasks.workunit.client.1.smithi184.stdout:7/822: symlink d6/d9/d13/d3e/dad/d7d/l11d 0 2024-02-28T23:07:46.143 INFO:tasks.workunit.client.1.smithi184.stdout:9/843: write d5/f24 [1300956,57106] 0 2024-02-28T23:07:46.146 INFO:tasks.workunit.client.1.smithi184.stdout:8/874: dwrite d1/f99 [0,4194304] 0 2024-02-28T23:07:46.148 INFO:tasks.workunit.client.0.smithi159.stdout:7/967: dread d5/fe [0,4194304] 0 2024-02-28T23:07:46.148 INFO:tasks.workunit.client.1.smithi184.stdout:2/809: dread d10/d1f/d21/d5e/f3d [0,4194304] 0 2024-02-28T23:07:46.149 INFO:tasks.workunit.client.1.smithi184.stdout:4/854: truncate d1/dc/df/d5b/fa6 611063 0 2024-02-28T23:07:46.151 INFO:tasks.workunit.client.0.smithi159.stdout:7/968: read d5/d16/d40/dce/fe9 [2187968,54778] 0 2024-02-28T23:07:46.152 INFO:tasks.workunit.client.1.smithi184.stdout:9/844: read d5/d17/d43/db8/ff0 [2564603,75975] 0 2024-02-28T23:07:46.155 INFO:tasks.workunit.client.1.smithi184.stdout:7/823: mkdir d6/d9/d13/d3e/dad/d49/d9c/d101/d11e 0 2024-02-28T23:07:46.158 INFO:tasks.workunit.client.1.smithi184.stdout:7/824: chown d6/d68/c116 13539466 1 2024-02-28T23:07:46.158 INFO:tasks.workunit.client.1.smithi184.stdout:1/900: dwrite d20/d32/d3e/d82/f122 [0,4194304] 0 2024-02-28T23:07:46.158 INFO:tasks.workunit.client.1.smithi184.stdout:6/789: unlink dc/de/db6/ccf 0 2024-02-28T23:07:46.162 INFO:tasks.workunit.client.1.smithi184.stdout:1/901: dread - d20/d46/d90/db3/f11f zero size 2024-02-28T23:07:46.165 INFO:tasks.workunit.client.1.smithi184.stdout:0/881: rename d0/d1f/f9a to d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/dac/f130 0 2024-02-28T23:07:46.171 INFO:tasks.workunit.client.1.smithi184.stdout:4/855: truncate d1/dc/df/d38/d57/dd6/ddd/dfe/f9c 1573852 0 2024-02-28T23:07:46.173 INFO:tasks.workunit.client.1.smithi184.stdout:0/882: stat d0/d1d/d3a/da9/d11b/d27/c34 0 2024-02-28T23:07:46.173 INFO:tasks.workunit.client.1.smithi184.stdout:3/889: dwrite d1/d4/d1c/d62/d66/dd3/f60 [4194304,4194304] 0 2024-02-28T23:07:46.173 INFO:tasks.workunit.client.1.smithi184.stdout:9/845: mkdir d5/db/de/d112 0 2024-02-28T23:07:46.178 INFO:tasks.workunit.client.1.smithi184.stdout:2/810: dwrite d10/d1f/d21/d5e/d15/d60/d6f/f103 [0,4194304] 0 2024-02-28T23:07:46.180 INFO:tasks.workunit.client.1.smithi184.stdout:1/902: mkdir d20/d32/d3e/d61/d8b/d101/d134 0 2024-02-28T23:07:46.181 INFO:tasks.workunit.client.1.smithi184.stdout:6/790: dread dc/de/d2a/d8e/dad/d8a/fcd [0,4194304] 0 2024-02-28T23:07:46.182 INFO:tasks.workunit.client.1.smithi184.stdout:9/846: symlink d5/db/de/de1/l113 0 2024-02-28T23:07:46.192 INFO:tasks.workunit.client.1.smithi184.stdout:3/890: mkdir d1/d4/d5/da9/d6e/d117 0 2024-02-28T23:07:46.196 INFO:tasks.workunit.client.1.smithi184.stdout:0/883: dwrite d0/d1d/d3a/de5/f124 [0,4194304] 0 2024-02-28T23:07:46.199 INFO:tasks.workunit.client.1.smithi184.stdout:4/856: truncate d1/dc/df/d38/d57/dd6/ddd/dfe/fab 872371 0 2024-02-28T23:07:46.201 INFO:tasks.workunit.client.1.smithi184.stdout:5/860: truncate db/d44/f4c 2250008 0 2024-02-28T23:07:46.202 INFO:tasks.workunit.client.1.smithi184.stdout:1/903: fdatasync d20/d32/f44 0 2024-02-28T23:07:46.205 INFO:tasks.workunit.client.1.smithi184.stdout:5/861: dread db/f7b [0,4194304] 0 2024-02-28T23:07:46.207 INFO:tasks.workunit.client.1.smithi184.stdout:6/791: dread f8 [0,4194304] 0 2024-02-28T23:07:46.209 INFO:tasks.workunit.client.1.smithi184.stdout:9/847: creat d5/d17/d43/f114 x:0 0 0 2024-02-28T23:07:46.212 INFO:tasks.workunit.client.1.smithi184.stdout:9/848: dread d5/d26/d50/fb6 [0,4194304] 0 2024-02-28T23:07:46.217 INFO:tasks.workunit.client.1.smithi184.stdout:0/884: write d0/d1d/d3a/da9/d11b/d27/d31/f8f [3468122,83230] 0 2024-02-28T23:07:46.223 INFO:tasks.workunit.client.1.smithi184.stdout:8/875: dwrite d1/da/dc/d16/d32/fa7 [0,4194304] 0 2024-02-28T23:07:46.224 INFO:tasks.workunit.client.1.smithi184.stdout:5/862: readlink db/d12/d1c/d21/d4d/d10e/d5d/d66/lab 0 2024-02-28T23:07:46.227 INFO:tasks.workunit.client.1.smithi184.stdout:5/863: truncate db/d12/d1c/d21/d4d/fbc 1221827 0 2024-02-28T23:07:46.236 INFO:tasks.workunit.client.1.smithi184.stdout:7/825: sync 2024-02-28T23:07:46.239 INFO:tasks.workunit.client.1.smithi184.stdout:7/826: dread - d6/d9/d13/d3e/dad/d49/d50/df8/d33/f11b zero size 2024-02-28T23:07:46.243 INFO:tasks.workunit.client.1.smithi184.stdout:9/849: dread d5/db/de/d10/d12/d2f/d3f/d8d/fa9 [0,4194304] 0 2024-02-28T23:07:46.244 INFO:tasks.workunit.client.1.smithi184.stdout:0/885: fsync d0/d1d/d4c/fda 0 2024-02-28T23:07:46.246 INFO:tasks.workunit.client.1.smithi184.stdout:1/904: mknod d20/d32/d3e/d61/d8b/d9c/db8/dd0/c135 0 2024-02-28T23:07:46.253 INFO:tasks.workunit.client.0.smithi159.stdout:7/969: creat d5/d56/d50/d88/f13a x:0 0 0 2024-02-28T23:07:46.255 INFO:tasks.workunit.client.1.smithi184.stdout:2/811: getdents d10/d1f/d21/d5e/dad/da3 0 2024-02-28T23:07:46.256 INFO:tasks.workunit.client.1.smithi184.stdout:3/891: dwrite d1/d4/d6/d83/fba [0,4194304] 0 2024-02-28T23:07:46.257 INFO:tasks.workunit.client.1.smithi184.stdout:4/857: creat d1/d8/d19/d92/f10b x:0 0 0 2024-02-28T23:07:46.259 INFO:tasks.workunit.client.0.smithi159.stdout:7/970: symlink d5/d16/d1a/d27/d46/d101/d64/db4/d10e/d111/d12c/l13b 0 2024-02-28T23:07:46.261 INFO:tasks.workunit.client.1.smithi184.stdout:9/850: fdatasync d5/d17/d43/f5b 0 2024-02-28T23:07:46.264 INFO:tasks.workunit.client.1.smithi184.stdout:1/905: creat d20/d32/db0/f136 x:0 0 0 2024-02-28T23:07:46.266 INFO:tasks.workunit.client.0.smithi159.stdout:7/971: unlink d5/d16/d1a/d27/d46/ce6 0 2024-02-28T23:07:46.268 INFO:tasks.workunit.client.1.smithi184.stdout:5/864: mkdir db/d12/d50/d111 0 2024-02-28T23:07:46.269 INFO:tasks.workunit.client.1.smithi184.stdout:2/812: mkdir d10/d1f/d21/d4d/d107 0 2024-02-28T23:07:46.269 INFO:tasks.workunit.client.1.smithi184.stdout:0/886: dread d0/d1d/d3a/da9/d11b/d27/d31/d51/f8d [0,4194304] 0 2024-02-28T23:07:46.270 INFO:tasks.workunit.client.1.smithi184.stdout:3/892: mknod d1/d4/d5/da9/c118 0 2024-02-28T23:07:46.271 INFO:tasks.workunit.client.0.smithi159.stdout:7/972: creat d5/d16/d1a/d27/d46/d65/f13c x:0 0 0 2024-02-28T23:07:46.271 INFO:tasks.workunit.client.1.smithi184.stdout:3/893: chown d1/d4/fb 4029686 1 2024-02-28T23:07:46.274 INFO:tasks.workunit.client.1.smithi184.stdout:4/858: rename d1/d4/d43/d73/l69 to d1/dc/df/d5b/db2/d9f/da0/l10c 0 2024-02-28T23:07:46.276 INFO:tasks.workunit.client.0.smithi159.stdout:7/973: mknod d5/d16/d1a/d27/dff/c13d 0 2024-02-28T23:07:46.276 INFO:tasks.workunit.client.1.smithi184.stdout:4/859: dread - d1/d8/d19/d56/fea zero size 2024-02-28T23:07:46.279 INFO:tasks.workunit.client.1.smithi184.stdout:5/865: symlink db/d12/d1c/d21/d25/dd3/df1/l112 0 2024-02-28T23:07:46.283 INFO:tasks.workunit.client.1.smithi184.stdout:6/792: truncate dc/de/d2a/d5c/f95 234593 0 2024-02-28T23:07:46.283 INFO:tasks.workunit.client.1.smithi184.stdout:0/887: creat d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/dac/f131 x:0 0 0 2024-02-28T23:07:46.287 INFO:tasks.workunit.client.1.smithi184.stdout:9/851: rename d5/d17/f3c to d5/db/de/d10/d6a/f115 0 2024-02-28T23:07:46.288 INFO:tasks.workunit.client.1.smithi184.stdout:8/876: sync 2024-02-28T23:07:46.293 INFO:tasks.workunit.client.1.smithi184.stdout:6/793: truncate dc/de/d2a/f35 476866 0 2024-02-28T23:07:46.294 INFO:tasks.workunit.client.1.smithi184.stdout:1/906: rename f19 to d20/d46/d90/dff/f137 0 2024-02-28T23:07:46.295 INFO:tasks.workunit.client.1.smithi184.stdout:2/813: dread d10/d1f/d38/d54/f8e [0,4194304] 0 2024-02-28T23:07:46.300 INFO:tasks.workunit.client.1.smithi184.stdout:0/888: truncate d0/d1f/de3/fc9 879932 0 2024-02-28T23:07:46.301 INFO:tasks.workunit.client.1.smithi184.stdout:7/827: truncate d6/d9/d13/d3e/dad/d49/d50/df8/f38 2652495 0 2024-02-28T23:07:46.302 INFO:tasks.workunit.client.1.smithi184.stdout:8/877: rename d1/da/d10/d17/ff1 to d1/da/dc/d16/d4d/d82/f137 0 2024-02-28T23:07:46.310 INFO:tasks.workunit.client.1.smithi184.stdout:2/814: symlink d10/d1f/d21/d6a/dc2/l108 0 2024-02-28T23:07:46.310 INFO:tasks.workunit.client.1.smithi184.stdout:0/889: truncate d0/d1f/f43 881493 0 2024-02-28T23:07:46.313 INFO:tasks.workunit.client.1.smithi184.stdout:8/878: creat d1/da/dc/d16/dbd/f138 x:0 0 0 2024-02-28T23:07:46.315 INFO:tasks.workunit.client.1.smithi184.stdout:7/828: mknod d6/d9/d13/d3e/dad/d49/d9c/d101/d11e/c11f 0 2024-02-28T23:07:46.315 INFO:tasks.workunit.client.1.smithi184.stdout:8/879: chown d1/da/d10/d17/d63/f68 105188240 1 2024-02-28T23:07:46.318 INFO:tasks.workunit.client.1.smithi184.stdout:2/815: creat d10/d1f/d21/d6a/f109 x:0 0 0 2024-02-28T23:07:46.318 INFO:tasks.workunit.client.1.smithi184.stdout:3/894: truncate d1/d4/d1c/d62/d66/dd3/f2b 633400 0 2024-02-28T23:07:46.319 INFO:tasks.workunit.client.1.smithi184.stdout:9/852: getdents d5/d73 0 2024-02-28T23:07:46.320 INFO:tasks.workunit.client.0.smithi159.stdout:7/974: dwrite d5/d16/d1a/f3c [0,4194304] 0 2024-02-28T23:07:46.323 INFO:tasks.workunit.client.1.smithi184.stdout:2/816: write d10/d1f/d21/d5e/d15/d60/d66/dc6/f9d [177710,189] 0 2024-02-28T23:07:46.324 INFO:tasks.workunit.client.1.smithi184.stdout:7/829: truncate d6/f16 4744329 0 2024-02-28T23:07:46.327 INFO:tasks.workunit.client.1.smithi184.stdout:2/817: write d10/d1f/d21/d5e/d15/d60/faf [188728,9183] 0 2024-02-28T23:07:46.328 INFO:tasks.workunit.client.1.smithi184.stdout:1/907: write d20/d32/d3e/f63 [3663582,111382] 0 2024-02-28T23:07:46.335 INFO:tasks.workunit.client.1.smithi184.stdout:4/860: dwrite d1/dc/df/d38/d57/dd6/ddd/fe7 [0,4194304] 0 2024-02-28T23:07:46.340 INFO:tasks.workunit.client.1.smithi184.stdout:3/895: dread d1/d4/d1c/d62/d66/dd3/d24/f88 [0,4194304] 0 2024-02-28T23:07:46.340 INFO:tasks.workunit.client.1.smithi184.stdout:9/853: rename d5/d17/d43/db8/l104 to d5/d26/d50/l116 0 2024-02-28T23:07:46.343 INFO:tasks.workunit.client.1.smithi184.stdout:8/880: creat d1/da/d10/d10d/f139 x:0 0 0 2024-02-28T23:07:46.345 INFO:tasks.workunit.client.1.smithi184.stdout:5/866: dwrite db/d12/d18/d2e/f89 [0,4194304] 0 2024-02-28T23:07:46.350 INFO:tasks.workunit.client.1.smithi184.stdout:0/890: dread d0/d1d/d3a/da9/d11b/f29 [0,4194304] 0 2024-02-28T23:07:46.352 INFO:tasks.workunit.client.1.smithi184.stdout:4/861: fdatasync d1/d8/d19/d56/d7a/faf 0 2024-02-28T23:07:46.355 INFO:tasks.workunit.client.1.smithi184.stdout:1/908: dwrite d20/d32/d3e/d82/d85/dfc/f119 [0,4194304] 0 2024-02-28T23:07:46.355 INFO:tasks.workunit.client.1.smithi184.stdout:5/867: readlink db/d12/d1c/d21/d4d/d10e/d5d/d66/lfd 0 2024-02-28T23:07:46.360 INFO:tasks.workunit.client.0.smithi159.stdout:7/975: truncate d5/d16/d1a/d27/d37/dcd/f105 5107641 0 2024-02-28T23:07:46.361 INFO:tasks.workunit.client.1.smithi184.stdout:4/862: truncate d1/dc/df/d38/d57/dd6/ddd/ff9 494792 0 2024-02-28T23:07:46.361 INFO:tasks.workunit.client.1.smithi184.stdout:3/896: mkdir d1/d4/d1c/d62/d66/dd3/d24/d76/d119 0 2024-02-28T23:07:46.363 INFO:tasks.workunit.client.1.smithi184.stdout:4/863: write d1/dc/df/d27/ff7 [434438,126139] 0 2024-02-28T23:07:46.363 INFO:tasks.workunit.client.1.smithi184.stdout:3/897: read d1/d4/d1c/d62/d66/dd3/d24/f88 [83142,27246] 0 2024-02-28T23:07:46.365 INFO:tasks.workunit.client.1.smithi184.stdout:9/854: symlink d5/db/de/d112/l117 0 2024-02-28T23:07:46.367 INFO:tasks.workunit.client.1.smithi184.stdout:0/891: mkdir d0/d11d/d108/d11c/d132 0 2024-02-28T23:07:46.369 INFO:tasks.workunit.client.1.smithi184.stdout:9/855: dread d5/d26/d50/f35 [0,4194304] 0 2024-02-28T23:07:46.370 INFO:tasks.workunit.client.1.smithi184.stdout:1/909: mkdir d20/d46/d90/db3/d138 0 2024-02-28T23:07:46.378 INFO:tasks.workunit.client.1.smithi184.stdout:4/864: readlink d1/d8/d35/dd9/lfb 0 2024-02-28T23:07:46.378 INFO:tasks.workunit.client.0.smithi159.stdout:7/976: dread d5/d56/d50/d88/fcc [0,4194304] 0 2024-02-28T23:07:46.381 INFO:tasks.workunit.client.1.smithi184.stdout:2/818: write d10/d1f/f93 [1962476,119888] 0 2024-02-28T23:07:46.382 INFO:tasks.workunit.client.0.smithi159.stdout:7/977: dread - d5/d16/d1a/d27/d46/d65/d81/d98/de5/f130 zero size 2024-02-28T23:07:46.383 INFO:tasks.workunit.client.1.smithi184.stdout:2/819: dread - d10/d1f/d21/d6a/fed zero size 2024-02-28T23:07:46.387 INFO:tasks.workunit.client.1.smithi184.stdout:9/856: rename d5/d47/d4a/f82 to d5/db/de/d10/d6a/f118 0 2024-02-28T23:07:46.388 INFO:tasks.workunit.client.1.smithi184.stdout:7/830: write d6/d9/d13/d1e/fbc [509343,94824] 0 2024-02-28T23:07:46.394 INFO:tasks.workunit.client.1.smithi184.stdout:8/881: write d1/da/d10/d17/fc0 [3327335,12091] 0 2024-02-28T23:07:46.396 INFO:tasks.workunit.client.1.smithi184.stdout:0/892: unlink d0/la0 0 2024-02-28T23:07:46.397 INFO:tasks.workunit.client.1.smithi184.stdout:8/882: write d1/da/d10/d43/d124/dac/dc5/f116 [157621,71293] 0 2024-02-28T23:07:46.400 INFO:tasks.workunit.client.1.smithi184.stdout:3/898: symlink d1/d4/d1c/d62/d66/dd3/d24/d76/d119/l11a 0 2024-02-28T23:07:46.406 INFO:tasks.workunit.client.1.smithi184.stdout:9/857: mknod d5/d47/d59/d92/c119 0 2024-02-28T23:07:46.407 INFO:tasks.workunit.client.1.smithi184.stdout:5/868: write db/d12/d50/f8d [1648190,79339] 0 2024-02-28T23:07:46.414 INFO:tasks.workunit.client.1.smithi184.stdout:3/899: fsync d1/d4/d6/d1e/d72/f50 0 2024-02-28T23:07:46.417 INFO:tasks.workunit.client.1.smithi184.stdout:6/794: sync 2024-02-28T23:07:46.419 INFO:tasks.workunit.client.1.smithi184.stdout:2/820: unlink d10/d1f/f41 0 2024-02-28T23:07:46.424 INFO:tasks.workunit.client.0.smithi159.stdout:7/978: dread d5/d16/d1a/d27/deb/f11 [0,4194304] 0 2024-02-28T23:07:46.425 INFO:tasks.workunit.client.1.smithi184.stdout:4/865: rename d1/dc/l20 to d1/dc/df/d5b/db2/d9f/l10d 0 2024-02-28T23:07:46.426 INFO:tasks.workunit.client.1.smithi184.stdout:3/900: dwrite d1/d4/fb [0,4194304] 0 2024-02-28T23:07:46.429 INFO:tasks.workunit.client.1.smithi184.stdout:7/831: creat d6/d9/d13/d3e/dad/d49/da6/dfd/f120 x:0 0 0 2024-02-28T23:07:46.430 INFO:tasks.workunit.client.1.smithi184.stdout:5/869: unlink db/fcd 0 2024-02-28T23:07:46.432 INFO:tasks.workunit.client.1.smithi184.stdout:1/910: write d20/d32/fd6 [4363618,17419] 0 2024-02-28T23:07:46.434 INFO:tasks.workunit.client.0.smithi159.stdout:7/979: creat d5/d16/d1a/d27/d37/dcd/f13e x:0 0 0 2024-02-28T23:07:46.442 INFO:tasks.workunit.client.1.smithi184.stdout:3/901: mkdir d1/d4/d5/da9/d11b 0 2024-02-28T23:07:46.442 INFO:tasks.workunit.client.1.smithi184.stdout:8/883: dwrite d1/da/d10/d43/d124/fe3 [0,4194304] 0 2024-02-28T23:07:46.443 INFO:tasks.workunit.client.1.smithi184.stdout:5/870: mknod db/d44/c113 0 2024-02-28T23:07:46.446 INFO:tasks.workunit.client.1.smithi184.stdout:2/821: mknod d10/d1f/d38/c10a 0 2024-02-28T23:07:46.450 INFO:tasks.workunit.client.1.smithi184.stdout:9/858: dwrite d5/d26/d50/fb6 [0,4194304] 0 2024-02-28T23:07:46.452 INFO:tasks.workunit.client.1.smithi184.stdout:0/893: rename d0/fa4 to d0/d1d/d3a/da9/d11b/d27/d31/f133 0 2024-02-28T23:07:46.455 INFO:tasks.workunit.client.1.smithi184.stdout:4/866: dread d1/d8/f9b [0,4194304] 0 2024-02-28T23:07:46.456 INFO:tasks.workunit.client.1.smithi184.stdout:8/884: symlink d1/da/dc/d16/d29/l13a 0 2024-02-28T23:07:46.461 INFO:tasks.workunit.client.1.smithi184.stdout:3/902: dread d1/d4/d1c/d62/d66/f6f [0,4194304] 0 2024-02-28T23:07:46.463 INFO:tasks.workunit.client.1.smithi184.stdout:0/894: creat d0/d1f/de3/f134 x:0 0 0 2024-02-28T23:07:46.468 INFO:tasks.workunit.client.1.smithi184.stdout:4/867: creat d1/dc/df/d38/d57/dd6/ddd/dfe/d49/f10e x:0 0 0 2024-02-28T23:07:46.468 INFO:tasks.workunit.client.1.smithi184.stdout:1/911: write d20/d32/d3e/f3f [2513300,111892] 0 2024-02-28T23:07:46.469 INFO:tasks.workunit.client.1.smithi184.stdout:3/903: mknod d1/d4/d1c/d62/d66/da6/c11c 0 2024-02-28T23:07:46.475 INFO:tasks.workunit.client.0.smithi159.stdout:7/980: dwrite d5/f9b [0,4194304] 0 2024-02-28T23:07:46.475 INFO:tasks.workunit.client.1.smithi184.stdout:9/859: dwrite d5/d17/d43/db8/fdc [0,4194304] 0 2024-02-28T23:07:46.476 INFO:tasks.workunit.client.1.smithi184.stdout:4/868: fsync d1/dc/f23 0 2024-02-28T23:07:46.480 INFO:tasks.workunit.client.1.smithi184.stdout:8/885: dwrite d1/da/dc/d16/d4d/f5a [0,4194304] 0 2024-02-28T23:07:46.483 INFO:tasks.workunit.client.1.smithi184.stdout:3/904: dread d1/fb5 [0,4194304] 0 2024-02-28T23:07:46.491 INFO:tasks.workunit.client.1.smithi184.stdout:1/912: symlink d20/d32/d3e/d82/d85/d120/l139 0 2024-02-28T23:07:46.492 INFO:tasks.workunit.client.1.smithi184.stdout:4/869: rmdir d1/dc/df/d38/d57/dd6 39 2024-02-28T23:07:46.492 INFO:tasks.workunit.client.1.smithi184.stdout:2/822: truncate d10/f14 2280742 0 2024-02-28T23:07:46.493 INFO:tasks.workunit.client.1.smithi184.stdout:0/895: link d0/d1d/d3a/da9/d11b/d27/d31/d5b/fb1 d0/d1d/d3a/da9/d129/f135 0 2024-02-28T23:07:46.494 INFO:tasks.workunit.client.1.smithi184.stdout:3/905: symlink d1/d4/d6/d83/l11d 0 2024-02-28T23:07:46.495 INFO:tasks.workunit.client.0.smithi159.stdout:7/981: unlink d5/d56/d50/f8c 0 2024-02-28T23:07:46.495 INFO:tasks.workunit.client.1.smithi184.stdout:2/823: chown d10/d1f/d21/d5e/dad/da3/dd6/dab/fbf 3822844 1 2024-02-28T23:07:46.497 INFO:tasks.workunit.client.1.smithi184.stdout:5/871: dread db/d12/d1c/d21/fb6 [0,4194304] 0 2024-02-28T23:07:46.499 INFO:tasks.workunit.client.0.smithi159.stdout:7/982: chown d5/d16/d1a/d27/d46/d65/d81/d83/d9d/fa1 4979 1 2024-02-28T23:07:46.500 INFO:tasks.workunit.client.0.smithi159.stdout:7/983: chown d5/d16 18656141 1 2024-02-28T23:07:46.502 INFO:tasks.workunit.client.1.smithi184.stdout:4/870: write d1/d8/d35/fc0 [4326435,125029] 0 2024-02-28T23:07:46.502 INFO:tasks.workunit.client.1.smithi184.stdout:1/913: stat d20/d32/d3e/d61/d8b/c121 0 2024-02-28T23:07:46.503 INFO:tasks.workunit.client.1.smithi184.stdout:9/860: creat d5/f11a x:0 0 0 2024-02-28T23:07:46.504 INFO:tasks.workunit.client.1.smithi184.stdout:3/906: symlink d1/d4/d5/da9/d6e/l11e 0 2024-02-28T23:07:46.506 INFO:tasks.workunit.client.0.smithi159.stdout:7/984: mkdir d5/d16/d1a/d27/d46/d65/d81/d98/d13f 0 2024-02-28T23:07:46.509 INFO:tasks.workunit.client.1.smithi184.stdout:1/914: creat d20/d32/d3e/d61/f13a x:0 0 0 2024-02-28T23:07:46.509 INFO:tasks.workunit.client.1.smithi184.stdout:3/907: write d1/d4/d6/ff7 [869241,60946] 0 2024-02-28T23:07:46.511 INFO:tasks.workunit.client.0.smithi159.stdout:7/985: symlink d5/d16/d1a/d27/d37/dcd/l140 0 2024-02-28T23:07:46.517 INFO:tasks.workunit.client.1.smithi184.stdout:0/896: dwrite d0/d1f/d109/d71/fc8 [0,4194304] 0 2024-02-28T23:07:46.517 INFO:tasks.workunit.client.1.smithi184.stdout:5/872: getdents db/d44/da5/ddf 0 2024-02-28T23:07:46.519 INFO:tasks.workunit.client.1.smithi184.stdout:8/886: dwrite d1/da/dc/d16/d4d/d82/fd1 [4194304,4194304] 0 2024-02-28T23:07:46.519 INFO:tasks.workunit.client.1.smithi184.stdout:3/908: mknod d1/d4/d1c/d62/d66/da6/df5/c11f 0 2024-02-28T23:07:46.520 INFO:tasks.workunit.client.1.smithi184.stdout:5/873: read - db/d12/d18/d2e/ffa zero size 2024-02-28T23:07:46.525 INFO:tasks.workunit.client.1.smithi184.stdout:0/897: mkdir d0/d1d/d3a/da9/df5/d136 0 2024-02-28T23:07:46.534 INFO:tasks.workunit.client.1.smithi184.stdout:5/874: symlink db/d12/d1c/d21/d4d/d10e/l114 0 2024-02-28T23:07:46.538 INFO:tasks.workunit.client.1.smithi184.stdout:4/871: write d1/d8/d19/d67/d99/f72 [1617880,82764] 0 2024-02-28T23:07:46.543 INFO:tasks.workunit.client.1.smithi184.stdout:3/909: rename d1/d4/d5/d40/d8f to d1/d4/d1c/d61/d120 0 2024-02-28T23:07:46.547 INFO:tasks.workunit.client.1.smithi184.stdout:8/887: write d1/da/dc/d16/f107 [300462,55775] 0 2024-02-28T23:07:46.547 INFO:tasks.workunit.client.0.smithi159.stdout:7/986: write d5/d16/d1a/d27/d46/d101/ffd [1008001,63238] 0 2024-02-28T23:07:46.547 INFO:tasks.workunit.client.1.smithi184.stdout:1/915: write d20/d46/d90/f92 [1748841,55832] 0 2024-02-28T23:07:46.548 INFO:tasks.workunit.client.1.smithi184.stdout:0/898: dwrite d0/f100 [0,4194304] 0 2024-02-28T23:07:46.549 INFO:tasks.workunit.client.1.smithi184.stdout:2/824: dwrite d10/d33/f9b [0,4194304] 0 2024-02-28T23:07:46.550 INFO:tasks.workunit.client.1.smithi184.stdout:4/872: dread - d1/dc/df/d27/fae zero size 2024-02-28T23:07:46.551 INFO:tasks.workunit.client.1.smithi184.stdout:3/910: rename d1/d4/d5/f9c to d1/f121 0 2024-02-28T23:07:46.554 INFO:tasks.workunit.client.0.smithi159.stdout:7/987: unlink d5/d16/d1a/d27/deb/d60/c72 0 2024-02-28T23:07:46.557 INFO:tasks.workunit.client.0.smithi159.stdout:7/988: chown d5/d16/d1a/d27/d46/f8d 0 1 2024-02-28T23:07:46.557 INFO:tasks.workunit.client.1.smithi184.stdout:5/875: dread db/f7f [0,4194304] 0 2024-02-28T23:07:46.559 INFO:tasks.workunit.client.0.smithi159.stdout:7/989: stat d5/d16/d1a/d27/d46/d65/d81/d98/de5/ff6 0 2024-02-28T23:07:46.562 INFO:tasks.workunit.client.1.smithi184.stdout:6/795: sync 2024-02-28T23:07:46.565 INFO:tasks.workunit.client.1.smithi184.stdout:2/825: mknod d10/d55/d89/c10b 0 2024-02-28T23:07:46.565 INFO:tasks.workunit.client.1.smithi184.stdout:9/861: dwrite d5/db/de/d10/d6a/f118 [0,4194304] 0 2024-02-28T23:07:46.568 INFO:tasks.workunit.client.1.smithi184.stdout:4/873: dread d1/dc/df/d5b/d6c/f9d [0,4194304] 0 2024-02-28T23:07:46.573 INFO:tasks.workunit.client.1.smithi184.stdout:8/888: mkdir d1/da/d10/d43/da1/de0/d13b 0 2024-02-28T23:07:46.575 INFO:tasks.workunit.client.1.smithi184.stdout:2/826: mkdir d10/d1f/d21/d5e/d15/d24/d5f/d10c 0 2024-02-28T23:07:46.577 INFO:tasks.workunit.client.1.smithi184.stdout:7/832: sync 2024-02-28T23:07:46.577 INFO:tasks.workunit.client.1.smithi184.stdout:7/833: fsync d6/f67 0 2024-02-28T23:07:46.579 INFO:tasks.workunit.client.0.smithi159.stdout:7/990: getdents d5/d16/d1a/d27/d46/d101/d64/db4/dc8/d102 0 2024-02-28T23:07:46.579 INFO:tasks.workunit.client.1.smithi184.stdout:7/834: chown d6/d9/d13/d3e/dad/d49/da6/dfd/f120 7764267 1 2024-02-28T23:07:46.585 INFO:tasks.workunit.client.0.smithi159.stdout:7/991: unlink d5/d16/d1a/d27/deb/f10f 0 2024-02-28T23:07:46.591 INFO:tasks.workunit.client.1.smithi184.stdout:1/916: dwrite d20/f3a [4194304,4194304] 0 2024-02-28T23:07:46.595 INFO:tasks.workunit.client.1.smithi184.stdout:7/835: write d6/d68/fd6 [15641,90105] 0 2024-02-28T23:07:46.595 INFO:tasks.workunit.client.1.smithi184.stdout:0/899: dwrite d0/d11d/fd6 [0,4194304] 0 2024-02-28T23:07:46.599 INFO:tasks.workunit.client.1.smithi184.stdout:7/836: stat d6/d9/d13/l54 0 2024-02-28T23:07:46.601 INFO:tasks.workunit.client.1.smithi184.stdout:3/911: readlink d1/d4/d5/lac 0 2024-02-28T23:07:46.602 INFO:tasks.workunit.client.1.smithi184.stdout:2/827: creat d10/d1f/d38/d54/f10d x:0 0 0 2024-02-28T23:07:46.604 INFO:tasks.workunit.client.1.smithi184.stdout:4/874: getdents d1/d8/d19/d56 0 2024-02-28T23:07:46.604 INFO:tasks.workunit.client.1.smithi184.stdout:9/862: link d5/d47/d59/d92/fb4 d5/db/de/de1/f11b 0 2024-02-28T23:07:46.605 INFO:tasks.workunit.client.1.smithi184.stdout:5/876: dwrite db/d12/d1c/d21/d2f/f71 [0,4194304] 0 2024-02-28T23:07:46.606 INFO:tasks.workunit.client.1.smithi184.stdout:2/828: readlink d10/d1f/d21/l61 0 2024-02-28T23:07:46.609 INFO:tasks.workunit.client.1.smithi184.stdout:6/796: dread dc/de/d10/d16/f37 [0,4194304] 0 2024-02-28T23:07:46.609 INFO:tasks.workunit.client.1.smithi184.stdout:5/877: fdatasync db/d12/f85 0 2024-02-28T23:07:46.610 INFO:tasks.workunit.client.1.smithi184.stdout:8/889: rename d1/da/dc/d16/c4c to d1/da/d10/c13c 0 2024-02-28T23:07:46.614 INFO:tasks.workunit.client.1.smithi184.stdout:9/863: truncate d5/d47/fda 1025272 0 2024-02-28T23:07:46.615 INFO:tasks.workunit.client.1.smithi184.stdout:3/912: creat d1/d4/d1c/d62/d66/da6/f122 x:0 0 0 2024-02-28T23:07:46.616 INFO:tasks.workunit.client.1.smithi184.stdout:1/917: dread d20/d32/d3e/f9d [0,4194304] 0 2024-02-28T23:07:46.618 INFO:tasks.workunit.client.1.smithi184.stdout:0/900: getdents d0/d1d 0 2024-02-28T23:07:46.618 INFO:tasks.workunit.client.1.smithi184.stdout:3/913: readlink d1/d4/d5/da9/d6e/l7b 0 2024-02-28T23:07:46.619 INFO:tasks.workunit.client.1.smithi184.stdout:2/829: symlink d10/d1f/d21/d4d/d67/l10e 0 2024-02-28T23:07:46.619 INFO:tasks.workunit.client.0.smithi159.stdout:7/992: write d5/d16/f5f [1375504,114695] 0 2024-02-28T23:07:46.621 INFO:tasks.workunit.client.1.smithi184.stdout:4/875: read d1/dc/df/d38/d57/dd6/ddd/dfe/f4c [3462125,47029] 0 2024-02-28T23:07:46.622 INFO:tasks.workunit.client.1.smithi184.stdout:5/878: fdatasync db/d12/d1c/d21/fbf 0 2024-02-28T23:07:46.622 INFO:tasks.workunit.client.0.smithi159.stdout:7/993: chown d5/d56/d50/d88/df5/c115 1338259 1 2024-02-28T23:07:46.628 INFO:tasks.workunit.client.1.smithi184.stdout:5/879: chown db/d12/d50/f8d 5947 1 2024-02-28T23:07:46.628 INFO:tasks.workunit.client.1.smithi184.stdout:9/864: creat d5/db/de/d112/f11c x:0 0 0 2024-02-28T23:07:46.628 INFO:tasks.workunit.client.1.smithi184.stdout:1/918: symlink d20/d32/d3e/d61/d8b/d9c/db8/l13b 0 2024-02-28T23:07:46.628 INFO:tasks.workunit.client.0.smithi159.stdout:7/994: truncate d5/d16/f5f 3362252 0 2024-02-28T23:07:46.630 INFO:tasks.workunit.client.1.smithi184.stdout:3/914: symlink d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/ddc/l123 0 2024-02-28T23:07:46.631 INFO:tasks.workunit.client.1.smithi184.stdout:7/837: link d6/d9/f103 d6/d9/d13/d3e/dad/d7d/f121 0 2024-02-28T23:07:46.634 INFO:tasks.workunit.client.1.smithi184.stdout:7/838: stat d6/d9/d13/d3e/dad/d7d/d8d/ca4 0 2024-02-28T23:07:46.635 INFO:tasks.workunit.client.1.smithi184.stdout:4/876: unlink d1/dc/df/d38/d57/dd6/ddd/fe7 0 2024-02-28T23:07:46.635 INFO:tasks.workunit.client.1.smithi184.stdout:0/901: mkdir d0/d11d/d108/d11c/d132/d137 0 2024-02-28T23:07:46.639 INFO:tasks.workunit.client.1.smithi184.stdout:3/915: chown d1/d4/d6/cd 104614 1 2024-02-28T23:07:46.639 INFO:tasks.workunit.client.1.smithi184.stdout:0/902: truncate d0/d7c/fec 79031 0 2024-02-28T23:07:46.639 INFO:tasks.workunit.client.1.smithi184.stdout:6/797: creat dc/de/d2a/d5c/ffd x:0 0 0 2024-02-28T23:07:46.640 INFO:tasks.workunit.client.0.smithi159.stdout:7/995: dread d5/d16/d1a/d27/d46/d101/f77 [0,4194304] 0 2024-02-28T23:07:46.641 INFO:tasks.workunit.client.1.smithi184.stdout:4/877: rename d1/d8/d19/d56/d7a/ld3 to d1/dc/df/d5b/d97/l10f 0 2024-02-28T23:07:46.642 INFO:tasks.workunit.client.1.smithi184.stdout:2/830: creat d10/d1f/d38/d54/f10f x:0 0 0 2024-02-28T23:07:46.643 INFO:tasks.workunit.client.1.smithi184.stdout:5/880: truncate db/d12/d18/d2e/f79 2442758 0 2024-02-28T23:07:46.647 INFO:tasks.workunit.client.1.smithi184.stdout:6/798: unlink dc/de/d2a/d5c/d79/d87/d9a/fc7 0 2024-02-28T23:07:46.647 INFO:tasks.workunit.client.1.smithi184.stdout:8/890: dwrite d1/da/d10/fca [0,4194304] 0 2024-02-28T23:07:46.651 INFO:tasks.workunit.client.1.smithi184.stdout:3/916: rename d1/d4/d1c/d62/d66/da6/f122 to d1/d4/d5/da9/d74/dcd/f124 0 2024-02-28T23:07:46.652 INFO:tasks.workunit.client.1.smithi184.stdout:1/919: getdents d20/d32/d3e/dc9 0 2024-02-28T23:07:46.653 INFO:tasks.workunit.client.1.smithi184.stdout:0/903: fdatasync d0/d1f/de3/fc9 0 2024-02-28T23:07:46.660 INFO:tasks.workunit.client.1.smithi184.stdout:6/799: dread dc/de/d10/f38 [0,4194304] 0 2024-02-28T23:07:46.663 INFO:tasks.workunit.client.0.smithi159.stdout:7/996: write d5/d16/d1a/d27/d46/fd8 [587508,77060] 0 2024-02-28T23:07:46.667 INFO:tasks.workunit.client.1.smithi184.stdout:6/800: mkdir dc/de/d2a/d5c/d79/da2/dfe 0 2024-02-28T23:07:46.668 INFO:tasks.workunit.client.1.smithi184.stdout:0/904: truncate d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/ff2 426550 0 2024-02-28T23:07:46.675 INFO:tasks.workunit.client.0.smithi159.stdout:7/997: creat d5/d56/f141 x:0 0 0 2024-02-28T23:07:46.676 INFO:tasks.workunit.client.1.smithi184.stdout:6/801: getdents dc/d60/d62/d6f/d99 0 2024-02-28T23:07:46.679 INFO:tasks.workunit.client.0.smithi159.stdout:7/998: creat d5/d16/d40/dce/d131/f142 x:0 0 0 2024-02-28T23:07:46.679 INFO:tasks.workunit.client.1.smithi184.stdout:7/839: dwrite d6/f16 [0,4194304] 0 2024-02-28T23:07:46.683 INFO:tasks.workunit.client.1.smithi184.stdout:0/905: creat d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/d106/f138 x:0 0 0 2024-02-28T23:07:46.684 INFO:tasks.workunit.client.1.smithi184.stdout:7/840: chown d6/d9/da/f37 354 1 2024-02-28T23:07:46.684 INFO:tasks.workunit.client.1.smithi184.stdout:8/891: dread d1/da/d10/f8d [0,4194304] 0 2024-02-28T23:07:46.686 INFO:tasks.workunit.client.1.smithi184.stdout:4/878: dwrite d1/d4/d43/d73/f91 [0,4194304] 0 2024-02-28T23:07:46.686 INFO:tasks.workunit.client.1.smithi184.stdout:1/920: dwrite d20/d32/d3e/d82/d85/fa6 [0,4194304] 0 2024-02-28T23:07:46.687 INFO:tasks.workunit.client.0.smithi159.stdout:7/999: getdents d5/d16/d1a/d27/d46/d65/d81/d98/de5 0 2024-02-28T23:07:46.688 INFO:tasks.workunit.client.1.smithi184.stdout:0/906: dread - d0/fb8 zero size 2024-02-28T23:07:46.688 INFO:tasks.workunit.client.1.smithi184.stdout:2/831: dread d10/d1f/d21/d5e/dad/da3/dd6/faa [0,4194304] 0 2024-02-28T23:07:46.693 INFO:tasks.workunit.client.1.smithi184.stdout:3/917: dread d1/d4/d1c/d62/d66/dd3/f2c [0,4194304] 0 2024-02-28T23:07:46.694 INFO:tasks.workunit.client.1.smithi184.stdout:6/802: write dc/de/d10/f9b [3744103,110209] 0 2024-02-28T23:07:46.696 INFO:tasks.workunit.client.1.smithi184.stdout:3/918: chown d1/d4/d1c 305 1 2024-02-28T23:07:46.699 INFO:tasks.workunit.client.0.smithi159.stderr:+ rm -rf -- ./tmp.YW5rI8OtDN 2024-02-28T23:07:46.700 INFO:tasks.workunit.client.1.smithi184.stdout:7/841: rmdir d6/d9/d13/d3e/dad/d49/d50/df8/d33 39 2024-02-28T23:07:46.708 INFO:tasks.workunit.client.1.smithi184.stdout:8/892: dread d1/da/dc/f73 [0,4194304] 0 2024-02-28T23:07:46.717 INFO:tasks.workunit.client.1.smithi184.stdout:6/803: dwrite dc/de/d2a/d5c/d79/da2/fe1 [0,4194304] 0 2024-02-28T23:07:46.718 INFO:tasks.workunit.client.1.smithi184.stdout:9/865: sync 2024-02-28T23:07:46.750 INFO:tasks.workunit.client.1.smithi184.stdout:5/881: sync 2024-02-28T23:07:46.751 INFO:tasks.workunit.client.1.smithi184.stdout:5/882: fdatasync db/d12/d50/d9e/f104 0 2024-02-28T23:07:46.766 INFO:tasks.workunit.client.1.smithi184.stdout:5/883: dread db/d12/d18/d2e/f36 [0,4194304] 0 2024-02-28T23:07:46.778 INFO:tasks.workunit.client.1.smithi184.stdout:5/884: dwrite db/d12/d1c/d21/d4d/f93 [0,4194304] 0 2024-02-28T23:07:46.821 INFO:tasks.workunit.client.1.smithi184.stdout:2/832: chown d10/d1f/d38/d54/f83 14597 1 2024-02-28T23:07:46.823 INFO:tasks.workunit.client.1.smithi184.stdout:4/879: chown d1/dc/df/d38/d57/dd6/ddd/dfe/f9c 2807 1 2024-02-28T23:07:46.824 INFO:tasks.workunit.client.1.smithi184.stdout:3/919: mkdir d1/d4/d1c/d62/d66/dd3/d26/dd2/d125 0 2024-02-28T23:07:46.824 INFO:tasks.workunit.client.1.smithi184.stdout:4/880: readlink d1/d8/d19/l54 0 2024-02-28T23:07:46.828 INFO:tasks.workunit.client.1.smithi184.stdout:7/842: creat d6/d9/d13/d3e/dad/d7d/d6c/df7/f122 x:0 0 0 2024-02-28T23:07:46.844 INFO:tasks.workunit.client.1.smithi184.stdout:3/920: chown d1/d4/d6/d83/c93 9 1 2024-02-28T23:07:46.850 INFO:tasks.workunit.client.1.smithi184.stdout:4/881: symlink d1/d8/d3d/l110 0 2024-02-28T23:07:46.850 INFO:tasks.workunit.client.1.smithi184.stdout:8/893: mkdir d1/da/d10/d17/d125/d13d 0 2024-02-28T23:07:46.852 INFO:tasks.workunit.client.1.smithi184.stdout:4/882: chown d1/dc/df/l62 428767682 1 2024-02-28T23:07:46.924 INFO:tasks.workunit.client.1.smithi184.stdout:3/921: mkdir d1/d4/d1c/d62/d66/dd3/d24/d126 0 2024-02-28T23:07:46.930 INFO:tasks.workunit.client.1.smithi184.stdout:3/922: write d1/d4/d5/da9/d74/ff1 [484971,64018] 0 2024-02-28T23:07:46.932 INFO:tasks.workunit.client.1.smithi184.stdout:7/843: truncate d6/d9/d13/d3e/dad/fa1 661871 0 2024-02-28T23:07:46.938 INFO:tasks.workunit.client.1.smithi184.stdout:5/885: mknod db/d12/d18/db5/dfc/c115 0 2024-02-28T23:07:46.939 INFO:tasks.workunit.client.1.smithi184.stdout:8/894: mknod d1/c13e 0 2024-02-28T23:07:46.946 INFO:tasks.workunit.client.1.smithi184.stdout:5/886: truncate db/d12/d1c/d21/d2f/f4e 4448361 0 2024-02-28T23:07:46.946 INFO:tasks.workunit.client.1.smithi184.stdout:9/866: getdents d5/d47/d68/d7c/df4 0 2024-02-28T23:07:46.950 INFO:tasks.workunit.client.1.smithi184.stdout:3/923: creat d1/d4/d5/da9/d115/f127 x:0 0 0 2024-02-28T23:07:46.954 INFO:tasks.workunit.client.1.smithi184.stdout:7/844: mkdir d6/d9/d13/d3e/dad/d49/d50/df8/d33/d123 0 2024-02-28T23:07:46.956 INFO:tasks.workunit.client.1.smithi184.stdout:9/867: creat d5/d47/d59/d92/f11d x:0 0 0 2024-02-28T23:07:46.959 INFO:tasks.workunit.client.1.smithi184.stdout:5/887: stat db/d12/d18/d2e/f79 0 2024-02-28T23:07:46.962 INFO:tasks.workunit.client.1.smithi184.stdout:8/895: link d1/da/d10/d17/d63/dbe/lda d1/da/dc/d16/d4d/l13f 0 2024-02-28T23:07:46.964 INFO:tasks.workunit.client.1.smithi184.stdout:9/868: truncate d5/db/de/d10/f30 1213472 0 2024-02-28T23:07:46.966 INFO:tasks.workunit.client.1.smithi184.stdout:8/896: write d1/da/dc/d16/d32/d42/d77/f85 [1122747,20110] 0 2024-02-28T23:07:46.971 INFO:tasks.workunit.client.1.smithi184.stdout:9/869: readlink d5/d17/d8f/la4 0 2024-02-28T23:07:46.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:46 smithi159 ceph-mon[28802]: pgmap v42: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 77 MiB/s rd, 184 MiB/s wr, 402 op/s 2024-02-28T23:07:46.976 INFO:tasks.workunit.client.1.smithi184.stdout:3/924: dread d1/d4/f89 [0,4194304] 0 2024-02-28T23:07:46.978 INFO:tasks.workunit.client.1.smithi184.stdout:3/925: fdatasync d1/d4/d5/da9/d74/ff1 0 2024-02-28T23:07:46.980 INFO:tasks.workunit.client.1.smithi184.stdout:0/907: rename d0/df/c46 to d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/da3/c139 0 2024-02-28T23:07:46.981 INFO:tasks.workunit.client.1.smithi184.stdout:3/926: chown d1/d4/d1c/d62/d66/dd3/d24/d10e 10 1 2024-02-28T23:07:46.983 INFO:tasks.workunit.client.1.smithi184.stdout:9/870: creat d5/db/de/d10/d12/d2f/d3f/f11e x:0 0 0 2024-02-28T23:07:46.986 INFO:tasks.workunit.client.1.smithi184.stdout:0/908: write d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/d106/f138 [7932,99633] 0 2024-02-28T23:07:46.987 INFO:tasks.workunit.client.1.smithi184.stdout:3/927: read d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/ff3 [311403,60415] 0 2024-02-28T23:07:46.989 INFO:tasks.workunit.client.1.smithi184.stdout:3/928: chown d1/d4/d5/da9 54 1 2024-02-28T23:07:46.989 INFO:tasks.workunit.client.1.smithi184.stdout:0/909: chown d0/d7c/fec 32833 1 2024-02-28T23:07:46.992 INFO:tasks.workunit.client.1.smithi184.stdout:3/929: chown d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/dc1/fc5 9234 1 2024-02-28T23:07:46.994 INFO:tasks.workunit.client.1.smithi184.stdout:3/930: chown d1/d4/d6/d83/fba 318 1 2024-02-28T23:07:47.011 INFO:tasks.workunit.client.1.smithi184.stdout:3/931: rmdir d1/d4/d1c/d61 39 2024-02-28T23:07:47.015 INFO:tasks.workunit.client.1.smithi184.stdout:3/932: chown d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d82/fc7 1389488 1 2024-02-28T23:07:47.021 INFO:tasks.workunit.client.1.smithi184.stdout:0/910: getdents d0/d1d/d3a/de5 0 2024-02-28T23:07:47.025 INFO:tasks.workunit.client.1.smithi184.stdout:3/933: unlink d1/d4/d1c/d62/d66/dd3/d26/d3a/ce2 0 2024-02-28T23:07:47.036 INFO:tasks.workunit.client.1.smithi184.stdout:0/911: symlink d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/l13a 0 2024-02-28T23:07:47.036 INFO:tasks.workunit.client.1.smithi184.stdout:2/833: mknod d10/d55/d89/c110 0 2024-02-28T23:07:47.049 INFO:tasks.workunit.client.1.smithi184.stdout:1/921: write d20/d32/d3e/f64 [988832,121606] 0 2024-02-28T23:07:47.052 INFO:tasks.workunit.client.1.smithi184.stdout:1/922: chown d20/d46/d90/da0/f126 2935653 1 2024-02-28T23:07:47.052 INFO:tasks.workunit.client.1.smithi184.stdout:2/834: dread d10/d1f/d21/d5e/d15/f1b [0,4194304] 0 2024-02-28T23:07:47.055 INFO:tasks.workunit.client.1.smithi184.stdout:1/923: chown d20/d32/d3e/d91/df2/f11d 917904 1 2024-02-28T23:07:47.081 INFO:tasks.workunit.client.1.smithi184.stdout:2/835: dwrite d10/d1f/d38/d54/f10f [0,4194304] 0 2024-02-28T23:07:47.083 INFO:tasks.workunit.client.1.smithi184.stdout:2/836: readlink d10/d1f/d21/d6a/lcb 0 2024-02-28T23:07:47.092 INFO:tasks.workunit.client.1.smithi184.stdout:2/837: truncate d10/d1f/d21/d5e/d15/d24/d5f/ff1 270521 0 2024-02-28T23:07:47.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:46 smithi184 ceph-mon[36198]: pgmap v42: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 77 MiB/s rd, 184 MiB/s wr, 402 op/s 2024-02-28T23:07:47.114 INFO:tasks.workunit.client.1.smithi184.stdout:4/883: write d1/d8/d35/dd9/fa4 [3158188,33227] 0 2024-02-28T23:07:47.115 INFO:tasks.workunit.client.1.smithi184.stdout:2/838: dwrite d10/d1f/fa8 [0,4194304] 0 2024-02-28T23:07:47.121 INFO:tasks.workunit.client.1.smithi184.stdout:4/884: mknod d1/dc/df/d38/d57/dd6/ddd/c111 0 2024-02-28T23:07:47.123 INFO:tasks.workunit.client.1.smithi184.stdout:2/839: mkdir d10/d1f/d21/d5e/d15/d24/d5f/d111 0 2024-02-28T23:07:47.135 INFO:tasks.workunit.client.1.smithi184.stdout:4/885: getdents d1/d4/d43/d73 0 2024-02-28T23:07:47.140 INFO:tasks.workunit.client.1.smithi184.stdout:2/840: dwrite d10/d1f/f93 [0,4194304] 0 2024-02-28T23:07:47.151 INFO:tasks.workunit.client.1.smithi184.stdout:2/841: dread d10/d1f/d38/d54/fbc [0,4194304] 0 2024-02-28T23:07:47.158 INFO:tasks.workunit.client.1.smithi184.stdout:8/897: dwrite d1/fed [0,4194304] 0 2024-02-28T23:07:47.161 INFO:tasks.workunit.client.1.smithi184.stdout:2/842: symlink d10/d1f/l112 0 2024-02-28T23:07:47.164 INFO:tasks.workunit.client.1.smithi184.stdout:3/934: mknod d1/d4/c128 0 2024-02-28T23:07:47.165 INFO:tasks.workunit.client.1.smithi184.stdout:9/871: write d5/d47/d59/d92/fc0 [2481694,34051] 0 2024-02-28T23:07:47.170 INFO:tasks.workunit.client.1.smithi184.stdout:7/845: rename d6/d9/d13/d3e/f64 to d6/d9/d13/d3e/dad/d7d/d6c/f124 0 2024-02-28T23:07:47.171 INFO:tasks.workunit.client.1.smithi184.stdout:2/843: truncate d10/d1f/d21/d5e/d15/f2e 305607 0 2024-02-28T23:07:47.178 INFO:tasks.workunit.client.1.smithi184.stdout:2/844: mknod d10/c113 0 2024-02-28T23:07:47.187 INFO:tasks.workunit.client.1.smithi184.stdout:6/804: mkdir dc/de/d2a/d8e/dff 0 2024-02-28T23:07:47.188 INFO:tasks.workunit.client.1.smithi184.stdout:6/805: readlink dc/de/l74 0 2024-02-28T23:07:47.188 INFO:tasks.workunit.client.1.smithi184.stdout:5/888: rename db/d44/da5/fe4 to db/d12/d50/f116 0 2024-02-28T23:07:47.191 INFO:tasks.workunit.client.1.smithi184.stdout:5/889: readlink db/d90/l10c 0 2024-02-28T23:07:47.191 INFO:tasks.workunit.client.1.smithi184.stdout:7/846: creat d6/f125 x:0 0 0 2024-02-28T23:07:47.194 INFO:tasks.workunit.client.1.smithi184.stdout:1/924: rename d20/d46/d90/db3/d103 to d20/d32/d3e/dc9/d13c 0 2024-02-28T23:07:47.195 INFO:tasks.workunit.client.1.smithi184.stdout:5/890: chown db/d12/d1c/d21/d25/l46 6287969 1 2024-02-28T23:07:47.198 INFO:tasks.workunit.client.1.smithi184.stdout:9/872: dread d5/d17/f5a [0,4194304] 0 2024-02-28T23:07:47.200 INFO:tasks.workunit.client.1.smithi184.stdout:0/912: dwrite d0/d1d/d4c/f6b [0,4194304] 0 2024-02-28T23:07:47.201 INFO:tasks.workunit.client.1.smithi184.stdout:4/886: rename d1/d8/d19/d92/l61 to d1/dc/df/d38/d57/dd6/l112 0 2024-02-28T23:07:47.202 INFO:tasks.workunit.client.1.smithi184.stdout:5/891: chown db/d12/d18/d2e/dc1/f9f 3485754 1 2024-02-28T23:07:47.204 INFO:tasks.workunit.client.1.smithi184.stdout:7/847: mknod d6/d9/d13/d3e/dad/d49/d50/df8/d98/dc4/c126 0 2024-02-28T23:07:47.208 INFO:tasks.workunit.client.1.smithi184.stdout:1/925: mknod d20/d46/d90/dff/c13d 0 2024-02-28T23:07:47.210 INFO:tasks.workunit.client.1.smithi184.stdout:1/926: chown d20/d32/d4d/c7f 12701 1 2024-02-28T23:07:47.211 INFO:tasks.workunit.client.1.smithi184.stdout:9/873: unlink d5/d17/d8f/f98 0 2024-02-28T23:07:47.222 INFO:tasks.workunit.client.1.smithi184.stdout:1/927: creat d20/d32/d3e/d61/f13e x:0 0 0 2024-02-28T23:07:47.225 INFO:tasks.workunit.client.1.smithi184.stdout:0/913: symlink d0/d1d/d3a/d10d/l13b 0 2024-02-28T23:07:47.236 INFO:tasks.workunit.client.1.smithi184.stdout:8/898: rename d1/da/dc/d16/d4d/d8a to d1/da/d10/d43/d140 0 2024-02-28T23:07:47.239 INFO:tasks.workunit.client.1.smithi184.stdout:0/914: mkdir d0/d1d/d3a/da9/d11b/d27/d31/d51/d117/d13c 0 2024-02-28T23:07:47.240 INFO:tasks.workunit.client.1.smithi184.stdout:5/892: mknod db/d12/df0/df4/c117 0 2024-02-28T23:07:47.244 INFO:tasks.workunit.client.1.smithi184.stdout:7/848: creat d6/f127 x:0 0 0 2024-02-28T23:07:47.244 INFO:tasks.workunit.client.1.smithi184.stdout:9/874: creat d5/d47/f11f x:0 0 0 2024-02-28T23:07:47.244 INFO:tasks.workunit.client.1.smithi184.stdout:5/893: fsync db/d12/d1c/d80/ffe 0 2024-02-28T23:07:47.246 INFO:tasks.workunit.client.1.smithi184.stdout:8/899: creat d1/da/dc/d16/d32/f141 x:0 0 0 2024-02-28T23:07:47.247 INFO:tasks.workunit.client.1.smithi184.stdout:0/915: creat d0/f13d x:0 0 0 2024-02-28T23:07:47.247 INFO:tasks.workunit.client.1.smithi184.stdout:5/894: dread - db/d12/d50/f105 zero size 2024-02-28T23:07:47.250 INFO:tasks.workunit.client.1.smithi184.stdout:0/916: dread - d0/d1d/d3a/da9/d11b/ffe zero size 2024-02-28T23:07:47.250 INFO:tasks.workunit.client.1.smithi184.stdout:5/895: dread - db/d12/d1c/d80/ffe zero size 2024-02-28T23:07:47.252 INFO:tasks.workunit.client.1.smithi184.stdout:8/900: symlink d1/da/df/d20/dc7/l142 0 2024-02-28T23:07:47.252 INFO:tasks.workunit.client.1.smithi184.stdout:3/935: write d1/fb9 [886889,107133] 0 2024-02-28T23:07:47.253 INFO:tasks.workunit.client.1.smithi184.stdout:9/875: rename d5/d17/d57 to d5/db/de/d10/d12/d2f/d3f/d8d/d120 0 2024-02-28T23:07:47.258 INFO:tasks.workunit.client.1.smithi184.stdout:3/936: creat d1/d4/d5/da9/d6e/f129 x:0 0 0 2024-02-28T23:07:47.258 INFO:tasks.workunit.client.1.smithi184.stdout:5/896: rmdir db/d12/d50/d111 0 2024-02-28T23:07:47.261 INFO:tasks.workunit.client.1.smithi184.stdout:8/901: rename d1/da/dc/d18/l75 to d1/da/d10/d17/d125/l143 0 2024-02-28T23:07:47.261 INFO:tasks.workunit.client.1.smithi184.stdout:0/917: truncate d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/da3/f10f 22852 0 2024-02-28T23:07:47.262 INFO:tasks.workunit.client.1.smithi184.stdout:5/897: chown db/d12/d1c/d21/d25/dd3 21886615 1 2024-02-28T23:07:47.263 INFO:tasks.workunit.client.1.smithi184.stdout:2/845: chown d10/d1f/d21/fca 117087 1 2024-02-28T23:07:47.263 INFO:tasks.workunit.client.1.smithi184.stdout:3/937: read - d1/d4/d1c/d62/d66/dd3/d26/d3a/fd7 zero size 2024-02-28T23:07:47.266 INFO:tasks.workunit.client.1.smithi184.stdout:9/876: dread d5/db/de/d10/d12/f9e [0,4194304] 0 2024-02-28T23:07:47.268 INFO:tasks.workunit.client.1.smithi184.stdout:5/898: chown db/d12/d1c/d21/ca9 1973 1 2024-02-28T23:07:47.269 INFO:tasks.workunit.client.1.smithi184.stdout:8/902: rename d1/da/d10/c106 to d1/da/d10/d10d/c144 0 2024-02-28T23:07:47.269 INFO:tasks.workunit.client.1.smithi184.stdout:0/918: chown d0/d1d/d3a/da9/d11b/d27/d31/d5b/fb1 0 1 2024-02-28T23:07:47.273 INFO:tasks.workunit.client.1.smithi184.stdout:5/899: chown db/d12/d1c/d9b/ld9 1067676 1 2024-02-28T23:07:47.274 INFO:tasks.workunit.client.1.smithi184.stdout:5/900: fdatasync db/f102 0 2024-02-28T23:07:47.277 INFO:tasks.workunit.client.1.smithi184.stdout:0/919: creat d0/d7c/d8a/f13e x:0 0 0 2024-02-28T23:07:47.278 INFO:tasks.workunit.client.1.smithi184.stdout:3/938: rename d1/d4/d1c/d61/f9a to d1/d4/d1c/f12a 0 2024-02-28T23:07:47.278 INFO:tasks.workunit.client.1.smithi184.stdout:6/806: dwrite dc/d60/d78/f8b [0,4194304] 0 2024-02-28T23:07:47.280 INFO:tasks.workunit.client.1.smithi184.stdout:2/846: getdents d10/d55/d89/db5/dc0 0 2024-02-28T23:07:47.282 INFO:tasks.workunit.client.1.smithi184.stdout:4/887: write d1/dc/df/d5b/fa6 [134539,53460] 0 2024-02-28T23:07:47.288 INFO:tasks.workunit.client.1.smithi184.stdout:5/901: truncate db/d12/d1c/d21/d25/fc0 625982 0 2024-02-28T23:07:47.289 INFO:tasks.workunit.client.1.smithi184.stdout:1/928: write d20/d46/d90/f5e [24782,33039] 0 2024-02-28T23:07:47.289 INFO:tasks.workunit.client.1.smithi184.stdout:8/903: dread d1/da/dc/d16/d4d/d82/fa8 [0,4194304] 0 2024-02-28T23:07:47.291 INFO:tasks.workunit.client.1.smithi184.stdout:6/807: symlink dc/de/d2a/d5c/d79/db9/de6/l100 0 2024-02-28T23:07:47.295 INFO:tasks.workunit.client.1.smithi184.stdout:9/877: link d5/db/f1f d5/db/d65/dc2/f121 0 2024-02-28T23:07:47.297 INFO:tasks.workunit.client.1.smithi184.stdout:5/902: dread db/d12/d50/f8d [0,4194304] 0 2024-02-28T23:07:47.303 INFO:tasks.workunit.client.1.smithi184.stdout:9/878: dread d5/db/de/df5/ff9 [0,4194304] 0 2024-02-28T23:07:47.309 INFO:tasks.workunit.client.1.smithi184.stdout:8/904: symlink d1/da/d10/d17/l145 0 2024-02-28T23:07:47.310 INFO:tasks.workunit.client.1.smithi184.stdout:8/905: chown d1/da/d10/d17/c7 53860070 1 2024-02-28T23:07:47.311 INFO:tasks.workunit.client.1.smithi184.stdout:6/808: rmdir dc/d60/d7c/d61/dd3 39 2024-02-28T23:07:47.316 INFO:tasks.workunit.client.1.smithi184.stdout:0/920: mknod d0/d1d/d3a/da9/d11b/d27/d31/d51/d117/d10e/c13f 0 2024-02-28T23:07:47.322 INFO:tasks.workunit.client.1.smithi184.stdout:4/888: mknod d1/d8/d19/c113 0 2024-02-28T23:07:47.334 INFO:tasks.workunit.client.1.smithi184.stdout:9/879: symlink d5/db/d5c/d5e/l122 0 2024-02-28T23:07:47.338 INFO:tasks.workunit.client.1.smithi184.stdout:6/809: unlink dc/de/d2a/l85 0 2024-02-28T23:07:47.346 INFO:tasks.workunit.client.1.smithi184.stdout:3/939: dwrite d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/f86 [0,4194304] 0 2024-02-28T23:07:47.352 INFO:tasks.workunit.client.1.smithi184.stdout:9/880: symlink d5/db/d5c/d5e/l123 0 2024-02-28T23:07:47.358 INFO:tasks.workunit.client.1.smithi184.stdout:5/903: dwrite db/d12/d1c/d21/d4d/d10e/d5d/ff6 [0,4194304] 0 2024-02-28T23:07:47.361 INFO:tasks.workunit.client.1.smithi184.stdout:2/847: dwrite d10/d1f/d21/d4d/d67/d65/fe0 [4194304,4194304] 0 2024-02-28T23:07:47.362 INFO:tasks.workunit.client.1.smithi184.stdout:4/889: mknod d1/d8/d19/d92/c114 0 2024-02-28T23:07:47.363 INFO:tasks.workunit.client.1.smithi184.stdout:1/929: link d20/l83 d20/d32/d3e/d91/d105/l13f 0 2024-02-28T23:07:47.365 INFO:tasks.workunit.client.1.smithi184.stdout:9/881: rmdir d5/d26/d50 39 2024-02-28T23:07:47.365 INFO:tasks.workunit.client.1.smithi184.stdout:2/848: fsync d10/d1f/d21/d5e/f58 0 2024-02-28T23:07:47.368 INFO:tasks.workunit.client.1.smithi184.stdout:1/930: chown d20/d32/f44 86706 1 2024-02-28T23:07:47.368 INFO:tasks.workunit.client.1.smithi184.stdout:9/882: stat d5/d47/d59/lee 0 2024-02-28T23:07:47.368 INFO:tasks.workunit.client.1.smithi184.stdout:0/921: link d0/df/f30 d0/d1d/d3a/da9/d11b/d27/d31/d51/d117/d13c/f140 0 2024-02-28T23:07:47.370 INFO:tasks.workunit.client.1.smithi184.stdout:5/904: fsync db/d12/d1c/d21/d2f/f55 0 2024-02-28T23:07:47.370 INFO:tasks.workunit.client.1.smithi184.stdout:8/906: dwrite d1/da/dc/d18/f38 [0,4194304] 0 2024-02-28T23:07:47.372 INFO:tasks.workunit.client.1.smithi184.stdout:3/940: creat d1/d4/d6/d1e/dfa/f12b x:0 0 0 2024-02-28T23:07:47.373 INFO:tasks.workunit.client.1.smithi184.stdout:1/931: stat d20/d32/d3e/d82/d106/c11c 0 2024-02-28T23:07:47.374 INFO:tasks.workunit.client.1.smithi184.stdout:2/849: chown d10/d1f/d21/d5e/d15/d60/d66/l8b 421883067 1 2024-02-28T23:07:47.375 INFO:tasks.workunit.client.1.smithi184.stdout:5/905: write db/d12/d18/d2e/fe5 [193813,16846] 0 2024-02-28T23:07:47.378 INFO:tasks.workunit.client.1.smithi184.stdout:5/906: readlink db/d12/d1c/d21/d4d/d10e/d5d/d66/la8 0 2024-02-28T23:07:47.379 INFO:tasks.workunit.client.1.smithi184.stdout:2/850: write d10/d1f/d38/d54/f10f [3120140,1919] 0 2024-02-28T23:07:47.381 INFO:tasks.workunit.client.1.smithi184.stdout:5/907: chown db/d12/d18/d2e/fda 439537907 1 2024-02-28T23:07:47.383 INFO:tasks.workunit.client.1.smithi184.stdout:4/890: rename d1/d8/d19/d67/d87/c102 to d1/dc/df/d38/d57/dd6/c115 0 2024-02-28T23:07:47.394 INFO:tasks.workunit.client.1.smithi184.stdout:8/907: dread d1/da/f89 [0,4194304] 0 2024-02-28T23:07:47.396 INFO:tasks.workunit.client.1.smithi184.stdout:2/851: dwrite d10/d1f/d21/d5e/d15/dc8/fd3 [0,4194304] 0 2024-02-28T23:07:47.402 INFO:tasks.workunit.client.1.smithi184.stdout:1/932: truncate d20/d46/d90/fcf 716467 0 2024-02-28T23:07:47.407 INFO:tasks.workunit.client.1.smithi184.stdout:5/908: mknod db/d44/da5/c118 0 2024-02-28T23:07:47.407 INFO:tasks.workunit.client.1.smithi184.stdout:7/849: sync 2024-02-28T23:07:47.408 INFO:tasks.workunit.client.1.smithi184.stdout:9/883: rename d5/d47/d68/c105 to d5/db/de/df5/c124 0 2024-02-28T23:07:47.414 INFO:tasks.workunit.client.1.smithi184.stdout:5/909: truncate db/d12/d1c/d21/d25/dd3/df1/ff7 570181 0 2024-02-28T23:07:47.418 INFO:tasks.workunit.client.1.smithi184.stdout:1/933: dwrite d20/d46/d90/fd1 [0,4194304] 0 2024-02-28T23:07:47.419 INFO:tasks.workunit.client.1.smithi184.stdout:1/934: chown d20/d32/d3e/fc7 15352 1 2024-02-28T23:07:47.421 INFO:tasks.workunit.client.1.smithi184.stdout:9/884: symlink d5/db/d5c/l125 0 2024-02-28T23:07:47.421 INFO:tasks.workunit.client.1.smithi184.stdout:8/908: link d1/da/dd7/f11b d1/da/d10/d43/d140/f146 0 2024-02-28T23:07:47.425 INFO:tasks.workunit.client.1.smithi184.stdout:0/922: getdents d0/d1d/d3a/da9/d11b/d27 0 2024-02-28T23:07:47.426 INFO:tasks.workunit.client.1.smithi184.stdout:8/909: truncate d1/da/dc/dc9/f129 115281 0 2024-02-28T23:07:47.426 INFO:tasks.workunit.client.1.smithi184.stdout:7/850: link d6/d9/d13/d3e/dad/d49/da6/daf/d65/f117 d6/d9/d13/d3e/dad/d49/da6/daf/d47/f128 0 2024-02-28T23:07:47.427 INFO:tasks.workunit.client.1.smithi184.stdout:3/941: rmdir d1/d4/d5/da9/d6e/d117 0 2024-02-28T23:07:47.427 INFO:tasks.workunit.client.1.smithi184.stdout:4/891: getdents d1/dc/df/d5b/db2/d9f 0 2024-02-28T23:07:47.428 INFO:tasks.workunit.client.1.smithi184.stdout:0/923: stat d0/db2/d114/l118 0 2024-02-28T23:07:47.430 INFO:tasks.workunit.client.1.smithi184.stdout:7/851: chown d6/d9/d13/d3e/l6e 18829462 1 2024-02-28T23:07:47.431 INFO:tasks.workunit.client.1.smithi184.stdout:2/852: rename d10/d1f/d21/d5e/d15/d24/d94/fe1 to d10/d1f/f114 0 2024-02-28T23:07:47.432 INFO:tasks.workunit.client.1.smithi184.stdout:3/942: fsync d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/f113 0 2024-02-28T23:07:47.432 INFO:tasks.workunit.client.1.smithi184.stdout:9/885: symlink d5/d47/d68/l126 0 2024-02-28T23:07:47.436 INFO:tasks.workunit.client.1.smithi184.stdout:5/910: rename db/d12/d18/db5/dfc/c115 to db/d44/da5/c119 0 2024-02-28T23:07:47.438 INFO:tasks.workunit.client.1.smithi184.stdout:8/910: unlink d1/da/f5b 0 2024-02-28T23:07:47.439 INFO:tasks.workunit.client.1.smithi184.stdout:8/911: stat d1/f86 0 2024-02-28T23:07:47.443 INFO:tasks.workunit.client.1.smithi184.stdout:1/935: write d20/d46/fe5 [592446,127987] 0 2024-02-28T23:07:47.506 INFO:tasks.workunit.client.1.smithi184.stdout:4/892: write d1/d4/d43/d73/fc5 [116083,4448] 0 2024-02-28T23:07:47.506 INFO:tasks.workunit.client.1.smithi184.stdout:7/852: write d6/d9/d13/d3e/dad/d49/d50/df8/d33/d80/fa5 [1124722,22447] 0 2024-02-28T23:07:47.510 INFO:tasks.workunit.client.1.smithi184.stdout:3/943: write d1/d4/d1c/d61/d120/f91 [2137757,11293] 0 2024-02-28T23:07:47.513 INFO:tasks.workunit.client.1.smithi184.stdout:8/912: symlink d1/da/d10/d43/d124/l147 0 2024-02-28T23:07:47.514 INFO:tasks.workunit.client.1.smithi184.stdout:5/911: creat db/d12/d1c/f11a x:0 0 0 2024-02-28T23:07:47.515 INFO:tasks.workunit.client.1.smithi184.stdout:1/936: read d20/d32/f48 [7162421,126765] 0 2024-02-28T23:07:47.517 INFO:tasks.workunit.client.1.smithi184.stdout:0/924: dwrite d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/dac/f12f [0,4194304] 0 2024-02-28T23:07:47.519 INFO:tasks.workunit.client.1.smithi184.stdout:5/912: chown db/d1f/f78 0 1 2024-02-28T23:07:47.520 INFO:tasks.workunit.client.1.smithi184.stdout:8/913: mkdir d1/da/dc/d148 0 2024-02-28T23:07:47.524 INFO:tasks.workunit.client.1.smithi184.stdout:1/937: unlink d20/d46/c7e 0 2024-02-28T23:07:47.525 INFO:tasks.workunit.client.1.smithi184.stdout:7/853: creat d6/d9/d13/d3e/d7e/f129 x:0 0 0 2024-02-28T23:07:47.528 INFO:tasks.workunit.client.1.smithi184.stdout:0/925: write d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/da3/f10f [233598,43454] 0 2024-02-28T23:07:47.533 INFO:tasks.workunit.client.1.smithi184.stdout:6/810: sync 2024-02-28T23:07:47.535 INFO:tasks.workunit.client.1.smithi184.stdout:5/913: creat db/d12/d1c/d21/d4d/d10e/f11b x:0 0 0 2024-02-28T23:07:47.535 INFO:tasks.workunit.client.1.smithi184.stdout:3/944: write d1/d4/d5/da9/d74/fbd [980936,58673] 0 2024-02-28T23:07:47.541 INFO:tasks.workunit.client.1.smithi184.stdout:4/893: rename d1/d8/d19/d92/feb to d1/dc/df/d38/f116 0 2024-02-28T23:07:47.542 INFO:tasks.workunit.client.1.smithi184.stdout:7/854: mkdir d6/d9/d13/d3e/dad/d49/d50/df8/d33/d123/d12a 0 2024-02-28T23:07:47.544 INFO:tasks.workunit.client.1.smithi184.stdout:9/886: dwrite d5/db/f1f [0,4194304] 0 2024-02-28T23:07:47.545 INFO:tasks.workunit.client.1.smithi184.stdout:5/914: mkdir db/d12/d1c/d21/d4d/d11c 0 2024-02-28T23:07:47.547 INFO:tasks.workunit.client.1.smithi184.stdout:8/914: rename d1/da/dc/d16/de7 to d1/da/d120/d130/d149 0 2024-02-28T23:07:47.552 INFO:tasks.workunit.client.1.smithi184.stdout:1/938: truncate d20/d32/d3e/f7c 3027724 0 2024-02-28T23:07:47.553 INFO:tasks.workunit.client.1.smithi184.stdout:9/887: mkdir d5/db/de/d10/d12/d2f/d3f/d8d/d127 0 2024-02-28T23:07:47.555 INFO:tasks.workunit.client.1.smithi184.stdout:8/915: creat d1/da/d120/f14a x:0 0 0 2024-02-28T23:07:47.559 INFO:tasks.workunit.client.1.smithi184.stdout:4/894: write d1/dc/df/d38/d57/dd6/ddd/dfe/fab [422113,45565] 0 2024-02-28T23:07:47.561 INFO:tasks.workunit.client.1.smithi184.stdout:8/916: chown d1/da/dc/d16/d29/d7d/fbf 35572 1 2024-02-28T23:07:47.562 INFO:tasks.workunit.client.1.smithi184.stdout:5/915: creat db/d12/d1c/d21/f11d x:0 0 0 2024-02-28T23:07:47.562 INFO:tasks.workunit.client.1.smithi184.stdout:3/945: dwrite d1/d4/d6/d83/fba [4194304,4194304] 0 2024-02-28T23:07:47.567 INFO:tasks.workunit.client.1.smithi184.stdout:0/926: rename d0/d1d/d3a/da9/d11b/d27/d31/c89 to d0/d1d/d3a/da9/d11b/c141 0 2024-02-28T23:07:47.569 INFO:tasks.workunit.client.1.smithi184.stdout:2/853: sync 2024-02-28T23:07:47.571 INFO:tasks.workunit.client.1.smithi184.stdout:1/939: mknod d20/d32/dc0/c140 0 2024-02-28T23:07:47.572 INFO:tasks.workunit.client.1.smithi184.stdout:8/917: mknod d1/da/d120/c14b 0 2024-02-28T23:07:47.573 INFO:tasks.workunit.client.1.smithi184.stdout:2/854: dread d10/d1f/d21/d6a/fae [0,4194304] 0 2024-02-28T23:07:47.576 INFO:tasks.workunit.client.1.smithi184.stdout:3/946: fdatasync d1/d4/d6/fe1 0 2024-02-28T23:07:47.577 INFO:tasks.workunit.client.1.smithi184.stdout:5/916: fdatasync db/d12/d18/d2e/f79 0 2024-02-28T23:07:47.578 INFO:tasks.workunit.client.1.smithi184.stdout:1/940: truncate d20/d32/d3e/d61/d8b/f104 608179 0 2024-02-28T23:07:47.581 INFO:tasks.workunit.client.1.smithi184.stdout:6/811: rename dc/d60/d7c/f6b to dc/d60/d62/d6f/d99/d9d/f101 0 2024-02-28T23:07:47.583 INFO:tasks.workunit.client.1.smithi184.stdout:5/917: read db/d12/d1c/f2b [434436,52728] 0 2024-02-28T23:07:47.585 INFO:tasks.workunit.client.1.smithi184.stdout:4/895: dwrite d1/dc/df/d5b/db2/ff4 [0,4194304] 0 2024-02-28T23:07:47.585 INFO:tasks.workunit.client.1.smithi184.stdout:0/927: creat d0/d1d/d3a/da9/d11b/d27/d31/d5b/f142 x:0 0 0 2024-02-28T23:07:47.591 INFO:tasks.workunit.client.1.smithi184.stdout:8/918: dread d1/da/dc/d16/f107 [0,4194304] 0 2024-02-28T23:07:47.592 INFO:tasks.workunit.client.1.smithi184.stdout:0/928: truncate d0/d1d/d3a/da9/d11b/f3b 5369237 0 2024-02-28T23:07:47.596 INFO:tasks.workunit.client.1.smithi184.stdout:3/947: read d1/d4/d1c/d62/d66/dd3/d26/dd2/fd9 [2380445,23838] 0 2024-02-28T23:07:47.604 INFO:tasks.workunit.client.1.smithi184.stdout:2/855: creat d10/d1f/d21/d5e/d15/d60/d66/dc6/f115 x:0 0 0 2024-02-28T23:07:47.606 INFO:tasks.workunit.client.1.smithi184.stdout:1/941: symlink d20/d32/db0/df7/l141 0 2024-02-28T23:07:47.607 INFO:tasks.workunit.client.1.smithi184.stdout:6/812: dwrite dc/de/d2a/d5c/d79/da2/fe1 [0,4194304] 0 2024-02-28T23:07:47.608 INFO:tasks.workunit.client.1.smithi184.stdout:0/929: dread d0/d11d/fd6 [0,4194304] 0 2024-02-28T23:07:47.612 INFO:tasks.workunit.client.1.smithi184.stdout:5/918: creat db/d12/df0/df4/f11e x:0 0 0 2024-02-28T23:07:47.624 INFO:tasks.workunit.client.1.smithi184.stdout:1/942: creat d20/d32/d3e/d61/d8b/d9c/db8/dd0/f142 x:0 0 0 2024-02-28T23:07:47.624 INFO:tasks.workunit.client.1.smithi184.stdout:0/930: rmdir d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/dac 39 2024-02-28T23:07:47.626 INFO:tasks.workunit.client.1.smithi184.stdout:1/943: fdatasync d20/d32/d3e/d61/fd9 0 2024-02-28T23:07:47.626 INFO:tasks.workunit.client.1.smithi184.stdout:2/856: dwrite d10/d1f/d21/d5e/d15/d24/d94/ffe [0,4194304] 0 2024-02-28T23:07:47.627 INFO:tasks.workunit.client.1.smithi184.stdout:8/919: mknod d1/da/d10/d17/d11c/c14c 0 2024-02-28T23:07:47.628 INFO:tasks.workunit.client.1.smithi184.stdout:3/948: mknod d1/d4/d1c/d61/c12c 0 2024-02-28T23:07:47.630 INFO:tasks.workunit.client.1.smithi184.stdout:7/855: rename d6/d9/d13/d3e/dad/d49/d50/df8/d33/fa9 to d6/d9/d13/d14/f12b 0 2024-02-28T23:07:47.637 INFO:tasks.workunit.client.1.smithi184.stdout:3/949: unlink d1/d4/d1c/ld6 0 2024-02-28T23:07:47.637 INFO:tasks.workunit.client.1.smithi184.stdout:0/931: read d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/dac/f12f [3000180,114619] 0 2024-02-28T23:07:47.637 INFO:tasks.workunit.client.1.smithi184.stdout:9/888: rename d5/db/ff1 to d5/db/de/d10/dc9/f128 0 2024-02-28T23:07:47.638 INFO:tasks.workunit.client.1.smithi184.stdout:8/920: read d1/da/d10/d17/f41 [349556,52491] 0 2024-02-28T23:07:47.640 INFO:tasks.workunit.client.1.smithi184.stdout:4/896: getdents d1/dc/df/d38/d57/dd6/ddd/dfe 0 2024-02-28T23:07:47.640 INFO:tasks.workunit.client.1.smithi184.stdout:0/932: readlink d0/d1d/d3a/da9/d11b/d27/d31/l48 0 2024-02-28T23:07:47.644 INFO:tasks.workunit.client.1.smithi184.stdout:0/933: write d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/fcd [3789263,96217] 0 2024-02-28T23:07:47.644 INFO:tasks.workunit.client.1.smithi184.stdout:1/944: symlink d20/d32/d3e/d82/d85/d8c/d11b/l143 0 2024-02-28T23:07:47.647 INFO:tasks.workunit.client.1.smithi184.stdout:1/945: chown d20/d32/d3e/d61/d8b/d101/f116 4 1 2024-02-28T23:07:47.653 INFO:tasks.workunit.client.1.smithi184.stdout:5/919: rename db/d12/d1c/d21/fbf to db/d12/d50/d9e/f11f 0 2024-02-28T23:07:47.654 INFO:tasks.workunit.client.1.smithi184.stdout:2/857: dread d10/d1f/d38/d54/f59 [12582912,4194304] 0 2024-02-28T23:07:47.654 INFO:tasks.workunit.client.1.smithi184.stdout:8/921: mkdir d1/da/dc/d16/d29/d92/d14d 0 2024-02-28T23:07:47.656 INFO:tasks.workunit.client.1.smithi184.stdout:5/920: dread - db/da4/ff8 zero size 2024-02-28T23:07:47.658 INFO:tasks.workunit.client.1.smithi184.stdout:9/889: creat d5/db/de/d10/dc9/de9/f129 x:0 0 0 2024-02-28T23:07:47.659 INFO:tasks.workunit.client.1.smithi184.stdout:3/950: mkdir d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/dc1/d12d 0 2024-02-28T23:07:47.661 INFO:tasks.workunit.client.1.smithi184.stdout:6/813: dwrite dc/de/d2a/d5c/d79/fac [0,4194304] 0 2024-02-28T23:07:47.666 INFO:tasks.workunit.client.1.smithi184.stdout:4/897: rename d1/dc/df/d38/d57/dd6 to d1/dc/d117 0 2024-02-28T23:07:47.668 INFO:tasks.workunit.client.1.smithi184.stdout:0/934: dread d0/f37 [4194304,4194304] 0 2024-02-28T23:07:47.670 INFO:tasks.workunit.client.1.smithi184.stdout:2/858: symlink d10/d1f/d21/d4d/l116 0 2024-02-28T23:07:47.676 INFO:tasks.workunit.client.1.smithi184.stdout:2/859: truncate d10/d1f/d21/d5e/dad/da3/dd6/de5/feb 163745 0 2024-02-28T23:07:47.680 INFO:tasks.workunit.client.1.smithi184.stdout:7/856: getdents d6/d9/d13/d3e/dad/d49/d9c 0 2024-02-28T23:07:47.682 INFO:tasks.workunit.client.1.smithi184.stdout:9/890: mkdir d5/d26/d50/d12a 0 2024-02-28T23:07:47.682 INFO:tasks.workunit.client.1.smithi184.stdout:7/857: read - d6/d9/d13/d3e/dad/d49/d50/df8/fe7 zero size 2024-02-28T23:07:47.684 INFO:tasks.workunit.client.1.smithi184.stdout:6/814: unlink dc/de/d2a/f35 0 2024-02-28T23:07:47.686 INFO:tasks.workunit.client.1.smithi184.stdout:7/858: dread - d6/d9/d13/d3e/dad/d49/da6/daf/d65/f108 zero size 2024-02-28T23:07:47.687 INFO:tasks.workunit.client.1.smithi184.stdout:6/815: truncate dc/d60/d7c/ff4 591123 0 2024-02-28T23:07:47.691 INFO:tasks.workunit.client.1.smithi184.stdout:0/935: truncate d0/d1d/d3a/d10d/f66 217202 0 2024-02-28T23:07:47.692 INFO:tasks.workunit.client.1.smithi184.stdout:9/891: truncate d5/d47/d68/d7c/f8b 1580101 0 2024-02-28T23:07:47.694 INFO:tasks.workunit.client.1.smithi184.stdout:4/898: write d1/dc/d117/ddd/dfe/f9c [333956,43606] 0 2024-02-28T23:07:47.694 INFO:tasks.workunit.client.1.smithi184.stdout:1/946: rename d20/d32/d3e/da2 to d20/d46/d144 0 2024-02-28T23:07:47.695 INFO:tasks.workunit.client.1.smithi184.stdout:2/860: dread d10/d1f/d38/f9c [0,4194304] 0 2024-02-28T23:07:47.697 INFO:tasks.workunit.client.1.smithi184.stdout:6/816: unlink dc/d60/f58 0 2024-02-28T23:07:47.698 INFO:tasks.workunit.client.1.smithi184.stdout:0/936: dread - d0/d1d/d3a/da9/d11b/ffe zero size 2024-02-28T23:07:47.698 INFO:tasks.workunit.client.1.smithi184.stdout:9/892: fsync d5/db/f102 0 2024-02-28T23:07:47.699 INFO:tasks.workunit.client.1.smithi184.stdout:7/859: mkdir d6/d9/d13/d14/d106/d12c 0 2024-02-28T23:07:47.700 INFO:tasks.workunit.client.1.smithi184.stdout:1/947: chown d20/f2c 115 1 2024-02-28T23:07:47.702 INFO:tasks.workunit.client.1.smithi184.stdout:4/899: mknod d1/d4/d43/d73/db7/c118 0 2024-02-28T23:07:47.703 INFO:tasks.workunit.client.1.smithi184.stdout:9/893: stat d5/db/de/d10/d6a 0 2024-02-28T23:07:47.704 INFO:tasks.workunit.client.1.smithi184.stdout:8/922: dwrite d1/da/d10/d17/f41 [0,4194304] 0 2024-02-28T23:07:47.706 INFO:tasks.workunit.client.1.smithi184.stdout:3/951: dwrite d1/d4/f42 [4194304,4194304] 0 2024-02-28T23:07:47.710 INFO:tasks.workunit.client.1.smithi184.stdout:9/894: chown d5/db/de/d10/d6a/f100 70030 1 2024-02-28T23:07:47.714 INFO:tasks.workunit.client.1.smithi184.stdout:9/895: chown d5/db/de/d10/dc9/de9/f129 19543099 1 2024-02-28T23:07:47.724 INFO:tasks.workunit.client.1.smithi184.stdout:0/937: unlink d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/da3/cbe 0 2024-02-28T23:07:47.724 INFO:tasks.workunit.client.1.smithi184.stdout:8/923: rmdir d1/da/dc/d16/d32/d80 39 2024-02-28T23:07:47.726 INFO:tasks.workunit.client.1.smithi184.stdout:8/924: chown d1/da/f89 32171 1 2024-02-28T23:07:47.727 INFO:tasks.workunit.client.1.smithi184.stdout:8/925: fsync d1/da/dc/d16/dbd/f12a 0 2024-02-28T23:07:47.728 INFO:tasks.workunit.client.1.smithi184.stdout:3/952: stat d1/d4/d6/l4c 0 2024-02-28T23:07:47.729 INFO:tasks.workunit.client.1.smithi184.stdout:8/926: read d1/da/dc/d18/f38 [2717889,83852] 0 2024-02-28T23:07:47.731 INFO:tasks.workunit.client.1.smithi184.stdout:1/948: unlink d20/c114 0 2024-02-28T23:07:47.736 INFO:tasks.workunit.client.1.smithi184.stdout:4/900: mkdir d1/d8/d19/d92/db3/db1/d119 0 2024-02-28T23:07:47.737 INFO:tasks.workunit.client.1.smithi184.stdout:2/861: rename d10/d1f/df9 to d10/d1f/d21/d117 0 2024-02-28T23:07:47.738 INFO:tasks.workunit.client.1.smithi184.stdout:7/860: creat d6/f12d x:0 0 0 2024-02-28T23:07:47.745 INFO:tasks.workunit.client.1.smithi184.stdout:4/901: unlink d1/dc/df/d27/d34/cd7 0 2024-02-28T23:07:47.748 INFO:tasks.workunit.client.1.smithi184.stdout:9/896: rename d5/db/de/d10/dc9/f128 to d5/db/de/d10/d12/d2f/d3f/f12b 0 2024-02-28T23:07:47.753 INFO:tasks.workunit.client.1.smithi184.stdout:7/861: fdatasync f4 0 2024-02-28T23:07:47.793 INFO:tasks.workunit.client.1.smithi184.stdout:3/953: mknod d1/d4/d1c/d61/c12e 0 2024-02-28T23:07:47.794 INFO:tasks.workunit.client.1.smithi184.stdout:8/927: rename d1/da/dc/d16/d32/d42/f6f to d1/da/dc/d16/d32/d80/f14e 0 2024-02-28T23:07:47.796 INFO:tasks.workunit.client.1.smithi184.stdout:1/949: symlink d20/l145 0 2024-02-28T23:07:47.799 INFO:tasks.workunit.client.1.smithi184.stdout:4/902: write d1/d8/d19/d67/d99/faa [5532063,49166] 0 2024-02-28T23:07:47.808 INFO:tasks.workunit.client.1.smithi184.stdout:7/862: link f0 d6/d9/dc5/f12e 0 2024-02-28T23:07:47.811 INFO:tasks.workunit.client.1.smithi184.stdout:4/903: read d1/d4/d43/d73/fc6 [186849,63340] 0 2024-02-28T23:07:47.813 INFO:tasks.workunit.client.1.smithi184.stdout:3/954: rename d1/d4/d6/d83 to d1/d4/d1c/d62/d66/dd3/d26/d12f 0 2024-02-28T23:07:47.815 INFO:tasks.workunit.client.1.smithi184.stdout:9/897: dwrite d5/f24 [4194304,4194304] 0 2024-02-28T23:07:47.818 INFO:tasks.workunit.client.1.smithi184.stdout:1/950: unlink d20/d32/d3e/d61/fd9 0 2024-02-28T23:07:47.818 INFO:tasks.workunit.client.1.smithi184.stdout:2/862: dwrite d10/d1f/d21/d5e/d15/d24/d5f/ff1 [0,4194304] 0 2024-02-28T23:07:47.823 INFO:tasks.workunit.client.1.smithi184.stdout:7/863: mkdir d6/d9/d13/d3e/dad/d49/d9c/d101/d11e/d12f 0 2024-02-28T23:07:47.823 INFO:tasks.workunit.client.1.smithi184.stdout:1/951: chown d20/d32/db0/df7/dfa/f12e 2 1 2024-02-28T23:07:47.824 INFO:tasks.workunit.client.1.smithi184.stdout:3/955: creat d1/d4/d1c/d62/d66/dd3/d24/d76/f130 x:0 0 0 2024-02-28T23:07:47.829 INFO:tasks.workunit.client.1.smithi184.stdout:2/863: symlink d10/d1f/d21/d5e/dad/dc7/l118 0 2024-02-28T23:07:47.831 INFO:tasks.workunit.client.1.smithi184.stdout:7/864: creat d6/d9/d13/d3e/dad/f130 x:0 0 0 2024-02-28T23:07:47.832 INFO:tasks.workunit.client.1.smithi184.stdout:8/928: dwrite d1/da/d10/d17/f13 [0,4194304] 0 2024-02-28T23:07:47.836 INFO:tasks.workunit.client.1.smithi184.stdout:2/864: write d10/d55/d89/db5/f9f [2616665,113708] 0 2024-02-28T23:07:47.840 INFO:tasks.workunit.client.1.smithi184.stdout:4/904: dwrite d1/d8/d19/f1a [0,4194304] 0 2024-02-28T23:07:47.842 INFO:tasks.workunit.client.1.smithi184.stdout:7/865: unlink d6/d9/d13/d3e/dad/laa 0 2024-02-28T23:07:47.845 INFO:tasks.workunit.client.1.smithi184.stdout:5/921: sync 2024-02-28T23:07:47.845 INFO:tasks.workunit.client.1.smithi184.stdout:6/817: sync 2024-02-28T23:07:47.846 INFO:tasks.workunit.client.1.smithi184.stdout:2/865: rmdir d10/d1f/d21/d4d/d67/d65 39 2024-02-28T23:07:47.859 INFO:tasks.workunit.client.1.smithi184.stdout:8/929: creat d1/da/d10/f14f x:0 0 0 2024-02-28T23:07:47.862 INFO:tasks.workunit.client.1.smithi184.stdout:7/866: readlink d6/d9/da/l11c 0 2024-02-28T23:07:47.865 INFO:tasks.workunit.client.1.smithi184.stdout:3/956: dwrite d1/d4/f103 [0,4194304] 0 2024-02-28T23:07:47.870 INFO:tasks.workunit.client.1.smithi184.stdout:9/898: dwrite d5/db/de/d10/d12/d2f/f7b [0,4194304] 0 2024-02-28T23:07:47.871 INFO:tasks.workunit.client.1.smithi184.stdout:3/957: chown d1/d4/d1c/d62/d66/dd3/d24/d126 417986 1 2024-02-28T23:07:47.873 INFO:tasks.workunit.client.1.smithi184.stdout:1/952: truncate d20/d32/d3e/d82/d85/fdf 112471 0 2024-02-28T23:07:47.877 INFO:tasks.workunit.client.1.smithi184.stdout:7/867: read d6/d9/d13/d3e/dad/d7d/d8d/fd7 [1580948,107824] 0 2024-02-28T23:07:47.878 INFO:tasks.workunit.client.1.smithi184.stdout:1/953: chown d20/d32/dc0/cc5 824 1 2024-02-28T23:07:47.880 INFO:tasks.workunit.client.1.smithi184.stdout:1/954: chown d20/d32/db0/c10f 52561 1 2024-02-28T23:07:47.882 INFO:tasks.workunit.client.1.smithi184.stdout:1/955: chown d20/d32/d4b/fe6 29153 1 2024-02-28T23:07:47.883 INFO:tasks.workunit.client.1.smithi184.stdout:6/818: dwrite dc/d60/ff6 [0,4194304] 0 2024-02-28T23:07:47.885 INFO:tasks.workunit.client.1.smithi184.stdout:1/956: dread - d20/d32/d3e/d61/f13e zero size 2024-02-28T23:07:47.900 INFO:tasks.workunit.client.1.smithi184.stdout:1/957: dwrite f9 [4194304,4194304] 0 2024-02-28T23:07:47.910 INFO:tasks.workunit.client.1.smithi184.stdout:0/938: sync 2024-02-28T23:07:47.921 INFO:tasks.workunit.client.1.smithi184.stdout:5/922: creat db/d12/d1c/d21/d4d/d11c/f120 x:0 0 0 2024-02-28T23:07:47.922 INFO:tasks.workunit.client.1.smithi184.stdout:4/905: creat d1/dc/df/d3b/f11a x:0 0 0 2024-02-28T23:07:47.923 INFO:tasks.workunit.client.1.smithi184.stdout:5/923: chown db/d1f/c10d 48512 1 2024-02-28T23:07:47.925 INFO:tasks.workunit.client.1.smithi184.stdout:9/899: unlink d5/db/de/d10/d12/d2f/d3f/c8a 0 2024-02-28T23:07:47.926 INFO:tasks.workunit.client.1.smithi184.stdout:3/958: mknod d1/d4/d1c/d62/d66/dd3/d26/dd2/d125/c131 0 2024-02-28T23:07:47.929 INFO:tasks.workunit.client.1.smithi184.stdout:2/866: dwrite d10/d1f/d38/d54/fbc [0,4194304] 0 2024-02-28T23:07:47.930 INFO:tasks.workunit.client.1.smithi184.stdout:2/867: stat d10/c113 0 2024-02-28T23:07:47.934 INFO:tasks.workunit.client.1.smithi184.stdout:0/939: symlink d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/l143 0 2024-02-28T23:07:47.938 INFO:tasks.workunit.client.1.smithi184.stdout:5/924: creat db/d12/d1c/d21/d25/dd3/df1/f121 x:0 0 0 2024-02-28T23:07:47.947 INFO:tasks.workunit.client.1.smithi184.stdout:6/819: creat dc/f102 x:0 0 0 2024-02-28T23:07:47.950 INFO:tasks.workunit.client.1.smithi184.stdout:3/959: mkdir d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/d132 0 2024-02-28T23:07:47.952 INFO:tasks.workunit.client.1.smithi184.stdout:2/868: mkdir d10/d1f/d21/d5e/dad/da3/d119 0 2024-02-28T23:07:47.952 INFO:tasks.workunit.client.1.smithi184.stdout:4/906: dwrite d1/dc/df/f16 [4194304,4194304] 0 2024-02-28T23:07:47.957 INFO:tasks.workunit.client.1.smithi184.stdout:1/958: creat d20/d32/d3e/d61/d8b/d9c/f146 x:0 0 0 2024-02-28T23:07:47.958 INFO:tasks.workunit.client.1.smithi184.stdout:8/930: write d1/da/d10/d43/d124/f59 [639338,63775] 0 2024-02-28T23:07:47.959 INFO:tasks.workunit.client.1.smithi184.stdout:8/931: chown d1/da/df/d20/lad 3108815 1 2024-02-28T23:07:47.962 INFO:tasks.workunit.client.1.smithi184.stdout:5/925: creat db/d12/d18/db5/f122 x:0 0 0 2024-02-28T23:07:47.967 INFO:tasks.workunit.client.1.smithi184.stdout:7/868: getdents d6/d9/d13/d3e/dad/d49/d9c/d101 0 2024-02-28T23:07:47.968 INFO:tasks.workunit.client.1.smithi184.stdout:6/820: fdatasync dc/de/f40 0 2024-02-28T23:07:47.974 INFO:tasks.workunit.client.1.smithi184.stdout:9/900: write d5/d73/fb3 [2543165,90738] 0 2024-02-28T23:07:47.974 INFO:tasks.workunit.client.1.smithi184.stdout:2/869: chown d10/d1f/f48 1 1 2024-02-28T23:07:47.975 INFO:tasks.workunit.client.1.smithi184.stdout:9/901: readlink d5/d47/d68/l126 0 2024-02-28T23:07:47.985 INFO:tasks.workunit.client.1.smithi184.stdout:6/821: write dc/d60/d62/d6f/d99/d9d/f101 [4402571,35628] 0 2024-02-28T23:07:47.988 INFO:tasks.workunit.client.1.smithi184.stdout:3/960: mkdir d1/d4/d1c/d61/d87/d133 0 2024-02-28T23:07:47.991 INFO:tasks.workunit.client.1.smithi184.stdout:0/940: truncate d0/d1d/d4c/f6b 901918 0 2024-02-28T23:07:47.995 INFO:tasks.workunit.client.1.smithi184.stdout:0/941: chown d0/d11d/d108 429450466 1 2024-02-28T23:07:47.996 INFO:tasks.workunit.client.1.smithi184.stdout:2/870: dwrite f8 [0,4194304] 0 2024-02-28T23:07:48.000 INFO:tasks.workunit.client.1.smithi184.stdout:5/926: dwrite db/d12/d1c/d21/d25/dd3/df1/ff7 [0,4194304] 0 2024-02-28T23:07:48.002 INFO:tasks.workunit.client.1.smithi184.stdout:4/907: getdents d1/dc/d117 0 2024-02-28T23:07:48.003 INFO:tasks.workunit.client.1.smithi184.stdout:6/822: unlink dc/de/d2a/d5c/d79/db9/ce8 0 2024-02-28T23:07:48.005 INFO:tasks.workunit.client.1.smithi184.stdout:5/927: read - db/d12/d18/d2e/ffa zero size 2024-02-28T23:07:48.007 INFO:tasks.workunit.client.1.smithi184.stdout:7/869: dread d6/d9/d13/d14/d45/ffa [0,4194304] 0 2024-02-28T23:07:48.010 INFO:tasks.workunit.client.1.smithi184.stdout:9/902: dread d5/d26/d50/fb6 [0,4194304] 0 2024-02-28T23:07:48.016 INFO:tasks.workunit.client.1.smithi184.stdout:4/908: creat d1/dc/d117/ddd/dfe/d49/f11b x:0 0 0 2024-02-28T23:07:48.023 INFO:tasks.workunit.client.1.smithi184.stdout:7/870: stat d6/d9/d13/d3e/dad/fa1 0 2024-02-28T23:07:48.029 INFO:tasks.workunit.client.1.smithi184.stdout:3/961: mknod d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/c134 0 2024-02-28T23:07:48.034 INFO:tasks.workunit.client.1.smithi184.stdout:1/959: getdents d20/d46/d90/db3 0 2024-02-28T23:07:48.035 INFO:tasks.workunit.client.1.smithi184.stdout:9/903: fsync d5/db/de/d10/d6a/f10b 0 2024-02-28T23:07:48.037 INFO:tasks.workunit.client.1.smithi184.stdout:4/909: rename d1/dc/df/d38/d57/de9 to d1/d8/d19/d67/d99/d11c 0 2024-02-28T23:07:48.040 INFO:tasks.workunit.client.1.smithi184.stdout:0/942: dwrite d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/dac/fe9 [0,4194304] 0 2024-02-28T23:07:48.041 INFO:tasks.workunit.client.1.smithi184.stdout:6/823: dwrite dc/d60/d62/d6f/f77 [4194304,4194304] 0 2024-02-28T23:07:48.042 INFO:tasks.workunit.client.1.smithi184.stdout:6/824: readlink dc/d60/lec 0 2024-02-28T23:07:48.046 INFO:tasks.workunit.client.1.smithi184.stdout:5/928: write db/d12/d1c/d21/d25/f69 [3538171,129929] 0 2024-02-28T23:07:48.052 INFO:tasks.workunit.client.1.smithi184.stdout:7/871: fdatasync d6/d9/d13/d14/fa2 0 2024-02-28T23:07:48.060 INFO:tasks.workunit.client.1.smithi184.stdout:8/932: sync 2024-02-28T23:07:48.060 INFO:tasks.workunit.client.1.smithi184.stdout:0/943: creat d0/d7c/f144 x:0 0 0 2024-02-28T23:07:48.062 INFO:tasks.workunit.client.1.smithi184.stdout:6/825: mknod dc/d60/d62/d6f/d99/d9d/c103 0 2024-02-28T23:07:48.065 INFO:tasks.workunit.client.1.smithi184.stdout:5/929: readlink db/d12/d1c/d21/d4d/d10e/d5d/l87 0 2024-02-28T23:07:48.066 INFO:tasks.workunit.client.1.smithi184.stdout:3/962: write d1/d4/d5/d40/f64 [4949489,27719] 0 2024-02-28T23:07:48.067 INFO:tasks.workunit.client.1.smithi184.stdout:1/960: rename d20/d46/d90/fcf to d20/d32/d3e/d82/d85/d120/f147 0 2024-02-28T23:07:48.068 INFO:tasks.workunit.client.1.smithi184.stdout:5/930: stat db/d12/d18/d2e/dc1/fff 0 2024-02-28T23:07:48.069 INFO:tasks.workunit.client.1.smithi184.stdout:1/961: dread - d20/d46/fcc zero size 2024-02-28T23:07:48.073 INFO:tasks.workunit.client.1.smithi184.stdout:4/910: mknod d1/dc/d117/ddd/dfe/d6d/dbd/c11d 0 2024-02-28T23:07:48.074 INFO:tasks.workunit.client.1.smithi184.stdout:7/872: unlink d6/d9/d13/d3e/dad/d49/d50/df8/d33/d80/f87 0 2024-02-28T23:07:48.075 INFO:tasks.workunit.client.1.smithi184.stdout:4/911: write d1/d8/d19/d67/d99/faa [147754,98762] 0 2024-02-28T23:07:48.076 INFO:tasks.workunit.client.1.smithi184.stdout:8/933: truncate d1/da/dc/d16/f115 702566 0 2024-02-28T23:07:48.079 INFO:tasks.workunit.client.1.smithi184.stdout:0/944: rename d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/dac/lab to d0/d1f/d109/d71/l145 0 2024-02-28T23:07:48.080 INFO:tasks.workunit.client.1.smithi184.stdout:5/931: fdatasync db/d12/d1c/d21/d4d/d10e/f83 0 2024-02-28T23:07:48.083 INFO:tasks.workunit.client.1.smithi184.stdout:9/904: link d5/d47/d68/d7c/fa8 d5/db/d5c/d5e/f12c 0 2024-02-28T23:07:48.086 INFO:tasks.workunit.client.1.smithi184.stdout:1/962: truncate d20/d32/d3e/d82/fa8 1162490 0 2024-02-28T23:07:48.087 INFO:tasks.workunit.client.1.smithi184.stdout:2/871: sync 2024-02-28T23:07:48.087 INFO:tasks.workunit.client.1.smithi184.stdout:3/963: dread d1/d4/d1c/d61/f90 [0,4194304] 0 2024-02-28T23:07:48.094 INFO:tasks.workunit.client.1.smithi184.stdout:6/826: mknod dc/d60/d62/c104 0 2024-02-28T23:07:48.098 INFO:tasks.workunit.client.1.smithi184.stdout:4/912: mkdir d1/d4/d43/d11e 0 2024-02-28T23:07:48.105 INFO:tasks.workunit.client.1.smithi184.stdout:5/932: mkdir db/d12/d1c/d21/d2f/dc4/d123 0 2024-02-28T23:07:48.110 INFO:tasks.workunit.client.1.smithi184.stdout:6/827: dwrite dc/d60/ff6 [0,4194304] 0 2024-02-28T23:07:48.118 INFO:tasks.workunit.client.1.smithi184.stdout:3/964: write d1/d4/d1c/f12a [61736,51159] 0 2024-02-28T23:07:48.119 INFO:tasks.workunit.client.1.smithi184.stdout:6/828: dread dc/d60/d62/d6f/d99/d9d/f101 [4194304,4194304] 0 2024-02-28T23:07:48.124 INFO:tasks.workunit.client.1.smithi184.stdout:7/873: fdatasync d6/d9/d13/d1e/f21 0 2024-02-28T23:07:48.126 INFO:tasks.workunit.client.1.smithi184.stdout:4/913: mknod d1/d8/d3d/c11f 0 2024-02-28T23:07:48.129 INFO:tasks.workunit.client.1.smithi184.stdout:5/933: creat db/d90/f124 x:0 0 0 2024-02-28T23:07:48.136 INFO:tasks.workunit.client.1.smithi184.stdout:3/965: dwrite d1/fb9 [0,4194304] 0 2024-02-28T23:07:48.138 INFO:tasks.workunit.client.1.smithi184.stdout:8/934: dwrite d1/da/df/f28 [4194304,4194304] 0 2024-02-28T23:07:48.140 INFO:tasks.workunit.client.1.smithi184.stdout:0/945: link d0/d7c/d8a/f13e d0/d11d/d108/d11c/f146 0 2024-02-28T23:07:48.140 INFO:tasks.workunit.client.1.smithi184.stdout:2/872: write d10/d1f/d21/d5e/d15/d60/fb2 [3982840,58575] 0 2024-02-28T23:07:48.144 INFO:tasks.workunit.client.1.smithi184.stdout:9/905: creat d5/db/de/d10/d12/d2f/d3f/d8d/d127/f12d x:0 0 0 2024-02-28T23:07:48.151 INFO:tasks.workunit.client.1.smithi184.stdout:6/829: write f8 [2517853,95337] 0 2024-02-28T23:07:48.155 INFO:tasks.workunit.client.1.smithi184.stdout:4/914: fdatasync d1/dc/d117/ddd/dfe/f4c 0 2024-02-28T23:07:48.157 INFO:tasks.workunit.client.1.smithi184.stdout:4/915: fdatasync d1/dc/df/d22/fce 0 2024-02-28T23:07:48.166 INFO:tasks.workunit.client.1.smithi184.stdout:1/963: creat d20/d46/f148 x:0 0 0 2024-02-28T23:07:48.170 INFO:tasks.workunit.client.1.smithi184.stdout:0/946: unlink d0/d1d/d3a/da9/d11b/d27/d58/c74 0 2024-02-28T23:07:48.172 INFO:tasks.workunit.client.1.smithi184.stdout:9/906: symlink d5/db/d65/l12e 0 2024-02-28T23:07:48.172 INFO:tasks.workunit.client.1.smithi184.stdout:3/966: write d1/d4/d1c/d62/d66/da6/fca [178896,38596] 0 2024-02-28T23:07:48.178 INFO:tasks.workunit.client.1.smithi184.stdout:6/830: dread dc/de/d2a/f94 [0,4194304] 0 2024-02-28T23:07:48.180 INFO:tasks.workunit.client.1.smithi184.stdout:2/873: link d10/d1f/f93 d10/d55/f11a 0 2024-02-28T23:07:48.182 INFO:tasks.workunit.client.1.smithi184.stdout:1/964: rmdir d20/d32/d3e/d61/d8b 39 2024-02-28T23:07:48.183 INFO:tasks.workunit.client.1.smithi184.stdout:5/934: dread db/d1f/f78 [0,4194304] 0 2024-02-28T23:07:48.187 INFO:tasks.workunit.client.1.smithi184.stdout:4/916: mkdir d1/dc/df/d3b/d120 0 2024-02-28T23:07:48.188 INFO:tasks.workunit.client.1.smithi184.stdout:8/935: dread d1/da/dc/d16/d29/d92/fb5 [0,4194304] 0 2024-02-28T23:07:48.193 INFO:tasks.workunit.client.1.smithi184.stdout:2/874: rmdir d10/d1f/d21/d5e/d15/d60/d66/dc6 39 2024-02-28T23:07:48.200 INFO:tasks.workunit.client.1.smithi184.stdout:0/947: fsync d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/ff2 0 2024-02-28T23:07:48.203 INFO:tasks.workunit.client.1.smithi184.stdout:3/967: symlink d1/d4/d1c/d62/d66/dd3/d24/d126/l135 0 2024-02-28T23:07:48.205 INFO:tasks.workunit.client.1.smithi184.stdout:4/917: creat d1/dc/d117/ddd/dfe/d49/f121 x:0 0 0 2024-02-28T23:07:48.206 INFO:tasks.workunit.client.1.smithi184.stdout:3/968: fsync d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d82/fc7 0 2024-02-28T23:07:48.207 INFO:tasks.workunit.client.1.smithi184.stdout:7/874: mknod d6/d9/d13/d3e/dad/d7d/d8d/df2/c131 0 2024-02-28T23:07:48.209 INFO:tasks.workunit.client.1.smithi184.stdout:4/918: read d1/d8/d19/d67/fb6 [503358,20106] 0 2024-02-28T23:07:48.212 INFO:tasks.workunit.client.1.smithi184.stdout:4/919: write d1/fd8 [1896712,105281] 0 2024-02-28T23:07:48.217 INFO:tasks.workunit.client.1.smithi184.stdout:9/907: dwrite d5/d47/d68/f6f [0,4194304] 0 2024-02-28T23:07:48.220 INFO:tasks.workunit.client.1.smithi184.stdout:1/965: dread d20/f47 [0,4194304] 0 2024-02-28T23:07:48.231 INFO:tasks.workunit.client.1.smithi184.stdout:6/831: creat dc/d60/d7c/d61/f105 x:0 0 0 2024-02-28T23:07:48.231 INFO:tasks.workunit.client.1.smithi184.stdout:6/832: stat dc/de/d2a/l8f 0 2024-02-28T23:07:48.233 INFO:tasks.workunit.client.1.smithi184.stdout:6/833: chown dc/d60/d78/fb2 19729921 1 2024-02-28T23:07:48.235 INFO:tasks.workunit.client.1.smithi184.stdout:7/875: unlink d6/d9/d13/d3e/dad/d49/d50/c63 0 2024-02-28T23:07:48.241 INFO:tasks.workunit.client.1.smithi184.stdout:4/920: creat d1/dc/df/d3b/d8f/f122 x:0 0 0 2024-02-28T23:07:48.243 INFO:tasks.workunit.client.1.smithi184.stdout:4/921: fdatasync d1/dc/df/d38/d57/fcd 0 2024-02-28T23:07:48.243 INFO:tasks.workunit.client.1.smithi184.stdout:7/876: read d6/d9/d13/d3e/dad/d7d/d6c/f81 [384132,109454] 0 2024-02-28T23:07:48.248 INFO:tasks.workunit.client.1.smithi184.stdout:1/966: rename d20/d46/fe5 to d20/d32/d3e/d82/d85/d86/f149 0 2024-02-28T23:07:48.251 INFO:tasks.workunit.client.1.smithi184.stdout:6/834: symlink dc/d42/l106 0 2024-02-28T23:07:48.253 INFO:tasks.workunit.client.1.smithi184.stdout:6/835: chown dc/d60/d62/d6f/d99/d9d/c103 105 1 2024-02-28T23:07:48.256 INFO:tasks.workunit.client.1.smithi184.stdout:3/969: write d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/ddc/fce [630372,41348] 0 2024-02-28T23:07:48.260 INFO:tasks.workunit.client.1.smithi184.stdout:0/948: fdatasync d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/fcd 0 2024-02-28T23:07:48.266 INFO:tasks.workunit.client.1.smithi184.stdout:2/875: dwrite d10/d1f/d21/d5e/f3d [0,4194304] 0 2024-02-28T23:07:48.266 INFO:tasks.workunit.client.1.smithi184.stdout:5/935: getdents db/d12/d1c/d21/d2f/dc4 0 2024-02-28T23:07:48.277 INFO:tasks.workunit.client.1.smithi184.stdout:8/936: sync 2024-02-28T23:07:48.283 INFO:tasks.workunit.client.1.smithi184.stdout:9/908: link d5/db/d5c/d5e/c81 d5/db/d65/c12f 0 2024-02-28T23:07:48.283 INFO:tasks.workunit.client.1.smithi184.stdout:4/922: link d1/dc/df/d22/fce d1/dc/df/d5b/d6c/f123 0 2024-02-28T23:07:48.285 INFO:tasks.workunit.client.1.smithi184.stdout:9/909: write d5/d17/f3d [2328300,80230] 0 2024-02-28T23:07:48.286 INFO:tasks.workunit.client.1.smithi184.stdout:7/877: write d6/d9/d13/d3e/dad/d49/da6/daf/d47/fdf [965346,12556] 0 2024-02-28T23:07:48.288 INFO:tasks.workunit.client.1.smithi184.stdout:6/836: rename dc/d60/d62/c104 to dc/d60/d7c/d61/dd3/c107 0 2024-02-28T23:07:48.289 INFO:tasks.workunit.client.1.smithi184.stdout:2/876: dwrite d10/d1f/d21/d5e/dad/dc7/fd7 [0,4194304] 0 2024-02-28T23:07:48.293 INFO:tasks.workunit.client.1.smithi184.stdout:6/837: readlink dc/de/d10/l18 0 2024-02-28T23:07:48.293 INFO:tasks.workunit.client.1.smithi184.stdout:4/923: symlink d1/d9a/l124 0 2024-02-28T23:07:48.294 INFO:tasks.workunit.client.1.smithi184.stdout:9/910: symlink d5/db/de/d112/l130 0 2024-02-28T23:07:48.300 INFO:tasks.workunit.client.1.smithi184.stdout:9/911: chown d5/db/c70 3290 1 2024-02-28T23:07:48.300 INFO:tasks.workunit.client.1.smithi184.stdout:7/878: dread - d6/d9/d13/d3e/dad/d49/da6/daf/fca zero size 2024-02-28T23:07:48.315 INFO:tasks.workunit.client.1.smithi184.stdout:1/967: dwrite d20/d32/d3e/d82/fc2 [0,4194304] 0 2024-02-28T23:07:48.317 INFO:tasks.workunit.client.1.smithi184.stdout:3/970: dwrite d1/d4/f5a [0,4194304] 0 2024-02-28T23:07:48.318 INFO:tasks.workunit.client.1.smithi184.stdout:0/949: dwrite d0/d1d/d3a/da9/d11b/d27/d31/d51/d85/f113 [0,4194304] 0 2024-02-28T23:07:48.318 INFO:tasks.workunit.client.1.smithi184.stdout:9/912: creat d5/db/de/d10/d12/dbb/f131 x:0 0 0 2024-02-28T23:07:48.320 INFO:tasks.workunit.client.1.smithi184.stdout:8/937: truncate d1/da/dd7/fe2 1376670 0 2024-02-28T23:07:48.322 INFO:tasks.workunit.client.1.smithi184.stdout:1/968: chown d20/d46/d90/db3/f11f 1507 1 2024-02-28T23:07:48.333 INFO:tasks.workunit.client.1.smithi184.stdout:8/938: unlink d1/da/d10/d6b/cc2 0 2024-02-28T23:07:48.333 INFO:tasks.workunit.client.1.smithi184.stdout:2/877: dread d10/f14 [0,4194304] 0 2024-02-28T23:07:48.334 INFO:tasks.workunit.client.1.smithi184.stdout:0/950: rmdir d0/d1d/d4c/d93 39 2024-02-28T23:07:48.334 INFO:tasks.workunit.client.1.smithi184.stdout:9/913: read d5/db/de/d10/d12/d2f/d3f/f66 [210857,103756] 0 2024-02-28T23:07:48.337 INFO:tasks.workunit.client.1.smithi184.stdout:1/969: rename fb to d20/d32/d3e/d91/d105/f14a 0 2024-02-28T23:07:48.337 INFO:tasks.workunit.client.1.smithi184.stdout:2/878: stat d10/d55/d89/db5/lb8 0 2024-02-28T23:07:48.339 INFO:tasks.workunit.client.1.smithi184.stdout:3/971: creat d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/dc1/f136 x:0 0 0 2024-02-28T23:07:48.343 INFO:tasks.workunit.client.1.smithi184.stdout:9/914: fdatasync d5/d47/f77 0 2024-02-28T23:07:48.344 INFO:tasks.workunit.client.1.smithi184.stdout:6/838: dwrite dc/de/d10/f38 [0,4194304] 0 2024-02-28T23:07:48.344 INFO:tasks.workunit.client.1.smithi184.stdout:2/879: chown d10/d1f/c7f 51250410 1 2024-02-28T23:07:48.345 INFO:tasks.workunit.client.1.smithi184.stdout:5/936: sync 2024-02-28T23:07:48.346 INFO:tasks.workunit.client.1.smithi184.stdout:7/879: rename d6/d68/f75 to d6/d9/d13/d3e/dad/d49/da6/daf/d47/f132 0 2024-02-28T23:07:48.348 INFO:tasks.workunit.client.1.smithi184.stdout:0/951: mkdir d0/d1d/d3a/da9/d11b/d147 0 2024-02-28T23:07:48.348 INFO:tasks.workunit.client.1.smithi184.stdout:5/937: chown db/d90/f124 730578564 1 2024-02-28T23:07:48.349 INFO:tasks.workunit.client.1.smithi184.stdout:1/970: mknod d20/d32/d3e/dc9/d11e/c14b 0 2024-02-28T23:07:48.350 INFO:tasks.workunit.client.1.smithi184.stdout:8/939: creat d1/da/dc/d16/d29/f150 x:0 0 0 2024-02-28T23:07:48.352 INFO:tasks.workunit.client.1.smithi184.stdout:8/940: readlink d1/da/l6c 0 2024-02-28T23:07:48.353 INFO:tasks.workunit.client.1.smithi184.stdout:3/972: dread d1/d4/d1c/d62/d66/da6/fca [0,4194304] 0 2024-02-28T23:07:48.355 INFO:tasks.workunit.client.1.smithi184.stdout:3/973: readlink d1/d4/l48 0 2024-02-28T23:07:48.357 INFO:tasks.workunit.client.1.smithi184.stdout:3/974: readlink d1/d4/d1c/d62/lde 0 2024-02-28T23:07:48.359 INFO:tasks.workunit.client.1.smithi184.stdout:6/839: creat dc/d60/d62/d6f/d99/d9d/f108 x:0 0 0 2024-02-28T23:07:48.362 INFO:tasks.workunit.client.1.smithi184.stdout:1/971: fsync d20/d32/d3e/d82/d85/d8c/fc6 0 2024-02-28T23:07:48.367 INFO:tasks.workunit.client.1.smithi184.stdout:4/924: dread d1/d8/d35/fc0 [0,4194304] 0 2024-02-28T23:07:48.370 INFO:tasks.workunit.client.1.smithi184.stdout:8/941: creat d1/da/d10/d43/d124/dac/dc5/f151 x:0 0 0 2024-02-28T23:07:48.372 INFO:tasks.workunit.client.1.smithi184.stdout:6/840: readlink dc/d60/l67 0 2024-02-28T23:07:48.377 INFO:tasks.workunit.client.1.smithi184.stdout:5/938: dread db/d12/d1c/d21/d2f/f4e [0,4194304] 0 2024-02-28T23:07:48.379 INFO:tasks.workunit.client.1.smithi184.stdout:5/939: chown db/d12/d1c/d80/ffe 1724600 1 2024-02-28T23:07:48.380 INFO:tasks.workunit.client.1.smithi184.stdout:9/915: rename d5/d26/l3a to d5/db/l132 0 2024-02-28T23:07:48.382 INFO:tasks.workunit.client.1.smithi184.stdout:3/975: mknod d1/d4/d1c/d61/d87/d133/c137 0 2024-02-28T23:07:48.385 INFO:tasks.workunit.client.1.smithi184.stdout:9/916: truncate d5/db/de/d10/fef 264971 0 2024-02-28T23:07:48.387 INFO:tasks.workunit.client.1.smithi184.stdout:0/952: mkdir d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/dac/d148 0 2024-02-28T23:07:48.389 INFO:tasks.workunit.client.1.smithi184.stdout:1/972: symlink d20/d46/l14c 0 2024-02-28T23:07:48.391 INFO:tasks.workunit.client.1.smithi184.stdout:8/942: dwrite d1/da/dc/d16/d29/f11f [0,4194304] 0 2024-02-28T23:07:48.392 INFO:tasks.workunit.client.1.smithi184.stdout:2/880: dread d10/fdc [0,4194304] 0 2024-02-28T23:07:48.392 INFO:tasks.workunit.client.1.smithi184.stdout:3/976: creat d1/d4/d1c/d61/d87/d133/f138 x:0 0 0 2024-02-28T23:07:48.392 INFO:tasks.workunit.client.1.smithi184.stdout:1/973: read - d20/d32/db0/f125 zero size 2024-02-28T23:07:48.393 INFO:tasks.workunit.client.1.smithi184.stdout:9/917: symlink d5/db/d65/l133 0 2024-02-28T23:07:48.394 INFO:tasks.workunit.client.1.smithi184.stdout:7/880: dread d6/d9/d13/d3e/fa0 [0,4194304] 0 2024-02-28T23:07:48.397 INFO:tasks.workunit.client.1.smithi184.stdout:6/841: getdents dc/d60/d62/d6f/d99 0 2024-02-28T23:07:48.399 INFO:tasks.workunit.client.1.smithi184.stdout:2/881: creat d10/d55/f11b x:0 0 0 2024-02-28T23:07:48.400 INFO:tasks.workunit.client.1.smithi184.stdout:5/940: creat db/d12/d18/f125 x:0 0 0 2024-02-28T23:07:48.410 INFO:tasks.workunit.client.1.smithi184.stdout:5/941: mkdir db/d12/d1c/d9b/d126 0 2024-02-28T23:07:48.410 INFO:tasks.workunit.client.1.smithi184.stdout:7/881: dread d6/d9/d13/d14/d45/ffa [0,4194304] 0 2024-02-28T23:07:48.411 INFO:tasks.workunit.client.1.smithi184.stdout:0/953: write d0/df/fff [631689,115667] 0 2024-02-28T23:07:48.412 INFO:tasks.workunit.client.1.smithi184.stdout:3/977: creat d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d67/dc1/d12d/f139 x:0 0 0 2024-02-28T23:07:48.414 INFO:tasks.workunit.client.1.smithi184.stdout:8/943: mkdir d1/da/dc/d16/d32/d134/d152 0 2024-02-28T23:07:48.416 INFO:tasks.workunit.client.1.smithi184.stdout:9/918: getdents d5/db/de/de1 0 2024-02-28T23:07:48.417 INFO:tasks.workunit.client.1.smithi184.stdout:1/974: creat d20/d32/d3e/d61/d8b/f14d x:0 0 0 2024-02-28T23:07:48.418 INFO:tasks.workunit.client.1.smithi184.stdout:2/882: dwrite d10/d1f/d21/d5e/d15/d24/f56 [0,4194304] 0 2024-02-28T23:07:48.419 INFO:tasks.workunit.client.1.smithi184.stdout:7/882: creat d6/d9/da/f133 x:0 0 0 2024-02-28T23:07:48.419 INFO:tasks.workunit.client.1.smithi184.stdout:0/954: fdatasync d0/d1f/de3/fae 0 2024-02-28T23:07:48.420 INFO:tasks.workunit.client.1.smithi184.stdout:5/942: rename db/d12/d1c/d21/d4d/d11c to db/d12/df0/df4/d127 0 2024-02-28T23:07:48.421 INFO:tasks.workunit.client.1.smithi184.stdout:2/883: chown d10/d55/d89/db5/de7 0 1 2024-02-28T23:07:48.422 INFO:tasks.workunit.client.1.smithi184.stdout:0/955: fsync d0/df/fff 0 2024-02-28T23:07:48.431 INFO:tasks.workunit.client.1.smithi184.stdout:2/884: chown d10/d33/lf7 563113833 1 2024-02-28T23:07:48.432 INFO:tasks.workunit.client.1.smithi184.stdout:5/943: mkdir db/d12/d1c/d21/d2f/dc4/df5/d128 0 2024-02-28T23:07:48.436 INFO:tasks.workunit.client.1.smithi184.stdout:3/978: write d1/d4/d1c/d61/f90 [408886,52921] 0 2024-02-28T23:07:48.440 INFO:tasks.workunit.client.1.smithi184.stdout:9/919: dwrite d5/d47/f11f [0,4194304] 0 2024-02-28T23:07:48.443 INFO:tasks.workunit.client.1.smithi184.stdout:7/883: write d6/d9/d13/d14/f12b [392534,61464] 0 2024-02-28T23:07:48.444 INFO:tasks.workunit.client.1.smithi184.stdout:8/944: dread d1/da/d10/d17/f9c [4194304,4194304] 0 2024-02-28T23:07:48.447 INFO:tasks.workunit.client.1.smithi184.stdout:3/979: creat d1/d4/d1c/d62/d66/dd3/d26/d3a/f13a x:0 0 0 2024-02-28T23:07:48.451 INFO:tasks.workunit.client.1.smithi184.stdout:7/884: read - d6/d9/d13/d3e/dad/d7d/f6b zero size 2024-02-28T23:07:48.454 INFO:tasks.workunit.client.1.smithi184.stdout:8/945: unlink d1/da/c91 0 2024-02-28T23:07:48.454 INFO:tasks.workunit.client.1.smithi184.stdout:3/980: dread - d1/d4/d6/d1e/ff9 zero size 2024-02-28T23:07:48.454 INFO:tasks.workunit.client.1.smithi184.stdout:2/885: truncate d10/f14 1680250 0 2024-02-28T23:07:48.456 INFO:tasks.workunit.client.1.smithi184.stdout:8/946: chown d1/l4 30632822 1 2024-02-28T23:07:48.458 INFO:tasks.workunit.client.1.smithi184.stdout:2/886: dread - d10/d55/ffb zero size 2024-02-28T23:07:48.461 INFO:tasks.workunit.client.1.smithi184.stdout:8/947: chown d1/da/d10/c13c 528722903 1 2024-02-28T23:07:48.461 INFO:tasks.workunit.client.1.smithi184.stdout:1/975: dread d20/d46/f57 [0,4194304] 0 2024-02-28T23:07:48.468 INFO:tasks.workunit.client.1.smithi184.stdout:5/944: dwrite db/d12/d1c/d21/f75 [0,4194304] 0 2024-02-28T23:07:48.468 INFO:tasks.workunit.client.1.smithi184.stdout:8/948: fsync d1/da/dc/d18/f10f 0 2024-02-28T23:07:48.468 INFO:tasks.workunit.client.1.smithi184.stdout:9/920: dwrite d5/d47/d59/d92/fc0 [0,4194304] 0 2024-02-28T23:07:48.468 INFO:tasks.workunit.client.1.smithi184.stdout:7/885: dread d6/d9/d13/d3e/fa0 [0,4194304] 0 2024-02-28T23:07:48.468 INFO:tasks.workunit.client.1.smithi184.stdout:1/976: dread - d20/d32/d3e/d82/d85/d86/fd7 zero size 2024-02-28T23:07:48.474 INFO:tasks.workunit.client.1.smithi184.stdout:7/886: symlink d6/d68/l134 0 2024-02-28T23:07:48.476 INFO:tasks.workunit.client.1.smithi184.stdout:0/956: dread d0/df/f7a [0,4194304] 0 2024-02-28T23:07:48.477 INFO:tasks.workunit.client.1.smithi184.stdout:8/949: dread d1/da/dc/fb6 [0,4194304] 0 2024-02-28T23:07:48.482 INFO:tasks.workunit.client.1.smithi184.stdout:3/981: truncate d1/d4/f89 2161545 0 2024-02-28T23:07:48.483 INFO:tasks.workunit.client.1.smithi184.stdout:2/887: rename d10/d1f/d38/d54/f83 to d10/d1f/d21/d4d/d67/f11c 0 2024-02-28T23:07:48.488 INFO:tasks.workunit.client.1.smithi184.stdout:0/957: truncate d0/d1d/d3a/da9/d11b/d27/d31/f128 525516 0 2024-02-28T23:07:48.490 INFO:tasks.workunit.client.1.smithi184.stdout:4/925: sync 2024-02-28T23:07:48.495 INFO:tasks.workunit.client.1.smithi184.stdout:7/887: write d6/d9/d13/d3e/fa0 [1113417,75475] 0 2024-02-28T23:07:48.496 INFO:tasks.workunit.client.1.smithi184.stdout:1/977: truncate d20/d32/d3e/d82/fa8 825056 0 2024-02-28T23:07:48.499 INFO:tasks.workunit.client.1.smithi184.stdout:5/945: truncate db/d12/d1c/d21/f75 2286556 0 2024-02-28T23:07:48.501 INFO:tasks.workunit.client.1.smithi184.stdout:7/888: read - d6/d9/d13/d3e/dad/d49/d9c/ffb zero size 2024-02-28T23:07:48.501 INFO:tasks.workunit.client.1.smithi184.stdout:4/926: creat d1/dc/df/d5b/db2/d9f/f125 x:0 0 0 2024-02-28T23:07:48.502 INFO:tasks.workunit.client.1.smithi184.stdout:2/888: symlink d10/l11d 0 2024-02-28T23:07:48.502 INFO:tasks.workunit.client.1.smithi184.stdout:9/921: dwrite d5/db/de/d10/d12/d2f/d3f/f12b [0,4194304] 0 2024-02-28T23:07:48.506 INFO:tasks.workunit.client.1.smithi184.stdout:9/922: fsync d5/d17/d43/f48 0 2024-02-28T23:07:48.510 INFO:tasks.workunit.client.1.smithi184.stdout:1/978: dread - d20/d32/d3e/d61/fe3 zero size 2024-02-28T23:07:48.514 INFO:tasks.workunit.client.1.smithi184.stdout:8/950: dwrite d1/da/df/d20/dc7/fcf [0,4194304] 0 2024-02-28T23:07:48.522 INFO:tasks.workunit.client.1.smithi184.stdout:7/889: dwrite d6/d9/d13/d1e/fbc [0,4194304] 0 2024-02-28T23:07:48.522 INFO:tasks.workunit.client.1.smithi184.stdout:3/982: creat d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/f13b x:0 0 0 2024-02-28T23:07:48.525 INFO:tasks.workunit.client.1.smithi184.stdout:0/958: creat d0/d1d/d3a/da9/d11b/d27/d31/f149 x:0 0 0 2024-02-28T23:07:48.530 INFO:tasks.workunit.client.1.smithi184.stdout:1/979: dwrite d20/d32/d4b/f99 [4194304,4194304] 0 2024-02-28T23:07:48.534 INFO:tasks.workunit.client.1.smithi184.stdout:5/946: write db/d12/d1c/d21/d2f/f7a [1982148,8231] 0 2024-02-28T23:07:48.542 INFO:tasks.workunit.client.1.smithi184.stdout:2/889: creat d10/d55/d89/db5/dc0/f11e x:0 0 0 2024-02-28T23:07:48.547 INFO:tasks.workunit.client.1.smithi184.stdout:7/890: rename d6/d9/d13/d3e/dad/d49/da6/daf/d47/f132 to d6/d9/da/f135 0 2024-02-28T23:07:48.549 INFO:tasks.workunit.client.1.smithi184.stdout:7/891: stat d6/d9/d13/d3e/dad/d7d 0 2024-02-28T23:07:48.549 INFO:tasks.workunit.client.1.smithi184.stdout:0/959: read d0/d1d/d3a/da9/d11b/f3b [2677391,54380] 0 2024-02-28T23:07:48.552 INFO:tasks.workunit.client.1.smithi184.stdout:0/960: readlink d0/d1d/d3a/da9/d11b/d27/d31/d51/d85/lf9 0 2024-02-28T23:07:48.554 INFO:tasks.workunit.client.1.smithi184.stdout:5/947: rmdir db/d12 39 2024-02-28T23:07:48.557 INFO:tasks.workunit.client.1.smithi184.stdout:3/983: symlink d1/d4/d1c/d62/d66/dd3/d26/dd2/d110/l13c 0 2024-02-28T23:07:48.562 INFO:tasks.workunit.client.1.smithi184.stdout:1/980: write d20/d32/d4d/f6e [4126888,99222] 0 2024-02-28T23:07:48.566 INFO:tasks.workunit.client.1.smithi184.stdout:9/923: creat d5/d47/f134 x:0 0 0 2024-02-28T23:07:48.567 INFO:tasks.workunit.client.1.smithi184.stdout:8/951: dwrite d1/da/dc/d18/f38 [0,4194304] 0 2024-02-28T23:07:48.569 INFO:tasks.workunit.client.1.smithi184.stdout:0/961: mknod d0/d1d/d3a/da9/d11b/d27/c14a 0 2024-02-28T23:07:48.571 INFO:tasks.workunit.client.1.smithi184.stdout:3/984: unlink d1/d4/fb 0 2024-02-28T23:07:48.573 INFO:tasks.workunit.client.1.smithi184.stdout:9/924: creat d5/d47/d4a/f135 x:0 0 0 2024-02-28T23:07:48.574 INFO:tasks.workunit.client.1.smithi184.stdout:1/981: creat d20/d32/d3e/dc9/f14e x:0 0 0 2024-02-28T23:07:48.574 INFO:tasks.workunit.client.1.smithi184.stdout:5/948: creat db/d12/d1c/d21/d4d/d10e/f129 x:0 0 0 2024-02-28T23:07:48.577 INFO:tasks.workunit.client.1.smithi184.stdout:8/952: dread - d1/da/dc/d16/d4d/fe5 zero size 2024-02-28T23:07:48.579 INFO:tasks.workunit.client.1.smithi184.stdout:6/842: sync 2024-02-28T23:07:48.580 INFO:tasks.workunit.client.1.smithi184.stdout:7/892: rmdir d6/d9/d13/d3e/dad/d49/d9c/d101/d11e/d12f 0 2024-02-28T23:07:48.581 INFO:tasks.workunit.client.1.smithi184.stdout:8/953: chown d1/da/dc/d16/d4d/d82/fa8 524400 1 2024-02-28T23:07:48.582 INFO:tasks.workunit.client.1.smithi184.stdout:3/985: symlink d1/d4/d1c/d62/d66/dd3/d26/d12f/l13d 0 2024-02-28T23:07:48.583 INFO:tasks.workunit.client.1.smithi184.stdout:8/954: chown d1/da/d120 14794 1 2024-02-28T23:07:48.585 INFO:tasks.workunit.client.1.smithi184.stdout:8/955: chown d1/da/df/d20 453 1 2024-02-28T23:07:48.587 INFO:tasks.workunit.client.1.smithi184.stdout:5/949: creat db/d44/da5/ddf/f12a x:0 0 0 2024-02-28T23:07:48.594 INFO:tasks.workunit.client.1.smithi184.stdout:2/890: getdents d10/d1f/d21/d5e/d15/d60/d6f 0 2024-02-28T23:07:48.594 INFO:tasks.workunit.client.1.smithi184.stdout:5/950: fdatasync db/d90/de1/fe8 0 2024-02-28T23:07:48.598 INFO:tasks.workunit.client.1.smithi184.stdout:1/982: symlink d20/d127/l14f 0 2024-02-28T23:07:48.599 INFO:tasks.workunit.client.1.smithi184.stdout:0/962: getdents d0/d1d/d4c 0 2024-02-28T23:07:48.602 INFO:tasks.workunit.client.1.smithi184.stdout:6/843: dwrite dc/d60/d7c/d61/fc4 [0,4194304] 0 2024-02-28T23:07:48.603 INFO:tasks.workunit.client.1.smithi184.stdout:2/891: mknod d10/d1f/d21/d6a/c11f 0 2024-02-28T23:07:48.604 INFO:tasks.workunit.client.1.smithi184.stdout:0/963: symlink d0/d7c/l14b 0 2024-02-28T23:07:48.605 INFO:tasks.workunit.client.1.smithi184.stdout:1/983: symlink d20/l150 0 2024-02-28T23:07:48.606 INFO:tasks.workunit.client.1.smithi184.stdout:5/951: mkdir db/d12/d18/d12b 0 2024-02-28T23:07:48.607 INFO:tasks.workunit.client.1.smithi184.stdout:0/964: readlink d0/d1d/d3a/d10d/l13b 0 2024-02-28T23:07:48.608 INFO:tasks.workunit.client.1.smithi184.stdout:1/984: stat d20/d32/d3e/d82/d85/d86/f112 0 2024-02-28T23:07:48.609 INFO:tasks.workunit.client.1.smithi184.stdout:5/952: chown db/d12/f85 126658555 1 2024-02-28T23:07:48.609 INFO:tasks.workunit.client.1.smithi184.stdout:9/925: dread d5/db/d65/dc2/f121 [0,4194304] 0 2024-02-28T23:07:48.609 INFO:tasks.workunit.client.1.smithi184.stdout:6/844: chown dc/d60/caf 18600 1 2024-02-28T23:07:48.611 INFO:tasks.workunit.client.1.smithi184.stdout:1/985: chown d20/d32/d3e/d82/d85/fa3 28 1 2024-02-28T23:07:48.611 INFO:tasks.workunit.client.1.smithi184.stdout:6/845: write dc/de/d10/f38 [185527,21990] 0 2024-02-28T23:07:48.617 INFO:tasks.workunit.client.1.smithi184.stdout:2/892: unlink d10/f14 0 2024-02-28T23:07:48.620 INFO:tasks.workunit.client.1.smithi184.stdout:7/893: dread d6/d9/d13/d3e/dad/d49/da6/daf/d47/f58 [0,4194304] 0 2024-02-28T23:07:48.621 INFO:tasks.workunit.client.1.smithi184.stdout:4/927: sync 2024-02-28T23:07:48.625 INFO:tasks.workunit.client.1.smithi184.stdout:4/928: fsync d1/dc/df/f82 0 2024-02-28T23:07:48.625 INFO:tasks.workunit.client.1.smithi184.stdout:5/953: truncate db/d12/d18/d2e/fe5 942529 0 2024-02-28T23:07:48.631 INFO:tasks.workunit.client.1.smithi184.stdout:8/956: dwrite d1/da/dc/ff0 [0,4194304] 0 2024-02-28T23:07:48.635 INFO:tasks.workunit.client.1.smithi184.stdout:9/926: write d5/fa7 [300602,81752] 0 2024-02-28T23:07:48.636 INFO:tasks.workunit.client.1.smithi184.stdout:3/986: dwrite d1/d4/d1c/d62/d66/dd3/f2b [0,4194304] 0 2024-02-28T23:07:48.640 INFO:tasks.workunit.client.1.smithi184.stdout:5/954: rename db/d12/d1c/d21/d25/lae to db/d12/d1c/d9b/l12c 0 2024-02-28T23:07:48.643 INFO:tasks.workunit.client.1.smithi184.stdout:7/894: creat d6/d9/f136 x:0 0 0 2024-02-28T23:07:48.647 INFO:tasks.workunit.client.1.smithi184.stdout:0/965: truncate d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/f101 175904 0 2024-02-28T23:07:48.648 INFO:tasks.workunit.client.1.smithi184.stdout:1/986: write d20/d46/d90/db3/fc4 [766215,3466] 0 2024-02-28T23:07:48.649 INFO:tasks.workunit.client.1.smithi184.stdout:4/929: rename d1/d4 to d1/dc/df/d5b/db2/d9f/da0/d126 0 2024-02-28T23:07:48.651 INFO:tasks.workunit.client.1.smithi184.stdout:6/846: dwrite dc/d60/d62/f82 [4194304,4194304] 0 2024-02-28T23:07:48.655 INFO:tasks.workunit.client.1.smithi184.stdout:4/930: readlink d1/dc/d117/l112 0 2024-02-28T23:07:48.657 INFO:tasks.workunit.client.1.smithi184.stdout:3/987: mkdir d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/d82/d13e 0 2024-02-28T23:07:48.658 INFO:tasks.workunit.client.1.smithi184.stdout:1/987: creat d20/d46/d90/de1/f151 x:0 0 0 2024-02-28T23:07:48.658 INFO:tasks.workunit.client.1.smithi184.stdout:7/895: truncate d6/d9/d13/d3e/dad/d49/da6/f10f 270213 0 2024-02-28T23:07:48.659 INFO:tasks.workunit.client.1.smithi184.stdout:5/955: rename db/da4/ff8 to db/d12/d1c/d21/d2f/dc4/f12d 0 2024-02-28T23:07:48.662 INFO:tasks.workunit.client.1.smithi184.stdout:6/847: mknod dc/d60/d6d/c109 0 2024-02-28T23:07:48.663 INFO:tasks.workunit.client.1.smithi184.stdout:7/896: dread - d6/d9/d13/d14/d45/f118 zero size 2024-02-28T23:07:48.666 INFO:tasks.workunit.client.1.smithi184.stdout:4/931: mknod d1/dc/df/d3b/d5c/c127 0 2024-02-28T23:07:48.666 INFO:tasks.workunit.client.1.smithi184.stdout:6/848: stat dc/de/ld1 0 2024-02-28T23:07:48.670 INFO:tasks.workunit.client.1.smithi184.stdout:3/988: read d1/d4/d5/da9/f77 [1051593,81445] 0 2024-02-28T23:07:48.675 INFO:tasks.workunit.client.1.smithi184.stdout:5/956: mkdir db/d12/d1c/d21/d2f/dc4/df5/d12e 0 2024-02-28T23:07:48.675 INFO:tasks.workunit.client.1.smithi184.stdout:0/966: dwrite d0/d7c/f144 [0,4194304] 0 2024-02-28T23:07:48.676 INFO:tasks.workunit.client.1.smithi184.stdout:2/893: write d10/fb1 [789370,40043] 0 2024-02-28T23:07:48.676 INFO:tasks.workunit.client.1.smithi184.stdout:4/932: dread d1/f12 [0,4194304] 0 2024-02-28T23:07:48.676 INFO:tasks.workunit.client.1.smithi184.stdout:3/989: chown d1/d4/d1c/d61/d120/f91 45390 1 2024-02-28T23:07:48.677 INFO:tasks.workunit.client.1.smithi184.stdout:7/897: mknod d6/d9/d13/d14/d106/c137 0 2024-02-28T23:07:48.682 INFO:tasks.workunit.client.1.smithi184.stdout:5/957: write db/d12/d1c/d21/d4d/d10e/d5d/f54 [261342,114107] 0 2024-02-28T23:07:48.683 INFO:tasks.workunit.client.1.smithi184.stdout:9/927: write d5/db/de/de1/f11b [1084158,128790] 0 2024-02-28T23:07:48.684 INFO:tasks.workunit.client.1.smithi184.stdout:0/967: fdatasync d0/d1f/de3/fea 0 2024-02-28T23:07:48.693 INFO:tasks.workunit.client.1.smithi184.stdout:8/957: dwrite d1/da/dc/d16/fbc [0,4194304] 0 2024-02-28T23:07:48.694 INFO:tasks.workunit.client.1.smithi184.stdout:4/933: dread d1/dc/d117/ddd/dfe/fab [0,4194304] 0 2024-02-28T23:07:48.697 INFO:tasks.workunit.client.1.smithi184.stdout:0/968: rmdir d0/d11d/d108/d11c 39 2024-02-28T23:07:48.699 INFO:tasks.workunit.client.1.smithi184.stdout:2/894: dread d10/d1f/d21/d5e/d15/d24/fa5 [0,4194304] 0 2024-02-28T23:07:48.699 INFO:tasks.workunit.client.1.smithi184.stdout:0/969: chown d0/d1d/d4c/fdd 1302802 1 2024-02-28T23:07:48.701 INFO:tasks.workunit.client.1.smithi184.stdout:9/928: creat d5/db/de/d10/d12/d2f/d3f/d8d/f136 x:0 0 0 2024-02-28T23:07:48.702 INFO:tasks.workunit.client.1.smithi184.stdout:7/898: truncate f0 3774620 0 2024-02-28T23:07:48.704 INFO:tasks.workunit.client.1.smithi184.stdout:8/958: fsync d1/da/dc/d16/d4d/fe5 0 2024-02-28T23:07:48.712 INFO:tasks.workunit.client.1.smithi184.stdout:4/934: mknod d1/dc/df/d5b/db2/d9f/da0/d126/d43/c128 0 2024-02-28T23:07:48.712 INFO:tasks.workunit.client.1.smithi184.stdout:0/970: readlink d0/d1d/d3a/da9/d11b/d27/l36 0 2024-02-28T23:07:48.714 INFO:tasks.workunit.client.1.smithi184.stdout:9/929: mknod d5/d47/d68/d7c/df4/c137 0 2024-02-28T23:07:48.715 INFO:tasks.workunit.client.1.smithi184.stdout:1/988: link d20/d32/cd5 d20/d32/d3e/d82/d85/c152 0 2024-02-28T23:07:48.715 INFO:tasks.workunit.client.1.smithi184.stdout:9/930: readlink d5/d17/d43/lb0 0 2024-02-28T23:07:48.717 INFO:tasks.workunit.client.1.smithi184.stdout:1/989: chown d20/d46/d90/f5e 46 1 2024-02-28T23:07:48.722 INFO:tasks.workunit.client.1.smithi184.stdout:8/959: read d1/da/dc/d16/d32/d80/f14e [282100,41433] 0 2024-02-28T23:07:48.723 INFO:tasks.workunit.client.1.smithi184.stdout:6/849: link dc/d60/d7c/d90/de2/ce3 dc/d60/d7c/df9/c10a 0 2024-02-28T23:07:48.730 INFO:tasks.workunit.client.1.smithi184.stdout:2/895: dwrite d10/d1f/d21/d5e/d15/d60/f9a [0,4194304] 0 2024-02-28T23:07:48.731 INFO:tasks.workunit.client.1.smithi184.stdout:0/971: mkdir d0/d1d/d3a/da9/df5/d136/d14c 0 2024-02-28T23:07:48.734 INFO:tasks.workunit.client.1.smithi184.stdout:6/850: creat dc/d60/d7c/d61/dd2/f10b x:0 0 0 2024-02-28T23:07:48.734 INFO:tasks.workunit.client.1.smithi184.stdout:8/960: unlink d1/da/d10/d43/d124/dac/dc5/c102 0 2024-02-28T23:07:48.735 INFO:tasks.workunit.client.1.smithi184.stdout:2/896: write d10/d1f/d38/d54/f10f [3055997,43178] 0 2024-02-28T23:07:48.737 INFO:tasks.workunit.client.1.smithi184.stdout:9/931: dwrite d5/d47/d59/d92/fb4 [0,4194304] 0 2024-02-28T23:07:48.737 INFO:tasks.workunit.client.1.smithi184.stdout:4/935: link d1/dc/df/d3b/d5c/c127 d1/dc/df/d5b/db2/d9f/da0/d126/c129 0 2024-02-28T23:07:48.742 INFO:tasks.workunit.client.1.smithi184.stdout:7/899: dwrite d6/d9/d13/d3e/dad/d7d/d6c/f81 [4194304,4194304] 0 2024-02-28T23:07:48.747 INFO:tasks.workunit.client.1.smithi184.stdout:8/961: write d1/da/dc/d16/d32/f141 [921866,99629] 0 2024-02-28T23:07:48.750 INFO:tasks.workunit.client.1.smithi184.stdout:4/936: creat d1/d8/d19/d67/d87/f12a x:0 0 0 2024-02-28T23:07:48.750 INFO:tasks.workunit.client.1.smithi184.stdout:7/900: write d6/d9/da/f31 [2646015,70962] 0 2024-02-28T23:07:48.753 INFO:tasks.workunit.client.1.smithi184.stdout:4/937: dread - d1/dc/df/d5b/d6c/f123 zero size 2024-02-28T23:07:48.760 INFO:tasks.workunit.client.1.smithi184.stdout:4/938: read d1/d8/d19/d92/f65 [1305614,102506] 0 2024-02-28T23:07:48.765 INFO:tasks.workunit.client.1.smithi184.stdout:1/990: write d20/d32/d4d/f7d [750364,80494] 0 2024-02-28T23:07:48.770 INFO:tasks.workunit.client.1.smithi184.stdout:1/991: truncate d20/d32/db0/f125 849664 0 2024-02-28T23:07:48.770 INFO:tasks.workunit.client.1.smithi184.stdout:4/939: mkdir d1/d8/d19/d56/d12b 0 2024-02-28T23:07:48.774 INFO:tasks.workunit.client.1.smithi184.stdout:9/932: rename d5/db/de/d10/d12/d2f/l31 to d5/db/l138 0 2024-02-28T23:07:48.778 INFO:tasks.workunit.client.1.smithi184.stdout:0/972: dwrite d0/fc [0,4194304] 0 2024-02-28T23:07:48.782 INFO:tasks.workunit.client.1.smithi184.stdout:3/990: sync 2024-02-28T23:07:48.782 INFO:tasks.workunit.client.1.smithi184.stdout:2/897: rename d10/d1f/d21/d6a/lc5 to d10/d1f/d21/d5e/dad/da3/dfa/l120 0 2024-02-28T23:07:48.784 INFO:tasks.workunit.client.1.smithi184.stdout:6/851: dread dc/d60/d62/f82 [0,4194304] 0 2024-02-28T23:07:48.784 INFO:tasks.workunit.client.1.smithi184.stdout:4/940: readlink d1/dc/df/d5b/d97/l10f 0 2024-02-28T23:07:48.788 INFO:tasks.workunit.client.1.smithi184.stdout:0/973: mknod d0/db2/c14d 0 2024-02-28T23:07:48.789 INFO:tasks.workunit.client.1.smithi184.stdout:7/901: dwrite d6/f127 [0,4194304] 0 2024-02-28T23:07:48.794 INFO:tasks.workunit.client.1.smithi184.stdout:9/933: symlink d5/d26/d50/d12a/l139 0 2024-02-28T23:07:48.794 INFO:tasks.workunit.client.1.smithi184.stdout:4/941: mkdir d1/dc/d12c 0 2024-02-28T23:07:48.794 INFO:tasks.workunit.client.1.smithi184.stdout:6/852: chown dc/d60/d7c/d61/dd2/lfa 449 1 2024-02-28T23:07:48.794 INFO:tasks.workunit.client.1.smithi184.stdout:3/991: mkdir d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/dee/d13f 0 2024-02-28T23:07:48.795 INFO:tasks.workunit.client.1.smithi184.stdout:2/898: mkdir d10/d1f/d21/d5e/d121 0 2024-02-28T23:07:48.796 INFO:tasks.workunit.client.1.smithi184.stdout:6/853: read - dc/d60/d7c/d61/f105 zero size 2024-02-28T23:07:48.799 INFO:tasks.workunit.client.1.smithi184.stdout:3/992: chown d1/d4/d1c/d62/d66/dd3/d26/d3a/d59/dee 1105326507 1 2024-02-28T23:07:48.801 INFO:tasks.workunit.client.1.smithi184.stdout:9/934: fsync d5/d26/fb5 0 2024-02-28T23:07:48.802 INFO:tasks.workunit.client.1.smithi184.stdout:8/962: dread d1/da/d10/d17/d63/f68 [0,4194304] 0 2024-02-28T23:07:48.802 INFO:tasks.workunit.client.1.smithi184.stdout:3/993: truncate d1/d4/d5/f111 532712 0 2024-02-28T23:07:48.803 INFO:tasks.workunit.client.1.smithi184.stdout:4/942: creat d1/d8/d19/d92/db3/d100/f12d x:0 0 0 2024-02-28T23:07:48.804 INFO:tasks.workunit.client.1.smithi184.stdout:8/963: chown d1/f99 22468 1 2024-02-28T23:07:48.806 INFO:tasks.workunit.client.1.smithi184.stdout:2/899: chown d10/fdc 925074 1 2024-02-28T23:07:48.806 INFO:tasks.workunit.client.1.smithi184.stdout:1/992: dread d20/d46/d90/f92 [0,4194304] 0 2024-02-28T23:07:48.807 INFO:tasks.workunit.client.1.smithi184.stdout:4/943: chown d1/dc/df/d5b/db2/d9f/da0/d126/d43 52552791 1 2024-02-28T23:07:48.809 INFO:tasks.workunit.client.1.smithi184.stdout:7/902: mkdir d6/d9/d13/d14/d45/df3/d138 0 2024-02-28T23:07:48.811 INFO:tasks.workunit.client.1.smithi184.stdout:2/900: write d10/d55/ff0 [1010270,40309] 0 2024-02-28T23:07:48.811 INFO:tasks.workunit.client.1.smithi184.stdout:4/944: truncate d1/d8/d19/d92/db3/d100/f12d 940638 0 2024-02-28T23:07:48.813 INFO:tasks.workunit.client.1.smithi184.stdout:7/903: write d6/d9/d13/d3e/d7e/ff6 [825404,103792] 0 2024-02-28T23:07:48.814 INFO:tasks.workunit.client.1.smithi184.stdout:9/935: creat d5/db/de/d10/d12/d2f/d7d/f13a x:0 0 0 2024-02-28T23:07:48.814 INFO:tasks.workunit.client.1.smithi184.stdout:4/945: write d1/d8/d3d/f74 [1024183,22160] 0 2024-02-28T23:07:48.817 INFO:tasks.workunit.client.1.smithi184.stdout:7/904: write d6/d9/d13/d14/d45/f10a [81507,20958] 0 2024-02-28T23:07:48.819 INFO:tasks.workunit.client.1.smithi184.stdout:8/964: creat d1/da/d10/d43/da1/de0/f153 x:0 0 0 2024-02-28T23:07:48.825 INFO:tasks.workunit.client.1.smithi184.stdout:0/974: getdents d0/db2 0 2024-02-28T23:07:48.830 INFO:tasks.workunit.client.1.smithi184.stdout:4/946: creat d1/dc/df/d5b/db2/d9f/da0/d126/d43/f12e x:0 0 0 2024-02-28T23:07:48.833 INFO:tasks.workunit.client.1.smithi184.stdout:1/993: write d20/d46/d90/de1/fe7 [969366,25367] 0 2024-02-28T23:07:48.833 INFO:tasks.workunit.client.1.smithi184.stdout:6/854: dwrite dc/de/d10/d16/f96 [0,4194304] 0 2024-02-28T23:07:48.837 INFO:tasks.workunit.client.1.smithi184.stdout:9/936: link d5/db/de/d10/d6a/f115 d5/d47/d4a/f13b 0 2024-02-28T23:07:48.838 INFO:tasks.workunit.client.1.smithi184.stdout:1/994: chown d20/d32/dc0/cd4 159904 1 2024-02-28T23:07:48.839 INFO:tasks.workunit.client.1.smithi184.stdout:3/994: dwrite d1/d4/d5/d40/fa1 [0,4194304] 0 2024-02-28T23:07:48.840 INFO:tasks.workunit.client.1.smithi184.stdout:9/937: readlink d5/d47/d68/d7c/df4/l107 0 2024-02-28T23:07:48.842 INFO:tasks.workunit.client.1.smithi184.stdout:2/901: creat d10/f122 x:0 0 0 2024-02-28T23:07:48.843 INFO:tasks.workunit.client.1.smithi184.stdout:7/905: symlink d6/d9/d13/d3e/dad/d49/d50/df8/d33/d123/d12a/l139 0 2024-02-28T23:07:48.844 INFO:tasks.workunit.client.1.smithi184.stdout:8/965: rename d1/da/d10/d43/da1/de0/f153 to d1/da/dc/d16/d29/d7d/dfa/f154 0 2024-02-28T23:07:48.846 INFO:tasks.workunit.client.1.smithi184.stdout:5/958: sync 2024-02-28T23:07:48.848 INFO:tasks.workunit.client.1.smithi184.stdout:1/995: rmdir d20/d32/d3e/d91/df2 39 2024-02-28T23:07:48.853 INFO:tasks.workunit.client.1.smithi184.stdout:6/855: symlink dc/de/d10/l10c 0 2024-02-28T23:07:48.853 INFO:tasks.workunit.client.1.smithi184.stdout:4/947: dwrite d1/d8/d19/d56/d7a/faf [0,4194304] 0 2024-02-28T23:07:48.856 INFO:tasks.workunit.client.1.smithi184.stdout:4/948: chown d1/f12 7 1 2024-02-28T23:07:48.864 INFO:tasks.workunit.client.1.smithi184.stdout:6/856: stat dc/de/d2a/d5c/d79/db9/de6/l100 0 2024-02-28T23:07:48.865 INFO:tasks.workunit.client.1.smithi184.stdout:0/975: dwrite d0/d1d/d3a/da9/d11b/f64 [0,4194304] 0 2024-02-28T23:07:48.869 INFO:tasks.workunit.client.1.smithi184.stdout:2/902: rmdir d10/d1f/d21/d6a 39 2024-02-28T23:07:48.869 INFO:tasks.workunit.client.1.smithi184.stdout:3/995: rmdir d1/d4/d5/da9/d115 39 2024-02-28T23:07:48.870 INFO:tasks.workunit.client.1.smithi184.stdout:7/906: write f4 [1230359,99373] 0 2024-02-28T23:07:48.878 INFO:tasks.workunit.client.1.smithi184.stdout:5/959: dwrite db/d12/d1c/d21/d4d/d10e/d5d/ff6 [0,4194304] 0 2024-02-28T23:07:48.886 INFO:tasks.workunit.client.1.smithi184.stdout:2/903: dwrite d10/d1f/d21/d5e/d15/d24/f56 [0,4194304] 0 2024-02-28T23:07:48.909 INFO:tasks.workunit.client.1.smithi184.stdout:8/966: creat d1/da/dc/d148/f155 x:0 0 0 2024-02-28T23:07:48.909 INFO:tasks.workunit.client.1.smithi184.stdout:9/938: creat d5/d47/d59/f13c x:0 0 0 2024-02-28T23:07:48.910 INFO:tasks.workunit.client.1.smithi184.stdout:4/949: creat d1/d9a/dd0/f12f x:0 0 0 2024-02-28T23:07:48.912 INFO:tasks.workunit.client.1.smithi184.stdout:6/857: read dc/d42/f7e [2697537,100686] 0 2024-02-28T23:07:48.912 INFO:tasks.workunit.client.1.smithi184.stdout:9/939: dread - d5/db/de/d112/f11c zero size 2024-02-28T23:07:48.913 INFO:tasks.workunit.client.1.smithi184.stdout:0/976: rename d0/d1f/d109/d71/f125 to d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/d106/f14e 0 2024-02-28T23:07:48.914 INFO:tasks.workunit.client.1.smithi184.stdout:9/940: write d5/db/f10f [70810,51703] 0 2024-02-28T23:07:48.914 INFO:tasks.workunit.client.1.smithi184.stdout:7/907: symlink d6/d9/d13/d3e/dad/d49/d50/df8/d33/d123/d12a/l13a 0 2024-02-28T23:07:48.916 INFO:tasks.workunit.client.1.smithi184.stdout:5/960: creat db/d12/d50/ddc/f12f x:0 0 0 2024-02-28T23:07:48.917 INFO:tasks.workunit.client.1.smithi184.stdout:1/996: creat d20/d32/d3e/d82/f153 x:0 0 0 2024-02-28T23:07:48.921 INFO:tasks.workunit.client.1.smithi184.stdout:4/950: fdatasync d1/d8/d19/d92/f65 0 2024-02-28T23:07:48.921 INFO:tasks.workunit.client.1.smithi184.stdout:2/904: getdents d10/d1f/d21/d117 0 2024-02-28T23:07:48.922 INFO:tasks.workunit.client.1.smithi184.stdout:0/977: truncate d0/d1f/de3/fae 5440 0 2024-02-28T23:07:48.923 INFO:tasks.workunit.client.1.smithi184.stdout:9/941: mknod d5/db/de/d10/d12/d2f/d3f/d8d/d127/c13d 0 2024-02-28T23:07:48.926 INFO:tasks.workunit.client.1.smithi184.stdout:0/978: read d0/d1d/d4c/f6b [182872,28357] 0 2024-02-28T23:07:48.927 INFO:tasks.workunit.client.1.smithi184.stdout:1/997: truncate d20/d32/d4b/fe0 1268523 0 2024-02-28T23:07:48.933 INFO:tasks.workunit.client.1.smithi184.stdout:1/998: symlink d20/d32/d3e/d82/d85/dfc/l154 0 2024-02-28T23:07:48.934 INFO:tasks.workunit.client.1.smithi184.stdout:0/979: unlink d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/fb5 0 2024-02-28T23:07:48.937 INFO:tasks.workunit.client.1.smithi184.stdout:2/905: link d10/d55/d89/db5/dc0/f11e d10/d1f/d21/d5e/dad/da3/dd6/dab/f123 0 2024-02-28T23:07:48.938 INFO:tasks.workunit.client.1.smithi184.stdout:7/908: getdents d6/d9/d13/d3e/dad/d49/d50/df8/d98 0 2024-02-28T23:07:48.938 INFO:tasks.workunit.client.1.smithi184.stdout:6/858: dread dc/f97 [0,4194304] 0 2024-02-28T23:07:48.940 INFO:tasks.workunit.client.1.smithi184.stdout:1/999: truncate d20/d32/d3e/dc9/f14e 183282 0 2024-02-28T23:07:48.941 INFO:tasks.workunit.client.1.smithi184.stdout:0/980: symlink d0/d1d/d3a/da9/d11b/l14f 0 2024-02-28T23:07:48.945 INFO:tasks.workunit.client.1.smithi184.stdout:9/942: dwrite d5/db/de/d10/d6a/f100 [0,4194304] 0 2024-02-28T23:07:48.945 INFO:tasks.workunit.client.1.smithi184.stdout:7/909: chown d6/d9/d13/d3e/dad/d49/da6/daf/l10b 787427 1 2024-02-28T23:07:48.947 INFO:tasks.workunit.client.1.smithi184.stdout:4/951: dread d1/d8/f5a [0,4194304] 0 2024-02-28T23:07:48.949 INFO:tasks.workunit.client.1.smithi184.stdout:0/981: symlink d0/d1f/de3/dfd/l150 0 2024-02-28T23:07:48.949 INFO:tasks.workunit.client.1.smithi184.stdout:9/943: write d5/db/de/d10/d12/d2f/d3f/f11e [634178,65668] 0 2024-02-28T23:07:48.951 INFO:tasks.workunit.client.1.smithi184.stdout:0/982: dread - d0/fb8 zero size 2024-02-28T23:07:48.953 INFO:tasks.workunit.client.1.smithi184.stdout:7/910: creat d6/d9/d13/d3e/dad/d49/d50/df8/d98/dc4/f13b x:0 0 0 2024-02-28T23:07:48.955 INFO:tasks.workunit.client.1.smithi184.stdout:9/944: chown d5/db/de/d10/d12/d2f/fba 126 1 2024-02-28T23:07:48.962 INFO:tasks.workunit.client.1.smithi184.stdout:2/906: dwrite d10/d1f/d21/d4d/d67/f95 [0,4194304] 0 2024-02-28T23:07:48.964 INFO:tasks.workunit.client.1.smithi184.stdout:7/911: creat d6/d9/d13/d3e/dad/d49/d50/df8/d98/dc4/df1/f13c x:0 0 0 2024-02-28T23:07:48.966 INFO:tasks.workunit.client.1.smithi184.stdout:3/996: write d1/d4/d1c/d62/d66/dd3/d26/f2a [550751,40525] 0 2024-02-28T23:07:48.968 INFO:tasks.workunit.client.1.smithi184.stdout:2/907: mknod d10/d1f/d21/d5e/dad/c124 0 2024-02-28T23:07:48.969 INFO:tasks.workunit.client.1.smithi184.stdout:5/961: truncate db/f7c 2262018 0 2024-02-28T23:07:48.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:48 smithi159 ceph-mon[28802]: pgmap v43: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 61 MiB/s rd, 144 MiB/s wr, 344 op/s 2024-02-28T23:07:48.976 INFO:tasks.workunit.client.1.smithi184.stdout:2/908: symlink d10/d55/d89/l125 0 2024-02-28T23:07:48.979 INFO:tasks.workunit.client.1.smithi184.stdout:3/997: unlink d1/d4/d1c/d62/d66/dd3/d26/d3a/la2 0 2024-02-28T23:07:48.981 INFO:tasks.workunit.client.1.smithi184.stdout:9/945: dwrite d5/db/f20 [4194304,4194304] 0 2024-02-28T23:07:48.981 INFO:tasks.workunit.client.1.smithi184.stdout:7/912: creat d6/d9/d13/d3e/dad/d49/d50/df8/d33/d123/d12a/f13d x:0 0 0 2024-02-28T23:07:48.982 INFO:tasks.workunit.client.1.smithi184.stdout:6/859: dread dc/de/d10/d16/f2d [0,4194304] 0 2024-02-28T23:07:48.984 INFO:tasks.workunit.client.1.smithi184.stdout:0/983: write d0/f57 [990415,3012] 0 2024-02-28T23:07:48.984 INFO:tasks.workunit.client.1.smithi184.stdout:8/967: dwrite d1/da/dc/d18/f51 [0,4194304] 0 2024-02-28T23:07:48.986 INFO:tasks.workunit.client.1.smithi184.stdout:5/962: mkdir db/d12/d1c/d130 0 2024-02-28T23:07:48.989 INFO:tasks.workunit.client.1.smithi184.stdout:8/968: read d1/da/f89 [203140,90862] 0 2024-02-28T23:07:48.991 INFO:tasks.workunit.client.1.smithi184.stdout:0/984: chown d0/d1d/c12c 0 1 2024-02-28T23:07:48.992 INFO:tasks.workunit.client.1.smithi184.stdout:6/860: dread - dc/de/d2a/d5c/d79/db9/de6/fea zero size 2024-02-28T23:07:48.995 INFO:tasks.workunit.client.1.smithi184.stdout:4/952: dread d1/d8/d19/d92/db3/d100/f103 [0,4194304] 0 2024-02-28T23:07:48.996 INFO:tasks.workunit.client.1.smithi184.stdout:7/913: creat d6/f13e x:0 0 0 2024-02-28T23:07:48.997 INFO:tasks.workunit.client.1.smithi184.stdout:8/969: unlink d1/c13e 0 2024-02-28T23:07:48.999 INFO:tasks.workunit.client.1.smithi184.stdout:5/963: mkdir db/d12/d1c/d21/d25/dd3/df1/d131 0 2024-02-28T23:07:49.001 INFO:tasks.workunit.client.1.smithi184.stdout:3/998: rename d1/d4/d6/d1e/dfa/f12b to d1/d4/d1c/d62/d66/dd3/d26/d3a/f140 0 2024-02-28T23:07:49.003 INFO:tasks.workunit.client.1.smithi184.stdout:7/914: truncate d6/d9/d13/d14/d45/f10a 338541 0 2024-02-28T23:07:49.007 INFO:tasks.workunit.client.1.smithi184.stdout:4/953: mknod d1/d8/d19/d67/d99/c130 0 2024-02-28T23:07:49.007 INFO:tasks.workunit.client.1.smithi184.stdout:6/861: mkdir dc/d10d 0 2024-02-28T23:07:49.013 INFO:tasks.workunit.client.1.smithi184.stdout:8/970: rename d1/da/df/f114 to d1/da/dc/d16/d4d/f156 0 2024-02-28T23:07:49.013 INFO:tasks.workunit.client.1.smithi184.stdout:3/999: dread - d1/d4/d1c/d62/d66/dab/ff2 zero size 2024-02-28T23:07:49.019 INFO:tasks.workunit.client.1.smithi184.stdout:7/915: dwrite d6/d9/d13/d3e/dad/d49/d50/f61 [4194304,4194304] 0 2024-02-28T23:07:49.020 INFO:tasks.workunit.client.1.smithi184.stdout:4/954: unlink d1/d8/d19/d92/f65 0 2024-02-28T23:07:49.021 INFO:tasks.workunit.client.1.smithi184.stdout:6/862: mknod dc/d60/d62/d6f/d99/c10e 0 2024-02-28T23:07:49.023 INFO:tasks.workunit.client.1.smithi184.stdout:9/946: write d5/db/de/d10/d12/f54 [3948608,57205] 0 2024-02-28T23:07:49.027 INFO:tasks.workunit.client.1.smithi184.stdout:5/964: truncate db/d12/d18/db5/fd5 908049 0 2024-02-28T23:07:49.028 INFO:tasks.workunit.client.1.smithi184.stdout:8/971: mknod d1/da/dc/d16/d32/d80/c157 0 2024-02-28T23:07:49.029 INFO:tasks.workunit.client.1.smithi184.stdout:2/909: dwrite d10/d1f/d21/d6a/fae [0,4194304] 0 2024-02-28T23:07:49.041 INFO:tasks.workunit.client.1.smithi184.stdout:5/965: mknod db/d12/d18/db5/c132 0 2024-02-28T23:07:49.042 INFO:tasks.workunit.client.1.smithi184.stdout:7/916: creat d6/d9/d13/d3e/dad/d7d/dc9/deb/f13f x:0 0 0 2024-02-28T23:07:49.043 INFO:tasks.workunit.client.1.smithi184.stdout:9/947: dwrite d5/db/de/d10/d12/d2f/d3f/d8d/f136 [0,4194304] 0 2024-02-28T23:07:49.043 INFO:tasks.workunit.client.1.smithi184.stdout:0/985: link d0/d1d/d3a/da9/d11b/c141 d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/d106/c151 0 2024-02-28T23:07:49.047 INFO:tasks.workunit.client.1.smithi184.stdout:5/966: fsync db/d12/d1c/d21/d2f/f71 0 2024-02-28T23:07:49.048 INFO:tasks.workunit.client.1.smithi184.stdout:9/948: write d5/d47/d68/f6f [1274871,53872] 0 2024-02-28T23:07:49.048 INFO:tasks.workunit.client.1.smithi184.stdout:2/910: mknod d10/d1f/d21/c126 0 2024-02-28T23:07:49.050 INFO:tasks.workunit.client.1.smithi184.stdout:5/967: read db/d12/d1c/d21/f75 [1073875,128122] 0 2024-02-28T23:07:49.053 INFO:tasks.workunit.client.1.smithi184.stdout:7/917: symlink d6/d9/d13/d3e/dad/d49/d50/df8/d33/d123/l140 0 2024-02-28T23:07:49.053 INFO:tasks.workunit.client.1.smithi184.stdout:0/986: chown d0/d1d/d3a/da9/d11b/d27/d58/lee 38192 1 2024-02-28T23:07:49.053 INFO:tasks.workunit.client.1.smithi184.stdout:2/911: mknod d10/d55/d89/db5/de7/c127 0 2024-02-28T23:07:49.057 INFO:tasks.workunit.client.1.smithi184.stdout:5/968: dread db/f7f [0,4194304] 0 2024-02-28T23:07:49.057 INFO:tasks.workunit.client.1.smithi184.stdout:7/918: mkdir d6/d141 0 2024-02-28T23:07:49.060 INFO:tasks.workunit.client.1.smithi184.stdout:5/969: write db/d12/df0/df4/d127/f120 [117976,44905] 0 2024-02-28T23:07:49.060 INFO:tasks.workunit.client.1.smithi184.stdout:7/919: chown d6/d9/d13/d14/d45/ffa 2143721813 1 2024-02-28T23:07:49.061 INFO:tasks.workunit.client.1.smithi184.stdout:9/949: rename d5/d47/f11f to d5/db/de/d10/d12/d2f/f13e 0 2024-02-28T23:07:49.063 INFO:tasks.workunit.client.1.smithi184.stdout:2/912: dread - d10/d1f/d21/d5e/d15/d60/d66/dc6/fb7 zero size 2024-02-28T23:07:49.069 INFO:tasks.workunit.client.1.smithi184.stdout:2/913: mknod d10/d1f/d21/d5e/dad/da3/dd6/de5/c128 0 2024-02-28T23:07:49.070 INFO:tasks.workunit.client.1.smithi184.stdout:5/970: mknod db/c133 0 2024-02-28T23:07:49.074 INFO:tasks.workunit.client.1.smithi184.stdout:7/920: link d6/d9/da/f37 d6/d9/d13/d14/d45/df3/d138/f142 0 2024-02-28T23:07:49.074 INFO:tasks.workunit.client.1.smithi184.stdout:6/863: dwrite dc/de/d2a/d5c/d6e/fa4 [4194304,4194304] 0 2024-02-28T23:07:49.083 INFO:tasks.workunit.client.1.smithi184.stdout:8/972: write d1/f135 [905366,17112] 0 2024-02-28T23:07:49.088 INFO:tasks.workunit.client.1.smithi184.stdout:8/973: readlink d1/da/dc/d16/d32/d42/l128 0 2024-02-28T23:07:49.091 INFO:tasks.workunit.client.1.smithi184.stdout:5/971: dwrite db/d12/df0/df4/d127/f120 [0,4194304] 0 2024-02-28T23:07:49.096 INFO:tasks.workunit.client.1.smithi184.stdout:6/864: link dc/de/d10/d3a/c8d dc/de/d2a/d5c/d71/c10f 0 2024-02-28T23:07:49.099 INFO:tasks.workunit.client.1.smithi184.stdout:8/974: dread d1/da/dc/d16/d32/d42/d77/ddd/f117 [0,4194304] 0 2024-02-28T23:07:49.099 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:48 smithi184 ceph-mon[36198]: pgmap v43: 65 pgs: 65 active+clean; 3.8 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 61 MiB/s rd, 144 MiB/s wr, 344 op/s 2024-02-28T23:07:49.099 INFO:tasks.workunit.client.1.smithi184.stdout:2/914: dread fa [0,4194304] 0 2024-02-28T23:07:49.103 INFO:tasks.workunit.client.1.smithi184.stdout:2/915: truncate d10/d1f/d21/d6a/f109 384381 0 2024-02-28T23:07:49.104 INFO:tasks.workunit.client.1.smithi184.stdout:9/950: dread d5/db/de/d10/d12/d2f/f52 [0,4194304] 0 2024-02-28T23:07:49.113 INFO:tasks.workunit.client.1.smithi184.stdout:9/951: fdatasync d5/db/de/d10/dc9/fd9 0 2024-02-28T23:07:49.119 INFO:tasks.workunit.client.1.smithi184.stdout:5/972: getdents db/d12/d50/ddc/d106 0 2024-02-28T23:07:49.121 INFO:tasks.workunit.client.1.smithi184.stdout:6/865: dread dc/d42/f7e [0,4194304] 0 2024-02-28T23:07:49.125 INFO:tasks.workunit.client.1.smithi184.stdout:6/866: chown dc/de/f36 24 1 2024-02-28T23:07:49.125 INFO:tasks.workunit.client.1.smithi184.stdout:7/921: dwrite d6/d9/da/f37 [4194304,4194304] 0 2024-02-28T23:07:49.127 INFO:tasks.workunit.client.1.smithi184.stdout:9/952: link d5/db/de/d10/d6a/f118 d5/d17/d8f/f13f 0 2024-02-28T23:07:49.131 INFO:tasks.workunit.client.1.smithi184.stdout:5/973: unlink db/d12/d18/d2e/c4f 0 2024-02-28T23:07:49.133 INFO:tasks.workunit.client.1.smithi184.stdout:5/974: dread - db/d12/d18/db5/f122 zero size 2024-02-28T23:07:49.140 INFO:tasks.workunit.client.1.smithi184.stdout:9/953: rmdir d5/d47/d68 39 2024-02-28T23:07:49.140 INFO:tasks.workunit.client.1.smithi184.stdout:8/975: dwrite d1/da/dc/d16/d29/f2a [0,4194304] 0 2024-02-28T23:07:49.145 INFO:tasks.workunit.client.1.smithi184.stdout:5/975: mknod db/d12/d1c/d21/c134 0 2024-02-28T23:07:49.145 INFO:tasks.workunit.client.1.smithi184.stdout:6/867: link dc/d60/lec dc/de/db6/l110 0 2024-02-28T23:07:49.146 INFO:tasks.workunit.client.1.smithi184.stdout:8/976: symlink d1/da/d10/d43/da1/l158 0 2024-02-28T23:07:49.147 INFO:tasks.workunit.client.1.smithi184.stdout:2/916: dwrite d10/f34 [0,4194304] 0 2024-02-28T23:07:49.157 INFO:tasks.workunit.client.1.smithi184.stdout:8/977: creat d1/da/dc/d18/f159 x:0 0 0 2024-02-28T23:07:49.158 INFO:tasks.workunit.client.1.smithi184.stdout:7/922: dread d6/d9/d13/d3e/dad/d49/da6/daf/d65/f83 [0,4194304] 0 2024-02-28T23:07:49.160 INFO:tasks.workunit.client.1.smithi184.stdout:6/868: rename dc/cbe to dc/de/d2a/d5c/d79/d87/c111 0 2024-02-28T23:07:49.162 INFO:tasks.workunit.client.1.smithi184.stdout:6/869: write dc/d60/d7c/d61/f105 [482498,43130] 0 2024-02-28T23:07:49.165 INFO:tasks.workunit.client.1.smithi184.stdout:4/955: sync 2024-02-28T23:07:49.166 INFO:tasks.workunit.client.1.smithi184.stdout:0/987: sync 2024-02-28T23:07:49.166 INFO:tasks.workunit.client.1.smithi184.stdout:5/976: write db/d12/d1c/d21/d2f/dc4/f12d [450266,95272] 0 2024-02-28T23:07:49.167 INFO:tasks.workunit.client.1.smithi184.stdout:4/956: chown d1/dc/d117/ddd/c111 176 1 2024-02-28T23:07:49.168 INFO:tasks.workunit.client.1.smithi184.stdout:2/917: mknod d10/d1f/d21/d5e/dad/da3/dfa/c129 0 2024-02-28T23:07:49.181 INFO:tasks.workunit.client.1.smithi184.stdout:5/977: fdatasync db/d12/d18/d2e/f79 0 2024-02-28T23:07:49.187 INFO:tasks.workunit.client.1.smithi184.stdout:4/957: rmdir d1/dc/d117/ddd/dfe/d6d/dbd 39 2024-02-28T23:07:49.323 INFO:tasks.workunit.client.1.smithi184.stdout:6/870: write dc/de/d10/f3d [2477848,89274] 0 2024-02-28T23:07:49.323 INFO:tasks.workunit.client.1.smithi184.stdout:9/954: link d5/d47/d4a/ld0 d5/db/de/d10/d12/d2f/l140 0 2024-02-28T23:07:49.323 INFO:tasks.workunit.client.1.smithi184.stdout:5/978: dwrite db/d12/d18/db5/f122 [0,4194304] 0 2024-02-28T23:07:49.323 INFO:tasks.workunit.client.1.smithi184.stdout:0/988: write d0/d1d/d3a/da9/d11b/d27/d31/d5b/d8e/d92/fc1 [1622627,22058] 0 2024-02-28T23:07:49.323 INFO:tasks.workunit.client.1.smithi184.stdout:7/923: unlink d6/d9/d13/d3e/dad/d49/d50/df8/d33/d80/ca7 0 2024-02-28T23:07:49.323 INFO:tasks.workunit.client.1.smithi184.stdout:0/989: truncate d0/d1d/d3a/da9/d11b/d27/d31/d5b/f142 661613 0 2024-02-28T23:07:49.323 INFO:tasks.workunit.client.1.smithi184.stdout:4/958: chown d1/dc/df/d27/d34/cdb 608 1 2024-02-28T23:07:49.323 INFO:tasks.workunit.client.1.smithi184.stdout:2/918: dwrite d10/d55/d89/db5/dc0/f11e [0,4194304] 0 2024-02-28T23:07:49.323 INFO:tasks.workunit.client.1.smithi184.stdout:2/919: dread - d10/d1f/f114 zero size 2024-02-28T23:07:49.324 INFO:tasks.workunit.client.1.smithi184.stdout:5/979: dwrite db/d44/da5/feb [0,4194304] 0 2024-02-28T23:07:49.324 INFO:tasks.workunit.client.1.smithi184.stdout:4/959: rmdir d1/d8/d35 39 2024-02-28T23:07:49.324 INFO:tasks.workunit.client.1.smithi184.stdout:9/955: unlink d5/d47/d68/d7c/c109 0 2024-02-28T23:07:49.324 INFO:tasks.workunit.client.1.smithi184.stdout:6/871: write dc/de/f29 [910090,51002] 0 2024-02-28T23:07:49.324 INFO:tasks.workunit.client.1.smithi184.stdout:8/978: getdents d1/da/d10/d17/d125 0 2024-02-28T23:07:49.324 INFO:tasks.workunit.client.1.smithi184.stdout:6/872: write dc/de/d2a/d5c/d6e/fa4 [1008979,116450] 0 2024-02-28T23:07:49.324 INFO:tasks.workunit.client.1.smithi184.stdout:2/920: rename d10/d1f/d21/d5e/d15/l49 to d10/d1f/d21/d6a/dc2/l12a 0 2024-02-28T23:07:49.324 INFO:tasks.workunit.client.1.smithi184.stdout:7/924: unlink d6/f3d 0 2024-02-28T23:07:49.324 INFO:tasks.workunit.client.1.smithi184.stdout:0/990: symlink d0/d1d/d3a/da9/df5/d136/d14c/l152 0 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:0/991: readlink d0/d1d/d3a/da9/d11b/d27/d31/l48 0 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:9/956: dread d5/db/d65/dc2/f121 [0,4194304] 0 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:5/980: unlink db/d12/d1c/d21/d4d/d10e/d5d/d66/la8 0 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:7/925: rmdir d6/d9/d13/d14/d45/df3/d138 39 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:6/873: dwrite dc/de/f40 [0,4194304] 0 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:7/926: dread - d6/d9/d13/d14/d45/f8c zero size 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:0/992: dread d0/d1d/d3a/da9/d11b/d27/d31/d51/f8d [0,4194304] 0 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:2/921: write d10/d1f/d21/d5e/dad/da3/dd6/faa [4163514,59340] 0 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:8/979: creat d1/da/d10/d17/d125/d13d/f15a x:0 0 0 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:4/960: truncate d1/dc/df/f16 8755957 0 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:8/980: chown d1/da/dc/d16/d29/l11a 265 1 2024-02-28T23:07:49.325 INFO:tasks.workunit.client.1.smithi184.stdout:9/957: rename d5/db/d65/l12e to d5/d17/d8f/l141 0 2024-02-28T23:07:49.326 INFO:tasks.workunit.client.1.smithi184.stdout:0/993: creat d0/d1d/d3a/da9/df5/d136/f153 x:0 0 0 2024-02-28T23:07:49.326 INFO:tasks.workunit.client.1.smithi184.stdout:8/981: mknod d1/da/d10/d17/d125/d13d/c15b 0 2024-02-28T23:07:49.326 INFO:tasks.workunit.client.1.smithi184.stdout:9/958: write d5/db/f1f [4745149,61317] 0 2024-02-28T23:07:49.326 INFO:tasks.workunit.client.1.smithi184.stdout:2/922: mknod d10/d1f/d21/d5e/d15/d60/d66/c12b 0 2024-02-28T23:07:49.326 INFO:tasks.workunit.client.1.smithi184.stdout:7/927: link d6/d9/d13/d3e/dad/d7d/d8d/lb7 d6/d9/d13/d3e/dad/d49/da6/dfd/l143 0 2024-02-28T23:07:49.326 INFO:tasks.workunit.client.1.smithi184.stdout:5/981: dwrite db/d12/d50/d9e/f11f [4194304,4194304] 0 2024-02-28T23:07:49.326 INFO:tasks.workunit.client.1.smithi184.stdout:5/982: fdatasync db/d12/d1c/d21/d4d/d10e/d5d/ff6 0 2024-02-28T23:07:49.326 INFO:tasks.workunit.client.1.smithi184.stdout:7/928: truncate d6/d9/d13/d3e/dad/d49/d50/df8/f89 3639504 0 2024-02-28T23:07:49.326 INFO:tasks.workunit.client.1.smithi184.stdout:0/994: write d0/d1d/d3a/da9/d11b/d27/d31/d51/d117/d13c/f140 [2493505,24286] 0 2024-02-28T23:07:49.327 INFO:tasks.workunit.client.1.smithi184.stdout:0/995: write d0/df/f30 [1118589,32013] 0 2024-02-28T23:07:49.327 INFO:tasks.workunit.client.1.smithi184.stdout:7/929: creat d6/d9/d13/d14/f144 x:0 0 0 2024-02-28T23:07:49.327 INFO:tasks.workunit.client.1.smithi184.stdout:4/961: dread d1/dc/df/d5b/db2/d9f/da0/d126/f11 [0,4194304] 0 2024-02-28T23:07:49.327 INFO:tasks.workunit.client.1.smithi184.stdout:7/930: creat d6/d68/f145 x:0 0 0 2024-02-28T23:07:49.327 INFO:tasks.workunit.client.1.smithi184.stdout:6/874: dread dc/de/d10/d16/f37 [0,4194304] 0 2024-02-28T23:07:49.327 INFO:tasks.workunit.client.1.smithi184.stdout:9/959: dwrite d5/d47/d68/d7c/f8b [0,4194304] 0 2024-02-28T23:07:49.327 INFO:tasks.workunit.client.1.smithi184.stdout:0/996: mknod d0/d11d/d108/d11c/d132/d137/c154 0 2024-02-28T23:07:49.327 INFO:tasks.workunit.client.1.smithi184.stdout:7/931: truncate d6/d9/d13/d3e/dad/d49/da6/dfd/f120 555614 0 2024-02-28T23:07:49.327 INFO:tasks.workunit.client.1.smithi184.stdout:0/997: chown d0/d11d/fde 4 1 2024-02-28T23:07:49.327 INFO:tasks.workunit.client.1.smithi184.stdout:4/962: getdents d1/d8/d19/d67/d99 0 2024-02-28T23:07:49.327 INFO:tasks.workunit.client.1.smithi184.stdout:9/960: write d5/db/de/d10/d12/d2f/d7d/f13a [320042,78053] 0 2024-02-28T23:07:49.328 INFO:tasks.workunit.client.1.smithi184.stdout:5/983: dread db/d12/d1c/f2b [0,4194304] 0 2024-02-28T23:07:49.328 INFO:tasks.workunit.client.1.smithi184.stdout:9/961: symlink d5/db/de/l142 0 2024-02-28T23:07:49.328 INFO:tasks.workunit.client.1.smithi184.stdout:6/875: dwrite dc/d60/d7c/d90/fe5 [0,4194304] 0 2024-02-28T23:07:49.329 INFO:tasks.workunit.client.1.smithi184.stdout:7/932: creat d6/d9/d13/d14/d45/df3/f146 x:0 0 0 2024-02-28T23:07:49.330 INFO:tasks.workunit.client.1.smithi184.stdout:5/984: dread db/d12/d18/d2e/f36 [0,4194304] 0 2024-02-28T23:07:49.331 INFO:tasks.workunit.client.1.smithi184.stdout:0/998: symlink d0/d1d/d3a/da9/d11b/d27/d31/d5b/d7b/l155 0 2024-02-28T23:07:49.340 INFO:tasks.workunit.client.1.smithi184.stdout:5/985: write db/d12/d18/d2e/f36 [1562463,95572] 0 2024-02-28T23:07:49.344 INFO:tasks.workunit.client.1.smithi184.stdout:7/933: mknod d6/d9/d13/c147 0 2024-02-28T23:07:49.346 INFO:tasks.workunit.client.1.smithi184.stdout:6/876: creat dc/d60/d7c/df9/f112 x:0 0 0 2024-02-28T23:07:49.347 INFO:tasks.workunit.client.1.smithi184.stdout:6/877: readlink dc/de/d10/l63 0 2024-02-28T23:07:49.347 INFO:tasks.workunit.client.1.smithi184.stdout:7/934: read - d6/d9/d13/d14/d45/f8c zero size 2024-02-28T23:07:49.348 INFO:tasks.workunit.client.1.smithi184.stdout:5/986: creat db/d12/d1c/d21/d2f/dc4/df5/d12e/f135 x:0 0 0 2024-02-28T23:07:49.349 INFO:tasks.workunit.client.1.smithi184.stdout:7/935: dread - d6/d9/d13/d3e/d7e/f129 zero size 2024-02-28T23:07:49.353 INFO:tasks.workunit.client.1.smithi184.stdout:4/963: truncate d1/dc/df/f59 1223083 0 2024-02-28T23:07:49.354 INFO:tasks.workunit.client.1.smithi184.stdout:5/987: rmdir db/d12/d1c/d21/d2f 39 2024-02-28T23:07:49.354 INFO:tasks.workunit.client.1.smithi184.stdout:4/964: chown d1/d8/d19/d67/d99/f72 26935 1 2024-02-28T23:07:49.356 INFO:tasks.workunit.client.1.smithi184.stdout:4/965: write d1/dc/df/d3b/f11a [801853,118314] 0 2024-02-28T23:07:49.362 INFO:tasks.workunit.client.1.smithi184.stdout:9/962: dread d5/db/de/d10/d12/d2f/f51 [0,4194304] 0 2024-02-28T23:07:49.365 INFO:tasks.workunit.client.1.smithi184.stdout:8/982: sync 2024-02-28T23:07:49.365 INFO:tasks.workunit.client.1.smithi184.stdout:2/923: sync 2024-02-28T23:07:49.366 INFO:tasks.workunit.client.1.smithi184.stdout:4/966: creat d1/dc/df/d5b/db2/d9f/da0/d126/f131 x:0 0 0 2024-02-28T23:07:49.368 INFO:tasks.workunit.client.1.smithi184.stdout:9/963: stat d5/db/de/d10/d12/cd8 0 2024-02-28T23:07:49.373 INFO:tasks.workunit.client.1.smithi184.stdout:5/988: dwrite db/d12/d1c/d21/d25/f69 [4194304,4194304] 0 2024-02-28T23:07:49.376 INFO:tasks.workunit.client.1.smithi184.stdout:2/924: dread - d10/d1f/d21/d6a/dc2/fe9 zero size 2024-02-28T23:07:49.378 INFO:tasks.workunit.client.1.smithi184.stdout:7/936: dwrite d6/f67 [0,4194304] 0 2024-02-28T23:07:49.380 INFO:tasks.workunit.client.1.smithi184.stdout:0/999: dread d0/d1d/d3a/de5/f124 [0,4194304] 0 2024-02-28T23:07:49.384 INFO:tasks.workunit.client.1.smithi184.stdout:5/989: read db/d12/d1c/d21/d4d/fbc [123569,48109] 0 2024-02-28T23:07:49.386 INFO:tasks.workunit.client.1.smithi184.stdout:4/967: rename d1/dc/df/d5b/db2/d9f/da0/d126/f131 to d1/d9a/f132 0 2024-02-28T23:07:49.386 INFO:tasks.workunit.client.1.smithi184.stdout:7/937: write d6/d9/d13/d14/d45/f118 [836374,130723] 0 2024-02-28T23:07:49.390 INFO:tasks.workunit.client.1.smithi184.stdout:6/878: dread dc/de/d10/f43 [4194304,4194304] 0 2024-02-28T23:07:49.391 INFO:tasks.workunit.client.1.smithi184.stdout:2/925: creat d10/d1f/d21/d117/f12c x:0 0 0 2024-02-28T23:07:49.396 INFO:tasks.workunit.client.1.smithi184.stdout:6/879: dread - dc/d60/d62/fdc zero size 2024-02-28T23:07:49.397 INFO:tasks.workunit.client.1.smithi184.stdout:8/983: dread d1/da/dd7/fe2 [0,4194304] 0 2024-02-28T23:07:49.398 INFO:tasks.workunit.client.1.smithi184.stdout:2/926: chown d10/d1f/d21/d5e/dad/da3/dd6/la9 1132199 1 2024-02-28T23:07:49.398 INFO:tasks.workunit.client.1.smithi184.stdout:9/964: dwrite d5/db/de/d10/d12/d2f/f13e [0,4194304] 0 2024-02-28T23:07:49.402 INFO:tasks.workunit.client.1.smithi184.stdout:6/880: mknod dc/de/d2a/d8e/dad/d8a/da1/c113 0 2024-02-28T23:07:49.406 INFO:tasks.workunit.client.1.smithi184.stdout:2/927: truncate d10/d55/d89/db5/de7/ff4 248035 0 2024-02-28T23:07:49.406 INFO:tasks.workunit.client.1.smithi184.stdout:4/968: dwrite d1/dc/df/d5b/db2/ff4 [0,4194304] 0 2024-02-28T23:07:49.409 INFO:tasks.workunit.client.1.smithi184.stdout:5/990: link db/d12/d1c/d21/d4d/d10e/d5d/d66/lfd db/d12/d50/ddc/l136 0 2024-02-28T23:07:49.414 INFO:tasks.workunit.client.1.smithi184.stdout:9/965: symlink d5/db/de/d10/d6a/dae/l143 0 2024-02-28T23:07:49.419 INFO:tasks.workunit.client.1.smithi184.stdout:9/966: chown d5/db/de/d10/dc9/l103 40637 1 2024-02-28T23:07:49.421 INFO:tasks.workunit.client.1.smithi184.stdout:9/967: stat d5/d17 0 2024-02-28T23:07:49.421 INFO:tasks.workunit.client.1.smithi184.stdout:7/938: truncate d6/d9/da/f31 4836535 0 2024-02-28T23:07:49.421 INFO:tasks.workunit.client.1.smithi184.stdout:8/984: dread d1/da/dc/f73 [0,4194304] 0 2024-02-28T23:07:49.421 INFO:tasks.workunit.client.1.smithi184.stdout:6/881: dwrite dc/de/d10/d16/f96 [0,4194304] 0 2024-02-28T23:07:49.427 INFO:tasks.workunit.client.1.smithi184.stdout:8/985: write d1/da/d10/f8d [38202,29043] 0 2024-02-28T23:07:49.431 INFO:tasks.workunit.client.1.smithi184.stdout:9/968: symlink d5/db/d65/l144 0 2024-02-28T23:07:49.434 INFO:tasks.workunit.client.1.smithi184.stdout:7/939: mknod d6/d9/d13/d3e/dad/d49/d50/df8/d33/c148 0 2024-02-28T23:07:49.434 INFO:tasks.workunit.client.1.smithi184.stdout:2/928: getdents d10/d1f/d21/d5e/d15 0 2024-02-28T23:07:49.435 INFO:tasks.workunit.client.1.smithi184.stdout:5/991: symlink db/d12/d1c/d21/d2f/l137 0 2024-02-28T23:07:49.437 INFO:tasks.workunit.client.1.smithi184.stdout:8/986: symlink d1/da/d10/d43/d140/l15c 0 2024-02-28T23:07:49.439 INFO:tasks.workunit.client.1.smithi184.stdout:9/969: mkdir d5/d17/d8f/d145 0 2024-02-28T23:07:49.441 INFO:tasks.workunit.client.1.smithi184.stdout:4/969: dwrite d1/dc/df/d5b/fa9 [0,4194304] 0 2024-02-28T23:07:49.444 INFO:tasks.workunit.client.1.smithi184.stdout:4/970: chown d1/d8/d19/d56/fea 20755540 1 2024-02-28T23:07:49.445 INFO:tasks.workunit.client.1.smithi184.stdout:6/882: write dc/d60/f92 [827749,114805] 0 2024-02-28T23:07:49.447 INFO:tasks.workunit.client.1.smithi184.stdout:5/992: fsync db/d12/d50/fb2 0 2024-02-28T23:07:49.452 INFO:tasks.workunit.client.1.smithi184.stdout:9/970: creat d5/d47/d59/d92/f146 x:0 0 0 2024-02-28T23:07:49.460 INFO:tasks.workunit.client.1.smithi184.stdout:4/971: symlink d1/d8/l133 0 2024-02-28T23:07:49.462 INFO:tasks.workunit.client.1.smithi184.stdout:2/929: write d10/d1f/d21/d5e/d15/d60/fd5 [37246,66433] 0 2024-02-28T23:07:49.462 INFO:tasks.workunit.client.1.smithi184.stdout:8/987: write d1/da/dc/f73 [1073860,52436] 0 2024-02-28T23:07:49.463 INFO:tasks.workunit.client.1.smithi184.stdout:9/971: creat d5/d17/d8f/d145/f147 x:0 0 0 2024-02-28T23:07:49.466 INFO:tasks.workunit.client.1.smithi184.stdout:7/940: getdents d6/d9/d13/d14/d45 0 2024-02-28T23:07:49.468 INFO:tasks.workunit.client.1.smithi184.stdout:4/972: mkdir d1/dc/df/d5b/db2/d9f/da0/d126/d43/d73/d134 0 2024-02-28T23:07:49.469 INFO:tasks.workunit.client.1.smithi184.stdout:8/988: unlink d1/da/d10/d43/d101/f122 0 2024-02-28T23:07:49.472 INFO:tasks.workunit.client.1.smithi184.stdout:9/972: rmdir d5/d26/d50/d12a 39 2024-02-28T23:07:49.474 INFO:tasks.workunit.client.1.smithi184.stdout:8/989: write d1/da/dc/dc9/f103 [1136983,8914] 0 2024-02-28T23:07:49.481 INFO:tasks.workunit.client.1.smithi184.stdout:2/930: link d10/d1f/d21/d5e/d15/c87 d10/d1f/d21/d6a/c12d 0 2024-02-28T23:07:49.483 INFO:tasks.workunit.client.1.smithi184.stdout:7/941: write d6/d9/d13/d3e/ff0 [1002003,94403] 0 2024-02-28T23:07:49.487 INFO:tasks.workunit.client.1.smithi184.stdout:6/883: dread dc/de/d10/fb8 [0,4194304] 0 2024-02-28T23:07:49.490 INFO:tasks.workunit.client.1.smithi184.stdout:6/884: write dc/de/d2a/d5c/ffd [755725,129271] 0 2024-02-28T23:07:49.497 INFO:tasks.workunit.client.1.smithi184.stdout:7/942: creat d6/d9/d13/d3e/dad/d49/da6/daf/d47/f149 x:0 0 0 2024-02-28T23:07:49.497 INFO:tasks.workunit.client.1.smithi184.stdout:7/943: chown d6/d68/fb9 1315 1 2024-02-28T23:07:49.499 INFO:tasks.workunit.client.1.smithi184.stdout:9/973: dwrite d5/db/f79 [4194304,4194304] 0 2024-02-28T23:07:49.500 INFO:tasks.workunit.client.1.smithi184.stdout:7/944: rmdir d6/d68 39 2024-02-28T23:07:49.501 INFO:tasks.workunit.client.1.smithi184.stdout:2/931: dwrite d10/d55/d89/db5/de7/ff4 [0,4194304] 0 2024-02-28T23:07:49.507 INFO:tasks.workunit.client.1.smithi184.stdout:7/945: unlink d6/d9/d13/d3e/dad/fd1 0 2024-02-28T23:07:49.510 INFO:tasks.workunit.client.1.smithi184.stdout:6/885: write dc/d60/d62/d6f/d99/d9d/f101 [811508,8063] 0 2024-02-28T23:07:49.514 INFO:tasks.workunit.client.1.smithi184.stdout:9/974: dread d5/fc [4194304,4194304] 0 2024-02-28T23:07:49.514 INFO:tasks.workunit.client.1.smithi184.stdout:8/990: dread d1/da/dc/d16/d29/fa0 [0,4194304] 0 2024-02-28T23:07:49.517 INFO:tasks.workunit.client.1.smithi184.stdout:7/946: mknod d6/d9/d13/d3e/dad/d49/d50/df8/d98/dc4/df1/c14a 0 2024-02-28T23:07:49.522 INFO:tasks.workunit.client.1.smithi184.stdout:9/975: write d5/d47/d68/fde [578446,35822] 0 2024-02-28T23:07:49.526 INFO:tasks.workunit.client.1.smithi184.stdout:7/947: mkdir d6/d9/d13/d3e/dad/d7d/d8d/d14b 0 2024-02-28T23:07:49.527 INFO:tasks.workunit.client.1.smithi184.stdout:8/991: getdents d1/da/df/d20/dc7 0 2024-02-28T23:07:49.528 INFO:tasks.workunit.client.1.smithi184.stdout:9/976: fsync d5/db/de/d10/d6a/f118 0 2024-02-28T23:07:49.531 INFO:tasks.workunit.client.1.smithi184.stdout:8/992: stat d1/da/dc/d16/d32/d42 0 2024-02-28T23:07:49.534 INFO:tasks.workunit.client.1.smithi184.stdout:2/932: dwrite d10/d1f/d21/d5e/fb4 [0,4194304] 0 2024-02-28T23:07:49.535 INFO:tasks.workunit.client.1.smithi184.stdout:6/886: dwrite dc/d60/d62/d6f/d99/fbf [4194304,4194304] 0 2024-02-28T23:07:49.540 INFO:tasks.workunit.client.1.smithi184.stdout:5/993: sync 2024-02-28T23:07:49.540 INFO:tasks.workunit.client.1.smithi184.stdout:8/993: mknod d1/da/df/d20/d7c/c15d 0 2024-02-28T23:07:49.542 INFO:tasks.workunit.client.1.smithi184.stdout:8/994: fdatasync d1/da/dc/d16/fbc 0 2024-02-28T23:07:49.549 INFO:tasks.workunit.client.1.smithi184.stdout:7/948: rmdir d6/d9/d13/d14/d106/d12c 0 2024-02-28T23:07:49.550 INFO:tasks.workunit.client.1.smithi184.stdout:2/933: mknod d10/d1f/d21/d5e/d15/d24/d5f/d111/c12e 0 2024-02-28T23:07:49.555 INFO:tasks.workunit.client.1.smithi184.stdout:5/994: rename db/d12/d50/ddc to db/d44/d138 0 2024-02-28T23:07:49.557 INFO:tasks.workunit.client.1.smithi184.stdout:7/949: unlink d6/d9/d13/d14/f12b 0 2024-02-28T23:07:49.559 INFO:tasks.workunit.client.1.smithi184.stdout:8/995: dwrite d1/da/d10/d43/d124/dac/dc5/f151 [0,4194304] 0 2024-02-28T23:07:49.562 INFO:tasks.workunit.client.1.smithi184.stdout:5/995: symlink db/l139 0 2024-02-28T23:07:49.565 INFO:tasks.workunit.client.1.smithi184.stdout:7/950: write d6/d9/d13/d3e/dad/d49/d50/df8/d98/dc4/f13b [434896,30240] 0 2024-02-28T23:07:49.565 INFO:tasks.workunit.client.1.smithi184.stdout:8/996: symlink d1/d12b/l15e 0 2024-02-28T23:07:49.573 INFO:tasks.workunit.client.1.smithi184.stdout:5/996: creat db/d12/d1c/d21/d2f/dc4/df5/d12e/f13a x:0 0 0 2024-02-28T23:07:49.574 INFO:tasks.workunit.client.1.smithi184.stdout:2/934: dwrite d10/d1f/fa8 [0,4194304] 0 2024-02-28T23:07:49.577 INFO:tasks.workunit.client.1.smithi184.stdout:5/997: write db/d44/da5/ddf/f12a [920799,2262] 0 2024-02-28T23:07:49.577 INFO:tasks.workunit.client.1.smithi184.stdout:9/977: dread d5/db/de/fbd [0,4194304] 0 2024-02-28T23:07:49.577 INFO:tasks.workunit.client.1.smithi184.stdout:2/935: write d10/fb1 [1283268,109135] 0 2024-02-28T23:07:49.579 INFO:tasks.workunit.client.1.smithi184.stdout:6/887: truncate dc/de/d2a/d5c/d79/fac 2325151 0 2024-02-28T23:07:49.582 INFO:tasks.workunit.client.1.smithi184.stdout:6/888: write dc/d60/d62/d6f/d99/d9d/f101 [2914790,2277] 0 2024-02-28T23:07:49.590 INFO:tasks.workunit.client.1.smithi184.stdout:5/998: mkdir db/d12/d1c/d21/d4d/d10e/d13b 0 2024-02-28T23:07:49.592 INFO:tasks.workunit.client.1.smithi184.stdout:7/951: write d6/d9/d13/d3e/dad/d49/d50/df8/fdb [1265705,129978] 0 2024-02-28T23:07:49.594 INFO:tasks.workunit.client.1.smithi184.stdout:7/952: fsync d6/d9/d13/d3e/dad/d49/d50/df8/d33/f11b 0 2024-02-28T23:07:49.594 INFO:tasks.workunit.client.1.smithi184.stdout:9/978: mknod d5/d26/d50/c148 0 2024-02-28T23:07:49.596 INFO:tasks.workunit.client.1.smithi184.stdout:8/997: rename d1/da/d10/d17/f9c to d1/da/d10/f15f 0 2024-02-28T23:07:49.599 INFO:tasks.workunit.client.1.smithi184.stdout:4/973: sync 2024-02-28T23:07:49.600 INFO:tasks.workunit.client.1.smithi184.stdout:5/999: rmdir db/d12/d50 39 2024-02-28T23:07:49.601 INFO:tasks.workunit.client.1.smithi184.stdout:2/936: dread d10/d1f/d21/d5e/d15/f2b [0,4194304] 0 2024-02-28T23:07:49.606 INFO:tasks.workunit.client.1.smithi184.stdout:7/953: rmdir d6/d9/d13/d14/d45/df3 39 2024-02-28T23:07:49.610 INFO:tasks.workunit.client.1.smithi184.stdout:8/998: mkdir d1/da/dc/d16/d32/d42/d77/d160 0 2024-02-28T23:07:49.614 INFO:tasks.workunit.client.1.smithi184.stdout:4/974: creat d1/dc/df/d3b/d5c/f135 x:0 0 0 2024-02-28T23:07:49.619 INFO:tasks.workunit.client.1.smithi184.stdout:7/954: dwrite d6/d9/d13/d3e/dad/d49/f11a [0,4194304] 0 2024-02-28T23:07:49.622 INFO:tasks.workunit.client.1.smithi184.stdout:6/889: rename dc/de/d2a/c98 to dc/de/d2a/d8e/dad/d8a/da1/c114 0 2024-02-28T23:07:49.629 INFO:tasks.workunit.client.1.smithi184.stdout:4/975: creat d1/d8/d19/d67/d99/d11c/f136 x:0 0 0 2024-02-28T23:07:49.633 INFO:tasks.workunit.client.1.smithi184.stdout:8/999: mkdir d1/da/dc/d16/d29/d92/d14d/d161 0 2024-02-28T23:07:49.636 INFO:tasks.workunit.client.1.smithi184.stdout:9/979: dwrite d5/db/de/f21 [0,4194304] 0 2024-02-28T23:07:49.638 INFO:tasks.workunit.client.1.smithi184.stdout:7/955: link d6/d9/d13/d1e/f22 d6/d9/d13/d3e/dad/d49/d9c/f14c 0 2024-02-28T23:07:49.645 INFO:tasks.workunit.client.1.smithi184.stdout:4/976: mkdir d1/dc/d117/ddd/d137 0 2024-02-28T23:07:49.650 INFO:tasks.workunit.client.1.smithi184.stdout:7/956: mknod d6/d9/d13/d3e/dad/d49/d9c/c14d 0 2024-02-28T23:07:49.651 INFO:tasks.workunit.client.1.smithi184.stdout:2/937: write d10/d1f/d21/d5e/d15/d24/fa5 [1130459,101282] 0 2024-02-28T23:07:49.653 INFO:tasks.workunit.client.1.smithi184.stdout:4/977: creat d1/d8/d19/d56/f138 x:0 0 0 2024-02-28T23:07:49.656 INFO:tasks.workunit.client.1.smithi184.stdout:2/938: write d10/d1f/d21/d5e/d15/d24/d94/ffe [1616215,104913] 0 2024-02-28T23:07:49.656 INFO:tasks.workunit.client.1.smithi184.stdout:6/890: dread dc/d60/d62/d6f/d99/fbf [0,4194304] 0 2024-02-28T23:07:49.662 INFO:tasks.workunit.client.1.smithi184.stdout:2/939: mkdir d10/d55/d89/db5/d12f 0 2024-02-28T23:07:49.665 INFO:tasks.workunit.client.1.smithi184.stdout:2/940: symlink d10/d1f/d21/d5e/dad/da3/dd6/l130 0 2024-02-28T23:07:49.672 INFO:tasks.workunit.client.1.smithi184.stdout:7/957: dwrite d6/d68/f104 [0,4194304] 0 2024-02-28T23:07:49.675 INFO:tasks.workunit.client.1.smithi184.stdout:4/978: dwrite d1/d8/d19/d67/d99/fb8 [0,4194304] 0 2024-02-28T23:07:49.677 INFO:tasks.workunit.client.1.smithi184.stdout:2/941: symlink d10/d1f/d21/d5e/dad/da3/dd6/de5/l131 0 2024-02-28T23:07:49.677 INFO:tasks.workunit.client.1.smithi184.stdout:9/980: dwrite d5/d17/f5a [0,4194304] 0 2024-02-28T23:07:49.682 INFO:tasks.workunit.client.1.smithi184.stdout:4/979: chown d1/d8/d19 200 1 2024-02-28T23:07:49.689 INFO:tasks.workunit.client.1.smithi184.stdout:2/942: unlink d10/d1f/d21/d5e/d15/d60/d66/dc6/f8c 0 2024-02-28T23:07:49.693 INFO:tasks.workunit.client.1.smithi184.stdout:6/891: dread dc/de/d10/f4b [0,4194304] 0 2024-02-28T23:07:49.700 INFO:tasks.workunit.client.1.smithi184.stdout:7/958: dwrite d6/d9/d13/d3e/dad/f130 [0,4194304] 0 2024-02-28T23:07:49.704 INFO:tasks.workunit.client.1.smithi184.stdout:6/892: creat dc/de/d2a/d8e/dad/f115 x:0 0 0 2024-02-28T23:07:49.704 INFO:tasks.workunit.client.1.smithi184.stdout:7/959: fdatasync d6/d68/f7a 0 2024-02-28T23:07:49.704 INFO:tasks.workunit.client.1.smithi184.stdout:2/943: mknod d10/d1f/d21/d5e/d15/d60/d66/c132 0 2024-02-28T23:07:49.708 INFO:tasks.workunit.client.1.smithi184.stdout:6/893: creat dc/d60/f116 x:0 0 0 2024-02-28T23:07:49.709 INFO:tasks.workunit.client.1.smithi184.stdout:4/980: dwrite d1/d8/d35/dd9/fa4 [0,4194304] 0 2024-02-28T23:07:49.710 INFO:tasks.workunit.client.1.smithi184.stdout:2/944: unlink d10/d1f/d21/d5e/dad/dc7/fd7 0 2024-02-28T23:07:49.712 INFO:tasks.workunit.client.1.smithi184.stdout:7/960: write d6/d9/d13/d3e/dad/d49/da6/daf/d47/f55 [2261942,120975] 0 2024-02-28T23:07:49.714 INFO:tasks.workunit.client.1.smithi184.stdout:6/894: mkdir dc/d60/d78/d117 0 2024-02-28T23:07:49.716 INFO:tasks.workunit.client.1.smithi184.stdout:2/945: mkdir d10/d1f/d21/d5e/d15/d60/d6f/d133 0 2024-02-28T23:07:49.718 INFO:tasks.workunit.client.1.smithi184.stdout:2/946: truncate d10/d1f/ff3 241795 0 2024-02-28T23:07:49.722 INFO:tasks.workunit.client.1.smithi184.stdout:7/961: read - d6/d68/f85 zero size 2024-02-28T23:07:49.728 INFO:tasks.workunit.client.1.smithi184.stdout:4/981: rename d1/dc/df/d3b/la2 to d1/dc/df/d38/d57/l139 0 2024-02-28T23:07:49.728 INFO:tasks.workunit.client.1.smithi184.stdout:6/895: dwrite dc/d60/d7c/d90/fe5 [0,4194304] 0 2024-02-28T23:07:49.739 INFO:tasks.workunit.client.1.smithi184.stdout:4/982: mkdir d1/dc/df/d3b/d8f/d13a 0 2024-02-28T23:07:49.740 INFO:tasks.workunit.client.1.smithi184.stdout:6/896: symlink dc/d60/d7c/d61/l118 0 2024-02-28T23:07:49.741 INFO:tasks.workunit.client.1.smithi184.stdout:4/983: fsync d1/dc/d117/ddd/dfe/d49/f121 0 2024-02-28T23:07:49.742 INFO:tasks.workunit.client.1.smithi184.stdout:2/947: creat d10/d33/f134 x:0 0 0 2024-02-28T23:07:49.748 INFO:tasks.workunit.client.1.smithi184.stdout:4/984: dread d1/dc/df/d5b/db2/d9f/da0/d126/d43/d73/fc5 [0,4194304] 0 2024-02-28T23:07:49.751 INFO:tasks.workunit.client.1.smithi184.stdout:2/948: read d10/d1f/d21/d4d/d67/d65/fe0 [4760790,59374] 0 2024-02-28T23:07:49.752 INFO:tasks.workunit.client.1.smithi184.stdout:7/962: write d6/d9/d13/d3e/dad/f12 [3707604,45807] 0 2024-02-28T23:07:49.756 INFO:tasks.workunit.client.1.smithi184.stdout:4/985: mkdir d1/dc/d12c/d13b 0 2024-02-28T23:07:49.760 INFO:tasks.workunit.client.1.smithi184.stdout:6/897: getdents dc/de/d10/d3a 0 2024-02-28T23:07:49.764 INFO:tasks.workunit.client.1.smithi184.stdout:4/986: creat d1/d8/d19/d67/d99/d11c/f13c x:0 0 0 2024-02-28T23:07:49.764 INFO:tasks.workunit.client.1.smithi184.stdout:7/963: dread d6/d9/d13/d3e/dad/f130 [0,4194304] 0 2024-02-28T23:07:49.765 INFO:tasks.workunit.client.1.smithi184.stdout:4/987: readlink d1/dc/df/d27/d34/l36 0 2024-02-28T23:07:49.766 INFO:tasks.workunit.client.1.smithi184.stdout:2/949: dwrite d10/d1f/d21/d5e/d15/d60/fd5 [0,4194304] 0 2024-02-28T23:07:49.767 INFO:tasks.workunit.client.1.smithi184.stdout:6/898: stat dc/de/d2a/cae 0 2024-02-28T23:07:49.769 INFO:tasks.workunit.client.1.smithi184.stdout:4/988: truncate d1/dc/df/d27/f79 4225191 0 2024-02-28T23:07:49.769 INFO:tasks.workunit.client.1.smithi184.stdout:6/899: chown dc/de/d2a/d8e/dad/d8a/da1 0 1 2024-02-28T23:07:49.772 INFO:tasks.workunit.client.1.smithi184.stdout:7/964: rename d6/d9/d13/d3e/dad/d49/d50/df8/d33/d123/l140 to d6/d9/d13/d3e/dad/d49/d50/df8/d98/l14e 0 2024-02-28T23:07:49.779 INFO:tasks.workunit.client.1.smithi184.stdout:9/981: sync 2024-02-28T23:07:49.782 INFO:tasks.workunit.client.1.smithi184.stdout:6/900: rename dc/de/d2a/d5c/d71/c10f to dc/c119 0 2024-02-28T23:07:49.783 INFO:tasks.workunit.client.1.smithi184.stdout:6/901: stat dc/de/d10/f3d 0 2024-02-28T23:07:49.786 INFO:tasks.workunit.client.1.smithi184.stdout:7/965: getdents d6/d9/d13/d3e/dad/d49/da6/dfd 0 2024-02-28T23:07:49.786 INFO:tasks.workunit.client.1.smithi184.stdout:9/982: mknod d5/db/de/d10/dc9/c149 0 2024-02-28T23:07:49.787 INFO:tasks.workunit.client.1.smithi184.stdout:4/989: dwrite d1/d8/d19/d92/db3/d100/f103 [0,4194304] 0 2024-02-28T23:07:49.792 INFO:tasks.workunit.client.1.smithi184.stdout:9/983: symlink d5/d47/d59/d92/l14a 0 2024-02-28T23:07:49.794 INFO:tasks.workunit.client.1.smithi184.stdout:9/984: stat d5/db/de/d10/d12/d2f 0 2024-02-28T23:07:49.797 INFO:tasks.workunit.client.1.smithi184.stdout:9/985: rmdir d5 39 2024-02-28T23:07:49.798 INFO:tasks.workunit.client.1.smithi184.stdout:4/990: creat d1/dc/df/d3b/d8f/d13a/f13d x:0 0 0 2024-02-28T23:07:49.799 INFO:tasks.workunit.client.1.smithi184.stdout:6/902: dwrite dc/de/d2a/d5c/d79/da2/fe1 [0,4194304] 0 2024-02-28T23:07:49.800 INFO:tasks.workunit.client.1.smithi184.stdout:7/966: creat d6/d9/d13/d3e/dad/d7d/f14f x:0 0 0 2024-02-28T23:07:49.801 INFO:tasks.workunit.client.1.smithi184.stdout:9/986: write d5/d47/d68/f6f [2173399,31817] 0 2024-02-28T23:07:49.807 INFO:tasks.workunit.client.1.smithi184.stdout:7/967: dread - d6/d9/d13/d3e/dad/d49/d50/df8/d33/d123/d12a/f13d zero size 2024-02-28T23:07:49.807 INFO:tasks.workunit.client.1.smithi184.stdout:4/991: rmdir d1/d8/d19/d67/d87 39 2024-02-28T23:07:49.808 INFO:tasks.workunit.client.1.smithi184.stdout:6/903: creat dc/de/d2a/d5c/d79/da2/f11a x:0 0 0 2024-02-28T23:07:49.808 INFO:tasks.workunit.client.1.smithi184.stdout:7/968: stat d6/d9/f103 0 2024-02-28T23:07:49.811 INFO:tasks.workunit.client.1.smithi184.stdout:9/987: creat d5/d47/d68/d7c/df4/d108/f14b x:0 0 0 2024-02-28T23:07:49.811 INFO:tasks.workunit.client.1.smithi184.stdout:7/969: chown d6/d9/d13/d3e/dad/d49/da6/daf/d65 3 1 2024-02-28T23:07:49.812 INFO:tasks.workunit.client.1.smithi184.stdout:9/988: chown d5/d26/f55 58 1 2024-02-28T23:07:49.813 INFO:tasks.workunit.client.1.smithi184.stdout:4/992: symlink d1/dc/df/d5b/db2/d9f/l13e 0 2024-02-28T23:07:49.813 INFO:tasks.workunit.client.1.smithi184.stdout:6/904: mkdir dc/d60/d62/d11b 0 2024-02-28T23:07:49.814 INFO:tasks.workunit.client.1.smithi184.stdout:9/989: dread - d5/d26/fa6 zero size 2024-02-28T23:07:49.816 INFO:tasks.workunit.client.1.smithi184.stdout:7/970: creat d6/d9/d13/d3e/dad/d49/d50/df8/d33/d123/f150 x:0 0 0 2024-02-28T23:07:49.816 INFO:tasks.workunit.client.1.smithi184.stdout:4/993: write d1/dc/df/d27/f109 [494653,54846] 0 2024-02-28T23:07:49.817 INFO:tasks.workunit.client.1.smithi184.stdout:6/905: dread dc/d60/d7c/ff4 [0,4194304] 0 2024-02-28T23:07:49.819 INFO:tasks.workunit.client.1.smithi184.stdout:6/906: stat dc/de/d10/d16/f37 0 2024-02-28T23:07:49.826 INFO:tasks.workunit.client.1.smithi184.stdout:4/994: rename d1/dc/df/d5b/d6c/f9d to d1/dc/df/d5b/db2/d9f/f13f 0 2024-02-28T23:07:49.827 INFO:tasks.workunit.client.1.smithi184.stdout:4/995: stat d1/dc/df/d27/d34/cdb 0 2024-02-28T23:07:49.828 INFO:tasks.workunit.client.1.smithi184.stdout:6/907: symlink dc/de/d2a/d5c/d79/da2/l11c 0 2024-02-28T23:07:49.838 INFO:tasks.workunit.client.1.smithi184.stdout:9/990: link d5/d26/fa6 d5/db/de/d10/d12/d2f/d3f/d8d/f14c 0 2024-02-28T23:07:49.841 INFO:tasks.workunit.client.1.smithi184.stdout:9/991: write d5/db/de/d10/d6a/fc1 [44536,79374] 0 2024-02-28T23:07:49.847 INFO:tasks.workunit.client.1.smithi184.stdout:6/908: creat dc/d60/f11d x:0 0 0 2024-02-28T23:07:49.848 INFO:tasks.workunit.client.1.smithi184.stdout:2/950: sync 2024-02-28T23:07:49.849 INFO:tasks.workunit.client.1.smithi184.stdout:9/992: mknod d5/db/d5c/d5e/c14d 0 2024-02-28T23:07:49.853 INFO:tasks.workunit.client.1.smithi184.stdout:9/993: truncate d5/db/de/d10/d12/d2f/d3f/f11e 980339 0 2024-02-28T23:07:49.856 INFO:tasks.workunit.client.1.smithi184.stdout:6/909: dread dc/d60/faa [0,4194304] 0 2024-02-28T23:07:49.857 INFO:tasks.workunit.client.1.smithi184.stdout:7/971: write f0 [1315346,73531] 0 2024-02-28T23:07:49.857 INFO:tasks.workunit.client.1.smithi184.stdout:6/910: stat dc/d60/d7c/d61/l118 0 2024-02-28T23:07:49.861 INFO:tasks.workunit.client.1.smithi184.stdout:2/951: creat d10/d1f/d21/d5e/d15/d24/d5f/d10c/f135 x:0 0 0 2024-02-28T23:07:49.867 INFO:tasks.workunit.client.1.smithi184.stdout:7/972: symlink d6/d9/d13/d3e/dad/d7d/d8d/df2/l151 0 2024-02-28T23:07:49.868 INFO:tasks.workunit.client.1.smithi184.stdout:7/973: readlink d6/d9/da/l4d 0 2024-02-28T23:07:49.869 INFO:tasks.workunit.client.1.smithi184.stdout:6/911: unlink dc/d60/d7c/d61/dd2/f10b 0 2024-02-28T23:07:49.870 INFO:tasks.workunit.client.1.smithi184.stdout:4/996: write d1/dc/df/f16 [4106177,109343] 0 2024-02-28T23:07:49.874 INFO:tasks.workunit.client.1.smithi184.stdout:6/912: write dc/d60/d62/d6f/d99/d9d/f108 [797992,33052] 0 2024-02-28T23:07:49.937 INFO:tasks.workunit.client.1.smithi184.stdout:2/952: rename d10/d55/c73 to d10/d1f/d21/d5e/d121/c136 0 2024-02-28T23:07:49.939 INFO:tasks.workunit.client.1.smithi184.stdout:4/997: creat d1/dc/d117/ddd/dfe/f140 x:0 0 0 2024-02-28T23:07:49.939 INFO:tasks.workunit.client.1.smithi184.stdout:7/974: creat d6/d9/d13/d3e/dad/d49/d50/db2/f152 x:0 0 0 2024-02-28T23:07:49.939 INFO:tasks.workunit.client.1.smithi184.stdout:6/913: unlink dc/de/d10/l18 0 2024-02-28T23:07:49.947 INFO:tasks.workunit.client.1.smithi184.stdout:6/914: creat dc/de/db6/f11e x:0 0 0 2024-02-28T23:07:49.948 INFO:tasks.workunit.client.1.smithi184.stdout:7/975: stat d6/d9/d13/d3e/dad/d49/d9c/ffb 0 2024-02-28T23:07:49.949 INFO:tasks.workunit.client.1.smithi184.stdout:4/998: mkdir d1/dc/df/d5b/db2/d9f/d141 0 2024-02-28T23:07:49.957 INFO:tasks.workunit.client.1.smithi184.stdout:9/994: sync 2024-02-28T23:07:49.958 INFO:tasks.workunit.client.1.smithi184.stdout:6/915: symlink dc/de/d2a/d5c/d79/l11f 0 2024-02-28T23:07:49.968 INFO:tasks.workunit.client.1.smithi184.stdout:6/916: mknod dc/de/d2a/d5c/d79/d87/c120 0 2024-02-28T23:07:49.969 INFO:tasks.workunit.client.1.smithi184.stdout:4/999: write d1/d8/d35/fa7 [1479472,20248] 0 2024-02-28T23:07:49.974 INFO:tasks.workunit.client.1.smithi184.stdout:9/995: link d5/d17/d8f/f13f d5/db/de/d10/dc9/f14e 0 2024-02-28T23:07:49.979 INFO:tasks.workunit.client.1.smithi184.stdout:6/917: symlink dc/d60/d62/d6f/d99/l121 0 2024-02-28T23:07:49.984 INFO:tasks.workunit.client.1.smithi184.stdout:6/918: dread - dc/fca zero size 2024-02-28T23:07:49.984 INFO:tasks.workunit.client.1.smithi184.stdout:2/953: dread d10/d1f/d21/d5e/d15/d24/d5f/ff1 [0,4194304] 0 2024-02-28T23:07:49.986 INFO:tasks.workunit.client.1.smithi184.stdout:7/976: dwrite d6/fcd [0,4194304] 0 2024-02-28T23:07:49.987 INFO:tasks.workunit.client.1.smithi184.stdout:2/954: dread - d10/d1f/d21/fca zero size 2024-02-28T23:07:49.993 INFO:tasks.workunit.client.1.smithi184.stdout:6/919: creat dc/d60/d7c/d61/dd3/f122 x:0 0 0 2024-02-28T23:07:49.994 INFO:tasks.workunit.client.1.smithi184.stdout:2/955: creat d10/d1f/d21/d6a/f137 x:0 0 0 2024-02-28T23:07:49.995 INFO:tasks.workunit.client.1.smithi184.stdout:6/920: stat dc/de/d2a/d5c/d6e/fa4 0 2024-02-28T23:07:50.006 INFO:tasks.workunit.client.1.smithi184.stdout:9/996: dwrite d5/f6 [4194304,4194304] 0 2024-02-28T23:07:50.007 INFO:tasks.workunit.client.1.smithi184.stdout:6/921: write dc/de/d10/d16/f2d [3964990,113628] 0 2024-02-28T23:07:50.018 INFO:tasks.workunit.client.1.smithi184.stdout:2/956: dwrite d10/d1f/d21/d6a/dc2/fff [0,4194304] 0 2024-02-28T23:07:50.022 INFO:tasks.workunit.client.1.smithi184.stdout:2/957: mknod d10/d1f/d21/d6a/dc2/c138 0 2024-02-28T23:07:50.031 INFO:tasks.workunit.client.1.smithi184.stdout:6/922: dwrite dc/de/d2a/d8e/dad/f115 [0,4194304] 0 2024-02-28T23:07:50.032 INFO:tasks.workunit.client.1.smithi184.stdout:2/958: mkdir d10/d1f/d21/d5e/dad/da3/dd6/dd2/d139 0 2024-02-28T23:07:50.033 INFO:tasks.workunit.client.1.smithi184.stdout:9/997: dwrite d5/db/f7f [0,4194304] 0 2024-02-28T23:07:50.038 INFO:tasks.workunit.client.1.smithi184.stdout:6/923: truncate dc/f75 1929477 0 2024-02-28T23:07:50.044 INFO:tasks.workunit.client.1.smithi184.stdout:2/959: link d10/d1f/d21/d4d/c102 d10/d33/c13a 0 2024-02-28T23:07:50.051 INFO:tasks.workunit.client.1.smithi184.stdout:9/998: dwrite d5/d26/fb5 [0,4194304] 0 2024-02-28T23:07:50.053 INFO:tasks.workunit.client.1.smithi184.stdout:6/924: dwrite dc/d60/d7c/df9/f112 [0,4194304] 0 2024-02-28T23:07:50.057 INFO:tasks.workunit.client.1.smithi184.stdout:9/999: write d5/d17/d8f/d145/f147 [248634,4487] 0 2024-02-28T23:07:50.058 INFO:tasks.workunit.client.1.smithi184.stdout:2/960: dread d10/f18 [0,4194304] 0 2024-02-28T23:07:50.060 INFO:tasks.workunit.client.1.smithi184.stdout:7/977: sync 2024-02-28T23:07:50.060 INFO:tasks.workunit.client.1.smithi184.stdout:2/961: mknod d10/d1f/d21/d5e/d15/d24/d5f/c13b 0 2024-02-28T23:07:50.064 INFO:tasks.workunit.client.1.smithi184.stdout:6/925: symlink dc/d60/d7c/d61/l123 0 2024-02-28T23:07:50.064 INFO:tasks.workunit.client.1.smithi184.stdout:7/978: fsync d6/d9/d13/d3e/dad/d49/d50/df8/d33/d123/d12a/f13d 0 2024-02-28T23:07:50.072 INFO:tasks.workunit.client.1.smithi184.stdout:6/926: mkdir dc/de/d2a/d5c/d79/db9/de6/d124 0 2024-02-28T23:07:50.080 INFO:tasks.workunit.client.1.smithi184.stdout:7/979: dwrite d6/d9/d13/d3e/dad/d49/d50/df8/f38 [0,4194304] 0 2024-02-28T23:07:50.083 INFO:tasks.workunit.client.1.smithi184.stdout:7/980: dread - d6/d9/d13/d3e/dad/d7d/d6c/df7/f122 zero size 2024-02-28T23:07:50.086 INFO:tasks.workunit.client.1.smithi184.stdout:7/981: creat d6/d68/f153 x:0 0 0 2024-02-28T23:07:50.086 INFO:tasks.workunit.client.1.smithi184.stdout:2/962: write d10/d55/f11a [2104853,23886] 0 2024-02-28T23:07:50.087 INFO:tasks.workunit.client.1.smithi184.stdout:2/963: readlink l3 0 2024-02-28T23:07:50.088 INFO:tasks.workunit.client.1.smithi184.stdout:6/927: write dc/d60/d7c/fc2 [2145530,55756] 0 2024-02-28T23:07:50.097 INFO:tasks.workunit.client.1.smithi184.stdout:2/964: chown d10/d1f/d21/d5e/d15/d24/d94/ldb 144421604 1 2024-02-28T23:07:50.098 INFO:tasks.workunit.client.1.smithi184.stdout:2/965: fdatasync d10/f122 0 2024-02-28T23:07:50.103 INFO:tasks.workunit.client.1.smithi184.stdout:2/966: mknod d10/d1f/d21/d5e/d15/d60/d66/dc6/c13c 0 2024-02-28T23:07:50.106 INFO:tasks.workunit.client.1.smithi184.stdout:2/967: symlink d10/d1f/d21/d5e/d15/d24/l13d 0 2024-02-28T23:07:50.112 INFO:tasks.workunit.client.1.smithi184.stdout:2/968: mkdir d10/d1f/d21/d5e/d15/d60/d13e 0 2024-02-28T23:07:50.114 INFO:tasks.workunit.client.1.smithi184.stdout:2/969: mknod d10/d1f/d21/d5e/d15/c13f 0 2024-02-28T23:07:50.125 INFO:tasks.workunit.client.1.smithi184.stdout:7/982: dread d6/d68/fb9 [0,4194304] 0 2024-02-28T23:07:50.127 INFO:tasks.workunit.client.1.smithi184.stdout:2/970: rename d10/d1f/d21/d117/f12c to d10/d1f/d21/d5e/dad/da3/dd6/f140 0 2024-02-28T23:07:50.129 INFO:tasks.workunit.client.1.smithi184.stdout:7/983: write d6/d9/d13/d3e/fa0 [1985747,109638] 0 2024-02-28T23:07:50.150 INFO:tasks.workunit.client.1.smithi184.stdout:6/928: sync 2024-02-28T23:07:50.156 INFO:tasks.workunit.client.1.smithi184.stdout:6/929: mkdir dc/d60/d62/d6f/d125 0 2024-02-28T23:07:50.159 INFO:tasks.workunit.client.1.smithi184.stdout:2/971: dwrite ff [0,4194304] 0 2024-02-28T23:07:50.162 INFO:tasks.workunit.client.1.smithi184.stdout:6/930: creat dc/de/d2a/d5c/d79/db9/de6/f126 x:0 0 0 2024-02-28T23:07:50.171 INFO:tasks.workunit.client.1.smithi184.stdout:6/931: mkdir dc/d60/d62/d11b/d127 0 2024-02-28T23:07:50.174 INFO:tasks.workunit.client.1.smithi184.stdout:6/932: fsync dc/d60/d7c/d61/dd3/f122 0 2024-02-28T23:07:50.177 INFO:tasks.workunit.client.1.smithi184.stdout:6/933: mkdir dc/d60/d78/d128 0 2024-02-28T23:07:50.182 INFO:tasks.workunit.client.1.smithi184.stdout:6/934: symlink dc/d60/d62/d11b/d127/l129 0 2024-02-28T23:07:50.200 INFO:tasks.workunit.client.1.smithi184.stdout:7/984: dread d6/d9/d13/d3e/dad/d7d/d6c/f124 [0,4194304] 0 2024-02-28T23:07:50.204 INFO:tasks.workunit.client.1.smithi184.stdout:7/985: rmdir d6/d9/d13/d3e/dad/d49/d50/db2 39 2024-02-28T23:07:50.208 INFO:tasks.workunit.client.1.smithi184.stdout:7/986: write d6/f59 [3532501,80219] 0 2024-02-28T23:07:50.211 INFO:tasks.workunit.client.1.smithi184.stdout:6/935: dread dc/d60/d78/fb2 [0,4194304] 0 2024-02-28T23:07:50.213 INFO:tasks.workunit.client.1.smithi184.stdout:6/936: write dc/de/d10/d16/f2d [2065334,31430] 0 2024-02-28T23:07:50.218 INFO:tasks.workunit.client.1.smithi184.stdout:6/937: chown dc/de/d2a/d5c/d79/d87/c111 26658544 1 2024-02-28T23:07:50.219 INFO:tasks.workunit.client.1.smithi184.stdout:7/987: creat d6/d9/d13/d14/d45/f154 x:0 0 0 2024-02-28T23:07:50.231 INFO:tasks.workunit.client.1.smithi184.stdout:7/988: link d6/d9/d13/d14/d45/df3/d138/f142 d6/d9/d13/d3e/dad/d49/da6/daf/f155 0 2024-02-28T23:07:50.233 INFO:tasks.workunit.client.1.smithi184.stdout:7/989: fsync d6/d9/d13/d3e/dad/d49/d50/df8/fdb 0 2024-02-28T23:07:50.236 INFO:tasks.workunit.client.1.smithi184.stdout:6/938: dread dc/de/d2a/d5c/d79/fac [0,4194304] 0 2024-02-28T23:07:50.242 INFO:tasks.workunit.client.1.smithi184.stdout:6/939: dread - dc/d60/d6d/fe4 zero size 2024-02-28T23:07:50.242 INFO:tasks.workunit.client.1.smithi184.stdout:2/972: sync 2024-02-28T23:07:50.242 INFO:tasks.workunit.client.1.smithi184.stdout:7/990: mknod d6/d9/d13/d3e/dad/d49/d50/db2/c156 0 2024-02-28T23:07:50.243 INFO:tasks.workunit.client.1.smithi184.stdout:2/973: chown d10/d55/d89/fa1 778076701 1 2024-02-28T23:07:50.246 INFO:tasks.workunit.client.1.smithi184.stdout:6/940: mkdir dc/de/d2a/d5c/d79/d12a 0 2024-02-28T23:07:50.248 INFO:tasks.workunit.client.1.smithi184.stdout:2/974: fdatasync d10/d1f/d21/d6a/ff5 0 2024-02-28T23:07:50.249 INFO:tasks.workunit.client.1.smithi184.stdout:2/975: dread - d10/d55/d89/ffc zero size 2024-02-28T23:07:50.251 INFO:tasks.workunit.client.1.smithi184.stdout:6/941: symlink dc/de/d2a/d5c/d79/db9/de6/l12b 0 2024-02-28T23:07:50.254 INFO:tasks.workunit.client.1.smithi184.stdout:2/976: creat d10/d1f/d21/d5e/dad/da3/dd6/f141 x:0 0 0 2024-02-28T23:07:50.256 INFO:tasks.workunit.client.1.smithi184.stdout:7/991: creat d6/d9/d13/d3e/dad/d49/d50/f157 x:0 0 0 2024-02-28T23:07:50.261 INFO:tasks.workunit.client.1.smithi184.stdout:7/992: write d6/d9/d13/d3e/dad/d49/d50/df8/d33/f11b [298948,84655] 0 2024-02-28T23:07:50.267 INFO:tasks.workunit.client.1.smithi184.stdout:7/993: symlink d6/d9/d13/d3e/dad/d7d/d6c/l158 0 2024-02-28T23:07:50.269 INFO:tasks.workunit.client.1.smithi184.stdout:7/994: write d6/d9/d13/d3e/fa0 [3775061,93015] 0 2024-02-28T23:07:50.275 INFO:tasks.workunit.client.1.smithi184.stdout:7/995: mknod d6/d9/d13/d3e/dad/d49/d50/df8/d33/d123/c159 0 2024-02-28T23:07:50.278 INFO:tasks.workunit.client.1.smithi184.stdout:2/977: dwrite d10/d1f/d21/d5e/f2c [0,4194304] 0 2024-02-28T23:07:50.279 INFO:tasks.workunit.client.1.smithi184.stdout:7/996: fsync d6/d9/d13/d14/d45/ffa 0 2024-02-28T23:07:50.281 INFO:tasks.workunit.client.1.smithi184.stdout:2/978: readlink d10/d1f/d21/d5e/dad/dc7/l118 0 2024-02-28T23:07:50.281 INFO:tasks.workunit.client.1.smithi184.stdout:6/942: dwrite dc/d60/d6d/fdf [0,4194304] 0 2024-02-28T23:07:50.283 INFO:tasks.workunit.client.1.smithi184.stdout:2/979: fsync d10/d1f/d21/d6a/fae 0 2024-02-28T23:07:50.291 INFO:tasks.workunit.client.1.smithi184.stdout:2/980: read d10/d1f/d21/fbb [967465,87618] 0 2024-02-28T23:07:50.291 INFO:tasks.workunit.client.1.smithi184.stdout:6/943: rename dc/f4f to dc/de/d2a/d8e/dad/f12c 0 2024-02-28T23:07:50.294 INFO:tasks.workunit.client.1.smithi184.stdout:2/981: truncate d10/d55/ffb 608768 0 2024-02-28T23:07:50.294 INFO:tasks.workunit.client.1.smithi184.stdout:6/944: fsync dc/d60/d7c/d90/fe5 0 2024-02-28T23:07:50.295 INFO:tasks.workunit.client.1.smithi184.stdout:7/997: mkdir d6/d9/d13/d14/dac/d15a 0 2024-02-28T23:07:50.299 INFO:tasks.workunit.client.1.smithi184.stdout:2/982: creat d10/d55/d89/db5/f142 x:0 0 0 2024-02-28T23:07:50.308 INFO:tasks.workunit.client.1.smithi184.stdout:7/998: link d6/d9/d13/d3e/dad/d7d/d6c/lb8 d6/d9/d13/d3e/dad/d49/da6/daf/d65/l15b 0 2024-02-28T23:07:50.309 INFO:tasks.workunit.client.1.smithi184.stdout:6/945: dwrite dc/de/d2a/d8e/dad/f7d [0,4194304] 0 2024-02-28T23:07:50.317 INFO:tasks.workunit.client.1.smithi184.stdout:7/999: rename d6/d9/d13/d3e/dad/d49/da6/daf/d47/f58 to d6/d9/d13/d3e/f15c 0 2024-02-28T23:07:50.320 INFO:tasks.workunit.client.1.smithi184.stdout:6/946: dread dc/d60/d7c/d61/fc4 [0,4194304] 0 2024-02-28T23:07:50.327 INFO:tasks.workunit.client.1.smithi184.stdout:2/983: write d10/d1f/d21/d5e/d15/f2e [310431,105609] 0 2024-02-28T23:07:50.340 INFO:tasks.workunit.client.1.smithi184.stdout:2/984: dwrite d10/d1f/d38/d54/f10d [0,4194304] 0 2024-02-28T23:07:50.346 INFO:tasks.workunit.client.1.smithi184.stdout:2/985: fdatasync d10/d1f/d21/d5e/dad/da3/fec 0 2024-02-28T23:07:50.349 INFO:tasks.workunit.client.1.smithi184.stdout:2/986: chown d10/d1f/d21/d5e/dad/dc7/cd0 122 1 2024-02-28T23:07:50.354 INFO:tasks.workunit.client.1.smithi184.stdout:2/987: symlink d10/d1f/d21/l143 0 2024-02-28T23:07:50.356 INFO:tasks.workunit.client.1.smithi184.stdout:2/988: write d10/d1f/d38/d54/f10f [477100,16485] 0 2024-02-28T23:07:50.368 INFO:tasks.workunit.client.1.smithi184.stdout:2/989: rename d10/d1f/d21/d5e/dad to d10/d1f/d21/d5e/d15/d60/d6f/d133/d144 0 2024-02-28T23:07:50.370 INFO:tasks.workunit.client.1.smithi184.stdout:2/990: chown d10/d1f/d21/d6a/c11f 96724 1 2024-02-28T23:07:50.384 INFO:tasks.workunit.client.1.smithi184.stdout:2/991: dwrite d10/d1f/f93 [4194304,4194304] 0 2024-02-28T23:07:50.392 INFO:tasks.workunit.client.1.smithi184.stdout:2/992: mknod d10/d1f/d21/d5e/d15/d60/d6f/d133/d144/da3/dd6/de5/c145 0 2024-02-28T23:07:50.397 INFO:tasks.workunit.client.1.smithi184.stdout:2/993: dread - d10/d1f/d21/d5e/d15/d60/fda zero size 2024-02-28T23:07:50.408 INFO:tasks.workunit.client.1.smithi184.stdout:2/994: link d10/d1f/d21/d4d/d67/f95 d10/d1f/d38/f146 0 2024-02-28T23:07:50.410 INFO:tasks.workunit.client.1.smithi184.stdout:6/947: sync 2024-02-28T23:07:50.413 INFO:tasks.workunit.client.1.smithi184.stdout:2/995: dread - d10/d1f/d21/d5e/d15/d60/d6f/d133/d144/da3/fec zero size 2024-02-28T23:07:50.415 INFO:tasks.workunit.client.1.smithi184.stdout:6/948: unlink dc/de/d2a/l8f 0 2024-02-28T23:07:50.418 INFO:tasks.workunit.client.1.smithi184.stdout:6/949: readlink dc/d60/d7c/d61/l118 0 2024-02-28T23:07:50.418 INFO:tasks.workunit.client.1.smithi184.stdout:2/996: write d10/d1f/d21/d6a/dc2/fff [1797141,13745] 0 2024-02-28T23:07:50.424 INFO:tasks.workunit.client.1.smithi184.stdout:2/997: fsync d10/f18 0 2024-02-28T23:07:50.428 INFO:tasks.workunit.client.1.smithi184.stdout:2/998: write d10/d1f/d21/d6a/fae [2051616,27104] 0 2024-02-28T23:07:50.432 INFO:tasks.workunit.client.1.smithi184.stdout:2/999: chown d10/d1f/d21/d4d/d67/d65/fe0 36 1 2024-02-28T23:07:50.433 INFO:tasks.workunit.client.1.smithi184.stdout:6/950: dread dc/f75 [0,4194304] 0 2024-02-28T23:07:50.439 INFO:tasks.workunit.client.1.smithi184.stdout:6/951: rmdir dc/de/d2a/d8e/dad/d8a 39 2024-02-28T23:07:50.444 INFO:tasks.workunit.client.1.smithi184.stdout:6/952: creat dc/d60/d62/f12d x:0 0 0 2024-02-28T23:07:50.450 INFO:tasks.workunit.client.1.smithi184.stdout:6/953: truncate dc/de/d2a/d5c/d79/d87/f9f 627217 0 2024-02-28T23:07:50.464 INFO:tasks.workunit.client.1.smithi184.stdout:6/954: write dc/d60/d6d/f83 [1178455,72920] 0 2024-02-28T23:07:50.490 INFO:tasks.workunit.client.1.smithi184.stdout:6/955: dread dc/de/d10/f43 [4194304,4194304] 0 2024-02-28T23:07:50.493 INFO:tasks.workunit.client.1.smithi184.stdout:6/956: fdatasync dc/d60/d7c/fc2 0 2024-02-28T23:07:50.511 INFO:tasks.workunit.client.1.smithi184.stdout:6/957: truncate dc/d42/fdb 644348 0 2024-02-28T23:07:50.515 INFO:tasks.workunit.client.1.smithi184.stdout:6/958: stat dc/de/d2a/d5c/d79/da2/fe1 0 2024-02-28T23:07:50.520 INFO:tasks.workunit.client.1.smithi184.stdout:6/959: symlink dc/d60/d62/d11b/l12e 0 2024-02-28T23:07:50.529 INFO:tasks.workunit.client.1.smithi184.stdout:6/960: mknod dc/de/d2a/d5c/d79/db9/de6/c12f 0 2024-02-28T23:07:50.534 INFO:tasks.workunit.client.1.smithi184.stdout:6/961: creat dc/d42/f130 x:0 0 0 2024-02-28T23:07:50.543 INFO:tasks.workunit.client.1.smithi184.stdout:6/962: write dc/de/d2a/d8e/dad/f115 [3535496,22417] 0 2024-02-28T23:07:50.556 INFO:tasks.workunit.client.1.smithi184.stdout:6/963: creat dc/de/d2a/d8e/dad/d8a/f131 x:0 0 0 2024-02-28T23:07:50.568 INFO:tasks.workunit.client.1.smithi184.stdout:6/964: truncate dc/d42/fdb 596037 0 2024-02-28T23:07:50.578 INFO:tasks.workunit.client.1.smithi184.stdout:6/965: getdents dc/d60/d62/d11b/d127 0 2024-02-28T23:07:50.606 INFO:tasks.workunit.client.1.smithi184.stdout:6/966: dread dc/de/d2a/d5c/d79/da2/fe1 [0,4194304] 0 2024-02-28T23:07:50.613 INFO:tasks.workunit.client.1.smithi184.stdout:6/967: mkdir dc/de/d2a/d5c/d79/d87/d9a/d132 0 2024-02-28T23:07:50.617 INFO:tasks.workunit.client.1.smithi184.stdout:6/968: readlink dc/de/d2a/d5c/d79/da2/l11c 0 2024-02-28T23:07:50.623 INFO:tasks.workunit.client.1.smithi184.stdout:6/969: mkdir dc/d60/d62/d6f/d125/d133 0 2024-02-28T23:07:50.641 INFO:tasks.workunit.client.1.smithi184.stdout:6/970: truncate dc/d60/d62/d6f/d99/d9d/fbb 732722 0 2024-02-28T23:07:50.651 INFO:tasks.workunit.client.1.smithi184.stdout:6/971: creat dc/de/d2a/d8e/dad/d8a/da1/f134 x:0 0 0 2024-02-28T23:07:50.676 INFO:tasks.workunit.client.1.smithi184.stdout:6/972: dread dc/de/d10/d16/f96 [0,4194304] 0 2024-02-28T23:07:50.686 INFO:tasks.workunit.client.1.smithi184.stdout:6/973: rename dc/d60/l68 to dc/d42/l135 0 2024-02-28T23:07:50.702 INFO:tasks.workunit.client.1.smithi184.stdout:6/974: dread dc/de/d2a/d5c/ffd [0,4194304] 0 2024-02-28T23:07:50.706 INFO:tasks.workunit.client.1.smithi184.stdout:6/975: dread - dc/d60/d7c/d61/dd3/f122 zero size 2024-02-28T23:07:50.712 INFO:tasks.workunit.client.1.smithi184.stdout:6/976: unlink dc/d60/d62/d6f/d99/l121 0 2024-02-28T23:07:50.785 INFO:tasks.workunit.client.1.smithi184.stdout:6/977: sync 2024-02-28T23:07:50.791 INFO:tasks.workunit.client.1.smithi184.stdout:6/978: fdatasync dc/de/d2a/d5c/d79/db9/de6/fea 0 2024-02-28T23:07:50.796 INFO:tasks.workunit.client.1.smithi184.stdout:6/979: chown dc/de/l7a 1776762159 1 2024-02-28T23:07:50.800 INFO:tasks.workunit.client.1.smithi184.stdout:6/980: write dc/de/f29 [1512057,26759] 0 2024-02-28T23:07:50.842 INFO:tasks.workunit.client.1.smithi184.stdout:6/981: dwrite dc/de/d2a/f7b [0,4194304] 0 2024-02-28T23:07:50.852 INFO:tasks.workunit.client.1.smithi184.stdout:6/982: fsync dc/de/d10/d16/f96 0 2024-02-28T23:07:50.859 INFO:tasks.workunit.client.1.smithi184.stdout:6/983: mkdir dc/d60/d62/d136 0 2024-02-28T23:07:50.865 INFO:tasks.workunit.client.1.smithi184.stdout:6/984: symlink dc/d60/d78/d117/l137 0 2024-02-28T23:07:50.884 INFO:tasks.workunit.client.1.smithi184.stdout:6/985: write dc/de/d10/f38 [3766829,19818] 0 2024-02-28T23:07:50.920 INFO:tasks.workunit.client.1.smithi184.stdout:6/986: rmdir dc/d60/d62/d11b 39 2024-02-28T23:07:50.928 INFO:tasks.workunit.client.1.smithi184.stdout:6/987: write dc/de/d2a/d5c/ffd [1815150,52357] 0 2024-02-28T23:07:50.933 INFO:tasks.workunit.client.1.smithi184.stdout:6/988: write dc/d60/f92 [150402,73283] 0 2024-02-28T23:07:50.993 INFO:tasks.workunit.client.1.smithi184.stdout:6/989: dwrite dc/d60/d62/d6f/d99/d9d/fbb [0,4194304] 0 2024-02-28T23:07:51.007 INFO:tasks.workunit.client.1.smithi184.stdout:6/990: rename dc/de/d10/d3a/l44 to dc/d60/d7c/d61/dd3/l138 0 2024-02-28T23:07:51.052 INFO:tasks.workunit.client.1.smithi184.stdout:6/991: dread dc/de/f29 [0,4194304] 0 2024-02-28T23:07:51.060 INFO:tasks.workunit.client.1.smithi184.stdout:6/992: symlink dc/de/d2a/d8e/dad/l139 0 2024-02-28T23:07:51.068 INFO:tasks.workunit.client.1.smithi184.stdout:6/993: mknod dc/de/d2a/d5c/d79/d12a/c13a 0 2024-02-28T23:07:51.074 INFO:tasks.workunit.client.1.smithi184.stdout:6/994: chown dc/de/d10/d3a/c8d 22903 1 2024-02-28T23:07:51.083 INFO:tasks.workunit.client.1.smithi184.stdout:6/995: creat dc/de/d2a/d5c/d79/db9/f13b x:0 0 0 2024-02-28T23:07:51.094 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:50 smithi184 ceph-mon[36198]: pgmap v44: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 92 MiB/s rd, 208 MiB/s wr, 514 op/s 2024-02-28T23:07:51.095 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:50 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:51.095 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:50 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:51.095 INFO:tasks.workunit.client.1.smithi184.stdout:6/996: rename dc/d60/d62/d6f/d125 to dc/d60/d7c/d61/d13c 0 2024-02-28T23:07:51.140 INFO:tasks.workunit.client.1.smithi184.stdout:6/997: dwrite dc/de/d10/f38 [0,4194304] 0 2024-02-28T23:07:51.144 INFO:tasks.workunit.client.1.smithi184.stdout:6/998: write dc/d60/ff6 [712115,15778] 0 2024-02-28T23:07:51.152 INFO:tasks.workunit.client.1.smithi184.stdout:6/999: unlink dc/de/f15 0 2024-02-28T23:07:51.168 INFO:tasks.workunit.client.1.smithi184.stderr:+ rm -rf -- ./tmp.gyegImHuqM 2024-02-28T23:07:51.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:50 smithi159 ceph-mon[28802]: pgmap v44: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 92 MiB/s rd, 208 MiB/s wr, 514 op/s 2024-02-28T23:07:51.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:50 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:51.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:50 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:52.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:51 smithi184 ceph-mon[36198]: Standby manager daemon smithi159.pobewk restarted 2024-02-28T23:07:52.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:51 smithi184 ceph-mon[36198]: Standby manager daemon smithi159.pobewk started 2024-02-28T23:07:52.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:51 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.pobewk/crt"}]: dispatch 2024-02-28T23:07:52.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:51 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:07:52.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:51 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.pobewk/key"}]: dispatch 2024-02-28T23:07:52.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:51 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:07:52.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:51 smithi159 ceph-mon[28802]: Standby manager daemon smithi159.pobewk restarted 2024-02-28T23:07:52.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:51 smithi159 ceph-mon[28802]: Standby manager daemon smithi159.pobewk started 2024-02-28T23:07:52.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:51 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.pobewk/crt"}]: dispatch 2024-02-28T23:07:52.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:51 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:07:52.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:51 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi159.pobewk/key"}]: dispatch 2024-02-28T23:07:52.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:51 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:07:53.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:52 smithi184 ceph-mon[36198]: pgmap v45: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 61 MiB/s rd, 134 MiB/s wr, 341 op/s 2024-02-28T23:07:53.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:52 smithi184 ceph-mon[36198]: mgrmap e26: smithi184.quvmnx(active, since 84s), standbys: smithi159.pobewk 2024-02-28T23:07:53.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:52 smithi159 ceph-mon[28802]: pgmap v45: 65 pgs: 65 active+clean; 4.1 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 61 MiB/s rd, 134 MiB/s wr, 341 op/s 2024-02-28T23:07:53.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:52 smithi159 ceph-mon[28802]: mgrmap e26: smithi184.quvmnx(active, since 84s), standbys: smithi159.pobewk 2024-02-28T23:07:54.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:53 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:54.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:53 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:54.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:53 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:53 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:55.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:54 smithi159 ceph-mon[28802]: pgmap v46: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 67 MiB/s rd, 148 MiB/s wr, 415 op/s 2024-02-28T23:07:55.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:54 smithi184 ceph-mon[36198]: pgmap v46: 65 pgs: 65 active+clean; 4.0 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 67 MiB/s rd, 148 MiB/s wr, 415 op/s 2024-02-28T23:07:57.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:56 smithi159 ceph-mon[28802]: pgmap v47: 65 pgs: 65 active+clean; 3.9 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 58 MiB/s rd, 124 MiB/s wr, 391 op/s 2024-02-28T23:07:57.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:56 smithi184 ceph-mon[36198]: pgmap v47: 65 pgs: 65 active+clean; 3.9 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 58 MiB/s rd, 124 MiB/s wr, 391 op/s 2024-02-28T23:07:58.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:57 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:07:58.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:57 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:07:59.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: pgmap v48: 65 pgs: 65 active+clean; 3.9 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 42 MiB/s rd, 90 MiB/s wr, 270 op/s 2024-02-28T23:07:59.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:59.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:59.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:07:59.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:07:59.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:59.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:07:59.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mgr fail", "who": "smithi184.quvmnx"}]: dispatch 2024-02-28T23:07:59.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T23:07:59.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd='[{"prefix": "mgr fail", "who": "smithi184.quvmnx"}]': finished 2024-02-28T23:07:59.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: mgrmap e27: smithi159.pobewk(active, starting, since 0.0150158s) 2024-02-28T23:07:59.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi159.pobewk", "id": "smithi159.pobewk"}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:07:59.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T23:07:59.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T23:07:59.225 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:58 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T23:07:59.267 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: pgmap v48: 65 pgs: 65 active+clean; 3.9 GiB data, 12 GiB used, 524 GiB / 536 GiB avail; 42 MiB/s rd, 90 MiB/s wr, 270 op/s 2024-02-28T23:07:59.267 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:59.267 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:59.267 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:07:59.267 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:07:59.267 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' 2024-02-28T23:07:59.267 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "mgr fail", "who": "smithi184.quvmnx"}]: dispatch 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.24357 172.21.15.184:0/3387844503' entity='mgr.smithi184.quvmnx' cmd='[{"prefix": "mgr fail", "who": "smithi184.quvmnx"}]': finished 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: mgrmap e27: smithi159.pobewk(active, starting, since 0.0150158s) 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi159.pobewk", "id": "smithi159.pobewk"}]: dispatch 2024-02-28T23:07:59.268 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T23:07:59.269 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T23:07:59.269 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:07:59.269 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:07:59.269 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:07:59.269 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:07:59.269 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T23:07:59.269 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T23:07:59.269 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:58 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T23:08:00.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:59 smithi159 ceph-mon[28802]: Manager daemon smithi159.pobewk is now available 2024-02-28T23:08:00.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:59 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:08:00.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:59 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:08:00.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:59 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:08:00.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:59 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/mirror_snapshot_schedule"}]: dispatch 2024-02-28T23:08:00.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:07:59 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/trash_purge_schedule"}]: dispatch 2024-02-28T23:08:00.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:59 smithi184 ceph-mon[36198]: Manager daemon smithi159.pobewk is now available 2024-02-28T23:08:00.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:59 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:08:00.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:59 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:08:00.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:59 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:08:00.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:59 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/mirror_snapshot_schedule"}]: dispatch 2024-02-28T23:08:00.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:07:59 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/trash_purge_schedule"}]: dispatch 2024-02-28T23:08:01.180 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:00 smithi184 ceph-mon[36198]: [28/Feb/2024:23:07:59] ENGINE Bus STARTING 2024-02-28T23:08:01.180 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:00 smithi184 ceph-mon[36198]: [28/Feb/2024:23:07:59] ENGINE Serving on https://172.21.15.159:7150 2024-02-28T23:08:01.180 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:00 smithi184 ceph-mon[36198]: [28/Feb/2024:23:07:59] ENGINE Serving on http://172.21.15.159:8765 2024-02-28T23:08:01.181 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:00 smithi184 ceph-mon[36198]: [28/Feb/2024:23:07:59] ENGINE Bus STARTED 2024-02-28T23:08:01.181 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:00 smithi184 ceph-mon[36198]: mgrmap e28: smithi159.pobewk(active, since 1.0476s) 2024-02-28T23:08:01.181 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:00 smithi184 ceph-mon[36198]: pgmap v3: 65 pgs: 65 active+clean; 3.0 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail 2024-02-28T23:08:01.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:00 smithi159 ceph-mon[28802]: [28/Feb/2024:23:07:59] ENGINE Bus STARTING 2024-02-28T23:08:01.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:00 smithi159 ceph-mon[28802]: [28/Feb/2024:23:07:59] ENGINE Serving on https://172.21.15.159:7150 2024-02-28T23:08:01.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:00 smithi159 ceph-mon[28802]: [28/Feb/2024:23:07:59] ENGINE Serving on http://172.21.15.159:8765 2024-02-28T23:08:01.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:00 smithi159 ceph-mon[28802]: [28/Feb/2024:23:07:59] ENGINE Bus STARTED 2024-02-28T23:08:01.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:00 smithi159 ceph-mon[28802]: mgrmap e28: smithi159.pobewk(active, since 1.0476s) 2024-02-28T23:08:01.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:00 smithi159 ceph-mon[28802]: pgmap v3: 65 pgs: 65 active+clean; 3.0 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail 2024-02-28T23:08:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.601+0000 7f3d19000700 1 -- 172.21.15.159:0/69919521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d140ff260 msgr2=0x7f3d14101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.601+0000 7f3d19000700 1 --2- 172.21.15.159:0/69919521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d140ff260 0x7f3d14101690 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009910 tx=0x7f3d04009c20 comp rx=0 tx=0).stop 2024-02-28T23:08:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.602+0000 7f3d19000700 1 -- 172.21.15.159:0/69919521 shutdown_connections 2024-02-28T23:08:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.602+0000 7f3d19000700 1 --2- 172.21.15.159:0/69919521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d14101bd0 0x7f3d14104060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.602+0000 7f3d19000700 1 --2- 172.21.15.159:0/69919521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d140ff260 0x7f3d14101690 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.602+0000 7f3d19000700 1 -- 172.21.15.159:0/69919521 >> 172.21.15.159:0/69919521 conn(0x7f3d140fae40 msgr2=0x7f3d140fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.602+0000 7f3d19000700 1 -- 172.21.15.159:0/69919521 shutdown_connections 2024-02-28T23:08:01.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.602+0000 7f3d19000700 1 -- 172.21.15.159:0/69919521 wait complete. 2024-02-28T23:08:01.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.603+0000 7f3d19000700 1 Processor -- start 2024-02-28T23:08:01.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.604+0000 7f3d19000700 1 -- start start 2024-02-28T23:08:01.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.604+0000 7f3d19000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d140ff260 0x7f3d1410ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:01.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.604+0000 7f3d19000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14101bd0 0x7f3d1410d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:01.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.604+0000 7f3d19000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1410d9f0 con 0x7f3d14101bd0 2024-02-28T23:08:01.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.604+0000 7f3d19000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d141aa530 con 0x7f3d140ff260 2024-02-28T23:08:01.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.604+0000 7f3d0be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14101bd0 0x7f3d1410d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:01.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.604+0000 7f3d0be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14101bd0 0x7f3d1410d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36818/0 (socket says 172.21.15.159:36818) 2024-02-28T23:08:01.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.604+0000 7f3d0be00700 1 -- 172.21.15.159:0/3515160519 learned_addr learned my addr 172.21.15.159:0/3515160519 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:08:01.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.604+0000 7f3d13400700 1 --2- 172.21.15.159:0/3515160519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d140ff260 0x7f3d1410ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:01.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.605+0000 7f3d0be00700 1 -- 172.21.15.159:0/3515160519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d140ff260 msgr2=0x7f3d1410ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:01.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.605+0000 7f3d0be00700 1 --2- 172.21.15.159:0/3515160519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d140ff260 0x7f3d1410ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:01.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.605+0000 7f3d0be00700 1 -- 172.21.15.159:0/3515160519 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d040095f0 con 0x7f3d14101bd0 2024-02-28T23:08:01.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.606+0000 7f3d0be00700 1 --2- 172.21.15.159:0/3515160519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14101bd0 0x7f3d1410d3d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00e920 tx=0x7f3cfc00ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:01.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.606+0000 7f3d10c00700 1 -- 172.21.15.159:0/3515160519 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cfc00c9d0 con 0x7f3d14101bd0 2024-02-28T23:08:01.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.607+0000 7f3d19000700 1 -- 172.21.15.159:0/3515160519 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d141aa730 con 0x7f3d14101bd0 2024-02-28T23:08:01.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.607+0000 7f3d10c00700 1 -- 172.21.15.159:0/3515160519 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3cfc010430 con 0x7f3d14101bd0 2024-02-28T23:08:01.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.607+0000 7f3d10c00700 1 -- 172.21.15.159:0/3515160519 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cfc018650 con 0x7f3d14101bd0 2024-02-28T23:08:01.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.607+0000 7f3d19000700 1 -- 172.21.15.159:0/3515160519 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d141aac30 con 0x7f3d14101bd0 2024-02-28T23:08:01.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.609+0000 7f3d10c00700 1 -- 172.21.15.159:0/3515160519 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 28) v1 ==== 46013+0+0 (secure 0 0 0) 0x7f3cfc00cb30 con 0x7f3d14101bd0 2024-02-28T23:08:01.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.609+0000 7f3d19000700 1 -- 172.21.15.159:0/3515160519 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d14107020 con 0x7f3d14101bd0 2024-02-28T23:08:01.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.609+0000 7f3d10c00700 1 --2- 172.21.15.159:0/3515160519 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3cf8038e30 0x7f3cf803b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:01.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.610+0000 7f3d10c00700 1 -- 172.21.15.159:0/3515160519 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3cfc014070 con 0x7f3d14101bd0 2024-02-28T23:08:01.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.610+0000 7f3d13400700 1 --2- 172.21.15.159:0/3515160519 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3cf8038e30 0x7f3cf803b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:01.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.611+0000 7f3d13400700 1 --2- 172.21.15.159:0/3515160519 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3cf8038e30 0x7f3cf803b2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009fd0 tx=0x7f3d04005fd0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:01.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.619+0000 7f3d10c00700 1 -- 172.21.15.159:0/3515160519 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f3cfc016330 con 0x7f3d14101bd0 2024-02-28T23:08:01.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.958+0000 7f3d19000700 1 -- 172.21.15.159:0/3515160519 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3d140611d0 con 0x7f3cf8038e30 2024-02-28T23:08:01.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.960+0000 7f3d10c00700 1 -- 172.21.15.159:0/3515160519 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f3d140611d0 con 0x7f3cf8038e30 2024-02-28T23:08:01.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.963+0000 7f3d19000700 1 -- 172.21.15.159:0/3515160519 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3cf8038e30 msgr2=0x7f3cf803b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:01.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.963+0000 7f3d19000700 1 --2- 172.21.15.159:0/3515160519 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3cf8038e30 0x7f3cf803b2f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3d04009fd0 tx=0x7f3d04005fd0 comp rx=0 tx=0).stop 2024-02-28T23:08:01.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.963+0000 7f3d19000700 1 -- 172.21.15.159:0/3515160519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14101bd0 msgr2=0x7f3d1410d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:01.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.963+0000 7f3d19000700 1 --2- 172.21.15.159:0/3515160519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14101bd0 0x7f3d1410d3d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f3cfc00e920 tx=0x7f3cfc00ec30 comp rx=0 tx=0).stop 2024-02-28T23:08:01.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.963+0000 7f3d19000700 1 -- 172.21.15.159:0/3515160519 shutdown_connections 2024-02-28T23:08:01.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.963+0000 7f3d19000700 1 --2- 172.21.15.159:0/3515160519 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3cf8038e30 0x7f3cf803b2f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:01.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.963+0000 7f3d19000700 1 --2- 172.21.15.159:0/3515160519 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d140ff260 0x7f3d1410ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:01.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.963+0000 7f3d19000700 1 --2- 172.21.15.159:0/3515160519 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d14101bd0 0x7f3d1410d3d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:01.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.963+0000 7f3d19000700 1 -- 172.21.15.159:0/3515160519 >> 172.21.15.159:0/3515160519 conn(0x7f3d140fae40 msgr2=0x7f3d140fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:01.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.964+0000 7f3d19000700 1 -- 172.21.15.159:0/3515160519 shutdown_connections 2024-02-28T23:08:01.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:01.964+0000 7f3d19000700 1 -- 172.21.15.159:0/3515160519 wait complete. 2024-02-28T23:08:01.982 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:08:02.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.160+0000 7f8891e00700 1 -- 172.21.15.159:0/1154656412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f888c101db0 msgr2=0x7f888c102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:02.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.160+0000 7f8891e00700 1 --2- 172.21.15.159:0/1154656412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f888c101db0 0x7f888c102210 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8878009910 tx=0x7f8878009c20 comp rx=0 tx=0).stop 2024-02-28T23:08:02.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.160+0000 7f8891e00700 1 -- 172.21.15.159:0/1154656412 shutdown_connections 2024-02-28T23:08:02.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.160+0000 7f8891e00700 1 --2- 172.21.15.159:0/1154656412 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f888c101db0 0x7f888c102210 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:02.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.160+0000 7f8891e00700 1 --2- 172.21.15.159:0/1154656412 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f888c100bb0 0x7f888c100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:02.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.160+0000 7f8891e00700 1 -- 172.21.15.159:0/1154656412 >> 172.21.15.159:0/1154656412 conn(0x7f888c0fc110 msgr2=0x7f888c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:02.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.161+0000 7f8891e00700 1 -- 172.21.15.159:0/1154656412 shutdown_connections 2024-02-28T23:08:02.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.161+0000 7f8891e00700 1 -- 172.21.15.159:0/1154656412 wait complete. 2024-02-28T23:08:02.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.163+0000 7f8891e00700 1 Processor -- start 2024-02-28T23:08:02.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.163+0000 7f8891e00700 1 -- start start 2024-02-28T23:08:02.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.163+0000 7f8891e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f888c100bb0 0x7f888c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:02.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.163+0000 7f8891e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f888c101db0 0x7f888c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:02.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.163+0000 7f8891e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c19d4b0 con 0x7f888c101db0 2024-02-28T23:08:02.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.163+0000 7f8891e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f888c19d5f0 con 0x7f888c100bb0 2024-02-28T23:08:02.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.164+0000 7f888a000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f888c101db0 0x7f888c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:02.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.164+0000 7f888a000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f888c101db0 0x7f888c19ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36844/0 (socket says 172.21.15.159:36844) 2024-02-28T23:08:02.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.164+0000 7f888a000700 1 -- 172.21.15.159:0/4084862848 learned_addr learned my addr 172.21.15.159:0/4084862848 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:08:02.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.164+0000 7f888aa00700 1 --2- 172.21.15.159:0/4084862848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f888c100bb0 0x7f888c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:02.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.164+0000 7f888aa00700 1 -- 172.21.15.159:0/4084862848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f888c101db0 msgr2=0x7f888c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:02.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.164+0000 7f888aa00700 1 --2- 172.21.15.159:0/4084862848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f888c101db0 0x7f888c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:02.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.164+0000 7f888aa00700 1 -- 172.21.15.159:0/4084862848 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88780095f0 con 0x7f888c100bb0 2024-02-28T23:08:02.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.165+0000 7f888aa00700 1 --2- 172.21.15.159:0/4084862848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f888c100bb0 0x7f888c19c950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f887c00d6c0 tx=0x7f887c00d9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:02.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.165+0000 7f8890a00700 1 -- 172.21.15.159:0/4084862848 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f887c0041f0 con 0x7f888c100bb0 2024-02-28T23:08:02.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.166+0000 7f8890a00700 1 -- 172.21.15.159:0/4084862848 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f887c004350 con 0x7f888c100bb0 2024-02-28T23:08:02.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.166+0000 7f8891e00700 1 -- 172.21.15.159:0/4084862848 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f888c1a20a0 con 0x7f888c100bb0 2024-02-28T23:08:02.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.166+0000 7f8890a00700 1 -- 172.21.15.159:0/4084862848 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f887c003d20 con 0x7f888c100bb0 2024-02-28T23:08:02.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.166+0000 7f8891e00700 1 -- 172.21.15.159:0/4084862848 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f888c1a25f0 con 0x7f888c100bb0 2024-02-28T23:08:02.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.167+0000 7f8891e00700 1 -- 172.21.15.159:0/4084862848 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f888c105e90 con 0x7f888c100bb0 2024-02-28T23:08:02.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.168+0000 7f8890a00700 1 -- 172.21.15.159:0/4084862848 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 29) v1 ==== 46069+0+0 (secure 0 0 0) 0x7f887c010460 con 0x7f888c100bb0 2024-02-28T23:08:02.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.168+0000 7f8890a00700 1 --2- 172.21.15.159:0/4084862848 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8870038f00 0x7f887003b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:02.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.168+0000 7f8890a00700 1 -- 172.21.15.159:0/4084862848 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f887c04cb50 con 0x7f888c100bb0 2024-02-28T23:08:02.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.169+0000 7f888a000700 1 --2- 172.21.15.159:0/4084862848 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8870038f00 0x7f887003b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:02.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.169+0000 7f888a000700 1 --2- 172.21.15.159:0/4084862848 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8870038f00 0x7f887003b3c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8878006010 tx=0x7f8878005a90 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:02.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.184+0000 7f8890a00700 1 -- 172.21.15.159:0/4084862848 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f887c019770 con 0x7f888c100bb0 2024-02-28T23:08:02.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:01 smithi159 ceph-mon[28802]: pgmap v4: 65 pgs: 65 active+clean; 3.0 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail 2024-02-28T23:08:02.255 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:01 smithi184 ceph-mon[36198]: pgmap v4: 65 pgs: 65 active+clean; 3.0 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail 2024-02-28T23:08:02.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.556+0000 7f8891e00700 1 -- 172.21.15.159:0/4084862848 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f888c0611d0 con 0x7f8870038f00 2024-02-28T23:08:02.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.558+0000 7f8890a00700 1 -- 172.21.15.159:0/4084862848 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f888c0611d0 con 0x7f8870038f00 2024-02-28T23:08:02.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.568+0000 7f8891e00700 1 -- 172.21.15.159:0/4084862848 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8870038f00 msgr2=0x7f887003b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:02.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.568+0000 7f8891e00700 1 --2- 172.21.15.159:0/4084862848 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8870038f00 0x7f887003b3c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f8878006010 tx=0x7f8878005a90 comp rx=0 tx=0).stop 2024-02-28T23:08:02.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.568+0000 7f8891e00700 1 -- 172.21.15.159:0/4084862848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f888c100bb0 msgr2=0x7f888c19c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:02.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.568+0000 7f8891e00700 1 --2- 172.21.15.159:0/4084862848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f888c100bb0 0x7f888c19c950 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f887c00d6c0 tx=0x7f887c00d9d0 comp rx=0 tx=0).stop 2024-02-28T23:08:02.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.569+0000 7f8891e00700 1 -- 172.21.15.159:0/4084862848 shutdown_connections 2024-02-28T23:08:02.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.569+0000 7f8891e00700 1 --2- 172.21.15.159:0/4084862848 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8870038f00 0x7f887003b3c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:02.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.569+0000 7f8891e00700 1 --2- 172.21.15.159:0/4084862848 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f888c100bb0 0x7f888c19c950 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:02.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.569+0000 7f8891e00700 1 --2- 172.21.15.159:0/4084862848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f888c101db0 0x7f888c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:02.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.569+0000 7f8891e00700 1 -- 172.21.15.159:0/4084862848 >> 172.21.15.159:0/4084862848 conn(0x7f888c0fc110 msgr2=0x7f888c102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:02.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.570+0000 7f8891e00700 1 -- 172.21.15.159:0/4084862848 shutdown_connections 2024-02-28T23:08:02.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.570+0000 7f8891e00700 1 -- 172.21.15.159:0/4084862848 wait complete. 2024-02-28T23:08:02.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.762+0000 7fbc70600700 1 -- 172.21.15.159:0/3002532008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc68103f70 msgr2=0x7fbc68106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:02.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.762+0000 7fbc70600700 1 --2- 172.21.15.159:0/3002532008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc68103f70 0x7fbc68106360 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fbc54009910 tx=0x7fbc54009c20 comp rx=0 tx=0).stop 2024-02-28T23:08:02.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.762+0000 7fbc70600700 1 -- 172.21.15.159:0/3002532008 shutdown_connections 2024-02-28T23:08:02.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.763+0000 7fbc70600700 1 --2- 172.21.15.159:0/3002532008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc68103f70 0x7fbc68106360 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:02.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.763+0000 7fbc70600700 1 --2- 172.21.15.159:0/3002532008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc68101640 0x7fbc68103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:02.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.763+0000 7fbc70600700 1 -- 172.21.15.159:0/3002532008 >> 172.21.15.159:0/3002532008 conn(0x7fbc680fb030 msgr2=0x7fbc680fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:02.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.763+0000 7fbc70600700 1 -- 172.21.15.159:0/3002532008 shutdown_connections 2024-02-28T23:08:02.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.763+0000 7fbc70600700 1 -- 172.21.15.159:0/3002532008 wait complete. 2024-02-28T23:08:02.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.764+0000 7fbc70600700 1 Processor -- start 2024-02-28T23:08:02.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.764+0000 7fbc70600700 1 -- start start 2024-02-28T23:08:02.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.764+0000 7fbc70600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc68103f70 0x7fbc681986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:02.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.764+0000 7fbc70600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc68198c20 0x7fbc6819dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:02.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.765+0000 7fbc70600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc68199130 con 0x7fbc68198c20 2024-02-28T23:08:02.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.765+0000 7fbc70600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc681992a0 con 0x7fbc68103f70 2024-02-28T23:08:02.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.765+0000 7fbc6d200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc68198c20 0x7fbc6819dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:02.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.765+0000 7fbc6d200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc68198c20 0x7fbc6819dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36860/0 (socket says 172.21.15.159:36860) 2024-02-28T23:08:02.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.765+0000 7fbc6d200700 1 -- 172.21.15.159:0/2086624500 learned_addr learned my addr 172.21.15.159:0/2086624500 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:08:02.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.765+0000 7fbc6dc00700 1 --2- 172.21.15.159:0/2086624500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc68103f70 0x7fbc681986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:02.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.765+0000 7fbc6d200700 1 -- 172.21.15.159:0/2086624500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc68103f70 msgr2=0x7fbc681986e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:02.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.765+0000 7fbc6d200700 1 --2- 172.21.15.159:0/2086624500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc68103f70 0x7fbc681986e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:02.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.765+0000 7fbc6d200700 1 -- 172.21.15.159:0/2086624500 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc540095f0 con 0x7fbc68198c20 2024-02-28T23:08:02.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.766+0000 7fbc6d200700 1 --2- 172.21.15.159:0/2086624500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc68198c20 0x7fbc6819dc90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400bd70 tx=0x7fbc5400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:02.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.766+0000 7fbc66000700 1 -- 172.21.15.159:0/2086624500 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc5401d070 con 0x7fbc68198c20 2024-02-28T23:08:02.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.766+0000 7fbc70600700 1 -- 172.21.15.159:0/2086624500 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6819e1d0 con 0x7fbc68198c20 2024-02-28T23:08:02.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.766+0000 7fbc66000700 1 -- 172.21.15.159:0/2086624500 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbc54022470 con 0x7fbc68198c20 2024-02-28T23:08:02.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.766+0000 7fbc66000700 1 -- 172.21.15.159:0/2086624500 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc5400f650 con 0x7fbc68198c20 2024-02-28T23:08:02.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.766+0000 7fbc70600700 1 -- 172.21.15.159:0/2086624500 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6810a110 con 0x7fbc68198c20 2024-02-28T23:08:02.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.768+0000 7fbc66000700 1 -- 172.21.15.159:0/2086624500 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 29) v1 ==== 46069+0+0 (secure 0 0 0) 0x7fbc5400f7b0 con 0x7fbc68198c20 2024-02-28T23:08:02.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.768+0000 7fbc5b400700 1 -- 172.21.15.159:0/2086624500 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc440052f0 con 0x7fbc68198c20 2024-02-28T23:08:02.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.768+0000 7fbc66000700 1 --2- 172.21.15.159:0/2086624500 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbc500416c0 0x7fbc50043b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:02.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.768+0000 7fbc66000700 1 -- 172.21.15.159:0/2086624500 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbc5404e820 con 0x7fbc68198c20 2024-02-28T23:08:02.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.769+0000 7fbc6dc00700 1 --2- 172.21.15.159:0/2086624500 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbc500416c0 0x7fbc50043b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:02.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.771+0000 7fbc6dc00700 1 --2- 172.21.15.159:0/2086624500 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbc500416c0 0x7fbc50043b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbc680685e0 tx=0x7fbc5c008040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:02.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:02.775+0000 7fbc66000700 1 -- 172.21.15.159:0/2086624500 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fbc54017400 con 0x7fbc68198c20 2024-02-28T23:08:03.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.120+0000 7fbc5b400700 1 -- 172.21.15.159:0/2086624500 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc44000bc0 con 0x7fbc500416c0 2024-02-28T23:08:03.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.133+0000 7fbc66000700 1 -- 172.21.15.159:0/2086624500 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fbc44000bc0 con 0x7fbc500416c0 2024-02-28T23:08:03.131 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (9m) 12s ago 11m 14.0M - 0.25.0 c8568f914cd2 2b2966e86e70 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (12m) 12s ago 12m 7906k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (10m) 82s ago 10m 7490k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (12m) 12s ago 12m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (10m) 82s ago 10m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (9m) 12s ago 11m 74.8M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (4m) 12s ago 4m 208M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (4m) 12s ago 4m 128M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (4m) 82s ago 4m 13.4M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (4m) 82s ago 4m 13.3M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (28s) 12s ago 13m 91.4M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (115s) 82s ago 10m 486M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1399495d8706 2024-02-28T23:08:03.132 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (13m) 12s ago 13m 49.8M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:08:03.133 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (10m) 82s ago 10m 38.4M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:08:03.133 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (11m) 12s ago 11m 7784k - 1.5.0 0da6a335fe13 009475616a7b 2024-02-28T23:08:03.133 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (10m) 82s ago 10m 8216k - 1.5.0 0da6a335fe13 a45ab4136b88 2024-02-28T23:08:03.133 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (9m) 12s ago 9m 189M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:08:03.133 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (8m) 12s ago 8m 216M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:08:03.133 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (8m) 12s ago 8m 176M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:08:03.133 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (7m) 82s ago 7m 112M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:08:03.133 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (6m) 82s ago 6m 107M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:08:03.133 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (6m) 82s ago 6m 104M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:08:03.133 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (59s) 12s ago 11m 42.0M - 2.43.0 a07b618ecd1d 8f1bbc427976 2024-02-28T23:08:03.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.136+0000 7fbc5b400700 1 -- 172.21.15.159:0/2086624500 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbc500416c0 msgr2=0x7fbc50043b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:03.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.136+0000 7fbc5b400700 1 --2- 172.21.15.159:0/2086624500 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbc500416c0 0x7fbc50043b80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbc680685e0 tx=0x7fbc5c008040 comp rx=0 tx=0).stop 2024-02-28T23:08:03.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.136+0000 7fbc5b400700 1 -- 172.21.15.159:0/2086624500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc68198c20 msgr2=0x7fbc6819dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:03.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.136+0000 7fbc5b400700 1 --2- 172.21.15.159:0/2086624500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc68198c20 0x7fbc6819dc90 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400bd70 tx=0x7fbc5400be50 comp rx=0 tx=0).stop 2024-02-28T23:08:03.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.136+0000 7fbc5b400700 1 -- 172.21.15.159:0/2086624500 shutdown_connections 2024-02-28T23:08:03.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.136+0000 7fbc5b400700 1 --2- 172.21.15.159:0/2086624500 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbc500416c0 0x7fbc50043b80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.136+0000 7fbc5b400700 1 --2- 172.21.15.159:0/2086624500 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc68103f70 0x7fbc681986e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.136+0000 7fbc5b400700 1 --2- 172.21.15.159:0/2086624500 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc68198c20 0x7fbc6819dc90 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.136+0000 7fbc5b400700 1 -- 172.21.15.159:0/2086624500 >> 172.21.15.159:0/2086624500 conn(0x7fbc680fb030 msgr2=0x7fbc68103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:03.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.136+0000 7fbc5b400700 1 -- 172.21.15.159:0/2086624500 shutdown_connections 2024-02-28T23:08:03.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.136+0000 7fbc5b400700 1 -- 172.21.15.159:0/2086624500 wait complete. 2024-02-28T23:08:03.284 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:02 smithi159 ceph-mon[28802]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:03.285 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:02 smithi159 ceph-mon[28802]: mgrmap e29: smithi159.pobewk(active, since 3s) 2024-02-28T23:08:03.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.319+0000 7f3433400700 1 -- 172.21.15.159:0/3720059323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f342c100bb0 msgr2=0x7f342c100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:03.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.319+0000 7f3433400700 1 --2- 172.21.15.159:0/3720059323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f342c100bb0 0x7f342c100fd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f3420009870 tx=0x7f3420009b80 comp rx=0 tx=0).stop 2024-02-28T23:08:03.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.319+0000 7f3433400700 1 -- 172.21.15.159:0/3720059323 shutdown_connections 2024-02-28T23:08:03.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.319+0000 7f3433400700 1 --2- 172.21.15.159:0/3720059323 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f342c101db0 0x7f342c102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.319+0000 7f3433400700 1 --2- 172.21.15.159:0/3720059323 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f342c100bb0 0x7f342c100fd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.319+0000 7f3433400700 1 -- 172.21.15.159:0/3720059323 >> 172.21.15.159:0/3720059323 conn(0x7f342c0fc110 msgr2=0x7f342c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:03.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.321+0000 7f3433400700 1 -- 172.21.15.159:0/3720059323 shutdown_connections 2024-02-28T23:08:03.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.321+0000 7f3433400700 1 -- 172.21.15.159:0/3720059323 wait complete. 2024-02-28T23:08:03.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.324+0000 7f3433400700 1 Processor -- start 2024-02-28T23:08:03.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.325+0000 7f3433400700 1 -- start start 2024-02-28T23:08:03.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.326+0000 7f3433400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f342c100bb0 0x7f342c10f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:03.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.327+0000 7f3433400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f342c101db0 0x7f342c10fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:03.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.327+0000 7f3433400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c110030 con 0x7f342c101db0 2024-02-28T23:08:03.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.327+0000 7f3433400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342c110170 con 0x7f342c100bb0 2024-02-28T23:08:03.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.328+0000 7f342be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f342c101db0 0x7f342c10fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:03.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.328+0000 7f342be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f342c101db0 0x7f342c10fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36878/0 (socket says 172.21.15.159:36878) 2024-02-28T23:08:03.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.328+0000 7f342be00700 1 -- 172.21.15.159:0/537659107 learned_addr learned my addr 172.21.15.159:0/537659107 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:08:03.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.330+0000 7f342be00700 1 -- 172.21.15.159:0/537659107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f342c100bb0 msgr2=0x7f342c10f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:03.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.330+0000 7f342be00700 1 --2- 172.21.15.159:0/537659107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f342c100bb0 0x7f342c10f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.330+0000 7f342be00700 1 -- 172.21.15.159:0/537659107 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3420009520 con 0x7f342c101db0 2024-02-28T23:08:03.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.331+0000 7f342be00700 1 --2- 172.21.15.159:0/537659107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f342c101db0 0x7f342c10fa10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f341800d900 tx=0x7f341800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:03.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.333+0000 7f3429600700 1 -- 172.21.15.159:0/537659107 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3418009900 con 0x7f342c101db0 2024-02-28T23:08:03.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.334+0000 7f3429600700 1 -- 172.21.15.159:0/537659107 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3418010460 con 0x7f342c101db0 2024-02-28T23:08:03.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.334+0000 7f3429600700 1 -- 172.21.15.159:0/537659107 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f341800f5f0 con 0x7f342c101db0 2024-02-28T23:08:03.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.335+0000 7f3433400700 1 -- 172.21.15.159:0/537659107 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342c112c10 con 0x7f342c101db0 2024-02-28T23:08:03.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.335+0000 7f3433400700 1 -- 172.21.15.159:0/537659107 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342c1131e0 con 0x7f342c101db0 2024-02-28T23:08:03.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.336+0000 7f3433400700 1 -- 172.21.15.159:0/537659107 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f342c107510 con 0x7f342c101db0 2024-02-28T23:08:03.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.338+0000 7f3429600700 1 -- 172.21.15.159:0/537659107 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 29) v1 ==== 46069+0+0 (secure 0 0 0) 0x7f3418009a60 con 0x7f342c101db0 2024-02-28T23:08:03.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.338+0000 7f3429600700 1 --2- 172.21.15.159:0/537659107 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3414038f00 0x7f341403b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:03.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.338+0000 7f3429600700 1 -- 172.21.15.159:0/537659107 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f341804d0c0 con 0x7f342c101db0 2024-02-28T23:08:03.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.342+0000 7f3430a00700 1 --2- 172.21.15.159:0/537659107 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3414038f00 0x7f341403b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:03.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.346+0000 7f3430a00700 1 --2- 172.21.15.159:0/537659107 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3414038f00 0x7f341403b3c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3420009870 tx=0x7f342000b5a0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:03.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:02 smithi184 ceph-mon[36198]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:03.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:02 smithi184 ceph-mon[36198]: mgrmap e29: smithi159.pobewk(active, since 3s) 2024-02-28T23:08:03.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.358+0000 7f3429600700 1 -- 172.21.15.159:0/537659107 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f34180105d0 con 0x7f342c101db0 2024-02-28T23:08:03.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.773+0000 7f3433400700 1 -- 172.21.15.159:0/537659107 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f342c107700 con 0x7f342c101db0 2024-02-28T23:08:03.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.774+0000 7f3429600700 1 -- 172.21.15.159:0/537659107 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f3418020020 con 0x7f342c101db0 2024-02-28T23:08:03.774 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:08:03.775 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:08:03.776 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-28T23:08:03.776 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:08:03.776 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:08:03.776 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:08:03.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.779+0000 7f3433400700 1 -- 172.21.15.159:0/537659107 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3414038f00 msgr2=0x7f341403b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:03.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.779+0000 7f3433400700 1 --2- 172.21.15.159:0/537659107 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3414038f00 0x7f341403b3c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3420009870 tx=0x7f342000b5a0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.779+0000 7f3433400700 1 -- 172.21.15.159:0/537659107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f342c101db0 msgr2=0x7f342c10fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:03.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.779+0000 7f3433400700 1 --2- 172.21.15.159:0/537659107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f342c101db0 0x7f342c10fa10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f341800d900 tx=0x7f341800dcc0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.779+0000 7f3433400700 1 -- 172.21.15.159:0/537659107 shutdown_connections 2024-02-28T23:08:03.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.779+0000 7f3433400700 1 --2- 172.21.15.159:0/537659107 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3414038f00 0x7f341403b3c0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.779+0000 7f3433400700 1 --2- 172.21.15.159:0/537659107 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f342c100bb0 0x7f342c10f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.779+0000 7f3433400700 1 --2- 172.21.15.159:0/537659107 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f342c101db0 0x7f342c10fa10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.779+0000 7f3433400700 1 -- 172.21.15.159:0/537659107 >> 172.21.15.159:0/537659107 conn(0x7f342c0fc110 msgr2=0x7f342c104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:03.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.779+0000 7f3433400700 1 -- 172.21.15.159:0/537659107 shutdown_connections 2024-02-28T23:08:03.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.779+0000 7f3433400700 1 -- 172.21.15.159:0/537659107 wait complete. 2024-02-28T23:08:03.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.964+0000 7fd851a00700 1 -- 172.21.15.159:0/2194285267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd84c1089e0 msgr2=0x7fd84c071e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:03.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.964+0000 7fd851a00700 1 --2- 172.21.15.159:0/2194285267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd84c1089e0 0x7fd84c071e30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd83c009910 tx=0x7fd83c009c20 comp rx=0 tx=0).stop 2024-02-28T23:08:03.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.965+0000 7fd851a00700 1 -- 172.21.15.159:0/2194285267 shutdown_connections 2024-02-28T23:08:03.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.965+0000 7fd851a00700 1 --2- 172.21.15.159:0/2194285267 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd84c108590 0x7fd84c076fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.965+0000 7fd851a00700 1 --2- 172.21.15.159:0/2194285267 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd84c1089e0 0x7fd84c071e30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.965+0000 7fd851a00700 1 -- 172.21.15.159:0/2194285267 >> 172.21.15.159:0/2194285267 conn(0x7fd84c06d790 msgr2=0x7fd84c06fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:03.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.965+0000 7fd851a00700 1 -- 172.21.15.159:0/2194285267 shutdown_connections 2024-02-28T23:08:03.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.966+0000 7fd851a00700 1 -- 172.21.15.159:0/2194285267 wait complete. 2024-02-28T23:08:03.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.967+0000 7fd851a00700 1 Processor -- start 2024-02-28T23:08:03.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.967+0000 7fd851a00700 1 -- start start 2024-02-28T23:08:03.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.967+0000 7fd851a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd84c108590 0x7fd84c1b22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:03.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.967+0000 7fd851a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd84c1089e0 0x7fd84c1b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:03.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.967+0000 7fd851a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1b4d60 con 0x7fd84c1089e0 2024-02-28T23:08:03.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.967+0000 7fd851a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84c1b4ea0 con 0x7fd84c108590 2024-02-28T23:08:03.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.968+0000 7fd84be00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd84c108590 0x7fd84c1b22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:03.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.968+0000 7fd84b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd84c1089e0 0x7fd84c1b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:03.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.968+0000 7fd84be00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd84c108590 0x7fd84c1b22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:45452/0 (socket says 172.21.15.159:45452) 2024-02-28T23:08:03.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.968+0000 7fd84be00700 1 -- 172.21.15.159:0/3394903223 learned_addr learned my addr 172.21.15.159:0/3394903223 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:08:03.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.968+0000 7fd84b400700 1 -- 172.21.15.159:0/3394903223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd84c108590 msgr2=0x7fd84c1b22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:03.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.968+0000 7fd84b400700 1 --2- 172.21.15.159:0/3394903223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd84c108590 0x7fd84c1b22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:03.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.968+0000 7fd84b400700 1 -- 172.21.15.159:0/3394903223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0095f0 con 0x7fd84c1089e0 2024-02-28T23:08:03.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.969+0000 7fd84b400700 1 --2- 172.21.15.159:0/3394903223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd84c1089e0 0x7fd84c1b4820 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd84c1082c0 tx=0x7fd838009f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:03.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.969+0000 7fd848c00700 1 -- 172.21.15.159:0/3394903223 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd838015070 con 0x7fd84c1089e0 2024-02-28T23:08:03.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.969+0000 7fd851a00700 1 -- 172.21.15.159:0/3394903223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84c078690 con 0x7fd84c1089e0 2024-02-28T23:08:03.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.970+0000 7fd848c00700 1 -- 172.21.15.159:0/3394903223 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd8380044e0 con 0x7fd84c1089e0 2024-02-28T23:08:03.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.970+0000 7fd848c00700 1 -- 172.21.15.159:0/3394903223 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd838015070 con 0x7fd84c1089e0 2024-02-28T23:08:03.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.970+0000 7fd851a00700 1 -- 172.21.15.159:0/3394903223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd84c078be0 con 0x7fd84c1089e0 2024-02-28T23:08:03.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.971+0000 7fd851a00700 1 -- 172.21.15.159:0/3394903223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84c07a6b0 con 0x7fd84c1089e0 2024-02-28T23:08:03.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.972+0000 7fd848c00700 1 -- 172.21.15.159:0/3394903223 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 29) v1 ==== 46069+0+0 (secure 0 0 0) 0x7fd83800bc20 con 0x7fd84c1089e0 2024-02-28T23:08:03.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.973+0000 7fd848c00700 1 --2- 172.21.15.159:0/3394903223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd830038f60 0x7fd83003b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:03.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.973+0000 7fd848c00700 1 -- 172.21.15.159:0/3394903223 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd838050c10 con 0x7fd84c1089e0 2024-02-28T23:08:03.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.974+0000 7fd84be00700 1 --2- 172.21.15.159:0/3394903223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd830038f60 0x7fd83003b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:03.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.975+0000 7fd84be00700 1 --2- 172.21.15.159:0/3394903223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd830038f60 0x7fd83003b420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd84c083dd0 tx=0x7fd83c005a90 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:03.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:03.982+0000 7fd848c00700 1 -- 172.21.15.159:0/3394903223 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fd838003680 con 0x7fd84c1089e0 2024-02-28T23:08:04.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:03 smithi159 ceph-mon[28802]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:04.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:03 smithi159 ceph-mon[28802]: pgmap v5: 65 pgs: 65 active+clean; 3.0 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail 2024-02-28T23:08:04.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:03 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/537659107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:08:04.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.337+0000 7fd851a00700 1 -- 172.21.15.159:0/3394903223 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd84c07d610 con 0x7fd830038f60 2024-02-28T23:08:04.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.341+0000 7fd848c00700 1 -- 172.21.15.159:0/3394903223 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fd84c07d610 con 0x7fd830038f60 2024-02-28T23:08:04.339 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:08:04.339 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:08:04.340 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:08:04.340 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:08:04.340 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:08:04.340 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:08:04.340 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:08:04.340 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T23:08:04.340 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "", 2024-02-28T23:08:04.340 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:08:04.340 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:08:04.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.345+0000 7fd851a00700 1 -- 172.21.15.159:0/3394903223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd830038f60 msgr2=0x7fd83003b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:04.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.345+0000 7fd851a00700 1 --2- 172.21.15.159:0/3394903223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd830038f60 0x7fd83003b420 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd84c083dd0 tx=0x7fd83c005a90 comp rx=0 tx=0).stop 2024-02-28T23:08:04.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.345+0000 7fd851a00700 1 -- 172.21.15.159:0/3394903223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd84c1089e0 msgr2=0x7fd84c1b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:04.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.345+0000 7fd851a00700 1 --2- 172.21.15.159:0/3394903223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd84c1089e0 0x7fd84c1b4820 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd84c1082c0 tx=0x7fd838009f00 comp rx=0 tx=0).stop 2024-02-28T23:08:04.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.345+0000 7fd851a00700 1 -- 172.21.15.159:0/3394903223 shutdown_connections 2024-02-28T23:08:04.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.345+0000 7fd851a00700 1 --2- 172.21.15.159:0/3394903223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd830038f60 0x7fd83003b420 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:04.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.345+0000 7fd851a00700 1 --2- 172.21.15.159:0/3394903223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd84c108590 0x7fd84c1b22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:04.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.345+0000 7fd851a00700 1 --2- 172.21.15.159:0/3394903223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd84c1089e0 0x7fd84c1b4820 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:04.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.345+0000 7fd851a00700 1 -- 172.21.15.159:0/3394903223 >> 172.21.15.159:0/3394903223 conn(0x7fd84c06d790 msgr2=0x7fd84c0757c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:04.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.346+0000 7fd851a00700 1 -- 172.21.15.159:0/3394903223 shutdown_connections 2024-02-28T23:08:04.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:04.346+0000 7fd851a00700 1 -- 172.21.15.159:0/3394903223 wait complete. 2024-02-28T23:08:04.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:03 smithi184 ceph-mon[36198]: from='client.24461 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:04.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:03 smithi184 ceph-mon[36198]: pgmap v5: 65 pgs: 65 active+clean; 3.0 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail 2024-02-28T23:08:04.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:03 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/537659107' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:08:05.253 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:04 smithi184 ceph-mon[36198]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:05.253 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:04 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:05.253 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:04 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:05.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:04 smithi159 ceph-mon[28802]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:05.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:04 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:05.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:04 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:06.197 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:05 smithi159 ceph-mon[28802]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:06.197 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:05 smithi159 ceph-mon[28802]: pgmap v6: 65 pgs: 65 active+clean; 3.0 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail 2024-02-28T23:08:06.304 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:05 smithi184 ceph-mon[36198]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:06.304 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:05 smithi184 ceph-mon[36198]: pgmap v6: 65 pgs: 65 active+clean; 3.0 GiB data, 9.6 GiB used, 527 GiB / 536 GiB avail 2024-02-28T23:08:07.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:07 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:07.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:07 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:07.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:07 smithi184 ceph-mon[36198]: pgmap v7: 65 pgs: 65 active+clean; 2.1 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 739 KiB/s rd, 833 KiB/s wr, 125 op/s 2024-02-28T23:08:07.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:07 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:07.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:07 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:07.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:07 smithi159 ceph-mon[28802]: pgmap v7: 65 pgs: 65 active+clean; 2.1 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 739 KiB/s rd, 833 KiB/s wr, 125 op/s 2024-02-28T23:08:09.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:09 smithi159 ceph-mon[28802]: pgmap v8: 65 pgs: 65 active+clean; 2.1 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 574 KiB/s rd, 647 KiB/s wr, 97 op/s 2024-02-28T23:08:09.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:09 smithi184 ceph-mon[36198]: pgmap v8: 65 pgs: 65 active+clean; 2.1 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 574 KiB/s rd, 647 KiB/s wr, 97 op/s 2024-02-28T23:08:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:10 smithi159 ceph-mon[28802]: Standby manager daemon smithi184.quvmnx started 2024-02-28T23:08:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:10 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/3380003230' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/crt"}]: dispatch 2024-02-28T23:08:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:10 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/3380003230' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:08:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:10 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/3380003230' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/key"}]: dispatch 2024-02-28T23:08:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:10 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/3380003230' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:08:10.850 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-28T23:08:10.851 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-02-28T23:08:10.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:10 smithi184 ceph-mon[36198]: Standby manager daemon smithi184.quvmnx started 2024-02-28T23:08:10.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:10 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/3380003230' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/crt"}]: dispatch 2024-02-28T23:08:10.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:10 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/3380003230' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:08:10.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:10 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/3380003230' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/key"}]: dispatch 2024-02-28T23:08:10.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:10 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/3380003230' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:08:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:11 smithi159 ceph-mon[28802]: mgrmap e30: smithi159.pobewk(active, since 11s), standbys: smithi184.quvmnx 2024-02-28T23:08:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:11 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi184.quvmnx", "id": "smithi184.quvmnx"}]: dispatch 2024-02-28T23:08:11.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:11 smithi159 ceph-mon[28802]: pgmap v9: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 876 KiB/s rd, 888 KiB/s wr, 137 op/s 2024-02-28T23:08:11.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:11 smithi184 ceph-mon[36198]: mgrmap e30: smithi159.pobewk(active, since 11s), standbys: smithi184.quvmnx 2024-02-28T23:08:11.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:11 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi184.quvmnx", "id": "smithi184.quvmnx"}]: dispatch 2024-02-28T23:08:11.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:11 smithi184 ceph-mon[36198]: pgmap v9: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 876 KiB/s rd, 888 KiB/s wr, 137 op/s 2024-02-28T23:08:14.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:13 smithi184 ceph-mon[36198]: pgmap v10: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 800 KiB/s rd, 811 KiB/s wr, 125 op/s 2024-02-28T23:08:14.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:13 smithi159 ceph-mon[28802]: pgmap v10: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 800 KiB/s rd, 811 KiB/s wr, 125 op/s 2024-02-28T23:08:15.097 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:15 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:08:15.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:15 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:08:16.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:16 smithi184 ceph-mon[36198]: pgmap v11: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 800 KiB/s rd, 811 KiB/s wr, 125 op/s 2024-02-28T23:08:16.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:16 smithi159 ceph-mon[28802]: pgmap v11: 65 pgs: 65 active+clean; 1.2 GiB data, 4.4 GiB used, 532 GiB / 536 GiB avail; 800 KiB/s rd, 811 KiB/s wr, 125 op/s 2024-02-28T23:08:17.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:17 smithi184 ceph-mon[36198]: pgmap v12: 65 pgs: 65 active+clean; 709 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 171 op/s 2024-02-28T23:08:17.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:17 smithi159 ceph-mon[28802]: pgmap v12: 65 pgs: 65 active+clean; 709 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.1 MiB/s wr, 171 op/s 2024-02-28T23:08:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:19 smithi184 ceph-mon[36198]: pgmap v13: 65 pgs: 65 active+clean; 709 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 610 KiB/s rd, 605 KiB/s wr, 98 op/s 2024-02-28T23:08:19.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:19.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:19.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:19 smithi159 ceph-mon[28802]: pgmap v13: 65 pgs: 65 active+clean; 709 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 610 KiB/s rd, 605 KiB/s wr, 98 op/s 2024-02-28T23:08:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:21 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:21 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:21 smithi159 ceph-mon[28802]: pgmap v14: 65 pgs: 65 active+clean; 531 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 961 KiB/s rd, 961 KiB/s wr, 166 op/s 2024-02-28T23:08:21.775 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-02-28T23:08:21.775 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-02-28T23:08:21.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:21 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:21.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:21 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:21.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:21 smithi184 ceph-mon[36198]: pgmap v14: 65 pgs: 65 active+clean; 531 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 961 KiB/s rd, 961 KiB/s wr, 166 op/s 2024-02-28T23:08:24.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:23 smithi184 ceph-mon[36198]: pgmap v15: 65 pgs: 65 active+clean; 531 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 590 KiB/s rd, 633 KiB/s wr, 114 op/s 2024-02-28T23:08:24.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:23 smithi159 ceph-mon[28802]: pgmap v15: 65 pgs: 65 active+clean; 531 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 590 KiB/s rd, 633 KiB/s wr, 114 op/s 2024-02-28T23:08:26.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:26 smithi159 ceph-mon[28802]: pgmap v16: 65 pgs: 65 active+clean; 531 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 590 KiB/s rd, 633 KiB/s wr, 114 op/s 2024-02-28T23:08:26.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:26 smithi184 ceph-mon[36198]: pgmap v16: 65 pgs: 65 active+clean; 531 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 590 KiB/s rd, 633 KiB/s wr, 114 op/s 2024-02-28T23:08:28.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:28 smithi184 ceph-mon[36198]: pgmap v17: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 213 op/s 2024-02-28T23:08:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:28 smithi159 ceph-mon[28802]: pgmap v17: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.0 MiB/s wr, 213 op/s 2024-02-28T23:08:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:08:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:08:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:29 smithi159 ceph-mon[28802]: Updating smithi159:/etc/ceph/ceph.conf 2024-02-28T23:08:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:29 smithi159 ceph-mon[28802]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-28T23:08:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:29 smithi159 ceph-mon[28802]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:08:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:29 smithi159 ceph-mon[28802]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:08:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:29 smithi159 ceph-mon[28802]: pgmap v18: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 786 KiB/s rd, 753 KiB/s wr, 167 op/s 2024-02-28T23:08:29.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:08:29.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:08:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:08:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:29 smithi184 ceph-mon[36198]: Updating smithi159:/etc/ceph/ceph.conf 2024-02-28T23:08:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:29 smithi184 ceph-mon[36198]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-28T23:08:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:29 smithi184 ceph-mon[36198]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:08:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:29 smithi184 ceph-mon[36198]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:08:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:29 smithi184 ceph-mon[36198]: pgmap v18: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 786 KiB/s rd, 753 KiB/s wr, 167 op/s 2024-02-28T23:08:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:08:30.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:30 smithi159 ceph-mon[28802]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:08:30.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:30 smithi184 ceph-mon[36198]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:08:32.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:31 smithi184 ceph-mon[36198]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:08:32.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:31 smithi184 ceph-mon[36198]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:08:32.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:31 smithi184 ceph-mon[36198]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:08:32.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:31 smithi184 ceph-mon[36198]: pgmap v19: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 280 op/s 2024-02-28T23:08:32.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:31 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:32.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:31 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:32.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:31 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:32.102 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:31 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:32.102 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:31 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:32.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:31 smithi159 ceph-mon[28802]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:08:32.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:31 smithi159 ceph-mon[28802]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:08:32.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:31 smithi159 ceph-mon[28802]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:08:32.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:31 smithi159 ceph-mon[28802]: pgmap v19: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 280 op/s 2024-02-28T23:08:32.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:31 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:32.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:31 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:32.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:31 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:32.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:31 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:32.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:31 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:33.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:32 smithi159 ceph-mon[28802]: Reconfiguring prometheus.smithi159 (dependencies changed)... 2024-02-28T23:08:33.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:32 smithi184 ceph-mon[36198]: Reconfiguring prometheus.smithi159 (dependencies changed)... 2024-02-28T23:08:34.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:33 smithi159 ceph-mon[28802]: Reconfiguring daemon prometheus.smithi159 on smithi159 2024-02-28T23:08:34.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:33 smithi159 ceph-mon[28802]: pgmap v20: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 811 KiB/s rd, 859 KiB/s wr, 212 op/s 2024-02-28T23:08:34.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:33 smithi184 ceph-mon[36198]: Reconfiguring daemon prometheus.smithi159 on smithi159 2024-02-28T23:08:34.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:33 smithi184 ceph-mon[36198]: pgmap v20: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 811 KiB/s rd, 859 KiB/s wr, 212 op/s 2024-02-28T23:08:34.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.547+0000 7f49f7400700 1 -- 172.21.15.159:0/1115125091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f0101db0 msgr2=0x7f49f0102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:34.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.547+0000 7f49f7400700 1 --2- 172.21.15.159:0/1115125091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f0101db0 0x7f49f0102210 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009910 tx=0x7f49dc009c20 comp rx=0 tx=0).stop 2024-02-28T23:08:34.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.547+0000 7f49f7400700 1 -- 172.21.15.159:0/1115125091 shutdown_connections 2024-02-28T23:08:34.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.547+0000 7f49f7400700 1 --2- 172.21.15.159:0/1115125091 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f0101db0 0x7f49f0102210 secure :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f49dc009910 tx=0x7f49dc009c20 comp rx=0 tx=0).stop 2024-02-28T23:08:34.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.547+0000 7f49f7400700 1 --2- 172.21.15.159:0/1115125091 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49f0100bb0 0x7f49f0100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:34.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.547+0000 7f49f7400700 1 -- 172.21.15.159:0/1115125091 >> 172.21.15.159:0/1115125091 conn(0x7f49f00fc110 msgr2=0x7f49f00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:34.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.549+0000 7f49f7400700 1 -- 172.21.15.159:0/1115125091 shutdown_connections 2024-02-28T23:08:34.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.549+0000 7f49f7400700 1 -- 172.21.15.159:0/1115125091 wait complete. 2024-02-28T23:08:34.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.551+0000 7f49f7400700 1 Processor -- start 2024-02-28T23:08:34.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.551+0000 7f49f7400700 1 -- start start 2024-02-28T23:08:34.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.552+0000 7f49f7400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f0100bb0 0x7f49f01943a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:34.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.552+0000 7f49f7400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49f01948e0 0x7f49f0199950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:34.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.552+0000 7f49f7400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f0194df0 con 0x7f49f0100bb0 2024-02-28T23:08:34.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.552+0000 7f49f7400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f0194f60 con 0x7f49f01948e0 2024-02-28T23:08:34.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.552+0000 7f49f4a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f0100bb0 0x7f49f01943a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:34.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.552+0000 7f49f4a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f0100bb0 0x7f49f01943a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52058/0 (socket says 172.21.15.159:52058) 2024-02-28T23:08:34.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.552+0000 7f49f4a00700 1 -- 172.21.15.159:0/1002429812 learned_addr learned my addr 172.21.15.159:0/1002429812 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:08:34.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.552+0000 7f49efe00700 1 --2- 172.21.15.159:0/1002429812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49f01948e0 0x7f49f0199950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:34.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.553+0000 7f49f4a00700 1 -- 172.21.15.159:0/1002429812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49f01948e0 msgr2=0x7f49f0199950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:34.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.553+0000 7f49f4a00700 1 --2- 172.21.15.159:0/1002429812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49f01948e0 0x7f49f0199950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:34.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.553+0000 7f49f4a00700 1 -- 172.21.15.159:0/1002429812 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc0095f0 con 0x7f49f0100bb0 2024-02-28T23:08:34.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.553+0000 7f49f4a00700 1 --2- 172.21.15.159:0/1002429812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f0100bb0 0x7f49f01943a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f49e400d900 tx=0x7f49e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:34.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.554+0000 7f49ed600700 1 -- 172.21.15.159:0/1002429812 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e40041f0 con 0x7f49f0100bb0 2024-02-28T23:08:34.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.554+0000 7f49ed600700 1 -- 172.21.15.159:0/1002429812 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f49e4004350 con 0x7f49f0100bb0 2024-02-28T23:08:34.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.554+0000 7f49f7400700 1 -- 172.21.15.159:0/1002429812 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f0199ef0 con 0x7f49f0100bb0 2024-02-28T23:08:34.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.554+0000 7f49f7400700 1 -- 172.21.15.159:0/1002429812 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f019a440 con 0x7f49f0100bb0 2024-02-28T23:08:34.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.555+0000 7f49ed600700 1 -- 172.21.15.159:0/1002429812 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49e4003da0 con 0x7f49f0100bb0 2024-02-28T23:08:34.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.555+0000 7f49f7400700 1 -- 172.21.15.159:0/1002429812 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d0005320 con 0x7f49f0100bb0 2024-02-28T23:08:34.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.557+0000 7f49ed600700 1 -- 172.21.15.159:0/1002429812 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 30) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f49e4010460 con 0x7f49f0100bb0 2024-02-28T23:08:34.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.558+0000 7f49ed600700 1 --2- 172.21.15.159:0/1002429812 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f49d806d650 0x7f49d806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:34.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.558+0000 7f49ed600700 1 -- 172.21.15.159:0/1002429812 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f49e408d090 con 0x7f49f0100bb0 2024-02-28T23:08:34.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.559+0000 7f49efe00700 1 --2- 172.21.15.159:0/1002429812 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f49d806d650 0x7f49d806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:34.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.560+0000 7f49efe00700 1 --2- 172.21.15.159:0/1002429812 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f49d806d650 0x7f49d806fb10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f49dc005090 tx=0x7f49dc00b540 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:34.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.565+0000 7f49ed600700 1 -- 172.21.15.159:0/1002429812 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f49e405a700 con 0x7f49f0100bb0 2024-02-28T23:08:34.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.912+0000 7f49f7400700 1 -- 172.21.15.159:0/1002429812 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49d0000bf0 con 0x7f49d806d650 2024-02-28T23:08:34.916 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.917+0000 7f49ed600700 1 -- 172.21.15.159:0/1002429812 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f49d0000bf0 con 0x7f49d806d650 2024-02-28T23:08:34.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.921+0000 7f49f7400700 1 -- 172.21.15.159:0/1002429812 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f49d806d650 msgr2=0x7f49d806fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:34.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.921+0000 7f49f7400700 1 --2- 172.21.15.159:0/1002429812 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f49d806d650 0x7f49d806fb10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f49dc005090 tx=0x7f49dc00b540 comp rx=0 tx=0).stop 2024-02-28T23:08:34.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.921+0000 7f49f7400700 1 -- 172.21.15.159:0/1002429812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f0100bb0 msgr2=0x7f49f01943a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:34.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.921+0000 7f49f7400700 1 --2- 172.21.15.159:0/1002429812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f0100bb0 0x7f49f01943a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f49e400d900 tx=0x7f49e400dcc0 comp rx=0 tx=0).stop 2024-02-28T23:08:34.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.921+0000 7f49f7400700 1 -- 172.21.15.159:0/1002429812 shutdown_connections 2024-02-28T23:08:34.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.921+0000 7f49f7400700 1 --2- 172.21.15.159:0/1002429812 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f49d806d650 0x7f49d806fb10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:34.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.921+0000 7f49f7400700 1 --2- 172.21.15.159:0/1002429812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49f0100bb0 0x7f49f01943a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:34.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.921+0000 7f49f7400700 1 --2- 172.21.15.159:0/1002429812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f49f01948e0 0x7f49f0199950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:34.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.921+0000 7f49f7400700 1 -- 172.21.15.159:0/1002429812 >> 172.21.15.159:0/1002429812 conn(0x7f49f00fc110 msgr2=0x7f49f0102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:34.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.921+0000 7f49f7400700 1 -- 172.21.15.159:0/1002429812 shutdown_connections 2024-02-28T23:08:34.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:34.921+0000 7f49f7400700 1 -- 172.21.15.159:0/1002429812 wait complete. 2024-02-28T23:08:34.947 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:08:35.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.115+0000 7f5404200700 1 -- 172.21.15.159:0/2338772158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc100bb0 msgr2=0x7f53fc100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:35.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.115+0000 7f5404200700 1 --2- 172.21.15.159:0/2338772158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc100bb0 0x7f53fc100fd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f53f0009910 tx=0x7f53f0009c20 comp rx=0 tx=0).stop 2024-02-28T23:08:35.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.116+0000 7f5404200700 1 -- 172.21.15.159:0/2338772158 shutdown_connections 2024-02-28T23:08:35.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.116+0000 7f5404200700 1 --2- 172.21.15.159:0/2338772158 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53fc101db0 0x7f53fc102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.116+0000 7f5404200700 1 --2- 172.21.15.159:0/2338772158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc100bb0 0x7f53fc100fd0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.116+0000 7f5404200700 1 -- 172.21.15.159:0/2338772158 >> 172.21.15.159:0/2338772158 conn(0x7f53fc0fc110 msgr2=0x7f53fc0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:35.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.116+0000 7f5404200700 1 -- 172.21.15.159:0/2338772158 shutdown_connections 2024-02-28T23:08:35.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.116+0000 7f5404200700 1 -- 172.21.15.159:0/2338772158 wait complete. 2024-02-28T23:08:35.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.117+0000 7f5404200700 1 Processor -- start 2024-02-28T23:08:35.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.117+0000 7f5404200700 1 -- start start 2024-02-28T23:08:35.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.117+0000 7f5404200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc100bb0 0x7f53fc198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:35.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.117+0000 7f5404200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53fc101db0 0x7f53fc198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:35.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.117+0000 7f5404200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc1990e0 con 0x7f53fc100bb0 2024-02-28T23:08:35.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.117+0000 7f5404200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53fc199220 con 0x7f53fc101db0 2024-02-28T23:08:35.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.118+0000 7f5401800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc100bb0 0x7f53fc198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:35.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.118+0000 7f5401800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc100bb0 0x7f53fc198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52064/0 (socket says 172.21.15.159:52064) 2024-02-28T23:08:35.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.118+0000 7f5401800700 1 -- 172.21.15.159:0/3071567200 learned_addr learned my addr 172.21.15.159:0/3071567200 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:08:35.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.118+0000 7f5400e00700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53fc101db0 0x7f53fc198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:35.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.118+0000 7f5401800700 1 -- 172.21.15.159:0/3071567200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53fc101db0 msgr2=0x7f53fc198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:35.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.118+0000 7f5401800700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53fc101db0 0x7f53fc198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.118+0000 7f5401800700 1 -- 172.21.15.159:0/3071567200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f00095f0 con 0x7f53fc100bb0 2024-02-28T23:08:35.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.118+0000 7f5400e00700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53fc101db0 0x7f53fc198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:08:35.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.119+0000 7f5401800700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc100bb0 0x7f53fc198580 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f53f000bda0 tx=0x7f53f000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:35.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.119+0000 7f53fa000700 1 -- 172.21.15.159:0/3071567200 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f001d070 con 0x7f53fc100bb0 2024-02-28T23:08:35.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.119+0000 7f53fa000700 1 -- 172.21.15.159:0/3071567200 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f53f000f460 con 0x7f53fc100bb0 2024-02-28T23:08:35.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.119+0000 7f53fa000700 1 -- 172.21.15.159:0/3071567200 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53f0021620 con 0x7f53fc100bb0 2024-02-28T23:08:35.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.119+0000 7f5404200700 1 -- 172.21.15.159:0/3071567200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53fc19dc70 con 0x7f53fc100bb0 2024-02-28T23:08:35.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.119+0000 7f5404200700 1 -- 172.21.15.159:0/3071567200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53fc19e110 con 0x7f53fc100bb0 2024-02-28T23:08:35.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.121+0000 7f5404200700 1 -- 172.21.15.159:0/3071567200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53fc105e90 con 0x7f53fc100bb0 2024-02-28T23:08:35.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.123+0000 7f53fa000700 1 -- 172.21.15.159:0/3071567200 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 30) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f53f000f5d0 con 0x7f53fc100bb0 2024-02-28T23:08:35.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.124+0000 7f53fa000700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f53e406d650 0x7f53e406fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:35.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.124+0000 7f53fa000700 1 -- 172.21.15.159:0/3071567200 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f53f008e620 con 0x7f53fc100bb0 2024-02-28T23:08:35.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.125+0000 7f5400e00700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f53e406d650 0x7f53e406fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:35.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.126+0000 7f5400e00700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f53e406d650 0x7f53e406fb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f53e8005950 tx=0x7f53e80058e0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:35.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.129+0000 7f53fa000700 1 -- 172.21.15.159:0/3071567200 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f53f005bb70 con 0x7f53fc100bb0 2024-02-28T23:08:35.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.419+0000 7f5404200700 1 -- 172.21.15.159:0/3071567200 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53fc0611d0 con 0x7f53e406d650 2024-02-28T23:08:35.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.421+0000 7f53fa000700 1 -- 172.21.15.159:0/3071567200 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f53fc0611d0 con 0x7f53e406d650 2024-02-28T23:08:35.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.424+0000 7f5404200700 1 -- 172.21.15.159:0/3071567200 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f53e406d650 msgr2=0x7f53e406fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:35.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.424+0000 7f5404200700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f53e406d650 0x7f53e406fb10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f53e8005950 tx=0x7f53e80058e0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.424+0000 7f5404200700 1 -- 172.21.15.159:0/3071567200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc100bb0 msgr2=0x7f53fc198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:35.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.424+0000 7f5404200700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc100bb0 0x7f53fc198580 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f53f000bda0 tx=0x7f53f000be80 comp rx=0 tx=0).stop 2024-02-28T23:08:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.424+0000 7f5404200700 1 -- 172.21.15.159:0/3071567200 shutdown_connections 2024-02-28T23:08:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.424+0000 7f5404200700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f53e406d650 0x7f53e406fb10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.424+0000 7f5404200700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53fc100bb0 0x7f53fc198580 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.424+0000 7f5404200700 1 --2- 172.21.15.159:0/3071567200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f53fc101db0 0x7f53fc198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.424+0000 7f5404200700 1 -- 172.21.15.159:0/3071567200 >> 172.21.15.159:0/3071567200 conn(0x7f53fc0fc110 msgr2=0x7f53fc102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.424+0000 7f5404200700 1 -- 172.21.15.159:0/3071567200 shutdown_connections 2024-02-28T23:08:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.424+0000 7f5404200700 1 -- 172.21.15.159:0/3071567200 wait complete. 2024-02-28T23:08:35.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.598+0000 7f503d200700 1 -- 172.21.15.159:0/2600914819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5038103f70 msgr2=0x7f5038106360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:35.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.598+0000 7f503d200700 1 --2- 172.21.15.159:0/2600914819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5038103f70 0x7f5038106360 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5024009910 tx=0x7f5024009c20 comp rx=0 tx=0).stop 2024-02-28T23:08:35.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.598+0000 7f503d200700 1 -- 172.21.15.159:0/2600914819 shutdown_connections 2024-02-28T23:08:35.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.598+0000 7f503d200700 1 --2- 172.21.15.159:0/2600914819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5038103f70 0x7f5038106360 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.598+0000 7f503d200700 1 --2- 172.21.15.159:0/2600914819 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5038101640 0x7f5038103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.598+0000 7f503d200700 1 -- 172.21.15.159:0/2600914819 >> 172.21.15.159:0/2600914819 conn(0x7f50380fb030 msgr2=0x7f50380fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:35.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.599+0000 7f503d200700 1 -- 172.21.15.159:0/2600914819 shutdown_connections 2024-02-28T23:08:35.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.599+0000 7f503d200700 1 -- 172.21.15.159:0/2600914819 wait complete. 2024-02-28T23:08:35.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.600+0000 7f503d200700 1 Processor -- start 2024-02-28T23:08:35.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.600+0000 7f503d200700 1 -- start start 2024-02-28T23:08:35.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.600+0000 7f503d200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5038101640 0x7f5038198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:35.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.600+0000 7f503d200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5038103f70 0x7f5038198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:35.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.600+0000 7f503d200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50381990c0 con 0x7f5038101640 2024-02-28T23:08:35.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.600+0000 7f503d200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5038199200 con 0x7f5038103f70 2024-02-28T23:08:35.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.600+0000 7f5035e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5038101640 0x7f5038198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:35.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.600+0000 7f5035e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5038101640 0x7f5038198560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52084/0 (socket says 172.21.15.159:52084) 2024-02-28T23:08:35.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.600+0000 7f5035e00700 1 -- 172.21.15.159:0/3437829774 learned_addr learned my addr 172.21.15.159:0/3437829774 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:08:35.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.601+0000 7f5035400700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5038103f70 0x7f5038198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:35.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.601+0000 7f5035e00700 1 -- 172.21.15.159:0/3437829774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5038103f70 msgr2=0x7f5038198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:35.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.601+0000 7f5035e00700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5038103f70 0x7f5038198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.601+0000 7f5035e00700 1 -- 172.21.15.159:0/3437829774 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50240095f0 con 0x7f5038101640 2024-02-28T23:08:35.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.601+0000 7f5035400700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5038103f70 0x7f5038198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:08:35.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.601+0000 7f5035e00700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5038101640 0x7f5038198560 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f502800d8d0 tx=0x7f502800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:35.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.602+0000 7f502ea00700 1 -- 172.21.15.159:0/3437829774 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5028009940 con 0x7f5038101640 2024-02-28T23:08:35.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.602+0000 7f502ea00700 1 -- 172.21.15.159:0/3437829774 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5028010460 con 0x7f5038101640 2024-02-28T23:08:35.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.602+0000 7f502ea00700 1 -- 172.21.15.159:0/3437829774 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f502800f5f0 con 0x7f5038101640 2024-02-28T23:08:35.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.602+0000 7f503d200700 1 -- 172.21.15.159:0/3437829774 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503819dcb0 con 0x7f5038101640 2024-02-28T23:08:35.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.602+0000 7f503d200700 1 -- 172.21.15.159:0/3437829774 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503819e1b0 con 0x7f5038101640 2024-02-28T23:08:35.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.603+0000 7f503d200700 1 -- 172.21.15.159:0/3437829774 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50380fcc20 con 0x7f5038101640 2024-02-28T23:08:35.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.604+0000 7f502ea00700 1 -- 172.21.15.159:0/3437829774 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 30) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f50280105d0 con 0x7f5038101640 2024-02-28T23:08:35.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.605+0000 7f502ea00700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f501c06d690 0x7f501c06fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:35.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.605+0000 7f502ea00700 1 -- 172.21.15.159:0/3437829774 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f502808d0e0 con 0x7f5038101640 2024-02-28T23:08:35.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.606+0000 7f5035400700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f501c06d690 0x7f501c06fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:35.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.606+0000 7f5035400700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f501c06d690 0x7f501c06fb50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5024006010 tx=0x7f502400b540 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:35.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.610+0000 7f502ea00700 1 -- 172.21.15.159:0/3437829774 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f502805a730 con 0x7f5038101640 2024-02-28T23:08:35.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.952+0000 7f503d200700 1 -- 172.21.15.159:0/3437829774 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f50380611d0 con 0x7f501c06d690 2024-02-28T23:08:35.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.971+0000 7f502ea00700 1 -- 172.21.15.159:0/3437829774 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f50380611d0 con 0x7f501c06d690 2024-02-28T23:08:35.971 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:08:35.971 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (10m) 17s ago 12m 14.0M - 0.25.0 c8568f914cd2 2b2966e86e70 2024-02-28T23:08:35.971 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (12m) 17s ago 12m 7931k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:08:35.972 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (11m) 31s ago 11m 7600k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:08:35.972 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (12m) 17s ago 12m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:08:35.972 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (11m) 31s ago 11m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:08:35.972 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (10m) 17s ago 11m 74.9M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:08:35.972 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (4m) 17s ago 4m 219M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:08:35.972 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (5m) 17s ago 5m 139M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:08:35.972 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (5m) 31s ago 5m 14.2M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:08:35.972 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (4m) 31s ago 4m 14.1M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:08:35.972 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (60s) 17s ago 14m 475M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:08:35.972 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (2m) 31s ago 10m 74.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 1399495d8706 2024-02-28T23:08:35.973 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (14m) 17s ago 14m 52.4M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:08:35.973 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (10m) 31s ago 10m 41.1M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:08:35.973 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (12m) 17s ago 12m 7856k - 1.5.0 0da6a335fe13 009475616a7b 2024-02-28T23:08:35.973 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (11m) 31s ago 11m 7671k - 1.5.0 0da6a335fe13 a45ab4136b88 2024-02-28T23:08:35.973 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (9m) 17s ago 9m 202M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:08:35.973 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (9m) 17s ago 9m 217M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:08:35.973 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (8m) 17s ago 8m 178M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:08:35.973 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (8m) 31s ago 8m 244M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:08:35.973 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (7m) 31s ago 7m 217M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:08:35.973 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (6m) 31s ago 6m 198M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:08:35.973 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (92s) 17s ago 11m 42.8M - 2.43.0 a07b618ecd1d 8f1bbc427976 2024-02-28T23:08:35.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.974+0000 7f503d200700 1 -- 172.21.15.159:0/3437829774 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f501c06d690 msgr2=0x7f501c06fb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:35.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.974+0000 7f503d200700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f501c06d690 0x7f501c06fb50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f5024006010 tx=0x7f502400b540 comp rx=0 tx=0).stop 2024-02-28T23:08:35.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.974+0000 7f503d200700 1 -- 172.21.15.159:0/3437829774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5038101640 msgr2=0x7f5038198560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:35.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.974+0000 7f503d200700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5038101640 0x7f5038198560 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f502800d8d0 tx=0x7f502800dc90 comp rx=0 tx=0).stop 2024-02-28T23:08:35.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.975+0000 7f503d200700 1 -- 172.21.15.159:0/3437829774 shutdown_connections 2024-02-28T23:08:35.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.975+0000 7f503d200700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f501c06d690 0x7f501c06fb50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.975+0000 7f503d200700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5038101640 0x7f5038198560 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.975+0000 7f503d200700 1 --2- 172.21.15.159:0/3437829774 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5038103f70 0x7f5038198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:35.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.975+0000 7f503d200700 1 -- 172.21.15.159:0/3437829774 >> 172.21.15.159:0/3437829774 conn(0x7f50380fb030 msgr2=0x7f50380ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:35.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.975+0000 7f503d200700 1 -- 172.21.15.159:0/3437829774 shutdown_connections 2024-02-28T23:08:35.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:35.975+0000 7f503d200700 1 -- 172.21.15.159:0/3437829774 wait complete. 2024-02-28T23:08:36.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.144+0000 7f97c5c00700 1 -- 172.21.15.159:0/2272442693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c0101640 msgr2=0x7f97c0103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:36.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.144+0000 7f97c5c00700 1 --2- 172.21.15.159:0/2272442693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c0101640 0x7f97c0103a30 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009910 tx=0x7f97b0009c20 comp rx=0 tx=0).stop 2024-02-28T23:08:36.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.144+0000 7f97c5c00700 1 -- 172.21.15.159:0/2272442693 shutdown_connections 2024-02-28T23:08:36.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.144+0000 7f97c5c00700 1 --2- 172.21.15.159:0/2272442693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97c0103f70 0x7f97c0106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:36.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.144+0000 7f97c5c00700 1 --2- 172.21.15.159:0/2272442693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c0101640 0x7f97c0103a30 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:36.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.144+0000 7f97c5c00700 1 -- 172.21.15.159:0/2272442693 >> 172.21.15.159:0/2272442693 conn(0x7f97c00fb030 msgr2=0x7f97c00fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:36.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.145+0000 7f97c5c00700 1 -- 172.21.15.159:0/2272442693 shutdown_connections 2024-02-28T23:08:36.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.145+0000 7f97c5c00700 1 -- 172.21.15.159:0/2272442693 wait complete. 2024-02-28T23:08:36.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.146+0000 7f97c5c00700 1 Processor -- start 2024-02-28T23:08:36.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.146+0000 7f97c5c00700 1 -- start start 2024-02-28T23:08:36.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.147+0000 7f97c5c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c0101640 0x7f97c019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:36.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.147+0000 7f97c5c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97c0103f70 0x7f97c019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:36.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.147+0000 7f97c5c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c019d4e0 con 0x7f97c0101640 2024-02-28T23:08:36.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.147+0000 7f97c5c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97c019d620 con 0x7f97c0103f70 2024-02-28T23:08:36.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.147+0000 7f97bea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c0101640 0x7f97c019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:36.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.147+0000 7f97bea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c0101640 0x7f97c019c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52116/0 (socket says 172.21.15.159:52116) 2024-02-28T23:08:36.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.147+0000 7f97bea00700 1 -- 172.21.15.159:0/1408596964 learned_addr learned my addr 172.21.15.159:0/1408596964 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:08:36.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.147+0000 7f97bea00700 1 -- 172.21.15.159:0/1408596964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97c0103f70 msgr2=0x7f97c019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:36.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.147+0000 7f97bea00700 1 --2- 172.21.15.159:0/1408596964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97c0103f70 0x7f97c019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:36.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.147+0000 7f97bea00700 1 -- 172.21.15.159:0/1408596964 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00095f0 con 0x7f97c0101640 2024-02-28T23:08:36.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.148+0000 7f97bea00700 1 --2- 172.21.15.159:0/1408596964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c0101640 0x7f97c019c980 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f97b0005b40 tx=0x7f97b000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:36.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.148+0000 7f97b7400700 1 -- 172.21.15.159:0/1408596964 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b001d070 con 0x7f97c0101640 2024-02-28T23:08:36.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.148+0000 7f97b7400700 1 -- 172.21.15.159:0/1408596964 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f97b0022470 con 0x7f97c0101640 2024-02-28T23:08:36.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.148+0000 7f97b7400700 1 -- 172.21.15.159:0/1408596964 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f97b000f690 con 0x7f97c0101640 2024-02-28T23:08:36.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.148+0000 7f97c5c00700 1 -- 172.21.15.159:0/1408596964 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97c01a2070 con 0x7f97c0101640 2024-02-28T23:08:36.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.148+0000 7f97c5c00700 1 -- 172.21.15.159:0/1408596964 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97c01a25e0 con 0x7f97c0101640 2024-02-28T23:08:36.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.150+0000 7f97c5c00700 1 -- 172.21.15.159:0/1408596964 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97c01096e0 con 0x7f97c0101640 2024-02-28T23:08:36.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.152+0000 7f97b7400700 1 -- 172.21.15.159:0/1408596964 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 30) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f97b00225e0 con 0x7f97c0101640 2024-02-28T23:08:36.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.153+0000 7f97b7400700 1 --2- 172.21.15.159:0/1408596964 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f97a406d6a0 0x7f97a406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:36.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.153+0000 7f97b7400700 1 -- 172.21.15.159:0/1408596964 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f97b008ea10 con 0x7f97c0101640 2024-02-28T23:08:36.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.154+0000 7f97be000700 1 --2- 172.21.15.159:0/1408596964 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f97a406d6a0 0x7f97a406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:36.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.155+0000 7f97be000700 1 --2- 172.21.15.159:0/1408596964 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f97a406d6a0 0x7f97a406fb60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0097b0 tx=0x7f97ac006d20 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:36.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.159+0000 7f97b7400700 1 -- 172.21.15.159:0/1408596964 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f97b005c180 con 0x7f97c0101640 2024-02-28T23:08:36.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:35 smithi159 ceph-mon[28802]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:36.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:35 smithi159 ceph-mon[28802]: pgmap v21: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 811 KiB/s rd, 859 KiB/s wr, 212 op/s 2024-02-28T23:08:36.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:35 smithi184 ceph-mon[36198]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:36.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:35 smithi184 ceph-mon[36198]: pgmap v21: 65 pgs: 65 active+clean; 286 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 811 KiB/s rd, 859 KiB/s wr, 212 op/s 2024-02-28T23:08:36.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.531+0000 7f97c5c00700 1 -- 172.21.15.159:0/1408596964 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f97c002d090 con 0x7f97c0101640 2024-02-28T23:08:36.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.532+0000 7f97b7400700 1 -- 172.21.15.159:0/1408596964 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f97b005bd10 con 0x7f97c0101640 2024-02-28T23:08:36.532 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:08:36.532 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:08:36.532 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:08:36.532 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:08:36.533 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:08:36.533 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:08:36.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:08:36.533 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:08:36.533 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:08:36.533 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:08:36.534 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:08:36.534 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:08:36.534 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:08:36.534 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:08:36.534 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-28T23:08:36.534 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:08:36.535 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:08:36.535 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:08:36.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.535+0000 7f97c5c00700 1 -- 172.21.15.159:0/1408596964 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f97a406d6a0 msgr2=0x7f97a406fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:36.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.535+0000 7f97c5c00700 1 --2- 172.21.15.159:0/1408596964 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f97a406d6a0 0x7f97a406fb60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0097b0 tx=0x7f97ac006d20 comp rx=0 tx=0).stop 2024-02-28T23:08:36.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.535+0000 7f97c5c00700 1 -- 172.21.15.159:0/1408596964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c0101640 msgr2=0x7f97c019c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:36.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.535+0000 7f97c5c00700 1 --2- 172.21.15.159:0/1408596964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c0101640 0x7f97c019c980 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f97b0005b40 tx=0x7f97b000be20 comp rx=0 tx=0).stop 2024-02-28T23:08:36.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.535+0000 7f97c5c00700 1 -- 172.21.15.159:0/1408596964 shutdown_connections 2024-02-28T23:08:36.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.535+0000 7f97c5c00700 1 --2- 172.21.15.159:0/1408596964 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f97a406d6a0 0x7f97a406fb60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:36.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.535+0000 7f97c5c00700 1 --2- 172.21.15.159:0/1408596964 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97c0101640 0x7f97c019c980 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:36.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.535+0000 7f97c5c00700 1 --2- 172.21.15.159:0/1408596964 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f97c0103f70 0x7f97c019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:36.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.535+0000 7f97c5c00700 1 -- 172.21.15.159:0/1408596964 >> 172.21.15.159:0/1408596964 conn(0x7f97c00fb030 msgr2=0x7f97c00fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:36.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.535+0000 7f97c5c00700 1 -- 172.21.15.159:0/1408596964 shutdown_connections 2024-02-28T23:08:36.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.535+0000 7f97c5c00700 1 -- 172.21.15.159:0/1408596964 wait complete. 2024-02-28T23:08:36.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.690+0000 7fb7c6800700 1 -- 172.21.15.159:0/469041490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c0100a30 msgr2=0x7fb7c0100e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:36.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.690+0000 7fb7c6800700 1 --2- 172.21.15.159:0/469041490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c0100a30 0x7fb7c0100e50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009910 tx=0x7fb7b4009c20 comp rx=0 tx=0).stop 2024-02-28T23:08:36.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.690+0000 7fb7c6800700 1 -- 172.21.15.159:0/469041490 shutdown_connections 2024-02-28T23:08:36.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.690+0000 7fb7c6800700 1 --2- 172.21.15.159:0/469041490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c0101c30 0x7fb7c0102090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:36.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.690+0000 7fb7c6800700 1 --2- 172.21.15.159:0/469041490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c0100a30 0x7fb7c0100e50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:36.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.690+0000 7fb7c6800700 1 -- 172.21.15.159:0/469041490 >> 172.21.15.159:0/469041490 conn(0x7fb7c00fbfd0 msgr2=0x7fb7c00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:36.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.690+0000 7fb7c6800700 1 -- 172.21.15.159:0/469041490 shutdown_connections 2024-02-28T23:08:36.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.690+0000 7fb7c6800700 1 -- 172.21.15.159:0/469041490 wait complete. 2024-02-28T23:08:36.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.692+0000 7fb7c6800700 1 Processor -- start 2024-02-28T23:08:36.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.692+0000 7fb7c6800700 1 -- start start 2024-02-28T23:08:36.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.692+0000 7fb7c6800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c0100a30 0x7fb7c01983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:36.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.692+0000 7fb7c6800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c0101c30 0x7fb7c0198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:36.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.692+0000 7fb7c6800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0198ea0 con 0x7fb7c0101c30 2024-02-28T23:08:36.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.692+0000 7fb7c6800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c0198fe0 con 0x7fb7c0100a30 2024-02-28T23:08:36.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.693+0000 7fb7c4a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c0101c30 0x7fb7c0198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:36.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.693+0000 7fb7c4a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c0101c30 0x7fb7c0198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52126/0 (socket says 172.21.15.159:52126) 2024-02-28T23:08:36.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.693+0000 7fb7c4a00700 1 -- 172.21.15.159:0/1423948758 learned_addr learned my addr 172.21.15.159:0/1423948758 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:08:36.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.693+0000 7fb7c5400700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c0100a30 0x7fb7c01983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:36.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.693+0000 7fb7c4a00700 1 -- 172.21.15.159:0/1423948758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c0100a30 msgr2=0x7fb7c01983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:36.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.693+0000 7fb7c4a00700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c0100a30 0x7fb7c01983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:36.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.693+0000 7fb7c4a00700 1 -- 172.21.15.159:0/1423948758 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40095f0 con 0x7fb7c0101c30 2024-02-28T23:08:36.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.693+0000 7fb7c5400700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c0100a30 0x7fb7c01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:08:36.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.694+0000 7fb7c4a00700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c0101c30 0x7fb7c0198910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c930 tx=0x7fb7ac00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:36.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.694+0000 7fb7be000700 1 -- 172.21.15.159:0/1423948758 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7ac007ad0 con 0x7fb7c0101c30 2024-02-28T23:08:36.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.694+0000 7fb7be000700 1 -- 172.21.15.159:0/1423948758 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb7ac007c30 con 0x7fb7c0101c30 2024-02-28T23:08:36.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.694+0000 7fb7c6800700 1 -- 172.21.15.159:0/1423948758 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c019daa0 con 0x7fb7c0101c30 2024-02-28T23:08:36.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.694+0000 7fb7c6800700 1 -- 172.21.15.159:0/1423948758 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c019dfc0 con 0x7fb7c0101c30 2024-02-28T23:08:36.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.694+0000 7fb7be000700 1 -- 172.21.15.159:0/1423948758 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7ac018630 con 0x7fb7c0101c30 2024-02-28T23:08:36.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.696+0000 7fb7c6800700 1 -- 172.21.15.159:0/1423948758 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7a0005320 con 0x7fb7c0101c30 2024-02-28T23:08:36.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.697+0000 7fb7be000700 1 -- 172.21.15.159:0/1423948758 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 30) v1 ==== 91442+0+0 (secure 0 0 0) 0x7fb7ac00f450 con 0x7fb7c0101c30 2024-02-28T23:08:36.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.698+0000 7fb7be000700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb7a806d6b0 0x7fb7a806fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:08:36.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.698+0000 7fb7be000700 1 -- 172.21.15.159:0/1423948758 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb7ac08d430 con 0x7fb7c0101c30 2024-02-28T23:08:36.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.699+0000 7fb7c5400700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb7a806d6b0 0x7fb7a806fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:08:36.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.700+0000 7fb7c5400700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb7a806d6b0 0x7fb7a806fb70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4006010 tx=0x7fb7b4005ab0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:08:36.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:36.706+0000 7fb7be000700 1 -- 172.21.15.159:0/1423948758 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fb7ac05a980 con 0x7fb7c0101c30 2024-02-28T23:08:37.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.075+0000 7fb7c6800700 1 -- 172.21.15.159:0/1423948758 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7a0000bf0 con 0x7fb7a806d6b0 2024-02-28T23:08:37.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.077+0000 7fb7be000700 1 -- 172.21.15.159:0/1423948758 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7fb7a0000bf0 con 0x7fb7a806d6b0 2024-02-28T23:08:37.077 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:08:37.078 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:08:37.078 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:08:37.078 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:08:37.078 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:08:37.078 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:08:37.078 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:08:37.078 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T23:08:37.079 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "", 2024-02-28T23:08:37.079 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:08:37.079 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:08:37.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.081+0000 7fb7c6800700 1 -- 172.21.15.159:0/1423948758 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb7a806d6b0 msgr2=0x7fb7a806fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:37.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.081+0000 7fb7c6800700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb7a806d6b0 0x7fb7a806fb70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4006010 tx=0x7fb7b4005ab0 comp rx=0 tx=0).stop 2024-02-28T23:08:37.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.081+0000 7fb7c6800700 1 -- 172.21.15.159:0/1423948758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c0101c30 msgr2=0x7fb7c0198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:08:37.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.081+0000 7fb7c6800700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c0101c30 0x7fb7c0198910 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fb7ac00c930 tx=0x7fb7ac00ccf0 comp rx=0 tx=0).stop 2024-02-28T23:08:37.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.082+0000 7fb7c6800700 1 -- 172.21.15.159:0/1423948758 shutdown_connections 2024-02-28T23:08:37.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.082+0000 7fb7c6800700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb7a806d6b0 0x7fb7a806fb70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:37.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.082+0000 7fb7c6800700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c0100a30 0x7fb7c01983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:37.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.082+0000 7fb7c6800700 1 --2- 172.21.15.159:0/1423948758 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c0101c30 0x7fb7c0198910 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:08:37.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.082+0000 7fb7c6800700 1 -- 172.21.15.159:0/1423948758 >> 172.21.15.159:0/1423948758 conn(0x7fb7c00fbfd0 msgr2=0x7fb7c0102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:08:37.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.082+0000 7fb7c6800700 1 -- 172.21.15.159:0/1423948758 shutdown_connections 2024-02-28T23:08:37.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:08:37.082+0000 7fb7c6800700 1 -- 172.21.15.159:0/1423948758 wait complete. 2024-02-28T23:08:37.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:36 smithi159 ceph-mon[28802]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:37.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:36 smithi159 ceph-mon[28802]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:37.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:36 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1408596964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:08:37.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:36 smithi184 ceph-mon[36198]: from='client.14730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:37.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:36 smithi184 ceph-mon[36198]: from='client.14734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:37.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:36 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1408596964' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:08:38.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:37 smithi184 ceph-mon[36198]: pgmap v22: 65 pgs: 65 active+clean; 289 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 357 op/s 2024-02-28T23:08:38.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:37 smithi159 ceph-mon[28802]: pgmap v22: 65 pgs: 65 active+clean; 289 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 357 op/s 2024-02-28T23:08:39.115 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:38 smithi159 ceph-mon[28802]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:39.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:38 smithi184 ceph-mon[36198]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:08:40.145 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:39 smithi159 ceph-mon[28802]: pgmap v23: 65 pgs: 65 active+clean; 289 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 927 KiB/s rd, 966 KiB/s wr, 258 op/s 2024-02-28T23:08:40.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:39 smithi184 ceph-mon[36198]: pgmap v23: 65 pgs: 65 active+clean; 289 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 927 KiB/s rd, 966 KiB/s wr, 258 op/s 2024-02-28T23:08:42.243 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:41 smithi159 ceph-mon[28802]: pgmap v24: 65 pgs: 65 active+clean; 291 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 363 op/s 2024-02-28T23:08:42.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:41 smithi184 ceph-mon[36198]: pgmap v24: 65 pgs: 65 active+clean; 291 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 363 op/s 2024-02-28T23:08:44.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:43 smithi184 ceph-mon[36198]: pgmap v25: 65 pgs: 65 active+clean; 291 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 910 KiB/s rd, 911 KiB/s wr, 250 op/s 2024-02-28T23:08:44.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:43 smithi159 ceph-mon[28802]: pgmap v25: 65 pgs: 65 active+clean; 291 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 910 KiB/s rd, 911 KiB/s wr, 250 op/s 2024-02-28T23:08:45.172 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:45 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:08:45.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:45 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:08:46.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:46 smithi159 ceph-mon[28802]: pgmap v26: 65 pgs: 65 active+clean; 291 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 910 KiB/s rd, 911 KiB/s wr, 250 op/s 2024-02-28T23:08:46.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:46 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:46.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:46 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:46.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:46 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:08:46.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:46 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:08:46.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:46 smithi184 ceph-mon[36198]: pgmap v26: 65 pgs: 65 active+clean; 291 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 910 KiB/s rd, 911 KiB/s wr, 250 op/s 2024-02-28T23:08:46.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:46 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:46.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:46 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:46.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:46 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:08:46.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:46 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:08:47.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:47 smithi184 ceph-mon[36198]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:08:47.471 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:47 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:08:48.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:48 smithi184 ceph-mon[36198]: pgmap v27: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 356 op/s 2024-02-28T23:08:48.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:48 smithi184 ceph-mon[36198]: Upgrade: Updating mgr.smithi184.quvmnx 2024-02-28T23:08:48.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:48 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.quvmnx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T23:08:48.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:48 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T23:08:48.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:48 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:08:48.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:48 smithi184 ceph-mon[36198]: Deploying daemon mgr.smithi184.quvmnx on smithi184 2024-02-28T23:08:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:48 smithi159 ceph-mon[28802]: pgmap v27: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 356 op/s 2024-02-28T23:08:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:48 smithi159 ceph-mon[28802]: Upgrade: Updating mgr.smithi184.quvmnx 2024-02-28T23:08:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:48 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.quvmnx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T23:08:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:48 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T23:08:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:48 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:08:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:48 smithi159 ceph-mon[28802]: Deploying daemon mgr.smithi184.quvmnx on smithi184 2024-02-28T23:08:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:49 smithi159 ceph-mon[28802]: pgmap v28: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 846 KiB/s rd, 857 KiB/s wr, 210 op/s 2024-02-28T23:08:49.794 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:49 smithi184 ceph-mon[36198]: pgmap v28: 65 pgs: 65 active+clean; 287 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 846 KiB/s rd, 857 KiB/s wr, 210 op/s 2024-02-28T23:08:52.202 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:52 smithi184 ceph-mon[36198]: pgmap v29: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 322 op/s 2024-02-28T23:08:52.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:52 smithi159 ceph-mon[28802]: pgmap v29: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 322 op/s 2024-02-28T23:08:54.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:54 smithi159 ceph-mon[28802]: pgmap v30: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 989 KiB/s rd, 960 KiB/s wr, 217 op/s 2024-02-28T23:08:54.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:54 smithi184 ceph-mon[36198]: pgmap v30: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 989 KiB/s rd, 960 KiB/s wr, 217 op/s 2024-02-28T23:08:55.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:55 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:55.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:55 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:55.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:55 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:08:55.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:55 smithi159 ceph-mon[28802]: pgmap v31: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 989 KiB/s rd, 960 KiB/s wr, 217 op/s 2024-02-28T23:08:55.582 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:55 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:55.582 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:55 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:55.582 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:55 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:08:55.582 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:55 smithi184 ceph-mon[36198]: pgmap v31: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 989 KiB/s rd, 960 KiB/s wr, 217 op/s 2024-02-28T23:08:58.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:58 smithi184 ceph-mon[36198]: pgmap v32: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 360 op/s 2024-02-28T23:08:58.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:58 smithi159 ceph-mon[28802]: pgmap v32: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 1.4 MiB/s wr, 360 op/s 2024-02-28T23:08:59.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:59 smithi159 ceph-mon[28802]: pgmap v33: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 926 KiB/s rd, 937 KiB/s wr, 255 op/s 2024-02-28T23:08:59.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:59 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:59.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:59 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:59.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:08:59 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:08:59.781 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:59 smithi184 ceph-mon[36198]: pgmap v33: 65 pgs: 65 active+clean; 284 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 926 KiB/s rd, 937 KiB/s wr, 255 op/s 2024-02-28T23:08:59.781 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:59 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:59.781 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:59 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:08:59.781 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:08:59 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:09:02.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:02 smithi159 ceph-mon[28802]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 644 op/s 2024-02-28T23:09:02.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:02 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:02.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:02 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:02.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:02 smithi184 ceph-mon[36198]: pgmap v34: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 644 op/s 2024-02-28T23:09:02.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:02 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:02.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:02 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:03.249 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:03 smithi159 ceph-mon[28802]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 787 KiB/s rd, 950 KiB/s wr, 532 op/s 2024-02-28T23:09:03.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:03 smithi184 ceph-mon[36198]: pgmap v35: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 787 KiB/s rd, 950 KiB/s wr, 532 op/s 2024-02-28T23:09:05.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:05 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:05.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:05 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:05.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:05 smithi184 ceph-mon[36198]: pgmap v36: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 787 KiB/s rd, 950 KiB/s wr, 532 op/s 2024-02-28T23:09:05.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:05 smithi184 ceph-mon[36198]: Standby manager daemon smithi184.quvmnx restarted 2024-02-28T23:09:05.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:05 smithi184 ceph-mon[36198]: Standby manager daemon smithi184.quvmnx started 2024-02-28T23:09:05.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:05 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/2493044121' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/crt"}]: dispatch 2024-02-28T23:09:05.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:05 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/2493044121' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:09:05.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:05 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/2493044121' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/key"}]: dispatch 2024-02-28T23:09:05.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:05 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/2493044121' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:09:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:05 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:05 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:05.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:05 smithi159 ceph-mon[28802]: pgmap v36: 65 pgs: 65 active+clean; 285 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 787 KiB/s rd, 950 KiB/s wr, 532 op/s 2024-02-28T23:09:05.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:05 smithi159 ceph-mon[28802]: Standby manager daemon smithi184.quvmnx restarted 2024-02-28T23:09:05.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:05 smithi159 ceph-mon[28802]: Standby manager daemon smithi184.quvmnx started 2024-02-28T23:09:05.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:05 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/2493044121' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/crt"}]: dispatch 2024-02-28T23:09:05.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:05 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/2493044121' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:09:05.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:05 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/2493044121' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/key"}]: dispatch 2024-02-28T23:09:05.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:05 smithi159 ceph-mon[28802]: from='mgr.? 172.21.15.184:0/2493044121' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:09:06.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:06 smithi184 ceph-mon[36198]: mgrmap e31: smithi159.pobewk(active, since 66s), standbys: smithi184.quvmnx 2024-02-28T23:09:06.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:06 smithi159 ceph-mon[28802]: mgrmap e31: smithi159.pobewk(active, since 66s), standbys: smithi184.quvmnx 2024-02-28T23:09:07.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.265+0000 7f5006a00700 1 -- 172.21.15.159:0/261374870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5000100bc0 msgr2=0x7f5000100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:07.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.265+0000 7f5006a00700 1 --2- 172.21.15.159:0/261374870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5000100bc0 0x7f5000100fe0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0009910 tx=0x7f4ff0009c20 comp rx=0 tx=0).stop 2024-02-28T23:09:07.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.265+0000 7f5006a00700 1 -- 172.21.15.159:0/261374870 shutdown_connections 2024-02-28T23:09:07.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.265+0000 7f5006a00700 1 --2- 172.21.15.159:0/261374870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5000101dc0 0x7f5000102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:07.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.265+0000 7f5006a00700 1 --2- 172.21.15.159:0/261374870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5000100bc0 0x7f5000100fe0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:07.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.265+0000 7f5006a00700 1 -- 172.21.15.159:0/261374870 >> 172.21.15.159:0/261374870 conn(0x7f50000fc140 msgr2=0x7f50000fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:07.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.266+0000 7f5006a00700 1 -- 172.21.15.159:0/261374870 shutdown_connections 2024-02-28T23:09:07.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.266+0000 7f5006a00700 1 -- 172.21.15.159:0/261374870 wait complete. 2024-02-28T23:09:07.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.267+0000 7f5006a00700 1 Processor -- start 2024-02-28T23:09:07.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.267+0000 7f5006a00700 1 -- start start 2024-02-28T23:09:07.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.268+0000 7f5006a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5000100bc0 0x7f5000198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:07.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.268+0000 7f5006a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5000101dc0 0x7f5000198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:07.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.268+0000 7f5006a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5000199160 con 0x7f5000101dc0 2024-02-28T23:09:07.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.268+0000 7f5006a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50001992a0 con 0x7f5000100bc0 2024-02-28T23:09:07.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.268+0000 7f4fff400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5000101dc0 0x7f5000198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:07.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.268+0000 7f4fff400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5000101dc0 0x7f5000198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51478/0 (socket says 172.21.15.159:51478) 2024-02-28T23:09:07.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.268+0000 7f4fff400700 1 -- 172.21.15.159:0/2275445823 learned_addr learned my addr 172.21.15.159:0/2275445823 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:09:07.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.269+0000 7f4fffe00700 1 --2- 172.21.15.159:0/2275445823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5000100bc0 0x7f5000198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:07.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.269+0000 7f4fff400700 1 -- 172.21.15.159:0/2275445823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5000100bc0 msgr2=0x7f5000198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:07.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.269+0000 7f4fff400700 1 --2- 172.21.15.159:0/2275445823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5000100bc0 0x7f5000198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:07.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.269+0000 7f4fff400700 1 -- 172.21.15.159:0/2275445823 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ff00095f0 con 0x7f5000101dc0 2024-02-28T23:09:07.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.269+0000 7f4fff400700 1 --2- 172.21.15.159:0/2275445823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5000101dc0 0x7f5000198b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00b4b0 tx=0x7f4fec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:07.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.270+0000 7f4ffcc00700 1 -- 172.21.15.159:0/2275445823 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fec011800 con 0x7f5000101dc0 2024-02-28T23:09:07.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.270+0000 7f5006a00700 1 -- 172.21.15.159:0/2275445823 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f500019dd50 con 0x7f5000101dc0 2024-02-28T23:09:07.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.270+0000 7f5006a00700 1 -- 172.21.15.159:0/2275445823 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f500019e320 con 0x7f5000101dc0 2024-02-28T23:09:07.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.270+0000 7f4ffcc00700 1 -- 172.21.15.159:0/2275445823 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f4fec011e10 con 0x7f5000101dc0 2024-02-28T23:09:07.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.270+0000 7f4ffcc00700 1 -- 172.21.15.159:0/2275445823 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4fec00f2e0 con 0x7f5000101dc0 2024-02-28T23:09:07.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.272+0000 7f5006a00700 1 -- 172.21.15.159:0/2275445823 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe0005320 con 0x7f5000101dc0 2024-02-28T23:09:07.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.273+0000 7f4ffcc00700 1 -- 172.21.15.159:0/2275445823 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 31) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f4fec011960 con 0x7f5000101dc0 2024-02-28T23:09:07.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.274+0000 7f4ffcc00700 1 --2- 172.21.15.159:0/2275445823 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f4fe406d6a0 0x7f4fe406fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:07.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.275+0000 7f4ffcc00700 1 -- 172.21.15.159:0/2275445823 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f4fec08cc10 con 0x7f5000101dc0 2024-02-28T23:09:07.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.275+0000 7f4fffe00700 1 --2- 172.21.15.159:0/2275445823 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f4fe406d6a0 0x7f4fe406fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:07.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.276+0000 7f4fffe00700 1 --2- 172.21.15.159:0/2275445823 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f4fe406d6a0 0x7f4fe406fb60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006010 tx=0x7f4ff000b540 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:07.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.281+0000 7f4ffcc00700 1 -- 172.21.15.159:0/2275445823 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f4fec05a2f0 con 0x7f5000101dc0 2024-02-28T23:09:07.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:07 smithi184 ceph-mon[36198]: pgmap v37: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 836 op/s 2024-02-28T23:09:07.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:07 smithi159 ceph-mon[28802]: pgmap v37: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 836 op/s 2024-02-28T23:09:07.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.661+0000 7f5006a00700 1 -- 172.21.15.159:0/2275445823 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4fe0000bf0 con 0x7f4fe406d6a0 2024-02-28T23:09:07.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.668+0000 7f4ffcc00700 1 -- 172.21.15.159:0/2275445823 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+360 (secure 0 0 0) 0x7f4fe0000bf0 con 0x7f4fe406d6a0 2024-02-28T23:09:07.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.672+0000 7f5006a00700 1 -- 172.21.15.159:0/2275445823 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f4fe406d6a0 msgr2=0x7f4fe406fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:07.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.672+0000 7f5006a00700 1 --2- 172.21.15.159:0/2275445823 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f4fe406d6a0 0x7f4fe406fb60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006010 tx=0x7f4ff000b540 comp rx=0 tx=0).stop 2024-02-28T23:09:07.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.672+0000 7f5006a00700 1 -- 172.21.15.159:0/2275445823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5000101dc0 msgr2=0x7f5000198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:07.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.672+0000 7f5006a00700 1 --2- 172.21.15.159:0/2275445823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5000101dc0 0x7f5000198b40 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4fec00b4b0 tx=0x7f4fec00b870 comp rx=0 tx=0).stop 2024-02-28T23:09:07.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.672+0000 7f5006a00700 1 -- 172.21.15.159:0/2275445823 shutdown_connections 2024-02-28T23:09:07.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.672+0000 7f5006a00700 1 --2- 172.21.15.159:0/2275445823 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f4fe406d6a0 0x7f4fe406fb60 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f4ff0006010 tx=0x7f4ff000b540 comp rx=0 tx=0).stop 2024-02-28T23:09:07.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.672+0000 7f5006a00700 1 --2- 172.21.15.159:0/2275445823 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5000100bc0 0x7f5000198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:07.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.672+0000 7f5006a00700 1 --2- 172.21.15.159:0/2275445823 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5000101dc0 0x7f5000198b40 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:07.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.672+0000 7f5006a00700 1 -- 172.21.15.159:0/2275445823 >> 172.21.15.159:0/2275445823 conn(0x7f50000fc140 msgr2=0x7f5000102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:07.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.672+0000 7f5006a00700 1 -- 172.21.15.159:0/2275445823 shutdown_connections 2024-02-28T23:09:07.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.673+0000 7f5006a00700 1 -- 172.21.15.159:0/2275445823 wait complete. 2024-02-28T23:09:07.692 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:09:07.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.899+0000 7fd575400700 1 -- 172.21.15.159:0/520387209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd570102df0 msgr2=0x7fd570103210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:07.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.899+0000 7fd575400700 1 --2- 172.21.15.159:0/520387209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd570102df0 0x7fd570103210 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd560009910 tx=0x7fd560009c20 comp rx=0 tx=0).stop 2024-02-28T23:09:07.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.899+0000 7fd575400700 1 -- 172.21.15.159:0/520387209 shutdown_connections 2024-02-28T23:09:07.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.899+0000 7fd575400700 1 --2- 172.21.15.159:0/520387209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd570103ff0 0x7fd570104450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:07.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.899+0000 7fd575400700 1 --2- 172.21.15.159:0/520387209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd570102df0 0x7fd570103210 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:07.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.899+0000 7fd575400700 1 -- 172.21.15.159:0/520387209 >> 172.21.15.159:0/520387209 conn(0x7fd5700fe390 msgr2=0x7fd5701007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:07.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.900+0000 7fd575400700 1 -- 172.21.15.159:0/520387209 shutdown_connections 2024-02-28T23:09:07.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.900+0000 7fd575400700 1 -- 172.21.15.159:0/520387209 wait complete. 2024-02-28T23:09:07.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.901+0000 7fd575400700 1 Processor -- start 2024-02-28T23:09:07.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.901+0000 7fd575400700 1 -- start start 2024-02-28T23:09:07.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.902+0000 7fd575400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd570102df0 0x7fd570071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:07.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.902+0000 7fd575400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd570103ff0 0x7fd5700722d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:07.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.902+0000 7fd575400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd570072860 con 0x7fd570103ff0 2024-02-28T23:09:07.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.902+0000 7fd575400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5700729d0 con 0x7fd570102df0 2024-02-28T23:09:07.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.902+0000 7fd56e800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd570102df0 0x7fd570071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:07.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.902+0000 7fd56e800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd570102df0 0x7fd570071d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:44830/0 (socket says 172.21.15.159:44830) 2024-02-28T23:09:07.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.902+0000 7fd56e800700 1 -- 172.21.15.159:0/2601479847 learned_addr learned my addr 172.21.15.159:0/2601479847 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:09:07.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.903+0000 7fd56de00700 1 --2- 172.21.15.159:0/2601479847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd570103ff0 0x7fd5700722d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:07.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.903+0000 7fd56e800700 1 -- 172.21.15.159:0/2601479847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd570103ff0 msgr2=0x7fd5700722d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:07.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.903+0000 7fd56e800700 1 --2- 172.21.15.159:0/2601479847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd570103ff0 0x7fd5700722d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:07.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.903+0000 7fd56e800700 1 -- 172.21.15.159:0/2601479847 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5600095f0 con 0x7fd570102df0 2024-02-28T23:09:07.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.904+0000 7fd56e800700 1 --2- 172.21.15.159:0/2601479847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd570102df0 0x7fd570071d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd56000bda0 tx=0x7fd56000be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:07.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.905+0000 7fd567400700 1 -- 172.21.15.159:0/2601479847 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd56001d070 con 0x7fd570102df0 2024-02-28T23:09:07.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.905+0000 7fd567400700 1 -- 172.21.15.159:0/2601479847 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd560004c50 con 0x7fd570102df0 2024-02-28T23:09:07.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.905+0000 7fd567400700 1 -- 172.21.15.159:0/2601479847 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd56000f690 con 0x7fd570102df0 2024-02-28T23:09:07.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.905+0000 7fd575400700 1 -- 172.21.15.159:0/2601479847 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5701a63e0 con 0x7fd570102df0 2024-02-28T23:09:07.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.905+0000 7fd575400700 1 -- 172.21.15.159:0/2601479847 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5701a68d0 con 0x7fd570102df0 2024-02-28T23:09:07.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.907+0000 7fd575400700 1 -- 172.21.15.159:0/2601479847 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd57010b950 con 0x7fd570102df0 2024-02-28T23:09:07.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.908+0000 7fd567400700 1 -- 172.21.15.159:0/2601479847 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 31) v1 ==== 91442+0+0 (secure 0 0 0) 0x7fd5600229b0 con 0x7fd570102df0 2024-02-28T23:09:07.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.909+0000 7fd567400700 1 --2- 172.21.15.159:0/2601479847 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd55406d660 0x7fd55406fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:07.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.910+0000 7fd567400700 1 -- 172.21.15.159:0/2601479847 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd56008e8d0 con 0x7fd570102df0 2024-02-28T23:09:07.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.910+0000 7fd56de00700 1 --2- 172.21.15.159:0/2601479847 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd55406d660 0x7fd55406fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:07.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.911+0000 7fd56de00700 1 --2- 172.21.15.159:0/2601479847 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd55406d660 0x7fd55406fb20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd570072e80 tx=0x7fd55c005d70 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:07.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:07.925+0000 7fd567400700 1 -- 172.21.15.159:0/2601479847 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fd5600584a0 con 0x7fd570102df0 2024-02-28T23:09:08.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.279+0000 7fd575400700 1 -- 172.21.15.159:0/2601479847 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd570108940 con 0x7fd55406d660 2024-02-28T23:09:08.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.280+0000 7fd567400700 1 -- 172.21.15.159:0/2601479847 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fd570108940 con 0x7fd55406d660 2024-02-28T23:09:08.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.283+0000 7fd575400700 1 -- 172.21.15.159:0/2601479847 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd55406d660 msgr2=0x7fd55406fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:08.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.283+0000 7fd575400700 1 --2- 172.21.15.159:0/2601479847 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd55406d660 0x7fd55406fb20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fd570072e80 tx=0x7fd55c005d70 comp rx=0 tx=0).stop 2024-02-28T23:09:08.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.283+0000 7fd575400700 1 -- 172.21.15.159:0/2601479847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd570102df0 msgr2=0x7fd570071d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:08.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.283+0000 7fd575400700 1 --2- 172.21.15.159:0/2601479847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd570102df0 0x7fd570071d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd56000bda0 tx=0x7fd56000be80 comp rx=0 tx=0).stop 2024-02-28T23:09:08.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.284+0000 7fd575400700 1 -- 172.21.15.159:0/2601479847 shutdown_connections 2024-02-28T23:09:08.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.284+0000 7fd575400700 1 --2- 172.21.15.159:0/2601479847 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd55406d660 0x7fd55406fb20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.284+0000 7fd575400700 1 --2- 172.21.15.159:0/2601479847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd570102df0 0x7fd570071d90 secure :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd56000bda0 tx=0x7fd56000be80 comp rx=0 tx=0).stop 2024-02-28T23:09:08.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.284+0000 7fd575400700 1 --2- 172.21.15.159:0/2601479847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd570103ff0 0x7fd5700722d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.284+0000 7fd575400700 1 -- 172.21.15.159:0/2601479847 >> 172.21.15.159:0/2601479847 conn(0x7fd5700fe390 msgr2=0x7fd570107220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:08.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.284+0000 7fd575400700 1 -- 172.21.15.159:0/2601479847 shutdown_connections 2024-02-28T23:09:08.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.284+0000 7fd575400700 1 -- 172.21.15.159:0/2601479847 wait complete. 2024-02-28T23:09:08.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.464+0000 7fd2f8400700 1 -- 172.21.15.159:0/1590215938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2f0101db0 msgr2=0x7fd2f0102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:08.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.464+0000 7fd2f8400700 1 --2- 172.21.15.159:0/1590215938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2f0101db0 0x7fd2f0102210 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc009910 tx=0x7fd2dc009c20 comp rx=0 tx=0).stop 2024-02-28T23:09:08.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.464+0000 7fd2f8400700 1 -- 172.21.15.159:0/1590215938 shutdown_connections 2024-02-28T23:09:08.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.464+0000 7fd2f8400700 1 --2- 172.21.15.159:0/1590215938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2f0101db0 0x7fd2f0102210 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.464+0000 7fd2f8400700 1 --2- 172.21.15.159:0/1590215938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2f0100bb0 0x7fd2f0100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.464+0000 7fd2f8400700 1 -- 172.21.15.159:0/1590215938 >> 172.21.15.159:0/1590215938 conn(0x7fd2f00fc110 msgr2=0x7fd2f00fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:08.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.464+0000 7fd2f8400700 1 -- 172.21.15.159:0/1590215938 shutdown_connections 2024-02-28T23:09:08.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.465+0000 7fd2f8400700 1 -- 172.21.15.159:0/1590215938 wait complete. 2024-02-28T23:09:08.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.466+0000 7fd2f8400700 1 Processor -- start 2024-02-28T23:09:08.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.466+0000 7fd2f8400700 1 -- start start 2024-02-28T23:09:08.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.466+0000 7fd2f8400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2f0100bb0 0x7fd2f01985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:08.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.466+0000 7fd2f8400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2f0101db0 0x7fd2f0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:08.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.466+0000 7fd2f8400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0199120 con 0x7fd2f0100bb0 2024-02-28T23:09:08.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.466+0000 7fd2f8400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f0199260 con 0x7fd2f0101db0 2024-02-28T23:09:08.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.466+0000 7fd2f5a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2f0100bb0 0x7fd2f01985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:08.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.466+0000 7fd2f5a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2f0100bb0 0x7fd2f01985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33348/0 (socket says 172.21.15.159:33348) 2024-02-28T23:09:08.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.466+0000 7fd2f5a00700 1 -- 172.21.15.159:0/2386985844 learned_addr learned my addr 172.21.15.159:0/2386985844 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:09:08.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.467+0000 7fd2f5000700 1 --2- 172.21.15.159:0/2386985844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2f0101db0 0x7fd2f0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:08.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.467+0000 7fd2f5a00700 1 -- 172.21.15.159:0/2386985844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2f0101db0 msgr2=0x7fd2f0198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:08.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.467+0000 7fd2f5a00700 1 --2- 172.21.15.159:0/2386985844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2f0101db0 0x7fd2f0198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.467+0000 7fd2f5a00700 1 -- 172.21.15.159:0/2386985844 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc0095f0 con 0x7fd2f0100bb0 2024-02-28T23:09:08.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.467+0000 7fd2f5a00700 1 --2- 172.21.15.159:0/2386985844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2f0100bb0 0x7fd2f01985c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400b480 tx=0x7fd2e400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:08.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.467+0000 7fd2ee000700 1 -- 172.21.15.159:0/2386985844 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2e40118c0 con 0x7fd2f0100bb0 2024-02-28T23:09:08.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.467+0000 7fd2ee000700 1 -- 172.21.15.159:0/2386985844 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd2e4010380 con 0x7fd2f0100bb0 2024-02-28T23:09:08.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.467+0000 7fd2ee000700 1 -- 172.21.15.159:0/2386985844 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2e400f4f0 con 0x7fd2f0100bb0 2024-02-28T23:09:08.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.468+0000 7fd2f8400700 1 -- 172.21.15.159:0/2386985844 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f019dd10 con 0x7fd2f0100bb0 2024-02-28T23:09:08.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.468+0000 7fd2f8400700 1 -- 172.21.15.159:0/2386985844 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f019e280 con 0x7fd2f0100bb0 2024-02-28T23:09:08.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.469+0000 7fd2f8400700 1 -- 172.21.15.159:0/2386985844 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f0105e90 con 0x7fd2f0100bb0 2024-02-28T23:09:08.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.470+0000 7fd2ee000700 1 -- 172.21.15.159:0/2386985844 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 31) v1 ==== 91442+0+0 (secure 0 0 0) 0x7fd2e40104f0 con 0x7fd2f0100bb0 2024-02-28T23:09:08.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.472+0000 7fd2ee000700 1 --2- 172.21.15.159:0/2386985844 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd2d806d650 0x7fd2d806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:08.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.472+0000 7fd2ee000700 1 -- 172.21.15.159:0/2386985844 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd2e408cd00 con 0x7fd2f0100bb0 2024-02-28T23:09:08.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.472+0000 7fd2f5000700 1 --2- 172.21.15.159:0/2386985844 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd2d806d650 0x7fd2d806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:08.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.473+0000 7fd2f5000700 1 --2- 172.21.15.159:0/2386985844 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd2d806d650 0x7fd2d806fb10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc000c00 tx=0x7fd2dc005fb0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:08.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.477+0000 7fd2ee000700 1 -- 172.21.15.159:0/2386985844 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fd2e4090030 con 0x7fd2f0100bb0 2024-02-28T23:09:08.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:09:08.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:09:08.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:09:08.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: Upgrade: Setting container_image for all mgr 2024-02-28T23:09:08.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.pobewk"}]: dispatch 2024-02-28T23:09:08.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.pobewk"}]': finished 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi184.quvmnx"}]: dispatch 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi184.quvmnx"}]': finished 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: Upgrade: Setting container_image for all rgw 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: Upgrade: Setting container_image for all iscsi 2024-02-28T23:09:08.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: Upgrade: Setting container_image for all nfs 2024-02-28T23:09:08.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:08.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: Upgrade: Setting container_image for all nvmeof 2024-02-28T23:09:08.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:08 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: Upgrade: Setting container_image for all mgr 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.pobewk"}]: dispatch 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi159.pobewk"}]': finished 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi184.quvmnx"}]: dispatch 2024-02-28T23:09:08.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi184.quvmnx"}]': finished 2024-02-28T23:09:08.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: Upgrade: Setting container_image for all rgw 2024-02-28T23:09:08.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T23:09:08.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: Upgrade: Setting container_image for all cephfs-mirror 2024-02-28T23:09:08.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: Upgrade: Setting container_image for all iscsi 2024-02-28T23:09:08.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: Upgrade: Setting container_image for all nfs 2024-02-28T23:09:08.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:08.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:08.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: Upgrade: Setting container_image for all nvmeof 2024-02-28T23:09:08.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:08 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:08.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.749+0000 7fd2f8400700 1 -- 172.21.15.159:0/2386985844 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2f00611d0 con 0x7fd2d806d650 2024-02-28T23:09:08.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.779+0000 7fd2ee000700 1 -- 172.21.15.159:0/2386985844 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fd2f00611d0 con 0x7fd2d806d650 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (10m) 4s ago 12m 14.2M - 0.25.0 c8568f914cd2 2b2966e86e70 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (13m) 4s ago 13m 8066k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (11m) 9s ago 11m 7671k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (13m) 4s ago 13m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (11m) 9s ago 11m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (10m) 4s ago 12m 74.3M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (5m) 4s ago 5m 214M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (5m) 4s ago 5m 136M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (5m) 9s ago 5m 14.7M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (5m) 9s ago 5m 14.5M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:09:08.782 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (93s) 4s ago 14m 495M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (15s) 9s ago 11m 65.1M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (14m) 4s ago 15m 54.4M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (11m) 9s ago 11m 41.4M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (13m) 4s ago 13m 8288k - 1.5.0 0da6a335fe13 009475616a7b 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (11m) 9s ago 11m 8044k - 1.5.0 0da6a335fe13 a45ab4136b88 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (10m) 4s ago 10m 205M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (9m) 4s ago 9m 223M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (9m) 4s ago 9m 187M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (8m) 9s ago 8m 257M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (8m) 9s ago 8m 225M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (7m) 9s ago 7m 201M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:09:08.783 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (25s) 4s ago 12m 37.4M - 2.43.0 a07b618ecd1d ca01ba9a8afb 2024-02-28T23:09:08.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.786+0000 7fd2f8400700 1 -- 172.21.15.159:0/2386985844 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd2d806d650 msgr2=0x7fd2d806fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:08.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.786+0000 7fd2f8400700 1 --2- 172.21.15.159:0/2386985844 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd2d806d650 0x7fd2d806fb10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc000c00 tx=0x7fd2dc005fb0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.786+0000 7fd2f8400700 1 -- 172.21.15.159:0/2386985844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2f0100bb0 msgr2=0x7fd2f01985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:08.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.786+0000 7fd2f8400700 1 --2- 172.21.15.159:0/2386985844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2f0100bb0 0x7fd2f01985c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400b480 tx=0x7fd2e400b840 comp rx=0 tx=0).stop 2024-02-28T23:09:08.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.786+0000 7fd2f8400700 1 -- 172.21.15.159:0/2386985844 shutdown_connections 2024-02-28T23:09:08.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.786+0000 7fd2f8400700 1 --2- 172.21.15.159:0/2386985844 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd2d806d650 0x7fd2d806fb10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.786+0000 7fd2f8400700 1 --2- 172.21.15.159:0/2386985844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd2f0100bb0 0x7fd2f01985c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.786+0000 7fd2f8400700 1 --2- 172.21.15.159:0/2386985844 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd2f0101db0 0x7fd2f0198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.786+0000 7fd2f8400700 1 -- 172.21.15.159:0/2386985844 >> 172.21.15.159:0/2386985844 conn(0x7fd2f00fc110 msgr2=0x7fd2f0102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:08.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.787+0000 7fd2f8400700 1 -- 172.21.15.159:0/2386985844 shutdown_connections 2024-02-28T23:09:08.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.787+0000 7fd2f8400700 1 -- 172.21.15.159:0/2386985844 wait complete. 2024-02-28T23:09:08.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.990+0000 7f9d32200700 1 -- 172.21.15.159:0/3500980455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c074dc0 msgr2=0x7f9d2c073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:08.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.990+0000 7f9d32200700 1 --2- 172.21.15.159:0/3500980455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c074dc0 0x7f9d2c073220 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009910 tx=0x7f9d1c009c20 comp rx=0 tx=0).stop 2024-02-28T23:09:08.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.990+0000 7f9d32200700 1 -- 172.21.15.159:0/3500980455 shutdown_connections 2024-02-28T23:09:08.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.990+0000 7f9d32200700 1 --2- 172.21.15.159:0/3500980455 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d2c0737f0 0x7f9d2c073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.990+0000 7f9d32200700 1 --2- 172.21.15.159:0/3500980455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c074dc0 0x7f9d2c073220 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.990+0000 7f9d32200700 1 -- 172.21.15.159:0/3500980455 >> 172.21.15.159:0/3500980455 conn(0x7f9d2c0fc110 msgr2=0x7f9d2c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:08.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.991+0000 7f9d32200700 1 -- 172.21.15.159:0/3500980455 shutdown_connections 2024-02-28T23:09:08.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.991+0000 7f9d32200700 1 -- 172.21.15.159:0/3500980455 wait complete. 2024-02-28T23:09:08.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.992+0000 7f9d32200700 1 Processor -- start 2024-02-28T23:09:08.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.993+0000 7f9d32200700 1 -- start start 2024-02-28T23:09:08.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.993+0000 7f9d32200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d2c0737f0 0x7f9d2c19c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:08.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.993+0000 7f9d32200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c074dc0 0x7f9d2c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:08.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.993+0000 7f9d32200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c19d4b0 con 0x7f9d2c074dc0 2024-02-28T23:09:08.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.993+0000 7f9d32200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c19d5f0 con 0x7f9d2c0737f0 2024-02-28T23:09:08.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.994+0000 7f9d2b400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d2c0737f0 0x7f9d2c19c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:08.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.994+0000 7f9d2b400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d2c0737f0 0x7f9d2c19c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:44874/0 (socket says 172.21.15.159:44874) 2024-02-28T23:09:08.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.994+0000 7f9d2b400700 1 -- 172.21.15.159:0/3455524261 learned_addr learned my addr 172.21.15.159:0/3455524261 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:09:08.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.994+0000 7f9d2aa00700 1 --2- 172.21.15.159:0/3455524261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c074dc0 0x7f9d2c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:08.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.994+0000 7f9d2b400700 1 -- 172.21.15.159:0/3455524261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c074dc0 msgr2=0x7f9d2c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:08.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.994+0000 7f9d2b400700 1 --2- 172.21.15.159:0/3455524261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c074dc0 0x7f9d2c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:08.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.994+0000 7f9d2b400700 1 -- 172.21.15.159:0/3455524261 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c0095f0 con 0x7f9d2c0737f0 2024-02-28T23:09:08.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.995+0000 7f9d2b400700 1 --2- 172.21.15.159:0/3455524261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d2c0737f0 0x7f9d2c19c950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00fa00 tx=0x7f9d1c00fa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:08.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.995+0000 7f9d23e00700 1 -- 172.21.15.159:0/3455524261 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1c01d070 con 0x7f9d2c0737f0 2024-02-28T23:09:08.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.995+0000 7f9d23e00700 1 -- 172.21.15.159:0/3455524261 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9d1c00fe90 con 0x7f9d2c0737f0 2024-02-28T23:09:08.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.995+0000 7f9d23e00700 1 -- 172.21.15.159:0/3455524261 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9d1c017630 con 0x7f9d2c0737f0 2024-02-28T23:09:08.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.995+0000 7f9d32200700 1 -- 172.21.15.159:0/3455524261 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c1a2040 con 0x7f9d2c0737f0 2024-02-28T23:09:08.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.995+0000 7f9d32200700 1 -- 172.21.15.159:0/3455524261 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c1a2530 con 0x7f9d2c0737f0 2024-02-28T23:09:08.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.997+0000 7f9d32200700 1 -- 172.21.15.159:0/3455524261 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0c005320 con 0x7f9d2c0737f0 2024-02-28T23:09:08.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.998+0000 7f9d23e00700 1 -- 172.21.15.159:0/3455524261 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 31) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f9d1c003680 con 0x7f9d2c0737f0 2024-02-28T23:09:08.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.999+0000 7f9d23e00700 1 --2- 172.21.15.159:0/3455524261 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9d1006d660 0x7f9d1006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:08.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:08.999+0000 7f9d23e00700 1 -- 172.21.15.159:0/3455524261 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9d1c08e7c0 con 0x7f9d2c0737f0 2024-02-28T23:09:08.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.000+0000 7f9d2aa00700 1 --2- 172.21.15.159:0/3455524261 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9d1006d660 0x7f9d1006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:08.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.000+0000 7f9d2aa00700 1 --2- 172.21.15.159:0/3455524261 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9d1006d660 0x7f9d1006fb20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c074af0 tx=0x7f9d18009260 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:09.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.008+0000 7f9d23e00700 1 -- 172.21.15.159:0/3455524261 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f9d1c05bed0 con 0x7f9d2c0737f0 2024-02-28T23:09:09.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.361+0000 7f9d32200700 1 -- 172.21.15.159:0/3455524261 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9d0c005cc0 con 0x7f9d2c0737f0 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.362+0000 7f9d23e00700 1 -- 172.21.15.159:0/3455524261 <== mon.1 v2:172.21.15.184:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f9d1c062070 con 0x7f9d2c0737f0 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:09:09.361 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:09:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:09:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:09:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:09:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-28T23:09:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:09:09.362 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:09:09.362 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:09:09.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.366+0000 7f9d32200700 1 -- 172.21.15.159:0/3455524261 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9d1006d660 msgr2=0x7f9d1006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:09.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.366+0000 7f9d32200700 1 --2- 172.21.15.159:0/3455524261 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9d1006d660 0x7f9d1006fb20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c074af0 tx=0x7f9d18009260 comp rx=0 tx=0).stop 2024-02-28T23:09:09.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.366+0000 7f9d32200700 1 -- 172.21.15.159:0/3455524261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d2c0737f0 msgr2=0x7f9d2c19c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:09.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.366+0000 7f9d32200700 1 --2- 172.21.15.159:0/3455524261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d2c0737f0 0x7f9d2c19c950 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00fa00 tx=0x7f9d1c00fa30 comp rx=0 tx=0).stop 2024-02-28T23:09:09.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.367+0000 7f9d32200700 1 -- 172.21.15.159:0/3455524261 shutdown_connections 2024-02-28T23:09:09.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.367+0000 7f9d32200700 1 --2- 172.21.15.159:0/3455524261 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9d1006d660 0x7f9d1006fb20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:09.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.367+0000 7f9d32200700 1 --2- 172.21.15.159:0/3455524261 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9d2c0737f0 0x7f9d2c19c950 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:09.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.367+0000 7f9d32200700 1 --2- 172.21.15.159:0/3455524261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9d2c074dc0 0x7f9d2c19ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:09.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.367+0000 7f9d32200700 1 -- 172.21.15.159:0/3455524261 >> 172.21.15.159:0/3455524261 conn(0x7f9d2c0fc110 msgr2=0x7f9d2c102540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:09.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.367+0000 7f9d32200700 1 -- 172.21.15.159:0/3455524261 shutdown_connections 2024-02-28T23:09:09.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.367+0000 7f9d32200700 1 -- 172.21.15.159:0/3455524261 wait complete. 2024-02-28T23:09:09.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.540+0000 7f3125800700 1 -- 172.21.15.159:0/2529801558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3120101640 msgr2=0x7f3120103a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:09.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.540+0000 7f3125800700 1 --2- 172.21.15.159:0/2529801558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3120101640 0x7f3120103a30 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3110009910 tx=0x7f3110009c20 comp rx=0 tx=0).stop 2024-02-28T23:09:09.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.540+0000 7f3125800700 1 -- 172.21.15.159:0/2529801558 shutdown_connections 2024-02-28T23:09:09.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.540+0000 7f3125800700 1 --2- 172.21.15.159:0/2529801558 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3120103f70 0x7f3120106360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:09.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.540+0000 7f3125800700 1 --2- 172.21.15.159:0/2529801558 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3120101640 0x7f3120103a30 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:09.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.540+0000 7f3125800700 1 -- 172.21.15.159:0/2529801558 >> 172.21.15.159:0/2529801558 conn(0x7f31200fb030 msgr2=0x7f31200fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:09.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.540+0000 7f3125800700 1 -- 172.21.15.159:0/2529801558 shutdown_connections 2024-02-28T23:09:09.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.540+0000 7f3125800700 1 -- 172.21.15.159:0/2529801558 wait complete. 2024-02-28T23:09:09.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.542+0000 7f3125800700 1 Processor -- start 2024-02-28T23:09:09.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.542+0000 7f3125800700 1 -- start start 2024-02-28T23:09:09.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.542+0000 7f3125800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3120101640 0x7f3120198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:09.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.542+0000 7f3125800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3120103f70 0x7f3120198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:09.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.542+0000 7f3125800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3120199080 con 0x7f3120101640 2024-02-28T23:09:09.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.542+0000 7f3125800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31201991c0 con 0x7f3120103f70 2024-02-28T23:09:09.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.543+0000 7f311ea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3120101640 0x7f3120198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:09.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.543+0000 7f311ea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3120101640 0x7f3120198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33392/0 (socket says 172.21.15.159:33392) 2024-02-28T23:09:09.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.543+0000 7f311ea00700 1 -- 172.21.15.159:0/1596895755 learned_addr learned my addr 172.21.15.159:0/1596895755 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:09:09.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.543+0000 7f311ea00700 1 -- 172.21.15.159:0/1596895755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3120103f70 msgr2=0x7f3120198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:09.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.543+0000 7f311ea00700 1 --2- 172.21.15.159:0/1596895755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3120103f70 0x7f3120198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:09.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.543+0000 7f311ea00700 1 -- 172.21.15.159:0/1596895755 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31100095f0 con 0x7f3120101640 2024-02-28T23:09:09.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.543+0000 7f311ea00700 1 --2- 172.21.15.159:0/1596895755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3120101640 0x7f3120198520 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f311000b5c0 tx=0x7f311000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:09.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.544+0000 7f3117400700 1 -- 172.21.15.159:0/1596895755 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f311001d070 con 0x7f3120101640 2024-02-28T23:09:09.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.544+0000 7f3125800700 1 -- 172.21.15.159:0/1596895755 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3120192ee0 con 0x7f3120101640 2024-02-28T23:09:09.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.544+0000 7f3125800700 1 -- 172.21.15.159:0/1596895755 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31201a2540 con 0x7f3120101640 2024-02-28T23:09:09.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.544+0000 7f3117400700 1 -- 172.21.15.159:0/1596895755 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3110022470 con 0x7f3120101640 2024-02-28T23:09:09.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.544+0000 7f3117400700 1 -- 172.21.15.159:0/1596895755 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f311000f670 con 0x7f3120101640 2024-02-28T23:09:09.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.545+0000 7f3125800700 1 -- 172.21.15.159:0/1596895755 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3100005320 con 0x7f3120101640 2024-02-28T23:09:09.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.547+0000 7f3117400700 1 -- 172.21.15.159:0/1596895755 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 31) v1 ==== 91442+0+0 (secure 0 0 0) 0x7f3110022a60 con 0x7f3120101640 2024-02-28T23:09:09.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.548+0000 7f3117400700 1 --2- 172.21.15.159:0/1596895755 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f310406d650 0x7f310406fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:09.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.548+0000 7f3117400700 1 -- 172.21.15.159:0/1596895755 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f311008eaa0 con 0x7f3120101640 2024-02-28T23:09:09.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.549+0000 7f311e000700 1 --2- 172.21.15.159:0/1596895755 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f310406d650 0x7f310406fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:09.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.549+0000 7f311e000700 1 --2- 172.21.15.159:0/1596895755 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f310406d650 0x7f310406fb10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f310c00a990 tx=0x7f310c005c80 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:09.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.556+0000 7f3117400700 1 -- 172.21.15.159:0/1596895755 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f311005c240 con 0x7f3120101640 2024-02-28T23:09:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:09 smithi159 ceph-mon[28802]: from='client.24489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:09 smithi159 ceph-mon[28802]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:09 smithi159 ceph-mon[28802]: pgmap v38: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 833 KiB/s rd, 1011 KiB/s wr, 693 op/s 2024-02-28T23:09:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:09 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3455524261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:09.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:09 smithi184 ceph-mon[36198]: from='client.24489 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:09.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:09 smithi184 ceph-mon[36198]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:09.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:09 smithi184 ceph-mon[36198]: pgmap v38: 65 pgs: 65 active+clean; 275 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 833 KiB/s rd, 1011 KiB/s wr, 693 op/s 2024-02-28T23:09:09.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:09 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3455524261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:09.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.878+0000 7f3125800700 1 -- 172.21.15.159:0/1596895755 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3100000bf0 con 0x7f310406d650 2024-02-28T23:09:09.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.882+0000 7f3117400700 1 -- 172.21.15.159:0/1596895755 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f3100000bf0 con 0x7f310406d650 2024-02-28T23:09:09.880 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:09:09.881 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:09:09.881 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:09:09.881 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:09:09.881 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:09:09.881 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:09:09.881 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:09:09.881 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T23:09:09.881 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-28T23:09:09.881 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:09:09.881 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:09:09.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.886+0000 7f3125800700 1 -- 172.21.15.159:0/1596895755 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f310406d650 msgr2=0x7f310406fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:09.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.886+0000 7f3125800700 1 --2- 172.21.15.159:0/1596895755 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f310406d650 0x7f310406fb10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f310c00a990 tx=0x7f310c005c80 comp rx=0 tx=0).stop 2024-02-28T23:09:09.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.886+0000 7f3125800700 1 -- 172.21.15.159:0/1596895755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3120101640 msgr2=0x7f3120198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:09.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.886+0000 7f3125800700 1 --2- 172.21.15.159:0/1596895755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3120101640 0x7f3120198520 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f311000b5c0 tx=0x7f311000be20 comp rx=0 tx=0).stop 2024-02-28T23:09:09.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.886+0000 7f3125800700 1 -- 172.21.15.159:0/1596895755 shutdown_connections 2024-02-28T23:09:09.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.886+0000 7f3125800700 1 --2- 172.21.15.159:0/1596895755 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f310406d650 0x7f310406fb10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:09.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.886+0000 7f3125800700 1 --2- 172.21.15.159:0/1596895755 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3120101640 0x7f3120198520 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:09.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.886+0000 7f3125800700 1 --2- 172.21.15.159:0/1596895755 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3120103f70 0x7f3120198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:09.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.886+0000 7f3125800700 1 -- 172.21.15.159:0/1596895755 >> 172.21.15.159:0/1596895755 conn(0x7f31200fb030 msgr2=0x7f31200ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:09.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.886+0000 7f3125800700 1 -- 172.21.15.159:0/1596895755 shutdown_connections 2024-02-28T23:09:09.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:09.886+0000 7f3125800700 1 -- 172.21.15.159:0/1596895755 wait complete. 2024-02-28T23:09:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:10 smithi159 ceph-mon[28802]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:10.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:10 smithi184 ceph-mon[36198]: from='client.14762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:11 smithi159 ceph-mon[28802]: pgmap v39: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 892 op/s 2024-02-28T23:09:11.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:11 smithi184 ceph-mon[36198]: pgmap v39: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.4 MiB/s wr, 892 op/s 2024-02-28T23:09:14.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:14 smithi159 ceph-mon[28802]: pgmap v40: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 959 KiB/s rd, 959 KiB/s wr, 502 op/s 2024-02-28T23:09:14.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:14 smithi184 ceph-mon[36198]: pgmap v40: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 959 KiB/s rd, 959 KiB/s wr, 502 op/s 2024-02-28T23:09:15.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:15 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:09:15.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:15 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:09:16.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:16 smithi159 ceph-mon[28802]: pgmap v41: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 959 KiB/s rd, 959 KiB/s wr, 502 op/s 2024-02-28T23:09:16.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:16 smithi159 ceph-mon[28802]: Upgrade: Updating node-exporter.smithi159 (1/2) 2024-02-28T23:09:16.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:16 smithi159 ceph-mon[28802]: Deploying daemon node-exporter.smithi159 on smithi159 2024-02-28T23:09:16.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:16 smithi184 ceph-mon[36198]: pgmap v41: 65 pgs: 65 active+clean; 269 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 959 KiB/s rd, 959 KiB/s wr, 502 op/s 2024-02-28T23:09:16.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:16 smithi184 ceph-mon[36198]: Upgrade: Updating node-exporter.smithi159 (1/2) 2024-02-28T23:09:16.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:16 smithi184 ceph-mon[36198]: Deploying daemon node-exporter.smithi159 on smithi159 2024-02-28T23:09:17.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:17 smithi184 ceph-mon[36198]: pgmap v42: 65 pgs: 65 active+clean; 263 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 627 op/s 2024-02-28T23:09:17.447 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:17 smithi159 ceph-mon[28802]: pgmap v42: 65 pgs: 65 active+clean; 263 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 627 op/s 2024-02-28T23:09:19.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:19 smithi159 ceph-mon[28802]: pgmap v43: 65 pgs: 65 active+clean; 263 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 847 KiB/s rd, 878 KiB/s wr, 323 op/s 2024-02-28T23:09:19.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:19 smithi184 ceph-mon[36198]: pgmap v43: 65 pgs: 65 active+clean; 263 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 847 KiB/s rd, 878 KiB/s wr, 323 op/s 2024-02-28T23:09:21.307 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:21 smithi159 ceph-mon[28802]: pgmap v44: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 440 op/s 2024-02-28T23:09:21.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:21 smithi184 ceph-mon[36198]: pgmap v44: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 440 op/s 2024-02-28T23:09:22.771 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:22.771 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:22.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:22.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:23 smithi184 ceph-mon[36198]: pgmap v45: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 793 KiB/s rd, 833 KiB/s wr, 242 op/s 2024-02-28T23:09:23.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:23 smithi159 ceph-mon[28802]: pgmap v45: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 793 KiB/s rd, 833 KiB/s wr, 242 op/s 2024-02-28T23:09:24.539 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:24 smithi159 ceph-mon[28802]: Upgrade: Updating node-exporter.smithi184 (2/2) 2024-02-28T23:09:24.539 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:24 smithi159 ceph-mon[28802]: Deploying daemon node-exporter.smithi184 on smithi184 2024-02-28T23:09:24.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:24 smithi184 ceph-mon[36198]: Upgrade: Updating node-exporter.smithi184 (2/2) 2024-02-28T23:09:24.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:24 smithi184 ceph-mon[36198]: Deploying daemon node-exporter.smithi184 on smithi184 2024-02-28T23:09:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:25 smithi184 ceph-mon[36198]: pgmap v46: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 793 KiB/s rd, 833 KiB/s wr, 242 op/s 2024-02-28T23:09:25.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:25 smithi159 ceph-mon[28802]: pgmap v46: 65 pgs: 65 active+clean; 256 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 793 KiB/s rd, 833 KiB/s wr, 242 op/s 2024-02-28T23:09:27.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:27 smithi184 ceph-mon[36198]: pgmap v47: 65 pgs: 65 active+clean; 251 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 343 op/s 2024-02-28T23:09:27.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:27 smithi159 ceph-mon[28802]: pgmap v47: 65 pgs: 65 active+clean; 251 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 343 op/s 2024-02-28T23:09:29.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:29.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:29.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:09:29.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:29 smithi159 ceph-mon[28802]: pgmap v48: 65 pgs: 65 active+clean; 251 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 720 KiB/s rd, 746 KiB/s wr, 218 op/s 2024-02-28T23:09:29.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:09:30.027 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:30.027 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:30.028 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:09:30.028 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:29 smithi184 ceph-mon[36198]: pgmap v48: 65 pgs: 65 active+clean; 251 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 720 KiB/s rd, 746 KiB/s wr, 218 op/s 2024-02-28T23:09:30.028 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:09:30.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:30 smithi159 ceph-mon[28802]: mgrmap e32: smithi159.pobewk(active, since 90s), standbys: smithi184.quvmnx 2024-02-28T23:09:31.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:30 smithi184 ceph-mon[36198]: mgrmap e32: smithi159.pobewk(active, since 90s), standbys: smithi184.quvmnx 2024-02-28T23:09:31.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:31 smithi159 ceph-mon[28802]: pgmap v49: 65 pgs: 65 active+clean; 246 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 321 op/s 2024-02-28T23:09:31.982 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:31 smithi184 ceph-mon[36198]: pgmap v49: 65 pgs: 65 active+clean; 246 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 321 op/s 2024-02-28T23:09:34.045 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:34 smithi184 ceph-mon[36198]: pgmap v50: 65 pgs: 65 active+clean; 246 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 650 KiB/s rd, 696 KiB/s wr, 204 op/s 2024-02-28T23:09:34.045 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:34 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:34.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:34 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:34 smithi159 ceph-mon[28802]: pgmap v50: 65 pgs: 65 active+clean; 246 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 650 KiB/s rd, 696 KiB/s wr, 204 op/s 2024-02-28T23:09:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:34 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:34.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:34 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:35.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:35 smithi184 ceph-mon[36198]: pgmap v51: 65 pgs: 65 active+clean; 246 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 650 KiB/s rd, 696 KiB/s wr, 204 op/s 2024-02-28T23:09:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:35 smithi159 ceph-mon[28802]: pgmap v51: 65 pgs: 65 active+clean; 246 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 650 KiB/s rd, 696 KiB/s wr, 204 op/s 2024-02-28T23:09:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:36 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:36 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:36 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:36 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:38.129 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:37 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:38.129 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:37 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:38.129 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:37 smithi184 ceph-mon[36198]: pgmap v52: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 327 op/s 2024-02-28T23:09:38.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:37 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:38.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:37 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:38.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:37 smithi159 ceph-mon[28802]: pgmap v52: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 327 op/s 2024-02-28T23:09:40.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.074+0000 7f6403c00700 1 -- 172.21.15.159:0/1939109830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63fc073770 msgr2=0x7f63fc073bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:40.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.074+0000 7f6403c00700 1 --2- 172.21.15.159:0/1939109830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63fc073770 0x7f63fc073bf0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f63e8009910 tx=0x7f63e8009c20 comp rx=0 tx=0).stop 2024-02-28T23:09:40.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.074+0000 7f6403c00700 1 -- 172.21.15.159:0/1939109830 shutdown_connections 2024-02-28T23:09:40.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.074+0000 7f6403c00700 1 --2- 172.21.15.159:0/1939109830 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63fc073770 0x7f63fc073bf0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.074+0000 7f6403c00700 1 --2- 172.21.15.159:0/1939109830 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63fc074d40 0x7f63fc0731a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.074+0000 7f6403c00700 1 -- 172.21.15.159:0/1939109830 >> 172.21.15.159:0/1939109830 conn(0x7f63fc0fc110 msgr2=0x7f63fc0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:40.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.074+0000 7f6403c00700 1 -- 172.21.15.159:0/1939109830 shutdown_connections 2024-02-28T23:09:40.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.074+0000 7f6403c00700 1 -- 172.21.15.159:0/1939109830 wait complete. 2024-02-28T23:09:40.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.076+0000 7f6403c00700 1 Processor -- start 2024-02-28T23:09:40.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.076+0000 7f6403c00700 1 -- start start 2024-02-28T23:09:40.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.076+0000 7f6403c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63fc073770 0x7f63fc198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:40.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.076+0000 7f6403c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63fc074d40 0x7f63fc198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:40.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.076+0000 7f6403c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc1990b0 con 0x7f63fc073770 2024-02-28T23:09:40.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.076+0000 7f6403c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63fc1991f0 con 0x7f63fc074d40 2024-02-28T23:09:40.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.077+0000 7f6401200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63fc073770 0x7f63fc198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:40.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.077+0000 7f63fbe00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63fc074d40 0x7f63fc198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:40.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.077+0000 7f6401200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63fc073770 0x7f63fc198550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44998/0 (socket says 172.21.15.159:44998) 2024-02-28T23:09:40.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.077+0000 7f6401200700 1 -- 172.21.15.159:0/2242870998 learned_addr learned my addr 172.21.15.159:0/2242870998 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:09:40.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.077+0000 7f6401200700 1 -- 172.21.15.159:0/2242870998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63fc074d40 msgr2=0x7f63fc198a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:40.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.077+0000 7f6401200700 1 --2- 172.21.15.159:0/2242870998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63fc074d40 0x7f63fc198a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.077+0000 7f6401200700 1 -- 172.21.15.159:0/2242870998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63e80095f0 con 0x7f63fc073770 2024-02-28T23:09:40.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.077+0000 7f6401200700 1 --2- 172.21.15.159:0/2242870998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63fc073770 0x7f63fc198550 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f63f000c8a0 tx=0x7f63f000cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:40.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.078+0000 7f63f9600700 1 -- 172.21.15.159:0/2242870998 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f00078e0 con 0x7f63fc073770 2024-02-28T23:09:40.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.078+0000 7f63f9600700 1 -- 172.21.15.159:0/2242870998 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f63f000f450 con 0x7f63fc073770 2024-02-28T23:09:40.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.078+0000 7f63f9600700 1 -- 172.21.15.159:0/2242870998 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f63f000e5e0 con 0x7f63fc073770 2024-02-28T23:09:40.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.078+0000 7f6403c00700 1 -- 172.21.15.159:0/2242870998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63fc19dca0 con 0x7f63fc073770 2024-02-28T23:09:40.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.078+0000 7f6403c00700 1 -- 172.21.15.159:0/2242870998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63fc19e1a0 con 0x7f63fc073770 2024-02-28T23:09:40.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.079+0000 7f6403c00700 1 -- 172.21.15.159:0/2242870998 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63fc10b900 con 0x7f63fc073770 2024-02-28T23:09:40.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.081+0000 7f63f9600700 1 -- 172.21.15.159:0/2242870998 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f63f000f5c0 con 0x7f63fc073770 2024-02-28T23:09:40.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.082+0000 7f63f9600700 1 --2- 172.21.15.159:0/2242870998 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f63e406d520 0x7f63e406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:40.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.082+0000 7f63f9600700 1 -- 172.21.15.159:0/2242870998 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f63f008ce00 con 0x7f63fc073770 2024-02-28T23:09:40.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.082+0000 7f63fbe00700 1 --2- 172.21.15.159:0/2242870998 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f63e406d520 0x7f63e406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:40.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.083+0000 7f63fbe00700 1 --2- 172.21.15.159:0/2242870998 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f63e406d520 0x7f63e406f9e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f63e8006010 tx=0x7f63e800b560 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:40.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.092+0000 7f63f9600700 1 -- 172.21.15.159:0/2242870998 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f63f005a690 con 0x7f63fc073770 2024-02-28T23:09:40.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:40 smithi184 ceph-mon[36198]: pgmap v53: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 813 KiB/s rd, 801 KiB/s wr, 225 op/s 2024-02-28T23:09:40.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:40 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:40.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:40 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:40.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:40 smithi159 ceph-mon[28802]: pgmap v53: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 813 KiB/s rd, 801 KiB/s wr, 225 op/s 2024-02-28T23:09:40.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:40 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:40.275 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:40 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:40.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.485+0000 7f6403c00700 1 -- 172.21.15.159:0/2242870998 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f63fc108130 con 0x7f63e406d520 2024-02-28T23:09:40.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.486+0000 7f63f9600700 1 -- 172.21.15.159:0/2242870998 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f63fc108130 con 0x7f63e406d520 2024-02-28T23:09:40.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.489+0000 7f6403c00700 1 -- 172.21.15.159:0/2242870998 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f63e406d520 msgr2=0x7f63e406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:40.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.489+0000 7f6403c00700 1 --2- 172.21.15.159:0/2242870998 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f63e406d520 0x7f63e406f9e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f63e8006010 tx=0x7f63e800b560 comp rx=0 tx=0).stop 2024-02-28T23:09:40.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.489+0000 7f6403c00700 1 -- 172.21.15.159:0/2242870998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63fc073770 msgr2=0x7f63fc198550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:40.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.489+0000 7f6403c00700 1 --2- 172.21.15.159:0/2242870998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63fc073770 0x7f63fc198550 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f63f000c8a0 tx=0x7f63f000cbb0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.489+0000 7f6403c00700 1 -- 172.21.15.159:0/2242870998 shutdown_connections 2024-02-28T23:09:40.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.489+0000 7f6403c00700 1 --2- 172.21.15.159:0/2242870998 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f63e406d520 0x7f63e406f9e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.489+0000 7f6403c00700 1 --2- 172.21.15.159:0/2242870998 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f63fc073770 0x7f63fc198550 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.489+0000 7f6403c00700 1 --2- 172.21.15.159:0/2242870998 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f63fc074d40 0x7f63fc198a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.489+0000 7f6403c00700 1 -- 172.21.15.159:0/2242870998 >> 172.21.15.159:0/2242870998 conn(0x7f63fc0fc110 msgr2=0x7f63fc106a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:40.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.489+0000 7f6403c00700 1 -- 172.21.15.159:0/2242870998 shutdown_connections 2024-02-28T23:09:40.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.489+0000 7f6403c00700 1 -- 172.21.15.159:0/2242870998 wait complete. 2024-02-28T23:09:40.505 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:09:40.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.675+0000 7fb711800700 1 -- 172.21.15.159:0/695633782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb70c074d60 msgr2=0x7fb70c0731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:40.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.675+0000 7fb711800700 1 --2- 172.21.15.159:0/695633782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb70c074d60 0x7fb70c0731c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc009910 tx=0x7fb6fc009c20 comp rx=0 tx=0).stop 2024-02-28T23:09:40.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.675+0000 7fb711800700 1 -- 172.21.15.159:0/695633782 shutdown_connections 2024-02-28T23:09:40.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.675+0000 7fb711800700 1 --2- 172.21.15.159:0/695633782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb70c073790 0x7fb70c073c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.675+0000 7fb711800700 1 --2- 172.21.15.159:0/695633782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb70c074d60 0x7fb70c0731c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.675+0000 7fb711800700 1 -- 172.21.15.159:0/695633782 >> 172.21.15.159:0/695633782 conn(0x7fb70c0fc110 msgr2=0x7fb70c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:40.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.676+0000 7fb711800700 1 -- 172.21.15.159:0/695633782 shutdown_connections 2024-02-28T23:09:40.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.676+0000 7fb711800700 1 -- 172.21.15.159:0/695633782 wait complete. 2024-02-28T23:09:40.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.677+0000 7fb711800700 1 Processor -- start 2024-02-28T23:09:40.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.677+0000 7fb711800700 1 -- start start 2024-02-28T23:09:40.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.678+0000 7fb711800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb70c073790 0x7fb70c198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:40.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.678+0000 7fb711800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb70c074d60 0x7fb70c198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:40.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.678+0000 7fb711800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c1990d0 con 0x7fb70c074d60 2024-02-28T23:09:40.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.678+0000 7fb711800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb70c199210 con 0x7fb70c073790 2024-02-28T23:09:40.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.678+0000 7fb70a000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb70c074d60 0x7fb70c198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:40.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.678+0000 7fb70aa00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb70c073790 0x7fb70c198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:40.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.678+0000 7fb70a000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb70c074d60 0x7fb70c198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45018/0 (socket says 172.21.15.159:45018) 2024-02-28T23:09:40.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.678+0000 7fb70a000700 1 -- 172.21.15.159:0/3101455109 learned_addr learned my addr 172.21.15.159:0/3101455109 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:09:40.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.679+0000 7fb70a000700 1 -- 172.21.15.159:0/3101455109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb70c073790 msgr2=0x7fb70c198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:40.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.679+0000 7fb70a000700 1 --2- 172.21.15.159:0/3101455109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb70c073790 0x7fb70c198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.679+0000 7fb70a000700 1 -- 172.21.15.159:0/3101455109 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6fc0095f0 con 0x7fb70c074d60 2024-02-28T23:09:40.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.679+0000 7fb70a000700 1 --2- 172.21.15.159:0/3101455109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb70c074d60 0x7fb70c198ab0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c8a0 tx=0x7fb6f800cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:40.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.680+0000 7fb703400700 1 -- 172.21.15.159:0/3101455109 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f80078e0 con 0x7fb70c074d60 2024-02-28T23:09:40.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.680+0000 7fb711800700 1 -- 172.21.15.159:0/3101455109 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c19dcc0 con 0x7fb70c074d60 2024-02-28T23:09:40.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.680+0000 7fb703400700 1 -- 172.21.15.159:0/3101455109 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fb6f800f450 con 0x7fb70c074d60 2024-02-28T23:09:40.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.680+0000 7fb703400700 1 -- 172.21.15.159:0/3101455109 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6f800e5e0 con 0x7fb70c074d60 2024-02-28T23:09:40.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.680+0000 7fb711800700 1 -- 172.21.15.159:0/3101455109 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb70c19e210 con 0x7fb70c074d60 2024-02-28T23:09:40.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.682+0000 7fb711800700 1 -- 172.21.15.159:0/3101455109 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb70c10b900 con 0x7fb70c074d60 2024-02-28T23:09:40.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.683+0000 7fb703400700 1 -- 172.21.15.159:0/3101455109 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7fb6f800f5c0 con 0x7fb70c074d60 2024-02-28T23:09:40.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.684+0000 7fb703400700 1 --2- 172.21.15.159:0/3101455109 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb6f006d520 0x7fb6f006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:40.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.684+0000 7fb703400700 1 -- 172.21.15.159:0/3101455109 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb6f808cea0 con 0x7fb70c074d60 2024-02-28T23:09:40.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.685+0000 7fb70aa00700 1 --2- 172.21.15.159:0/3101455109 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb6f006d520 0x7fb6f006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:40.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.687+0000 7fb70aa00700 1 --2- 172.21.15.159:0/3101455109 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb6f006d520 0x7fb6f006f9e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc006010 tx=0x7fb6fc00b560 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:40.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.691+0000 7fb703400700 1 -- 172.21.15.159:0/3101455109 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fb6f805a690 con 0x7fb70c074d60 2024-02-28T23:09:40.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.988+0000 7fb711800700 1 -- 172.21.15.159:0/3101455109 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb70c108110 con 0x7fb6f006d520 2024-02-28T23:09:40.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.990+0000 7fb703400700 1 -- 172.21.15.159:0/3101455109 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fb70c108110 con 0x7fb6f006d520 2024-02-28T23:09:40.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.993+0000 7fb711800700 1 -- 172.21.15.159:0/3101455109 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb6f006d520 msgr2=0x7fb6f006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:40.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.993+0000 7fb711800700 1 --2- 172.21.15.159:0/3101455109 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb6f006d520 0x7fb6f006f9e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc006010 tx=0x7fb6fc00b560 comp rx=0 tx=0).stop 2024-02-28T23:09:40.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.993+0000 7fb711800700 1 -- 172.21.15.159:0/3101455109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb70c074d60 msgr2=0x7fb70c198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:40.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.993+0000 7fb711800700 1 --2- 172.21.15.159:0/3101455109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb70c074d60 0x7fb70c198ab0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb6f800c8a0 tx=0x7fb6f800cbb0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.993+0000 7fb711800700 1 -- 172.21.15.159:0/3101455109 shutdown_connections 2024-02-28T23:09:40.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.993+0000 7fb711800700 1 --2- 172.21.15.159:0/3101455109 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb6f006d520 0x7fb6f006f9e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.993+0000 7fb711800700 1 --2- 172.21.15.159:0/3101455109 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb70c073790 0x7fb70c198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.993+0000 7fb711800700 1 --2- 172.21.15.159:0/3101455109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb70c074d60 0x7fb70c198ab0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:40.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.993+0000 7fb711800700 1 -- 172.21.15.159:0/3101455109 >> 172.21.15.159:0/3101455109 conn(0x7fb70c0fc110 msgr2=0x7fb70c1069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:40.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.993+0000 7fb711800700 1 -- 172.21.15.159:0/3101455109 shutdown_connections 2024-02-28T23:09:40.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:40.994+0000 7fb711800700 1 -- 172.21.15.159:0/3101455109 wait complete. 2024-02-28T23:09:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.167+0000 7fabb1600700 1 -- 172.21.15.159:0/4091356516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabac101db0 msgr2=0x7fabac102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.167+0000 7fabb1600700 1 --2- 172.21.15.159:0/4091356516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabac101db0 0x7fabac102210 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fab98009910 tx=0x7fab98009c20 comp rx=0 tx=0).stop 2024-02-28T23:09:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.167+0000 7fabb1600700 1 -- 172.21.15.159:0/4091356516 shutdown_connections 2024-02-28T23:09:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.167+0000 7fabb1600700 1 --2- 172.21.15.159:0/4091356516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabac101db0 0x7fabac102210 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.167+0000 7fabb1600700 1 --2- 172.21.15.159:0/4091356516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac100bb0 0x7fabac100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.167+0000 7fabb1600700 1 -- 172.21.15.159:0/4091356516 >> 172.21.15.159:0/4091356516 conn(0x7fabac0fc110 msgr2=0x7fabac0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:41.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.168+0000 7fabb1600700 1 -- 172.21.15.159:0/4091356516 shutdown_connections 2024-02-28T23:09:41.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.168+0000 7fabb1600700 1 -- 172.21.15.159:0/4091356516 wait complete. 2024-02-28T23:09:41.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.169+0000 7fabb1600700 1 Processor -- start 2024-02-28T23:09:41.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.169+0000 7fabb1600700 1 -- start start 2024-02-28T23:09:41.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.169+0000 7fabb1600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac100bb0 0x7fabac194160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:41.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.169+0000 7fabb1600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabac101db0 0x7fabac1946a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:41.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.169+0000 7fabb1600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac194cc0 con 0x7fabac101db0 2024-02-28T23:09:41.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.169+0000 7fabb1600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabac194e00 con 0x7fabac100bb0 2024-02-28T23:09:41.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.170+0000 7fabaa000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabac101db0 0x7fabac1946a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:41.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.170+0000 7fabaa000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabac101db0 0x7fabac1946a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45034/0 (socket says 172.21.15.159:45034) 2024-02-28T23:09:41.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.170+0000 7fabaa000700 1 -- 172.21.15.159:0/328240277 learned_addr learned my addr 172.21.15.159:0/328240277 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:09:41.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.170+0000 7fabaaa00700 1 --2- 172.21.15.159:0/328240277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac100bb0 0x7fabac194160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:41.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.170+0000 7fabaa000700 1 -- 172.21.15.159:0/328240277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac100bb0 msgr2=0x7fabac194160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:41.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.170+0000 7fabaa000700 1 --2- 172.21.15.159:0/328240277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac100bb0 0x7fabac194160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:41.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.170+0000 7fabaa000700 1 -- 172.21.15.159:0/328240277 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980095f0 con 0x7fabac101db0 2024-02-28T23:09:41.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.171+0000 7fabaa000700 1 --2- 172.21.15.159:0/328240277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabac101db0 0x7fabac1946a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fab98005b40 tx=0x7fab9800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:41.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.171+0000 7faba3400700 1 -- 172.21.15.159:0/328240277 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9801d070 con 0x7fabac101db0 2024-02-28T23:09:41.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.171+0000 7faba3400700 1 -- 172.21.15.159:0/328240277 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fab98022470 con 0x7fabac101db0 2024-02-28T23:09:41.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.171+0000 7faba3400700 1 -- 172.21.15.159:0/328240277 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab9800f690 con 0x7fabac101db0 2024-02-28T23:09:41.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.171+0000 7fabb1600700 1 -- 172.21.15.159:0/328240277 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac199850 con 0x7fabac101db0 2024-02-28T23:09:41.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.172+0000 7fabb1600700 1 -- 172.21.15.159:0/328240277 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabac199d40 con 0x7fabac101db0 2024-02-28T23:09:41.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.173+0000 7fabb1600700 1 -- 172.21.15.159:0/328240277 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabac107510 con 0x7fabac101db0 2024-02-28T23:09:41.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.175+0000 7faba3400700 1 -- 172.21.15.159:0/328240277 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7fab980225e0 con 0x7fabac101db0 2024-02-28T23:09:41.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.176+0000 7faba3400700 1 --2- 172.21.15.159:0/328240277 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fab90071930 0x7fab90073df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:41.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.176+0000 7faba3400700 1 -- 172.21.15.159:0/328240277 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fab9808e780 con 0x7fabac101db0 2024-02-28T23:09:41.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.176+0000 7fabaaa00700 1 --2- 172.21.15.159:0/328240277 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fab90071930 0x7fab90073df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:41.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.177+0000 7fabaaa00700 1 --2- 172.21.15.159:0/328240277 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fab90071930 0x7fab90073df0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faba4007720 tx=0x7faba40076b0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:41.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.182+0000 7faba3400700 1 -- 172.21.15.159:0/328240277 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fab9805c110 con 0x7fabac101db0 2024-02-28T23:09:41.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.522+0000 7fabb1600700 1 -- 172.21.15.159:0/328240277 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fabac106700 con 0x7fab90071930 2024-02-28T23:09:41.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.537+0000 7faba3400700 1 -- 172.21.15.159:0/328240277 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fabac106700 con 0x7fab90071930 2024-02-28T23:09:41.536 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:09:41.536 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (11m) 4s ago 13m 14.3M - 0.25.0 c8568f914cd2 2b2966e86e70 2024-02-28T23:09:41.536 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (13m) 4s ago 13m 8120k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:09:41.536 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (12m) 8s ago 12m 7721k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:09:41.536 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (13m) 4s ago 13m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (12m) 8s ago 12m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (11m) 4s ago 13m 74.7M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (6m) 4s ago 6m 186M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (6m) 4s ago 6m 111M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (6m) 8s ago 6m 15.0M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (6m) 8s ago 6m 14.9M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (2m) 4s ago 15m 497M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (48s) 8s ago 12m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (15m) 4s ago 15m 55.0M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (11m) 8s ago 11m 43.2M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (22s) 4s ago 13m 6887k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (13s) 8s ago 12m 2939k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (10m) 4s ago 10m 222M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:09:41.537 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (10m) 4s ago 10m 239M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:09:41.538 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (9m) 4s ago 9m 203M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:09:41.538 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (9m) 8s ago 9m 286M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:09:41.538 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (8m) 8s ago 8m 242M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:09:41.538 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (8m) 8s ago 8m 219M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:09:41.538 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (58s) 4s ago 12m 42.9M - 2.43.0 a07b618ecd1d ca01ba9a8afb 2024-02-28T23:09:41.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.541+0000 7fabb1600700 1 -- 172.21.15.159:0/328240277 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fab90071930 msgr2=0x7fab90073df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:41.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.541+0000 7fabb1600700 1 --2- 172.21.15.159:0/328240277 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fab90071930 0x7fab90073df0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7faba4007720 tx=0x7faba40076b0 comp rx=0 tx=0).stop 2024-02-28T23:09:41.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.541+0000 7fabb1600700 1 -- 172.21.15.159:0/328240277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabac101db0 msgr2=0x7fabac1946a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:41.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.541+0000 7fabb1600700 1 --2- 172.21.15.159:0/328240277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabac101db0 0x7fabac1946a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fab98005b40 tx=0x7fab9800be20 comp rx=0 tx=0).stop 2024-02-28T23:09:41.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.541+0000 7fabb1600700 1 -- 172.21.15.159:0/328240277 shutdown_connections 2024-02-28T23:09:41.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.541+0000 7fabb1600700 1 --2- 172.21.15.159:0/328240277 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fab90071930 0x7fab90073df0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:41.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.541+0000 7fabb1600700 1 --2- 172.21.15.159:0/328240277 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabac100bb0 0x7fabac194160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:41.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.541+0000 7fabb1600700 1 --2- 172.21.15.159:0/328240277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabac101db0 0x7fabac1946a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:41.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.541+0000 7fabb1600700 1 -- 172.21.15.159:0/328240277 >> 172.21.15.159:0/328240277 conn(0x7fabac0fc110 msgr2=0x7fabac104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:41.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.542+0000 7fabb1600700 1 -- 172.21.15.159:0/328240277 shutdown_connections 2024-02-28T23:09:41.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.542+0000 7fabb1600700 1 -- 172.21.15.159:0/328240277 wait complete. 2024-02-28T23:09:41.695 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-02-28T23:09:41.696 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-02-28T23:09:41.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.706+0000 7ff26fc00700 1 -- 172.21.15.159:0/1156741887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff268101db0 msgr2=0x7ff268102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:41.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.706+0000 7ff26fc00700 1 --2- 172.21.15.159:0/1156741887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff268101db0 0x7ff268102210 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff254009910 tx=0x7ff254009c20 comp rx=0 tx=0).stop 2024-02-28T23:09:41.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.706+0000 7ff26fc00700 1 -- 172.21.15.159:0/1156741887 shutdown_connections 2024-02-28T23:09:41.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.706+0000 7ff26fc00700 1 --2- 172.21.15.159:0/1156741887 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff268101db0 0x7ff268102210 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:41.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.706+0000 7ff26fc00700 1 --2- 172.21.15.159:0/1156741887 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff268100bb0 0x7ff268100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:41.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.706+0000 7ff26fc00700 1 -- 172.21.15.159:0/1156741887 >> 172.21.15.159:0/1156741887 conn(0x7ff2680fc110 msgr2=0x7ff2680fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:41.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.706+0000 7ff26fc00700 1 -- 172.21.15.159:0/1156741887 shutdown_connections 2024-02-28T23:09:41.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.706+0000 7ff26fc00700 1 -- 172.21.15.159:0/1156741887 wait complete. 2024-02-28T23:09:41.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.707+0000 7ff26fc00700 1 Processor -- start 2024-02-28T23:09:41.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.708+0000 7ff26fc00700 1 -- start start 2024-02-28T23:09:41.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.708+0000 7ff26fc00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff268100bb0 0x7ff2681985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:41.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.708+0000 7ff26fc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff268101db0 0x7ff268198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:41.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.708+0000 7ff26fc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff268199140 con 0x7ff268101db0 2024-02-28T23:09:41.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.708+0000 7ff26fc00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff268199280 con 0x7ff268100bb0 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.708+0000 7ff267e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff268101db0 0x7ff268198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.708+0000 7ff267e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff268101db0 0x7ff268198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45052/0 (socket says 172.21.15.159:45052) 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.708+0000 7ff267e00700 1 -- 172.21.15.159:0/1738626176 learned_addr learned my addr 172.21.15.159:0/1738626176 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.709+0000 7ff26d200700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff268100bb0 0x7ff2681985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.709+0000 7ff267e00700 1 -- 172.21.15.159:0/1738626176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff268100bb0 msgr2=0x7ff2681985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.709+0000 7ff267e00700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff268100bb0 0x7ff2681985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.709+0000 7ff267e00700 1 -- 172.21.15.159:0/1738626176 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2540095f0 con 0x7ff268101db0 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.709+0000 7ff26d200700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff268100bb0 0x7ff2681985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.709+0000 7ff267e00700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff268101db0 0x7ff268198b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff25400b5c0 tx=0x7ff25400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.709+0000 7ff265600700 1 -- 172.21.15.159:0/1738626176 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff25401d070 con 0x7ff268101db0 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.709+0000 7ff265600700 1 -- 172.21.15.159:0/1738626176 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ff254022470 con 0x7ff268101db0 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.709+0000 7ff26fc00700 1 -- 172.21.15.159:0/1738626176 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26819dcd0 con 0x7ff268101db0 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.709+0000 7ff265600700 1 -- 172.21.15.159:0/1738626176 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff25400f690 con 0x7ff268101db0 2024-02-28T23:09:41.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.710+0000 7ff26fc00700 1 -- 172.21.15.159:0/1738626176 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26819e240 con 0x7ff268101db0 2024-02-28T23:09:41.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.711+0000 7ff26fc00700 1 -- 172.21.15.159:0/1738626176 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff268105e90 con 0x7ff268101db0 2024-02-28T23:09:41.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.712+0000 7ff265600700 1 -- 172.21.15.159:0/1738626176 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7ff254004b70 con 0x7ff268101db0 2024-02-28T23:09:41.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.713+0000 7ff265600700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff25006d520 0x7ff25006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:41.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.714+0000 7ff265600700 1 -- 172.21.15.159:0/1738626176 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff25408e6d0 con 0x7ff268101db0 2024-02-28T23:09:41.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.714+0000 7ff26d200700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff25006d520 0x7ff25006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:41.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.714+0000 7ff26d200700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff25006d520 0x7ff25006f9e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff268101c10 tx=0x7ff25c008040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:41.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:41.718+0000 7ff265600700 1 -- 172.21.15.159:0/1738626176 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7ff25405c090 con 0x7ff268101db0 2024-02-28T23:09:42.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.086+0000 7ff26fc00700 1 -- 172.21.15.159:0/1738626176 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff26802cc70 con 0x7ff268101db0 2024-02-28T23:09:42.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.087+0000 7ff265600700 1 -- 172.21.15.159:0/1738626176 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7ff25405bc20 con 0x7ff268101db0 2024-02-28T23:09:42.086 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:09:42.086 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:09:42.086 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:09:42.086 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:09:42.087 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:09:42.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.090+0000 7ff26fc00700 1 -- 172.21.15.159:0/1738626176 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff25006d520 msgr2=0x7ff25006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:42.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.090+0000 7ff26fc00700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff25006d520 0x7ff25006f9e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff268101c10 tx=0x7ff25c008040 comp rx=0 tx=0).stop 2024-02-28T23:09:42.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.090+0000 7ff26fc00700 1 -- 172.21.15.159:0/1738626176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff268101db0 msgr2=0x7ff268198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:42.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.090+0000 7ff26fc00700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff268101db0 0x7ff268198b20 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff25400b5c0 tx=0x7ff25400be20 comp rx=0 tx=0).stop 2024-02-28T23:09:42.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.090+0000 7ff26fc00700 1 -- 172.21.15.159:0/1738626176 shutdown_connections 2024-02-28T23:09:42.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.090+0000 7ff26fc00700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff25006d520 0x7ff25006f9e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:42.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.091+0000 7ff26fc00700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff268100bb0 0x7ff2681985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:42.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.091+0000 7ff26fc00700 1 --2- 172.21.15.159:0/1738626176 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff268101db0 0x7ff268198b20 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:42.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.091+0000 7ff26fc00700 1 -- 172.21.15.159:0/1738626176 >> 172.21.15.159:0/1738626176 conn(0x7ff2680fc110 msgr2=0x7ff268102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:42.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.091+0000 7ff26fc00700 1 -- 172.21.15.159:0/1738626176 shutdown_connections 2024-02-28T23:09:42.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.091+0000 7ff26fc00700 1 -- 172.21.15.159:0/1738626176 wait complete. 2024-02-28T23:09:42.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:41 smithi184 ceph-mon[36198]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:42.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:41 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:42.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:41 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:42.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:41 smithi184 ceph-mon[36198]: pgmap v54: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 332 op/s 2024-02-28T23:09:42.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:41 smithi184 ceph-mon[36198]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:42.146 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:41 smithi159 ceph-mon[28802]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:42.146 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:41 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:42.146 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:41 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:42.147 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:41 smithi159 ceph-mon[28802]: pgmap v54: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.2 MiB/s wr, 332 op/s 2024-02-28T23:09:42.147 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:41 smithi159 ceph-mon[28802]: from='client.14770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:42.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.290+0000 7fd6dd400700 1 -- 172.21.15.159:0/3986775508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6d810a7e0 msgr2=0x7fd6d810cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:42.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.290+0000 7fd6dd400700 1 --2- 172.21.15.159:0/3986775508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6d810a7e0 0x7fd6d810cbf0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009870 tx=0x7fd6c4009b80 comp rx=0 tx=0).stop 2024-02-28T23:09:42.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.292+0000 7fd6dd400700 1 -- 172.21.15.159:0/3986775508 shutdown_connections 2024-02-28T23:09:42.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.292+0000 7fd6dd400700 1 --2- 172.21.15.159:0/3986775508 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6d810a7e0 0x7fd6d810cbf0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:42.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.292+0000 7fd6dd400700 1 --2- 172.21.15.159:0/3986775508 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d8107e20 0x7fd6d810a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:42.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.292+0000 7fd6dd400700 1 -- 172.21.15.159:0/3986775508 >> 172.21.15.159:0/3986775508 conn(0x7fd6d806d9f0 msgr2=0x7fd6d806fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:42.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.293+0000 7fd6dd400700 1 -- 172.21.15.159:0/3986775508 shutdown_connections 2024-02-28T23:09:42.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.293+0000 7fd6dd400700 1 -- 172.21.15.159:0/3986775508 wait complete. 2024-02-28T23:09:42.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.295+0000 7fd6dd400700 1 Processor -- start 2024-02-28T23:09:42.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.295+0000 7fd6dd400700 1 -- start start 2024-02-28T23:09:42.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.295+0000 7fd6dd400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6d8107e20 0x7fd6d81a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:42.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.296+0000 7fd6dd400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d810a7e0 0x7fd6d81a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:42.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.296+0000 7fd6dd400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d81a5ca0 con 0x7fd6d810a7e0 2024-02-28T23:09:42.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.296+0000 7fd6dd400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d81a5e10 con 0x7fd6d8107e20 2024-02-28T23:09:42.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.296+0000 7fd6d5e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d810a7e0 0x7fd6d81a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:42.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.296+0000 7fd6d6800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6d8107e20 0x7fd6d81a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:42.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.296+0000 7fd6d5e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d810a7e0 0x7fd6d81a5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:45082/0 (socket says 172.21.15.159:45082) 2024-02-28T23:09:42.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.296+0000 7fd6d5e00700 1 -- 172.21.15.159:0/422548959 learned_addr learned my addr 172.21.15.159:0/422548959 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:09:42.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.297+0000 7fd6d5e00700 1 -- 172.21.15.159:0/422548959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6d8107e20 msgr2=0x7fd6d81a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:42.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.297+0000 7fd6d5e00700 1 --2- 172.21.15.159:0/422548959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6d8107e20 0x7fd6d81a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:42.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.297+0000 7fd6d5e00700 1 -- 172.21.15.159:0/422548959 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c4009520 con 0x7fd6d810a7e0 2024-02-28T23:09:42.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.297+0000 7fd6d5e00700 1 --2- 172.21.15.159:0/422548959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d810a7e0 0x7fd6d81a5660 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009f50 tx=0x7fd6c400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:42.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.303+0000 7fd6cf400700 1 -- 172.21.15.159:0/422548959 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c401c070 con 0x7fd6d810a7e0 2024-02-28T23:09:42.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.303+0000 7fd6cf400700 1 -- 172.21.15.159:0/422548959 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fd6c400be80 con 0x7fd6d810a7e0 2024-02-28T23:09:42.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.303+0000 7fd6cf400700 1 -- 172.21.15.159:0/422548959 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c40173f0 con 0x7fd6d810a7e0 2024-02-28T23:09:42.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.303+0000 7fd6dd400700 1 -- 172.21.15.159:0/422548959 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d8077120 con 0x7fd6d810a7e0 2024-02-28T23:09:42.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.303+0000 7fd6dd400700 1 -- 172.21.15.159:0/422548959 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d8077690 con 0x7fd6d810a7e0 2024-02-28T23:09:42.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.308+0000 7fd6dd400700 1 -- 172.21.15.159:0/422548959 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b8005320 con 0x7fd6d810a7e0 2024-02-28T23:09:42.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.313+0000 7fd6cf400700 1 -- 172.21.15.159:0/422548959 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7fd6c4020070 con 0x7fd6d810a7e0 2024-02-28T23:09:42.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.316+0000 7fd6cf400700 1 --2- 172.21.15.159:0/422548959 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd6bc06d570 0x7fd6bc06fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:09:42.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.316+0000 7fd6cf400700 1 -- 172.21.15.159:0/422548959 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd6c408eb60 con 0x7fd6d810a7e0 2024-02-28T23:09:42.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.322+0000 7fd6d6800700 1 --2- 172.21.15.159:0/422548959 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd6bc06d570 0x7fd6bc06fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:09:42.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.324+0000 7fd6d6800700 1 --2- 172.21.15.159:0/422548959 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd6bc06d570 0x7fd6bc06fa30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6d81a6680 tx=0x7fd6d000c040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:09:42.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.332+0000 7fd6cf400700 1 -- 172.21.15.159:0/422548959 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fd6c4058ff0 con 0x7fd6d810a7e0 2024-02-28T23:09:42.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.677+0000 7fd6dd400700 1 -- 172.21.15.159:0/422548959 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6b8000bf0 con 0x7fd6bc06d570 2024-02-28T23:09:42.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.680+0000 7fd6cf400700 1 -- 172.21.15.159:0/422548959 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fd6b8000bf0 con 0x7fd6bc06d570 2024-02-28T23:09:42.679 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:09:42.679 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:09:42.679 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:09:42.679 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:09:42.679 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:09:42.679 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:09:42.679 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:09:42.679 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T23:09:42.679 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading node-exporter daemons", 2024-02-28T23:09:42.679 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:09:42.680 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:09:42.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.682+0000 7fd6dd400700 1 -- 172.21.15.159:0/422548959 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd6bc06d570 msgr2=0x7fd6bc06fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:42.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.682+0000 7fd6dd400700 1 --2- 172.21.15.159:0/422548959 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd6bc06d570 0x7fd6bc06fa30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd6d81a6680 tx=0x7fd6d000c040 comp rx=0 tx=0).stop 2024-02-28T23:09:42.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.682+0000 7fd6dd400700 1 -- 172.21.15.159:0/422548959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d810a7e0 msgr2=0x7fd6d81a5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:09:42.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.682+0000 7fd6dd400700 1 --2- 172.21.15.159:0/422548959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d810a7e0 0x7fd6d81a5660 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4009f50 tx=0x7fd6c400f740 comp rx=0 tx=0).stop 2024-02-28T23:09:42.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.683+0000 7fd6dd400700 1 -- 172.21.15.159:0/422548959 shutdown_connections 2024-02-28T23:09:42.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.683+0000 7fd6dd400700 1 --2- 172.21.15.159:0/422548959 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd6bc06d570 0x7fd6bc06fa30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:42.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.683+0000 7fd6dd400700 1 --2- 172.21.15.159:0/422548959 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd6d8107e20 0x7fd6d81a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:42.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.683+0000 7fd6dd400700 1 --2- 172.21.15.159:0/422548959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6d810a7e0 0x7fd6d81a5660 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:09:42.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.683+0000 7fd6dd400700 1 -- 172.21.15.159:0/422548959 >> 172.21.15.159:0/422548959 conn(0x7fd6d806d9f0 msgr2=0x7fd6d806fe30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:09:42.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.683+0000 7fd6dd400700 1 -- 172.21.15.159:0/422548959 shutdown_connections 2024-02-28T23:09:42.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:09:42.683+0000 7fd6dd400700 1 -- 172.21.15.159:0/422548959 wait complete. 2024-02-28T23:09:42.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:42 smithi159 ceph-mon[28802]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:42.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:42 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1738626176' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:42.987 DEBUG:teuthology.parallel:result is None 2024-02-28T23:09:43.207 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:42 smithi184 ceph-mon[36198]: from='client.14774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:43.207 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:42 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1738626176' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:44.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:43 smithi159 ceph-mon[28802]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:44.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:43 smithi159 ceph-mon[28802]: pgmap v55: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 785 KiB/s rd, 848 KiB/s wr, 229 op/s 2024-02-28T23:09:44.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:43 smithi184 ceph-mon[36198]: from='client.14782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:09:44.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:43 smithi184 ceph-mon[36198]: pgmap v55: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 785 KiB/s rd, 848 KiB/s wr, 229 op/s 2024-02-28T23:09:45.049 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:09:45.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:09:46.037 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:45 smithi159 ceph-mon[28802]: pgmap v56: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 785 KiB/s rd, 848 KiB/s wr, 229 op/s 2024-02-28T23:09:46.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:45 smithi184 ceph-mon[36198]: pgmap v56: 65 pgs: 65 active+clean; 242 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 785 KiB/s rd, 848 KiB/s wr, 229 op/s 2024-02-28T23:09:47.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:47.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:47.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:09:47.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:09:47.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:47.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:09:47.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:47 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:47.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:47.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:09:47.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:09:47.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:09:47.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:09:47.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:47.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:47 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:09:48.345 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:48 smithi184 ceph-mon[36198]: pgmap v57: 65 pgs: 65 active+clean; 231 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 339 op/s 2024-02-28T23:09:48.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:48 smithi159 ceph-mon[28802]: pgmap v57: 65 pgs: 65 active+clean; 231 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 MiB/s rd, 1.1 MiB/s wr, 339 op/s 2024-02-28T23:09:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:49 smithi159 ceph-mon[28802]: pgmap v58: 65 pgs: 65 active+clean; 231 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 697 KiB/s rd, 713 KiB/s wr, 216 op/s 2024-02-28T23:09:49.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:49 smithi184 ceph-mon[36198]: pgmap v58: 65 pgs: 65 active+clean; 231 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 697 KiB/s rd, 713 KiB/s wr, 216 op/s 2024-02-28T23:09:51.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:51 smithi184 ceph-mon[36198]: pgmap v59: 65 pgs: 65 active+clean; 221 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 863 KiB/s rd, 887 KiB/s wr, 275 op/s 2024-02-28T23:09:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:51 smithi159 ceph-mon[28802]: pgmap v59: 65 pgs: 65 active+clean; 221 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 863 KiB/s rd, 887 KiB/s wr, 275 op/s 2024-02-28T23:09:53.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:53 smithi159 ceph-mon[28802]: pgmap v60: 65 pgs: 65 active+clean; 221 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 524 KiB/s rd, 464 KiB/s wr, 168 op/s 2024-02-28T23:09:53.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:53 smithi184 ceph-mon[36198]: pgmap v60: 65 pgs: 65 active+clean; 221 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 524 KiB/s rd, 464 KiB/s wr, 168 op/s 2024-02-28T23:09:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:54 smithi159 ceph-mon[28802]: Upgrade: Updating prometheus.smithi159 2024-02-28T23:09:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:54 smithi159 ceph-mon[28802]: Deploying daemon prometheus.smithi159 on smithi159 2024-02-28T23:09:54.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:54 smithi184 ceph-mon[36198]: Upgrade: Updating prometheus.smithi159 2024-02-28T23:09:54.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:54 smithi184 ceph-mon[36198]: Deploying daemon prometheus.smithi159 on smithi159 2024-02-28T23:09:55.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:55 smithi159 ceph-mon[28802]: pgmap v61: 65 pgs: 65 active+clean; 221 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 524 KiB/s rd, 464 KiB/s wr, 168 op/s 2024-02-28T23:09:55.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:55 smithi184 ceph-mon[36198]: pgmap v61: 65 pgs: 65 active+clean; 221 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 524 KiB/s rd, 464 KiB/s wr, 168 op/s 2024-02-28T23:09:57.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:57 smithi184 ceph-mon[36198]: pgmap v62: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 672 KiB/s rd, 620 KiB/s wr, 214 op/s 2024-02-28T23:09:57.444 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:57 smithi159 ceph-mon[28802]: pgmap v62: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 672 KiB/s rd, 620 KiB/s wr, 214 op/s 2024-02-28T23:09:59.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:59 smithi159 ceph-mon[28802]: pgmap v63: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 314 KiB/s rd, 329 KiB/s wr, 105 op/s 2024-02-28T23:09:59.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:09:59 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:09:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:59 smithi184 ceph-mon[36198]: pgmap v63: 65 pgs: 65 active+clean; 217 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 314 KiB/s rd, 329 KiB/s wr, 105 op/s 2024-02-28T23:09:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:09:59 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:10:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:00 smithi159 ceph-mon[28802]: overall HEALTH_OK 2024-02-28T23:10:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:00 smithi184 ceph-mon[36198]: overall HEALTH_OK 2024-02-28T23:10:01.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:01 smithi159 ceph-mon[28802]: pgmap v64: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 456 KiB/s rd, 512 KiB/s wr, 165 op/s 2024-02-28T23:10:01.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:01 smithi184 ceph-mon[36198]: pgmap v64: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 456 KiB/s rd, 512 KiB/s wr, 165 op/s 2024-02-28T23:10:03.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:03 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:03.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:03 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:03.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:03 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:10:03.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:03 smithi159 ceph-mon[28802]: pgmap v65: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 290 KiB/s rd, 339 KiB/s wr, 106 op/s 2024-02-28T23:10:04.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:03 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:04.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:03 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:04.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:03 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:10:04.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:03 smithi184 ceph-mon[36198]: pgmap v65: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 290 KiB/s rd, 339 KiB/s wr, 106 op/s 2024-02-28T23:10:05.104 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-02-28T23:10:05.104 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-02-28T23:10:05.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:05 smithi184 ceph-mon[36198]: pgmap v66: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 290 KiB/s rd, 339 KiB/s wr, 106 op/s 2024-02-28T23:10:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:05 smithi159 ceph-mon[28802]: pgmap v66: 65 pgs: 65 active+clean; 216 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 290 KiB/s rd, 339 KiB/s wr, 106 op/s 2024-02-28T23:10:06.196 DEBUG:teuthology.parallel:result is None 2024-02-28T23:10:06.197 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-02-28T23:10:06.287 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-02-28T23:10:06.288 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-02-28T23:10:06.406 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-02-28T23:10:06.406 DEBUG:teuthology.parallel:result is None 2024-02-28T23:10:07.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:07 smithi184 ceph-mon[36198]: pgmap v67: 65 pgs: 65 active+clean; 214 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 495 KiB/s rd, 549 KiB/s wr, 163 op/s 2024-02-28T23:10:07.356 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:07 smithi159 ceph-mon[28802]: pgmap v67: 65 pgs: 65 active+clean; 214 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 495 KiB/s rd, 549 KiB/s wr, 163 op/s 2024-02-28T23:10:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:09 smithi159 ceph-mon[28802]: pgmap v68: 65 pgs: 65 active+clean; 214 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 347 KiB/s rd, 394 KiB/s wr, 116 op/s 2024-02-28T23:10:09.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:09 smithi184 ceph-mon[36198]: pgmap v68: 65 pgs: 65 active+clean; 214 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 347 KiB/s rd, 394 KiB/s wr, 116 op/s 2024-02-28T23:10:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:11 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:11.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:11 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:11.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:11 smithi159 ceph-mon[28802]: pgmap v69: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 395 KiB/s rd, 410 KiB/s wr, 137 op/s 2024-02-28T23:10:11.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:11 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:11.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:11 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:11.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:11 smithi184 ceph-mon[36198]: pgmap v69: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 395 KiB/s rd, 410 KiB/s wr, 137 op/s 2024-02-28T23:10:12.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.852+0000 7f8e9c800700 1 -- 172.21.15.159:0/3972061666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e94101db0 msgr2=0x7f8e94102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:12.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.852+0000 7f8e9c800700 1 --2- 172.21.15.159:0/3972061666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e94101db0 0x7f8e94102210 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8e84009910 tx=0x7f8e84009c20 comp rx=0 tx=0).stop 2024-02-28T23:10:12.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.852+0000 7f8e9c800700 1 -- 172.21.15.159:0/3972061666 shutdown_connections 2024-02-28T23:10:12.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.852+0000 7f8e9c800700 1 --2- 172.21.15.159:0/3972061666 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e94101db0 0x7f8e94102210 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:12.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.852+0000 7f8e9c800700 1 --2- 172.21.15.159:0/3972061666 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e94100bb0 0x7f8e94100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:12.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.852+0000 7f8e9c800700 1 -- 172.21.15.159:0/3972061666 >> 172.21.15.159:0/3972061666 conn(0x7f8e940fc110 msgr2=0x7f8e940fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:12.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.853+0000 7f8e9c800700 1 -- 172.21.15.159:0/3972061666 shutdown_connections 2024-02-28T23:10:12.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.853+0000 7f8e9c800700 1 -- 172.21.15.159:0/3972061666 wait complete. 2024-02-28T23:10:12.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.854+0000 7f8e9c800700 1 Processor -- start 2024-02-28T23:10:12.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.854+0000 7f8e9c800700 1 -- start start 2024-02-28T23:10:12.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.854+0000 7f8e9c800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e94100bb0 0x7f8e94198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:12.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.854+0000 7f8e9c800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e94101db0 0x7f8e94198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:12.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.854+0000 7f8e9c800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e941990d0 con 0x7f8e94101db0 2024-02-28T23:10:12.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.854+0000 7f8e9c800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e94199210 con 0x7f8e94100bb0 2024-02-28T23:10:12.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.855+0000 7f8e99400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e94101db0 0x7f8e94198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:12.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.855+0000 7f8e99400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e94101db0 0x7f8e94198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49666/0 (socket says 172.21.15.159:49666) 2024-02-28T23:10:12.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.855+0000 7f8e99400700 1 -- 172.21.15.159:0/3971140922 learned_addr learned my addr 172.21.15.159:0/3971140922 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:10:12.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.855+0000 7f8e99e00700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e94100bb0 0x7f8e94198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.855+0000 7f8e99400700 1 -- 172.21.15.159:0/3971140922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e94100bb0 msgr2=0x7f8e94198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.855+0000 7f8e99400700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e94100bb0 0x7f8e94198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.855+0000 7f8e99400700 1 -- 172.21.15.159:0/3971140922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e840095f0 con 0x7f8e94101db0 2024-02-28T23:10:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.855+0000 7f8e99e00700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e94100bb0 0x7f8e94198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:10:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.856+0000 7f8e99400700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e94101db0 0x7f8e94198ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400b5c0 tx=0x7f8e8400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.856+0000 7f8e8ea00700 1 -- 172.21.15.159:0/3971140922 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e8401d070 con 0x7f8e94101db0 2024-02-28T23:10:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.856+0000 7f8e8ea00700 1 -- 172.21.15.159:0/3971140922 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f8e8400f460 con 0x7f8e94101db0 2024-02-28T23:10:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.856+0000 7f8e9c800700 1 -- 172.21.15.159:0/3971140922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9419dc60 con 0x7f8e94101db0 2024-02-28T23:10:12.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.856+0000 7f8e8ea00700 1 -- 172.21.15.159:0/3971140922 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e84021640 con 0x7f8e94101db0 2024-02-28T23:10:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.856+0000 7f8e9c800700 1 -- 172.21.15.159:0/3971140922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9419e150 con 0x7f8e94101db0 2024-02-28T23:10:12.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.858+0000 7f8e9c800700 1 -- 172.21.15.159:0/3971140922 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e94105e90 con 0x7f8e94101db0 2024-02-28T23:10:12.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.860+0000 7f8e8ea00700 1 -- 172.21.15.159:0/3971140922 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f8e8400f5d0 con 0x7f8e94101db0 2024-02-28T23:10:12.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.860+0000 7f8e8ea00700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8e7c06d520 0x7f8e7c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:12.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.861+0000 7f8e8ea00700 1 -- 172.21.15.159:0/3971140922 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8e8408e300 con 0x7f8e94101db0 2024-02-28T23:10:12.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.861+0000 7f8e99e00700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8e7c06d520 0x7f8e7c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:12.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.861+0000 7f8e99e00700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8e7c06d520 0x7f8e7c06f9e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8e88005950 tx=0x7f8e880058e0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:12.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:12.866+0000 7f8e8ea00700 1 -- 172.21.15.159:0/3971140922 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f8e8405bb30 con 0x7f8e94101db0 2024-02-28T23:10:13.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.106+0000 7f8e9c800700 1 -- 172.21.15.159:0/3971140922 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e940611d0 con 0x7f8e7c06d520 2024-02-28T23:10:13.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.108+0000 7f8e8ea00700 1 -- 172.21.15.159:0/3971140922 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7f8e940611d0 con 0x7f8e7c06d520 2024-02-28T23:10:13.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.111+0000 7f8e9c800700 1 -- 172.21.15.159:0/3971140922 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8e7c06d520 msgr2=0x7f8e7c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:13.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.111+0000 7f8e9c800700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8e7c06d520 0x7f8e7c06f9e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8e88005950 tx=0x7f8e880058e0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.111+0000 7f8e9c800700 1 -- 172.21.15.159:0/3971140922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e94101db0 msgr2=0x7f8e94198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:13.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.111+0000 7f8e9c800700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e94101db0 0x7f8e94198ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400b5c0 tx=0x7f8e8400be20 comp rx=0 tx=0).stop 2024-02-28T23:10:13.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.111+0000 7f8e9c800700 1 -- 172.21.15.159:0/3971140922 shutdown_connections 2024-02-28T23:10:13.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.111+0000 7f8e9c800700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8e7c06d520 0x7f8e7c06f9e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.111+0000 7f8e9c800700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8e94100bb0 0x7f8e94198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.111+0000 7f8e9c800700 1 --2- 172.21.15.159:0/3971140922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8e94101db0 0x7f8e94198ab0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.111+0000 7f8e9c800700 1 -- 172.21.15.159:0/3971140922 >> 172.21.15.159:0/3971140922 conn(0x7f8e940fc110 msgr2=0x7f8e94102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:13.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.112+0000 7f8e9c800700 1 -- 172.21.15.159:0/3971140922 shutdown_connections 2024-02-28T23:10:13.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.112+0000 7f8e9c800700 1 -- 172.21.15.159:0/3971140922 wait complete. 2024-02-28T23:10:13.128 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:10:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.269+0000 7fe89f800700 1 -- 172.21.15.159:0/1492576361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe898100bc0 msgr2=0x7fe898100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.269+0000 7fe89f800700 1 --2- 172.21.15.159:0/1492576361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe898100bc0 0x7fe898100fe0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe88c009910 tx=0x7fe88c009c20 comp rx=0 tx=0).stop 2024-02-28T23:10:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.269+0000 7fe89f800700 1 -- 172.21.15.159:0/1492576361 shutdown_connections 2024-02-28T23:10:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.269+0000 7fe89f800700 1 --2- 172.21.15.159:0/1492576361 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe898101dc0 0x7fe898102220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.269+0000 7fe89f800700 1 --2- 172.21.15.159:0/1492576361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe898100bc0 0x7fe898100fe0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.269+0000 7fe89f800700 1 -- 172.21.15.159:0/1492576361 >> 172.21.15.159:0/1492576361 conn(0x7fe8980fc140 msgr2=0x7fe8980fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.269+0000 7fe89f800700 1 -- 172.21.15.159:0/1492576361 shutdown_connections 2024-02-28T23:10:13.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.269+0000 7fe89f800700 1 -- 172.21.15.159:0/1492576361 wait complete. 2024-02-28T23:10:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.270+0000 7fe89f800700 1 Processor -- start 2024-02-28T23:10:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.270+0000 7fe89f800700 1 -- start start 2024-02-28T23:10:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.270+0000 7fe89f800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe898100bc0 0x7fe8981985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.271+0000 7fe89f800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe898101dc0 0x7fe898198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.271+0000 7fe89f800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe898199150 con 0x7fe898100bc0 2024-02-28T23:10:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.271+0000 7fe89f800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe898199290 con 0x7fe898101dc0 2024-02-28T23:10:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.271+0000 7fe89ce00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe898100bc0 0x7fe8981985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.271+0000 7fe89ce00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe898100bc0 0x7fe8981985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49672/0 (socket says 172.21.15.159:49672) 2024-02-28T23:10:13.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.271+0000 7fe89ce00700 1 -- 172.21.15.159:0/3431769079 learned_addr learned my addr 172.21.15.159:0/3431769079 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:10:13.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.271+0000 7fe897e00700 1 --2- 172.21.15.159:0/3431769079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe898101dc0 0x7fe898198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:13.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.271+0000 7fe89ce00700 1 -- 172.21.15.159:0/3431769079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe898101dc0 msgr2=0x7fe898198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:13.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.271+0000 7fe89ce00700 1 --2- 172.21.15.159:0/3431769079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe898101dc0 0x7fe898198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.271+0000 7fe89ce00700 1 -- 172.21.15.159:0/3431769079 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe88c0095f0 con 0x7fe898100bc0 2024-02-28T23:10:13.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.272+0000 7fe89ce00700 1 --2- 172.21.15.159:0/3431769079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe898100bc0 0x7fe8981985f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00bd70 tx=0x7fe88c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:13.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.272+0000 7fe895600700 1 -- 172.21.15.159:0/3431769079 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe88c01d070 con 0x7fe898100bc0 2024-02-28T23:10:13.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.272+0000 7fe895600700 1 -- 172.21.15.159:0/3431769079 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fe88c00f460 con 0x7fe898100bc0 2024-02-28T23:10:13.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.272+0000 7fe895600700 1 -- 172.21.15.159:0/3431769079 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe88c021640 con 0x7fe898100bc0 2024-02-28T23:10:13.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.272+0000 7fe89f800700 1 -- 172.21.15.159:0/3431769079 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89819dce0 con 0x7fe898100bc0 2024-02-28T23:10:13.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.272+0000 7fe89f800700 1 -- 172.21.15.159:0/3431769079 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89819e200 con 0x7fe898100bc0 2024-02-28T23:10:13.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.274+0000 7fe89f800700 1 -- 172.21.15.159:0/3431769079 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe898105ea0 con 0x7fe898100bc0 2024-02-28T23:10:13.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.275+0000 7fe895600700 1 -- 172.21.15.159:0/3431769079 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7fe88c00fab0 con 0x7fe898100bc0 2024-02-28T23:10:13.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.276+0000 7fe895600700 1 --2- 172.21.15.159:0/3431769079 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fe88006d520 0x7fe88006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:13.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.276+0000 7fe895600700 1 -- 172.21.15.159:0/3431769079 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fe88c08e2d0 con 0x7fe898100bc0 2024-02-28T23:10:13.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.276+0000 7fe897e00700 1 --2- 172.21.15.159:0/3431769079 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fe88006d520 0x7fe88006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:13.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.277+0000 7fe897e00700 1 --2- 172.21.15.159:0/3431769079 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fe88006d520 0x7fe88006f9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe884006fd0 tx=0x7fe884008040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:13.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.280+0000 7fe895600700 1 -- 172.21.15.159:0/3431769079 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fe88c05bb60 con 0x7fe898100bc0 2024-02-28T23:10:13.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.545+0000 7fe89f800700 1 -- 172.21.15.159:0/3431769079 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe8980611d0 con 0x7fe88006d520 2024-02-28T23:10:13.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.547+0000 7fe895600700 1 -- 172.21.15.159:0/3431769079 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fe8980611d0 con 0x7fe88006d520 2024-02-28T23:10:13.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.550+0000 7fe89f800700 1 -- 172.21.15.159:0/3431769079 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fe88006d520 msgr2=0x7fe88006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:13.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.550+0000 7fe89f800700 1 --2- 172.21.15.159:0/3431769079 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fe88006d520 0x7fe88006f9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe884006fd0 tx=0x7fe884008040 comp rx=0 tx=0).stop 2024-02-28T23:10:13.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.550+0000 7fe89f800700 1 -- 172.21.15.159:0/3431769079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe898100bc0 msgr2=0x7fe8981985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:13.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.550+0000 7fe89f800700 1 --2- 172.21.15.159:0/3431769079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe898100bc0 0x7fe8981985f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00bd70 tx=0x7fe88c00be50 comp rx=0 tx=0).stop 2024-02-28T23:10:13.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.551+0000 7fe89f800700 1 -- 172.21.15.159:0/3431769079 shutdown_connections 2024-02-28T23:10:13.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.551+0000 7fe89f800700 1 --2- 172.21.15.159:0/3431769079 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fe88006d520 0x7fe88006f9e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.551+0000 7fe89f800700 1 --2- 172.21.15.159:0/3431769079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe898100bc0 0x7fe8981985f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.551+0000 7fe89f800700 1 --2- 172.21.15.159:0/3431769079 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe898101dc0 0x7fe898198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.551+0000 7fe89f800700 1 -- 172.21.15.159:0/3431769079 >> 172.21.15.159:0/3431769079 conn(0x7fe8980fc140 msgr2=0x7fe898102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:13.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.551+0000 7fe89f800700 1 -- 172.21.15.159:0/3431769079 shutdown_connections 2024-02-28T23:10:13.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.551+0000 7fe89f800700 1 -- 172.21.15.159:0/3431769079 wait complete. 2024-02-28T23:10:13.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.709+0000 7f200f800700 1 -- 172.21.15.159:0/2206437056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2008074dc0 msgr2=0x7f2008073220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:13.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.709+0000 7f200f800700 1 --2- 172.21.15.159:0/2206437056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2008074dc0 0x7f2008073220 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009910 tx=0x7f1ffc009c20 comp rx=0 tx=0).stop 2024-02-28T23:10:13.709 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:13 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:13.709 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:13 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:13.709 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:13 smithi159 ceph-mon[28802]: pgmap v70: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 253 KiB/s rd, 227 KiB/s wr, 77 op/s 2024-02-28T23:10:13.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.709+0000 7f200f800700 1 -- 172.21.15.159:0/2206437056 shutdown_connections 2024-02-28T23:10:13.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.709+0000 7f200f800700 1 --2- 172.21.15.159:0/2206437056 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20080737f0 0x7f2008073c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.709+0000 7f200f800700 1 --2- 172.21.15.159:0/2206437056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2008074dc0 0x7f2008073220 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.709+0000 7f200f800700 1 -- 172.21.15.159:0/2206437056 >> 172.21.15.159:0/2206437056 conn(0x7f20080fc110 msgr2=0x7f20080fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:13.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.710+0000 7f200f800700 1 -- 172.21.15.159:0/2206437056 shutdown_connections 2024-02-28T23:10:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.710+0000 7f200f800700 1 -- 172.21.15.159:0/2206437056 wait complete. 2024-02-28T23:10:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.711+0000 7f200f800700 1 Processor -- start 2024-02-28T23:10:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.711+0000 7f200f800700 1 -- start start 2024-02-28T23:10:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.711+0000 7f200f800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20080737f0 0x7f2008198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.711+0000 7f200f800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2008074dc0 0x7f2008198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.711+0000 7f200f800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20081990d0 con 0x7f2008074dc0 2024-02-28T23:10:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.711+0000 7f200f800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2008199210 con 0x7f20080737f0 2024-02-28T23:10:13.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.712+0000 7f2007e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2008074dc0 0x7f2008198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:13.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.712+0000 7f2007e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2008074dc0 0x7f2008198ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49696/0 (socket says 172.21.15.159:49696) 2024-02-28T23:10:13.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.712+0000 7f2007e00700 1 -- 172.21.15.159:0/98542338 learned_addr learned my addr 172.21.15.159:0/98542338 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:10:13.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.712+0000 7f200ce00700 1 --2- 172.21.15.159:0/98542338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20080737f0 0x7f2008198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:13.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.712+0000 7f2007e00700 1 -- 172.21.15.159:0/98542338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20080737f0 msgr2=0x7f2008198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:13.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.712+0000 7f2007e00700 1 --2- 172.21.15.159:0/98542338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20080737f0 0x7f2008198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.712+0000 7f2007e00700 1 -- 172.21.15.159:0/98542338 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ffc0095f0 con 0x7f2008074dc0 2024-02-28T23:10:13.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.712+0000 7f2007e00700 1 --2- 172.21.15.159:0/98542338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2008074dc0 0x7f2008198ab0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c8f0 tx=0x7f1ff400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:13.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.713+0000 7f2005600700 1 -- 172.21.15.159:0/98542338 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ff4007a70 con 0x7f2008074dc0 2024-02-28T23:10:13.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.713+0000 7f2005600700 1 -- 172.21.15.159:0/98542338 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f1ff4007bd0 con 0x7f2008074dc0 2024-02-28T23:10:13.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.713+0000 7f200f800700 1 -- 172.21.15.159:0/98542338 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200819dcc0 con 0x7f2008074dc0 2024-02-28T23:10:13.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.713+0000 7f2005600700 1 -- 172.21.15.159:0/98542338 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1ff4018630 con 0x7f2008074dc0 2024-02-28T23:10:13.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.713+0000 7f200f800700 1 -- 172.21.15.159:0/98542338 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200819e210 con 0x7f2008074dc0 2024-02-28T23:10:13.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.714+0000 7f200f800700 1 -- 172.21.15.159:0/98542338 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200810b920 con 0x7f2008074dc0 2024-02-28T23:10:13.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.715+0000 7f2005600700 1 -- 172.21.15.159:0/98542338 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f1ff400f450 con 0x7f2008074dc0 2024-02-28T23:10:13.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.716+0000 7f2005600700 1 --2- 172.21.15.159:0/98542338 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1ff006d520 0x7f1ff006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:13.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.716+0000 7f2005600700 1 -- 172.21.15.159:0/98542338 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1ff408cfe0 con 0x7f2008074dc0 2024-02-28T23:10:13.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.716+0000 7f200ce00700 1 --2- 172.21.15.159:0/98542338 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1ff006d520 0x7f1ff006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:13.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.717+0000 7f200ce00700 1 --2- 172.21.15.159:0/98542338 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1ff006d520 0x7f1ff006f9e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc006010 tx=0x7f1ffc00b580 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:13.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.721+0000 7f2005600700 1 -- 172.21.15.159:0/98542338 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f1ff40c0a70 con 0x7f2008074dc0 2024-02-28T23:10:13.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:13 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:13.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:13 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:13.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:13 smithi184 ceph-mon[36198]: pgmap v70: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 253 KiB/s rd, 227 KiB/s wr, 77 op/s 2024-02-28T23:10:13.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.955+0000 7f200f800700 1 -- 172.21.15.159:0/98542338 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f20081080b0 con 0x7f1ff006d520 2024-02-28T23:10:13.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.966+0000 7f2005600700 1 -- 172.21.15.159:0/98542338 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f20081080b0 con 0x7f1ff006d520 2024-02-28T23:10:13.966 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (12m) 3s ago 13m 14.3M - 0.25.0 c8568f914cd2 2b2966e86e70 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (14m) 3s ago 14m 8166k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (12m) 40s ago 12m 7721k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (14m) 3s ago 14m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (12m) 40s ago 12m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (11m) 3s ago 13m 76.0M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (6m) 3s ago 6m 155M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (6m) 3s ago 6m 90.9M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (6m) 40s ago 6m 15.0M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (6m) 40s ago 6m 14.9M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (2m) 3s ago 15m 501M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (80s) 40s ago 12m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (15m) 3s ago 16m 56.4M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:10:13.967 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (12m) 40s ago 12m 43.2M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:10:13.968 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (55s) 3s ago 14m 7054k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:10:13.968 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (46s) 40s ago 12m 2939k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:10:13.968 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (11m) 3s ago 11m 230M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:10:13.968 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (10m) 3s ago 10m 249M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:10:13.968 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (10m) 3s ago 10m 210M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:10:13.968 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (9m) 40s ago 9m 286M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:10:13.968 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (9m) 40s ago 9m 242M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:10:13.968 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (8m) 40s ago 8m 219M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:10:13.968 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (12s) 3s ago 13m 34.1M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:10:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.969+0000 7f200f800700 1 -- 172.21.15.159:0/98542338 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1ff006d520 msgr2=0x7f1ff006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.969+0000 7f200f800700 1 --2- 172.21.15.159:0/98542338 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1ff006d520 0x7f1ff006f9e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc006010 tx=0x7f1ffc00b580 comp rx=0 tx=0).stop 2024-02-28T23:10:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.969+0000 7f200f800700 1 -- 172.21.15.159:0/98542338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2008074dc0 msgr2=0x7f2008198ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.969+0000 7f200f800700 1 --2- 172.21.15.159:0/98542338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2008074dc0 0x7f2008198ab0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c8f0 tx=0x7f1ff400ccb0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.969+0000 7f200f800700 1 -- 172.21.15.159:0/98542338 shutdown_connections 2024-02-28T23:10:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.969+0000 7f200f800700 1 --2- 172.21.15.159:0/98542338 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1ff006d520 0x7f1ff006f9e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.969+0000 7f200f800700 1 --2- 172.21.15.159:0/98542338 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20080737f0 0x7f2008198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.969+0000 7f200f800700 1 --2- 172.21.15.159:0/98542338 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2008074dc0 0x7f2008198ab0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.969+0000 7f200f800700 1 -- 172.21.15.159:0/98542338 >> 172.21.15.159:0/98542338 conn(0x7f20080fc110 msgr2=0x7f2008106990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.969+0000 7f200f800700 1 -- 172.21.15.159:0/98542338 shutdown_connections 2024-02-28T23:10:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:13.969+0000 7f200f800700 1 -- 172.21.15.159:0/98542338 wait complete. 2024-02-28T23:10:14.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.124+0000 7fa64ee00700 1 -- 172.21.15.159:0/1033002643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa648101db0 msgr2=0x7fa648102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:14.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.124+0000 7fa64ee00700 1 --2- 172.21.15.159:0/1033002643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa648101db0 0x7fa648102210 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fa634009910 tx=0x7fa634009c20 comp rx=0 tx=0).stop 2024-02-28T23:10:14.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.124+0000 7fa64ee00700 1 -- 172.21.15.159:0/1033002643 shutdown_connections 2024-02-28T23:10:14.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.124+0000 7fa64ee00700 1 --2- 172.21.15.159:0/1033002643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa648101db0 0x7fa648102210 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.124+0000 7fa64ee00700 1 --2- 172.21.15.159:0/1033002643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa648100bb0 0x7fa648100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.124+0000 7fa64ee00700 1 -- 172.21.15.159:0/1033002643 >> 172.21.15.159:0/1033002643 conn(0x7fa6480fc110 msgr2=0x7fa6480fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:14.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.124+0000 7fa64ee00700 1 -- 172.21.15.159:0/1033002643 shutdown_connections 2024-02-28T23:10:14.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.124+0000 7fa64ee00700 1 -- 172.21.15.159:0/1033002643 wait complete. 2024-02-28T23:10:14.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.125+0000 7fa64ee00700 1 Processor -- start 2024-02-28T23:10:14.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.125+0000 7fa64ee00700 1 -- start start 2024-02-28T23:10:14.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.125+0000 7fa64ee00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa648100bb0 0x7fa6481985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:14.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.125+0000 7fa64ee00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa648101db0 0x7fa648198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:14.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.125+0000 7fa64ee00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa648199140 con 0x7fa648100bb0 2024-02-28T23:10:14.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.125+0000 7fa64ee00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa648199280 con 0x7fa648101db0 2024-02-28T23:10:14.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.126+0000 7fa647e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa648100bb0 0x7fa6481985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:14.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.126+0000 7fa647e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa648100bb0 0x7fa6481985e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49710/0 (socket says 172.21.15.159:49710) 2024-02-28T23:10:14.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.126+0000 7fa647e00700 1 -- 172.21.15.159:0/2965943885 learned_addr learned my addr 172.21.15.159:0/2965943885 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:10:14.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.126+0000 7fa647400700 1 --2- 172.21.15.159:0/2965943885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa648101db0 0x7fa648198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:14.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.126+0000 7fa647e00700 1 -- 172.21.15.159:0/2965943885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa648101db0 msgr2=0x7fa648198b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:14.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.126+0000 7fa647e00700 1 --2- 172.21.15.159:0/2965943885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa648101db0 0x7fa648198b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.126+0000 7fa647e00700 1 -- 172.21.15.159:0/2965943885 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6340095f0 con 0x7fa648100bb0 2024-02-28T23:10:14.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.127+0000 7fa647e00700 1 --2- 172.21.15.159:0/2965943885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa648100bb0 0x7fa6481985e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa63800b480 tx=0x7fa63800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:14.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.127+0000 7fa644c00700 1 -- 172.21.15.159:0/2965943885 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6380118c0 con 0x7fa648100bb0 2024-02-28T23:10:14.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.127+0000 7fa644c00700 1 -- 172.21.15.159:0/2965943885 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fa638010380 con 0x7fa648100bb0 2024-02-28T23:10:14.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.127+0000 7fa64ee00700 1 -- 172.21.15.159:0/2965943885 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa64819dd30 con 0x7fa648100bb0 2024-02-28T23:10:14.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.127+0000 7fa64ee00700 1 -- 172.21.15.159:0/2965943885 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa64819e2a0 con 0x7fa648100bb0 2024-02-28T23:10:14.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.128+0000 7fa644c00700 1 -- 172.21.15.159:0/2965943885 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa63800f4f0 con 0x7fa648100bb0 2024-02-28T23:10:14.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.128+0000 7fa64ee00700 1 -- 172.21.15.159:0/2965943885 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa648105e90 con 0x7fa648100bb0 2024-02-28T23:10:14.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.129+0000 7fa644c00700 1 -- 172.21.15.159:0/2965943885 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7fa6380104f0 con 0x7fa648100bb0 2024-02-28T23:10:14.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.130+0000 7fa644c00700 1 --2- 172.21.15.159:0/2965943885 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fa62c06d520 0x7fa62c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:14.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.130+0000 7fa644c00700 1 -- 172.21.15.159:0/2965943885 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fa63808cc20 con 0x7fa648100bb0 2024-02-28T23:10:14.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.130+0000 7fa647400700 1 --2- 172.21.15.159:0/2965943885 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fa62c06d520 0x7fa62c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:14.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.131+0000 7fa647400700 1 --2- 172.21.15.159:0/2965943885 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fa62c06d520 0x7fa62c06f9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa634006010 tx=0x7fa63400b540 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:14.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.135+0000 7fa644c00700 1 -- 172.21.15.159:0/2965943885 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fa63805a390 con 0x7fa648100bb0 2024-02-28T23:10:14.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.434+0000 7fa64ee00700 1 -- 172.21.15.159:0/2965943885 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa6481097b0 con 0x7fa648100bb0 2024-02-28T23:10:14.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.435+0000 7fa644c00700 1 -- 172.21.15.159:0/2965943885 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fa638059f20 con 0x7fa648100bb0 2024-02-28T23:10:14.434 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:10:14.434 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:10:14.435 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:10:14.436 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:10:14.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.438+0000 7fa64ee00700 1 -- 172.21.15.159:0/2965943885 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fa62c06d520 msgr2=0x7fa62c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:14.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.438+0000 7fa64ee00700 1 --2- 172.21.15.159:0/2965943885 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fa62c06d520 0x7fa62c06f9e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa634006010 tx=0x7fa63400b540 comp rx=0 tx=0).stop 2024-02-28T23:10:14.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.438+0000 7fa64ee00700 1 -- 172.21.15.159:0/2965943885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa648100bb0 msgr2=0x7fa6481985e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:14.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.438+0000 7fa64ee00700 1 --2- 172.21.15.159:0/2965943885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa648100bb0 0x7fa6481985e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa63800b480 tx=0x7fa63800b840 comp rx=0 tx=0).stop 2024-02-28T23:10:14.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.438+0000 7fa64ee00700 1 -- 172.21.15.159:0/2965943885 shutdown_connections 2024-02-28T23:10:14.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.438+0000 7fa64ee00700 1 --2- 172.21.15.159:0/2965943885 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fa62c06d520 0x7fa62c06f9e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.438+0000 7fa64ee00700 1 --2- 172.21.15.159:0/2965943885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa648100bb0 0x7fa6481985e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.438+0000 7fa64ee00700 1 --2- 172.21.15.159:0/2965943885 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa648101db0 0x7fa648198b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.438+0000 7fa64ee00700 1 -- 172.21.15.159:0/2965943885 >> 172.21.15.159:0/2965943885 conn(0x7fa6480fc110 msgr2=0x7fa648102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:14.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.438+0000 7fa64ee00700 1 -- 172.21.15.159:0/2965943885 shutdown_connections 2024-02-28T23:10:14.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.438+0000 7fa64ee00700 1 -- 172.21.15.159:0/2965943885 wait complete. 2024-02-28T23:10:14.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.592+0000 7fcb51c00700 1 -- 172.21.15.159:0/706732858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb4c102c20 msgr2=0x7fcb4c103040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:14.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.592+0000 7fcb51c00700 1 --2- 172.21.15.159:0/706732858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb4c102c20 0x7fcb4c103040 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009910 tx=0x7fcb3c009c20 comp rx=0 tx=0).stop 2024-02-28T23:10:14.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.592+0000 7fcb51c00700 1 -- 172.21.15.159:0/706732858 shutdown_connections 2024-02-28T23:10:14.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.592+0000 7fcb51c00700 1 --2- 172.21.15.159:0/706732858 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb4c103e20 0x7fcb4c104280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.592+0000 7fcb51c00700 1 --2- 172.21.15.159:0/706732858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb4c102c20 0x7fcb4c103040 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.592+0000 7fcb51c00700 1 -- 172.21.15.159:0/706732858 >> 172.21.15.159:0/706732858 conn(0x7fcb4c0fe1a0 msgr2=0x7fcb4c100600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:14.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.592+0000 7fcb51c00700 1 -- 172.21.15.159:0/706732858 shutdown_connections 2024-02-28T23:10:14.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.592+0000 7fcb51c00700 1 -- 172.21.15.159:0/706732858 wait complete. 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.593+0000 7fcb51c00700 1 Processor -- start 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.593+0000 7fcb51c00700 1 -- start start 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.593+0000 7fcb51c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb4c102c20 0x7fcb4c1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.593+0000 7fcb51c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb4c103e20 0x7fcb4c198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.594+0000 7fcb51c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c198f30 con 0x7fcb4c102c20 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.594+0000 7fcb51c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c199070 con 0x7fcb4c103e20 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.594+0000 7fcb4be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb4c102c20 0x7fcb4c1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.594+0000 7fcb4be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb4c102c20 0x7fcb4c1983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49728/0 (socket says 172.21.15.159:49728) 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.594+0000 7fcb4be00700 1 -- 172.21.15.159:0/3840794318 learned_addr learned my addr 172.21.15.159:0/3840794318 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.594+0000 7fcb4be00700 1 -- 172.21.15.159:0/3840794318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb4c103e20 msgr2=0x7fcb4c198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.594+0000 7fcb4b400700 1 --2- 172.21.15.159:0/3840794318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb4c103e20 0x7fcb4c198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.594+0000 7fcb4be00700 1 --2- 172.21.15.159:0/3840794318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb4c103e20 0x7fcb4c198910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.594+0000 7fcb4be00700 1 -- 172.21.15.159:0/3840794318 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0095f0 con 0x7fcb4c102c20 2024-02-28T23:10:14.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.595+0000 7fcb4be00700 1 --2- 172.21.15.159:0/3840794318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb4c102c20 0x7fcb4c1983d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00bda0 tx=0x7fcb3c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:14.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.595+0000 7fcb48c00700 1 -- 172.21.15.159:0/3840794318 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3c01d070 con 0x7fcb4c102c20 2024-02-28T23:10:14.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.595+0000 7fcb48c00700 1 -- 172.21.15.159:0/3840794318 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fcb3c004c50 con 0x7fcb4c102c20 2024-02-28T23:10:14.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.595+0000 7fcb51c00700 1 -- 172.21.15.159:0/3840794318 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c19dac0 con 0x7fcb4c102c20 2024-02-28T23:10:14.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.595+0000 7fcb48c00700 1 -- 172.21.15.159:0/3840794318 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb3c00f690 con 0x7fcb4c102c20 2024-02-28T23:10:14.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.595+0000 7fcb51c00700 1 -- 172.21.15.159:0/3840794318 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c19dfb0 con 0x7fcb4c102c20 2024-02-28T23:10:14.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.596+0000 7fcb51c00700 1 -- 172.21.15.159:0/3840794318 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb4c10b780 con 0x7fcb4c102c20 2024-02-28T23:10:14.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.597+0000 7fcb48c00700 1 -- 172.21.15.159:0/3840794318 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7fcb3c022a20 con 0x7fcb4c102c20 2024-02-28T23:10:14.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.598+0000 7fcb48c00700 1 --2- 172.21.15.159:0/3840794318 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fcb3006d520 0x7fcb3006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:14.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.598+0000 7fcb48c00700 1 -- 172.21.15.159:0/3840794318 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fcb3c08e6c0 con 0x7fcb4c102c20 2024-02-28T23:10:14.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.598+0000 7fcb4b400700 1 --2- 172.21.15.159:0/3840794318 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fcb3006d520 0x7fcb3006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:14.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.599+0000 7fcb4b400700 1 --2- 172.21.15.159:0/3840794318 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fcb3006d520 0x7fcb3006f9e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcb38005950 tx=0x7fcb38005cf0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:14.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.603+0000 7fcb48c00700 1 -- 172.21.15.159:0/3840794318 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fcb3c05bf80 con 0x7fcb4c102c20 2024-02-28T23:10:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:14 smithi159 ceph-mon[28802]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:14 smithi159 ceph-mon[28802]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:14.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:14 smithi159 ceph-mon[28802]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:14.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:14 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:10:14.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:14 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2965943885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.842+0000 7fcb51c00700 1 -- 172.21.15.159:0/3840794318 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb4c108770 con 0x7fcb3006d520 2024-02-28T23:10:14.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.844+0000 7fcb48c00700 1 -- 172.21.15.159:0/3840794318 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+367 (secure 0 0 0) 0x7fcb4c108770 con 0x7fcb3006d520 2024-02-28T23:10:14.844 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:10:14.844 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:10:14.844 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:10:14.844 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:10:14.844 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:10:14.844 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:10:14.844 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:10:14.844 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T23:10:14.845 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading prometheus daemons", 2024-02-28T23:10:14.845 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:10:14.845 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:10:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.847+0000 7fcb51c00700 1 -- 172.21.15.159:0/3840794318 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fcb3006d520 msgr2=0x7fcb3006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.847+0000 7fcb51c00700 1 --2- 172.21.15.159:0/3840794318 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fcb3006d520 0x7fcb3006f9e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fcb38005950 tx=0x7fcb38005cf0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.847+0000 7fcb51c00700 1 -- 172.21.15.159:0/3840794318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb4c102c20 msgr2=0x7fcb4c1983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.847+0000 7fcb51c00700 1 --2- 172.21.15.159:0/3840794318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb4c102c20 0x7fcb4c1983d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00bda0 tx=0x7fcb3c00be80 comp rx=0 tx=0).stop 2024-02-28T23:10:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.847+0000 7fcb51c00700 1 -- 172.21.15.159:0/3840794318 shutdown_connections 2024-02-28T23:10:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.847+0000 7fcb51c00700 1 --2- 172.21.15.159:0/3840794318 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fcb3006d520 0x7fcb3006f9e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.847+0000 7fcb51c00700 1 --2- 172.21.15.159:0/3840794318 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb4c102c20 0x7fcb4c1983d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.847+0000 7fcb51c00700 1 --2- 172.21.15.159:0/3840794318 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcb4c103e20 0x7fcb4c198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.847+0000 7fcb51c00700 1 -- 172.21.15.159:0/3840794318 >> 172.21.15.159:0/3840794318 conn(0x7fcb4c0fe1a0 msgr2=0x7fcb4c107050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.847+0000 7fcb51c00700 1 -- 172.21.15.159:0/3840794318 shutdown_connections 2024-02-28T23:10:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:14.847+0000 7fcb51c00700 1 -- 172.21.15.159:0/3840794318 wait complete. 2024-02-28T23:10:14.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:14 smithi184 ceph-mon[36198]: from='client.14786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:14.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:14 smithi184 ceph-mon[36198]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:14.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:14 smithi184 ceph-mon[36198]: from='client.14794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:14.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:14 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:10:14.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:14 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2965943885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:15 smithi159 ceph-mon[28802]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:15.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:15 smithi159 ceph-mon[28802]: pgmap v71: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 253 KiB/s rd, 227 KiB/s wr, 77 op/s 2024-02-28T23:10:15.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:15 smithi184 ceph-mon[36198]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:15.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:15 smithi184 ceph-mon[36198]: pgmap v71: 65 pgs: 65 active+clean; 213 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 253 KiB/s rd, 227 KiB/s wr, 77 op/s 2024-02-28T23:10:17.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:17 smithi184 ceph-mon[36198]: pgmap v72: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 253 KiB/s rd, 227 KiB/s wr, 79 op/s 2024-02-28T23:10:17.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:17 smithi159 ceph-mon[28802]: pgmap v72: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 253 KiB/s rd, 227 KiB/s wr, 79 op/s 2024-02-28T23:10:19.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:19.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:19.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:10:19.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:10:19.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:19.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:10:19.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:10:19.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.286 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.287 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:19 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:19.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:19.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:10:19.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:10:19.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:19.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:10:19.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:10:19.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:19.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:19 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:20.165 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:20 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:10:20.165 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:20 smithi159 ceph-mon[28802]: pgmap v73: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 17 KiB/s wr, 22 op/s 2024-02-28T23:10:20.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:20 smithi184 ceph-mon[36198]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-28T23:10:20.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:20 smithi184 ceph-mon[36198]: pgmap v73: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 17 KiB/s wr, 22 op/s 2024-02-28T23:10:22.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:22 smithi184 ceph-mon[36198]: Upgrade: Updating alertmanager.smithi159 2024-02-28T23:10:22.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:22 smithi184 ceph-mon[36198]: Deploying daemon alertmanager.smithi159 on smithi159 2024-02-28T23:10:22.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:22 smithi184 ceph-mon[36198]: pgmap v74: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 17 KiB/s wr, 23 op/s 2024-02-28T23:10:22.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:22 smithi159 ceph-mon[28802]: Upgrade: Updating alertmanager.smithi159 2024-02-28T23:10:22.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:22 smithi159 ceph-mon[28802]: Deploying daemon alertmanager.smithi159 on smithi159 2024-02-28T23:10:22.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:22 smithi159 ceph-mon[28802]: pgmap v74: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 49 KiB/s rd, 17 KiB/s wr, 23 op/s 2024-02-28T23:10:24.203 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:24 smithi159 ceph-mon[28802]: pgmap v75: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 426 B/s wr, 2 op/s 2024-02-28T23:10:24.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:24 smithi184 ceph-mon[36198]: pgmap v75: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 426 B/s wr, 2 op/s 2024-02-28T23:10:26.202 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:26 smithi159 ceph-mon[28802]: pgmap v76: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 426 B/s wr, 2 op/s 2024-02-28T23:10:26.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:26 smithi184 ceph-mon[36198]: pgmap v76: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 426 B/s wr, 2 op/s 2024-02-28T23:10:28.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:28 smithi184 ceph-mon[36198]: pgmap v77: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 426 B/s wr, 3 op/s 2024-02-28T23:10:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:28 smithi159 ceph-mon[28802]: pgmap v77: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 426 B/s wr, 3 op/s 2024-02-28T23:10:30.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:30.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:30.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:10:30.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:29 smithi184 ceph-mon[36198]: pgmap v78: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:30.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:10:30.113 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:30.113 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:30.113 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:10:30.113 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:29 smithi159 ceph-mon[28802]: pgmap v78: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:30.113 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:10:31.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:31 smithi159 ceph-mon[28802]: pgmap v79: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:31.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:31 smithi184 ceph-mon[36198]: pgmap v79: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:33.156 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:33 smithi159 ceph-mon[28802]: pgmap v80: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:33.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:33 smithi184 ceph-mon[36198]: pgmap v80: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:35.271 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:35 smithi159 ceph-mon[28802]: pgmap v81: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:35.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:35 smithi184 ceph-mon[36198]: pgmap v81: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:37.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:36 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:37.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:36 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:37.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:36 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:37.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:36 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:38.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:37 smithi184 ceph-mon[36198]: pgmap v82: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:38.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:37 smithi159 ceph-mon[28802]: pgmap v82: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:39.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:39 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:39.328 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:39 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:39.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:39 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:39.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:39 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:40.204 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:40 smithi159 ceph-mon[28802]: pgmap v83: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:40.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:40 smithi184 ceph-mon[36198]: pgmap v83: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:42.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:42 smithi184 ceph-mon[36198]: pgmap v84: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:42.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:42 smithi159 ceph-mon[28802]: pgmap v84: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:44.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: pgmap v85: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:44.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:44.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:44.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:10:44.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:10:44.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:44.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T23:10:44.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:10:44.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: pgmap v85: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:44.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:45.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.019+0000 7f5213200700 1 -- 172.21.15.159:0/1933154428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f520c103e40 msgr2=0x7f520c1042a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:45.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.020+0000 7f5213200700 1 --2- 172.21.15.159:0/1933154428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f520c103e40 0x7f520c1042a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009910 tx=0x7f51fc009c20 comp rx=0 tx=0).stop 2024-02-28T23:10:45.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.020+0000 7f5213200700 1 -- 172.21.15.159:0/1933154428 shutdown_connections 2024-02-28T23:10:45.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.020+0000 7f5213200700 1 --2- 172.21.15.159:0/1933154428 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f520c103e40 0x7f520c1042a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.020+0000 7f5213200700 1 --2- 172.21.15.159:0/1933154428 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f520c102c40 0x7f520c103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.020+0000 7f5213200700 1 -- 172.21.15.159:0/1933154428 >> 172.21.15.159:0/1933154428 conn(0x7f520c0fe1e0 msgr2=0x7f520c100620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:45.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.020+0000 7f5213200700 1 -- 172.21.15.159:0/1933154428 shutdown_connections 2024-02-28T23:10:45.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.020+0000 7f5213200700 1 -- 172.21.15.159:0/1933154428 wait complete. 2024-02-28T23:10:45.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.021+0000 7f5213200700 1 Processor -- start 2024-02-28T23:10:45.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.022+0000 7f5213200700 1 -- start start 2024-02-28T23:10:45.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.022+0000 7f5213200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f520c102c40 0x7f520c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:45.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.022+0000 7f5213200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f520c103e40 0x7f520c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:45.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.022+0000 7f5213200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c198fa0 con 0x7f520c102c40 2024-02-28T23:10:45.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.022+0000 7f5213200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c1990e0 con 0x7f520c103e40 2024-02-28T23:10:45.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.022+0000 7f5211e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f520c102c40 0x7f520c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:45.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.022+0000 7f5211e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f520c102c40 0x7f520c198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43346/0 (socket says 172.21.15.159:43346) 2024-02-28T23:10:45.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.022+0000 7f5211e00700 1 -- 172.21.15.159:0/3517408278 learned_addr learned my addr 172.21.15.159:0/3517408278 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:10:45.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.023+0000 7f5211400700 1 --2- 172.21.15.159:0/3517408278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f520c103e40 0x7f520c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:45.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.023+0000 7f5211e00700 1 -- 172.21.15.159:0/3517408278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f520c103e40 msgr2=0x7f520c198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:45.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.023+0000 7f5211e00700 1 --2- 172.21.15.159:0/3517408278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f520c103e40 0x7f520c198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.023+0000 7f5211e00700 1 -- 172.21.15.159:0/3517408278 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc0095f0 con 0x7f520c102c40 2024-02-28T23:10:45.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.023+0000 7f5211e00700 1 --2- 172.21.15.159:0/3517408278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f520c102c40 0x7f520c198440 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f520000b480 tx=0x7f520000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:45.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.024+0000 7f5206a00700 1 -- 172.21.15.159:0/3517408278 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52000118c0 con 0x7f520c102c40 2024-02-28T23:10:45.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.024+0000 7f5206a00700 1 -- 172.21.15.159:0/3517408278 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5200010380 con 0x7f520c102c40 2024-02-28T23:10:45.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.024+0000 7f5206a00700 1 -- 172.21.15.159:0/3517408278 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f520000f4f0 con 0x7f520c102c40 2024-02-28T23:10:45.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.024+0000 7f5213200700 1 -- 172.21.15.159:0/3517408278 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c19db90 con 0x7f520c102c40 2024-02-28T23:10:45.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.024+0000 7f5213200700 1 -- 172.21.15.159:0/3517408278 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c19e0e0 con 0x7f520c102c40 2024-02-28T23:10:45.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.026+0000 7f5213200700 1 -- 172.21.15.159:0/3517408278 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c10b840 con 0x7f520c102c40 2024-02-28T23:10:45.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.027+0000 7f5206a00700 1 -- 172.21.15.159:0/3517408278 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f52000104f0 con 0x7f520c102c40 2024-02-28T23:10:45.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.028+0000 7f5206a00700 1 --2- 172.21.15.159:0/3517408278 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f51f406d520 0x7f51f406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:45.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.028+0000 7f5206a00700 1 -- 172.21.15.159:0/3517408278 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f520008cf20 con 0x7f520c102c40 2024-02-28T23:10:45.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.028+0000 7f5211400700 1 --2- 172.21.15.159:0/3517408278 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f51f406d520 0x7f51f406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:45.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.029+0000 7f5211400700 1 --2- 172.21.15.159:0/3517408278 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f51f406d520 0x7f51f406f9e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00b5c0 tx=0x7f51fc005960 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:45.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.032+0000 7f5206a00700 1 -- 172.21.15.159:0/3517408278 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f520005a850 con 0x7f520c102c40 2024-02-28T23:10:45.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.280+0000 7f5213200700 1 -- 172.21.15.159:0/3517408278 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f520c108790 con 0x7f51f406d520 2024-02-28T23:10:45.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:45 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T23:10:45.279 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:45 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:10:45.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.281+0000 7f5206a00700 1 -- 172.21.15.159:0/3517408278 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f520c108790 con 0x7f51f406d520 2024-02-28T23:10:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.284+0000 7f5213200700 1 -- 172.21.15.159:0/3517408278 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f51f406d520 msgr2=0x7f51f406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.284+0000 7f5213200700 1 --2- 172.21.15.159:0/3517408278 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f51f406d520 0x7f51f406f9e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00b5c0 tx=0x7f51fc005960 comp rx=0 tx=0).stop 2024-02-28T23:10:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.284+0000 7f5213200700 1 -- 172.21.15.159:0/3517408278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f520c102c40 msgr2=0x7f520c198440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.284+0000 7f5213200700 1 --2- 172.21.15.159:0/3517408278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f520c102c40 0x7f520c198440 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f520000b480 tx=0x7f520000b840 comp rx=0 tx=0).stop 2024-02-28T23:10:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.284+0000 7f5213200700 1 -- 172.21.15.159:0/3517408278 shutdown_connections 2024-02-28T23:10:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.284+0000 7f5213200700 1 --2- 172.21.15.159:0/3517408278 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f51f406d520 0x7f51f406f9e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.284+0000 7f5213200700 1 --2- 172.21.15.159:0/3517408278 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f520c102c40 0x7f520c198440 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.284+0000 7f5213200700 1 --2- 172.21.15.159:0/3517408278 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f520c103e40 0x7f520c198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.284+0000 7f5213200700 1 -- 172.21.15.159:0/3517408278 >> 172.21.15.159:0/3517408278 conn(0x7f520c0fe1e0 msgr2=0x7f520c107070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.285+0000 7f5213200700 1 -- 172.21.15.159:0/3517408278 shutdown_connections 2024-02-28T23:10:45.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.285+0000 7f5213200700 1 -- 172.21.15.159:0/3517408278 wait complete. 2024-02-28T23:10:45.299 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:10:45.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:45 smithi184 ceph-mon[36198]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-28T23:10:45.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:45 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:10:45.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.442+0000 7f5281e00700 1 -- 172.21.15.159:0/704409419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c1014c0 msgr2=0x7f527c1038b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:45.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.442+0000 7f5281e00700 1 --2- 172.21.15.159:0/704409419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c1014c0 0x7f527c1038b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5270009910 tx=0x7f5270009c20 comp rx=0 tx=0).stop 2024-02-28T23:10:45.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.443+0000 7f5281e00700 1 -- 172.21.15.159:0/704409419 shutdown_connections 2024-02-28T23:10:45.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.443+0000 7f5281e00700 1 --2- 172.21.15.159:0/704409419 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f527c103df0 0x7f527c1061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.443+0000 7f5281e00700 1 --2- 172.21.15.159:0/704409419 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c1014c0 0x7f527c1038b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.443+0000 7f5281e00700 1 -- 172.21.15.159:0/704409419 >> 172.21.15.159:0/704409419 conn(0x7f527c0faed0 msgr2=0x7f527c0fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:45.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.443+0000 7f5281e00700 1 -- 172.21.15.159:0/704409419 shutdown_connections 2024-02-28T23:10:45.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.443+0000 7f5281e00700 1 -- 172.21.15.159:0/704409419 wait complete. 2024-02-28T23:10:45.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.444+0000 7f5281e00700 1 Processor -- start 2024-02-28T23:10:45.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.444+0000 7f5281e00700 1 -- start start 2024-02-28T23:10:45.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.444+0000 7f5281e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c1014c0 0x7f527c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:45.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.444+0000 7f5281e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f527c103df0 0x7f527c1988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:45.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.444+0000 7f5281e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c198f10 con 0x7f527c1014c0 2024-02-28T23:10:45.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.444+0000 7f5281e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f527c199050 con 0x7f527c103df0 2024-02-28T23:10:45.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.445+0000 7f5280a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c1014c0 0x7f527c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:45.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.445+0000 7f5280a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c1014c0 0x7f527c1983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43356/0 (socket says 172.21.15.159:43356) 2024-02-28T23:10:45.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.445+0000 7f5280a00700 1 -- 172.21.15.159:0/381912733 learned_addr learned my addr 172.21.15.159:0/381912733 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:10:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.445+0000 7f527be00700 1 --2- 172.21.15.159:0/381912733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f527c103df0 0x7f527c1988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.445+0000 7f5280a00700 1 -- 172.21.15.159:0/381912733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f527c103df0 msgr2=0x7f527c1988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.445+0000 7f5280a00700 1 --2- 172.21.15.159:0/381912733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f527c103df0 0x7f527c1988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.445+0000 7f5280a00700 1 -- 172.21.15.159:0/381912733 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52700095f0 con 0x7f527c1014c0 2024-02-28T23:10:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.446+0000 7f5280a00700 1 --2- 172.21.15.159:0/381912733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c1014c0 0x7f527c1983b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f527000b5c0 tx=0x7f527000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.446+0000 7f5279600700 1 -- 172.21.15.159:0/381912733 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f527001d070 con 0x7f527c1014c0 2024-02-28T23:10:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.446+0000 7f5279600700 1 -- 172.21.15.159:0/381912733 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f5270022470 con 0x7f527c1014c0 2024-02-28T23:10:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.446+0000 7f5281e00700 1 -- 172.21.15.159:0/381912733 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f527c19daa0 con 0x7f527c1014c0 2024-02-28T23:10:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.446+0000 7f5279600700 1 -- 172.21.15.159:0/381912733 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f527000f690 con 0x7f527c1014c0 2024-02-28T23:10:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.446+0000 7f5281e00700 1 -- 172.21.15.159:0/381912733 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f527c19df90 con 0x7f527c1014c0 2024-02-28T23:10:45.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.448+0000 7f5281e00700 1 -- 172.21.15.159:0/381912733 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f527c0fcaa0 con 0x7f527c1014c0 2024-02-28T23:10:45.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.448+0000 7f5279600700 1 -- 172.21.15.159:0/381912733 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f5270004b70 con 0x7f527c1014c0 2024-02-28T23:10:45.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.450+0000 7f5279600700 1 --2- 172.21.15.159:0/381912733 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f526406d520 0x7f526406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:45.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.451+0000 7f5279600700 1 -- 172.21.15.159:0/381912733 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f527008e7c0 con 0x7f527c1014c0 2024-02-28T23:10:45.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.451+0000 7f527be00700 1 --2- 172.21.15.159:0/381912733 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f526406d520 0x7f526406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:45.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.451+0000 7f527be00700 1 --2- 172.21.15.159:0/381912733 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f526406d520 0x7f526406f9e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5268005fd0 tx=0x7f526800a560 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:45.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.454+0000 7f5279600700 1 -- 172.21.15.159:0/381912733 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f527005c180 con 0x7f527c1014c0 2024-02-28T23:10:45.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.697+0000 7f5281e00700 1 -- 172.21.15.159:0/381912733 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f527c0611d0 con 0x7f526406d520 2024-02-28T23:10:45.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.698+0000 7f5279600700 1 -- 172.21.15.159:0/381912733 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f527c0611d0 con 0x7f526406d520 2024-02-28T23:10:45.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.701+0000 7f5281e00700 1 -- 172.21.15.159:0/381912733 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f526406d520 msgr2=0x7f526406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:45.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.701+0000 7f5281e00700 1 --2- 172.21.15.159:0/381912733 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f526406d520 0x7f526406f9e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5268005fd0 tx=0x7f526800a560 comp rx=0 tx=0).stop 2024-02-28T23:10:45.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.701+0000 7f5281e00700 1 -- 172.21.15.159:0/381912733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c1014c0 msgr2=0x7f527c1983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:45.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.701+0000 7f5281e00700 1 --2- 172.21.15.159:0/381912733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c1014c0 0x7f527c1983b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f527000b5c0 tx=0x7f527000be20 comp rx=0 tx=0).stop 2024-02-28T23:10:45.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.701+0000 7f5281e00700 1 -- 172.21.15.159:0/381912733 shutdown_connections 2024-02-28T23:10:45.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.701+0000 7f5281e00700 1 --2- 172.21.15.159:0/381912733 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f526406d520 0x7f526406f9e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.701+0000 7f5281e00700 1 --2- 172.21.15.159:0/381912733 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f527c1014c0 0x7f527c1983b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.701+0000 7f5281e00700 1 --2- 172.21.15.159:0/381912733 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f527c103df0 0x7f527c1988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.701+0000 7f5281e00700 1 -- 172.21.15.159:0/381912733 >> 172.21.15.159:0/381912733 conn(0x7f527c0faed0 msgr2=0x7f527c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:45.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.702+0000 7f5281e00700 1 -- 172.21.15.159:0/381912733 shutdown_connections 2024-02-28T23:10:45.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.702+0000 7f5281e00700 1 -- 172.21.15.159:0/381912733 wait complete. 2024-02-28T23:10:45.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.855+0000 7fbf3a000700 1 -- 172.21.15.159:0/2045153425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf34101fe0 msgr2=0x7fbf34102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:45.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.855+0000 7fbf3a000700 1 --2- 172.21.15.159:0/2045153425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf34101fe0 0x7fbf34102400 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbf28009910 tx=0x7fbf28009c20 comp rx=0 tx=0).stop 2024-02-28T23:10:45.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.855+0000 7fbf3a000700 1 -- 172.21.15.159:0/2045153425 shutdown_connections 2024-02-28T23:10:45.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.855+0000 7fbf3a000700 1 --2- 172.21.15.159:0/2045153425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf340fea60 0x7fbf340feee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.855+0000 7fbf3a000700 1 --2- 172.21.15.159:0/2045153425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf34101fe0 0x7fbf34102400 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.855+0000 7fbf3a000700 1 -- 172.21.15.159:0/2045153425 >> 172.21.15.159:0/2045153425 conn(0x7fbf340fa600 msgr2=0x7fbf340fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:45.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.855+0000 7fbf3a000700 1 -- 172.21.15.159:0/2045153425 shutdown_connections 2024-02-28T23:10:45.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.855+0000 7fbf3a000700 1 -- 172.21.15.159:0/2045153425 wait complete. 2024-02-28T23:10:45.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.856+0000 7fbf3a000700 1 Processor -- start 2024-02-28T23:10:45.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.856+0000 7fbf3a000700 1 -- start start 2024-02-28T23:10:45.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.857+0000 7fbf3a000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf340fea60 0x7fbf341983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:45.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.857+0000 7fbf3a000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf34101fe0 0x7fbf34198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:45.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.857+0000 7fbf3a000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf34198f30 con 0x7fbf340fea60 2024-02-28T23:10:45.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.857+0000 7fbf3a000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf34199070 con 0x7fbf34101fe0 2024-02-28T23:10:45.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.857+0000 7fbf38c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf340fea60 0x7fbf341983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:45.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.857+0000 7fbf38c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf340fea60 0x7fbf341983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43382/0 (socket says 172.21.15.159:43382) 2024-02-28T23:10:45.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.857+0000 7fbf38c00700 1 -- 172.21.15.159:0/791529739 learned_addr learned my addr 172.21.15.159:0/791529739 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:10:45.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.857+0000 7fbf33e00700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf34101fe0 0x7fbf34198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:45.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.858+0000 7fbf38c00700 1 -- 172.21.15.159:0/791529739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf34101fe0 msgr2=0x7fbf34198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:45.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.858+0000 7fbf38c00700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf34101fe0 0x7fbf34198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:45.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.858+0000 7fbf38c00700 1 -- 172.21.15.159:0/791529739 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf280095f0 con 0x7fbf340fea60 2024-02-28T23:10:45.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.858+0000 7fbf33e00700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf34101fe0 0x7fbf34198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:10:45.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.858+0000 7fbf38c00700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf340fea60 0x7fbf341983d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800bd70 tx=0x7fbf2800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:45.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.858+0000 7fbf31600700 1 -- 172.21.15.159:0/791529739 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf2801d070 con 0x7fbf340fea60 2024-02-28T23:10:45.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.858+0000 7fbf31600700 1 -- 172.21.15.159:0/791529739 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7fbf2800f460 con 0x7fbf340fea60 2024-02-28T23:10:45.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.858+0000 7fbf31600700 1 -- 172.21.15.159:0/791529739 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf28021640 con 0x7fbf340fea60 2024-02-28T23:10:45.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.858+0000 7fbf3a000700 1 -- 172.21.15.159:0/791529739 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf3419dac0 con 0x7fbf340fea60 2024-02-28T23:10:45.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.858+0000 7fbf3a000700 1 -- 172.21.15.159:0/791529739 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf3419dfb0 con 0x7fbf340fea60 2024-02-28T23:10:45.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.859+0000 7fbf3a000700 1 -- 172.21.15.159:0/791529739 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf34105e60 con 0x7fbf340fea60 2024-02-28T23:10:45.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.860+0000 7fbf31600700 1 -- 172.21.15.159:0/791529739 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7fbf2800fab0 con 0x7fbf340fea60 2024-02-28T23:10:45.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.861+0000 7fbf31600700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbf1c06d520 0x7fbf1c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:45.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.861+0000 7fbf31600700 1 -- 172.21.15.159:0/791529739 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fbf2808e370 con 0x7fbf340fea60 2024-02-28T23:10:45.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.861+0000 7fbf33e00700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbf1c06d520 0x7fbf1c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:45.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.862+0000 7fbf33e00700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbf1c06d520 0x7fbf1c06f9e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf20005fd0 tx=0x7fbf20005dc0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:45.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:45.866+0000 7fbf31600700 1 -- 172.21.15.159:0/791529739 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fbf2805bb60 con 0x7fbf340fea60 2024-02-28T23:10:46.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.098+0000 7fbf3a000700 1 -- 172.21.15.159:0/791529739 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fbf340611d0 con 0x7fbf1c06d520 2024-02-28T23:10:46.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.147+0000 7fbf31600700 1 -- 172.21.15.159:0/791529739 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fbf340611d0 con 0x7fbf1c06d520 2024-02-28T23:10:46.146 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:46 smithi159 ceph-mon[28802]: pgmap v86: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:46.146 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:10:46.146 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (18s) 10s ago 14m 13.5M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:10:46.147 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (14m) 10s ago 14m 8200k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:10:46.147 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (13m) 72s ago 13m 7721k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:10:46.147 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (14m) 10s ago 14m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:10:46.147 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (13m) 72s ago 13m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:10:46.147 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (12m) 10s ago 14m 75.8M - 9.4.7 954c08fa6188 2d6c5a3743c3 2024-02-28T23:10:46.147 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (7m) 10s ago 7m 150M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:10:46.147 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (7m) 10s ago 7m 86.7M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:10:46.147 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (7m) 72s ago 7m 15.0M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:10:46.147 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (7m) 72s ago 7m 14.9M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:10:46.147 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (3m) 10s ago 16m 501M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:10:46.148 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (112s) 72s ago 13m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:10:46.148 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (16m) 10s ago 16m 56.9M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:10:46.148 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (13m) 72s ago 13m 43.2M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:10:46.148 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (87s) 10s ago 14m 7201k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:10:46.148 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (78s) 72s ago 13m 2939k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:10:46.148 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (12m) 10s ago 12m 232M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:10:46.148 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (11m) 10s ago 11m 250M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:10:46.148 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (10m) 10s ago 10m 210M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:10:46.148 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (10m) 72s ago 10m 286M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:10:46.149 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (9m) 72s ago 9m 242M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:10:46.149 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (9m) 72s ago 9m 219M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:10:46.149 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (44s) 10s ago 13m 42.4M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:10:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.150+0000 7fbf3a000700 1 -- 172.21.15.159:0/791529739 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbf1c06d520 msgr2=0x7fbf1c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.150+0000 7fbf3a000700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbf1c06d520 0x7fbf1c06f9e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbf20005fd0 tx=0x7fbf20005dc0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.150+0000 7fbf3a000700 1 -- 172.21.15.159:0/791529739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf340fea60 msgr2=0x7fbf341983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.150+0000 7fbf3a000700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf340fea60 0x7fbf341983d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbf2800bd70 tx=0x7fbf2800be50 comp rx=0 tx=0).stop 2024-02-28T23:10:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.150+0000 7fbf3a000700 1 -- 172.21.15.159:0/791529739 shutdown_connections 2024-02-28T23:10:46.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.150+0000 7fbf3a000700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fbf1c06d520 0x7fbf1c06f9e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.150+0000 7fbf3a000700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf340fea60 0x7fbf341983d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.150+0000 7fbf3a000700 1 --2- 172.21.15.159:0/791529739 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf34101fe0 0x7fbf34198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.150+0000 7fbf3a000700 1 -- 172.21.15.159:0/791529739 >> 172.21.15.159:0/791529739 conn(0x7fbf340fa600 msgr2=0x7fbf34102fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:46.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.151+0000 7fbf3a000700 1 -- 172.21.15.159:0/791529739 shutdown_connections 2024-02-28T23:10:46.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.151+0000 7fbf3a000700 1 -- 172.21.15.159:0/791529739 wait complete. 2024-02-28T23:10:46.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.302+0000 7f72fc200700 1 -- 172.21.15.159:0/1936440645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f4101db0 msgr2=0x7f72f4102210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:46.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.302+0000 7f72fc200700 1 --2- 172.21.15.159:0/1936440645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f4101db0 0x7f72f4102210 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f72e0009910 tx=0x7f72e0009c20 comp rx=0 tx=0).stop 2024-02-28T23:10:46.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.302+0000 7f72fc200700 1 -- 172.21.15.159:0/1936440645 shutdown_connections 2024-02-28T23:10:46.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.302+0000 7f72fc200700 1 --2- 172.21.15.159:0/1936440645 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f4101db0 0x7f72f4102210 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.302+0000 7f72fc200700 1 --2- 172.21.15.159:0/1936440645 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72f4100bb0 0x7f72f4100fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.302+0000 7f72fc200700 1 -- 172.21.15.159:0/1936440645 >> 172.21.15.159:0/1936440645 conn(0x7f72f40fc110 msgr2=0x7f72f40fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:46.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.302+0000 7f72fc200700 1 -- 172.21.15.159:0/1936440645 shutdown_connections 2024-02-28T23:10:46.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.302+0000 7f72fc200700 1 -- 172.21.15.159:0/1936440645 wait complete. 2024-02-28T23:10:46.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.303+0000 7f72fc200700 1 Processor -- start 2024-02-28T23:10:46.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.304+0000 7f72fc200700 1 -- start start 2024-02-28T23:10:46.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.304+0000 7f72fc200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72f4100bb0 0x7f72f41985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:46.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.304+0000 7f72fc200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f4101db0 0x7f72f4198b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:46.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.304+0000 7f72fc200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4199140 con 0x7f72f4101db0 2024-02-28T23:10:46.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.304+0000 7f72fc200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f4199280 con 0x7f72f4100bb0 2024-02-28T23:10:46.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.304+0000 7f72f8e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f4101db0 0x7f72f4198b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:46.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.304+0000 7f72f8e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f4101db0 0x7f72f4198b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43390/0 (socket says 172.21.15.159:43390) 2024-02-28T23:10:46.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.304+0000 7f72f8e00700 1 -- 172.21.15.159:0/2025401409 learned_addr learned my addr 172.21.15.159:0/2025401409 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:10:46.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.305+0000 7f72f9800700 1 --2- 172.21.15.159:0/2025401409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72f4100bb0 0x7f72f41985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:46.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.305+0000 7f72f8e00700 1 -- 172.21.15.159:0/2025401409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72f4100bb0 msgr2=0x7f72f41985e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:46.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.305+0000 7f72f8e00700 1 --2- 172.21.15.159:0/2025401409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72f4100bb0 0x7f72f41985e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.305+0000 7f72f8e00700 1 -- 172.21.15.159:0/2025401409 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e00095f0 con 0x7f72f4101db0 2024-02-28T23:10:46.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.305+0000 7f72f8e00700 1 --2- 172.21.15.159:0/2025401409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f4101db0 0x7f72f4198b20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f72e000b5c0 tx=0x7f72e000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:46.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.305+0000 7f72f2000700 1 -- 172.21.15.159:0/2025401409 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e001d070 con 0x7f72f4101db0 2024-02-28T23:10:46.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.305+0000 7f72f2000700 1 -- 172.21.15.159:0/2025401409 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f72e0022470 con 0x7f72f4101db0 2024-02-28T23:10:46.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.305+0000 7f72f2000700 1 -- 172.21.15.159:0/2025401409 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72e000f690 con 0x7f72f4101db0 2024-02-28T23:10:46.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.305+0000 7f72fc200700 1 -- 172.21.15.159:0/2025401409 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f419dcd0 con 0x7f72f4101db0 2024-02-28T23:10:46.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.306+0000 7f72fc200700 1 -- 172.21.15.159:0/2025401409 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f419e240 con 0x7f72f4101db0 2024-02-28T23:10:46.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.307+0000 7f72fc200700 1 -- 172.21.15.159:0/2025401409 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f4105e90 con 0x7f72f4101db0 2024-02-28T23:10:46.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.308+0000 7f72f2000700 1 -- 172.21.15.159:0/2025401409 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f72e0004b70 con 0x7f72f4101db0 2024-02-28T23:10:46.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.309+0000 7f72f2000700 1 --2- 172.21.15.159:0/2025401409 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f72dc06d520 0x7f72dc06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:46.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.309+0000 7f72f2000700 1 -- 172.21.15.159:0/2025401409 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f72e008e6d0 con 0x7f72f4101db0 2024-02-28T23:10:46.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.309+0000 7f72f9800700 1 --2- 172.21.15.159:0/2025401409 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f72dc06d520 0x7f72dc06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:46.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.310+0000 7f72f9800700 1 --2- 172.21.15.159:0/2025401409 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f72dc06d520 0x7f72dc06f9e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f72e8006fd0 tx=0x7f72e8008040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:46.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.313+0000 7f72f2000700 1 -- 172.21.15.159:0/2025401409 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f72e005c090 con 0x7f72f4101db0 2024-02-28T23:10:46.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:46 smithi184 ceph-mon[36198]: pgmap v86: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:46.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.606+0000 7f72fc200700 1 -- 172.21.15.159:0/2025401409 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f72f402cc70 con 0x7f72f4101db0 2024-02-28T23:10:46.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.607+0000 7f72f2000700 1 -- 172.21.15.159:0/2025401409 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f72e005bc20 con 0x7f72f4101db0 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:10:46.606 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:10:46.607 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-28T23:10:46.607 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:10:46.607 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:10:46.607 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:10:46.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.610+0000 7f72fc200700 1 -- 172.21.15.159:0/2025401409 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f72dc06d520 msgr2=0x7f72dc06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:46.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.610+0000 7f72fc200700 1 --2- 172.21.15.159:0/2025401409 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f72dc06d520 0x7f72dc06f9e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f72e8006fd0 tx=0x7f72e8008040 comp rx=0 tx=0).stop 2024-02-28T23:10:46.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.610+0000 7f72fc200700 1 -- 172.21.15.159:0/2025401409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f4101db0 msgr2=0x7f72f4198b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:46.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.610+0000 7f72fc200700 1 --2- 172.21.15.159:0/2025401409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f4101db0 0x7f72f4198b20 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f72e000b5c0 tx=0x7f72e000be20 comp rx=0 tx=0).stop 2024-02-28T23:10:46.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.610+0000 7f72fc200700 1 -- 172.21.15.159:0/2025401409 shutdown_connections 2024-02-28T23:10:46.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.610+0000 7f72fc200700 1 --2- 172.21.15.159:0/2025401409 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f72dc06d520 0x7f72dc06f9e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.610+0000 7f72fc200700 1 --2- 172.21.15.159:0/2025401409 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f72f4100bb0 0x7f72f41985e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.610+0000 7f72fc200700 1 --2- 172.21.15.159:0/2025401409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f72f4101db0 0x7f72f4198b20 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.610+0000 7f72fc200700 1 -- 172.21.15.159:0/2025401409 >> 172.21.15.159:0/2025401409 conn(0x7f72f40fc110 msgr2=0x7f72f4102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:46.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.610+0000 7f72fc200700 1 -- 172.21.15.159:0/2025401409 shutdown_connections 2024-02-28T23:10:46.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.610+0000 7f72fc200700 1 -- 172.21.15.159:0/2025401409 wait complete. 2024-02-28T23:10:46.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.761+0000 7f3638e00700 1 -- 172.21.15.159:0/818195304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36340ffdf0 msgr2=0x7f3634100270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:46.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.761+0000 7f3638e00700 1 --2- 172.21.15.159:0/818195304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36340ffdf0 0x7f3634100270 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3620009910 tx=0x7f3620009c20 comp rx=0 tx=0).stop 2024-02-28T23:10:46.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.761+0000 7f3638e00700 1 -- 172.21.15.159:0/818195304 shutdown_connections 2024-02-28T23:10:46.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.761+0000 7f3638e00700 1 --2- 172.21.15.159:0/818195304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36340ffdf0 0x7f3634100270 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.761+0000 7f3638e00700 1 --2- 172.21.15.159:0/818195304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36340ff490 0x7f36340ff8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.761+0000 7f3638e00700 1 -- 172.21.15.159:0/818195304 >> 172.21.15.159:0/818195304 conn(0x7f36340fb030 msgr2=0x7f36340fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:46.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.761+0000 7f3638e00700 1 -- 172.21.15.159:0/818195304 shutdown_connections 2024-02-28T23:10:46.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.762+0000 7f3638e00700 1 -- 172.21.15.159:0/818195304 wait complete. 2024-02-28T23:10:46.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.763+0000 7f3638e00700 1 Processor -- start 2024-02-28T23:10:46.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.763+0000 7f3638e00700 1 -- start start 2024-02-28T23:10:46.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.763+0000 7f3638e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36340ff490 0x7f3634198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:46.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.763+0000 7f3638e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36340ffdf0 0x7f3634198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:46.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.763+0000 7f3638e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3634199080 con 0x7f36340ffdf0 2024-02-28T23:10:46.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.763+0000 7f3638e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36341991c0 con 0x7f36340ff490 2024-02-28T23:10:46.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.763+0000 7f3631400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36340ffdf0 0x7f3634198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:46.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.764+0000 7f3631400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36340ffdf0 0x7f3634198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43416/0 (socket says 172.21.15.159:43416) 2024-02-28T23:10:46.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.764+0000 7f3631400700 1 -- 172.21.15.159:0/65642559 learned_addr learned my addr 172.21.15.159:0/65642559 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:10:46.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.764+0000 7f3631400700 1 -- 172.21.15.159:0/65642559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36340ff490 msgr2=0x7f3634198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:46.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.764+0000 7f3631e00700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36340ff490 0x7f3634198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:46.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.764+0000 7f3631400700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36340ff490 0x7f3634198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:46.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.764+0000 7f3631400700 1 -- 172.21.15.159:0/65642559 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36200095f0 con 0x7f36340ffdf0 2024-02-28T23:10:46.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.764+0000 7f3631e00700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36340ff490 0x7f3634198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:10:46.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.765+0000 7f3631400700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36340ffdf0 0x7f3634198a60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3620005b40 tx=0x7f362000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:46.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.765+0000 7f362aa00700 1 -- 172.21.15.159:0/65642559 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362001d070 con 0x7f36340ffdf0 2024-02-28T23:10:46.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.765+0000 7f362aa00700 1 -- 172.21.15.159:0/65642559 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3620022470 con 0x7f36340ffdf0 2024-02-28T23:10:46.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.765+0000 7f362aa00700 1 -- 172.21.15.159:0/65642559 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f362000f690 con 0x7f36340ffdf0 2024-02-28T23:10:46.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.765+0000 7f3638e00700 1 -- 172.21.15.159:0/65642559 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363419dc10 con 0x7f36340ffdf0 2024-02-28T23:10:46.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.765+0000 7f3638e00700 1 -- 172.21.15.159:0/65642559 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363419e100 con 0x7f36340ffdf0 2024-02-28T23:10:46.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.767+0000 7f3638e00700 1 -- 172.21.15.159:0/65642559 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363410b910 con 0x7f36340ffdf0 2024-02-28T23:10:46.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.768+0000 7f362aa00700 1 -- 172.21.15.159:0/65642559 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f36200225e0 con 0x7f36340ffdf0 2024-02-28T23:10:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.769+0000 7f362aa00700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f361806d520 0x7f361806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:10:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.769+0000 7f362aa00700 1 -- 172.21.15.159:0/65642559 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f362008e6f0 con 0x7f36340ffdf0 2024-02-28T23:10:46.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.769+0000 7f3631e00700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f361806d520 0x7f361806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:10:46.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.770+0000 7f3631e00700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f361806d520 0x7f361806f9e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3624005fd0 tx=0x7f3624005dc0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:10:46.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:46.774+0000 7f362aa00700 1 -- 172.21.15.159:0/65642559 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f362005c020 con 0x7f36340ffdf0 2024-02-28T23:10:47.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.036+0000 7f3638e00700 1 -- 172.21.15.159:0/65642559 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f36341091e0 con 0x7f361806d520 2024-02-28T23:10:47.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.040+0000 7f362aa00700 1 -- 172.21.15.159:0/65642559 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f36341091e0 con 0x7f361806d520 2024-02-28T23:10:47.039 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:10:47.039 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:10:47.039 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:10:47.039 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:10:47.039 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:10:47.039 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:10:47.039 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:10:47.039 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T23:10:47.040 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading grafana daemons", 2024-02-28T23:10:47.040 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:10:47.040 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:10:47.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.043+0000 7f3638e00700 1 -- 172.21.15.159:0/65642559 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f361806d520 msgr2=0x7f361806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:47.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.043+0000 7f3638e00700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f361806d520 0x7f361806f9e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3624005fd0 tx=0x7f3624005dc0 comp rx=0 tx=0).stop 2024-02-28T23:10:47.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.043+0000 7f3638e00700 1 -- 172.21.15.159:0/65642559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36340ffdf0 msgr2=0x7f3634198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:10:47.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.043+0000 7f3638e00700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36340ffdf0 0x7f3634198a60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3620005b40 tx=0x7f362000be20 comp rx=0 tx=0).stop 2024-02-28T23:10:47.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.044+0000 7f3638e00700 1 -- 172.21.15.159:0/65642559 shutdown_connections 2024-02-28T23:10:47.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.044+0000 7f3638e00700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f361806d520 0x7f361806f9e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:47.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.044+0000 7f3638e00700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f36340ff490 0x7f3634198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:47.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.044+0000 7f3638e00700 1 --2- 172.21.15.159:0/65642559 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36340ffdf0 0x7f3634198a60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:10:47.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.044+0000 7f3638e00700 1 -- 172.21.15.159:0/65642559 >> 172.21.15.159:0/65642559 conn(0x7f36340fb030 msgr2=0x7f3634107ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:10:47.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.044+0000 7f3638e00700 1 -- 172.21.15.159:0/65642559 shutdown_connections 2024-02-28T23:10:47.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:10:47.044+0000 7f3638e00700 1 -- 172.21.15.159:0/65642559 wait complete. 2024-02-28T23:10:47.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:47 smithi184 ceph-mon[36198]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:47.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:47 smithi184 ceph-mon[36198]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:47.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:47 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2025401409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:47.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:47 smithi159 ceph-mon[28802]: from='client.14806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:47.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:47 smithi159 ceph-mon[28802]: from='client.14810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:47.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:47 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2025401409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:10:48.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:48 smithi184 ceph-mon[36198]: Upgrade: Updating grafana.smithi159 2024-02-28T23:10:48.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:48 smithi184 ceph-mon[36198]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:48.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:48 smithi184 ceph-mon[36198]: Deploying daemon grafana.smithi159 on smithi159 2024-02-28T23:10:48.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:48 smithi184 ceph-mon[36198]: pgmap v87: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:48.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:48 smithi184 ceph-mon[36198]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:48 smithi159 ceph-mon[28802]: Upgrade: Updating grafana.smithi159 2024-02-28T23:10:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:48 smithi159 ceph-mon[28802]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:48 smithi159 ceph-mon[28802]: Deploying daemon grafana.smithi159 on smithi159 2024-02-28T23:10:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:48 smithi159 ceph-mon[28802]: pgmap v87: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:48.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:48 smithi159 ceph-mon[28802]: from='client.14822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:10:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:49 smithi159 ceph-mon[28802]: pgmap v88: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:49.838 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:49 smithi184 ceph-mon[36198]: pgmap v88: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:51.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:51 smithi184 ceph-mon[36198]: pgmap v89: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:51.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:51 smithi159 ceph-mon[28802]: pgmap v89: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:53.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:53 smithi184 ceph-mon[36198]: pgmap v90: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:53.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:53 smithi159 ceph-mon[28802]: pgmap v90: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:55.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:55 smithi184 ceph-mon[36198]: pgmap v91: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:55.396 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:55 smithi159 ceph-mon[28802]: pgmap v91: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:57.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:57 smithi184 ceph-mon[36198]: pgmap v92: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:57.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:57 smithi159 ceph-mon[28802]: pgmap v92: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:10:59.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:59 smithi159 ceph-mon[28802]: pgmap v93: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:59.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:10:59 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:10:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:59 smithi184 ceph-mon[36198]: pgmap v93: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:10:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:10:59 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:11:01.239 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:01 smithi159 ceph-mon[28802]: pgmap v94: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:01.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:01 smithi184 ceph-mon[36198]: pgmap v94: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:03.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:03 smithi184 ceph-mon[36198]: pgmap v95: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:03.408 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:03 smithi159 ceph-mon[28802]: pgmap v95: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:05.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:05 smithi184 ceph-mon[36198]: pgmap v96: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:05 smithi159 ceph-mon[28802]: pgmap v96: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:08.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:07 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:08.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:07 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:08.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:07 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:11:08.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:07 smithi159 ceph-mon[28802]: pgmap v97: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:08.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:07 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:08.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:07 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:08.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:07 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:11:08.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:07 smithi184 ceph-mon[36198]: pgmap v97: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:09.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:09 smithi184 ceph-mon[36198]: pgmap v98: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:09.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:09 smithi159 ceph-mon[28802]: pgmap v98: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:11.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:11 smithi184 ceph-mon[36198]: pgmap v99: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:11.359 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:11 smithi159 ceph-mon[28802]: pgmap v99: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:13.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:13 smithi184 ceph-mon[36198]: pgmap v100: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:13.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:13 smithi159 ceph-mon[28802]: pgmap v100: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:14 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:11:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:14 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:14 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:14.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:14 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:11:14.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:14 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:14.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:14 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:15.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:15 smithi184 ceph-mon[36198]: pgmap v101: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:15.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:15 smithi159 ceph-mon[28802]: pgmap v101: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:17.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.207+0000 7ffb6dc00700 1 -- 172.21.15.159:0/2946902642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb68101dc0 msgr2=0x7ffb68102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:17.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.207+0000 7ffb6dc00700 1 --2- 172.21.15.159:0/2946902642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb68101dc0 0x7ffb68102220 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ffb50009910 tx=0x7ffb50009c20 comp rx=0 tx=0).stop 2024-02-28T23:11:17.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.207+0000 7ffb6dc00700 1 -- 172.21.15.159:0/2946902642 shutdown_connections 2024-02-28T23:11:17.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.207+0000 7ffb6dc00700 1 --2- 172.21.15.159:0/2946902642 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb68101dc0 0x7ffb68102220 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.207+0000 7ffb6dc00700 1 --2- 172.21.15.159:0/2946902642 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb68100bc0 0x7ffb68100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.207+0000 7ffb6dc00700 1 -- 172.21.15.159:0/2946902642 >> 172.21.15.159:0/2946902642 conn(0x7ffb680fc140 msgr2=0x7ffb680fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:17.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.207+0000 7ffb6dc00700 1 -- 172.21.15.159:0/2946902642 shutdown_connections 2024-02-28T23:11:17.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.207+0000 7ffb6dc00700 1 -- 172.21.15.159:0/2946902642 wait complete. 2024-02-28T23:11:17.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.208+0000 7ffb6dc00700 1 Processor -- start 2024-02-28T23:11:17.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.208+0000 7ffb6dc00700 1 -- start start 2024-02-28T23:11:17.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.209+0000 7ffb6dc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb68100bc0 0x7ffb68196370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.209+0000 7ffb6dc00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb68101dc0 0x7ffb681968b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.209+0000 7ffb6dc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb68196e40 con 0x7ffb68100bc0 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.209+0000 7ffb6dc00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb68196f80 con 0x7ffb68101dc0 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.209+0000 7ffb66a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb68100bc0 0x7ffb68196370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.209+0000 7ffb66a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb68100bc0 0x7ffb68196370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60574/0 (socket says 172.21.15.159:60574) 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.209+0000 7ffb66a00700 1 -- 172.21.15.159:0/1518979931 learned_addr learned my addr 172.21.15.159:0/1518979931 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.209+0000 7ffb5fe00700 1 --2- 172.21.15.159:0/1518979931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb68101dc0 0x7ffb681968b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.209+0000 7ffb66a00700 1 -- 172.21.15.159:0/1518979931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb68101dc0 msgr2=0x7ffb681968b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.209+0000 7ffb66a00700 1 --2- 172.21.15.159:0/1518979931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb68101dc0 0x7ffb681968b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.209+0000 7ffb66a00700 1 -- 172.21.15.159:0/1518979931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb500095f0 con 0x7ffb68100bc0 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.210+0000 7ffb66a00700 1 --2- 172.21.15.159:0/1518979931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb68100bc0 0x7ffb68196370 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c910 tx=0x7ffb5800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.210+0000 7ffb5f400700 1 -- 172.21.15.159:0/1518979931 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb580041f0 con 0x7ffb68100bc0 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.210+0000 7ffb5f400700 1 -- 172.21.15.159:0/1518979931 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7ffb58007db0 con 0x7ffb68100bc0 2024-02-28T23:11:17.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.210+0000 7ffb6dc00700 1 -- 172.21.15.159:0/1518979931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6819ba40 con 0x7ffb68100bc0 2024-02-28T23:11:17.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.210+0000 7ffb5f400700 1 -- 172.21.15.159:0/1518979931 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb58003d60 con 0x7ffb68100bc0 2024-02-28T23:11:17.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.210+0000 7ffb6dc00700 1 -- 172.21.15.159:0/1518979931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6819bf60 con 0x7ffb68100bc0 2024-02-28T23:11:17.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.212+0000 7ffb6dc00700 1 -- 172.21.15.159:0/1518979931 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb68109720 con 0x7ffb68100bc0 2024-02-28T23:11:17.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.212+0000 7ffb5f400700 1 -- 172.21.15.159:0/1518979931 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7ffb58007900 con 0x7ffb68100bc0 2024-02-28T23:11:17.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.214+0000 7ffb5f400700 1 --2- 172.21.15.159:0/1518979931 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ffb4c06d520 0x7ffb4c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:17.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.214+0000 7ffb5f400700 1 -- 172.21.15.159:0/1518979931 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ffb5808cc90 con 0x7ffb68100bc0 2024-02-28T23:11:17.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.214+0000 7ffb5fe00700 1 --2- 172.21.15.159:0/1518979931 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ffb4c06d520 0x7ffb4c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:17.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.215+0000 7ffb5fe00700 1 --2- 172.21.15.159:0/1518979931 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ffb4c06d520 0x7ffb4c06f9e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000b5c0 tx=0x7ffb50005960 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:17.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.219+0000 7ffb5f400700 1 -- 172.21.15.159:0/1518979931 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7ffb5805a4a0 con 0x7ffb68100bc0 2024-02-28T23:11:17.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.466+0000 7ffb6dc00700 1 -- 172.21.15.159:0/1518979931 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffb68106710 con 0x7ffb4c06d520 2024-02-28T23:11:17.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:17 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:17.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:17 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:17.466 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:17 smithi159 ceph-mon[28802]: pgmap v102: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:17.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.468+0000 7ffb5f400700 1 -- 172.21.15.159:0/1518979931 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7ffb68106710 con 0x7ffb4c06d520 2024-02-28T23:11:17.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.472+0000 7ffb6dc00700 1 -- 172.21.15.159:0/1518979931 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ffb4c06d520 msgr2=0x7ffb4c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:17.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.472+0000 7ffb6dc00700 1 --2- 172.21.15.159:0/1518979931 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ffb4c06d520 0x7ffb4c06f9e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ffb5000b5c0 tx=0x7ffb50005960 comp rx=0 tx=0).stop 2024-02-28T23:11:17.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.472+0000 7ffb6dc00700 1 -- 172.21.15.159:0/1518979931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb68100bc0 msgr2=0x7ffb68196370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:17.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.472+0000 7ffb6dc00700 1 --2- 172.21.15.159:0/1518979931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb68100bc0 0x7ffb68196370 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ffb5800c910 tx=0x7ffb5800ccd0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.472+0000 7ffb6dc00700 1 -- 172.21.15.159:0/1518979931 shutdown_connections 2024-02-28T23:11:17.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.472+0000 7ffb6dc00700 1 --2- 172.21.15.159:0/1518979931 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ffb4c06d520 0x7ffb4c06f9e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.472+0000 7ffb6dc00700 1 --2- 172.21.15.159:0/1518979931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb68100bc0 0x7ffb68196370 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.472+0000 7ffb6dc00700 1 --2- 172.21.15.159:0/1518979931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb68101dc0 0x7ffb681968b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.472+0000 7ffb6dc00700 1 -- 172.21.15.159:0/1518979931 >> 172.21.15.159:0/1518979931 conn(0x7ffb680fc140 msgr2=0x7ffb68104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:17.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.472+0000 7ffb6dc00700 1 -- 172.21.15.159:0/1518979931 shutdown_connections 2024-02-28T23:11:17.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.472+0000 7ffb6dc00700 1 -- 172.21.15.159:0/1518979931 wait complete. 2024-02-28T23:11:17.488 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:11:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:17 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:17 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:17 smithi184 ceph-mon[36198]: pgmap v102: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:17.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.624+0000 7f17cc200700 1 -- 172.21.15.159:0/2097552489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4100bb0 msgr2=0x7f17c4100fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:17.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.624+0000 7f17cc200700 1 --2- 172.21.15.159:0/2097552489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4100bb0 0x7f17c4100fd0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f17b8009910 tx=0x7f17b8009c20 comp rx=0 tx=0).stop 2024-02-28T23:11:17.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.624+0000 7f17cc200700 1 -- 172.21.15.159:0/2097552489 shutdown_connections 2024-02-28T23:11:17.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.624+0000 7f17cc200700 1 --2- 172.21.15.159:0/2097552489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c4101db0 0x7f17c4102210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.624+0000 7f17cc200700 1 --2- 172.21.15.159:0/2097552489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4100bb0 0x7f17c4100fd0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.624+0000 7f17cc200700 1 -- 172.21.15.159:0/2097552489 >> 172.21.15.159:0/2097552489 conn(0x7f17c40fc110 msgr2=0x7f17c40fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:17.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.624+0000 7f17cc200700 1 -- 172.21.15.159:0/2097552489 shutdown_connections 2024-02-28T23:11:17.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.624+0000 7f17cc200700 1 -- 172.21.15.159:0/2097552489 wait complete. 2024-02-28T23:11:17.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.625+0000 7f17cc200700 1 Processor -- start 2024-02-28T23:11:17.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.626+0000 7f17cc200700 1 -- start start 2024-02-28T23:11:17.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.626+0000 7f17cc200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4100bb0 0x7f17c4198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:17.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.626+0000 7f17cc200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c4101db0 0x7f17c4198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:17.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.626+0000 7f17cc200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c41990f0 con 0x7f17c4100bb0 2024-02-28T23:11:17.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.626+0000 7f17cc200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c4199230 con 0x7f17c4101db0 2024-02-28T23:11:17.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.626+0000 7f17c9800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4100bb0 0x7f17c4198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:17.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.626+0000 7f17c9800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4100bb0 0x7f17c4198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60596/0 (socket says 172.21.15.159:60596) 2024-02-28T23:11:17.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.626+0000 7f17c9800700 1 -- 172.21.15.159:0/4161305892 learned_addr learned my addr 172.21.15.159:0/4161305892 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:11:17.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.627+0000 7f17c8e00700 1 --2- 172.21.15.159:0/4161305892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c4101db0 0x7f17c4198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:17.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.627+0000 7f17c9800700 1 -- 172.21.15.159:0/4161305892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c4101db0 msgr2=0x7f17c4198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:17.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.627+0000 7f17c9800700 1 --2- 172.21.15.159:0/4161305892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c4101db0 0x7f17c4198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.627+0000 7f17c9800700 1 -- 172.21.15.159:0/4161305892 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80095f0 con 0x7f17c4100bb0 2024-02-28T23:11:17.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.627+0000 7f17c9800700 1 --2- 172.21.15.159:0/4161305892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4100bb0 0x7f17c4198590 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f17b800bd70 tx=0x7f17b800be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:17.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.627+0000 7f17c2000700 1 -- 172.21.15.159:0/4161305892 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17b801d070 con 0x7f17c4100bb0 2024-02-28T23:11:17.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.627+0000 7f17c2000700 1 -- 172.21.15.159:0/4161305892 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f17b800f460 con 0x7f17c4100bb0 2024-02-28T23:11:17.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.627+0000 7f17cc200700 1 -- 172.21.15.159:0/4161305892 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c419dc80 con 0x7f17c4100bb0 2024-02-28T23:11:17.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.627+0000 7f17c2000700 1 -- 172.21.15.159:0/4161305892 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17b8021640 con 0x7f17c4100bb0 2024-02-28T23:11:17.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.628+0000 7f17cc200700 1 -- 172.21.15.159:0/4161305892 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c419e170 con 0x7f17c4100bb0 2024-02-28T23:11:17.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.629+0000 7f17cc200700 1 -- 172.21.15.159:0/4161305892 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c4105e90 con 0x7f17c4100bb0 2024-02-28T23:11:17.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.630+0000 7f17c2000700 1 -- 172.21.15.159:0/4161305892 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f17b800fab0 con 0x7f17c4100bb0 2024-02-28T23:11:17.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.630+0000 7f17c2000700 1 --2- 172.21.15.159:0/4161305892 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f17ac06d520 0x7f17ac06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:17.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.631+0000 7f17c2000700 1 -- 172.21.15.159:0/4161305892 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f17b808e370 con 0x7f17c4100bb0 2024-02-28T23:11:17.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.631+0000 7f17c8e00700 1 --2- 172.21.15.159:0/4161305892 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f17ac06d520 0x7f17ac06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:17.631 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.632+0000 7f17c8e00700 1 --2- 172.21.15.159:0/4161305892 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f17ac06d520 0x7f17ac06f9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17b0005fd0 tx=0x7f17b000a560 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:17.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.635+0000 7f17c2000700 1 -- 172.21.15.159:0/4161305892 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f17b805bb60 con 0x7f17c4100bb0 2024-02-28T23:11:17.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.881+0000 7f17cc200700 1 -- 172.21.15.159:0/4161305892 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f17c40611d0 con 0x7f17ac06d520 2024-02-28T23:11:17.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.882+0000 7f17c2000700 1 -- 172.21.15.159:0/4161305892 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f17c40611d0 con 0x7f17ac06d520 2024-02-28T23:11:17.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.885+0000 7f17cc200700 1 -- 172.21.15.159:0/4161305892 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f17ac06d520 msgr2=0x7f17ac06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:17.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.885+0000 7f17cc200700 1 --2- 172.21.15.159:0/4161305892 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f17ac06d520 0x7f17ac06f9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17b0005fd0 tx=0x7f17b000a560 comp rx=0 tx=0).stop 2024-02-28T23:11:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.885+0000 7f17cc200700 1 -- 172.21.15.159:0/4161305892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4100bb0 msgr2=0x7f17c4198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:17.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.885+0000 7f17cc200700 1 --2- 172.21.15.159:0/4161305892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4100bb0 0x7f17c4198590 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f17b800bd70 tx=0x7f17b800be50 comp rx=0 tx=0).stop 2024-02-28T23:11:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.885+0000 7f17cc200700 1 -- 172.21.15.159:0/4161305892 shutdown_connections 2024-02-28T23:11:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.885+0000 7f17cc200700 1 --2- 172.21.15.159:0/4161305892 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f17ac06d520 0x7f17ac06f9e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.885+0000 7f17cc200700 1 --2- 172.21.15.159:0/4161305892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17c4100bb0 0x7f17c4198590 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.885+0000 7f17cc200700 1 --2- 172.21.15.159:0/4161305892 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f17c4101db0 0x7f17c4198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.885+0000 7f17cc200700 1 -- 172.21.15.159:0/4161305892 >> 172.21.15.159:0/4161305892 conn(0x7f17c40fc110 msgr2=0x7f17c4102fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.885+0000 7f17cc200700 1 -- 172.21.15.159:0/4161305892 shutdown_connections 2024-02-28T23:11:17.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:17.885+0000 7f17cc200700 1 -- 172.21.15.159:0/4161305892 wait complete. 2024-02-28T23:11:18.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.034+0000 7f9821a00700 1 -- 172.21.15.159:0/27950568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f981c074d60 msgr2=0x7f981c0731c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:18.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.034+0000 7f9821a00700 1 --2- 172.21.15.159:0/27950568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f981c074d60 0x7f981c0731c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f980c009910 tx=0x7f980c009c20 comp rx=0 tx=0).stop 2024-02-28T23:11:18.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.034+0000 7f9821a00700 1 -- 172.21.15.159:0/27950568 shutdown_connections 2024-02-28T23:11:18.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.034+0000 7f9821a00700 1 --2- 172.21.15.159:0/27950568 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f981c073790 0x7f981c073c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.034+0000 7f9821a00700 1 --2- 172.21.15.159:0/27950568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f981c074d60 0x7f981c0731c0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.034+0000 7f9821a00700 1 -- 172.21.15.159:0/27950568 >> 172.21.15.159:0/27950568 conn(0x7f981c0fbfa0 msgr2=0x7f981c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:18.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.034+0000 7f9821a00700 1 -- 172.21.15.159:0/27950568 shutdown_connections 2024-02-28T23:11:18.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.034+0000 7f9821a00700 1 -- 172.21.15.159:0/27950568 wait complete. 2024-02-28T23:11:18.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.035+0000 7f9821a00700 1 Processor -- start 2024-02-28T23:11:18.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.036+0000 7f9821a00700 1 -- start start 2024-02-28T23:11:18.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.036+0000 7f9821a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f981c073790 0x7f981c198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:18.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.036+0000 7f9821a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f981c074d60 0x7f981c198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:18.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.036+0000 7f9821a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c198fa0 con 0x7f981c074d60 2024-02-28T23:11:18.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.036+0000 7f9821a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981c1990e0 con 0x7f981c073790 2024-02-28T23:11:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.036+0000 7f981b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f981c074d60 0x7f981c198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.036+0000 7f981b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f981c074d60 0x7f981c198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35218/0 (socket says 172.21.15.159:35218) 2024-02-28T23:11:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.036+0000 7f981b400700 1 -- 172.21.15.159:0/3371095367 learned_addr learned my addr 172.21.15.159:0/3371095367 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:11:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.036+0000 7f981be00700 1 --2- 172.21.15.159:0/3371095367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f981c073790 0x7f981c198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.037+0000 7f981b400700 1 -- 172.21.15.159:0/3371095367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f981c073790 msgr2=0x7f981c198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.037+0000 7f981b400700 1 --2- 172.21.15.159:0/3371095367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f981c073790 0x7f981c198440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.037+0000 7f981b400700 1 -- 172.21.15.159:0/3371095367 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c0095f0 con 0x7f981c074d60 2024-02-28T23:11:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.037+0000 7f981b400700 1 --2- 172.21.15.159:0/3371095367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f981c074d60 0x7f981c198980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f980800b4b0 tx=0x7f980800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.037+0000 7f9818c00700 1 -- 172.21.15.159:0/3371095367 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9808011800 con 0x7f981c074d60 2024-02-28T23:11:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.037+0000 7f9821a00700 1 -- 172.21.15.159:0/3371095367 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981c19db90 con 0x7f981c074d60 2024-02-28T23:11:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.037+0000 7f9818c00700 1 -- 172.21.15.159:0/3371095367 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f9808011e10 con 0x7f981c074d60 2024-02-28T23:11:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.037+0000 7f9818c00700 1 -- 172.21.15.159:0/3371095367 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f980800f2e0 con 0x7f981c074d60 2024-02-28T23:11:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.037+0000 7f9821a00700 1 -- 172.21.15.159:0/3371095367 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981c19e160 con 0x7f981c074d60 2024-02-28T23:11:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.038+0000 7f9821a00700 1 -- 172.21.15.159:0/3371095367 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981c10b7f0 con 0x7f981c074d60 2024-02-28T23:11:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.039+0000 7f9818c00700 1 -- 172.21.15.159:0/3371095367 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f9808010380 con 0x7f981c074d60 2024-02-28T23:11:18.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.040+0000 7f9818c00700 1 --2- 172.21.15.159:0/3371095367 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f980006d520 0x7f980006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:18.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.040+0000 7f9818c00700 1 -- 172.21.15.159:0/3371095367 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f980808cc60 con 0x7f981c074d60 2024-02-28T23:11:18.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.040+0000 7f981be00700 1 --2- 172.21.15.159:0/3371095367 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f980006d520 0x7f980006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:18.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.041+0000 7f981be00700 1 --2- 172.21.15.159:0/3371095367 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f980006d520 0x7f980006f9e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f980c006010 tx=0x7f980c00b540 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:18.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.045+0000 7f9818c00700 1 -- 172.21.15.159:0/3371095367 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f980805a3d0 con 0x7f981c074d60 2024-02-28T23:11:18.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.272+0000 7f9821a00700 1 -- 172.21.15.159:0/3371095367 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f981c107f80 con 0x7f980006d520 2024-02-28T23:11:18.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.302+0000 7f9818c00700 1 -- 172.21.15.159:0/3371095367 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f981c107f80 con 0x7f980006d520 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (50s) 4s ago 15m 13.6M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (15m) 4s ago 15m 8246k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (13m) 105s ago 13m 7721k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (15m) 4s ago 15m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (13m) 105s ago 13m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (12s) 4s ago 14m 52.4M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (7m) 4s ago 7m 149M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (7m) 4s ago 7m 86.4M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (7m) 105s ago 7m 15.0M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (7m) 105s ago 7m 14.9M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:11:18.302 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (3m) 4s ago 16m 502M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (2m) 105s ago 13m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (16m) 4s ago 17m 55.3M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (13m) 105s ago 13m 43.2M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (119s) 4s ago 15m 7814k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (110s) 105s ago 13m 2939k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (12m) 4s ago 12m 233M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (11m) 4s ago 11m 249M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (11m) 4s ago 11m 210M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (10m) 105s ago 10m 286M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (10m) 105s ago 10m 242M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (9m) 105s ago 9m 219M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:11:18.303 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (76s) 4s ago 14m 46.0M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:11:18.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.305+0000 7f9821a00700 1 -- 172.21.15.159:0/3371095367 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f980006d520 msgr2=0x7f980006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:18.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.305+0000 7f9821a00700 1 --2- 172.21.15.159:0/3371095367 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f980006d520 0x7f980006f9e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f980c006010 tx=0x7f980c00b540 comp rx=0 tx=0).stop 2024-02-28T23:11:18.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.305+0000 7f9821a00700 1 -- 172.21.15.159:0/3371095367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f981c074d60 msgr2=0x7f981c198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:18.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.305+0000 7f9821a00700 1 --2- 172.21.15.159:0/3371095367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f981c074d60 0x7f981c198980 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f980800b4b0 tx=0x7f980800b870 comp rx=0 tx=0).stop 2024-02-28T23:11:18.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.305+0000 7f9821a00700 1 -- 172.21.15.159:0/3371095367 shutdown_connections 2024-02-28T23:11:18.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.305+0000 7f9821a00700 1 --2- 172.21.15.159:0/3371095367 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f980006d520 0x7f980006f9e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.305+0000 7f9821a00700 1 --2- 172.21.15.159:0/3371095367 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f981c073790 0x7f981c198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.306+0000 7f9821a00700 1 --2- 172.21.15.159:0/3371095367 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f981c074d60 0x7f981c198980 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.306+0000 7f9821a00700 1 -- 172.21.15.159:0/3371095367 >> 172.21.15.159:0/3371095367 conn(0x7f981c0fbfa0 msgr2=0x7f981c106860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:18.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.306+0000 7f9821a00700 1 -- 172.21.15.159:0/3371095367 shutdown_connections 2024-02-28T23:11:18.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.306+0000 7f9821a00700 1 -- 172.21.15.159:0/3371095367 wait complete. 2024-02-28T23:11:18.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.451+0000 7f14f8600700 1 -- 172.21.15.159:0/538340643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14f0101dc0 msgr2=0x7f14f0102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:18.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.451+0000 7f14f8600700 1 --2- 172.21.15.159:0/538340643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14f0101dc0 0x7f14f0102220 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f14dc009910 tx=0x7f14dc009c20 comp rx=0 tx=0).stop 2024-02-28T23:11:18.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.451+0000 7f14f8600700 1 -- 172.21.15.159:0/538340643 shutdown_connections 2024-02-28T23:11:18.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.451+0000 7f14f8600700 1 --2- 172.21.15.159:0/538340643 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14f0101dc0 0x7f14f0102220 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.451+0000 7f14f8600700 1 --2- 172.21.15.159:0/538340643 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14f0100bc0 0x7f14f0100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.451+0000 7f14f8600700 1 -- 172.21.15.159:0/538340643 >> 172.21.15.159:0/538340643 conn(0x7f14f00fc140 msgr2=0x7f14f00fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:18.452 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:18 smithi159 ceph-mon[28802]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:11:18.452 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:18 smithi159 ceph-mon[28802]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:11:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.452+0000 7f14f8600700 1 -- 172.21.15.159:0/538340643 shutdown_connections 2024-02-28T23:11:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.452+0000 7f14f8600700 1 -- 172.21.15.159:0/538340643 wait complete. 2024-02-28T23:11:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.453+0000 7f14f8600700 1 Processor -- start 2024-02-28T23:11:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.453+0000 7f14f8600700 1 -- start start 2024-02-28T23:11:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.453+0000 7f14f8600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14f0100bc0 0x7f14f0074b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.453+0000 7f14f8600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14f0101dc0 0x7f14f0073180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:18.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.453+0000 7f14f8600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f00736c0 con 0x7f14f0101dc0 2024-02-28T23:11:18.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.453+0000 7f14f8600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f0073800 con 0x7f14f0100bc0 2024-02-28T23:11:18.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.454+0000 7f14f5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14f0101dc0 0x7f14f0073180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:18.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.454+0000 7f14f5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14f0101dc0 0x7f14f0073180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35248/0 (socket says 172.21.15.159:35248) 2024-02-28T23:11:18.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.454+0000 7f14f5200700 1 -- 172.21.15.159:0/3207236160 learned_addr learned my addr 172.21.15.159:0/3207236160 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:11:18.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.454+0000 7f14f5c00700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14f0100bc0 0x7f14f0074b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:18.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.454+0000 7f14f5200700 1 -- 172.21.15.159:0/3207236160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14f0100bc0 msgr2=0x7f14f0074b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:18.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.454+0000 7f14f5200700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14f0100bc0 0x7f14f0074b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.454+0000 7f14f5200700 1 -- 172.21.15.159:0/3207236160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc0095f0 con 0x7f14f0101dc0 2024-02-28T23:11:18.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.454+0000 7f14f5c00700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14f0100bc0 0x7f14f0074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:11:18.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.454+0000 7f14f5200700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14f0101dc0 0x7f14f0073180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f14dc005b40 tx=0x7f14dc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:18.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.455+0000 7f14ee000700 1 -- 172.21.15.159:0/3207236160 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14dc01d070 con 0x7f14f0101dc0 2024-02-28T23:11:18.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.455+0000 7f14f8600700 1 -- 172.21.15.159:0/3207236160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f0073a80 con 0x7f14f0101dc0 2024-02-28T23:11:18.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.455+0000 7f14ee000700 1 -- 172.21.15.159:0/3207236160 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f14dc022470 con 0x7f14f0101dc0 2024-02-28T23:11:18.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.455+0000 7f14ee000700 1 -- 172.21.15.159:0/3207236160 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14dc00f690 con 0x7f14f0101dc0 2024-02-28T23:11:18.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.455+0000 7f14f8600700 1 -- 172.21.15.159:0/3207236160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f0073f70 con 0x7f14f0101dc0 2024-02-28T23:11:18.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.456+0000 7f14f8600700 1 -- 172.21.15.159:0/3207236160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f0109740 con 0x7f14f0101dc0 2024-02-28T23:11:18.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.457+0000 7f14ee000700 1 -- 172.21.15.159:0/3207236160 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f14dc0225e0 con 0x7f14f0101dc0 2024-02-28T23:11:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.458+0000 7f14ee000700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f14d806d520 0x7f14d806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:18.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.458+0000 7f14ee000700 1 -- 172.21.15.159:0/3207236160 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f14dc08e7b0 con 0x7f14f0101dc0 2024-02-28T23:11:18.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.459+0000 7f14f5c00700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f14d806d520 0x7f14d806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:18.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.459+0000 7f14f5c00700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f14d806d520 0x7f14d806f9e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14e4005fd0 tx=0x7f14e4005de0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:18.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.463+0000 7f14ee000700 1 -- 172.21.15.159:0/3207236160 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f14dc05c020 con 0x7f14f0101dc0 2024-02-28T23:11:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:18 smithi184 ceph-mon[36198]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:11:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:18 smithi184 ceph-mon[36198]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:11:18.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.801+0000 7f14f8600700 1 -- 172.21.15.159:0/3207236160 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f14f0109930 con 0x7f14f0101dc0 2024-02-28T23:11:18.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.802+0000 7f14ee000700 1 -- 172.21.15.159:0/3207236160 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f14dc05bbb0 con 0x7f14f0101dc0 2024-02-28T23:11:18.801 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:11:18.802 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-28T23:11:18.803 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:11:18.803 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:11:18.803 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:11:18.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.805+0000 7f14f8600700 1 -- 172.21.15.159:0/3207236160 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f14d806d520 msgr2=0x7f14d806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:18.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.805+0000 7f14f8600700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f14d806d520 0x7f14d806f9e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14e4005fd0 tx=0x7f14e4005de0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.805+0000 7f14f8600700 1 -- 172.21.15.159:0/3207236160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14f0101dc0 msgr2=0x7f14f0073180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:18.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.805+0000 7f14f8600700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14f0101dc0 0x7f14f0073180 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f14dc005b40 tx=0x7f14dc00be20 comp rx=0 tx=0).stop 2024-02-28T23:11:18.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.805+0000 7f14f8600700 1 -- 172.21.15.159:0/3207236160 shutdown_connections 2024-02-28T23:11:18.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.805+0000 7f14f8600700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f14d806d520 0x7f14d806f9e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.805+0000 7f14f8600700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f14f0100bc0 0x7f14f0074b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.805+0000 7f14f8600700 1 --2- 172.21.15.159:0/3207236160 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14f0101dc0 0x7f14f0073180 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.805+0000 7f14f8600700 1 -- 172.21.15.159:0/3207236160 >> 172.21.15.159:0/3207236160 conn(0x7f14f00fc140 msgr2=0x7f14f0104ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:18.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.805+0000 7f14f8600700 1 -- 172.21.15.159:0/3207236160 shutdown_connections 2024-02-28T23:11:18.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.805+0000 7f14f8600700 1 -- 172.21.15.159:0/3207236160 wait complete. 2024-02-28T23:11:18.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.953+0000 7f339de00700 1 -- 172.21.15.159:0/1697176279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3398102e10 msgr2=0x7f3398103230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:18.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.953+0000 7f339de00700 1 --2- 172.21.15.159:0/1697176279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3398102e10 0x7f3398103230 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3388009910 tx=0x7f3388009c20 comp rx=0 tx=0).stop 2024-02-28T23:11:18.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.953+0000 7f339de00700 1 -- 172.21.15.159:0/1697176279 shutdown_connections 2024-02-28T23:11:18.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.953+0000 7f339de00700 1 --2- 172.21.15.159:0/1697176279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3398103f70 0x7f33981043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.953+0000 7f339de00700 1 --2- 172.21.15.159:0/1697176279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3398102e10 0x7f3398103230 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.953+0000 7f339de00700 1 -- 172.21.15.159:0/1697176279 >> 172.21.15.159:0/1697176279 conn(0x7f33980fe3d0 msgr2=0x7f33981007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:18.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.953+0000 7f339de00700 1 -- 172.21.15.159:0/1697176279 shutdown_connections 2024-02-28T23:11:18.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.953+0000 7f339de00700 1 -- 172.21.15.159:0/1697176279 wait complete. 2024-02-28T23:11:18.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.955+0000 7f339de00700 1 Processor -- start 2024-02-28T23:11:18.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.955+0000 7f339de00700 1 -- start start 2024-02-28T23:11:18.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.955+0000 7f339de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3398102e10 0x7f33981985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:18.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.955+0000 7f339de00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3398103f70 0x7f3398198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:18.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.955+0000 7f339de00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398199150 con 0x7f3398102e10 2024-02-28T23:11:18.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.955+0000 7f339de00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3398199290 con 0x7f3398103f70 2024-02-28T23:11:18.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.956+0000 7f3396a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3398102e10 0x7f33981985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:18.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.956+0000 7f3396a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3398102e10 0x7f33981985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35276/0 (socket says 172.21.15.159:35276) 2024-02-28T23:11:18.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.956+0000 7f3396a00700 1 -- 172.21.15.159:0/3873854479 learned_addr learned my addr 172.21.15.159:0/3873854479 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:11:18.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.956+0000 7f3396000700 1 --2- 172.21.15.159:0/3873854479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3398103f70 0x7f3398198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:18.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.956+0000 7f3396a00700 1 -- 172.21.15.159:0/3873854479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3398103f70 msgr2=0x7f3398198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:18.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.956+0000 7f3396a00700 1 --2- 172.21.15.159:0/3873854479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3398103f70 0x7f3398198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:18.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.956+0000 7f3396a00700 1 -- 172.21.15.159:0/3873854479 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33880095f0 con 0x7f3398102e10 2024-02-28T23:11:18.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.956+0000 7f3396a00700 1 --2- 172.21.15.159:0/3873854479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3398102e10 0x7f33981985f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f338800b5c0 tx=0x7f338800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:18.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.957+0000 7f339ca00700 1 -- 172.21.15.159:0/3873854479 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338801d070 con 0x7f3398102e10 2024-02-28T23:11:18.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.957+0000 7f339ca00700 1 -- 172.21.15.159:0/3873854479 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1101+0+0 (secure 0 0 0) 0x7f3388022470 con 0x7f3398102e10 2024-02-28T23:11:18.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.957+0000 7f339ca00700 1 -- 172.21.15.159:0/3873854479 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338800f690 con 0x7f3398102e10 2024-02-28T23:11:18.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.957+0000 7f339de00700 1 -- 172.21.15.159:0/3873854479 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339819dce0 con 0x7f3398102e10 2024-02-28T23:11:18.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.957+0000 7f339de00700 1 -- 172.21.15.159:0/3873854479 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339819e200 con 0x7f3398102e10 2024-02-28T23:11:18.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.958+0000 7f339de00700 1 -- 172.21.15.159:0/3873854479 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339810b970 con 0x7f3398102e10 2024-02-28T23:11:18.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.960+0000 7f339ca00700 1 -- 172.21.15.159:0/3873854479 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f3388004b70 con 0x7f3398102e10 2024-02-28T23:11:18.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.961+0000 7f339ca00700 1 --2- 172.21.15.159:0/3873854479 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f337c06d520 0x7f337c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:18.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.961+0000 7f339ca00700 1 -- 172.21.15.159:0/3873854479 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f338808eb20 con 0x7f3398102e10 2024-02-28T23:11:18.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.962+0000 7f3396000700 1 --2- 172.21.15.159:0/3873854479 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f337c06d520 0x7f337c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:18.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.962+0000 7f3396000700 1 --2- 172.21.15.159:0/3873854479 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f337c06d520 0x7f337c06f9e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3384006fd0 tx=0x7f3384008040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:18.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:18.966+0000 7f339ca00700 1 -- 172.21.15.159:0/3873854479 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f338805c440 con 0x7f3398102e10 2024-02-28T23:11:19.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.205+0000 7f339de00700 1 -- 172.21.15.159:0/3873854479 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3398108950 con 0x7f337c06d520 2024-02-28T23:11:19.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.207+0000 7f339ca00700 1 -- 172.21.15.159:0/3873854479 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+364 (secure 0 0 0) 0x7f3398108950 con 0x7f337c06d520 2024-02-28T23:11:19.206 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:11:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:11:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:11:19.206 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-02-28T23:11:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:11:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:11:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:11:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "2/2 daemons upgraded", 2024-02-28T23:11:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading grafana daemons", 2024-02-28T23:11:19.207 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:11:19.207 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:11:19.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.209+0000 7f339de00700 1 -- 172.21.15.159:0/3873854479 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f337c06d520 msgr2=0x7f337c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:19.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.209+0000 7f339de00700 1 --2- 172.21.15.159:0/3873854479 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f337c06d520 0x7f337c06f9e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3384006fd0 tx=0x7f3384008040 comp rx=0 tx=0).stop 2024-02-28T23:11:19.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.209+0000 7f339de00700 1 -- 172.21.15.159:0/3873854479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3398102e10 msgr2=0x7f33981985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:19.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.209+0000 7f339de00700 1 --2- 172.21.15.159:0/3873854479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3398102e10 0x7f33981985f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f338800b5c0 tx=0x7f338800be20 comp rx=0 tx=0).stop 2024-02-28T23:11:19.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.210+0000 7f339de00700 1 -- 172.21.15.159:0/3873854479 shutdown_connections 2024-02-28T23:11:19.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.210+0000 7f339de00700 1 --2- 172.21.15.159:0/3873854479 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f337c06d520 0x7f337c06f9e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:19.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.210+0000 7f339de00700 1 --2- 172.21.15.159:0/3873854479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3398102e10 0x7f33981985f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:19.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.210+0000 7f339de00700 1 --2- 172.21.15.159:0/3873854479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3398103f70 0x7f3398198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:19.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.210+0000 7f339de00700 1 -- 172.21.15.159:0/3873854479 >> 172.21.15.159:0/3873854479 conn(0x7f33980fe3d0 msgr2=0x7f3398107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:19.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.210+0000 7f339de00700 1 -- 172.21.15.159:0/3873854479 shutdown_connections 2024-02-28T23:11:19.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:19.210+0000 7f339de00700 1 -- 172.21.15.159:0/3873854479 wait complete. 2024-02-28T23:11:19.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:19 smithi184 ceph-mon[36198]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:11:19.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:19 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/3207236160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:19.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:19 smithi184 ceph-mon[36198]: pgmap v103: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:19.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:19 smithi159 ceph-mon[28802]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:11:19.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:19 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/3207236160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:19.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:19 smithi159 ceph-mon[28802]: pgmap v103: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:20 smithi184 ceph-mon[36198]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:11:20.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:20 smithi159 ceph-mon[28802]: from='client.14842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:11:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:21 smithi159 ceph-mon[28802]: pgmap v104: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:21.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:21 smithi184 ceph-mon[36198]: pgmap v104: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:22.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:22.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:22.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:11:22.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:11:22.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:22.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T23:11:22.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T23:11:22.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:11:22.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: Upgrade: Finalizing container_image settings 2024-02-28T23:11:22.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:22.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T23:11:22.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T23:11:22.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T23:11:22.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T23:11:22.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T23:11:22.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T23:11:22.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T23:11:22.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T23:11:22.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T23:11:22.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T23:11:22.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T23:11:22.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T23:11:22.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T23:11:22.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T23:11:22.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T23:11:22.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T23:11:22.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T23:11:22.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T23:11:22.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T23:11:22.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:11:22.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:11:22.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:11:22.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:22.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:11:22.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:11:22.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:11:22.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:22 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:22.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:22.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:22.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:11:22.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.974 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:22.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: Upgrade: Finalizing container_image settings 2024-02-28T23:11:22.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:22.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T23:11:22.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T23:11:22.975 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.976 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T23:11:22.976 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T23:11:22.976 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T23:11:22.976 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T23:11:22.976 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T23:11:22.976 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T23:11:22.976 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T23:11:22.976 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.977 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:11:22.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T23:11:22.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T23:11:22.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:11:22.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:11:22.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:11:22.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:22.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:11:22.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:11:22.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:11:22.978 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:22 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:23 smithi184 ceph-mon[36198]: Upgrade: Complete! 2024-02-28T23:11:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:23 smithi184 ceph-mon[36198]: pgmap v105: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:23.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:23 smithi159 ceph-mon[28802]: Upgrade: Complete! 2024-02-28T23:11:23.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:23 smithi159 ceph-mon[28802]: pgmap v105: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:25.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:25 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:25.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:25 smithi159 ceph-mon[28802]: pgmap v106: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:25.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:25 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:11:25.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:25 smithi184 ceph-mon[36198]: pgmap v106: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:27.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:27 smithi184 ceph-mon[36198]: pgmap v107: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:27.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:27 smithi159 ceph-mon[28802]: pgmap v107: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:29.823 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:29 smithi159 ceph-mon[28802]: pgmap v108: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:29.823 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:11:29.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:29 smithi184 ceph-mon[36198]: pgmap v108: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:29.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:11:31.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:31 smithi184 ceph-mon[36198]: pgmap v109: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:31.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:31 smithi159 ceph-mon[28802]: pgmap v109: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:33.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:33 smithi184 ceph-mon[36198]: pgmap v110: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:33.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:33 smithi159 ceph-mon[28802]: pgmap v110: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:35.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:35 smithi184 ceph-mon[36198]: pgmap v111: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:35 smithi159 ceph-mon[28802]: pgmap v111: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:37.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:37 smithi184 ceph-mon[36198]: pgmap v112: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:37.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:37 smithi159 ceph-mon[28802]: pgmap v112: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:39.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:39 smithi184 ceph-mon[36198]: pgmap v113: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:39.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:39 smithi159 ceph-mon[28802]: pgmap v113: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:41.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:41 smithi159 ceph-mon[28802]: pgmap v114: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:41.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:41 smithi184 ceph-mon[36198]: pgmap v114: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:43.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:43 smithi159 ceph-mon[28802]: pgmap v115: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:43.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:43 smithi184 ceph-mon[36198]: pgmap v115: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:11:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:44 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:11:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:45 smithi159 ceph-mon[28802]: pgmap v116: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:45.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:45 smithi184 ceph-mon[36198]: pgmap v116: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:47.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:47 smithi159 ceph-mon[28802]: pgmap v117: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:47.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:47 smithi184 ceph-mon[36198]: pgmap v117: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:49.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.378+0000 7fd54b800700 1 -- 172.21.15.159:0/3186853345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd544103f70 msgr2=0x7fd5441043f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:49.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.378+0000 7fd54b800700 1 --2- 172.21.15.159:0/3186853345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd544103f70 0x7fd5441043f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd530009910 tx=0x7fd530009c20 comp rx=0 tx=0).stop 2024-02-28T23:11:49.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.379+0000 7fd54b800700 1 -- 172.21.15.159:0/3186853345 shutdown_connections 2024-02-28T23:11:49.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.379+0000 7fd54b800700 1 --2- 172.21.15.159:0/3186853345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd544103f70 0x7fd5441043f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:49.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.379+0000 7fd54b800700 1 --2- 172.21.15.159:0/3186853345 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd544102e10 0x7fd544103230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:49.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.379+0000 7fd54b800700 1 -- 172.21.15.159:0/3186853345 >> 172.21.15.159:0/3186853345 conn(0x7fd5440fe3d0 msgr2=0x7fd5441007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:49.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.379+0000 7fd54b800700 1 -- 172.21.15.159:0/3186853345 shutdown_connections 2024-02-28T23:11:49.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.379+0000 7fd54b800700 1 -- 172.21.15.159:0/3186853345 wait complete. 2024-02-28T23:11:49.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.380+0000 7fd54b800700 1 Processor -- start 2024-02-28T23:11:49.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.380+0000 7fd54b800700 1 -- start start 2024-02-28T23:11:49.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.380+0000 7fd54b800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd544102e10 0x7fd544198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:49.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.380+0000 7fd54b800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd544103f70 0x7fd544198b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:49.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.380+0000 7fd54b800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5441991b0 con 0x7fd544102e10 2024-02-28T23:11:49.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.380+0000 7fd54b800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5441992f0 con 0x7fd544103f70 2024-02-28T23:11:49.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.381+0000 7fd548e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd544102e10 0x7fd544198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:49.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.381+0000 7fd548e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd544102e10 0x7fd544198650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43580/0 (socket says 172.21.15.159:43580) 2024-02-28T23:11:49.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.381+0000 7fd548e00700 1 -- 172.21.15.159:0/3568843087 learned_addr learned my addr 172.21.15.159:0/3568843087 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:11:49.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.381+0000 7fd543e00700 1 --2- 172.21.15.159:0/3568843087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd544103f70 0x7fd544198b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:49.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.381+0000 7fd548e00700 1 -- 172.21.15.159:0/3568843087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd544103f70 msgr2=0x7fd544198b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:49.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.381+0000 7fd548e00700 1 --2- 172.21.15.159:0/3568843087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd544103f70 0x7fd544198b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:49.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.381+0000 7fd548e00700 1 -- 172.21.15.159:0/3568843087 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5300095f0 con 0x7fd544102e10 2024-02-28T23:11:49.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.382+0000 7fd548e00700 1 --2- 172.21.15.159:0/3568843087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd544102e10 0x7fd544198650 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b4b0 tx=0x7fd53800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:49.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.382+0000 7fd541600700 1 -- 172.21.15.159:0/3568843087 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd538011800 con 0x7fd544102e10 2024-02-28T23:11:49.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.382+0000 7fd541600700 1 -- 172.21.15.159:0/3568843087 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd538011e20 con 0x7fd544102e10 2024-02-28T23:11:49.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.382+0000 7fd541600700 1 -- 172.21.15.159:0/3568843087 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd53800f2e0 con 0x7fd544102e10 2024-02-28T23:11:49.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.382+0000 7fd54b800700 1 -- 172.21.15.159:0/3568843087 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd54419dda0 con 0x7fd544102e10 2024-02-28T23:11:49.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.382+0000 7fd54b800700 1 -- 172.21.15.159:0/3568843087 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd54419e2e0 con 0x7fd544102e10 2024-02-28T23:11:49.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.383+0000 7fd54b800700 1 -- 172.21.15.159:0/3568843087 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54410b9e0 con 0x7fd544102e10 2024-02-28T23:11:49.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.384+0000 7fd541600700 1 -- 172.21.15.159:0/3568843087 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7fd538010380 con 0x7fd544102e10 2024-02-28T23:11:49.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.385+0000 7fd541600700 1 --2- 172.21.15.159:0/3568843087 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd52c06d520 0x7fd52c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.385+0000 7fd541600700 1 -- 172.21.15.159:0/3568843087 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd53808cad0 con 0x7fd544102e10 2024-02-28T23:11:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.386+0000 7fd543e00700 1 --2- 172.21.15.159:0/3568843087 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd52c06d520 0x7fd52c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.386+0000 7fd543e00700 1 --2- 172.21.15.159:0/3568843087 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd52c06d520 0x7fd52c06f9e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd530006010 tx=0x7fd53000b580 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:49.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.390+0000 7fd541600700 1 -- 172.21.15.159:0/3568843087 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fd53805a2c0 con 0x7fd544102e10 2024-02-28T23:11:49.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.623+0000 7fd54b800700 1 -- 172.21.15.159:0/3568843087 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd544108950 con 0x7fd52c06d520 2024-02-28T23:11:49.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.625+0000 7fd541600700 1 -- 172.21.15.159:0/3568843087 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fd544108950 con 0x7fd52c06d520 2024-02-28T23:11:49.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.628+0000 7fd54b800700 1 -- 172.21.15.159:0/3568843087 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd52c06d520 msgr2=0x7fd52c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:49.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.628+0000 7fd54b800700 1 --2- 172.21.15.159:0/3568843087 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd52c06d520 0x7fd52c06f9e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd530006010 tx=0x7fd53000b580 comp rx=0 tx=0).stop 2024-02-28T23:11:49.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.628+0000 7fd54b800700 1 -- 172.21.15.159:0/3568843087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd544102e10 msgr2=0x7fd544198650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:49.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.628+0000 7fd54b800700 1 --2- 172.21.15.159:0/3568843087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd544102e10 0x7fd544198650 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd53800b4b0 tx=0x7fd53800b870 comp rx=0 tx=0).stop 2024-02-28T23:11:49.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.628+0000 7fd54b800700 1 -- 172.21.15.159:0/3568843087 shutdown_connections 2024-02-28T23:11:49.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.628+0000 7fd54b800700 1 --2- 172.21.15.159:0/3568843087 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd52c06d520 0x7fd52c06f9e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:49.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.628+0000 7fd54b800700 1 --2- 172.21.15.159:0/3568843087 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd544102e10 0x7fd544198650 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:49.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.628+0000 7fd54b800700 1 --2- 172.21.15.159:0/3568843087 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd544103f70 0x7fd544198b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:49.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.628+0000 7fd54b800700 1 -- 172.21.15.159:0/3568843087 >> 172.21.15.159:0/3568843087 conn(0x7fd5440fe3d0 msgr2=0x7fd544107230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:49.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.628+0000 7fd54b800700 1 -- 172.21.15.159:0/3568843087 shutdown_connections 2024-02-28T23:11:49.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:49.628+0000 7fd54b800700 1 -- 172.21.15.159:0/3568843087 wait complete. 2024-02-28T23:11:49.645 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:49 smithi159 ceph-mon[28802]: pgmap v118: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:49.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:49 smithi184 ceph-mon[36198]: pgmap v118: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:50.461 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-02-28T23:11:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:50 smithi159 ceph-mon[28802]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:11:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:50 smithi184 ceph-mon[36198]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:11:50.926 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:11:51.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:51 smithi159 ceph-mon[28802]: pgmap v119: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:51.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:51 smithi184 ceph-mon[36198]: pgmap v119: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:53.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.077+0000 7f8d16200700 1 -- 172.21.15.159:0/3403453152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d101009a0 msgr2=0x7f8d10100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:53.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.077+0000 7f8d16200700 1 --2- 172.21.15.159:0/3403453152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d101009a0 0x7f8d10100e20 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc009910 tx=0x7f8cfc009c20 comp rx=0 tx=0).stop 2024-02-28T23:11:53.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.077+0000 7f8d16200700 1 -- 172.21.15.159:0/3403453152 shutdown_connections 2024-02-28T23:11:53.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.077+0000 7f8d16200700 1 --2- 172.21.15.159:0/3403453152 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d101009a0 0x7f8d10100e20 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:53.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.077+0000 7f8d16200700 1 --2- 172.21.15.159:0/3403453152 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d101069a0 0x7f8d10106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:53.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.077+0000 7f8d16200700 1 -- 172.21.15.159:0/3403453152 >> 172.21.15.159:0/3403453152 conn(0x7f8d100fc4b0 msgr2=0x7f8d100fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:53.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.077+0000 7f8d16200700 1 -- 172.21.15.159:0/3403453152 shutdown_connections 2024-02-28T23:11:53.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.077+0000 7f8d16200700 1 -- 172.21.15.159:0/3403453152 wait complete. 2024-02-28T23:11:53.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.078+0000 7f8d16200700 1 Processor -- start 2024-02-28T23:11:53.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.078+0000 7f8d16200700 1 -- start start 2024-02-28T23:11:53.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.078+0000 7f8d16200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d101009a0 0x7f8d101965a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:53.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.078+0000 7f8d16200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d101069a0 0x7f8d10196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:53.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.078+0000 7f8d16200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d101971c0 con 0x7f8d101069a0 2024-02-28T23:11:53.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.079+0000 7f8d16200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1019af50 con 0x7f8d101009a0 2024-02-28T23:11:53.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.079+0000 7f8d0fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d101069a0 0x7f8d10196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:53.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.079+0000 7f8d0fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d101069a0 0x7f8d10196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43606/0 (socket says 172.21.15.159:43606) 2024-02-28T23:11:53.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.079+0000 7f8d0fe00700 1 -- 172.21.15.159:0/1361835072 learned_addr learned my addr 172.21.15.159:0/1361835072 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:11:53.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.079+0000 7f8d14e00700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d101009a0 0x7f8d101965a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:53.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.079+0000 7f8d0fe00700 1 -- 172.21.15.159:0/1361835072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d101009a0 msgr2=0x7f8d101965a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:53.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.079+0000 7f8d0fe00700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d101009a0 0x7f8d101965a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:53.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.079+0000 7f8d0fe00700 1 -- 172.21.15.159:0/1361835072 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc0095f0 con 0x7f8d101069a0 2024-02-28T23:11:53.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.079+0000 7f8d14e00700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d101009a0 0x7f8d101965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:11:53.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.080+0000 7f8d0fe00700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d101069a0 0x7f8d10196ae0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b5c0 tx=0x7f8cfc00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:53.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.080+0000 7f8d0d600700 1 -- 172.21.15.159:0/1361835072 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cfc01d070 con 0x7f8d101069a0 2024-02-28T23:11:53.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.080+0000 7f8d0d600700 1 -- 172.21.15.159:0/1361835072 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8cfc00f460 con 0x7f8d101069a0 2024-02-28T23:11:53.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.080+0000 7f8d0d600700 1 -- 172.21.15.159:0/1361835072 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cfc017610 con 0x7f8d101069a0 2024-02-28T23:11:53.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.080+0000 7f8d16200700 1 -- 172.21.15.159:0/1361835072 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1019b1d0 con 0x7f8d101069a0 2024-02-28T23:11:53.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.080+0000 7f8d16200700 1 -- 172.21.15.159:0/1361835072 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1019b6c0 con 0x7f8d101069a0 2024-02-28T23:11:53.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.081+0000 7f8d16200700 1 -- 172.21.15.159:0/1361835072 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d10108f30 con 0x7f8d101069a0 2024-02-28T23:11:53.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.082+0000 7f8d0d600700 1 -- 172.21.15.159:0/1361835072 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f8cfc00f5d0 con 0x7f8d101069a0 2024-02-28T23:11:53.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.083+0000 7f8d0d600700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8cf806d520 0x7f8cf806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:53.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.084+0000 7f8d0d600700 1 -- 172.21.15.159:0/1361835072 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f8cfc08e640 con 0x7f8d101069a0 2024-02-28T23:11:53.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.084+0000 7f8d14e00700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8cf806d520 0x7f8cf806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:53.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.085+0000 7f8d14e00700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8cf806d520 0x7f8cf806f9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8d04005fd0 tx=0x7f8d04005dc0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:53.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.088+0000 7f8d0d600700 1 -- 172.21.15.159:0/1361835072 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f8cfc058280 con 0x7f8d101069a0 2024-02-28T23:11:53.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.390+0000 7f8d16200700 1 -- 172.21.15.159:0/1361835072 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8d1002cc70 con 0x7f8d101069a0 2024-02-28T23:11:53.390 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:53 smithi159 ceph-mon[28802]: pgmap v120: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:53.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.391+0000 7f8d0d600700 1 -- 172.21.15.159:0/1361835072 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f8cfc05b940 con 0x7f8d101069a0 2024-02-28T23:11:53.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.394+0000 7f8d16200700 1 -- 172.21.15.159:0/1361835072 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8cf806d520 msgr2=0x7f8cf806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:53.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.394+0000 7f8d16200700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8cf806d520 0x7f8cf806f9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8d04005fd0 tx=0x7f8d04005dc0 comp rx=0 tx=0).stop 2024-02-28T23:11:53.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.394+0000 7f8d16200700 1 -- 172.21.15.159:0/1361835072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d101069a0 msgr2=0x7f8d10196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:53.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.394+0000 7f8d16200700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d101069a0 0x7f8d10196ae0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b5c0 tx=0x7f8cfc00be00 comp rx=0 tx=0).stop 2024-02-28T23:11:53.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.394+0000 7f8d16200700 1 -- 172.21.15.159:0/1361835072 shutdown_connections 2024-02-28T23:11:53.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.394+0000 7f8d16200700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f8cf806d520 0x7f8cf806f9e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:53.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.394+0000 7f8d16200700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8d101009a0 0x7f8d101965a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:53.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.394+0000 7f8d16200700 1 --2- 172.21.15.159:0/1361835072 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8d101069a0 0x7f8d10196ae0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:53.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.394+0000 7f8d16200700 1 -- 172.21.15.159:0/1361835072 >> 172.21.15.159:0/1361835072 conn(0x7f8d100fc4b0 msgr2=0x7f8d100fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:53.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.394+0000 7f8d16200700 1 -- 172.21.15.159:0/1361835072 shutdown_connections 2024-02-28T23:11:53.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:53.394+0000 7f8d16200700 1 -- 172.21.15.159:0/1361835072 wait complete. 2024-02-28T23:11:53.410 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:11:53.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:53 smithi184 ceph-mon[36198]: pgmap v120: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:54.273 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-02-28T23:11:54.359 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:54 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1361835072' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:54 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1361835072' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:54.698 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:11:55.430 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:55 smithi159 ceph-mon[28802]: pgmap v121: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:55.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:55 smithi184 ceph-mon[36198]: pgmap v121: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:57.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.057+0000 7ff04fe00700 1 -- 172.21.15.159:0/512965182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff050106a40 msgr2=0x7ff050106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:57.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.057+0000 7ff04fe00700 1 --2- 172.21.15.159:0/512965182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff050106a40 0x7ff050106e20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff040009910 tx=0x7ff040009c20 comp rx=0 tx=0).stop 2024-02-28T23:11:57.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.058+0000 7ff04fe00700 1 -- 172.21.15.159:0/512965182 shutdown_connections 2024-02-28T23:11:57.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.058+0000 7ff04fe00700 1 --2- 172.21.15.159:0/512965182 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff050068410 0x7ff050068890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:57.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.058+0000 7ff04fe00700 1 --2- 172.21.15.159:0/512965182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff050106a40 0x7ff050106e20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:57.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.058+0000 7ff04fe00700 1 -- 172.21.15.159:0/512965182 >> 172.21.15.159:0/512965182 conn(0x7ff050075330 msgr2=0x7ff050075740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:57.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.058+0000 7ff04fe00700 1 -- 172.21.15.159:0/512965182 shutdown_connections 2024-02-28T23:11:57.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.058+0000 7ff04fe00700 1 -- 172.21.15.159:0/512965182 wait complete. 2024-02-28T23:11:57.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.059+0000 7ff04fe00700 1 Processor -- start 2024-02-28T23:11:57.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.059+0000 7ff04fe00700 1 -- start start 2024-02-28T23:11:57.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.059+0000 7ff04fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff050068410 0x7ff050196680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:57.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.059+0000 7ff04fe00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff050106a40 0x7ff050196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:57.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.060+0000 7ff04fe00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff050197250 con 0x7ff050068410 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.060+0000 7ff04fe00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff050199f80 con 0x7ff050106a40 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.060+0000 7ff04ea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff050068410 0x7ff050196680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.060+0000 7ff04ea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff050068410 0x7ff050196680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43622/0 (socket says 172.21.15.159:43622) 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.060+0000 7ff04ea00700 1 -- 172.21.15.159:0/153629716 learned_addr learned my addr 172.21.15.159:0/153629716 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.060+0000 7ff04ea00700 1 -- 172.21.15.159:0/153629716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff050106a40 msgr2=0x7ff050196bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.060+0000 7ff04e000700 1 --2- 172.21.15.159:0/153629716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff050106a40 0x7ff050196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.060+0000 7ff04ea00700 1 --2- 172.21.15.159:0/153629716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff050106a40 0x7ff050196bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.060+0000 7ff04ea00700 1 -- 172.21.15.159:0/153629716 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400095f0 con 0x7ff050068410 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.061+0000 7ff04ea00700 1 --2- 172.21.15.159:0/153629716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff050068410 0x7ff050196680 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff040006010 tx=0x7ff04000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.061+0000 7ff047400700 1 -- 172.21.15.159:0/153629716 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff04001d070 con 0x7ff050068410 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.061+0000 7ff047400700 1 -- 172.21.15.159:0/153629716 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff040004fb0 con 0x7ff050068410 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.061+0000 7ff047400700 1 -- 172.21.15.159:0/153629716 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff04000f480 con 0x7ff050068410 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.061+0000 7ff04fe00700 1 -- 172.21.15.159:0/153629716 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05019a200 con 0x7ff050068410 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.061+0000 7ff04fe00700 1 -- 172.21.15.159:0/153629716 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05019a6f0 con 0x7ff050068410 2024-02-28T23:11:57.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.062+0000 7ff04fe00700 1 -- 172.21.15.159:0/153629716 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff050103ce0 con 0x7ff050068410 2024-02-28T23:11:57.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.063+0000 7ff047400700 1 -- 172.21.15.159:0/153629716 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7ff040022890 con 0x7ff050068410 2024-02-28T23:11:57.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.064+0000 7ff047400700 1 --2- 172.21.15.159:0/153629716 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff03406d520 0x7ff03406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:11:57.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.064+0000 7ff047400700 1 -- 172.21.15.159:0/153629716 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7ff04008e5e0 con 0x7ff050068410 2024-02-28T23:11:57.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.064+0000 7ff04e000700 1 --2- 172.21.15.159:0/153629716 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff03406d520 0x7ff03406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:11:57.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.065+0000 7ff04e000700 1 --2- 172.21.15.159:0/153629716 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff03406d520 0x7ff03406f9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff03c006fd0 tx=0x7ff03c008040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:11:57.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.069+0000 7ff047400700 1 -- 172.21.15.159:0/153629716 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7ff040058350 con 0x7ff050068410 2024-02-28T23:11:57.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:57 smithi159 ceph-mon[28802]: pgmap v122: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:57.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.357+0000 7ff04fe00700 1 -- 172.21.15.159:0/153629716 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff05004f2e0 con 0x7ff050068410 2024-02-28T23:11:57.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.358+0000 7ff047400700 1 -- 172.21.15.159:0/153629716 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7ff04005ba10 con 0x7ff050068410 2024-02-28T23:11:57.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.361+0000 7ff04fe00700 1 -- 172.21.15.159:0/153629716 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff03406d520 msgr2=0x7ff03406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:57.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.361+0000 7ff04fe00700 1 --2- 172.21.15.159:0/153629716 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff03406d520 0x7ff03406f9e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff03c006fd0 tx=0x7ff03c008040 comp rx=0 tx=0).stop 2024-02-28T23:11:57.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.361+0000 7ff04fe00700 1 -- 172.21.15.159:0/153629716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff050068410 msgr2=0x7ff050196680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:11:57.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.361+0000 7ff04fe00700 1 --2- 172.21.15.159:0/153629716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff050068410 0x7ff050196680 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff040006010 tx=0x7ff04000be20 comp rx=0 tx=0).stop 2024-02-28T23:11:57.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.361+0000 7ff04fe00700 1 -- 172.21.15.159:0/153629716 shutdown_connections 2024-02-28T23:11:57.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.361+0000 7ff04fe00700 1 --2- 172.21.15.159:0/153629716 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7ff03406d520 0x7ff03406f9e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:57.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.361+0000 7ff04fe00700 1 --2- 172.21.15.159:0/153629716 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff050068410 0x7ff050196680 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:57.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.361+0000 7ff04fe00700 1 --2- 172.21.15.159:0/153629716 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff050106a40 0x7ff050196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:11:57.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.361+0000 7ff04fe00700 1 -- 172.21.15.159:0/153629716 >> 172.21.15.159:0/153629716 conn(0x7ff050075330 msgr2=0x7ff0500feb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:11:57.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.361+0000 7ff04fe00700 1 -- 172.21.15.159:0/153629716 shutdown_connections 2024-02-28T23:11:57.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:11:57.361+0000 7ff04fe00700 1 -- 172.21.15.159:0/153629716 wait complete. 2024-02-28T23:11:57.376 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)" 2024-02-28T23:11:57.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:57 smithi184 ceph-mon[36198]: pgmap v122: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:11:58.070 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-02-28T23:11:58.465 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:11:58.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:58 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/153629716' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:58.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:58 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/153629716' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:11:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:59 smithi184 ceph-mon[36198]: pgmap v123: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:11:59 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:11:59.924 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:59 smithi159 ceph-mon[28802]: pgmap v123: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:11:59.925 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:11:59 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:12:00.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.780+0000 7f3adf200700 1 -- 172.21.15.159:0/3167045456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ad8105a40 msgr2=0x7f3ad8105e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:00.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.780+0000 7f3adf200700 1 --2- 172.21.15.159:0/3167045456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ad8105a40 0x7f3ad8105e20 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8009910 tx=0x7f3ac8009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:00.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.780+0000 7f3adf200700 1 -- 172.21.15.159:0/3167045456 shutdown_connections 2024-02-28T23:12:00.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.780+0000 7f3adf200700 1 --2- 172.21.15.159:0/3167045456 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad80ffa40 0x7f3ad80ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:00.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.781+0000 7f3adf200700 1 --2- 172.21.15.159:0/3167045456 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ad8105a40 0x7f3ad8105e20 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:00.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.781+0000 7f3adf200700 1 -- 172.21.15.159:0/3167045456 >> 172.21.15.159:0/3167045456 conn(0x7f3ad80fb570 msgr2=0x7f3ad80fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:00.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.781+0000 7f3adf200700 1 -- 172.21.15.159:0/3167045456 shutdown_connections 2024-02-28T23:12:00.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.781+0000 7f3adf200700 1 -- 172.21.15.159:0/3167045456 wait complete. 2024-02-28T23:12:00.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.782+0000 7f3adf200700 1 Processor -- start 2024-02-28T23:12:00.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.782+0000 7f3adf200700 1 -- start start 2024-02-28T23:12:00.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.783+0000 7f3adf200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad80ffa40 0x7f3ad819e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:00.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.783+0000 7f3adf200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ad8105a40 0x7f3ad819ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:00.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.783+0000 7f3adf200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad819f2d0 con 0x7f3ad8105a40 2024-02-28T23:12:00.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.783+0000 7f3adf200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad8198780 con 0x7f3ad80ffa40 2024-02-28T23:12:00.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.783+0000 7f3ad7400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ad8105a40 0x7f3ad819ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:00.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.784+0000 7f3ad7400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ad8105a40 0x7f3ad819ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39606/0 (socket says 172.21.15.159:39606) 2024-02-28T23:12:00.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.784+0000 7f3ad7400700 1 -- 172.21.15.159:0/1403518001 learned_addr learned my addr 172.21.15.159:0/1403518001 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:00.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.784+0000 7f3ad7e00700 1 --2- 172.21.15.159:0/1403518001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad80ffa40 0x7f3ad819e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:00.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.784+0000 7f3ad7400700 1 -- 172.21.15.159:0/1403518001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad80ffa40 msgr2=0x7f3ad819e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:00.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.784+0000 7f3ad7400700 1 --2- 172.21.15.159:0/1403518001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad80ffa40 0x7f3ad819e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:00.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.784+0000 7f3ad7400700 1 -- 172.21.15.159:0/1403518001 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac80095f0 con 0x7f3ad8105a40 2024-02-28T23:12:00.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.784+0000 7f3ad7400700 1 --2- 172.21.15.159:0/1403518001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ad8105a40 0x7f3ad819ec40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400c8a0 tx=0x7f3ac400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:00.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.785+0000 7f3ad4c00700 1 -- 172.21.15.159:0/1403518001 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ac400cea0 con 0x7f3ad8105a40 2024-02-28T23:12:00.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.785+0000 7f3ad4c00700 1 -- 172.21.15.159:0/1403518001 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ac4004830 con 0x7f3ad8105a40 2024-02-28T23:12:00.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.785+0000 7f3adf200700 1 -- 172.21.15.159:0/1403518001 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad8198a60 con 0x7f3ad8105a40 2024-02-28T23:12:00.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.785+0000 7f3ad4c00700 1 -- 172.21.15.159:0/1403518001 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ac40055b0 con 0x7f3ad8105a40 2024-02-28T23:12:00.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.785+0000 7f3adf200700 1 -- 172.21.15.159:0/1403518001 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad8198fb0 con 0x7f3ad8105a40 2024-02-28T23:12:00.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.786+0000 7f3adf200700 1 -- 172.21.15.159:0/1403518001 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ad804ea90 con 0x7f3ad8105a40 2024-02-28T23:12:00.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.787+0000 7f3ad4c00700 1 -- 172.21.15.159:0/1403518001 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f3ac4007ad0 con 0x7f3ad8105a40 2024-02-28T23:12:00.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.788+0000 7f3ad4c00700 1 --2- 172.21.15.159:0/1403518001 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3abc06d520 0x7f3abc06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:00.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.789+0000 7f3ad4c00700 1 -- 172.21.15.159:0/1403518001 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f3ac408cd30 con 0x7f3ad8105a40 2024-02-28T23:12:00.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.789+0000 7f3ad7e00700 1 --2- 172.21.15.159:0/1403518001 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3abc06d520 0x7f3abc06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:00.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.790+0000 7f3ad7e00700 1 --2- 172.21.15.159:0/1403518001 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3abc06d520 0x7f3abc06f9e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8006010 tx=0x7f3ac801a040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:00.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:00.793+0000 7f3ad4c00700 1 -- 172.21.15.159:0/1403518001 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f3ac405a4a0 con 0x7f3ad8105a40 2024-02-28T23:12:01.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.108+0000 7f3adf200700 1 -- 172.21.15.159:0/1403518001 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3ad8199c90 con 0x7f3ad8105a40 2024-02-28T23:12:01.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.109+0000 7f3ad4c00700 1 -- 172.21.15.159:0/1403518001 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7f3ac405a030 con 0x7f3ad8105a40 2024-02-28T23:12:01.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.112+0000 7f3adf200700 1 -- 172.21.15.159:0/1403518001 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3abc06d520 msgr2=0x7f3abc06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:01.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.112+0000 7f3adf200700 1 --2- 172.21.15.159:0/1403518001 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3abc06d520 0x7f3abc06f9e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3ac8006010 tx=0x7f3ac801a040 comp rx=0 tx=0).stop 2024-02-28T23:12:01.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.112+0000 7f3adf200700 1 -- 172.21.15.159:0/1403518001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ad8105a40 msgr2=0x7f3ad819ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:01.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.112+0000 7f3adf200700 1 --2- 172.21.15.159:0/1403518001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ad8105a40 0x7f3ad819ec40 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3ac400c8a0 tx=0x7f3ac400cc60 comp rx=0 tx=0).stop 2024-02-28T23:12:01.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.112+0000 7f3adf200700 1 -- 172.21.15.159:0/1403518001 shutdown_connections 2024-02-28T23:12:01.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.112+0000 7f3adf200700 1 --2- 172.21.15.159:0/1403518001 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f3abc06d520 0x7f3abc06f9e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:01.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.112+0000 7f3adf200700 1 --2- 172.21.15.159:0/1403518001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3ad80ffa40 0x7f3ad819e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:01.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.112+0000 7f3adf200700 1 --2- 172.21.15.159:0/1403518001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ad8105a40 0x7f3ad819ec40 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:01.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.112+0000 7f3adf200700 1 -- 172.21.15.159:0/1403518001 >> 172.21.15.159:0/1403518001 conn(0x7f3ad80fb570 msgr2=0x7f3ad810bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:01.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.112+0000 7f3adf200700 1 -- 172.21.15.159:0/1403518001 shutdown_connections 2024-02-28T23:12:01.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:01.112+0000 7f3adf200700 1 -- 172.21.15.159:0/1403518001 wait complete. 2024-02-28T23:12:01.128 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:12:01.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:01 smithi159 ceph-mon[28802]: pgmap v124: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:01.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:01 smithi184 ceph-mon[36198]: pgmap v124: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:01.929 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-02-28T23:12:02.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:02 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/1403518001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:12:02.341 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:12:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:02 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1403518001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:12:03.387 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:03 smithi159 ceph-mon[28802]: pgmap v125: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:03.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:03 smithi184 ceph-mon[36198]: pgmap v125: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:04.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.527+0000 7fd89a400700 1 -- 172.21.15.159:0/3806678165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd894103000 msgr2=0x7fd8941033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:04.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.527+0000 7fd89a400700 1 --2- 172.21.15.159:0/3806678165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd894103000 0x7fd8941033e0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd884009910 tx=0x7fd884009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:04.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.528+0000 7fd89a400700 1 -- 172.21.15.159:0/3806678165 shutdown_connections 2024-02-28T23:12:04.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.528+0000 7fd89a400700 1 --2- 172.21.15.159:0/3806678165 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd8941039b0 0x7fd894107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:04.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.528+0000 7fd89a400700 1 --2- 172.21.15.159:0/3806678165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd894103000 0x7fd8941033e0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:04.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.528+0000 7fd89a400700 1 -- 172.21.15.159:0/3806678165 >> 172.21.15.159:0/3806678165 conn(0x7fd8940fe8d0 msgr2=0x7fd894100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:04.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.528+0000 7fd89a400700 1 -- 172.21.15.159:0/3806678165 shutdown_connections 2024-02-28T23:12:04.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.528+0000 7fd89a400700 1 -- 172.21.15.159:0/3806678165 wait complete. 2024-02-28T23:12:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.529+0000 7fd89a400700 1 Processor -- start 2024-02-28T23:12:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.529+0000 7fd89a400700 1 -- start start 2024-02-28T23:12:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.529+0000 7fd89a400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894103000 0x7fd89419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.529+0000 7fd89a400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8941039b0 0x7fd89419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.529+0000 7fd89a400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89419f4d0 con 0x7fd8941039b0 2024-02-28T23:12:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.529+0000 7fd89a400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd894198980 con 0x7fd894103000 2024-02-28T23:12:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.530+0000 7fd892a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8941039b0 0x7fd89419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.530+0000 7fd892a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8941039b0 0x7fd89419ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39624/0 (socket says 172.21.15.159:39624) 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.530+0000 7fd892a00700 1 -- 172.21.15.159:0/1487706063 learned_addr learned my addr 172.21.15.159:0/1487706063 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.530+0000 7fd893400700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894103000 0x7fd89419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.530+0000 7fd892a00700 1 -- 172.21.15.159:0/1487706063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894103000 msgr2=0x7fd89419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.530+0000 7fd892a00700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894103000 0x7fd89419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.530+0000 7fd892a00700 1 -- 172.21.15.159:0/1487706063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8840095f0 con 0x7fd8941039b0 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.530+0000 7fd893400700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894103000 0x7fd89419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.530+0000 7fd892a00700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8941039b0 0x7fd89419ee40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd88000b480 tx=0x7fd88000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.531+0000 7fd88be00700 1 -- 172.21.15.159:0/1487706063 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8800118c0 con 0x7fd8941039b0 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.531+0000 7fd88be00700 1 -- 172.21.15.159:0/1487706063 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd880010380 con 0x7fd8941039b0 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.531+0000 7fd89a400700 1 -- 172.21.15.159:0/1487706063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd894198c60 con 0x7fd8941039b0 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.531+0000 7fd88be00700 1 -- 172.21.15.159:0/1487706063 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd88000f4f0 con 0x7fd8941039b0 2024-02-28T23:12:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.531+0000 7fd89a400700 1 -- 172.21.15.159:0/1487706063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8941991b0 con 0x7fd8941039b0 2024-02-28T23:12:04.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.532+0000 7fd89a400700 1 -- 172.21.15.159:0/1487706063 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89410b3a0 con 0x7fd8941039b0 2024-02-28T23:12:04.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.533+0000 7fd88be00700 1 -- 172.21.15.159:0/1487706063 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7fd8800104f0 con 0x7fd8941039b0 2024-02-28T23:12:04.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.534+0000 7fd88be00700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd87806d520 0x7fd87806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:04.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.534+0000 7fd88be00700 1 -- 172.21.15.159:0/1487706063 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd88008cb70 con 0x7fd8941039b0 2024-02-28T23:12:04.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.534+0000 7fd893400700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd87806d520 0x7fd87806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:04.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.535+0000 7fd893400700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd87806d520 0x7fd87806f9e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd884006010 tx=0x7fd88400b540 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:04.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.539+0000 7fd88be00700 1 -- 172.21.15.159:0/1487706063 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fd88005a360 con 0x7fd8941039b0 2024-02-28T23:12:04.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:04.777+0000 7fd89a400700 1 -- 172.21.15.159:0/1487706063 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}) v1 -- 0x7fd894199480 con 0x7fd87806d520 2024-02-28T23:12:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:05 smithi159 ceph-mon[28802]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:05 smithi159 ceph-mon[28802]: pgmap v126: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:05.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:05 smithi184 ceph-mon[36198]: from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:05.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:05 smithi184 ceph-mon[36198]: pgmap v126: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:07.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:07 smithi159 ceph-mon[28802]: pgmap v127: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:07.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:07 smithi184 ceph-mon[36198]: pgmap v127: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:07.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.655+0000 7fd88be00700 1 -- 172.21.15.159:0/1487706063 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5391 (secure 0 0 0) 0x7fd894199480 con 0x7fd87806d520 2024-02-28T23:12:07.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.659+0000 7fd89a400700 1 -- 172.21.15.159:0/1487706063 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd87806d520 msgr2=0x7fd87806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:07.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.659+0000 7fd89a400700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd87806d520 0x7fd87806f9e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd884006010 tx=0x7fd88400b540 comp rx=0 tx=0).stop 2024-02-28T23:12:07.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.659+0000 7fd89a400700 1 -- 172.21.15.159:0/1487706063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8941039b0 msgr2=0x7fd89419ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:07.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.659+0000 7fd89a400700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8941039b0 0x7fd89419ee40 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd88000b480 tx=0x7fd88000b840 comp rx=0 tx=0).stop 2024-02-28T23:12:07.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.659+0000 7fd89a400700 1 -- 172.21.15.159:0/1487706063 shutdown_connections 2024-02-28T23:12:07.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.659+0000 7fd89a400700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd87806d520 0x7fd87806f9e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:07.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.659+0000 7fd89a400700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd894103000 0x7fd89419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:07.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.659+0000 7fd89a400700 1 --2- 172.21.15.159:0/1487706063 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8941039b0 0x7fd89419ee40 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:07.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.659+0000 7fd89a400700 1 -- 172.21.15.159:0/1487706063 >> 172.21.15.159:0/1487706063 conn(0x7fd8940fe8d0 msgr2=0x7fd8940fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:07.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.659+0000 7fd89a400700 1 -- 172.21.15.159:0/1487706063 shutdown_connections 2024-02-28T23:12:07.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:07.659+0000 7fd89a400700 1 -- 172.21.15.159:0/1487706063 wait complete. 2024-02-28T23:12:07.677 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:12:08.460 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-02-28T23:12:08.866 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:12:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:09 smithi159 ceph-mon[28802]: pgmap v128: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:09.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:09 smithi184 ceph-mon[36198]: pgmap v128: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:11.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.337+0000 7f0967800700 1 -- 172.21.15.159:0/523639365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0960103960 msgr2=0x7f09601079b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:11.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.337+0000 7f0967800700 1 --2- 172.21.15.159:0/523639365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0960103960 0x7f09601079b0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f094c009910 tx=0x7f094c009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:11.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.337+0000 7f0967800700 1 -- 172.21.15.159:0/523639365 shutdown_connections 2024-02-28T23:12:11.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.337+0000 7f0967800700 1 --2- 172.21.15.159:0/523639365 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0960103960 0x7f09601079b0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:11.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.337+0000 7f0967800700 1 --2- 172.21.15.159:0/523639365 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960102fb0 0x7f0960103390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:11.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.337+0000 7f0967800700 1 -- 172.21.15.159:0/523639365 >> 172.21.15.159:0/523639365 conn(0x7f09600fe840 msgr2=0x7f0960100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:11.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.337+0000 7f0967800700 1 -- 172.21.15.159:0/523639365 shutdown_connections 2024-02-28T23:12:11.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.337+0000 7f0967800700 1 -- 172.21.15.159:0/523639365 wait complete. 2024-02-28T23:12:11.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.338+0000 7f0967800700 1 Processor -- start 2024-02-28T23:12:11.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.339+0000 7f0967800700 1 -- start start 2024-02-28T23:12:11.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.339+0000 7f0967800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960102fb0 0x7f096019e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:11.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.339+0000 7f0967800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0960103960 0x7f096019edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:11.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.339+0000 7f0967800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f096019f480 con 0x7f0960103960 2024-02-28T23:12:11.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.339+0000 7f0967800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0960198930 con 0x7f0960102fb0 2024-02-28T23:12:11.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.339+0000 7f095fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0960103960 0x7f096019edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:11.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.339+0000 7f095fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0960103960 0x7f096019edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52964/0 (socket says 172.21.15.159:52964) 2024-02-28T23:12:11.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.339+0000 7f095fe00700 1 -- 172.21.15.159:0/207033319 learned_addr learned my addr 172.21.15.159:0/207033319 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:11.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.340+0000 7f0964e00700 1 --2- 172.21.15.159:0/207033319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960102fb0 0x7f096019e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:11.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.340+0000 7f095fe00700 1 -- 172.21.15.159:0/207033319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960102fb0 msgr2=0x7f096019e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:11.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.340+0000 7f095fe00700 1 --2- 172.21.15.159:0/207033319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960102fb0 0x7f096019e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:11.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.340+0000 7f095fe00700 1 -- 172.21.15.159:0/207033319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f094c0095f0 con 0x7f0960103960 2024-02-28T23:12:11.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.340+0000 7f095fe00700 1 --2- 172.21.15.159:0/207033319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0960103960 0x7f096019edf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f094c0092e0 tx=0x7f094c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:11.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.340+0000 7f095d600700 1 -- 172.21.15.159:0/207033319 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f094c01d070 con 0x7f0960103960 2024-02-28T23:12:11.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.340+0000 7f095d600700 1 -- 172.21.15.159:0/207033319 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f094c00f460 con 0x7f0960103960 2024-02-28T23:12:11.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.340+0000 7f0967800700 1 -- 172.21.15.159:0/207033319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0960198bb0 con 0x7f0960103960 2024-02-28T23:12:11.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.340+0000 7f095d600700 1 -- 172.21.15.159:0/207033319 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f094c0175f0 con 0x7f0960103960 2024-02-28T23:12:11.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.341+0000 7f0967800700 1 -- 172.21.15.159:0/207033319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09601990a0 con 0x7f0960103960 2024-02-28T23:12:11.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.342+0000 7f0967800700 1 -- 172.21.15.159:0/207033319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096010b300 con 0x7f0960103960 2024-02-28T23:12:11.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.343+0000 7f095d600700 1 -- 172.21.15.159:0/207033319 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f094c00f5d0 con 0x7f0960103960 2024-02-28T23:12:11.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.344+0000 7f095d600700 1 --2- 172.21.15.159:0/207033319 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f094806d520 0x7f094806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:11.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.344+0000 7f095d600700 1 -- 172.21.15.159:0/207033319 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f094c08e570 con 0x7f0960103960 2024-02-28T23:12:11.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.344+0000 7f0964e00700 1 --2- 172.21.15.159:0/207033319 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f094806d520 0x7f094806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:11.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.345+0000 7f0964e00700 1 --2- 172.21.15.159:0/207033319 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f094806d520 0x7f094806f9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0954006fd0 tx=0x7f0954008040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:11.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.349+0000 7f095d600700 1 -- 172.21.15.159:0/207033319 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f094c05bce0 con 0x7f0960103960 2024-02-28T23:12:11.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:11 smithi159 ceph-mon[28802]: pgmap v129: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:11.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.581+0000 7f0967800700 1 -- 172.21.15.159:0/207033319 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f096002cce0 con 0x7f094806d520 2024-02-28T23:12:11.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:11 smithi184 ceph-mon[36198]: pgmap v129: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:11.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.614+0000 7f095d600700 1 -- 172.21.15.159:0/207033319 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f096002cce0 con 0x7f094806d520 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (103s) 57s ago 15m 13.6M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (16m) 57s ago 16m 8246k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (14m) 2m ago 14m 7721k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (16m) 57s ago 16m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (14m) 2m ago 14m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (65s) 57s ago 15m 52.4M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (8m) 57s ago 8m 149M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (8m) 57s ago 8m 86.4M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (8m) 2m ago 8m 15.0M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (8m) 2m ago 8m 14.9M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:12:11.614 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (4m) 57s ago 17m 502M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (3m) 2m ago 14m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (17m) 57s ago 18m 55.3M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (14m) 2m ago 14m 43.2M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (2m) 57s ago 16m 7814k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (2m) 2m ago 14m 2939k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (13m) 57s ago 13m 233M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (12m) 57s ago 12m 249M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (12m) 57s ago 12m 210M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (11m) 2m ago 11m 286M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (11m) 2m ago 11m 242M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (10m) 2m ago 10m 219M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:12:11.615 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (2m) 57s ago 15m 46.0M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:12:11.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.617+0000 7f0967800700 1 -- 172.21.15.159:0/207033319 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f094806d520 msgr2=0x7f094806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:11.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.617+0000 7f0967800700 1 --2- 172.21.15.159:0/207033319 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f094806d520 0x7f094806f9e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0954006fd0 tx=0x7f0954008040 comp rx=0 tx=0).stop 2024-02-28T23:12:11.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.617+0000 7f0967800700 1 -- 172.21.15.159:0/207033319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0960103960 msgr2=0x7f096019edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:11.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.617+0000 7f0967800700 1 --2- 172.21.15.159:0/207033319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0960103960 0x7f096019edf0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f094c0092e0 tx=0x7f094c00be20 comp rx=0 tx=0).stop 2024-02-28T23:12:11.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.617+0000 7f0967800700 1 -- 172.21.15.159:0/207033319 shutdown_connections 2024-02-28T23:12:11.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.617+0000 7f0967800700 1 --2- 172.21.15.159:0/207033319 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f094806d520 0x7f094806f9e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:11.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.617+0000 7f0967800700 1 --2- 172.21.15.159:0/207033319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0960102fb0 0x7f096019e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:11.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.617+0000 7f0967800700 1 --2- 172.21.15.159:0/207033319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0960103960 0x7f096019edf0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:11.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.617+0000 7f0967800700 1 -- 172.21.15.159:0/207033319 >> 172.21.15.159:0/207033319 conn(0x7f09600fe840 msgr2=0x7f09600fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:11.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.617+0000 7f0967800700 1 -- 172.21.15.159:0/207033319 shutdown_connections 2024-02-28T23:12:11.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:11.617+0000 7f0967800700 1 -- 172.21.15.159:0/207033319 wait complete. 2024-02-28T23:12:12.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:12 smithi184 ceph-mon[36198]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:12.389 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:12 smithi159 ceph-mon[28802]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:12.462 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T23:12:12.463 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:12:12.463 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-02-28T23:12:12.885 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:12:13.394 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:13 smithi159 ceph-mon[28802]: pgmap v130: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:13.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:13 smithi184 ceph-mon[36198]: pgmap v130: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:14 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:12:14.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:14 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:12:15.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.007+0000 7f2c55400700 1 -- 172.21.15.159:0/125126069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c50073130 msgr2=0x7f2c50073510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:15.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.007+0000 7f2c55400700 1 --2- 172.21.15.159:0/125126069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c50073130 0x7f2c50073510 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009910 tx=0x7f2c40009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:15.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.007+0000 7f2c55400700 1 -- 172.21.15.159:0/125126069 shutdown_connections 2024-02-28T23:12:15.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.007+0000 7f2c55400700 1 --2- 172.21.15.159:0/125126069 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c50073a50 0x7f2c50111610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:15.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.007+0000 7f2c55400700 1 --2- 172.21.15.159:0/125126069 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c50073130 0x7f2c50073510 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:15.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.007+0000 7f2c55400700 1 -- 172.21.15.159:0/125126069 >> 172.21.15.159:0/125126069 conn(0x7f2c500fc650 msgr2=0x7f2c500fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:15.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.007+0000 7f2c55400700 1 -- 172.21.15.159:0/125126069 shutdown_connections 2024-02-28T23:12:15.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.007+0000 7f2c55400700 1 -- 172.21.15.159:0/125126069 wait complete. 2024-02-28T23:12:15.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.008+0000 7f2c55400700 1 Processor -- start 2024-02-28T23:12:15.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.009+0000 7f2c55400700 1 -- start start 2024-02-28T23:12:15.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.009+0000 7f2c55400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c50073130 0x7f2c5019cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:15.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.009+0000 7f2c55400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c50073a50 0x7f2c5019d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:15.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.009+0000 7f2c55400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5019d9c0 con 0x7f2c50073a50 2024-02-28T23:12:15.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.009+0000 7f2c55400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c501a1750 con 0x7f2c50073130 2024-02-28T23:12:15.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.009+0000 7f2c45e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c50073a50 0x7f2c5019d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:15.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.009+0000 7f2c45e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c50073a50 0x7f2c5019d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52984/0 (socket says 172.21.15.159:52984) 2024-02-28T23:12:15.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.009+0000 7f2c45e00700 1 -- 172.21.15.159:0/318066008 learned_addr learned my addr 172.21.15.159:0/318066008 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:15.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.010+0000 7f2c4e800700 1 --2- 172.21.15.159:0/318066008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c50073130 0x7f2c5019cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:15.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.010+0000 7f2c45e00700 1 -- 172.21.15.159:0/318066008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c50073130 msgr2=0x7f2c5019cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:15.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.010+0000 7f2c45e00700 1 --2- 172.21.15.159:0/318066008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c50073130 0x7f2c5019cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:15.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.010+0000 7f2c45e00700 1 -- 172.21.15.159:0/318066008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c400095f0 con 0x7f2c50073a50 2024-02-28T23:12:15.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.010+0000 7f2c45e00700 1 --2- 172.21.15.159:0/318066008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c50073a50 0x7f2c5019d2e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800b4b0 tx=0x7f2c3800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:15.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.011+0000 7f2c47e00700 1 -- 172.21.15.159:0/318066008 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c38011800 con 0x7f2c50073a50 2024-02-28T23:12:15.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.011+0000 7f2c47e00700 1 -- 172.21.15.159:0/318066008 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2c38011e20 con 0x7f2c50073a50 2024-02-28T23:12:15.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.011+0000 7f2c55400700 1 -- 172.21.15.159:0/318066008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c501a1a30 con 0x7f2c50073a50 2024-02-28T23:12:15.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.011+0000 7f2c47e00700 1 -- 172.21.15.159:0/318066008 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c3800f2e0 con 0x7f2c50073a50 2024-02-28T23:12:15.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.011+0000 7f2c55400700 1 -- 172.21.15.159:0/318066008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c501a1f80 con 0x7f2c50073a50 2024-02-28T23:12:15.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.012+0000 7f2c55400700 1 -- 172.21.15.159:0/318066008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c5010ed90 con 0x7f2c50073a50 2024-02-28T23:12:15.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.013+0000 7f2c47e00700 1 -- 172.21.15.159:0/318066008 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f2c38010380 con 0x7f2c50073a50 2024-02-28T23:12:15.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.014+0000 7f2c47e00700 1 --2- 172.21.15.159:0/318066008 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f2c3406d520 0x7f2c3406f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:15.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.014+0000 7f2c47e00700 1 -- 172.21.15.159:0/318066008 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f2c3808cb20 con 0x7f2c50073a50 2024-02-28T23:12:15.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.014+0000 7f2c4e800700 1 --2- 172.21.15.159:0/318066008 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f2c3406d520 0x7f2c3406f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:15.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.015+0000 7f2c4e800700 1 --2- 172.21.15.159:0/318066008 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f2c3406d520 0x7f2c3406f9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c40006010 tx=0x7f2c4001a040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:15.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.019+0000 7f2c47e00700 1 -- 172.21.15.159:0/318066008 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f2c38056800 con 0x7f2c50073a50 2024-02-28T23:12:15.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.241+0000 7f2c55400700 1 -- 172.21.15.159:0/318066008 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f2c5004ea90 con 0x7f2c50073a50 2024-02-28T23:12:15.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.248+0000 7f2c47e00700 1 -- 172.21.15.159:0/318066008 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v44)=0 v44) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2c38059ec0 con 0x7f2c50073a50 2024-02-28T23:12:15.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.251+0000 7f2c55400700 1 -- 172.21.15.159:0/318066008 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f2c3406d520 msgr2=0x7f2c3406f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:15.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.251+0000 7f2c55400700 1 --2- 172.21.15.159:0/318066008 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f2c3406d520 0x7f2c3406f9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2c40006010 tx=0x7f2c4001a040 comp rx=0 tx=0).stop 2024-02-28T23:12:15.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.251+0000 7f2c55400700 1 -- 172.21.15.159:0/318066008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c50073a50 msgr2=0x7f2c5019d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:15.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.251+0000 7f2c55400700 1 --2- 172.21.15.159:0/318066008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c50073a50 0x7f2c5019d2e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2c3800b4b0 tx=0x7f2c3800b870 comp rx=0 tx=0).stop 2024-02-28T23:12:15.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.252+0000 7f2c55400700 1 -- 172.21.15.159:0/318066008 shutdown_connections 2024-02-28T23:12:15.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.252+0000 7f2c55400700 1 --2- 172.21.15.159:0/318066008 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f2c3406d520 0x7f2c3406f9e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:15.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.252+0000 7f2c55400700 1 --2- 172.21.15.159:0/318066008 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2c50073130 0x7f2c5019cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:15.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.252+0000 7f2c55400700 1 --2- 172.21.15.159:0/318066008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2c50073a50 0x7f2c5019d2e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:15.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.252+0000 7f2c55400700 1 -- 172.21.15.159:0/318066008 >> 172.21.15.159:0/318066008 conn(0x7f2c500fc650 msgr2=0x7f2c50103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:15.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.252+0000 7f2c55400700 1 -- 172.21.15.159:0/318066008 shutdown_connections 2024-02-28T23:12:15.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:15.252+0000 7f2c55400700 1 -- 172.21.15.159:0/318066008 wait complete. 2024-02-28T23:12:15.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:15 smithi184 ceph-mon[36198]: pgmap v131: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:15.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:15 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/318066008' entity='client.admin' 2024-02-28T23:12:15.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:15 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:12:15.962 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:15 smithi159 ceph-mon[28802]: pgmap v131: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:15.962 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:15 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/318066008' entity='client.admin' 2024-02-28T23:12:15.962 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:15 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:12:16.014 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T23:12:16.014 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:12:16.015 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-28T23:12:16.440 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:12:16.834 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:16 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:12:16.834 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:16 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:12:16.835 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:16 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:16.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:16 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:12:16.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:16 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:12:16.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:16 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:17.819 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:17 smithi159 ceph-mon[28802]: pgmap v132: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:17.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:17 smithi184 ceph-mon[36198]: pgmap v132: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:18.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.715+0000 7f9adf600700 1 -- 172.21.15.159:0/949568790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ad81039b0 msgr2=0x7f9ad8107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:18.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.715+0000 7f9adf600700 1 --2- 172.21.15.159:0/949568790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ad81039b0 0x7f9ad8107a00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009910 tx=0x7f9ac4009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:18.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.715+0000 7f9adf600700 1 -- 172.21.15.159:0/949568790 shutdown_connections 2024-02-28T23:12:18.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.715+0000 7f9adf600700 1 --2- 172.21.15.159:0/949568790 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ad81039b0 0x7f9ad8107a00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:18.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.715+0000 7f9adf600700 1 --2- 172.21.15.159:0/949568790 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad8103000 0x7f9ad81033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:18.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.715+0000 7f9adf600700 1 -- 172.21.15.159:0/949568790 >> 172.21.15.159:0/949568790 conn(0x7f9ad80fe8d0 msgr2=0x7f9ad8100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:18.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.715+0000 7f9adf600700 1 -- 172.21.15.159:0/949568790 shutdown_connections 2024-02-28T23:12:18.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.716+0000 7f9adf600700 1 -- 172.21.15.159:0/949568790 wait complete. 2024-02-28T23:12:18.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.717+0000 7f9adf600700 1 Processor -- start 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.717+0000 7f9adf600700 1 -- start start 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.717+0000 7f9adf600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ad8103000 0x7f9ad819e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.717+0000 7f9adf600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad81039b0 0x7f9ad819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.717+0000 7f9adf600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad819f390 con 0x7f9ad8103000 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.717+0000 7f9adf600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad8198840 con 0x7f9ad81039b0 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.718+0000 7f9adcc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ad8103000 0x7f9ad819e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.718+0000 7f9adcc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ad8103000 0x7f9ad819e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38164/0 (socket says 172.21.15.159:38164) 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.718+0000 7f9adcc00700 1 -- 172.21.15.159:0/531463289 learned_addr learned my addr 172.21.15.159:0/531463289 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.718+0000 7f9ad7e00700 1 --2- 172.21.15.159:0/531463289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad81039b0 0x7f9ad819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.718+0000 7f9adcc00700 1 -- 172.21.15.159:0/531463289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad81039b0 msgr2=0x7f9ad819ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.718+0000 7f9adcc00700 1 --2- 172.21.15.159:0/531463289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad81039b0 0x7f9ad819ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:18.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.718+0000 7f9adcc00700 1 -- 172.21.15.159:0/531463289 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40095f0 con 0x7f9ad8103000 2024-02-28T23:12:18.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.718+0000 7f9adcc00700 1 --2- 172.21.15.159:0/531463289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ad8103000 0x7f9ad819e7c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00c8a0 tx=0x7f9acc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:18.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.719+0000 7f9ad5600700 1 -- 172.21.15.159:0/531463289 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9acc00cea0 con 0x7f9ad8103000 2024-02-28T23:12:18.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.719+0000 7f9ad5600700 1 -- 172.21.15.159:0/531463289 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9acc004830 con 0x7f9ad8103000 2024-02-28T23:12:18.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.719+0000 7f9ad5600700 1 -- 172.21.15.159:0/531463289 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9acc0055b0 con 0x7f9ad8103000 2024-02-28T23:12:18.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.719+0000 7f9adf600700 1 -- 172.21.15.159:0/531463289 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad8198b20 con 0x7f9ad8103000 2024-02-28T23:12:18.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.719+0000 7f9adf600700 1 -- 172.21.15.159:0/531463289 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad8199070 con 0x7f9ad8103000 2024-02-28T23:12:18.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.720+0000 7f9adf600700 1 -- 172.21.15.159:0/531463289 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad810b400 con 0x7f9ad8103000 2024-02-28T23:12:18.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.721+0000 7f9ad5600700 1 -- 172.21.15.159:0/531463289 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f9acc0049a0 con 0x7f9ad8103000 2024-02-28T23:12:18.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.722+0000 7f9ad5600700 1 --2- 172.21.15.159:0/531463289 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9ac006d520 0x7f9ac006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:18.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.722+0000 7f9ad5600700 1 -- 172.21.15.159:0/531463289 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f9acc08cbd0 con 0x7f9ad8103000 2024-02-28T23:12:18.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.722+0000 7f9ad7e00700 1 --2- 172.21.15.159:0/531463289 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9ac006d520 0x7f9ac006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:18.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.723+0000 7f9ad7e00700 1 --2- 172.21.15.159:0/531463289 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9ac006d520 0x7f9ac006f9e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006010 tx=0x7f9ac400b540 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:18.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.727+0000 7f9ad5600700 1 -- 172.21.15.159:0/531463289 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f9acc05a3c0 con 0x7f9ad8103000 2024-02-28T23:12:18.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.944+0000 7f9adf600700 1 -- 172.21.15.159:0/531463289 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f9ad804ea90 con 0x7f9ad8103000 2024-02-28T23:12:18.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.945+0000 7f9ad5600700 1 -- 172.21.15.159:0/531463289 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v44)=0 v44) v1 ==== 155+0+0 (secure 0 0 0) 0x7f9acc01d020 con 0x7f9ad8103000 2024-02-28T23:12:18.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.949+0000 7f9adf600700 1 -- 172.21.15.159:0/531463289 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9ac006d520 msgr2=0x7f9ac006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:18.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.949+0000 7f9adf600700 1 --2- 172.21.15.159:0/531463289 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9ac006d520 0x7f9ac006f9e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006010 tx=0x7f9ac400b540 comp rx=0 tx=0).stop 2024-02-28T23:12:18.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.949+0000 7f9adf600700 1 -- 172.21.15.159:0/531463289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ad8103000 msgr2=0x7f9ad819e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:18.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.949+0000 7f9adf600700 1 --2- 172.21.15.159:0/531463289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ad8103000 0x7f9ad819e7c0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9acc00c8a0 tx=0x7f9acc00cc60 comp rx=0 tx=0).stop 2024-02-28T23:12:18.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.949+0000 7f9adf600700 1 -- 172.21.15.159:0/531463289 shutdown_connections 2024-02-28T23:12:18.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.949+0000 7f9adf600700 1 --2- 172.21.15.159:0/531463289 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f9ac006d520 0x7f9ac006f9e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:18.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.949+0000 7f9adf600700 1 --2- 172.21.15.159:0/531463289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ad8103000 0x7f9ad819e7c0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:18.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.949+0000 7f9adf600700 1 --2- 172.21.15.159:0/531463289 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ad81039b0 0x7f9ad819ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:18.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.949+0000 7f9adf600700 1 -- 172.21.15.159:0/531463289 >> 172.21.15.159:0/531463289 conn(0x7f9ad80fe8d0 msgr2=0x7f9ad8100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:18.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.949+0000 7f9adf600700 1 -- 172.21.15.159:0/531463289 shutdown_connections 2024-02-28T23:12:18.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:18.949+0000 7f9adf600700 1 -- 172.21.15.159:0/531463289 wait complete. 2024-02-28T23:12:19.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:19 smithi159 ceph-mon[28802]: pgmap v133: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:19.828 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-28T23:12:19.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:19 smithi184 ceph-mon[36198]: pgmap v133: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:20.238 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:12:21.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:21 smithi159 ceph-mon[28802]: pgmap v134: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:21 smithi184 ceph-mon[36198]: pgmap v134: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:22.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.455+0000 7fb8b0000700 1 -- 172.21.15.159:0/2394667459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a8073ae0 msgr2=0x7fb8a810ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:22.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.455+0000 7fb8b0000700 1 --2- 172.21.15.159:0/2394667459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a8073ae0 0x7fb8a810ce40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb894009910 tx=0x7fb894009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:22.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.455+0000 7fb8b0000700 1 -- 172.21.15.159:0/2394667459 shutdown_connections 2024-02-28T23:12:22.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.455+0000 7fb8b0000700 1 --2- 172.21.15.159:0/2394667459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a8073ae0 0x7fb8a810ce40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:22.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.455+0000 7fb8b0000700 1 --2- 172.21.15.159:0/2394667459 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8a80731c0 0x7fb8a80735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:22.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.455+0000 7fb8b0000700 1 -- 172.21.15.159:0/2394667459 >> 172.21.15.159:0/2394667459 conn(0x7fb8a80fc630 msgr2=0x7fb8a80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:22.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.455+0000 7fb8b0000700 1 -- 172.21.15.159:0/2394667459 shutdown_connections 2024-02-28T23:12:22.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.455+0000 7fb8b0000700 1 -- 172.21.15.159:0/2394667459 wait complete. 2024-02-28T23:12:22.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.456+0000 7fb8b0000700 1 Processor -- start 2024-02-28T23:12:22.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.456+0000 7fb8b0000700 1 -- start start 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.457+0000 7fb8b0000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8a80731c0 0x7fb8a8198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.457+0000 7fb8b0000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a8073ae0 0x7fb8a8198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.457+0000 7fb8b0000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a8199530 con 0x7fb8a8073ae0 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.457+0000 7fb8b0000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a819d340 con 0x7fb8a80731c0 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.457+0000 7fb8acc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a8073ae0 0x7fb8a8198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.457+0000 7fb8acc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a8073ae0 0x7fb8a8198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38176/0 (socket says 172.21.15.159:38176) 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.457+0000 7fb8acc00700 1 -- 172.21.15.159:0/3523678268 learned_addr learned my addr 172.21.15.159:0/3523678268 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.457+0000 7fb8acc00700 1 -- 172.21.15.159:0/3523678268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8a80731c0 msgr2=0x7fb8a8198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.457+0000 7fb8acc00700 1 --2- 172.21.15.159:0/3523678268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8a80731c0 0x7fb8a8198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.457+0000 7fb8acc00700 1 -- 172.21.15.159:0/3523678268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8940095f0 con 0x7fb8a8073ae0 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.458+0000 7fb8acc00700 1 --2- 172.21.15.159:0/3523678268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a8073ae0 0x7fb8a8198ea0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb894006010 tx=0x7fb89400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:22.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.458+0000 7fb8a6000700 1 -- 172.21.15.159:0/3523678268 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb89401d070 con 0x7fb8a8073ae0 2024-02-28T23:12:22.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.458+0000 7fb8a6000700 1 -- 172.21.15.159:0/3523678268 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb894004fb0 con 0x7fb8a8073ae0 2024-02-28T23:12:22.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.458+0000 7fb8b0000700 1 -- 172.21.15.159:0/3523678268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a819d5c0 con 0x7fb8a8073ae0 2024-02-28T23:12:22.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.458+0000 7fb8a6000700 1 -- 172.21.15.159:0/3523678268 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb89400f480 con 0x7fb8a8073ae0 2024-02-28T23:12:22.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.458+0000 7fb8b0000700 1 -- 172.21.15.159:0/3523678268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a819dab0 con 0x7fb8a8073ae0 2024-02-28T23:12:22.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.459+0000 7fb8b0000700 1 -- 172.21.15.159:0/3523678268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a810a540 con 0x7fb8a8073ae0 2024-02-28T23:12:22.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.461+0000 7fb8a6000700 1 -- 172.21.15.159:0/3523678268 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7fb894022890 con 0x7fb8a8073ae0 2024-02-28T23:12:22.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.462+0000 7fb8a6000700 1 --2- 172.21.15.159:0/3523678268 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb89006d520 0x7fb89006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:22.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.462+0000 7fb8a6000700 1 -- 172.21.15.159:0/3523678268 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fb89408e610 con 0x7fb8a8073ae0 2024-02-28T23:12:22.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.463+0000 7fb8ad600700 1 --2- 172.21.15.159:0/3523678268 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb89006d520 0x7fb89006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:22.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.463+0000 7fb8ad600700 1 --2- 172.21.15.159:0/3523678268 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb89006d520 0x7fb89006f9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00a990 tx=0x7fb89c005c80 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:22.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.467+0000 7fb8a6000700 1 -- 172.21.15.159:0/3523678268 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fb89405bff0 con 0x7fb8a8073ae0 2024-02-28T23:12:22.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.686+0000 7fb8b0000700 1 -- 172.21.15.159:0/3523678268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fb8a819dd90 con 0x7fb8a8073ae0 2024-02-28T23:12:22.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.687+0000 7fb8a6000700 1 -- 172.21.15.159:0/3523678268 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v44)=0 v44) v1 ==== 163+0+0 (secure 0 0 0) 0x7fb89405bb80 con 0x7fb8a8073ae0 2024-02-28T23:12:22.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.690+0000 7fb8b0000700 1 -- 172.21.15.159:0/3523678268 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb89006d520 msgr2=0x7fb89006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:22.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.690+0000 7fb8b0000700 1 --2- 172.21.15.159:0/3523678268 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb89006d520 0x7fb89006f9e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00a990 tx=0x7fb89c005c80 comp rx=0 tx=0).stop 2024-02-28T23:12:22.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.690+0000 7fb8b0000700 1 -- 172.21.15.159:0/3523678268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a8073ae0 msgr2=0x7fb8a8198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:22.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.690+0000 7fb8b0000700 1 --2- 172.21.15.159:0/3523678268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a8073ae0 0x7fb8a8198ea0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb894006010 tx=0x7fb89400be20 comp rx=0 tx=0).stop 2024-02-28T23:12:22.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.690+0000 7fb8b0000700 1 -- 172.21.15.159:0/3523678268 shutdown_connections 2024-02-28T23:12:22.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.690+0000 7fb8b0000700 1 --2- 172.21.15.159:0/3523678268 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fb89006d520 0x7fb89006f9e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:22.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.690+0000 7fb8b0000700 1 --2- 172.21.15.159:0/3523678268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb8a80731c0 0x7fb8a8198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:22.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.690+0000 7fb8b0000700 1 --2- 172.21.15.159:0/3523678268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb8a8073ae0 0x7fb8a8198ea0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:22.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.690+0000 7fb8b0000700 1 -- 172.21.15.159:0/3523678268 >> 172.21.15.159:0/3523678268 conn(0x7fb8a80fc630 msgr2=0x7fb8a8107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:22.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.690+0000 7fb8b0000700 1 -- 172.21.15.159:0/3523678268 shutdown_connections 2024-02-28T23:12:22.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:22.690+0000 7fb8b0000700 1 -- 172.21.15.159:0/3523678268 wait complete. 2024-02-28T23:12:23.450 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:23 smithi159 ceph-mon[28802]: pgmap v135: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:23.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph config set global log_to_journald false --force' 2024-02-28T23:12:23.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:23 smithi184 ceph-mon[36198]: pgmap v135: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:23.919 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:12:25.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:25 smithi159 ceph-mon[28802]: pgmap v136: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:25.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:25 smithi184 ceph-mon[36198]: pgmap v136: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:26.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.452+0000 7f7cffc00700 1 -- 172.21.15.159:0/3714103226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cf8068670 msgr2=0x7f7cf8068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:26.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.452+0000 7f7cffc00700 1 --2- 172.21.15.159:0/3714103226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cf8068670 0x7f7cf8068a50 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009910 tx=0x7f7cec009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:26.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.453+0000 7f7cffc00700 1 -- 172.21.15.159:0/3714103226 shutdown_connections 2024-02-28T23:12:26.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.453+0000 7f7cffc00700 1 --2- 172.21.15.159:0/3714103226 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf8069020 0x7f7cf8105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:26.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.453+0000 7f7cffc00700 1 --2- 172.21.15.159:0/3714103226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cf8068670 0x7f7cf8068a50 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:26.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.453+0000 7f7cffc00700 1 -- 172.21.15.159:0/3714103226 >> 172.21.15.159:0/3714103226 conn(0x7f7cf80755a0 msgr2=0x7f7cf80759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:26.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.453+0000 7f7cffc00700 1 -- 172.21.15.159:0/3714103226 shutdown_connections 2024-02-28T23:12:26.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.453+0000 7f7cffc00700 1 -- 172.21.15.159:0/3714103226 wait complete. 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.454+0000 7f7cffc00700 1 Processor -- start 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.454+0000 7f7cffc00700 1 -- start start 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.454+0000 7f7cffc00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf8068670 0x7f7cf819c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.454+0000 7f7cffc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cf8069020 0x7f7cf819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.454+0000 7f7cffc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf819d290 con 0x7f7cf8069020 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.454+0000 7f7cffc00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf8196740 con 0x7f7cf8068670 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.455+0000 7f7cf7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cf8069020 0x7f7cf819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.455+0000 7f7cf7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cf8069020 0x7f7cf819cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38196/0 (socket says 172.21.15.159:38196) 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.455+0000 7f7cf7e00700 1 -- 172.21.15.159:0/1460457340 learned_addr learned my addr 172.21.15.159:0/1460457340 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.455+0000 7f7cfd200700 1 --2- 172.21.15.159:0/1460457340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf8068670 0x7f7cf819c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.455+0000 7f7cf7e00700 1 -- 172.21.15.159:0/1460457340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf8068670 msgr2=0x7f7cf819c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.455+0000 7f7cf7e00700 1 --2- 172.21.15.159:0/1460457340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf8068670 0x7f7cf819c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:26.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.455+0000 7f7cf7e00700 1 -- 172.21.15.159:0/1460457340 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec0095f0 con 0x7f7cf8069020 2024-02-28T23:12:26.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.456+0000 7f7cf7e00700 1 --2- 172.21.15.159:0/1460457340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cf8069020 0x7f7cf819cc00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400b480 tx=0x7f7ce400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:26.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.456+0000 7f7cf5600700 1 -- 172.21.15.159:0/1460457340 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ce40118c0 con 0x7f7cf8069020 2024-02-28T23:12:26.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.456+0000 7f7cf5600700 1 -- 172.21.15.159:0/1460457340 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ce4010380 con 0x7f7cf8069020 2024-02-28T23:12:26.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.456+0000 7f7cffc00700 1 -- 172.21.15.159:0/1460457340 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf8196a20 con 0x7f7cf8069020 2024-02-28T23:12:26.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.456+0000 7f7cf5600700 1 -- 172.21.15.159:0/1460457340 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ce400f4f0 con 0x7f7cf8069020 2024-02-28T23:12:26.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.456+0000 7f7cffc00700 1 -- 172.21.15.159:0/1460457340 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf8196f70 con 0x7f7cf8069020 2024-02-28T23:12:26.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.457+0000 7f7cffc00700 1 -- 172.21.15.159:0/1460457340 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf8109130 con 0x7f7cf8069020 2024-02-28T23:12:26.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.459+0000 7f7cf5600700 1 -- 172.21.15.159:0/1460457340 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f7ce40104f0 con 0x7f7cf8069020 2024-02-28T23:12:26.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.462+0000 7f7cf5600700 1 --2- 172.21.15.159:0/1460457340 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7ce006d570 0x7f7ce006fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:26.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.462+0000 7f7cf5600700 1 -- 172.21.15.159:0/1460457340 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7ce408cb70 con 0x7f7cf8069020 2024-02-28T23:12:26.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.462+0000 7f7cfd200700 1 --2- 172.21.15.159:0/1460457340 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7ce006d570 0x7f7ce006fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:26.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.463+0000 7f7cfd200700 1 --2- 172.21.15.159:0/1460457340 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7ce006d570 0x7f7ce006fa30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7cec006010 tx=0x7f7cec01a040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:26.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.465+0000 7f7cf5600700 1 -- 172.21.15.159:0/1460457340 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f7ce405a360 con 0x7f7cf8069020 2024-02-28T23:12:26.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.680+0000 7f7cffc00700 1 -- 172.21.15.159:0/1460457340 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f7cf8197240 con 0x7f7cf8069020 2024-02-28T23:12:26.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.681+0000 7f7cf5600700 1 -- 172.21.15.159:0/1460457340 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v44)=0 v44) v1 ==== 135+0+0 (secure 0 0 0) 0x7f7ce4059ef0 con 0x7f7cf8069020 2024-02-28T23:12:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.684+0000 7f7cffc00700 1 -- 172.21.15.159:0/1460457340 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7ce006d570 msgr2=0x7f7ce006fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.684+0000 7f7cffc00700 1 --2- 172.21.15.159:0/1460457340 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7ce006d570 0x7f7ce006fa30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7cec006010 tx=0x7f7cec01a040 comp rx=0 tx=0).stop 2024-02-28T23:12:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.684+0000 7f7cffc00700 1 -- 172.21.15.159:0/1460457340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cf8069020 msgr2=0x7f7cf819cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.684+0000 7f7cffc00700 1 --2- 172.21.15.159:0/1460457340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cf8069020 0x7f7cf819cc00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400b480 tx=0x7f7ce400b840 comp rx=0 tx=0).stop 2024-02-28T23:12:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.684+0000 7f7cffc00700 1 -- 172.21.15.159:0/1460457340 shutdown_connections 2024-02-28T23:12:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.684+0000 7f7cffc00700 1 --2- 172.21.15.159:0/1460457340 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7ce006d570 0x7f7ce006fa30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.684+0000 7f7cffc00700 1 --2- 172.21.15.159:0/1460457340 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7cf8068670 0x7f7cf819c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.684+0000 7f7cffc00700 1 --2- 172.21.15.159:0/1460457340 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7cf8069020 0x7f7cf819cc00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.684+0000 7f7cffc00700 1 -- 172.21.15.159:0/1460457340 >> 172.21.15.159:0/1460457340 conn(0x7f7cf80755a0 msgr2=0x7f7cf80fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.684+0000 7f7cffc00700 1 -- 172.21.15.159:0/1460457340 shutdown_connections 2024-02-28T23:12:26.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:26.684+0000 7f7cffc00700 1 -- 172.21.15.159:0/1460457340 wait complete. 2024-02-28T23:12:27.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:27 smithi184 ceph-mon[36198]: pgmap v137: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:27.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:27 smithi159 ceph-mon[28802]: pgmap v137: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:27.551 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-28T23:12:27.973 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:12:29.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:29 smithi159 ceph-mon[28802]: pgmap v138: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:29.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:29 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:12:29.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:29 smithi184 ceph-mon[36198]: pgmap v138: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:29.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:29 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:12:30.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.018+0000 7f017e800700 1 -- 172.21.15.159:0/1381561767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0178068950 msgr2=0x7f0178068dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:30.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.018+0000 7f017e800700 1 --2- 172.21.15.159:0/1381561767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0178068950 0x7f0178068dd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f0164009910 tx=0x7f0164009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:30.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.018+0000 7f017e800700 1 -- 172.21.15.159:0/1381561767 shutdown_connections 2024-02-28T23:12:30.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.018+0000 7f017e800700 1 --2- 172.21.15.159:0/1381561767 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0178068950 0x7f0178068dd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:30.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.018+0000 7f017e800700 1 --2- 172.21.15.159:0/1381561767 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0178105b50 0x7f0178068410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:30.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.018+0000 7f017e800700 1 -- 172.21.15.159:0/1381561767 >> 172.21.15.159:0/1381561767 conn(0x7f01780755a0 msgr2=0x7f01780759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:30.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.018+0000 7f017e800700 1 -- 172.21.15.159:0/1381561767 shutdown_connections 2024-02-28T23:12:30.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.018+0000 7f017e800700 1 -- 172.21.15.159:0/1381561767 wait complete. 2024-02-28T23:12:30.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.019+0000 7f017e800700 1 Processor -- start 2024-02-28T23:12:30.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.019+0000 7f017e800700 1 -- start start 2024-02-28T23:12:30.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.019+0000 7f017e800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0178068950 0x7f01781a2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:30.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.019+0000 7f017e800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0178105b50 0x7f01781a3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:30.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.019+0000 7f017e800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01781a3610 con 0x7f0178105b50 2024-02-28T23:12:30.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.019+0000 7f017e800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017819cb50 con 0x7f0178068950 2024-02-28T23:12:30.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.020+0000 7f0176a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0178105b50 0x7f01781a3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:30.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.020+0000 7f0176a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0178105b50 0x7f01781a3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34662/0 (socket says 172.21.15.159:34662) 2024-02-28T23:12:30.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.020+0000 7f0176a00700 1 -- 172.21.15.159:0/1235154814 learned_addr learned my addr 172.21.15.159:0/1235154814 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:30.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.020+0000 7f0177400700 1 --2- 172.21.15.159:0/1235154814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0178068950 0x7f01781a2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:30.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.020+0000 7f0176a00700 1 -- 172.21.15.159:0/1235154814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0178068950 msgr2=0x7f01781a2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:30.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.020+0000 7f0176a00700 1 --2- 172.21.15.159:0/1235154814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0178068950 0x7f01781a2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:30.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.020+0000 7f0176a00700 1 -- 172.21.15.159:0/1235154814 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01640095f0 con 0x7f0178105b50 2024-02-28T23:12:30.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.021+0000 7f0176a00700 1 --2- 172.21.15.159:0/1235154814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0178105b50 0x7f01781a3010 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f016400b5c0 tx=0x7f016400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:30.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.021+0000 7f016fe00700 1 -- 172.21.15.159:0/1235154814 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f016401d070 con 0x7f0178105b50 2024-02-28T23:12:30.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.021+0000 7f016fe00700 1 -- 172.21.15.159:0/1235154814 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f016400f460 con 0x7f0178105b50 2024-02-28T23:12:30.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.021+0000 7f017e800700 1 -- 172.21.15.159:0/1235154814 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f017819cdd0 con 0x7f0178105b50 2024-02-28T23:12:30.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.021+0000 7f016fe00700 1 -- 172.21.15.159:0/1235154814 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0164017610 con 0x7f0178105b50 2024-02-28T23:12:30.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.021+0000 7f017e800700 1 -- 172.21.15.159:0/1235154814 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f017819d2c0 con 0x7f0178105b50 2024-02-28T23:12:30.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.022+0000 7f017e800700 1 -- 172.21.15.159:0/1235154814 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017804ea90 con 0x7f0178105b50 2024-02-28T23:12:30.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.023+0000 7f016fe00700 1 -- 172.21.15.159:0/1235154814 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f016400f5d0 con 0x7f0178105b50 2024-02-28T23:12:30.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.024+0000 7f016fe00700 1 --2- 172.21.15.159:0/1235154814 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f015c06d520 0x7f015c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:30.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.024+0000 7f016fe00700 1 -- 172.21.15.159:0/1235154814 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f016408e620 con 0x7f0178105b50 2024-02-28T23:12:30.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.025+0000 7f0177400700 1 --2- 172.21.15.159:0/1235154814 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f015c06d520 0x7f015c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:30.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.025+0000 7f0177400700 1 --2- 172.21.15.159:0/1235154814 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f015c06d520 0x7f015c06f9e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0168005fd0 tx=0x7f0168005e50 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:30.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.029+0000 7f016fe00700 1 -- 172.21.15.159:0/1235154814 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f016405bd90 con 0x7f0178105b50 2024-02-28T23:12:30.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.267+0000 7f017e800700 1 -- 172.21.15.159:0/1235154814 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}) v1 -- 0x7f017819d6f0 con 0x7f015c06d520 2024-02-28T23:12:30.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.276+0000 7f016fe00700 1 -- 172.21.15.159:0/1235154814 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f017819d6f0 con 0x7f015c06d520 2024-02-28T23:12:30.275 INFO:teuthology.orchestra.run.smithi159.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:12:30.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.279+0000 7f017e800700 1 -- 172.21.15.159:0/1235154814 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f015c06d520 msgr2=0x7f015c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:30.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.279+0000 7f017e800700 1 --2- 172.21.15.159:0/1235154814 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f015c06d520 0x7f015c06f9e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0168005fd0 tx=0x7f0168005e50 comp rx=0 tx=0).stop 2024-02-28T23:12:30.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.279+0000 7f017e800700 1 -- 172.21.15.159:0/1235154814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0178105b50 msgr2=0x7f01781a3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:30.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.279+0000 7f017e800700 1 --2- 172.21.15.159:0/1235154814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0178105b50 0x7f01781a3010 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f016400b5c0 tx=0x7f016400be00 comp rx=0 tx=0).stop 2024-02-28T23:12:30.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.279+0000 7f017e800700 1 -- 172.21.15.159:0/1235154814 shutdown_connections 2024-02-28T23:12:30.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.279+0000 7f017e800700 1 --2- 172.21.15.159:0/1235154814 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f015c06d520 0x7f015c06f9e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:30.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.279+0000 7f017e800700 1 --2- 172.21.15.159:0/1235154814 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0178068950 0x7f01781a2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:30.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.279+0000 7f017e800700 1 --2- 172.21.15.159:0/1235154814 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0178105b50 0x7f01781a3010 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:30.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.279+0000 7f017e800700 1 -- 172.21.15.159:0/1235154814 >> 172.21.15.159:0/1235154814 conn(0x7f01780755a0 msgr2=0x7f0178101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:30.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.280+0000 7f017e800700 1 -- 172.21.15.159:0/1235154814 shutdown_connections 2024-02-28T23:12:30.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:30.280+0000 7f017e800700 1 -- 172.21.15.159:0/1235154814 wait complete. 2024-02-28T23:12:31.367 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-02-28T23:12:31.367 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:12:31.367 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-02-28T23:12:31.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:31 smithi184 ceph-mon[36198]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:31.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:31 smithi184 ceph-mon[36198]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:12:31.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:31 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:31.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:31 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:12:31.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:31 smithi184 ceph-mon[36198]: pgmap v139: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:31.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:31 smithi159 ceph-mon[28802]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:31.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:31 smithi159 ceph-mon[28802]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:12:31.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:31 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:31.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:31 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:12:31.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:31 smithi159 ceph-mon[28802]: pgmap v139: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:31.769 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:12:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:32 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:12:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:32 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:12:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:32 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:32.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:32 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:12:32.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:32 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:12:32.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:32 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:33.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:33 smithi184 ceph-mon[36198]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:12:33.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:33 smithi184 ceph-mon[36198]: pgmap v140: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:33.698 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:33 smithi159 ceph-mon[28802]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:1fb5d10608dccee73edd6ef8a2c7b804a097c324 2024-02-28T23:12:33.698 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:33 smithi159 ceph-mon[28802]: pgmap v140: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:34.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.049+0000 7f769ee00700 1 -- 172.21.15.159:0/2463258352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76981039b0 msgr2=0x7f7698107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:34.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.049+0000 7f769ee00700 1 --2- 172.21.15.159:0/2463258352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76981039b0 0x7f7698107a00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7680009910 tx=0x7f7680009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:34.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.049+0000 7f769ee00700 1 -- 172.21.15.159:0/2463258352 shutdown_connections 2024-02-28T23:12:34.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.049+0000 7f769ee00700 1 --2- 172.21.15.159:0/2463258352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76981039b0 0x7f7698107a00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.049+0000 7f769ee00700 1 --2- 172.21.15.159:0/2463258352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7698103000 0x7f76981033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.049+0000 7f769ee00700 1 -- 172.21.15.159:0/2463258352 >> 172.21.15.159:0/2463258352 conn(0x7f76980fe8d0 msgr2=0x7f7698100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:34.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.049+0000 7f769ee00700 1 -- 172.21.15.159:0/2463258352 shutdown_connections 2024-02-28T23:12:34.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.050+0000 7f769ee00700 1 -- 172.21.15.159:0/2463258352 wait complete. 2024-02-28T23:12:34.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.051+0000 7f769ee00700 1 Processor -- start 2024-02-28T23:12:34.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.051+0000 7f769ee00700 1 -- start start 2024-02-28T23:12:34.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.051+0000 7f769ee00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7698103000 0x7f769819e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:34.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.051+0000 7f769ee00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76981039b0 0x7f769819ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:34.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.051+0000 7f769ee00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f769819f390 con 0x7f76981039b0 2024-02-28T23:12:34.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.051+0000 7f769ee00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7698198840 con 0x7f7698103000 2024-02-28T23:12:34.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.052+0000 7f768fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76981039b0 0x7f769819ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:34.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.052+0000 7f768fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76981039b0 0x7f769819ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34680/0 (socket says 172.21.15.159:34680) 2024-02-28T23:12:34.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.052+0000 7f768fe00700 1 -- 172.21.15.159:0/3498661016 learned_addr learned my addr 172.21.15.159:0/3498661016 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:34.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.052+0000 7f7697e00700 1 --2- 172.21.15.159:0/3498661016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7698103000 0x7f769819e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:34.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.052+0000 7f768fe00700 1 -- 172.21.15.159:0/3498661016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7698103000 msgr2=0x7f769819e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:34.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.052+0000 7f768fe00700 1 --2- 172.21.15.159:0/3498661016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7698103000 0x7f769819e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.052+0000 7f768fe00700 1 -- 172.21.15.159:0/3498661016 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76800095f0 con 0x7f76981039b0 2024-02-28T23:12:34.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.052+0000 7f768fe00700 1 --2- 172.21.15.159:0/3498661016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76981039b0 0x7f769819ed00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f768000bda0 tx=0x7f768000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:34.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.053+0000 7f7695600700 1 -- 172.21.15.159:0/3498661016 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f768001d070 con 0x7f76981039b0 2024-02-28T23:12:34.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.053+0000 7f769ee00700 1 -- 172.21.15.159:0/3498661016 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7698198ac0 con 0x7f76981039b0 2024-02-28T23:12:34.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.053+0000 7f7695600700 1 -- 172.21.15.159:0/3498661016 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f768000f460 con 0x7f76981039b0 2024-02-28T23:12:34.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.053+0000 7f7695600700 1 -- 172.21.15.159:0/3498661016 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7680017610 con 0x7f76981039b0 2024-02-28T23:12:34.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.054+0000 7f769ee00700 1 -- 172.21.15.159:0/3498661016 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7698198fb0 con 0x7f76981039b0 2024-02-28T23:12:34.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.055+0000 7f769ee00700 1 -- 172.21.15.159:0/3498661016 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f769810b400 con 0x7f76981039b0 2024-02-28T23:12:34.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.056+0000 7f7695600700 1 -- 172.21.15.159:0/3498661016 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f768000fa40 con 0x7f76981039b0 2024-02-28T23:12:34.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.057+0000 7f7695600700 1 --2- 172.21.15.159:0/3498661016 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f767c06d520 0x7f767c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:34.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.057+0000 7f7695600700 1 -- 172.21.15.159:0/3498661016 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f768008dff0 con 0x7f76981039b0 2024-02-28T23:12:34.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.058+0000 7f7697e00700 1 --2- 172.21.15.159:0/3498661016 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f767c06d520 0x7f767c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:34.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.058+0000 7f7697e00700 1 --2- 172.21.15.159:0/3498661016 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f767c06d520 0x7f767c06f9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7688005950 tx=0x7f76880058e0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:34.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.062+0000 7f7695600700 1 -- 172.21.15.159:0/3498661016 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f76800c1a70 con 0x7f76981039b0 2024-02-28T23:12:34.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.311+0000 7f769ee00700 1 -- 172.21.15.159:0/3498661016 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f769802cd80 con 0x7f767c06d520 2024-02-28T23:12:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.313+0000 7f7695600700 1 -- 172.21.15.159:0/3498661016 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f769802cd80 con 0x7f767c06d520 2024-02-28T23:12:34.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.315+0000 7f769ee00700 1 -- 172.21.15.159:0/3498661016 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f767c06d520 msgr2=0x7f767c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:34.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.315+0000 7f769ee00700 1 --2- 172.21.15.159:0/3498661016 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f767c06d520 0x7f767c06f9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7688005950 tx=0x7f76880058e0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.315+0000 7f769ee00700 1 -- 172.21.15.159:0/3498661016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76981039b0 msgr2=0x7f769819ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:34.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.315+0000 7f769ee00700 1 --2- 172.21.15.159:0/3498661016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76981039b0 0x7f769819ed00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f768000bda0 tx=0x7f768000be80 comp rx=0 tx=0).stop 2024-02-28T23:12:34.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.316+0000 7f769ee00700 1 -- 172.21.15.159:0/3498661016 shutdown_connections 2024-02-28T23:12:34.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.316+0000 7f769ee00700 1 --2- 172.21.15.159:0/3498661016 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f767c06d520 0x7f767c06f9e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.316+0000 7f769ee00700 1 --2- 172.21.15.159:0/3498661016 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7698103000 0x7f769819e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.316+0000 7f769ee00700 1 --2- 172.21.15.159:0/3498661016 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76981039b0 0x7f769819ed00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.316+0000 7f769ee00700 1 -- 172.21.15.159:0/3498661016 >> 172.21.15.159:0/3498661016 conn(0x7f76980fe8d0 msgr2=0x7f7698100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:34.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.316+0000 7f769ee00700 1 -- 172.21.15.159:0/3498661016 shutdown_connections 2024-02-28T23:12:34.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.316+0000 7f769ee00700 1 -- 172.21.15.159:0/3498661016 wait complete. 2024-02-28T23:12:34.330 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:12:34.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.482+0000 7f7b2b400700 1 -- 172.21.15.159:0/1713488762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b240731c0 msgr2=0x7f7b240735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:34.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.482+0000 7f7b2b400700 1 --2- 172.21.15.159:0/1713488762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b240731c0 0x7f7b240735a0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009910 tx=0x7f7b18009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:34.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.482+0000 7f7b2b400700 1 -- 172.21.15.159:0/1713488762 shutdown_connections 2024-02-28T23:12:34.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.482+0000 7f7b2b400700 1 --2- 172.21.15.159:0/1713488762 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b24073ae0 0x7f7b2410ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.482+0000 7f7b2b400700 1 --2- 172.21.15.159:0/1713488762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b240731c0 0x7f7b240735a0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.482+0000 7f7b2b400700 1 -- 172.21.15.159:0/1713488762 >> 172.21.15.159:0/1713488762 conn(0x7f7b240fc630 msgr2=0x7f7b240fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:34.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.482+0000 7f7b2b400700 1 -- 172.21.15.159:0/1713488762 shutdown_connections 2024-02-28T23:12:34.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.483+0000 7f7b2b400700 1 -- 172.21.15.159:0/1713488762 wait complete. 2024-02-28T23:12:34.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.484+0000 7f7b2b400700 1 Processor -- start 2024-02-28T23:12:34.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.484+0000 7f7b2b400700 1 -- start start 2024-02-28T23:12:34.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.484+0000 7f7b2b400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b240731c0 0x7f7b24198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:34.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.484+0000 7f7b2b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24073ae0 0x7f7b24198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:34.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.484+0000 7f7b2b400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24199490 con 0x7f7b24073ae0 2024-02-28T23:12:34.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.484+0000 7f7b2b400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b24199600 con 0x7f7b240731c0 2024-02-28T23:12:34.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.485+0000 7f7b23e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24073ae0 0x7f7b24198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:34.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.485+0000 7f7b23e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24073ae0 0x7f7b24198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34708/0 (socket says 172.21.15.159:34708) 2024-02-28T23:12:34.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.485+0000 7f7b23e00700 1 -- 172.21.15.159:0/3815906793 learned_addr learned my addr 172.21.15.159:0/3815906793 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:34.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.485+0000 7f7b28a00700 1 --2- 172.21.15.159:0/3815906793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b240731c0 0x7f7b24198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:34.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.485+0000 7f7b23e00700 1 -- 172.21.15.159:0/3815906793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b240731c0 msgr2=0x7f7b24198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:34.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.485+0000 7f7b23e00700 1 --2- 172.21.15.159:0/3815906793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b240731c0 0x7f7b24198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.485+0000 7f7b23e00700 1 -- 172.21.15.159:0/3815906793 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b180095f0 con 0x7f7b24073ae0 2024-02-28T23:12:34.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.485+0000 7f7b23e00700 1 --2- 172.21.15.159:0/3815906793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24073ae0 0x7f7b24198e90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c930 tx=0x7f7b1000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:34.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.486+0000 7f7b21600700 1 -- 172.21.15.159:0/3815906793 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b10007ad0 con 0x7f7b24073ae0 2024-02-28T23:12:34.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.486+0000 7f7b21600700 1 -- 172.21.15.159:0/3815906793 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7b10007c30 con 0x7f7b24073ae0 2024-02-28T23:12:34.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.486+0000 7f7b2b400700 1 -- 172.21.15.159:0/3815906793 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b2419d480 con 0x7f7b24073ae0 2024-02-28T23:12:34.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.486+0000 7f7b21600700 1 -- 172.21.15.159:0/3815906793 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b10018610 con 0x7f7b24073ae0 2024-02-28T23:12:34.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.486+0000 7f7b2b400700 1 -- 172.21.15.159:0/3815906793 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2419d9d0 con 0x7f7b24073ae0 2024-02-28T23:12:34.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.487+0000 7f7b2b400700 1 -- 172.21.15.159:0/3815906793 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b04005320 con 0x7f7b24073ae0 2024-02-28T23:12:34.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.488+0000 7f7b21600700 1 -- 172.21.15.159:0/3815906793 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f7b10018900 con 0x7f7b24073ae0 2024-02-28T23:12:34.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.490+0000 7f7b21600700 1 --2- 172.21.15.159:0/3815906793 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7b0c06d520 0x7f7b0c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:34.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.490+0000 7f7b21600700 1 -- 172.21.15.159:0/3815906793 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7b1008d190 con 0x7f7b24073ae0 2024-02-28T23:12:34.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.490+0000 7f7b28a00700 1 --2- 172.21.15.159:0/3815906793 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7b0c06d520 0x7f7b0c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:34.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.491+0000 7f7b28a00700 1 --2- 172.21.15.159:0/3815906793 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7b0c06d520 0x7f7b0c06f9e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800b5c0 tx=0x7f7b1801a040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:34.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.494+0000 7f7b21600700 1 -- 172.21.15.159:0/3815906793 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f7b1005a900 con 0x7f7b24073ae0 2024-02-28T23:12:34.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.738+0000 7f7b2b400700 1 -- 172.21.15.159:0/3815906793 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b04000bf0 con 0x7f7b0c06d520 2024-02-28T23:12:34.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.740+0000 7f7b21600700 1 -- 172.21.15.159:0/3815906793 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f7b04000bf0 con 0x7f7b0c06d520 2024-02-28T23:12:34.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.743+0000 7f7b2b400700 1 -- 172.21.15.159:0/3815906793 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7b0c06d520 msgr2=0x7f7b0c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:34.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.743+0000 7f7b2b400700 1 --2- 172.21.15.159:0/3815906793 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7b0c06d520 0x7f7b0c06f9e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b1800b5c0 tx=0x7f7b1801a040 comp rx=0 tx=0).stop 2024-02-28T23:12:34.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.743+0000 7f7b2b400700 1 -- 172.21.15.159:0/3815906793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24073ae0 msgr2=0x7f7b24198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:34.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.743+0000 7f7b2b400700 1 --2- 172.21.15.159:0/3815906793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24073ae0 0x7f7b24198e90 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7b1000c930 tx=0x7f7b1000ccf0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.743+0000 7f7b2b400700 1 -- 172.21.15.159:0/3815906793 shutdown_connections 2024-02-28T23:12:34.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.743+0000 7f7b2b400700 1 --2- 172.21.15.159:0/3815906793 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7b0c06d520 0x7f7b0c06f9e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.743+0000 7f7b2b400700 1 --2- 172.21.15.159:0/3815906793 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7b240731c0 0x7f7b24198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.743+0000 7f7b2b400700 1 --2- 172.21.15.159:0/3815906793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b24073ae0 0x7f7b24198e90 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.743+0000 7f7b2b400700 1 -- 172.21.15.159:0/3815906793 >> 172.21.15.159:0/3815906793 conn(0x7f7b240fc630 msgr2=0x7f7b24107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:34.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.744+0000 7f7b2b400700 1 -- 172.21.15.159:0/3815906793 shutdown_connections 2024-02-28T23:12:34.743 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.744+0000 7f7b2b400700 1 -- 172.21.15.159:0/3815906793 wait complete. 2024-02-28T23:12:34.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.901+0000 7f7e6b800700 1 -- 172.21.15.159:0/684775496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e640739d0 msgr2=0x7f7e6410cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:34.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.901+0000 7f7e6b800700 1 --2- 172.21.15.159:0/684775496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e640739d0 0x7f7e6410cee0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7e50009910 tx=0x7f7e50009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:34.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.901+0000 7f7e6b800700 1 -- 172.21.15.159:0/684775496 shutdown_connections 2024-02-28T23:12:34.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.901+0000 7f7e6b800700 1 --2- 172.21.15.159:0/684775496 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e640739d0 0x7f7e6410cee0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.901+0000 7f7e6b800700 1 --2- 172.21.15.159:0/684775496 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e640730b0 0x7f7e64073490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.901+0000 7f7e6b800700 1 -- 172.21.15.159:0/684775496 >> 172.21.15.159:0/684775496 conn(0x7f7e640fc650 msgr2=0x7f7e640fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:34.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.902+0000 7f7e6b800700 1 -- 172.21.15.159:0/684775496 shutdown_connections 2024-02-28T23:12:34.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.902+0000 7f7e6b800700 1 -- 172.21.15.159:0/684775496 wait complete. 2024-02-28T23:12:34.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.903+0000 7f7e6b800700 1 Processor -- start 2024-02-28T23:12:34.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.903+0000 7f7e6b800700 1 -- start start 2024-02-28T23:12:34.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.903+0000 7f7e6b800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e640730b0 0x7f7e6419e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:34.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.903+0000 7f7e6b800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e640739d0 0x7f7e6419ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:34.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.903+0000 7f7e6b800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6419f2e0 con 0x7f7e640739d0 2024-02-28T23:12:34.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.903+0000 7f7e6b800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e64198790 con 0x7f7e640730b0 2024-02-28T23:12:34.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.904+0000 7f7e63e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e640739d0 0x7f7e6419ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:34.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.904+0000 7f7e63e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e640739d0 0x7f7e6419ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34722/0 (socket says 172.21.15.159:34722) 2024-02-28T23:12:34.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.904+0000 7f7e63e00700 1 -- 172.21.15.159:0/698992729 learned_addr learned my addr 172.21.15.159:0/698992729 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:34.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.904+0000 7f7e68e00700 1 --2- 172.21.15.159:0/698992729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e640730b0 0x7f7e6419e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:34.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.904+0000 7f7e63e00700 1 -- 172.21.15.159:0/698992729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e640730b0 msgr2=0x7f7e6419e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:34.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.904+0000 7f7e63e00700 1 --2- 172.21.15.159:0/698992729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e640730b0 0x7f7e6419e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:34.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.904+0000 7f7e63e00700 1 -- 172.21.15.159:0/698992729 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e500095f0 con 0x7f7e640739d0 2024-02-28T23:12:34.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.905+0000 7f7e63e00700 1 --2- 172.21.15.159:0/698992729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e640739d0 0x7f7e6419ec50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000b5c0 tx=0x7f7e5000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:34.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.905+0000 7f7e61600700 1 -- 172.21.15.159:0/698992729 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e5001d070 con 0x7f7e640739d0 2024-02-28T23:12:34.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.905+0000 7f7e61600700 1 -- 172.21.15.159:0/698992729 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e5000f460 con 0x7f7e640739d0 2024-02-28T23:12:34.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.905+0000 7f7e6b800700 1 -- 172.21.15.159:0/698992729 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e64198a10 con 0x7f7e640739d0 2024-02-28T23:12:34.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.905+0000 7f7e61600700 1 -- 172.21.15.159:0/698992729 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e50017610 con 0x7f7e640739d0 2024-02-28T23:12:34.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.905+0000 7f7e6b800700 1 -- 172.21.15.159:0/698992729 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e64198f00 con 0x7f7e640739d0 2024-02-28T23:12:34.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.906+0000 7f7e6b800700 1 -- 172.21.15.159:0/698992729 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e6410a5e0 con 0x7f7e640739d0 2024-02-28T23:12:34.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.908+0000 7f7e61600700 1 -- 172.21.15.159:0/698992729 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f7e5000f5d0 con 0x7f7e640739d0 2024-02-28T23:12:34.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.908+0000 7f7e61600700 1 --2- 172.21.15.159:0/698992729 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7e4c06d520 0x7f7e4c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:34.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.909+0000 7f7e61600700 1 -- 172.21.15.159:0/698992729 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f7e5008e570 con 0x7f7e640739d0 2024-02-28T23:12:34.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.909+0000 7f7e68e00700 1 --2- 172.21.15.159:0/698992729 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7e4c06d520 0x7f7e4c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:34.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.909+0000 7f7e68e00700 1 --2- 172.21.15.159:0/698992729 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7e4c06d520 0x7f7e4c06f9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e58005fd0 tx=0x7f7e5800a560 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:34.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:34.913+0000 7f7e61600700 1 -- 172.21.15.159:0/698992729 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f7e5005bd60 con 0x7f7e640739d0 2024-02-28T23:12:35.140 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.142+0000 7f7e6b800700 1 -- 172.21.15.159:0/698992729 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e64199230 con 0x7f7e4c06d520 2024-02-28T23:12:35.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.170+0000 7f7e61600700 1 -- 172.21.15.159:0/698992729 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f7e64199230 con 0x7f7e4c06d520 2024-02-28T23:12:35.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:35 smithi159 ceph-mon[28802]: from='client.14890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:35.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:35 smithi159 ceph-mon[28802]: from='client.14894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:35.169 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:35 smithi159 ceph-mon[28802]: pgmap v141: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:35.169 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (2m) 80s ago 16m 13.6M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (16m) 80s ago 16m 8246k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (15m) 3m ago 15m 7721k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (16m) 80s ago 16m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (15m) 3m ago 15m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (88s) 80s ago 15m 52.4M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (8m) 80s ago 8m 149M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (9m) 80s ago 9m 86.4M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (9m) 3m ago 9m 15.0M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (8m) 3m ago 8m 14.9M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (5m) 80s ago 18m 502M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (3m) 3m ago 14m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:12:35.170 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (18m) 80s ago 18m 55.3M 2048M 18.2.1 5be31c24972a 6bdfab2318d0 2024-02-28T23:12:35.171 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (14m) 3m ago 14m 43.2M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:12:35.171 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (3m) 80s ago 16m 7814k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:12:35.171 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (3m) 3m ago 15m 2939k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:12:35.171 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (13m) 80s ago 13m 233M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:12:35.171 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (13m) 80s ago 13m 249M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:12:35.171 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (12m) 80s ago 12m 210M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:12:35.171 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (12m) 3m ago 12m 286M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:12:35.171 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (11m) 3m ago 11m 242M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:12:35.171 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (10m) 3m ago 10m 219M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:12:35.171 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (2m) 80s ago 15m 46.0M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:12:35.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.175+0000 7f7e6b800700 1 -- 172.21.15.159:0/698992729 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7e4c06d520 msgr2=0x7f7e4c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:35.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.175+0000 7f7e6b800700 1 --2- 172.21.15.159:0/698992729 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7e4c06d520 0x7f7e4c06f9e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e58005fd0 tx=0x7f7e5800a560 comp rx=0 tx=0).stop 2024-02-28T23:12:35.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.175+0000 7f7e6b800700 1 -- 172.21.15.159:0/698992729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e640739d0 msgr2=0x7f7e6419ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:35.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.175+0000 7f7e6b800700 1 --2- 172.21.15.159:0/698992729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e640739d0 0x7f7e6419ec50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f7e5000b5c0 tx=0x7f7e5000be00 comp rx=0 tx=0).stop 2024-02-28T23:12:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.175+0000 7f7e6b800700 1 -- 172.21.15.159:0/698992729 shutdown_connections 2024-02-28T23:12:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.175+0000 7f7e6b800700 1 --2- 172.21.15.159:0/698992729 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f7e4c06d520 0x7f7e4c06f9e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.175+0000 7f7e6b800700 1 --2- 172.21.15.159:0/698992729 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e640730b0 0x7f7e6419e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.175+0000 7f7e6b800700 1 --2- 172.21.15.159:0/698992729 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e640739d0 0x7f7e6419ec50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.175+0000 7f7e6b800700 1 -- 172.21.15.159:0/698992729 >> 172.21.15.159:0/698992729 conn(0x7f7e640fc650 msgr2=0x7f7e64107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:35.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.175+0000 7f7e6b800700 1 -- 172.21.15.159:0/698992729 shutdown_connections 2024-02-28T23:12:35.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.176+0000 7f7e6b800700 1 -- 172.21.15.159:0/698992729 wait complete. 2024-02-28T23:12:35.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.316+0000 7fd7ca200700 1 -- 172.21.15.159:0/1238188153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c4103000 msgr2=0x7fd7c41033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:35.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.316+0000 7fd7ca200700 1 --2- 172.21.15.159:0/1238188153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c4103000 0x7fd7c41033e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4009910 tx=0x7fd7b4009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:35.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.316+0000 7fd7ca200700 1 -- 172.21.15.159:0/1238188153 shutdown_connections 2024-02-28T23:12:35.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.316+0000 7fd7ca200700 1 --2- 172.21.15.159:0/1238188153 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c41039b0 0x7fd7c4107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.316+0000 7fd7ca200700 1 --2- 172.21.15.159:0/1238188153 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c4103000 0x7fd7c41033e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.316+0000 7fd7ca200700 1 -- 172.21.15.159:0/1238188153 >> 172.21.15.159:0/1238188153 conn(0x7fd7c40fe8d0 msgr2=0x7fd7c4100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:35.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.316+0000 7fd7ca200700 1 -- 172.21.15.159:0/1238188153 shutdown_connections 2024-02-28T23:12:35.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.316+0000 7fd7ca200700 1 -- 172.21.15.159:0/1238188153 wait complete. 2024-02-28T23:12:35.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.317+0000 7fd7ca200700 1 Processor -- start 2024-02-28T23:12:35.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.318+0000 7fd7ca200700 1 -- start start 2024-02-28T23:12:35.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.318+0000 7fd7ca200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c4103000 0x7fd7c419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:35.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.318+0000 7fd7ca200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c41039b0 0x7fd7c419ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:35.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.318+0000 7fd7ca200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c419f4d0 con 0x7fd7c4103000 2024-02-28T23:12:35.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.318+0000 7fd7ca200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c4198980 con 0x7fd7c41039b0 2024-02-28T23:12:35.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.318+0000 7fd7c3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c4103000 0x7fd7c419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:35.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.318+0000 7fd7c3400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c4103000 0x7fd7c419e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34734/0 (socket says 172.21.15.159:34734) 2024-02-28T23:12:35.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.318+0000 7fd7c3400700 1 -- 172.21.15.159:0/40420223 learned_addr learned my addr 172.21.15.159:0/40420223 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:35.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.319+0000 7fd7c3400700 1 -- 172.21.15.159:0/40420223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c41039b0 msgr2=0x7fd7c419ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:35.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.319+0000 7fd7c2a00700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c41039b0 0x7fd7c419ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:35.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.319+0000 7fd7c3400700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c41039b0 0x7fd7c419ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.319+0000 7fd7c3400700 1 -- 172.21.15.159:0/40420223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b40095f0 con 0x7fd7c4103000 2024-02-28T23:12:35.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.319+0000 7fd7c2a00700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c41039b0 0x7fd7c419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:12:35.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.319+0000 7fd7c3400700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c4103000 0x7fd7c419e900 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4006010 tx=0x7fd7b400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:35.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.319+0000 7fd7bbe00700 1 -- 172.21.15.159:0/40420223 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b401d070 con 0x7fd7c4103000 2024-02-28T23:12:35.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.319+0000 7fd7bbe00700 1 -- 172.21.15.159:0/40420223 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd7b4004fb0 con 0x7fd7c4103000 2024-02-28T23:12:35.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.319+0000 7fd7bbe00700 1 -- 172.21.15.159:0/40420223 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7b4022ea0 con 0x7fd7c4103000 2024-02-28T23:12:35.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.319+0000 7fd7ca200700 1 -- 172.21.15.159:0/40420223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c4198c00 con 0x7fd7c4103000 2024-02-28T23:12:35.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.319+0000 7fd7ca200700 1 -- 172.21.15.159:0/40420223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c41990f0 con 0x7fd7c4103000 2024-02-28T23:12:35.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.320+0000 7fd7ca200700 1 -- 172.21.15.159:0/40420223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c410b3a0 con 0x7fd7c4103000 2024-02-28T23:12:35.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.321+0000 7fd7bbe00700 1 -- 172.21.15.159:0/40420223 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7fd7b4022470 con 0x7fd7c4103000 2024-02-28T23:12:35.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.323+0000 7fd7bbe00700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd7a806d520 0x7fd7a806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:35.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.323+0000 7fd7bbe00700 1 -- 172.21.15.159:0/40420223 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7fd7b408e490 con 0x7fd7c4103000 2024-02-28T23:12:35.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.323+0000 7fd7c2a00700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd7a806d520 0x7fd7a806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:35.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.324+0000 7fd7c2a00700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd7a806d520 0x7fd7a806f9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40ff140 tx=0x7fd7b0008040 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:35.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.327+0000 7fd7bbe00700 1 -- 172.21.15.159:0/40420223 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7fd7b405bd30 con 0x7fd7c4103000 2024-02-28T23:12:35.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:35 smithi184 ceph-mon[36198]: from='client.14890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:35.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:35 smithi184 ceph-mon[36198]: from='client.14894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:35.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:35 smithi184 ceph-mon[36198]: pgmap v141: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:12:35.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.652+0000 7fd7ca200700 1 -- 172.21.15.159:0/40420223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd7c4199420 con 0x7fd7c4103000 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.652+0000 7fd7bbe00700 1 -- 172.21.15.159:0/40420223 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+675 (secure 0 0 0) 0x7fd7b4022720 con 0x7fd7c4103000 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:12:35.651 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:12:35.652 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:12:35.652 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:12:35.652 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:12:35.652 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 12, 2024-02-28T23:12:35.652 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:12:35.652 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:12:35.652 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:12:35.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.657+0000 7fd7ca200700 1 -- 172.21.15.159:0/40420223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd7a806d520 msgr2=0x7fd7a806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:35.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.657+0000 7fd7ca200700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd7a806d520 0x7fd7a806f9e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40ff140 tx=0x7fd7b0008040 comp rx=0 tx=0).stop 2024-02-28T23:12:35.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.657+0000 7fd7ca200700 1 -- 172.21.15.159:0/40420223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c4103000 msgr2=0x7fd7c419e900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:35.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.657+0000 7fd7ca200700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c4103000 0x7fd7c419e900 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4006010 tx=0x7fd7b400be20 comp rx=0 tx=0).stop 2024-02-28T23:12:35.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.657+0000 7fd7ca200700 1 -- 172.21.15.159:0/40420223 shutdown_connections 2024-02-28T23:12:35.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.657+0000 7fd7ca200700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7fd7a806d520 0x7fd7a806f9e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.657+0000 7fd7ca200700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd7c4103000 0x7fd7c419e900 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.657+0000 7fd7ca200700 1 --2- 172.21.15.159:0/40420223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd7c41039b0 0x7fd7c419ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.657+0000 7fd7ca200700 1 -- 172.21.15.159:0/40420223 >> 172.21.15.159:0/40420223 conn(0x7fd7c40fe8d0 msgr2=0x7fd7c40fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:35.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.657+0000 7fd7ca200700 1 -- 172.21.15.159:0/40420223 shutdown_connections 2024-02-28T23:12:35.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.657+0000 7fd7ca200700 1 -- 172.21.15.159:0/40420223 wait complete. 2024-02-28T23:12:35.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.809+0000 7f1b79800700 1 -- 172.21.15.159:0/3088222045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b74069020 msgr2=0x7f1b74105780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:35.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.809+0000 7f1b79800700 1 --2- 172.21.15.159:0/3088222045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b74069020 0x7f1b74105780 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c009910 tx=0x7f1b5c009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:35.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.809+0000 7f1b79800700 1 -- 172.21.15.159:0/3088222045 shutdown_connections 2024-02-28T23:12:35.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.809+0000 7f1b79800700 1 --2- 172.21.15.159:0/3088222045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b74069020 0x7f1b74105780 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.809+0000 7f1b79800700 1 --2- 172.21.15.159:0/3088222045 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b74068670 0x7f1b74068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.809+0000 7f1b79800700 1 -- 172.21.15.159:0/3088222045 >> 172.21.15.159:0/3088222045 conn(0x7f1b740754f0 msgr2=0x7f1b74075900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:35.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.809+0000 7f1b79800700 1 -- 172.21.15.159:0/3088222045 shutdown_connections 2024-02-28T23:12:35.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.809+0000 7f1b79800700 1 -- 172.21.15.159:0/3088222045 wait complete. 2024-02-28T23:12:35.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.810+0000 7f1b79800700 1 Processor -- start 2024-02-28T23:12:35.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.810+0000 7f1b79800700 1 -- start start 2024-02-28T23:12:35.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.810+0000 7f1b79800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b74068670 0x7f1b7419e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:35.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.810+0000 7f1b79800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b74069020 0x7f1b7419ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:35.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.811+0000 7f1b79800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7419f2b0 con 0x7f1b74069020 2024-02-28T23:12:35.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.811+0000 7f1b79800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74198760 con 0x7f1b74068670 2024-02-28T23:12:35.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.811+0000 7f1b6be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b74069020 0x7f1b7419ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:35.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.811+0000 7f1b6be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b74069020 0x7f1b7419ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34756/0 (socket says 172.21.15.159:34756) 2024-02-28T23:12:35.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.811+0000 7f1b6be00700 1 -- 172.21.15.159:0/2217904247 learned_addr learned my addr 172.21.15.159:0/2217904247 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:35.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.811+0000 7f1b72a00700 1 --2- 172.21.15.159:0/2217904247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b74068670 0x7f1b7419e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:35.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.811+0000 7f1b6be00700 1 -- 172.21.15.159:0/2217904247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b74068670 msgr2=0x7f1b7419e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:35.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.811+0000 7f1b6be00700 1 --2- 172.21.15.159:0/2217904247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b74068670 0x7f1b7419e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:35.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.811+0000 7f1b6be00700 1 -- 172.21.15.159:0/2217904247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c0095f0 con 0x7f1b74069020 2024-02-28T23:12:35.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.812+0000 7f1b6be00700 1 --2- 172.21.15.159:0/2217904247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b74069020 0x7f1b7419ec20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00bda0 tx=0x7f1b5c00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:35.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.812+0000 7f1b6b400700 1 -- 172.21.15.159:0/2217904247 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b5c01d070 con 0x7f1b74069020 2024-02-28T23:12:35.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.812+0000 7f1b6b400700 1 -- 172.21.15.159:0/2217904247 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1b5c00f460 con 0x7f1b74069020 2024-02-28T23:12:35.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.812+0000 7f1b79800700 1 -- 172.21.15.159:0/2217904247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b741989e0 con 0x7f1b74069020 2024-02-28T23:12:35.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.812+0000 7f1b6b400700 1 -- 172.21.15.159:0/2217904247 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b5c017630 con 0x7f1b74069020 2024-02-28T23:12:35.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.812+0000 7f1b79800700 1 -- 172.21.15.159:0/2217904247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b74198ed0 con 0x7f1b74069020 2024-02-28T23:12:35.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.813+0000 7f1b79800700 1 -- 172.21.15.159:0/2217904247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b7404ea90 con 0x7f1b74069020 2024-02-28T23:12:35.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.814+0000 7f1b6b400700 1 -- 172.21.15.159:0/2217904247 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f1b5c00fa40 con 0x7f1b74069020 2024-02-28T23:12:35.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.815+0000 7f1b6b400700 1 --2- 172.21.15.159:0/2217904247 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1b5806d520 0x7f1b5806f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:35.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.815+0000 7f1b6b400700 1 -- 172.21.15.159:0/2217904247 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f1b5c08e310 con 0x7f1b74069020 2024-02-28T23:12:35.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.816+0000 7f1b72a00700 1 --2- 172.21.15.159:0/2217904247 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1b5806d520 0x7f1b5806f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:35.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.816+0000 7f1b72a00700 1 --2- 172.21.15.159:0/2217904247 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1b5806d520 0x7f1b5806f9e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b64005950 tx=0x7f1b640058e0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:35.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:35.820+0000 7f1b6b400700 1 -- 172.21.15.159:0/2217904247 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f1b5c05bba0 con 0x7f1b74069020 2024-02-28T23:12:36.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.076+0000 7f1b79800700 1 -- 172.21.15.159:0/2217904247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f1b74199c70 con 0x7f1b74069020 2024-02-28T23:12:36.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.077+0000 7f1b6b400700 1 -- 172.21.15.159:0/2217904247 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1858 (secure 0 0 0) 0x7f1b5c05b730 con 0x7f1b74069020 2024-02-28T23:12:36.076 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:12:36.076 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:12:36.076 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:12:36.076 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:12:36.076 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:12:36.076 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:12:36.076 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:12:36.076 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:12:36.076 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:12:36.077 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:12:36.078 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:12:36.079 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:12:36.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.081+0000 7f1b79800700 1 -- 172.21.15.159:0/2217904247 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1b5806d520 msgr2=0x7f1b5806f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:36.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.081+0000 7f1b79800700 1 --2- 172.21.15.159:0/2217904247 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1b5806d520 0x7f1b5806f9e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1b64005950 tx=0x7f1b640058e0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.081+0000 7f1b79800700 1 -- 172.21.15.159:0/2217904247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b74069020 msgr2=0x7f1b7419ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:36.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.081+0000 7f1b79800700 1 --2- 172.21.15.159:0/2217904247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b74069020 0x7f1b7419ec20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00bda0 tx=0x7f1b5c00be80 comp rx=0 tx=0).stop 2024-02-28T23:12:36.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.081+0000 7f1b79800700 1 -- 172.21.15.159:0/2217904247 shutdown_connections 2024-02-28T23:12:36.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.081+0000 7f1b79800700 1 --2- 172.21.15.159:0/2217904247 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f1b5806d520 0x7f1b5806f9e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.081+0000 7f1b79800700 1 --2- 172.21.15.159:0/2217904247 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1b74068670 0x7f1b7419e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.081+0000 7f1b79800700 1 --2- 172.21.15.159:0/2217904247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b74069020 0x7f1b7419ec20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.081+0000 7f1b79800700 1 -- 172.21.15.159:0/2217904247 >> 172.21.15.159:0/2217904247 conn(0x7f1b740754f0 msgr2=0x7f1b74103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:36.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.082+0000 7f1b79800700 1 -- 172.21.15.159:0/2217904247 shutdown_connections 2024-02-28T23:12:36.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.082+0000 7f1b79800700 1 -- 172.21.15.159:0/2217904247 wait complete. 2024-02-28T23:12:36.082 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:12:36.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.232+0000 7f85e0800700 1 -- 172.21.15.159:0/4039607422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8073ae0 msgr2=0x7f85d810ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:36.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.232+0000 7f85e0800700 1 --2- 172.21.15.159:0/4039607422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8073ae0 0x7f85d810ce40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f85c8009910 tx=0x7f85c8009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:36.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.232+0000 7f85e0800700 1 -- 172.21.15.159:0/4039607422 shutdown_connections 2024-02-28T23:12:36.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.232+0000 7f85e0800700 1 --2- 172.21.15.159:0/4039607422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8073ae0 0x7f85d810ce40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.232+0000 7f85e0800700 1 --2- 172.21.15.159:0/4039607422 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d80731c0 0x7f85d80735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.232+0000 7f85e0800700 1 -- 172.21.15.159:0/4039607422 >> 172.21.15.159:0/4039607422 conn(0x7f85d80fc630 msgr2=0x7f85d80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:36.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.232+0000 7f85e0800700 1 -- 172.21.15.159:0/4039607422 shutdown_connections 2024-02-28T23:12:36.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.232+0000 7f85e0800700 1 -- 172.21.15.159:0/4039607422 wait complete. 2024-02-28T23:12:36.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.233+0000 7f85e0800700 1 Processor -- start 2024-02-28T23:12:36.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.233+0000 7f85e0800700 1 -- start start 2024-02-28T23:12:36.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.234+0000 7f85e0800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d80731c0 0x7f85d8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:36.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.234+0000 7f85e0800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8073ae0 0x7f85d8198ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:36.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.234+0000 7f85e0800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d8199550 con 0x7f85d8073ae0 2024-02-28T23:12:36.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.234+0000 7f85e0800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d819d360 con 0x7f85d80731c0 2024-02-28T23:12:36.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.234+0000 7f85dd400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8073ae0 0x7f85d8198ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:36.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.234+0000 7f85dd400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8073ae0 0x7f85d8198ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34772/0 (socket says 172.21.15.159:34772) 2024-02-28T23:12:36.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.234+0000 7f85dd400700 1 -- 172.21.15.159:0/3429348813 learned_addr learned my addr 172.21.15.159:0/3429348813 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:36.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.234+0000 7f85dde00700 1 --2- 172.21.15.159:0/3429348813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d80731c0 0x7f85d8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:36.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.234+0000 7f85dd400700 1 -- 172.21.15.159:0/3429348813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d80731c0 msgr2=0x7f85d8198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:36.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.234+0000 7f85dd400700 1 --2- 172.21.15.159:0/3429348813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d80731c0 0x7f85d8198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.234+0000 7f85dd400700 1 -- 172.21.15.159:0/3429348813 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c80095f0 con 0x7f85d8073ae0 2024-02-28T23:12:36.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.235+0000 7f85dd400700 1 --2- 172.21.15.159:0/3429348813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8073ae0 0x7f85d8198ec0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f85c80092e0 tx=0x7f85c800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:36.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.235+0000 7f85d2a00700 1 -- 172.21.15.159:0/3429348813 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c801d070 con 0x7f85d8073ae0 2024-02-28T23:12:36.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.235+0000 7f85d2a00700 1 -- 172.21.15.159:0/3429348813 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f85c800f460 con 0x7f85d8073ae0 2024-02-28T23:12:36.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.235+0000 7f85e0800700 1 -- 172.21.15.159:0/3429348813 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85d819d5e0 con 0x7f85d8073ae0 2024-02-28T23:12:36.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.235+0000 7f85d2a00700 1 -- 172.21.15.159:0/3429348813 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85c8017630 con 0x7f85d8073ae0 2024-02-28T23:12:36.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.235+0000 7f85e0800700 1 -- 172.21.15.159:0/3429348813 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d819dad0 con 0x7f85d8073ae0 2024-02-28T23:12:36.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.236+0000 7f85e0800700 1 -- 172.21.15.159:0/3429348813 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d810a540 con 0x7f85d8073ae0 2024-02-28T23:12:36.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.238+0000 7f85d2a00700 1 -- 172.21.15.159:0/3429348813 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f85c800f5d0 con 0x7f85d8073ae0 2024-02-28T23:12:36.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.238+0000 7f85d2a00700 1 --2- 172.21.15.159:0/3429348813 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f85c006d520 0x7f85c006f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:36.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.239+0000 7f85d2a00700 1 -- 172.21.15.159:0/3429348813 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f85c808e550 con 0x7f85d8073ae0 2024-02-28T23:12:36.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.239+0000 7f85dde00700 1 --2- 172.21.15.159:0/3429348813 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f85c006d520 0x7f85c006f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:36.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.239+0000 7f85dde00700 1 --2- 172.21.15.159:0/3429348813 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f85c006d520 0x7f85c006f9e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005950 tx=0x7f85cc005cf0 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:36.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.247+0000 7f85d2a00700 1 -- 172.21.15.159:0/3429348813 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f85c805bd60 con 0x7f85d8073ae0 2024-02-28T23:12:36.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.479+0000 7f85e0800700 1 -- 172.21.15.159:0/3429348813 --> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f85d802cce0 con 0x7f85c006d520 2024-02-28T23:12:36.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.481+0000 7f85d2a00700 1 -- 172.21.15.159:0/3429348813 <== mgr.14680 v2:172.21.15.159:6800/3612719472 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f85d802cce0 con 0x7f85c006d520 2024-02-28T23:12:36.480 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:12:36.480 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:12:36.480 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:12:36.480 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:12:36.480 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:12:36.480 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:12:36.480 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:12:36.480 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "2/23 daemons upgraded", 2024-02-28T23:12:36.480 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading mon daemons", 2024-02-28T23:12:36.481 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:12:36.481 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:12:36.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.484+0000 7f85e0800700 1 -- 172.21.15.159:0/3429348813 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f85c006d520 msgr2=0x7f85c006f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:36.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.484+0000 7f85e0800700 1 --2- 172.21.15.159:0/3429348813 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f85c006d520 0x7f85c006f9e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f85cc005950 tx=0x7f85cc005cf0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.484+0000 7f85e0800700 1 -- 172.21.15.159:0/3429348813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8073ae0 msgr2=0x7f85d8198ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:36.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.484+0000 7f85e0800700 1 --2- 172.21.15.159:0/3429348813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8073ae0 0x7f85d8198ec0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f85c80092e0 tx=0x7f85c800be00 comp rx=0 tx=0).stop 2024-02-28T23:12:36.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.484+0000 7f85e0800700 1 -- 172.21.15.159:0/3429348813 shutdown_connections 2024-02-28T23:12:36.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.484+0000 7f85e0800700 1 --2- 172.21.15.159:0/3429348813 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f85c006d520 0x7f85c006f9e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.484+0000 7f85e0800700 1 --2- 172.21.15.159:0/3429348813 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f85d80731c0 0x7f85d8198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.484+0000 7f85e0800700 1 --2- 172.21.15.159:0/3429348813 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f85d8073ae0 0x7f85d8198ec0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.484+0000 7f85e0800700 1 -- 172.21.15.159:0/3429348813 >> 172.21.15.159:0/3429348813 conn(0x7f85d80fc630 msgr2=0x7f85d8107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:36.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.484+0000 7f85e0800700 1 -- 172.21.15.159:0/3429348813 shutdown_connections 2024-02-28T23:12:36.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.484+0000 7f85e0800700 1 -- 172.21.15.159:0/3429348813 wait complete. 2024-02-28T23:12:36.632 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:36 smithi159 ceph-mon[28802]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:36.632 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:36 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:36.632 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:36 smithi159 ceph-mon[28802]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (squid) 2024-02-28T23:12:36.632 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:36 smithi159 ceph-mon[28802]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T23:12:36.632 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:36 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:12:36.632 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:36 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:12:36.632 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:36 smithi159 ceph-mon[28802]: Upgrade: Setting container_image for all mgr 2024-02-28T23:12:36.632 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:36 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:36.632 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:36 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T23:12:36.632 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:36 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/40420223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:12:36.632 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:36 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2217904247' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:12:36.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.642+0000 7f0c4dc00700 1 -- 172.21.15.159:0/3946431130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48069020 msgr2=0x7f0c48105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:36.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.642+0000 7f0c4dc00700 1 --2- 172.21.15.159:0/3946431130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48069020 0x7f0c48105790 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f0c34009910 tx=0x7f0c34009c20 comp rx=0 tx=0).stop 2024-02-28T23:12:36.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.642+0000 7f0c4dc00700 1 -- 172.21.15.159:0/3946431130 shutdown_connections 2024-02-28T23:12:36.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.642+0000 7f0c4dc00700 1 --2- 172.21.15.159:0/3946431130 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48069020 0x7f0c48105790 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.642+0000 7f0c4dc00700 1 --2- 172.21.15.159:0/3946431130 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c48068670 0x7f0c48068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.642+0000 7f0c4dc00700 1 -- 172.21.15.159:0/3946431130 >> 172.21.15.159:0/3946431130 conn(0x7f0c480755a0 msgr2=0x7f0c480759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:36.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.642+0000 7f0c4dc00700 1 -- 172.21.15.159:0/3946431130 shutdown_connections 2024-02-28T23:12:36.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.642+0000 7f0c4dc00700 1 -- 172.21.15.159:0/3946431130 wait complete. 2024-02-28T23:12:36.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.643+0000 7f0c4dc00700 1 Processor -- start 2024-02-28T23:12:36.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.643+0000 7f0c4dc00700 1 -- start start 2024-02-28T23:12:36.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.644+0000 7f0c4dc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48068670 0x7f0c48196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:36.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.644+0000 7f0c4dc00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c48069020 0x7f0c48196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:36.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.644+0000 7f0c4dc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c481972d0 con 0x7f0c48068670 2024-02-28T23:12:36.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.644+0000 7f0c4dc00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c4819a000 con 0x7f0c48069020 2024-02-28T23:12:36.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.644+0000 7f0c46a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48068670 0x7f0c48196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:36.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.644+0000 7f0c46a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48068670 0x7f0c48196700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34782/0 (socket says 172.21.15.159:34782) 2024-02-28T23:12:36.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.644+0000 7f0c46a00700 1 -- 172.21.15.159:0/2951240406 learned_addr learned my addr 172.21.15.159:0/2951240406 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:12:36.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.645+0000 7f0c46000700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c48069020 0x7f0c48196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:36.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.645+0000 7f0c46a00700 1 -- 172.21.15.159:0/2951240406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c48069020 msgr2=0x7f0c48196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:36.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.645+0000 7f0c46a00700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c48069020 0x7f0c48196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.645+0000 7f0c46a00700 1 -- 172.21.15.159:0/2951240406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c340095f0 con 0x7f0c48068670 2024-02-28T23:12:36.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.645+0000 7f0c46000700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c48069020 0x7f0c48196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:12:36.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.645+0000 7f0c46a00700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48068670 0x7f0c48196700 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800d8d0 tx=0x7f0c3800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:36.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.645+0000 7f0c3f400700 1 -- 172.21.15.159:0/2951240406 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c38009940 con 0x7f0c48068670 2024-02-28T23:12:36.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.645+0000 7f0c4dc00700 1 -- 172.21.15.159:0/2951240406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c4819a2e0 con 0x7f0c48068670 2024-02-28T23:12:36.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.645+0000 7f0c3f400700 1 -- 172.21.15.159:0/2951240406 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0c38010460 con 0x7f0c48068670 2024-02-28T23:12:36.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.645+0000 7f0c3f400700 1 -- 172.21.15.159:0/2951240406 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0c3800f5f0 con 0x7f0c48068670 2024-02-28T23:12:36.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.646+0000 7f0c4dc00700 1 -- 172.21.15.159:0/2951240406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c4819a830 con 0x7f0c48068670 2024-02-28T23:12:36.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.647+0000 7f0c4dc00700 1 -- 172.21.15.159:0/2951240406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c481090a0 con 0x7f0c48068670 2024-02-28T23:12:36.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.648+0000 7f0c3f400700 1 -- 172.21.15.159:0/2951240406 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 32) v1 ==== 91340+0+0 (secure 0 0 0) 0x7f0c380105d0 con 0x7f0c48068670 2024-02-28T23:12:36.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.649+0000 7f0c3f400700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f0c2c06d520 0x7f0c2c06f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:12:36.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.649+0000 7f0c3f400700 1 -- 172.21.15.159:0/2951240406 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 6156+0+0 (secure 0 0 0) 0x7f0c3808ceb0 con 0x7f0c48068670 2024-02-28T23:12:36.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.649+0000 7f0c46000700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f0c2c06d520 0x7f0c2c06f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:12:36.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.650+0000 7f0c46000700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f0c2c06d520 0x7f0c2c06f9e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c34006010 tx=0x7f0c3400b540 comp rx=0 tx=0).ready entity=mgr.14680 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:12:36.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.654+0000 7f0c3f400700 1 -- 172.21.15.159:0/2951240406 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182869 (secure 0 0 0) 0x7f0c38056c10 con 0x7f0c48068670 2024-02-28T23:12:36.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:36 smithi184 ceph-mon[36198]: from='client.14898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:36.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:36 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:36.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:36 smithi184 ceph-mon[36198]: Upgrade: Target is version 19.0.0-1670-g1fb5d106 (squid) 2024-02-28T23:12:36.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:36 smithi184 ceph-mon[36198]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc'] 2024-02-28T23:12:36.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:36 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:12:36.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:36 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:12:36.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:36 smithi184 ceph-mon[36198]: Upgrade: Setting container_image for all mgr 2024-02-28T23:12:36.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:36 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:36.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:36 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T23:12:36.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:36 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/40420223' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:12:36.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:36 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2217904247' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:12:36.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.961+0000 7f0c4dc00700 1 -- 172.21.15.159:0/2951240406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0c4804ea90 con 0x7f0c48068670 2024-02-28T23:12:36.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.962+0000 7f0c3f400700 1 -- 172.21.15.159:0/2951240406 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0c38016090 con 0x7f0c48068670 2024-02-28T23:12:36.961 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_OK 2024-02-28T23:12:36.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.965+0000 7f0c4dc00700 1 -- 172.21.15.159:0/2951240406 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f0c2c06d520 msgr2=0x7f0c2c06f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:36.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.965+0000 7f0c4dc00700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f0c2c06d520 0x7f0c2c06f9e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0c34006010 tx=0x7f0c3400b540 comp rx=0 tx=0).stop 2024-02-28T23:12:36.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.965+0000 7f0c4dc00700 1 -- 172.21.15.159:0/2951240406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48068670 msgr2=0x7f0c48196700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:12:36.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.965+0000 7f0c4dc00700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48068670 0x7f0c48196700 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800d8d0 tx=0x7f0c3800dc90 comp rx=0 tx=0).stop 2024-02-28T23:12:36.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.965+0000 7f0c4dc00700 1 -- 172.21.15.159:0/2951240406 shutdown_connections 2024-02-28T23:12:36.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.965+0000 7f0c4dc00700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.159:6800/3612719472,v1:172.21.15.159:6801/3612719472] conn(0x7f0c2c06d520 0x7f0c2c06f9e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.965+0000 7f0c4dc00700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c48068670 0x7f0c48196700 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.965+0000 7f0c4dc00700 1 --2- 172.21.15.159:0/2951240406 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0c48069020 0x7f0c48196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:12:36.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.965+0000 7f0c4dc00700 1 -- 172.21.15.159:0/2951240406 >> 172.21.15.159:0/2951240406 conn(0x7f0c480755a0 msgr2=0x7f0c48105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:12:36.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.966+0000 7f0c4dc00700 1 -- 172.21.15.159:0/2951240406 shutdown_connections 2024-02-28T23:12:36.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:12:36.966+0000 7f0c4dc00700 1 -- 172.21.15.159:0/2951240406 wait complete. 2024-02-28T23:12:37.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:37 smithi159 ceph-mon[28802]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:37.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:37 smithi159 ceph-mon[28802]: from='client.? 172.21.15.159:0/2951240406' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:12:37.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:37 smithi159 ceph-mon[28802]: pgmap v142: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:37.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:37 smithi184 ceph-mon[36198]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:12:37.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:37 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2951240406' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:12:37.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:37 smithi184 ceph-mon[36198]: pgmap v142: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:39.074 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:38 smithi159 ceph-mon[28802]: Upgrade: Updating mon.smithi159 2024-02-28T23:12:39.074 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:38 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:39.074 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:38 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T23:12:39.074 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:38 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T23:12:39.074 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:38 smithi159 ceph-mon[28802]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:12:39.074 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:38 smithi159 ceph-mon[28802]: Deploying daemon mon.smithi159 on smithi159 2024-02-28T23:12:39.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:38 smithi184 ceph-mon[36198]: Upgrade: Updating mon.smithi159 2024-02-28T23:12:39.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:38 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:39.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:38 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T23:12:39.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:38 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T23:12:39.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:38 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:12:39.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:38 smithi184 ceph-mon[36198]: Deploying daemon mon.smithi159 on smithi159 2024-02-28T23:12:39.969 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:39 smithi159 ceph-mon[28802]: pgmap v143: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:40.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:39 smithi184 ceph-mon[36198]: pgmap v143: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:40.924 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:40 smithi159 systemd[1]: Stopping Ceph mon.smithi159 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:12:41.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:40 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159[28798]: 2024-02-28T23:12:40.922+0000 7f0de2600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi159 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:12:41.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:40 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159[28798]: 2024-02-28T23:12:40.922+0000 7f0de2600700 -1 mon.smithi159@0(leader) e2 *** Got Signal Terminated *** 2024-02-28T23:12:41.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:41 smithi159 podman[113663]: 2024-02-28 23:12:41.12871844 +0000 UTC m=+0.337623213 container died 6bdfab2318d019cec76fedab091e3beef74fcf53ee086976a0cf5fd06217f36f (image=quay.io/ceph/ceph:v18.2.1, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, ceph=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:12:41.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:41 smithi159 podman[113663]: 2024-02-28 23:12:41.574426561 +0000 UTC m=+0.783331324 container cleanup 6bdfab2318d019cec76fedab091e3beef74fcf53ee086976a0cf5fd06217f36f (image=quay.io/ceph/ceph:v18.2.1, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.29.1, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-02-28T23:12:41.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:41 smithi159 bash[113663]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159 2024-02-28T23:12:41.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:41 smithi159 podman[113688]: 2024-02-28 23:12:41.817619242 +0000 UTC m=+0.673122438 container remove 6bdfab2318d019cec76fedab091e3beef74fcf53ee086976a0cf5fd06217f36f (image=quay.io/ceph/ceph:v18.2.1, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, org.label-schema.license=GPLv2, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, ceph=True, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-28T23:12:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:42 smithi159 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi159.service: Deactivated successfully. 2024-02-28T23:12:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:42 smithi159 systemd[1]: Stopped Ceph mon.smithi159 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:12:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:42 smithi159 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi159.service: Consumed 32.234s CPU time. 2024-02-28T23:12:43.077 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:42 smithi159 systemd[1]: Starting Ceph mon.smithi159 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:12:43.421 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 podman[113814]: 2024-02-28 23:12:42.98428707 +0000 UTC m=+0.033919741 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:12:43.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 podman[113814]: 2024-02-28 23:12:43.102168626 +0000 UTC m=+0.151801324 container create 9657ea46dc51b69b3e341d958de79e44f3de16d8a361218608fcc4930aed4b04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T23:12:43.422 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 podman[113814]: 2024-02-28 23:12:43.422802239 +0000 UTC m=+0.472434990 container init 9657ea46dc51b69b3e341d958de79e44f3de16d8a361218608fcc4930aed4b04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T23:12:43.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 podman[113814]: 2024-02-28 23:12:43.433367569 +0000 UTC m=+0.483000298 container start 9657ea46dc51b69b3e341d958de79e44f3de16d8a361218608fcc4930aed4b04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-02-28T23:12:43.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T23:12:43.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev), process ceph-mon, pid 2 2024-02-28T23:12:43.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: pidfile_write: ignore empty --pid-file 2024-02-28T23:12:43.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: load: jerasure load: lrc 2024-02-28T23:12:43.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: RocksDB version: 7.9.2 2024-02-28T23:12:43.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Git sha 0 2024-02-28T23:12:43.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Compile date 2024-02-23 16:20:17 2024-02-28T23:12:43.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: DB SUMMARY 2024-02-28T23:12:43.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: DB Session ID: TG5C0B0WN4YW9UBE41I9 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: CURRENT file: CURRENT 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1732 Bytes 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi159/store.db dir, Total Num: 1, files: 000035.sst 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi159/store.db: 000033.log size: 1198429 ; 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.error_if_exists: 0 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.create_if_missing: 0 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.paranoid_checks: 1 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.env: 0x564c9dfa1b20 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.fs: PosixFileSystem 2024-02-28T23:12:43.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.info_log: 0x564c9ea337c0 2024-02-28T23:12:43.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T23:12:43.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.statistics: (nil) 2024-02-28T23:12:43.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.use_fsync: 0 2024-02-28T23:12:43.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_log_file_size: 0 2024-02-28T23:12:43.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T23:12:43.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T23:12:43.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T23:12:43.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T23:12:43.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.allow_fallocate: 1 2024-02-28T23:12:43.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.use_direct_reads: 0 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.db_log_dir: 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.wal_dir: 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T23:12:43.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.write_buffer_manager: 0x564c9ea07400 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.unordered_write: 0 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T23:12:43.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.row_cache: None 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.wal_filter: None 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.two_write_queues: 0 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.wal_compression: 0 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.atomic_flush: 0 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T23:12:43.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T23:12:43.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T23:12:43.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.log_readahead_size: 0 2024-02-28T23:12:43.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T23:12:43.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T23:12:43.730 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_background_jobs: 2 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_background_compactions: -1 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_subcompactions: 1 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T23:12:43.731 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_open_files: -1 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_background_flushes: -1 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Compression algorithms supported: 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T23:12:43.732 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: kZSTD supported: 0 2024-02-28T23:12:43.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: kXpressCompression supported: 0 2024-02-28T23:12:43.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T23:12:43.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: kZlibCompression supported: 1 2024-02-28T23:12:43.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: kSnappyCompression supported: 1 2024-02-28T23:12:43.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: kLZ4Compression supported: 1 2024-02-28T23:12:43.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: kBZip2Compression supported: 0 2024-02-28T23:12:43.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T23:12:43.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-28T23:12:43.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000015 2024-02-28T23:12:43.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-28T23:12:43.733 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.merge_operator: 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_filter: None 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564c9ea338e0) 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: cache_index_and_filter_blocks: 1 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: pin_top_level_index_and_filter: 1 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_type: 0 2024-02-28T23:12:43.734 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_block_index_type: 0 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_shortening: 1 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: checksum: 4 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: no_block_cache: 0 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache: 0x564c9ea37090 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_name: BinnedLRUCache 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_options: 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: capacity : 536870912 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: num_shard_bits : 4 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: strict_capacity_limit : 0 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: high_pri_pool_ratio: 0.000 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_cache_compressed: (nil) 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: persistent_cache: (nil) 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_size: 4096 2024-02-28T23:12:43.735 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_size_deviation: 10 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_restart_interval: 16 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: index_block_restart_interval: 1 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: metadata_block_size: 4096 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: partition_filters: 0 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: use_delta_encoding: 1 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: filter_policy: bloomfilter 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: whole_key_filtering: 1 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: verify_compression: 0 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: read_amp_bytes_per_bit: 0 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: format_version: 5 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: enable_index_compression: 1 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: block_align: 0 2024-02-28T23:12:43.736 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_auto_readahead_size: 262144 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: prepopulate_block_cache: 0 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: initial_auto_readahead_size: 8192 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: num_file_reads_for_auto_readahead: 2 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compression: NoCompression 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.num_levels: 7 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T23:12:43.737 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T23:12:43.738 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T23:12:43.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T23:12:43.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T23:12:43.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-28T23:12:43.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T23:12:43.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T23:12:43.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-28T23:12:43.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T23:12:43.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T23:12:43.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T23:12:43.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T23:12:43.739 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T23:12:43.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T23:12:43.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T23:12:43.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T23:12:43.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T23:12:43.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T23:12:43.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T23:12:43.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T23:12:43.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T23:12:43.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T23:12:43.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T23:12:43.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T23:12:43.741 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T23:12:43.741 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-28T23:12:43.741 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.arena_block_size: 1048576 2024-02-28T23:12:43.741 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T23:12:43.742 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T23:12:43.742 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T23:12:43.742 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T23:12:43.742 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T23:12:43.742 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T23:12:43.742 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T23:12:43.742 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T23:12:43.742 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T23:12:43.742 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T23:12:43.742 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.table_properties_collectors: 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.inplace_update_support: 0 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.bloom_locality: 0 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.max_successive_merges: 0 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T23:12:43.743 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.ttl: 2592000 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.enable_blob_files: false 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.min_blob_size: 0 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T23:12:43.744 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.blob_file_starting_level: 0 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi159/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 37, last_sequence is 16464, log_number is 33,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 33 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 33 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7ea593f4-d031-4554-ad32-a9bca24b6cbd 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709161963496069, "job": 1, "event": "recovery_started", "wal_files": [33]} 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #33 mode 2 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709161963504987, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 38, "file_size": 1105912, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 16465, "largest_seqno": 18057, "table_properties": {"data_size": 1099495, "index_size": 3802, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1605, "raw_key_size": 14614, "raw_average_key_size": 23, "raw_value_size": 1086355, "raw_average_value_size": 1727, "num_data_blocks": 173, "num_entries": 629, "num_filter_entries": 629, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709161963, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7ea593f4-d031-4554-ad32-a9bca24b6cbd", "db_session_id": "TG5C0B0WN4YW9UBE41I9", "orig_file_number": 38, "seqno_to_time_mapping": "N/A"}} 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709161963505185, "job": 1, "event": "recovery_finished"} 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/version_set.cc:5047] Creating manifest 40 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi159/store.db/000033.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T23:12:43.745 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564c9eb26000 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: DB pointer 0x564c9eb12000 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** DB Stats ** 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T23:12:43.746 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: L0 1/0 1.05 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 214.4 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: L6 1/0 7.79 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Sum 2/0 8.84 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 214.4 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 214.4 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** Compaction Stats [default] ** 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 214.4 0.00 0.00 1 0.005 0 0 0.0 0.0 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-28T23:12:43.747 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Cumulative compaction: 0.00 GB write, 63.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Interval compaction: 0.00 GB write, 63.47 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Block cache BinnedLRUCache@0x564c9ea37090#2 capacity: 512.00 MB usage: 5.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.6e-05 secs_since: 0 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.78 KB,0.000339746%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T23:12:43.748 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T23:12:43.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: starting mon.smithi159 rank 0 at public addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] at bind addrs [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi159 fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T23:12:43.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: mon.smithi159@-1(???) e2 preinit fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T23:12:43.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: mon.smithi159@-1(???).mds e18 new map 2024-02-28T23:12:43.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: mon.smithi159@-1(???).mds e18 print_map 2024-02-28T23:12:43.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: e18 2024-02-28T23:12:43.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:12:43.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:12:43.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: legacy client fscid: 1 2024-02-28T23:12:43.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T23:12:43.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Filesystem 'cephfs' (1) 2024-02-28T23:12:43.749 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: fs_name cephfs 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: epoch 18 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: tableserver 0 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: root 0 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: session_timeout 60 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: session_autoclose 300 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_file_size 1099511627776 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_xattr_size 65536 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: required_client_features {} 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: last_failure 0 2024-02-28T23:12:43.750 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: last_failure_osd_epoch 46 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: max_mds 1 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: in 0 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: up {0=14472} 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: failed 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: damaged 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: stopped 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: data_pools [3] 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: metadata_pool 2 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: inline_data disabled 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: balancer 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: bal_rank_mask -1 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: standby_count_wanted 1 2024-02-28T23:12:43.751 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: Standby daemons: 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout: [mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: mon.smithi159@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: mon.smithi159@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: mon.smithi159@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: mon.smithi159@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T23:12:43.752 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 ceph-mon[113833]: mon.smithi159@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-02-28T23:12:43.753 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 bash[113814]: 9657ea46dc51b69b3e341d958de79e44f3de16d8a361218608fcc4930aed4b04 2024-02-28T23:12:43.753 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:43 smithi159 systemd[1]: Started Ceph mon.smithi159 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:12:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: pgmap v144: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: pgmap v145: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: mon.smithi159 calling monitor election 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: mon.smithi159 is new leader, mons smithi159,smithi184 in quorum (ranks 0,1) 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: monmap e2: 2 mons at {smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0],smithi184=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: mgrmap e32: smithi159.pobewk(active, since 4m), standbys: smithi184.quvmnx 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: overall HEALTH_OK 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: from='mgr.14680 ' entity='' 2024-02-28T23:12:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:44 smithi159 ceph-mon[113833]: mgrmap e33: smithi159.pobewk(active, since 4m), standbys: smithi184.quvmnx 2024-02-28T23:12:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:12:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:12:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: pgmap v144: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:12:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: pgmap v145: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:12:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: from='mgr.14680 172.21.15.159:0/2499533308' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:12:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: mon.smithi159 calling monitor election 2024-02-28T23:12:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: mon.smithi159 is new leader, mons smithi159,smithi184 in quorum (ranks 0,1) 2024-02-28T23:12:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: monmap e2: 2 mons at {smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0],smithi184=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T23:12:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:12:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: osdmap e48: 6 total, 6 up, 6 in 2024-02-28T23:12:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: mgrmap e32: smithi159.pobewk(active, since 4m), standbys: smithi184.quvmnx 2024-02-28T23:12:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: overall HEALTH_OK 2024-02-28T23:12:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: from='mgr.14680 ' entity='' 2024-02-28T23:12:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:44 smithi184 ceph-mon[36198]: mgrmap e33: smithi159.pobewk(active, since 4m), standbys: smithi184.quvmnx 2024-02-28T23:12:53.201 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:53 smithi184 ceph-mon[36198]: Standby manager daemon smithi184.quvmnx restarted 2024-02-28T23:12:53.201 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:53 smithi184 ceph-mon[36198]: Standby manager daemon smithi184.quvmnx started 2024-02-28T23:12:53.201 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:53 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/1767390735' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/crt"}]: dispatch 2024-02-28T23:12:53.201 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:53 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/1767390735' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:12:53.201 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:53 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/1767390735' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/key"}]: dispatch 2024-02-28T23:12:53.201 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:53 smithi184 ceph-mon[36198]: from='mgr.? 172.21.15.184:0/1767390735' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:12:53.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:53 smithi159 ceph-mon[113833]: Standby manager daemon smithi184.quvmnx restarted 2024-02-28T23:12:53.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:53 smithi159 ceph-mon[113833]: Standby manager daemon smithi184.quvmnx started 2024-02-28T23:12:53.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:53 smithi159 ceph-mon[113833]: from='mgr.? 172.21.15.184:0/1767390735' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/crt"}]: dispatch 2024-02-28T23:12:53.272 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:53 smithi159 ceph-mon[113833]: from='mgr.? 172.21.15.184:0/1767390735' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-28T23:12:53.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:53 smithi159 ceph-mon[113833]: from='mgr.? 172.21.15.184:0/1767390735' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi184.quvmnx/key"}]: dispatch 2024-02-28T23:12:53.273 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:53 smithi159 ceph-mon[113833]: from='mgr.? 172.21.15.184:0/1767390735' entity='mgr.smithi184.quvmnx' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-28T23:12:54.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: mgrmap e34: smithi159.pobewk(active, since 4m), standbys: smithi184.quvmnx 2024-02-28T23:12:54.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: Active manager daemon smithi159.pobewk restarted 2024-02-28T23:12:54.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: Activating manager daemon smithi159.pobewk 2024-02-28T23:12:54.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: mgrmap e35: smithi159.pobewk(active, starting, since 0.020264s), standbys: smithi184.quvmnx 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi159.pobewk", "id": "smithi159.pobewk"}]: dispatch 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi184.quvmnx", "id": "smithi184.quvmnx"}]: dispatch 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:12:54.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: Manager daemon smithi159.pobewk is now available 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/mirror_snapshot_schedule"}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/mirror_snapshot_schedule"}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/trash_purge_schedule"}]: dispatch 2024-02-28T23:12:54.353 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:54 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/trash_purge_schedule"}]: dispatch 2024-02-28T23:12:54.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: mgrmap e34: smithi159.pobewk(active, since 4m), standbys: smithi184.quvmnx 2024-02-28T23:12:54.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: Active manager daemon smithi159.pobewk restarted 2024-02-28T23:12:54.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: Activating manager daemon smithi159.pobewk 2024-02-28T23:12:54.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T23:12:54.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: mgrmap e35: smithi159.pobewk(active, starting, since 0.020264s), standbys: smithi184.quvmnx 2024-02-28T23:12:54.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:12:54.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:12:54.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:12:54.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:12:54.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi159.pobewk", "id": "smithi159.pobewk"}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr metadata", "who": "smithi184.quvmnx", "id": "smithi184.quvmnx"}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: Manager daemon smithi159.pobewk is now available 2024-02-28T23:12:54.475 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:12:54.476 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:12:54.476 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:12:54.476 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/mirror_snapshot_schedule"}]: dispatch 2024-02-28T23:12:54.476 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/mirror_snapshot_schedule"}]: dispatch 2024-02-28T23:12:54.476 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/trash_purge_schedule"}]: dispatch 2024-02-28T23:12:54.476 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:54 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi159.pobewk/trash_purge_schedule"}]: dispatch 2024-02-28T23:12:55.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:55 smithi159 ceph-mon[113833]: [28/Feb/2024:23:12:53] ENGINE Bus STARTING 2024-02-28T23:12:55.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:55 smithi159 ceph-mon[113833]: [28/Feb/2024:23:12:54] ENGINE Serving on http://172.21.15.159:8765 2024-02-28T23:12:55.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:55 smithi159 ceph-mon[113833]: mgrmap e36: smithi159.pobewk(active, since 1.02079s), standbys: smithi184.quvmnx 2024-02-28T23:12:55.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:55 smithi159 ceph-mon[113833]: pgmap v3: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:12:55.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:55 smithi159 ceph-mon[113833]: [28/Feb/2024:23:12:54] ENGINE Serving on https://172.21.15.159:7150 2024-02-28T23:12:55.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:55 smithi159 ceph-mon[113833]: [28/Feb/2024:23:12:54] ENGINE Bus STARTED 2024-02-28T23:12:55.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:55 smithi184 ceph-mon[36198]: [28/Feb/2024:23:12:53] ENGINE Bus STARTING 2024-02-28T23:12:55.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:55 smithi184 ceph-mon[36198]: [28/Feb/2024:23:12:54] ENGINE Serving on http://172.21.15.159:8765 2024-02-28T23:12:55.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:55 smithi184 ceph-mon[36198]: mgrmap e36: smithi159.pobewk(active, since 1.02079s), standbys: smithi184.quvmnx 2024-02-28T23:12:55.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:55 smithi184 ceph-mon[36198]: pgmap v3: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:12:55.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:55 smithi184 ceph-mon[36198]: [28/Feb/2024:23:12:54] ENGINE Serving on https://172.21.15.159:7150 2024-02-28T23:12:55.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:55 smithi184 ceph-mon[36198]: [28/Feb/2024:23:12:54] ENGINE Bus STARTED 2024-02-28T23:12:56.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:56 smithi184 ceph-mon[36198]: pgmap v4: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:12:56.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:56 smithi184 ceph-mon[36198]: mgrmap e37: smithi159.pobewk(active, since 2s), standbys: smithi184.quvmnx 2024-02-28T23:12:56.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:56 smithi159 ceph-mon[113833]: pgmap v4: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:12:56.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:56 smithi159 ceph-mon[113833]: mgrmap e37: smithi159.pobewk(active, since 2s), standbys: smithi184.quvmnx 2024-02-28T23:12:58.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:58 smithi184 ceph-mon[36198]: pgmap v5: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:12:58.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:58 smithi184 ceph-mon[36198]: mgrmap e38: smithi159.pobewk(active, since 4s), standbys: smithi184.quvmnx 2024-02-28T23:12:58.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:58 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:58.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:12:58 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:58.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:58 smithi159 ceph-mon[113833]: pgmap v5: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:12:58.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:58 smithi159 ceph-mon[113833]: mgrmap e38: smithi159.pobewk(active, since 4s), standbys: smithi184.quvmnx 2024-02-28T23:12:58.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:58 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:12:58.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:12:58 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:00.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:00 smithi184 ceph-mon[36198]: pgmap v6: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:13:00.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:00 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:00.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:00 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:00.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:00 smithi159 ceph-mon[113833]: pgmap v6: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:13:00.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:00 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:00.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:00 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:01.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:01 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:01.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:01 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:01.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:01 smithi184 ceph-mon[36198]: pgmap v7: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-02-28T23:13:01.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:01 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:01.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:01 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:01.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:01 smithi159 ceph-mon[113833]: pgmap v7: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 30 KiB/s rd, 0 B/s wr, 18 op/s 2024-02-28T23:13:03.931 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:03 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:03.931 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:03 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:03.931 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:03 smithi159 ceph-mon[113833]: pgmap v8: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-28T23:13:04.059 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:03 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:04.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:03 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:04.060 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:03 smithi184 ceph-mon[36198]: pgmap v8: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 14 op/s 2024-02-28T23:13:06.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:06 smithi184 ceph-mon[36198]: pgmap v9: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-28T23:13:06.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:06 smithi184 ceph-mon[36198]: Detected new or changed devices on smithi184 2024-02-28T23:13:06.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:06 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:06.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:06 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:06.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:06 smithi159 ceph-mon[113833]: pgmap v9: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-28T23:13:06.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:06 smithi159 ceph-mon[113833]: Detected new or changed devices on smithi184 2024-02-28T23:13:06.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:06 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:06.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:06 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:07.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.154+0000 7fae16a00700 1 -- 172.21.15.159:0/524336893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae10073a80 msgr2=0x7fae1010cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:07.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.154+0000 7fae16a00700 1 --2- 172.21.15.159:0/524336893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae10073a80 0x7fae1010cea0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009910 tx=0x7fadfc009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:07.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.154+0000 7fae16a00700 1 -- 172.21.15.159:0/524336893 shutdown_connections 2024-02-28T23:13:07.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.154+0000 7fae16a00700 1 --2- 172.21.15.159:0/524336893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae10073a80 0x7fae1010cea0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.154+0000 7fae16a00700 1 --2- 172.21.15.159:0/524336893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10073160 0x7fae10073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.154+0000 7fae16a00700 1 -- 172.21.15.159:0/524336893 >> 172.21.15.159:0/524336893 conn(0x7fae100fc630 msgr2=0x7fae100fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:07.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.154+0000 7fae16a00700 1 -- 172.21.15.159:0/524336893 shutdown_connections 2024-02-28T23:13:07.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.154+0000 7fae16a00700 1 -- 172.21.15.159:0/524336893 wait complete. 2024-02-28T23:13:07.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.155+0000 7fae16a00700 1 Processor -- start 2024-02-28T23:13:07.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.155+0000 7fae16a00700 1 -- start start 2024-02-28T23:13:07.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.156+0000 7fae16a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10073160 0x7fae1019e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:07.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.156+0000 7fae16a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae10073a80 0x7fae1019ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:07.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.156+0000 7fae16a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1019f2d0 con 0x7fae10073a80 2024-02-28T23:13:07.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.156+0000 7fae16a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae10198780 con 0x7fae10073160 2024-02-28T23:13:07.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.156+0000 7fae0f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae10073a80 0x7fae1019ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:07.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.156+0000 7fae0f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae10073a80 0x7fae1019ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47846/0 (socket says 172.21.15.159:47846) 2024-02-28T23:13:07.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.156+0000 7fae0f400700 1 -- 172.21.15.159:0/2495343867 learned_addr learned my addr 172.21.15.159:0/2495343867 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:07.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.156+0000 7fae0fe00700 1 --2- 172.21.15.159:0/2495343867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10073160 0x7fae1019e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:07.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.157+0000 7fae0f400700 1 -- 172.21.15.159:0/2495343867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10073160 msgr2=0x7fae1019e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:07.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.157+0000 7fae0f400700 1 --2- 172.21.15.159:0/2495343867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10073160 0x7fae1019e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.157+0000 7fae0f400700 1 -- 172.21.15.159:0/2495343867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc0095f0 con 0x7fae10073a80 2024-02-28T23:13:07.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.157+0000 7fae0f400700 1 --2- 172.21.15.159:0/2495343867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae10073a80 0x7fae1019ec40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0092e0 tx=0x7fadfc00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:07.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.157+0000 7fae0cc00700 1 -- 172.21.15.159:0/2495343867 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadfc01d070 con 0x7fae10073a80 2024-02-28T23:13:07.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.157+0000 7fae0cc00700 1 -- 172.21.15.159:0/2495343867 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fadfc00f460 con 0x7fae10073a80 2024-02-28T23:13:07.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.157+0000 7fae0cc00700 1 -- 172.21.15.159:0/2495343867 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadfc017630 con 0x7fae10073a80 2024-02-28T23:13:07.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.157+0000 7fae16a00700 1 -- 172.21.15.159:0/2495343867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae10198a00 con 0x7fae10073a80 2024-02-28T23:13:07.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.157+0000 7fae16a00700 1 -- 172.21.15.159:0/2495343867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae10198ea0 con 0x7fae10073a80 2024-02-28T23:13:07.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.159+0000 7fae16a00700 1 -- 172.21.15.159:0/2495343867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae1010a5a0 con 0x7fae10073a80 2024-02-28T23:13:07.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.160+0000 7fae0cc00700 1 -- 172.21.15.159:0/2495343867 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fadfc00f5d0 con 0x7fae10073a80 2024-02-28T23:13:07.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.161+0000 7fae0cc00700 1 --2- 172.21.15.159:0/2495343867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fadf406d9d0 0x7fadf406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:07.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.161+0000 7fae0cc00700 1 -- 172.21.15.159:0/2495343867 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fadfc08ed90 con 0x7fae10073a80 2024-02-28T23:13:07.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.162+0000 7fae0fe00700 1 --2- 172.21.15.159:0/2495343867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fadf406d9d0 0x7fadf406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:07.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.162+0000 7fae0fe00700 1 --2- 172.21.15.159:0/2495343867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fadf406d9d0 0x7fadf406fe90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fae00005fd0 tx=0x7fae0000a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:07.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.166+0000 7fae0cc00700 1 -- 172.21.15.159:0/2495343867 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fadfc05be60 con 0x7fae10073a80 2024-02-28T23:13:07.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.490+0000 7fae16a00700 1 -- 172.21.15.159:0/2495343867 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae101991d0 con 0x7fadf406d9d0 2024-02-28T23:13:07.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.492+0000 7fae0cc00700 1 -- 172.21.15.159:0/2495343867 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fae101991d0 con 0x7fadf406d9d0 2024-02-28T23:13:07.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.495+0000 7fae16a00700 1 -- 172.21.15.159:0/2495343867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fadf406d9d0 msgr2=0x7fadf406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:07.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.495+0000 7fae16a00700 1 --2- 172.21.15.159:0/2495343867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fadf406d9d0 0x7fadf406fe90 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fae00005fd0 tx=0x7fae0000a560 comp rx=0 tx=0).stop 2024-02-28T23:13:07.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.495+0000 7fae16a00700 1 -- 172.21.15.159:0/2495343867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae10073a80 msgr2=0x7fae1019ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:07.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.495+0000 7fae16a00700 1 --2- 172.21.15.159:0/2495343867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae10073a80 0x7fae1019ec40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0092e0 tx=0x7fadfc00be00 comp rx=0 tx=0).stop 2024-02-28T23:13:07.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.495+0000 7fae16a00700 1 -- 172.21.15.159:0/2495343867 shutdown_connections 2024-02-28T23:13:07.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.495+0000 7fae16a00700 1 --2- 172.21.15.159:0/2495343867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fae10073160 0x7fae1019e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.495+0000 7fae16a00700 1 --2- 172.21.15.159:0/2495343867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fadf406d9d0 0x7fadf406fe90 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.495+0000 7fae16a00700 1 --2- 172.21.15.159:0/2495343867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fae10073a80 0x7fae1019ec40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.495+0000 7fae16a00700 1 -- 172.21.15.159:0/2495343867 >> 172.21.15.159:0/2495343867 conn(0x7fae100fc630 msgr2=0x7fae101076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:07.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.496+0000 7fae16a00700 1 -- 172.21.15.159:0/2495343867 shutdown_connections 2024-02-28T23:13:07.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.496+0000 7fae16a00700 1 -- 172.21.15.159:0/2495343867 wait complete. 2024-02-28T23:13:07.508 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:13:07.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.646+0000 7fa1d6a00700 1 -- 172.21.15.159:0/1350741159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d010d280 msgr2=0x7fa1d010d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:07.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.646+0000 7fa1d6a00700 1 --2- 172.21.15.159:0/1350741159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d010d280 0x7fa1d010d660 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009910 tx=0x7fa1c0009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:07.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.646+0000 7fa1d6a00700 1 -- 172.21.15.159:0/1350741159 shutdown_connections 2024-02-28T23:13:07.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.646+0000 7fa1d6a00700 1 --2- 172.21.15.159:0/1350741159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d01071d0 0x7fa1d0107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.646+0000 7fa1d6a00700 1 --2- 172.21.15.159:0/1350741159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d010d280 0x7fa1d010d660 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.646+0000 7fa1d6a00700 1 -- 172.21.15.159:0/1350741159 >> 172.21.15.159:0/1350741159 conn(0x7fa1d00769e0 msgr2=0x7fa1d0078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:07.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.646+0000 7fa1d6a00700 1 -- 172.21.15.159:0/1350741159 shutdown_connections 2024-02-28T23:13:07.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.646+0000 7fa1d6a00700 1 -- 172.21.15.159:0/1350741159 wait complete. 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.647+0000 7fa1d6a00700 1 Processor -- start 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.647+0000 7fa1d6a00700 1 -- start start 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.648+0000 7fa1d6a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d01071d0 0x7fa1d01a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.648+0000 7fa1d6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d010d280 0x7fa1d01a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.648+0000 7fa1d6a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d01a35b0 con 0x7fa1d010d280 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.648+0000 7fa1d6a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d019cb00 con 0x7fa1d01071d0 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.648+0000 7fa1cf400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d010d280 0x7fa1d01a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.648+0000 7fa1cf400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d010d280 0x7fa1d01a2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47860/0 (socket says 172.21.15.159:47860) 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.648+0000 7fa1cf400700 1 -- 172.21.15.159:0/771054765 learned_addr learned my addr 172.21.15.159:0/771054765 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.648+0000 7fa1cfe00700 1 --2- 172.21.15.159:0/771054765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d01071d0 0x7fa1d01a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.649+0000 7fa1cf400700 1 -- 172.21.15.159:0/771054765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d01071d0 msgr2=0x7fa1d01a2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:07.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.649+0000 7fa1cf400700 1 --2- 172.21.15.159:0/771054765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d01071d0 0x7fa1d01a2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.649+0000 7fa1cf400700 1 -- 172.21.15.159:0/771054765 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c00095f0 con 0x7fa1d010d280 2024-02-28T23:13:07.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.649+0000 7fa1cf400700 1 --2- 172.21.15.159:0/771054765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d010d280 0x7fa1d01a2f60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00c930 tx=0x7fa1bc00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:07.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.649+0000 7fa1ccc00700 1 -- 172.21.15.159:0/771054765 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1bc007ad0 con 0x7fa1d010d280 2024-02-28T23:13:07.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.649+0000 7fa1ccc00700 1 -- 172.21.15.159:0/771054765 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa1bc007c30 con 0x7fa1d010d280 2024-02-28T23:13:07.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.649+0000 7fa1ccc00700 1 -- 172.21.15.159:0/771054765 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa1bc018610 con 0x7fa1d010d280 2024-02-28T23:13:07.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.649+0000 7fa1d6a00700 1 -- 172.21.15.159:0/771054765 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d019cde0 con 0x7fa1d010d280 2024-02-28T23:13:07.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.649+0000 7fa1d6a00700 1 -- 172.21.15.159:0/771054765 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d019d310 con 0x7fa1d010d280 2024-02-28T23:13:07.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.650+0000 7fa1d6a00700 1 -- 172.21.15.159:0/771054765 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d004ea90 con 0x7fa1d010d280 2024-02-28T23:13:07.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.651+0000 7fa1ccc00700 1 -- 172.21.15.159:0/771054765 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fa1bc00f450 con 0x7fa1d010d280 2024-02-28T23:13:07.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.652+0000 7fa1ccc00700 1 --2- 172.21.15.159:0/771054765 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa1b406d9e0 0x7fa1b406fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.652+0000 7fa1ccc00700 1 -- 172.21.15.159:0/771054765 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fa1bc08d9f0 con 0x7fa1d010d280 2024-02-28T23:13:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.652+0000 7fa1cfe00700 1 --2- 172.21.15.159:0/771054765 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa1b406d9e0 0x7fa1b406fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:07.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.653+0000 7fa1cfe00700 1 --2- 172.21.15.159:0/771054765 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa1b406d9e0 0x7fa1b406fea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000b5c0 tx=0x7fa1c001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:07.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.657+0000 7fa1ccc00700 1 -- 172.21.15.159:0/771054765 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa1bc05aac0 con 0x7fa1d010d280 2024-02-28T23:13:07.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.894+0000 7fa1d6a00700 1 -- 172.21.15.159:0/771054765 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa1d019d6f0 con 0x7fa1b406d9e0 2024-02-28T23:13:07.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.897+0000 7fa1ccc00700 1 -- 172.21.15.159:0/771054765 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7fa1d019d6f0 con 0x7fa1b406d9e0 2024-02-28T23:13:07.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.899+0000 7fa1d6a00700 1 -- 172.21.15.159:0/771054765 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa1b406d9e0 msgr2=0x7fa1b406fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:07.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.899+0000 7fa1d6a00700 1 --2- 172.21.15.159:0/771054765 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa1b406d9e0 0x7fa1b406fea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000b5c0 tx=0x7fa1c001a040 comp rx=0 tx=0).stop 2024-02-28T23:13:07.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.899+0000 7fa1d6a00700 1 -- 172.21.15.159:0/771054765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d010d280 msgr2=0x7fa1d01a2f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:07.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.899+0000 7fa1d6a00700 1 --2- 172.21.15.159:0/771054765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d010d280 0x7fa1d01a2f60 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa1bc00c930 tx=0x7fa1bc00ccf0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.899+0000 7fa1d6a00700 1 -- 172.21.15.159:0/771054765 shutdown_connections 2024-02-28T23:13:07.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.899+0000 7fa1d6a00700 1 --2- 172.21.15.159:0/771054765 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa1d01071d0 0x7fa1d01a2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.899+0000 7fa1d6a00700 1 --2- 172.21.15.159:0/771054765 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa1b406d9e0 0x7fa1b406fea0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.899+0000 7fa1d6a00700 1 --2- 172.21.15.159:0/771054765 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa1d010d280 0x7fa1d01a2f60 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:07.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.899+0000 7fa1d6a00700 1 -- 172.21.15.159:0/771054765 >> 172.21.15.159:0/771054765 conn(0x7fa1d00769e0 msgr2=0x7fa1d0078410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:07.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.900+0000 7fa1d6a00700 1 -- 172.21.15.159:0/771054765 shutdown_connections 2024-02-28T23:13:07.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:07.900+0000 7fa1d6a00700 1 -- 172.21.15.159:0/771054765 wait complete. 2024-02-28T23:13:08.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.051+0000 7f9a4b000700 1 -- 172.21.15.159:0/4207929657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a44107bd0 msgr2=0x7f9a4410bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:08.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.051+0000 7f9a4b000700 1 --2- 172.21.15.159:0/4207929657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a44107bd0 0x7f9a4410bc10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f9a30009910 tx=0x7f9a30009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:08.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.052+0000 7f9a4b000700 1 -- 172.21.15.159:0/4207929657 shutdown_connections 2024-02-28T23:13:08.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.052+0000 7f9a4b000700 1 --2- 172.21.15.159:0/4207929657 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a44107bd0 0x7f9a4410bc10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.052+0000 7f9a4b000700 1 --2- 172.21.15.159:0/4207929657 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a44107220 0x7f9a44107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.052+0000 7f9a4b000700 1 -- 172.21.15.159:0/4207929657 >> 172.21.15.159:0/4207929657 conn(0x7f9a440767e0 msgr2=0x7f9a44078c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:08.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.052+0000 7f9a4b000700 1 -- 172.21.15.159:0/4207929657 shutdown_connections 2024-02-28T23:13:08.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.052+0000 7f9a4b000700 1 -- 172.21.15.159:0/4207929657 wait complete. 2024-02-28T23:13:08.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.053+0000 7f9a4b000700 1 Processor -- start 2024-02-28T23:13:08.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.053+0000 7f9a4b000700 1 -- start start 2024-02-28T23:13:08.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.053+0000 7f9a4b000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a44107220 0x7f9a441a29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:08.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.053+0000 7f9a4b000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a44107bd0 0x7f9a441a2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:08.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.053+0000 7f9a4b000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a441a35c0 con 0x7f9a44107220 2024-02-28T23:13:08.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.053+0000 7f9a4b000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4419ca70 con 0x7f9a44107bd0 2024-02-28T23:13:08.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.054+0000 7f9a49c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a44107220 0x7f9a441a29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:08.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.054+0000 7f9a49c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a44107220 0x7f9a441a29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44222/0 (socket says 172.21.15.159:44222) 2024-02-28T23:13:08.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.054+0000 7f9a49c00700 1 -- 172.21.15.159:0/2591321440 learned_addr learned my addr 172.21.15.159:0/2591321440 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:08.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.054+0000 7f9a49200700 1 --2- 172.21.15.159:0/2591321440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a44107bd0 0x7f9a441a2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:08.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.054+0000 7f9a49c00700 1 -- 172.21.15.159:0/2591321440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a44107bd0 msgr2=0x7f9a441a2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:08.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.054+0000 7f9a49c00700 1 --2- 172.21.15.159:0/2591321440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a44107bd0 0x7f9a441a2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.054+0000 7f9a49c00700 1 -- 172.21.15.159:0/2591321440 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a300095f0 con 0x7f9a44107220 2024-02-28T23:13:08.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.054+0000 7f9a49c00700 1 --2- 172.21.15.159:0/2591321440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a44107220 0x7f9a441a29f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800d8d0 tx=0x7f9a3800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:08.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.054+0000 7f9a42000700 1 -- 172.21.15.159:0/2591321440 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a38009940 con 0x7f9a44107220 2024-02-28T23:13:08.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.055+0000 7f9a42000700 1 -- 172.21.15.159:0/2591321440 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9a38010460 con 0x7f9a44107220 2024-02-28T23:13:08.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.055+0000 7f9a42000700 1 -- 172.21.15.159:0/2591321440 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a3800f5f0 con 0x7f9a44107220 2024-02-28T23:13:08.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.055+0000 7f9a4b000700 1 -- 172.21.15.159:0/2591321440 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4419cd50 con 0x7f9a44107220 2024-02-28T23:13:08.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.055+0000 7f9a4b000700 1 -- 172.21.15.159:0/2591321440 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4419d2a0 con 0x7f9a44107220 2024-02-28T23:13:08.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.056+0000 7f9a4b000700 1 -- 172.21.15.159:0/2591321440 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a4410f610 con 0x7f9a44107220 2024-02-28T23:13:08.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.057+0000 7f9a42000700 1 -- 172.21.15.159:0/2591321440 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f9a380105d0 con 0x7f9a44107220 2024-02-28T23:13:08.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.057+0000 7f9a42000700 1 --2- 172.21.15.159:0/2591321440 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9a2c06d9d0 0x7f9a2c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:08.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.057+0000 7f9a42000700 1 -- 172.21.15.159:0/2591321440 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f9a3808d6a0 con 0x7f9a44107220 2024-02-28T23:13:08.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.058+0000 7f9a49200700 1 --2- 172.21.15.159:0/2591321440 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9a2c06d9d0 0x7f9a2c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:08.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.058+0000 7f9a49200700 1 --2- 172.21.15.159:0/2591321440 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9a2c06d9d0 0x7f9a2c06fe90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9a30000c00 tx=0x7f9a30005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:08.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.062+0000 7f9a42000700 1 -- 172.21.15.159:0/2591321440 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9a3805a7f0 con 0x7f9a44107220 2024-02-28T23:13:08.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:08 smithi159 ceph-mon[113833]: pgmap v10: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-28T23:13:08.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.301+0000 7f9a4b000700 1 -- 172.21.15.159:0/2591321440 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a4419d510 con 0x7f9a2c06d9d0 2024-02-28T23:13:08.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.314+0000 7f9a42000700 1 -- 172.21.15.159:0/2591321440 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9a4419d510 con 0x7f9a2c06d9d0 2024-02-28T23:13:08.313 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:13:08.313 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (2m) 7s ago 16m 14.5M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (17m) 7s ago 17m 8384k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (15m) 10s ago 15m 7986k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (17m) 7s ago 17m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (15m) 10s ago 15m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (2m) 7s ago 16m 75.1M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (9m) 7s ago 9m 148M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (9m) 7s ago 9m 86.7M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (9m) 10s ago 9m 16.5M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (9m) 10s ago 9m 16.4M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (5m) 7s ago 18m 476M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (4m) 10s ago 15m 447M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (25s) 7s ago 19m 28.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (15m) 10s ago 15m 47.9M 2048M 18.2.1 5be31c24972a 472cd67d6c85 2024-02-28T23:13:08.314 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (3m) 7s ago 17m 7578k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:13:08.315 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (3m) 10s ago 15m 7684k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:13:08.315 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (14m) 7s ago 14m 235M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:13:08.315 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (13m) 7s ago 13m 250M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:13:08.315 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (13m) 7s ago 13m 212M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:13:08.315 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (12m) 10s ago 12m 299M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:13:08.315 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (12m) 10s ago 12m 251M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:13:08.315 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (11m) 10s ago 11m 230M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:13:08.315 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (3m) 7s ago 16m 52.6M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:13:08.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.317+0000 7f9a4b000700 1 -- 172.21.15.159:0/2591321440 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9a2c06d9d0 msgr2=0x7f9a2c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:08.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.317+0000 7f9a4b000700 1 --2- 172.21.15.159:0/2591321440 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9a2c06d9d0 0x7f9a2c06fe90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9a30000c00 tx=0x7f9a30005fd0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.317+0000 7f9a4b000700 1 -- 172.21.15.159:0/2591321440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a44107220 msgr2=0x7f9a441a29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:08.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.317+0000 7f9a4b000700 1 --2- 172.21.15.159:0/2591321440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a44107220 0x7f9a441a29f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f9a3800d8d0 tx=0x7f9a3800dc90 comp rx=0 tx=0).stop 2024-02-28T23:13:08.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.317+0000 7f9a4b000700 1 -- 172.21.15.159:0/2591321440 shutdown_connections 2024-02-28T23:13:08.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.317+0000 7f9a4b000700 1 --2- 172.21.15.159:0/2591321440 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9a2c06d9d0 0x7f9a2c06fe90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.317+0000 7f9a4b000700 1 --2- 172.21.15.159:0/2591321440 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9a44107220 0x7f9a441a29f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.317+0000 7f9a4b000700 1 --2- 172.21.15.159:0/2591321440 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9a44107bd0 0x7f9a441a2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.317+0000 7f9a4b000700 1 -- 172.21.15.159:0/2591321440 >> 172.21.15.159:0/2591321440 conn(0x7f9a440767e0 msgr2=0x7f9a44078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:08.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.318+0000 7f9a4b000700 1 -- 172.21.15.159:0/2591321440 shutdown_connections 2024-02-28T23:13:08.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.318+0000 7f9a4b000700 1 -- 172.21.15.159:0/2591321440 wait complete. 2024-02-28T23:13:08.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:08 smithi184 ceph-mon[36198]: pgmap v10: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-28T23:13:08.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.495+0000 7fc735600700 1 -- 172.21.15.159:0/1622673857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7301039a0 msgr2=0x7fc7301079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:08.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.495+0000 7fc735600700 1 --2- 172.21.15.159:0/1622673857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7301039a0 0x7fc7301079f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009910 tx=0x7fc71c009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:08.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.495+0000 7fc735600700 1 -- 172.21.15.159:0/1622673857 shutdown_connections 2024-02-28T23:13:08.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.495+0000 7fc735600700 1 --2- 172.21.15.159:0/1622673857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc7301039a0 0x7fc7301079f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.495+0000 7fc735600700 1 --2- 172.21.15.159:0/1622673857 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc730102ff0 0x7fc7301033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.495+0000 7fc735600700 1 -- 172.21.15.159:0/1622673857 >> 172.21.15.159:0/1622673857 conn(0x7fc7300fe880 msgr2=0x7fc730100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:08.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.495+0000 7fc735600700 1 -- 172.21.15.159:0/1622673857 shutdown_connections 2024-02-28T23:13:08.494 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.495+0000 7fc735600700 1 -- 172.21.15.159:0/1622673857 wait complete. 2024-02-28T23:13:08.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.496+0000 7fc735600700 1 Processor -- start 2024-02-28T23:13:08.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.497+0000 7fc735600700 1 -- start start 2024-02-28T23:13:08.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.497+0000 7fc735600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730102ff0 0x7fc7301989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:08.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.497+0000 7fc735600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7301039a0 0x7fc730198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:08.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.497+0000 7fc735600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc730199570 con 0x7fc730102ff0 2024-02-28T23:13:08.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.497+0000 7fc735600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73019d380 con 0x7fc7301039a0 2024-02-28T23:13:08.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.497+0000 7fc72ea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730102ff0 0x7fc7301989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:08.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.497+0000 7fc72ea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730102ff0 0x7fc7301989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44240/0 (socket says 172.21.15.159:44240) 2024-02-28T23:13:08.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.497+0000 7fc72ea00700 1 -- 172.21.15.159:0/1675760847 learned_addr learned my addr 172.21.15.159:0/1675760847 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:08.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.497+0000 7fc72e000700 1 --2- 172.21.15.159:0/1675760847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7301039a0 0x7fc730198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:08.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.498+0000 7fc72ea00700 1 -- 172.21.15.159:0/1675760847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7301039a0 msgr2=0x7fc730198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:08.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.498+0000 7fc72ea00700 1 --2- 172.21.15.159:0/1675760847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7301039a0 0x7fc730198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.498+0000 7fc72ea00700 1 -- 172.21.15.159:0/1675760847 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc71c0095f0 con 0x7fc730102ff0 2024-02-28T23:13:08.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.498+0000 7fc72ea00700 1 --2- 172.21.15.159:0/1675760847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730102ff0 0x7fc7301989a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc72000e920 tx=0x7fc72000ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:08.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.498+0000 7fc727400700 1 -- 172.21.15.159:0/1675760847 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc72000c9d0 con 0x7fc730102ff0 2024-02-28T23:13:08.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.499+0000 7fc727400700 1 -- 172.21.15.159:0/1675760847 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc720010430 con 0x7fc730102ff0 2024-02-28T23:13:08.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.499+0000 7fc727400700 1 -- 172.21.15.159:0/1675760847 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc720018630 con 0x7fc730102ff0 2024-02-28T23:13:08.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.499+0000 7fc735600700 1 -- 172.21.15.159:0/1675760847 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc73019d660 con 0x7fc730102ff0 2024-02-28T23:13:08.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.499+0000 7fc735600700 1 -- 172.21.15.159:0/1675760847 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc73019db80 con 0x7fc730102ff0 2024-02-28T23:13:08.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.500+0000 7fc735600700 1 -- 172.21.15.159:0/1675760847 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc73010b3f0 con 0x7fc730102ff0 2024-02-28T23:13:08.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.501+0000 7fc727400700 1 -- 172.21.15.159:0/1675760847 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fc7200105a0 con 0x7fc730102ff0 2024-02-28T23:13:08.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.502+0000 7fc727400700 1 --2- 172.21.15.159:0/1675760847 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc71406d9d0 0x7fc71406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:08.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.502+0000 7fc727400700 1 -- 172.21.15.159:0/1675760847 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fc720014070 con 0x7fc730102ff0 2024-02-28T23:13:08.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.502+0000 7fc72e000700 1 --2- 172.21.15.159:0/1675760847 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc71406d9d0 0x7fc71406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:08.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.503+0000 7fc72e000700 1 --2- 172.21.15.159:0/1675760847 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc71406d9d0 0x7fc71406fe90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009fd0 tx=0x7fc71c005a90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:08.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.507+0000 7fc727400700 1 -- 172.21.15.159:0/1675760847 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc720052d20 con 0x7fc730102ff0 2024-02-28T23:13:08.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.876+0000 7fc735600700 1 -- 172.21.15.159:0/1675760847 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc730199e10 con 0x7fc730102ff0 2024-02-28T23:13:08.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.877+0000 7fc727400700 1 -- 172.21.15.159:0/1675760847 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+779 (secure 0 0 0) 0x7fc72005aae0 con 0x7fc730102ff0 2024-02-28T23:13:08.876 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:13:08.876 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:13:08.876 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-02-28T23:13:08.876 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:13:08.876 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:13:08.876 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:13:08.876 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 11, 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:13:08.877 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:13:08.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.880+0000 7fc735600700 1 -- 172.21.15.159:0/1675760847 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc71406d9d0 msgr2=0x7fc71406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:08.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.880+0000 7fc735600700 1 --2- 172.21.15.159:0/1675760847 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc71406d9d0 0x7fc71406fe90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc71c009fd0 tx=0x7fc71c005a90 comp rx=0 tx=0).stop 2024-02-28T23:13:08.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.880+0000 7fc735600700 1 -- 172.21.15.159:0/1675760847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730102ff0 msgr2=0x7fc7301989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:08.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.880+0000 7fc735600700 1 --2- 172.21.15.159:0/1675760847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730102ff0 0x7fc7301989a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc72000e920 tx=0x7fc72000ec30 comp rx=0 tx=0).stop 2024-02-28T23:13:08.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.880+0000 7fc735600700 1 -- 172.21.15.159:0/1675760847 shutdown_connections 2024-02-28T23:13:08.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.880+0000 7fc735600700 1 --2- 172.21.15.159:0/1675760847 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc71406d9d0 0x7fc71406fe90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.880+0000 7fc735600700 1 --2- 172.21.15.159:0/1675760847 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc730102ff0 0x7fc7301989a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.880+0000 7fc735600700 1 --2- 172.21.15.159:0/1675760847 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc7301039a0 0x7fc730198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:08.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.880+0000 7fc735600700 1 -- 172.21.15.159:0/1675760847 >> 172.21.15.159:0/1675760847 conn(0x7fc7300fe880 msgr2=0x7fc730100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:08.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.881+0000 7fc735600700 1 -- 172.21.15.159:0/1675760847 shutdown_connections 2024-02-28T23:13:08.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:08.881+0000 7fc735600700 1 -- 172.21.15.159:0/1675760847 wait complete. 2024-02-28T23:13:09.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.040+0000 7f0fb2400700 1 -- 172.21.15.159:0/2638864952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fac106980 msgr2=0x7f0fac106d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:09.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.040+0000 7f0fb2400700 1 --2- 172.21.15.159:0/2638864952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fac106980 0x7f0fac106d60 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009910 tx=0x7f0fa0009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:09.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.041+0000 7f0fb2400700 1 -- 172.21.15.159:0/2638864952 shutdown_connections 2024-02-28T23:13:09.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.041+0000 7f0fb2400700 1 --2- 172.21.15.159:0/2638864952 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac100980 0x7f0fac100e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.041+0000 7f0fb2400700 1 --2- 172.21.15.159:0/2638864952 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fac106980 0x7f0fac106d60 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.041+0000 7f0fb2400700 1 -- 172.21.15.159:0/2638864952 >> 172.21.15.159:0/2638864952 conn(0x7f0fac0fc470 msgr2=0x7f0fac0fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:09.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.041+0000 7f0fb2400700 1 -- 172.21.15.159:0/2638864952 shutdown_connections 2024-02-28T23:13:09.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.041+0000 7f0fb2400700 1 -- 172.21.15.159:0/2638864952 wait complete. 2024-02-28T23:13:09.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.042+0000 7f0fb2400700 1 Processor -- start 2024-02-28T23:13:09.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.042+0000 7f0fb2400700 1 -- start start 2024-02-28T23:13:09.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.042+0000 7f0fb2400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac100980 0x7f0fac19e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:09.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.043+0000 7f0fb2400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fac106980 0x7f0fac19ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:09.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.043+0000 7f0fb2400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac19f0f0 con 0x7f0fac106980 2024-02-28T23:13:09.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.043+0000 7f0fb2400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fac1985a0 con 0x7f0fac100980 2024-02-28T23:13:09.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.043+0000 7f0fabe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fac106980 0x7f0fac19ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:09.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.043+0000 7f0fabe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fac106980 0x7f0fac19ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44258/0 (socket says 172.21.15.159:44258) 2024-02-28T23:13:09.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.043+0000 7f0fabe00700 1 -- 172.21.15.159:0/2090537437 learned_addr learned my addr 172.21.15.159:0/2090537437 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:09.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.043+0000 7f0fb1000700 1 --2- 172.21.15.159:0/2090537437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac100980 0x7f0fac19e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:09.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.043+0000 7f0fabe00700 1 -- 172.21.15.159:0/2090537437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac100980 msgr2=0x7f0fac19e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:09.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.043+0000 7f0fabe00700 1 --2- 172.21.15.159:0/2090537437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac100980 0x7f0fac19e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.043+0000 7f0fabe00700 1 -- 172.21.15.159:0/2090537437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa00095f0 con 0x7f0fac106980 2024-02-28T23:13:09.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.044+0000 7f0fabe00700 1 --2- 172.21.15.159:0/2090537437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fac106980 0x7f0fac19ea60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800e920 tx=0x7f0f9800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:09.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.044+0000 7f0fa9600700 1 -- 172.21.15.159:0/2090537437 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f9800c9d0 con 0x7f0fac106980 2024-02-28T23:13:09.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.044+0000 7f0fa9600700 1 -- 172.21.15.159:0/2090537437 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0f98010430 con 0x7f0fac106980 2024-02-28T23:13:09.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.044+0000 7f0fb2400700 1 -- 172.21.15.159:0/2090537437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fac198880 con 0x7f0fac106980 2024-02-28T23:13:09.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.044+0000 7f0fa9600700 1 -- 172.21.15.159:0/2090537437 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f98018630 con 0x7f0fac106980 2024-02-28T23:13:09.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.044+0000 7f0fb2400700 1 -- 172.21.15.159:0/2090537437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fac198dd0 con 0x7f0fac106980 2024-02-28T23:13:09.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.046+0000 7f0fb2400700 1 -- 172.21.15.159:0/2090537437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fac04f2e0 con 0x7f0fac106980 2024-02-28T23:13:09.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.046+0000 7f0fa9600700 1 -- 172.21.15.159:0/2090537437 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f0f9800cb30 con 0x7f0fac106980 2024-02-28T23:13:09.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.048+0000 7f0fa9600700 1 --2- 172.21.15.159:0/2090537437 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9406d9d0 0x7f0f9406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:09.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.048+0000 7f0fa9600700 1 -- 172.21.15.159:0/2090537437 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0f98014070 con 0x7f0fac106980 2024-02-28T23:13:09.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.048+0000 7f0fb1000700 1 --2- 172.21.15.159:0/2090537437 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9406d9d0 0x7f0f9406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:09.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.049+0000 7f0fb1000700 1 --2- 172.21.15.159:0/2090537437 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9406d9d0 0x7f0f9406fe90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009fd0 tx=0x7f0fa0005a90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:09.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.052+0000 7f0fa9600700 1 -- 172.21.15.159:0/2090537437 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0f98052d20 con 0x7f0fac106980 2024-02-28T23:13:09.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:09 smithi159 ceph-mon[113833]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:09.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:09 smithi159 ceph-mon[113833]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:09.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:09 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:13:09.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:09 smithi159 ceph-mon[113833]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:09.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:09 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:09.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:09 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:09.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:09 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:09 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:13:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:09 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1675760847' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:13:09.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.340+0000 7f0fb2400700 1 -- 172.21.15.159:0/2090537437 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0fac199220 con 0x7f0fac106980 2024-02-28T23:13:09.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.341+0000 7f0fa9600700 1 -- 172.21.15.159:0/2090537437 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f0f9805ab20 con 0x7f0fac106980 2024-02-28T23:13:09.340 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:13:09.340 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:13:09.340 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:13:09.340 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:13:09.340 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:13:09.340 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:13:09.340 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:13:09.340 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:13:09.340 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:13:09.340 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:13:09.340 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:13:09.341 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:13:09.342 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:09.343 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:09.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.344+0000 7f0fb2400700 1 -- 172.21.15.159:0/2090537437 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9406d9d0 msgr2=0x7f0f9406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:09.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.344+0000 7f0fb2400700 1 --2- 172.21.15.159:0/2090537437 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9406d9d0 0x7f0f9406fe90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0009fd0 tx=0x7f0fa0005a90 comp rx=0 tx=0).stop 2024-02-28T23:13:09.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.344+0000 7f0fb2400700 1 -- 172.21.15.159:0/2090537437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fac106980 msgr2=0x7f0fac19ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:09.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.344+0000 7f0fb2400700 1 --2- 172.21.15.159:0/2090537437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fac106980 0x7f0fac19ea60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800e920 tx=0x7f0f9800ec30 comp rx=0 tx=0).stop 2024-02-28T23:13:09.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.344+0000 7f0fb2400700 1 -- 172.21.15.159:0/2090537437 shutdown_connections 2024-02-28T23:13:09.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.344+0000 7f0fb2400700 1 --2- 172.21.15.159:0/2090537437 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fac100980 0x7f0fac19e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.344+0000 7f0fb2400700 1 --2- 172.21.15.159:0/2090537437 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9406d9d0 0x7f0f9406fe90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.344+0000 7f0fb2400700 1 --2- 172.21.15.159:0/2090537437 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fac106980 0x7f0fac19ea60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.344+0000 7f0fb2400700 1 -- 172.21.15.159:0/2090537437 >> 172.21.15.159:0/2090537437 conn(0x7f0fac0fc470 msgr2=0x7f0fac073020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:09.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.344+0000 7f0fb2400700 1 -- 172.21.15.159:0/2090537437 shutdown_connections 2024-02-28T23:13:09.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.344+0000 7f0fb2400700 1 -- 172.21.15.159:0/2090537437 wait complete. 2024-02-28T23:13:09.344 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:13:09.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:09 smithi184 ceph-mon[36198]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:09.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:09 smithi184 ceph-mon[36198]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:09.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:09 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:13:09.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:09 smithi184 ceph-mon[36198]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:09.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:09 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:09.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:09 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:09.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:09 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:09.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:09 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:13:09.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:09 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/1675760847' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:13:09.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.503+0000 7ff010200700 1 -- 172.21.15.159:0/1758307678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff008101750 msgr2=0x7ff0081057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:09.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.503+0000 7ff010200700 1 --2- 172.21.15.159:0/1758307678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff008101750 0x7ff0081057a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7feff4009910 tx=0x7feff4009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:09.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.504+0000 7ff010200700 1 -- 172.21.15.159:0/1758307678 shutdown_connections 2024-02-28T23:13:09.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.504+0000 7ff010200700 1 --2- 172.21.15.159:0/1758307678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff008101750 0x7ff0081057a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.504+0000 7ff010200700 1 --2- 172.21.15.159:0/1758307678 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff008100da0 0x7ff008101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.504+0000 7ff010200700 1 -- 172.21.15.159:0/1758307678 >> 172.21.15.159:0/1758307678 conn(0x7ff0080fc630 msgr2=0x7ff0080fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:09.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.504+0000 7ff010200700 1 -- 172.21.15.159:0/1758307678 shutdown_connections 2024-02-28T23:13:09.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.504+0000 7ff010200700 1 -- 172.21.15.159:0/1758307678 wait complete. 2024-02-28T23:13:09.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.505+0000 7ff010200700 1 Processor -- start 2024-02-28T23:13:09.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.505+0000 7ff010200700 1 -- start start 2024-02-28T23:13:09.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.505+0000 7ff010200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff008100da0 0x7ff00819e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:09.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.505+0000 7ff010200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff008101750 0x7ff00819ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:09.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.505+0000 7ff010200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00819f350 con 0x7ff008100da0 2024-02-28T23:13:09.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.505+0000 7ff010200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff008198800 con 0x7ff008101750 2024-02-28T23:13:09.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.506+0000 7ff00d800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff008100da0 0x7ff00819e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:09.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.506+0000 7ff00d800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff008100da0 0x7ff00819e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44276/0 (socket says 172.21.15.159:44276) 2024-02-28T23:13:09.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.506+0000 7ff00d800700 1 -- 172.21.15.159:0/4240670806 learned_addr learned my addr 172.21.15.159:0/4240670806 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:09.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.506+0000 7ff00ce00700 1 --2- 172.21.15.159:0/4240670806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff008101750 0x7ff00819ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:09.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.506+0000 7ff00d800700 1 -- 172.21.15.159:0/4240670806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff008101750 msgr2=0x7ff00819ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:09.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.506+0000 7ff00d800700 1 --2- 172.21.15.159:0/4240670806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff008101750 0x7ff00819ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.507+0000 7ff00d800700 1 -- 172.21.15.159:0/4240670806 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff40095f0 con 0x7ff008100da0 2024-02-28T23:13:09.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.507+0000 7ff00d800700 1 --2- 172.21.15.159:0/4240670806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff008100da0 0x7ff00819e780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feffc00d8d0 tx=0x7feffc00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:09.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.507+0000 7ff006000700 1 -- 172.21.15.159:0/4240670806 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feffc0098a0 con 0x7ff008100da0 2024-02-28T23:13:09.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.507+0000 7ff006000700 1 -- 172.21.15.159:0/4240670806 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feffc010460 con 0x7ff008100da0 2024-02-28T23:13:09.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.507+0000 7ff010200700 1 -- 172.21.15.159:0/4240670806 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff008198ae0 con 0x7ff008100da0 2024-02-28T23:13:09.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.507+0000 7ff006000700 1 -- 172.21.15.159:0/4240670806 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feffc00f5f0 con 0x7ff008100da0 2024-02-28T23:13:09.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.507+0000 7ff010200700 1 -- 172.21.15.159:0/4240670806 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff008199030 con 0x7ff008100da0 2024-02-28T23:13:09.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.509+0000 7ff010200700 1 -- 172.21.15.159:0/4240670806 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff008104f20 con 0x7ff008100da0 2024-02-28T23:13:09.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.510+0000 7ff006000700 1 -- 172.21.15.159:0/4240670806 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7feffc009a00 con 0x7ff008100da0 2024-02-28T23:13:09.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.511+0000 7ff006000700 1 --2- 172.21.15.159:0/4240670806 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feff006d9d0 0x7feff006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:09.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.511+0000 7ff006000700 1 -- 172.21.15.159:0/4240670806 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7feffc08d4e0 con 0x7ff008100da0 2024-02-28T23:13:09.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.511+0000 7ff00ce00700 1 --2- 172.21.15.159:0/4240670806 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feff006d9d0 0x7feff006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:09.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.512+0000 7ff00ce00700 1 --2- 172.21.15.159:0/4240670806 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feff006d9d0 0x7feff006fe90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0080fcd70 tx=0x7feff401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:09.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.516+0000 7ff006000700 1 -- 172.21.15.159:0/4240670806 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feffc05a6d0 con 0x7ff008100da0 2024-02-28T23:13:09.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.767+0000 7ff010200700 1 -- 172.21.15.159:0/4240670806 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0081992a0 con 0x7feff006d9d0 2024-02-28T23:13:09.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.768+0000 7ff006000700 1 -- 172.21.15.159:0/4240670806 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+337 (secure 0 0 0) 0x7ff0081992a0 con 0x7feff006d9d0 2024-02-28T23:13:09.767 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:13:09.767 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:13:09.767 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:13:09.767 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:13:09.767 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:13:09.767 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:13:09.767 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:13:09.767 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "3/23 daemons upgraded", 2024-02-28T23:13:09.767 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "", 2024-02-28T23:13:09.767 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:13:09.767 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:13:09.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.770+0000 7ff010200700 1 -- 172.21.15.159:0/4240670806 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feff006d9d0 msgr2=0x7feff006fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:09.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.771+0000 7ff010200700 1 --2- 172.21.15.159:0/4240670806 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feff006d9d0 0x7feff006fe90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff0080fcd70 tx=0x7feff401a040 comp rx=0 tx=0).stop 2024-02-28T23:13:09.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.771+0000 7ff010200700 1 -- 172.21.15.159:0/4240670806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff008100da0 msgr2=0x7ff00819e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:09.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.771+0000 7ff010200700 1 --2- 172.21.15.159:0/4240670806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff008100da0 0x7ff00819e780 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feffc00d8d0 tx=0x7feffc00dbe0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.771+0000 7ff010200700 1 -- 172.21.15.159:0/4240670806 shutdown_connections 2024-02-28T23:13:09.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.771+0000 7ff010200700 1 --2- 172.21.15.159:0/4240670806 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feff006d9d0 0x7feff006fe90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.771+0000 7ff010200700 1 --2- 172.21.15.159:0/4240670806 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff008100da0 0x7ff00819e780 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.771+0000 7ff010200700 1 --2- 172.21.15.159:0/4240670806 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff008101750 0x7ff00819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.771+0000 7ff010200700 1 -- 172.21.15.159:0/4240670806 >> 172.21.15.159:0/4240670806 conn(0x7ff0080fc630 msgr2=0x7ff0080fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:09.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.771+0000 7ff010200700 1 -- 172.21.15.159:0/4240670806 shutdown_connections 2024-02-28T23:13:09.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.771+0000 7ff010200700 1 -- 172.21.15.159:0/4240670806 wait complete. 2024-02-28T23:13:09.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.916+0000 7fad9bc00700 1 -- 172.21.15.159:0/1714567009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad94069020 msgr2=0x7fad94105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:09.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.916+0000 7fad9bc00700 1 --2- 172.21.15.159:0/1714567009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad94069020 0x7fad94105790 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fad80009910 tx=0x7fad80009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:09.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.916+0000 7fad9bc00700 1 -- 172.21.15.159:0/1714567009 shutdown_connections 2024-02-28T23:13:09.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.916+0000 7fad9bc00700 1 --2- 172.21.15.159:0/1714567009 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad94069020 0x7fad94105790 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.916+0000 7fad9bc00700 1 --2- 172.21.15.159:0/1714567009 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad94068670 0x7fad94068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.916+0000 7fad9bc00700 1 -- 172.21.15.159:0/1714567009 >> 172.21.15.159:0/1714567009 conn(0x7fad940755a0 msgr2=0x7fad940759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:09.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.916+0000 7fad9bc00700 1 -- 172.21.15.159:0/1714567009 shutdown_connections 2024-02-28T23:13:09.916 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.917+0000 7fad9bc00700 1 -- 172.21.15.159:0/1714567009 wait complete. 2024-02-28T23:13:09.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.917+0000 7fad9bc00700 1 Processor -- start 2024-02-28T23:13:09.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.918+0000 7fad9bc00700 1 -- start start 2024-02-28T23:13:09.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.918+0000 7fad9bc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad94068670 0x7fad94198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:09.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.918+0000 7fad9bc00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad94069020 0x7fad94198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:09.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.918+0000 7fad9bc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94199530 con 0x7fad94068670 2024-02-28T23:13:09.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.918+0000 7fad9bc00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9419d340 con 0x7fad94069020 2024-02-28T23:13:09.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.918+0000 7fad99200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad94068670 0x7fad94198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:09.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.918+0000 7fad99200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad94068670 0x7fad94198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44294/0 (socket says 172.21.15.159:44294) 2024-02-28T23:13:09.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.918+0000 7fad99200700 1 -- 172.21.15.159:0/2133747203 learned_addr learned my addr 172.21.15.159:0/2133747203 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:09.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.919+0000 7fad99200700 1 -- 172.21.15.159:0/2133747203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad94069020 msgr2=0x7fad94198ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:09.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.919+0000 7fad99200700 1 --2- 172.21.15.159:0/2133747203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad94069020 0x7fad94198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:09.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.919+0000 7fad99200700 1 -- 172.21.15.159:0/2133747203 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad800095f0 con 0x7fad94068670 2024-02-28T23:13:09.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.919+0000 7fad99200700 1 --2- 172.21.15.159:0/2133747203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad94068670 0x7fad94198960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c8f0 tx=0x7fad8800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:09.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.919+0000 7fad91600700 1 -- 172.21.15.159:0/2133747203 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad88007a70 con 0x7fad94068670 2024-02-28T23:13:09.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.919+0000 7fad91600700 1 -- 172.21.15.159:0/2133747203 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad88004cf0 con 0x7fad94068670 2024-02-28T23:13:09.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.919+0000 7fad91600700 1 -- 172.21.15.159:0/2133747203 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad88005610 con 0x7fad94068670 2024-02-28T23:13:09.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.919+0000 7fad9bc00700 1 -- 172.21.15.159:0/2133747203 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9419d620 con 0x7fad94068670 2024-02-28T23:13:09.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.920+0000 7fad9bc00700 1 -- 172.21.15.159:0/2133747203 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9419db70 con 0x7fad94068670 2024-02-28T23:13:09.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.921+0000 7fad9bc00700 1 -- 172.21.15.159:0/2133747203 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad94105620 con 0x7fad94068670 2024-02-28T23:13:09.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.923+0000 7fad91600700 1 -- 172.21.15.159:0/2133747203 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fad88004750 con 0x7fad94068670 2024-02-28T23:13:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.924+0000 7fad91600700 1 --2- 172.21.15.159:0/2133747203 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad7c06d9e0 0x7fad7c06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.924+0000 7fad91600700 1 -- 172.21.15.159:0/2133747203 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fad88013070 con 0x7fad94068670 2024-02-28T23:13:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.924+0000 7fad93e00700 1 --2- 172.21.15.159:0/2133747203 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad7c06d9e0 0x7fad7c06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.925+0000 7fad93e00700 1 --2- 172.21.15.159:0/2133747203 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad7c06d9e0 0x7fad7c06fea0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fad80006010 tx=0x7fad80005960 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:09.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:09.927+0000 7fad91600700 1 -- 172.21.15.159:0/2133747203 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fad8805ad70 con 0x7fad94068670 2024-02-28T23:13:10.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.232+0000 7fad9bc00700 1 -- 172.21.15.159:0/2133747203 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fad9404ea90 con 0x7fad94068670 2024-02-28T23:13:10.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.233+0000 7fad91600700 1 -- 172.21.15.159:0/2133747203 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fad8805a900 con 0x7fad94068670 2024-02-28T23:13:10.232 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_OK 2024-02-28T23:13:10.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.235+0000 7fad9bc00700 1 -- 172.21.15.159:0/2133747203 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad7c06d9e0 msgr2=0x7fad7c06fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:10.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.235+0000 7fad9bc00700 1 --2- 172.21.15.159:0/2133747203 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad7c06d9e0 0x7fad7c06fea0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fad80006010 tx=0x7fad80005960 comp rx=0 tx=0).stop 2024-02-28T23:13:10.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.235+0000 7fad9bc00700 1 -- 172.21.15.159:0/2133747203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad94068670 msgr2=0x7fad94198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:10.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.235+0000 7fad9bc00700 1 --2- 172.21.15.159:0/2133747203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad94068670 0x7fad94198960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fad8800c8f0 tx=0x7fad8800ccb0 comp rx=0 tx=0).stop 2024-02-28T23:13:10.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.236+0000 7fad9bc00700 1 -- 172.21.15.159:0/2133747203 shutdown_connections 2024-02-28T23:13:10.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.236+0000 7fad9bc00700 1 --2- 172.21.15.159:0/2133747203 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad7c06d9e0 0x7fad7c06fea0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:10.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.236+0000 7fad9bc00700 1 --2- 172.21.15.159:0/2133747203 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fad94068670 0x7fad94198960 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:10.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.236+0000 7fad9bc00700 1 --2- 172.21.15.159:0/2133747203 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fad94069020 0x7fad94198ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:10.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.236+0000 7fad9bc00700 1 -- 172.21.15.159:0/2133747203 >> 172.21.15.159:0/2133747203 conn(0x7fad940755a0 msgr2=0x7fad94102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:10.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.236+0000 7fad9bc00700 1 -- 172.21.15.159:0/2133747203 shutdown_connections 2024-02-28T23:13:10.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:10.236+0000 7fad9bc00700 1 -- 172.21.15.159:0/2133747203 wait complete. 2024-02-28T23:13:10.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:10 smithi184 ceph-mon[36198]: Detected new or changed devices on smithi159 2024-02-28T23:13:10.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:10 smithi184 ceph-mon[36198]: Updating smithi159:/etc/ceph/ceph.conf 2024-02-28T23:13:10.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:10 smithi184 ceph-mon[36198]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-28T23:13:10.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:10 smithi184 ceph-mon[36198]: pgmap v11: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-28T23:13:10.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:10 smithi184 ceph-mon[36198]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:13:10.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:10 smithi184 ceph-mon[36198]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:13:10.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:10 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2090537437' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:13:10.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:10 smithi159 ceph-mon[113833]: Detected new or changed devices on smithi159 2024-02-28T23:13:10.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:10 smithi159 ceph-mon[113833]: Updating smithi159:/etc/ceph/ceph.conf 2024-02-28T23:13:10.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:10 smithi159 ceph-mon[113833]: Updating smithi184:/etc/ceph/ceph.conf 2024-02-28T23:13:10.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:10 smithi159 ceph-mon[113833]: pgmap v11: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 11 op/s 2024-02-28T23:13:10.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:10 smithi159 ceph-mon[113833]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:13:10.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:10 smithi159 ceph-mon[113833]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.conf 2024-02-28T23:13:10.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:10 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2090537437' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:13:11.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:11 smithi184 ceph-mon[36198]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:13:11.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:11 smithi184 ceph-mon[36198]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:11.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:11 smithi184 ceph-mon[36198]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:13:11.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:11 smithi184 ceph-mon[36198]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:13:11.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:11 smithi184 ceph-mon[36198]: from='client.? 172.21.15.159:0/2133747203' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:13:11.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:11 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:11.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:11 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:11.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:11 smithi159 ceph-mon[113833]: Updating smithi159:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:13:11.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:11 smithi159 ceph-mon[113833]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:11.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:11 smithi159 ceph-mon[113833]: Updating smithi184:/etc/ceph/ceph.client.admin.keyring 2024-02-28T23:13:11.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:11 smithi159 ceph-mon[113833]: Updating smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:13:11.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:11 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2133747203' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:13:11.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:11 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:11.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:11 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:12.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:12 smithi184 ceph-mon[36198]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:13:12.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:12 smithi184 ceph-mon[36198]: pgmap v12: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-28T23:13:12.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:12 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:12.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:12 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:12.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:12 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:12.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:12 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:13:12.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:12 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:13:12.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:12 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T23:13:12.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:12 smithi159 ceph-mon[113833]: Updating smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/config/ceph.client.admin.keyring 2024-02-28T23:13:12.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:12 smithi159 ceph-mon[113833]: pgmap v12: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 18 KiB/s rd, 0 B/s wr, 12 op/s 2024-02-28T23:13:12.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:12 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:12.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:12 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:12.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:12 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:12.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:12 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:13:12.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:12 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:13:12.386 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:12 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-28T23:13:14.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:14 smithi184 ceph-mon[36198]: pgmap v13: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:14.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:14 smithi184 ceph-mon[36198]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:14.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:14 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T23:13:14.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:14 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T23:13:14.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:14 smithi184 ceph-mon[36198]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:14.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:14 smithi159 ceph-mon[113833]: pgmap v13: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:14 smithi159 ceph-mon[113833]: from='mgr.34102 ' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T23:13:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T23:13:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:15.413 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:15 smithi184 ceph-mon[36198]: Upgrade: Updating mon.smithi184 2024-02-28T23:13:15.413 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:15 smithi184 ceph-mon[36198]: Deploying daemon mon.smithi184 on smithi184 2024-02-28T23:13:15.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:15 smithi159 ceph-mon[113833]: Upgrade: Updating mon.smithi184 2024-02-28T23:13:15.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:15 smithi159 ceph-mon[113833]: Deploying daemon mon.smithi184 on smithi184 2024-02-28T23:13:16.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:16 smithi159 ceph-mon[113833]: pgmap v14: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:16.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:16 smithi184 ceph-mon[36198]: pgmap v14: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:17.055 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:16 smithi184 systemd[1]: Stopping Ceph mon.smithi184 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:13:17.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:17 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184[36192]: 2024-02-28T23:13:17.054+0000 7fea80800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi184 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:13:17.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:17 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184[36192]: 2024-02-28T23:13:17.054+0000 7fea80800700 -1 mon.smithi184@1(peon) e2 *** Got Signal Terminated *** 2024-02-28T23:13:17.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:17 smithi184 podman[86325]: 2024-02-28 23:13:17.230380674 +0000 UTC m=+0.312651808 container died 472cd67d6c85c9faaf42ac59f632334e341b8d0fa7e4ec8e87f03a896badf40c (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=-18.2.1, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2) 2024-02-28T23:13:17.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:17 smithi184 podman[86325]: 2024-02-28 23:13:17.664651371 +0000 UTC m=+0.746922505 container cleanup 472cd67d6c85c9faaf42ac59f632334e341b8d0fa7e4ec8e87f03a896badf40c (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, RELEASE=HEAD) 2024-02-28T23:13:17.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:17 smithi184 bash[86325]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184 2024-02-28T23:13:18.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:17 smithi184 podman[86339]: 2024-02-28 23:13:17.965926193 +0000 UTC m=+0.717794175 container remove 472cd67d6c85c9faaf42ac59f632334e341b8d0fa7e4ec8e87f03a896badf40c (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=HEAD, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:13:18.658 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:18 smithi184 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi184.service: Deactivated successfully. 2024-02-28T23:13:18.658 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:18 smithi184 systemd[1]: Stopped Ceph mon.smithi184 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:13:18.658 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:18 smithi184 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi184.service: Consumed 20.267s CPU time. 2024-02-28T23:13:19.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:18 smithi184 systemd[1]: Starting Ceph mon.smithi184 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:13:19.420 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 podman[86463]: 2024-02-28 23:13:19.0283532 +0000 UTC m=+0.034796525 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:13:19.420 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 podman[86463]: 2024-02-28 23:13:19.142107487 +0000 UTC m=+0.148550867 container create e57190b5e43e8f82af1b51a08af0fba994c530b2e15de615ae5a549fd0e4564d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=main-1fb5d10) 2024-02-28T23:13:19.420 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 podman[86463]: 2024-02-28 23:13:19.421017694 +0000 UTC m=+0.427461061 container init e57190b5e43e8f82af1b51a08af0fba994c530b2e15de615ae5a549fd0e4564d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T23:13:19.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 podman[86463]: 2024-02-28 23:13:19.432615806 +0000 UTC m=+0.439059149 container start e57190b5e43e8f82af1b51a08af0fba994c530b2e15de615ae5a549fd0e4564d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_CLEAN=True, ceph=True) 2024-02-28T23:13:19.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: set uid:gid to 167:167 (ceph:ceph) 2024-02-28T23:13:19.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev), process ceph-mon, pid 2 2024-02-28T23:13:19.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: pidfile_write: ignore empty --pid-file 2024-02-28T23:13:19.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: load: jerasure load: lrc 2024-02-28T23:13:19.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: RocksDB version: 7.9.2 2024-02-28T23:13:19.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Git sha 0 2024-02-28T23:13:19.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Compile date 2024-02-23 16:20:17 2024-02-28T23:13:19.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: DB SUMMARY 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: DB Session ID: OQ7H828FOI3D251LNU87 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: CURRENT file: CURRENT 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: IDENTITY file: IDENTITY 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: MANIFEST file: MANIFEST-000010 size: 2127 Bytes 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi184/store.db dir, Total Num: 1, files: 000036.sst 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi184/store.db: 000034.log size: 1866 ; 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.error_if_exists: 0 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.create_if_missing: 0 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.paranoid_checks: 1 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.flush_verify_memtable_count: 1 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.env: 0x560b3d7bdb20 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.fs: PosixFileSystem 2024-02-28T23:13:19.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.info_log: 0x560b3fdb17c0 2024-02-28T23:13:19.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_file_opening_threads: 16 2024-02-28T23:13:19.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.statistics: (nil) 2024-02-28T23:13:19.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.use_fsync: 0 2024-02-28T23:13:19.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_log_file_size: 0 2024-02-28T23:13:19.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-28T23:13:19.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.log_file_time_to_roll: 0 2024-02-28T23:13:19.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.keep_log_file_num: 1000 2024-02-28T23:13:19.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.recycle_log_file_num: 0 2024-02-28T23:13:19.854 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.allow_fallocate: 1 2024-02-28T23:13:19.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.allow_mmap_reads: 0 2024-02-28T23:13:19.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.allow_mmap_writes: 0 2024-02-28T23:13:19.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.use_direct_reads: 0 2024-02-28T23:13:19.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-28T23:13:19.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.create_missing_column_families: 0 2024-02-28T23:13:19.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.db_log_dir: 2024-02-28T23:13:19.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.wal_dir: 2024-02-28T23:13:19.855 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.table_cache_numshardbits: 6 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.WAL_ttl_seconds: 0 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.WAL_size_limit_MB: 0 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.is_fd_close_on_exec: 1 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.advise_random_on_open: 1 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.db_write_buffer_size: 0 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.write_buffer_manager: 0x560b3fd85400 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.use_adaptive_mutex: 0 2024-02-28T23:13:19.856 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.rate_limiter: (nil) 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.wal_recovery_mode: 2 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.enable_thread_tracking: 0 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.enable_pipelined_write: 0 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.unordered_write: 0 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.row_cache: None 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.wal_filter: None 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-28T23:13:19.857 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.allow_ingest_behind: 0 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.two_write_queues: 0 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.manual_wal_flush: 0 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.wal_compression: 0 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.atomic_flush: 0 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.persist_stats_to_disk: 0 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.write_dbid_to_manifest: 0 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.log_readahead_size: 0 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.best_efforts_recovery: 0 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.allow_data_in_errors: 0 2024-02-28T23:13:19.858 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.db_host_id: __hostname__ 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.enforce_single_del_contracts: true 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_background_jobs: 2 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_background_compactions: -1 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_subcompactions: 1 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.delayed_write_rate : 16777216 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_total_wal_size: 0 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.stats_dump_period_sec: 600 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.stats_persist_period_sec: 600 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-28T23:13:19.859 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_open_files: -1 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bytes_per_sync: 0 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.wal_bytes_per_sync: 0 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.strict_bytes_per_sync: 0 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_readahead_size: 0 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_background_flushes: -1 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Compression algorithms supported: 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: kZSTD supported: 0 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: kXpressCompression supported: 0 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: kLZ4HCCompression supported: 1 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: kZlibCompression supported: 1 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: kSnappyCompression supported: 1 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: kLZ4Compression supported: 1 2024-02-28T23:13:19.860 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: kBZip2Compression supported: 0 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Fast CRC32 supported: Supported on x86 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: DMutex implementation: pthread_mutex_t 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi184/store.db/MANIFEST-000010 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.merge_operator: 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_filter: None 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_filter_factory: None 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.sst_partitioner_factory: None 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.memtable_factory: SkipListFactory 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.table_factory: BlockBasedTable 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560b3fdb18e0) 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: cache_index_and_filter_blocks: 1 2024-02-28T23:13:19.861 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: pin_top_level_index_and_filter: 1 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: index_type: 0 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: data_block_index_type: 0 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: index_shortening: 1 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: data_block_hash_table_util_ratio: 0.750000 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: checksum: 4 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: no_block_cache: 0 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache: 0x560b3fdb5090 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache_name: BinnedLRUCache 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache_options: 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: capacity : 536870912 2024-02-28T23:13:19.862 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: num_shard_bits : 4 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: strict_capacity_limit : 0 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: high_pri_pool_ratio: 0.000 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_cache_compressed: (nil) 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: persistent_cache: (nil) 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_size: 4096 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_size_deviation: 10 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_restart_interval: 16 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: index_block_restart_interval: 1 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: metadata_block_size: 4096 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: partition_filters: 0 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: use_delta_encoding: 1 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: filter_policy: bloomfilter 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: whole_key_filtering: 1 2024-02-28T23:13:19.863 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: verify_compression: 0 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: read_amp_bytes_per_bit: 0 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: format_version: 5 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: enable_index_compression: 1 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: block_align: 0 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: max_auto_readahead_size: 262144 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: prepopulate_block_cache: 0 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: initial_auto_readahead_size: 8192 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: num_file_reads_for_auto_readahead: 2 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.write_buffer_size: 33554432 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_write_buffer_number: 2 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compression: NoCompression 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bottommost_compression: Disabled 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.prefix_extractor: nullptr 2024-02-28T23:13:19.864 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-28T23:13:19.865 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.num_levels: 7 2024-02-28T23:13:19.865 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compression_opts.window_bits: -14 2024-02-28T23:13:19.866 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compression_opts.level: 32767 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compression_opts.strategy: 0 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compression_opts.enabled: false 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.target_file_size_base: 67108864 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.target_file_size_multiplier: 1 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-28T23:13:19.867 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.arena_block_size: 1048576 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-28T23:13:19.868 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.disable_auto_compactions: 0 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.table_properties_collectors: 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.inplace_update_support: 0 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.inplace_update_num_locks: 10000 2024-02-28T23:13:19.869 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.memtable_huge_page_size: 0 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.bloom_locality: 0 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.max_successive_merges: 0 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.optimize_filters_for_hits: 0 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.paranoid_file_checks: 0 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.force_consistency_checks: 1 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.report_bg_io_stats: 0 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.ttl: 2592000 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.periodic_compaction_seconds: 0 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.enable_blob_files: false 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.min_blob_size: 0 2024-02-28T23:13:19.870 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.blob_file_size: 268435456 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.blob_compression_type: NoCompression 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.enable_blob_garbage_collection: false 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.blob_file_starting_level: 0 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi184/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 38, last_sequence is 19628, log_number is 34,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 34 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 34 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8f662077-7fdf-4a8d-9382-29e3595c46a2 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709161999489037, "job": 1, "event": "recovery_started", "wal_files": [34]} 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #34 mode 2 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709161999490184, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 39, "file_size": 2350, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 19630, "largest_seqno": 19636, "table_properties": {"data_size": 1248, "index_size": 33, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 165, "raw_average_key_size": 23, "raw_value_size": 1082, "raw_average_value_size": 154, "num_data_blocks": 1, "num_entries": 7, "num_filter_entries": 7, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1709161999, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8f662077-7fdf-4a8d-9382-29e3595c46a2", "db_session_id": "OQ7H828FOI3D251LNU87", "orig_file_number": 39, "seqno_to_time_mapping": "N/A"}} 2024-02-28T23:13:19.871 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: EVENT_LOG_v1 {"time_micros": 1709161999490325, "job": 1, "event": "recovery_finished"} 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/version_set.cc:5047] Creating manifest 41 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi184/store.db/000034.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560b3fea4000 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: DB pointer 0x560b3fe90000 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** DB Stats ** 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-28T23:13:19.872 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** Compaction Stats [default] ** 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: L0 1/0 2.29 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: L6 1/0 7.50 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Sum 2/0 7.50 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** Compaction Stats [default] ** 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2024-02-28T23:13:19.873 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: AddFile(Keys): cumulative 0, interval 0 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Cumulative compaction: 0.00 GB write, 0.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Interval compaction: 0.00 GB write, 0.40 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Block cache BinnedLRUCache@0x560b3fdb5090#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.12 KB,2.38419e-05%) Misc(1,0.00 KB,0%) 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2024-02-28T23:13:19.874 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: ** File Read Latency Histogram By Level [default] ** 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: starting mon.smithi184 rank 1 at public addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] at bind addrs [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi184 fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: mon.smithi184@-1(???) e2 preinit fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: mon.smithi184@-1(???).mds e18 new map 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: mon.smithi184@-1(???).mds e18 print_map 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: e18 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: legacy client fscid: 1 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Filesystem 'cephfs' (1) 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: fs_name cephfs 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: epoch 18 2024-02-28T23:13:19.875 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: tableserver 0 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: root 0 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: session_timeout 60 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: session_autoclose 300 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: max_file_size 1099511627776 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: max_xattr_size 65536 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: required_client_features {} 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: last_failure 0 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: last_failure_osd_epoch 46 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: max_mds 1 2024-02-28T23:13:19.876 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: in 0 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: up {0=14472} 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: failed 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: damaged 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: stopped 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: data_pools [3] 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: metadata_pool 2 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: inline_data disabled 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: balancer 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: bal_rank_mask -1 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: standby_count_wanted 1 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: [mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: [mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2024-02-28T23:13:19.877 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2024-02-28T23:13:19.878 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: Standby daemons: 2024-02-28T23:13:19.878 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: 2024-02-28T23:13:19.878 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: [mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:19.878 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout: [mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:19.878 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: mon.smithi184@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-28T23:13:19.878 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: mon.smithi184@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T23:13:19.878 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: mon.smithi184@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T23:13:19.878 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: mon.smithi184@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-02-28T23:13:19.878 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 ceph-mon[86482]: mon.smithi184@-1(???).paxosservice(auth 1..25) refresh upgraded, format 0 -> 3 2024-02-28T23:13:19.878 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 bash[86463]: e57190b5e43e8f82af1b51a08af0fba994c530b2e15de615ae5a549fd0e4564d 2024-02-28T23:13:19.878 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:19 smithi184 systemd[1]: Started Ceph mon.smithi184 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:13:21.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:13:21.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: mon.smithi184 calling monitor election 2024-02-28T23:13:21.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: mon.smithi159 calling monitor election 2024-02-28T23:13:21.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:13:21.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: mon.smithi159 is new leader, mons smithi159,smithi184 in quorum (ranks 0,1) 2024-02-28T23:13:21.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: monmap e3: 2 mons at {smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0],smithi184=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T23:13:21.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:13:21.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T23:13:21.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: mgrmap e38: smithi159.pobewk(active, since 27s), standbys: smithi184.quvmnx 2024-02-28T23:13:21.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: overall HEALTH_OK 2024-02-28T23:13:21.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:21.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:21.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:21 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:13:21.509 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi159"}]: dispatch 2024-02-28T23:13:21.509 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: mon.smithi184 calling monitor election 2024-02-28T23:13:21.509 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: mon.smithi159 calling monitor election 2024-02-28T23:13:21.509 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mon metadata", "id": "smithi184"}]: dispatch 2024-02-28T23:13:21.509 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: mon.smithi159 is new leader, mons smithi159,smithi184 in quorum (ranks 0,1) 2024-02-28T23:13:21.509 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: monmap e3: 2 mons at {smithi159=[v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0],smithi184=[v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-02-28T23:13:21.509 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:13:21.509 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: osdmap e49: 6 total, 6 up, 6 in 2024-02-28T23:13:21.509 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: mgrmap e38: smithi159.pobewk(active, since 27s), standbys: smithi184.quvmnx 2024-02-28T23:13:21.510 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: overall HEALTH_OK 2024-02-28T23:13:21.510 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:21.510 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:21.510 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:21 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:13:22.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:22 smithi159 ceph-mon[113833]: pgmap v17: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:22.514 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:22 smithi184 ceph-mon[86482]: pgmap v17: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:23.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:13:23.578 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:13:24.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:24 smithi159 ceph-mon[113833]: pgmap v18: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:13:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:24 smithi184 ceph-mon[86482]: pgmap v18: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:13:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:25 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:25 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:25 smithi184 ceph-mon[86482]: pgmap v19: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:25.928 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:25 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:25.928 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:25 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:25.928 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:25 smithi159 ceph-mon[113833]: pgmap v19: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:27.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:27 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:27.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:27 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:27.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:27 smithi184 ceph-mon[86482]: pgmap v20: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:13:27.856 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:27 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:27.857 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:27 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:27.857 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:27 smithi159 ceph-mon[113833]: pgmap v20: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:13:30.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:30 smithi159 ceph-mon[113833]: pgmap v21: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:30.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:30 smithi184 ceph-mon[86482]: pgmap v21: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:32 smithi159 ceph-mon[113833]: pgmap v22: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:32 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:32 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:32 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:32 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:13:32.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:32 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:32.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:32 smithi184 ceph-mon[86482]: pgmap v22: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:32.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:32 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:32.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:32 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:32.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:32 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:32.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:32 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:13:32.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:32 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:33.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:33 smithi159 ceph-mon[113833]: Reconfiguring mon.smithi159 (monmap changed)... 2024-02-28T23:13:33.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:33 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T23:13:33.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:33 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T23:13:33.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:33 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:33.341 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:33 smithi159 ceph-mon[113833]: Reconfiguring daemon mon.smithi159 on smithi159 2024-02-28T23:13:33.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:33 smithi184 ceph-mon[86482]: Reconfiguring mon.smithi159 (monmap changed)... 2024-02-28T23:13:33.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:33 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T23:13:33.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:33 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T23:13:33.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:33 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:33.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:33 smithi184 ceph-mon[86482]: Reconfiguring daemon mon.smithi159 on smithi159 2024-02-28T23:13:34.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:34 smithi184 ceph-mon[86482]: pgmap v23: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:34.436 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:34 smithi159 ceph-mon[113833]: pgmap v23: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:35 smithi159 ceph-mon[113833]: Reconfiguring mgr.smithi159.pobewk (monmap changed)... 2024-02-28T23:13:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.pobewk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T23:13:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T23:13:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:35 smithi159 ceph-mon[113833]: Reconfiguring daemon mgr.smithi159.pobewk on smithi159 2024-02-28T23:13:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:35 smithi159 ceph-mon[113833]: pgmap v24: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:36.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:36.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:36.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:35 smithi184 ceph-mon[86482]: Reconfiguring mgr.smithi159.pobewk (monmap changed)... 2024-02-28T23:13:36.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi159.pobewk", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T23:13:36.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T23:13:36.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:36.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:35 smithi184 ceph-mon[86482]: Reconfiguring daemon mgr.smithi159.pobewk on smithi159 2024-02-28T23:13:36.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:35 smithi184 ceph-mon[86482]: pgmap v24: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:38.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:37 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:38.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:37 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:38.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:37 smithi159 ceph-mon[113833]: Reconfiguring ceph-exporter.smithi159 (monmap changed)... 2024-02-28T23:13:38.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:37 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:13:38.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:37 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:13:38.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:37 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T23:13:38.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:37 smithi159 ceph-mon[113833]: Unable to update caps for client.ceph-exporter.smithi159 2024-02-28T23:13:38.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:37 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi159"}]: dispatch 2024-02-28T23:13:38.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:37 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:38.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:37 smithi159 ceph-mon[113833]: Reconfiguring daemon ceph-exporter.smithi159 on smithi159 2024-02-28T23:13:38.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:37 smithi159 ceph-mon[113833]: pgmap v25: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:37 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:37 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:37 smithi184 ceph-mon[86482]: Reconfiguring ceph-exporter.smithi159 (monmap changed)... 2024-02-28T23:13:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:37 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:13:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:37 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:13:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:37 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T23:13:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:37 smithi184 ceph-mon[86482]: Unable to update caps for client.ceph-exporter.smithi159 2024-02-28T23:13:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:37 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi159"}]: dispatch 2024-02-28T23:13:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:37 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:37 smithi184 ceph-mon[86482]: Reconfiguring daemon ceph-exporter.smithi159 on smithi159 2024-02-28T23:13:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:37 smithi184 ceph-mon[86482]: pgmap v25: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:39.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:39 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:13:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:39 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:13:40.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:40 smithi159 ceph-mon[113833]: pgmap v26: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:40.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:40 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:40.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:40 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:40.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:40 smithi159 ceph-mon[113833]: Reconfiguring crash.smithi159 (monmap changed)... 2024-02-28T23:13:40.320 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:40 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T23:13:40.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:40 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:40.321 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:40 smithi159 ceph-mon[113833]: Reconfiguring daemon crash.smithi159 on smithi159 2024-02-28T23:13:40.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.401+0000 7f6a9d000700 1 -- 172.21.15.159:0/304516704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a98100da0 msgr2=0x7f6a98101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:40.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.401+0000 7f6a9d000700 1 --2- 172.21.15.159:0/304516704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a98100da0 0x7f6a98101180 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6a88009910 tx=0x7f6a88009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:40.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.401+0000 7f6a9d000700 1 -- 172.21.15.159:0/304516704 shutdown_connections 2024-02-28T23:13:40.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.401+0000 7f6a9d000700 1 --2- 172.21.15.159:0/304516704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a98101750 0x7f6a981057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:40.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.401+0000 7f6a9d000700 1 --2- 172.21.15.159:0/304516704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a98100da0 0x7f6a98101180 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:40.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.401+0000 7f6a9d000700 1 -- 172.21.15.159:0/304516704 >> 172.21.15.159:0/304516704 conn(0x7f6a980fc630 msgr2=0x7f6a980fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:40.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.402+0000 7f6a9d000700 1 -- 172.21.15.159:0/304516704 shutdown_connections 2024-02-28T23:13:40.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.402+0000 7f6a9d000700 1 -- 172.21.15.159:0/304516704 wait complete. 2024-02-28T23:13:40.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.403+0000 7f6a9d000700 1 Processor -- start 2024-02-28T23:13:40.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.403+0000 7f6a9d000700 1 -- start start 2024-02-28T23:13:40.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.403+0000 7f6a9d000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a98100da0 0x7f6a9819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:40.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.403+0000 7f6a9d000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a98101750 0x7f6a9819cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:40.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.403+0000 7f6a9d000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9819d210 con 0x7f6a98100da0 2024-02-28T23:13:40.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.403+0000 7f6a9d000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a981966c0 con 0x7f6a98101750 2024-02-28T23:13:40.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.403+0000 7f6a95e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a98100da0 0x7f6a9819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:40.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.403+0000 7f6a95e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a98100da0 0x7f6a9819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60232/0 (socket says 172.21.15.159:60232) 2024-02-28T23:13:40.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.403+0000 7f6a95e00700 1 -- 172.21.15.159:0/1039562997 learned_addr learned my addr 172.21.15.159:0/1039562997 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:40.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.404+0000 7f6a95e00700 1 -- 172.21.15.159:0/1039562997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a98101750 msgr2=0x7f6a9819cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:40.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.404+0000 7f6a95400700 1 --2- 172.21.15.159:0/1039562997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a98101750 0x7f6a9819cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:40.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.404+0000 7f6a95e00700 1 --2- 172.21.15.159:0/1039562997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a98101750 0x7f6a9819cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:40.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.404+0000 7f6a95e00700 1 -- 172.21.15.159:0/1039562997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a880095f0 con 0x7f6a98100da0 2024-02-28T23:13:40.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.404+0000 7f6a95e00700 1 --2- 172.21.15.159:0/1039562997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a98100da0 0x7f6a9819c640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800b5c0 tx=0x7f6a8800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:40.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.404+0000 7f6a8ea00700 1 -- 172.21.15.159:0/1039562997 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a8801d070 con 0x7f6a98100da0 2024-02-28T23:13:40.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.404+0000 7f6a8ea00700 1 -- 172.21.15.159:0/1039562997 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6a8800f460 con 0x7f6a98100da0 2024-02-28T23:13:40.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.404+0000 7f6a8ea00700 1 -- 172.21.15.159:0/1039562997 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a88017610 con 0x7f6a98100da0 2024-02-28T23:13:40.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.404+0000 7f6a9d000700 1 -- 172.21.15.159:0/1039562997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a98196940 con 0x7f6a98100da0 2024-02-28T23:13:40.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.405+0000 7f6a9d000700 1 -- 172.21.15.159:0/1039562997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a98196e30 con 0x7f6a98100da0 2024-02-28T23:13:40.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.406+0000 7f6a9d000700 1 -- 172.21.15.159:0/1039562997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a98109140 con 0x7f6a98100da0 2024-02-28T23:13:40.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.407+0000 7f6a8ea00700 1 -- 172.21.15.159:0/1039562997 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f6a8800f5d0 con 0x7f6a98100da0 2024-02-28T23:13:40.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.408+0000 7f6a8ea00700 1 --2- 172.21.15.159:0/1039562997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6a7c06d9d0 0x7f6a7c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:40.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.408+0000 7f6a8ea00700 1 -- 172.21.15.159:0/1039562997 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f6a8808ec90 con 0x7f6a98100da0 2024-02-28T23:13:40.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.408+0000 7f6a95400700 1 --2- 172.21.15.159:0/1039562997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6a7c06d9d0 0x7f6a7c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:40.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.409+0000 7f6a95400700 1 --2- 172.21.15.159:0/1039562997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6a7c06d9d0 0x7f6a7c06fe90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6a84006fd0 tx=0x7f6a84008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:40.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.413+0000 7f6a8ea00700 1 -- 172.21.15.159:0/1039562997 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6a8805be80 con 0x7f6a98100da0 2024-02-28T23:13:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:40 smithi184 ceph-mon[86482]: pgmap v26: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:40 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:40.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:40 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:40.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:40 smithi184 ceph-mon[86482]: Reconfiguring crash.smithi159 (monmap changed)... 2024-02-28T23:13:40.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:40 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T23:13:40.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:40 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:40.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:40 smithi184 ceph-mon[86482]: Reconfiguring daemon crash.smithi159 on smithi159 2024-02-28T23:13:40.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.652+0000 7f6a9d000700 1 -- 172.21.15.159:0/1039562997 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a981970a0 con 0x7f6a7c06d9d0 2024-02-28T23:13:40.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.656+0000 7f6a8ea00700 1 -- 172.21.15.159:0/1039562997 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f6a981970a0 con 0x7f6a7c06d9d0 2024-02-28T23:13:40.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.659+0000 7f6a9d000700 1 -- 172.21.15.159:0/1039562997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6a7c06d9d0 msgr2=0x7f6a7c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:40.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.659+0000 7f6a9d000700 1 --2- 172.21.15.159:0/1039562997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6a7c06d9d0 0x7f6a7c06fe90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6a84006fd0 tx=0x7f6a84008040 comp rx=0 tx=0).stop 2024-02-28T23:13:40.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.659+0000 7f6a9d000700 1 -- 172.21.15.159:0/1039562997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a98100da0 msgr2=0x7f6a9819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:40.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.659+0000 7f6a9d000700 1 --2- 172.21.15.159:0/1039562997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a98100da0 0x7f6a9819c640 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6a8800b5c0 tx=0x7f6a8800be00 comp rx=0 tx=0).stop 2024-02-28T23:13:40.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.660+0000 7f6a9d000700 1 -- 172.21.15.159:0/1039562997 shutdown_connections 2024-02-28T23:13:40.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.660+0000 7f6a9d000700 1 --2- 172.21.15.159:0/1039562997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6a7c06d9d0 0x7f6a7c06fe90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:40.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.660+0000 7f6a9d000700 1 --2- 172.21.15.159:0/1039562997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6a98100da0 0x7f6a9819c640 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:40.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.660+0000 7f6a9d000700 1 --2- 172.21.15.159:0/1039562997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6a98101750 0x7f6a9819cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:40.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.660+0000 7f6a9d000700 1 -- 172.21.15.159:0/1039562997 >> 172.21.15.159:0/1039562997 conn(0x7f6a980fc630 msgr2=0x7f6a980fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:40.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.660+0000 7f6a9d000700 1 -- 172.21.15.159:0/1039562997 shutdown_connections 2024-02-28T23:13:40.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.660+0000 7f6a9d000700 1 -- 172.21.15.159:0/1039562997 wait complete. 2024-02-28T23:13:40.675 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:13:40.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.820+0000 7fb94ac00700 1 -- 172.21.15.159:0/1353658184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb944102fd0 msgr2=0x7fb9441033b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:40.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.820+0000 7fb94ac00700 1 --2- 172.21.15.159:0/1353658184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb944102fd0 0x7fb9441033b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb934009910 tx=0x7fb934009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:40.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.821+0000 7fb94ac00700 1 -- 172.21.15.159:0/1353658184 shutdown_connections 2024-02-28T23:13:40.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.821+0000 7fb94ac00700 1 --2- 172.21.15.159:0/1353658184 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb944103980 0x7fb9441079d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:40.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.821+0000 7fb94ac00700 1 --2- 172.21.15.159:0/1353658184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb944102fd0 0x7fb9441033b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:40.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.821+0000 7fb94ac00700 1 -- 172.21.15.159:0/1353658184 >> 172.21.15.159:0/1353658184 conn(0x7fb9440fe840 msgr2=0x7fb944100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:40.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.821+0000 7fb94ac00700 1 -- 172.21.15.159:0/1353658184 shutdown_connections 2024-02-28T23:13:40.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.821+0000 7fb94ac00700 1 -- 172.21.15.159:0/1353658184 wait complete. 2024-02-28T23:13:40.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.822+0000 7fb94ac00700 1 Processor -- start 2024-02-28T23:13:40.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.822+0000 7fb94ac00700 1 -- start start 2024-02-28T23:13:40.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.823+0000 7fb94ac00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb944102fd0 0x7fb94419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:40.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.823+0000 7fb94ac00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb944103980 0x7fb94419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:40.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.823+0000 7fb94ac00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94419f3b0 con 0x7fb944103980 2024-02-28T23:13:40.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.823+0000 7fb94ac00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb944198860 con 0x7fb944102fd0 2024-02-28T23:13:40.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.823+0000 7fb943400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb944103980 0x7fb94419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:40.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.823+0000 7fb943400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb944103980 0x7fb94419ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60258/0 (socket says 172.21.15.159:60258) 2024-02-28T23:13:40.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.823+0000 7fb943400700 1 -- 172.21.15.159:0/915295469 learned_addr learned my addr 172.21.15.159:0/915295469 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:40.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.823+0000 7fb943e00700 1 --2- 172.21.15.159:0/915295469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb944102fd0 0x7fb94419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:40.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.823+0000 7fb943400700 1 -- 172.21.15.159:0/915295469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb944102fd0 msgr2=0x7fb94419e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:40.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.824+0000 7fb943400700 1 --2- 172.21.15.159:0/915295469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb944102fd0 0x7fb94419e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:40.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.824+0000 7fb943400700 1 -- 172.21.15.159:0/915295469 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340095f0 con 0x7fb944103980 2024-02-28T23:13:40.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.824+0000 7fb943400700 1 --2- 172.21.15.159:0/915295469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb944103980 0x7fb94419ed20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb93000c8f0 tx=0x7fb93000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:40.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.824+0000 7fb940c00700 1 -- 172.21.15.159:0/915295469 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb930007a50 con 0x7fb944103980 2024-02-28T23:13:40.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.824+0000 7fb940c00700 1 -- 172.21.15.159:0/915295469 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb930007bb0 con 0x7fb944103980 2024-02-28T23:13:40.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.824+0000 7fb94ac00700 1 -- 172.21.15.159:0/915295469 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb944198b40 con 0x7fb944103980 2024-02-28T23:13:40.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.824+0000 7fb940c00700 1 -- 172.21.15.159:0/915295469 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb930018630 con 0x7fb944103980 2024-02-28T23:13:40.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.824+0000 7fb94ac00700 1 -- 172.21.15.159:0/915295469 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb944199090 con 0x7fb944103980 2024-02-28T23:13:40.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.826+0000 7fb94ac00700 1 -- 172.21.15.159:0/915295469 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94410b370 con 0x7fb944103980 2024-02-28T23:13:40.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.827+0000 7fb940c00700 1 -- 172.21.15.159:0/915295469 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fb930007d20 con 0x7fb944103980 2024-02-28T23:13:40.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.828+0000 7fb940c00700 1 --2- 172.21.15.159:0/915295469 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb92806d9e0 0x7fb92806fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:40.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.828+0000 7fb940c00700 1 -- 172.21.15.159:0/915295469 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fb93008d680 con 0x7fb944103980 2024-02-28T23:13:40.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.828+0000 7fb943e00700 1 --2- 172.21.15.159:0/915295469 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb92806d9e0 0x7fb92806fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:40.828 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.829+0000 7fb943e00700 1 --2- 172.21.15.159:0/915295469 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb92806d9e0 0x7fb92806fea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb93400b5c0 tx=0x7fb93401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:40.832 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:40.833+0000 7fb940c00700 1 -- 172.21.15.159:0/915295469 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb93005a7d0 con 0x7fb944103980 2024-02-28T23:13:41.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.073+0000 7fb94ac00700 1 -- 172.21.15.159:0/915295469 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb944199360 con 0x7fb92806d9e0 2024-02-28T23:13:41.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.075+0000 7fb940c00700 1 -- 172.21.15.159:0/915295469 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb944199360 con 0x7fb92806d9e0 2024-02-28T23:13:41.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.078+0000 7fb94ac00700 1 -- 172.21.15.159:0/915295469 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb92806d9e0 msgr2=0x7fb92806fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:41.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.078+0000 7fb94ac00700 1 --2- 172.21.15.159:0/915295469 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb92806d9e0 0x7fb92806fea0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fb93400b5c0 tx=0x7fb93401a040 comp rx=0 tx=0).stop 2024-02-28T23:13:41.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.078+0000 7fb94ac00700 1 -- 172.21.15.159:0/915295469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb944103980 msgr2=0x7fb94419ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:41.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.078+0000 7fb94ac00700 1 --2- 172.21.15.159:0/915295469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb944103980 0x7fb94419ed20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb93000c8f0 tx=0x7fb93000ccb0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.079+0000 7fb94ac00700 1 -- 172.21.15.159:0/915295469 shutdown_connections 2024-02-28T23:13:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.079+0000 7fb94ac00700 1 --2- 172.21.15.159:0/915295469 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb944102fd0 0x7fb94419e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.079+0000 7fb94ac00700 1 --2- 172.21.15.159:0/915295469 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb92806d9e0 0x7fb92806fea0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.079+0000 7fb94ac00700 1 --2- 172.21.15.159:0/915295469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb944103980 0x7fb94419ed20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.079+0000 7fb94ac00700 1 -- 172.21.15.159:0/915295469 >> 172.21.15.159:0/915295469 conn(0x7fb9440fe840 msgr2=0x7fb9440ffe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.079+0000 7fb94ac00700 1 -- 172.21.15.159:0/915295469 shutdown_connections 2024-02-28T23:13:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.079+0000 7fb94ac00700 1 -- 172.21.15.159:0/915295469 wait complete. 2024-02-28T23:13:41.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.239+0000 7f2ab8800700 1 -- 172.21.15.159:0/2167145221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab0101750 msgr2=0x7f2ab01057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:41.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.239+0000 7f2ab8800700 1 --2- 172.21.15.159:0/2167145221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab0101750 0x7f2ab01057a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0009910 tx=0x7f2aa0009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:41.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.239+0000 7f2ab8800700 1 -- 172.21.15.159:0/2167145221 shutdown_connections 2024-02-28T23:13:41.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.239+0000 7f2ab8800700 1 --2- 172.21.15.159:0/2167145221 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab0101750 0x7f2ab01057a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.239+0000 7f2ab8800700 1 --2- 172.21.15.159:0/2167145221 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab0100da0 0x7f2ab0101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.239+0000 7f2ab8800700 1 -- 172.21.15.159:0/2167145221 >> 172.21.15.159:0/2167145221 conn(0x7f2ab00fc630 msgr2=0x7f2ab00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:41.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.239+0000 7f2ab8800700 1 -- 172.21.15.159:0/2167145221 shutdown_connections 2024-02-28T23:13:41.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.239+0000 7f2ab8800700 1 -- 172.21.15.159:0/2167145221 wait complete. 2024-02-28T23:13:41.241 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.241+0000 7f2ab8800700 1 Processor -- start 2024-02-28T23:13:41.241 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.242+0000 7f2ab8800700 1 -- start start 2024-02-28T23:13:41.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.243+0000 7f2ab8800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab0100da0 0x7f2ab0196730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:41.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.243+0000 7f2ab8800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab0101750 0x7f2ab0196c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:41.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.243+0000 7f2ab8800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab0197270 con 0x7f2ab0100da0 2024-02-28T23:13:41.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.243+0000 7f2ab8800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ab01973e0 con 0x7f2ab0101750 2024-02-28T23:13:41.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.243+0000 7f2ab5e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab0100da0 0x7f2ab0196730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:41.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.243+0000 7f2ab5e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab0100da0 0x7f2ab0196730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60284/0 (socket says 172.21.15.159:60284) 2024-02-28T23:13:41.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.243+0000 7f2ab5e00700 1 -- 172.21.15.159:0/957607723 learned_addr learned my addr 172.21.15.159:0/957607723 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:41.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.243+0000 7f2ab5400700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab0101750 0x7f2ab0196c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:41.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.244+0000 7f2ab5e00700 1 -- 172.21.15.159:0/957607723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab0101750 msgr2=0x7f2ab0196c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:41.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.244+0000 7f2ab5e00700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab0101750 0x7f2ab0196c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.244+0000 7f2ab5e00700 1 -- 172.21.15.159:0/957607723 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa00095f0 con 0x7f2ab0100da0 2024-02-28T23:13:41.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.244+0000 7f2ab5400700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab0101750 0x7f2ab0196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:13:41.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.244+0000 7f2ab5e00700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab0100da0 0x7f2ab0196730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c930 tx=0x7f2aa400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:41.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.244+0000 7f2aaaa00700 1 -- 172.21.15.159:0/957607723 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa4007ad0 con 0x7f2ab0100da0 2024-02-28T23:13:41.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.244+0000 7f2aaaa00700 1 -- 172.21.15.159:0/957607723 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2aa4007c30 con 0x7f2ab0100da0 2024-02-28T23:13:41.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.244+0000 7f2ab8800700 1 -- 172.21.15.159:0/957607723 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ab019a110 con 0x7f2ab0100da0 2024-02-28T23:13:41.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.244+0000 7f2aaaa00700 1 -- 172.21.15.159:0/957607723 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2aa4018610 con 0x7f2ab0100da0 2024-02-28T23:13:41.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.244+0000 7f2ab8800700 1 -- 172.21.15.159:0/957607723 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ab019a660 con 0x7f2ab0100da0 2024-02-28T23:13:41.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.246+0000 7f2ab8800700 1 -- 172.21.15.159:0/957607723 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ab01091a0 con 0x7f2ab0100da0 2024-02-28T23:13:41.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.247+0000 7f2aaaa00700 1 -- 172.21.15.159:0/957607723 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f2aa400f450 con 0x7f2ab0100da0 2024-02-28T23:13:41.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.248+0000 7f2aaaa00700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2a9806d9d0 0x7f2a9806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:41.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.249+0000 7f2aaaa00700 1 -- 172.21.15.159:0/957607723 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f2aa408d860 con 0x7f2ab0100da0 2024-02-28T23:13:41.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.249+0000 7f2ab5400700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2a9806d9d0 0x7f2a9806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:41.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.250+0000 7f2ab5400700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2a9806d9d0 0x7f2a9806fe90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0006010 tx=0x7f2aa000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:41.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.254+0000 7f2aaaa00700 1 -- 172.21.15.159:0/957607723 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2aa4056f20 con 0x7f2ab0100da0 2024-02-28T23:13:41.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.488+0000 7f2ab8800700 1 -- 172.21.15.159:0/957607723 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ab002cde0 con 0x7f2a9806d9d0 2024-02-28T23:13:41.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.500+0000 7f2aaaa00700 1 -- 172.21.15.159:0/957607723 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f2ab002cde0 con 0x7f2a9806d9d0 2024-02-28T23:13:41.500 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:13:41.500 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (3m) 40s ago 17m 14.5M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:13:41.500 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (17m) 40s ago 17m 8384k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:13:41.500 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (16m) 16s ago 16m 8019k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:13:41.500 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (17m) 40s ago 17m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:13:41.500 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (16m) 16s ago 16m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:13:41.500 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (2m) 40s ago 17m 75.1M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:13:41.500 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (10m) 40s ago 10m 148M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:13:41.500 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (10m) 40s ago 10m 86.7M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (10m) 16s ago 10m 17.1M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (10m) 16s ago 10m 17.0M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (6m) 40s ago 19m 476M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (4m) 16s ago 16m 448M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (58s) 40s ago 19m 28.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (22s) 16s ago 15m 16.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (4m) 40s ago 17m 7578k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (4m) 16s ago 16m 7805k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (14m) 40s ago 14m 235M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (14m) 40s ago 14m 250M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (13m) 40s ago 13m 212M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (13m) 16s ago 13m 300M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:13:41.501 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (12m) 16s ago 12m 251M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:13:41.502 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (12m) 16s ago 12m 230M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:13:41.502 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (3m) 40s ago 16m 52.6M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:13:41.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.503+0000 7f2ab8800700 1 -- 172.21.15.159:0/957607723 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2a9806d9d0 msgr2=0x7f2a9806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:41.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.503+0000 7f2ab8800700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2a9806d9d0 0x7f2a9806fe90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2aa0006010 tx=0x7f2aa000b540 comp rx=0 tx=0).stop 2024-02-28T23:13:41.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.503+0000 7f2ab8800700 1 -- 172.21.15.159:0/957607723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab0100da0 msgr2=0x7f2ab0196730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:41.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.503+0000 7f2ab8800700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab0100da0 0x7f2ab0196730 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f2aa400c930 tx=0x7f2aa400ccf0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.503+0000 7f2ab8800700 1 -- 172.21.15.159:0/957607723 shutdown_connections 2024-02-28T23:13:41.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.503+0000 7f2ab8800700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2a9806d9d0 0x7f2a9806fe90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.503+0000 7f2ab8800700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2ab0100da0 0x7f2ab0196730 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.503+0000 7f2ab8800700 1 --2- 172.21.15.159:0/957607723 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2ab0101750 0x7f2ab0196c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.503+0000 7f2ab8800700 1 -- 172.21.15.159:0/957607723 >> 172.21.15.159:0/957607723 conn(0x7f2ab00fc630 msgr2=0x7f2ab00fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:41.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.503+0000 7f2ab8800700 1 -- 172.21.15.159:0/957607723 shutdown_connections 2024-02-28T23:13:41.503 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.503+0000 7f2ab8800700 1 -- 172.21.15.159:0/957607723 wait complete. 2024-02-28T23:13:41.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.657+0000 7f800be00700 1 -- 172.21.15.159:0/1138705142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004100dc0 msgr2=0x7f80041011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:41.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.657+0000 7f800be00700 1 --2- 172.21.15.159:0/1138705142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004100dc0 0x7f80041011a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009910 tx=0x7f7ff8009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:41.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.657+0000 7f800be00700 1 -- 172.21.15.159:0/1138705142 shutdown_connections 2024-02-28T23:13:41.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.657+0000 7f800be00700 1 --2- 172.21.15.159:0/1138705142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8004101770 0x7f80041057c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.657+0000 7f800be00700 1 --2- 172.21.15.159:0/1138705142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004100dc0 0x7f80041011a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.657+0000 7f800be00700 1 -- 172.21.15.159:0/1138705142 >> 172.21.15.159:0/1138705142 conn(0x7f80040fc650 msgr2=0x7f80040fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:41.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.657+0000 7f800be00700 1 -- 172.21.15.159:0/1138705142 shutdown_connections 2024-02-28T23:13:41.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.657+0000 7f800be00700 1 -- 172.21.15.159:0/1138705142 wait complete. 2024-02-28T23:13:41.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.658+0000 7f800be00700 1 Processor -- start 2024-02-28T23:13:41.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.659+0000 7f800be00700 1 -- start start 2024-02-28T23:13:41.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.659+0000 7f800be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004100dc0 0x7f8004198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:41.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.659+0000 7f800be00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8004101770 0x7f8004198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:41.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.659+0000 7f800be00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8004199490 con 0x7f8004100dc0 2024-02-28T23:13:41.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.659+0000 7f800be00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8004199600 con 0x7f8004101770 2024-02-28T23:13:41.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.659+0000 7f8009400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004100dc0 0x7f8004198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:41.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.659+0000 7f8009400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004100dc0 0x7f8004198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60308/0 (socket says 172.21.15.159:60308) 2024-02-28T23:13:41.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.659+0000 7f8009400700 1 -- 172.21.15.159:0/322117916 learned_addr learned my addr 172.21.15.159:0/322117916 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:41.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.660+0000 7f8009400700 1 -- 172.21.15.159:0/322117916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8004101770 msgr2=0x7f8004198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:41.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.660+0000 7f8009400700 1 --2- 172.21.15.159:0/322117916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8004101770 0x7f8004198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.660+0000 7f8009400700 1 -- 172.21.15.159:0/322117916 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff80095f0 con 0x7f8004100dc0 2024-02-28T23:13:41.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.660+0000 7f8009400700 1 --2- 172.21.15.159:0/322117916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004100dc0 0x7f8004198950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8006010 tx=0x7f7ff800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:41.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.660+0000 7f8002000700 1 -- 172.21.15.159:0/322117916 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff801d070 con 0x7f8004100dc0 2024-02-28T23:13:41.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.660+0000 7f8002000700 1 -- 172.21.15.159:0/322117916 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ff8004fb0 con 0x7f8004100dc0 2024-02-28T23:13:41.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.660+0000 7f8002000700 1 -- 172.21.15.159:0/322117916 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff800f690 con 0x7f8004100dc0 2024-02-28T23:13:41.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.660+0000 7f800be00700 1 -- 172.21.15.159:0/322117916 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800419d420 con 0x7f8004100dc0 2024-02-28T23:13:41.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.661+0000 7f800be00700 1 -- 172.21.15.159:0/322117916 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800419d8c0 con 0x7f8004100dc0 2024-02-28T23:13:41.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.662+0000 7f800be00700 1 -- 172.21.15.159:0/322117916 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8004104f40 con 0x7f8004100dc0 2024-02-28T23:13:41.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.663+0000 7f8002000700 1 -- 172.21.15.159:0/322117916 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f7ff80228a0 con 0x7f8004100dc0 2024-02-28T23:13:41.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.664+0000 7f8002000700 1 --2- 172.21.15.159:0/322117916 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fec06d9d0 0x7f7fec06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:41.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.664+0000 7f8002000700 1 -- 172.21.15.159:0/322117916 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f7ff808eff0 con 0x7f8004100dc0 2024-02-28T23:13:41.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.664+0000 7f8008a00700 1 --2- 172.21.15.159:0/322117916 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fec06d9d0 0x7f7fec06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:41.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.665+0000 7f8008a00700 1 --2- 172.21.15.159:0/322117916 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fec06d9d0 0x7f7fec06fe90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0005fd0 tx=0x7f7ff0005d00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:41.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.668+0000 7f8002000700 1 -- 172.21.15.159:0/322117916 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7ff805c120 con 0x7f8004100dc0 2024-02-28T23:13:41.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.962+0000 7f800be00700 1 -- 172.21.15.159:0/322117916 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f800404ea90 con 0x7f8004100dc0 2024-02-28T23:13:41.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.963+0000 7f8002000700 1 -- 172.21.15.159:0/322117916 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f7ff805bcb0 con 0x7f8004100dc0 2024-02-28T23:13:41.962 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:13:41.962 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:13:41.962 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 10, 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:13:41.963 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:13:41.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.966+0000 7f800be00700 1 -- 172.21.15.159:0/322117916 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fec06d9d0 msgr2=0x7f7fec06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:41.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.966+0000 7f800be00700 1 --2- 172.21.15.159:0/322117916 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fec06d9d0 0x7f7fec06fe90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7ff0005fd0 tx=0x7f7ff0005d00 comp rx=0 tx=0).stop 2024-02-28T23:13:41.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.966+0000 7f800be00700 1 -- 172.21.15.159:0/322117916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004100dc0 msgr2=0x7f8004198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:41.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.966+0000 7f800be00700 1 --2- 172.21.15.159:0/322117916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004100dc0 0x7f8004198950 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8006010 tx=0x7f7ff800be20 comp rx=0 tx=0).stop 2024-02-28T23:13:41.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.966+0000 7f800be00700 1 -- 172.21.15.159:0/322117916 shutdown_connections 2024-02-28T23:13:41.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.966+0000 7f800be00700 1 --2- 172.21.15.159:0/322117916 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fec06d9d0 0x7f7fec06fe90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.966+0000 7f800be00700 1 --2- 172.21.15.159:0/322117916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004100dc0 0x7f8004198950 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.966+0000 7f800be00700 1 --2- 172.21.15.159:0/322117916 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f8004101770 0x7f8004198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:41.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.966+0000 7f800be00700 1 -- 172.21.15.159:0/322117916 >> 172.21.15.159:0/322117916 conn(0x7f80040fc650 msgr2=0x7f80040fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:41.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.966+0000 7f800be00700 1 -- 172.21.15.159:0/322117916 shutdown_connections 2024-02-28T23:13:41.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:41.966+0000 7f800be00700 1 -- 172.21.15.159:0/322117916 wait complete. 2024-02-28T23:13:42.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.113+0000 7fd0d1200700 1 -- 172.21.15.159:0/431771602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc105b50 msgr2=0x7fd0cc105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:42.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.113+0000 7fd0d1200700 1 --2- 172.21.15.159:0/431771602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc105b50 0x7fd0cc105f30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009910 tx=0x7fd0bc009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:42.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.114+0000 7fd0d1200700 1 -- 172.21.15.159:0/431771602 shutdown_connections 2024-02-28T23:13:42.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.114+0000 7fd0d1200700 1 --2- 172.21.15.159:0/431771602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0cc0fef70 0x7fd0cc0ff3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.114+0000 7fd0d1200700 1 --2- 172.21.15.159:0/431771602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc105b50 0x7fd0cc105f30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.114+0000 7fd0d1200700 1 -- 172.21.15.159:0/431771602 >> 172.21.15.159:0/431771602 conn(0x7fd0cc075e30 msgr2=0x7fd0cc0fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:42.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.114+0000 7fd0d1200700 1 -- 172.21.15.159:0/431771602 shutdown_connections 2024-02-28T23:13:42.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.114+0000 7fd0d1200700 1 -- 172.21.15.159:0/431771602 wait complete. 2024-02-28T23:13:42.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.115+0000 7fd0d1200700 1 Processor -- start 2024-02-28T23:13:42.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.115+0000 7fd0d1200700 1 -- start start 2024-02-28T23:13:42.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.115+0000 7fd0d1200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0cc0fef70 0x7fd0cc19c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:42.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.115+0000 7fd0d1200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc105b50 0x7fd0cc19cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:42.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.115+0000 7fd0d1200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc19d0b0 con 0x7fd0cc105b50 2024-02-28T23:13:42.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.115+0000 7fd0d1200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc1965f0 con 0x7fd0cc0fef70 2024-02-28T23:13:42.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.116+0000 7fd0c3e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc105b50 0x7fd0cc19cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:42.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.116+0000 7fd0c3e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc105b50 0x7fd0cc19cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60330/0 (socket says 172.21.15.159:60330) 2024-02-28T23:13:42.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.116+0000 7fd0c3e00700 1 -- 172.21.15.159:0/1395390259 learned_addr learned my addr 172.21.15.159:0/1395390259 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:42.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.116+0000 7fd0c3e00700 1 -- 172.21.15.159:0/1395390259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0cc0fef70 msgr2=0x7fd0cc19c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:42.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.116+0000 7fd0c3e00700 1 --2- 172.21.15.159:0/1395390259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0cc0fef70 0x7fd0cc19c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.116+0000 7fd0c3e00700 1 -- 172.21.15.159:0/1395390259 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0bc0095f0 con 0x7fd0cc105b50 2024-02-28T23:13:42.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.116+0000 7fd0c3e00700 1 --2- 172.21.15.159:0/1395390259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc105b50 0x7fd0cc19cab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400c930 tx=0x7fd0b400ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:42.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.117+0000 7fd0c2a00700 1 -- 172.21.15.159:0/1395390259 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b4007ad0 con 0x7fd0cc105b50 2024-02-28T23:13:42.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.117+0000 7fd0c2a00700 1 -- 172.21.15.159:0/1395390259 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd0b4007c30 con 0x7fd0cc105b50 2024-02-28T23:13:42.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.117+0000 7fd0d1200700 1 -- 172.21.15.159:0/1395390259 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0cc1968d0 con 0x7fd0cc105b50 2024-02-28T23:13:42.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.117+0000 7fd0c2a00700 1 -- 172.21.15.159:0/1395390259 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0b4018610 con 0x7fd0cc105b50 2024-02-28T23:13:42.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.117+0000 7fd0d1200700 1 -- 172.21.15.159:0/1395390259 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc196e20 con 0x7fd0cc105b50 2024-02-28T23:13:42.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.118+0000 7fd0d1200700 1 -- 172.21.15.159:0/1395390259 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0cc109140 con 0x7fd0cc105b50 2024-02-28T23:13:42.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.119+0000 7fd0c2a00700 1 -- 172.21.15.159:0/1395390259 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fd0b400f450 con 0x7fd0cc105b50 2024-02-28T23:13:42.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.120+0000 7fd0c2a00700 1 --2- 172.21.15.159:0/1395390259 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd0b006d9d0 0x7fd0b006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:42.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.120+0000 7fd0c2a00700 1 -- 172.21.15.159:0/1395390259 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd0b408d900 con 0x7fd0cc105b50 2024-02-28T23:13:42.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.120+0000 7fd0c9e00700 1 --2- 172.21.15.159:0/1395390259 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd0b006d9d0 0x7fd0b006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:42.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.121+0000 7fd0c9e00700 1 --2- 172.21.15.159:0/1395390259 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd0b006d9d0 0x7fd0b006fe90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc006010 tx=0x7fd0bc00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:42.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.124+0000 7fd0c2a00700 1 -- 172.21.15.159:0/1395390259 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd0b405aa50 con 0x7fd0cc105b50 2024-02-28T23:13:42.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.405+0000 7fd0d1200700 1 -- 172.21.15.159:0/1395390259 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd0cc04ea90 con 0x7fd0cc105b50 2024-02-28T23:13:42.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.406+0000 7fd0c2a00700 1 -- 172.21.15.159:0/1395390259 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1879 (secure 0 0 0) 0x7fd0b405a5e0 con 0x7fd0cc105b50 2024-02-28T23:13:42.406 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:13:42.406 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:13:42.406 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:13:42.406 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:13:42.406 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:13:42.406 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:13:42.406 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:13:42.407 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:13:42.408 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:42.409 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:13:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:13:42.409 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:13:42.409 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:13:42.409 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:42.409 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:13:42.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.408+0000 7fd0d1200700 1 -- 172.21.15.159:0/1395390259 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd0b006d9d0 msgr2=0x7fd0b006fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:42.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.408+0000 7fd0d1200700 1 --2- 172.21.15.159:0/1395390259 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd0b006d9d0 0x7fd0b006fe90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc006010 tx=0x7fd0bc00b540 comp rx=0 tx=0).stop 2024-02-28T23:13:42.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.408+0000 7fd0d1200700 1 -- 172.21.15.159:0/1395390259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc105b50 msgr2=0x7fd0cc19cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:42.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.408+0000 7fd0d1200700 1 --2- 172.21.15.159:0/1395390259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc105b50 0x7fd0cc19cab0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd0b400c930 tx=0x7fd0b400ccf0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.408+0000 7fd0d1200700 1 -- 172.21.15.159:0/1395390259 shutdown_connections 2024-02-28T23:13:42.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.408+0000 7fd0d1200700 1 --2- 172.21.15.159:0/1395390259 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd0cc0fef70 0x7fd0cc19c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.408+0000 7fd0d1200700 1 --2- 172.21.15.159:0/1395390259 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd0b006d9d0 0x7fd0b006fe90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.408+0000 7fd0d1200700 1 --2- 172.21.15.159:0/1395390259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0cc105b50 0x7fd0cc19cab0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.408+0000 7fd0d1200700 1 -- 172.21.15.159:0/1395390259 >> 172.21.15.159:0/1395390259 conn(0x7fd0cc075e30 msgr2=0x7fd0cc104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:42.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.409+0000 7fd0d1200700 1 -- 172.21.15.159:0/1395390259 shutdown_connections 2024-02-28T23:13:42.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.409+0000 7fd0d1200700 1 -- 172.21.15.159:0/1395390259 wait complete. 2024-02-28T23:13:42.411 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:13:42.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:42 smithi159 ceph-mon[113833]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:42.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:42 smithi159 ceph-mon[113833]: pgmap v27: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:42.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:42 smithi159 ceph-mon[113833]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:42.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:42.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:42.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T23:13:42.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:42.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:42 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/322117916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:13:42.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.562+0000 7f1612c00700 1 -- 172.21.15.159:0/3011743947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c100da0 msgr2=0x7f160c101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:42.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.562+0000 7f1612c00700 1 --2- 172.21.15.159:0/3011743947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c100da0 0x7f160c101180 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f15fc009910 tx=0x7f15fc009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:42.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.562+0000 7f1612c00700 1 -- 172.21.15.159:0/3011743947 shutdown_connections 2024-02-28T23:13:42.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.562+0000 7f1612c00700 1 --2- 172.21.15.159:0/3011743947 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c101750 0x7f160c1057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.562+0000 7f1612c00700 1 --2- 172.21.15.159:0/3011743947 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c100da0 0x7f160c101180 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.562+0000 7f1612c00700 1 -- 172.21.15.159:0/3011743947 >> 172.21.15.159:0/3011743947 conn(0x7f160c0fc630 msgr2=0x7f160c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:42.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.562+0000 7f1612c00700 1 -- 172.21.15.159:0/3011743947 shutdown_connections 2024-02-28T23:13:42.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.562+0000 7f1612c00700 1 -- 172.21.15.159:0/3011743947 wait complete. 2024-02-28T23:13:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.563+0000 7f1612c00700 1 Processor -- start 2024-02-28T23:13:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.563+0000 7f1612c00700 1 -- start start 2024-02-28T23:13:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.563+0000 7f1612c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c100da0 0x7f160c19e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.563+0000 7f1612c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c101750 0x7f160c19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.563+0000 7f1612c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c19f420 con 0x7f160c101750 2024-02-28T23:13:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.563+0000 7f1612c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f160c1988d0 con 0x7f160c100da0 2024-02-28T23:13:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.564+0000 7f160b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c101750 0x7f160c19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.564+0000 7f160b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c101750 0x7f160c19ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60340/0 (socket says 172.21.15.159:60340) 2024-02-28T23:13:42.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.564+0000 7f160b400700 1 -- 172.21.15.159:0/231490682 learned_addr learned my addr 172.21.15.159:0/231490682 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.564+0000 7f160b400700 1 -- 172.21.15.159:0/231490682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c100da0 msgr2=0x7f160c19e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.564+0000 7f160be00700 1 --2- 172.21.15.159:0/231490682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c100da0 0x7f160c19e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.564+0000 7f160b400700 1 --2- 172.21.15.159:0/231490682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c100da0 0x7f160c19e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.564+0000 7f160b400700 1 -- 172.21.15.159:0/231490682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15fc0095f0 con 0x7f160c101750 2024-02-28T23:13:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.564+0000 7f160b400700 1 --2- 172.21.15.159:0/231490682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c101750 0x7f160c19ed90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f15f800b480 tx=0x7f15f800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.565+0000 7f1608c00700 1 -- 172.21.15.159:0/231490682 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15f80118c0 con 0x7f160c101750 2024-02-28T23:13:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.565+0000 7f1608c00700 1 -- 172.21.15.159:0/231490682 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f15f8010380 con 0x7f160c101750 2024-02-28T23:13:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.565+0000 7f1612c00700 1 -- 172.21.15.159:0/231490682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f160c198bb0 con 0x7f160c101750 2024-02-28T23:13:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.565+0000 7f1608c00700 1 -- 172.21.15.159:0/231490682 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15f800f4f0 con 0x7f160c101750 2024-02-28T23:13:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.565+0000 7f1612c00700 1 -- 172.21.15.159:0/231490682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160c199100 con 0x7f160c101750 2024-02-28T23:13:42.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.566+0000 7f1612c00700 1 -- 172.21.15.159:0/231490682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f160c104f20 con 0x7f160c101750 2024-02-28T23:13:42.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.567+0000 7f1608c00700 1 -- 172.21.15.159:0/231490682 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f15f80104f0 con 0x7f160c101750 2024-02-28T23:13:42.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.568+0000 7f1608c00700 1 --2- 172.21.15.159:0/231490682 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f15f006d9d0 0x7f15f006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:42.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.568+0000 7f1608c00700 1 -- 172.21.15.159:0/231490682 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f15f808d2e0 con 0x7f160c101750 2024-02-28T23:13:42.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.568+0000 7f160be00700 1 --2- 172.21.15.159:0/231490682 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f15f006d9d0 0x7f15f006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:42.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.569+0000 7f160be00700 1 --2- 172.21.15.159:0/231490682 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f15f006d9d0 0x7f15f006fe90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f15fc000c00 tx=0x7f15fc005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:42.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.573+0000 7f1608c00700 1 -- 172.21.15.159:0/231490682 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f15f805a4c0 con 0x7f160c101750 2024-02-28T23:13:42.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:42 smithi184 ceph-mon[86482]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:42.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:42 smithi184 ceph-mon[86482]: pgmap v27: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:42.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:42 smithi184 ceph-mon[86482]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:42.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:42.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:42.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T23:13:42.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:42.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:42 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/322117916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:13:42.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.808+0000 7f1612c00700 1 -- 172.21.15.159:0/231490682 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f160c1993f0 con 0x7f15f006d9d0 2024-02-28T23:13:42.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.810+0000 7f1608c00700 1 -- 172.21.15.159:0/231490682 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f160c1993f0 con 0x7f15f006d9d0 2024-02-28T23:13:42.810 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:13:42.810 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:13:42.810 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:13:42.810 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:13:42.810 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:13:42.810 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:13:42.810 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:13:42.811 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:13:42.811 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "4/23 daemons upgraded", 2024-02-28T23:13:42.811 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading mon daemons", 2024-02-28T23:13:42.811 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:13:42.811 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:13:42.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.813+0000 7f1612c00700 1 -- 172.21.15.159:0/231490682 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f15f006d9d0 msgr2=0x7f15f006fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:42.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.813+0000 7f1612c00700 1 --2- 172.21.15.159:0/231490682 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f15f006d9d0 0x7f15f006fe90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f15fc000c00 tx=0x7f15fc005fd0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.813+0000 7f1612c00700 1 -- 172.21.15.159:0/231490682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c101750 msgr2=0x7f160c19ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:42.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.813+0000 7f1612c00700 1 --2- 172.21.15.159:0/231490682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c101750 0x7f160c19ed90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f15f800b480 tx=0x7f15f800b840 comp rx=0 tx=0).stop 2024-02-28T23:13:42.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.813+0000 7f1612c00700 1 -- 172.21.15.159:0/231490682 shutdown_connections 2024-02-28T23:13:42.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.813+0000 7f1612c00700 1 --2- 172.21.15.159:0/231490682 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f160c100da0 0x7f160c19e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.813+0000 7f1612c00700 1 --2- 172.21.15.159:0/231490682 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f15f006d9d0 0x7f15f006fe90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.813+0000 7f1612c00700 1 --2- 172.21.15.159:0/231490682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f160c101750 0x7f160c19ed90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.813+0000 7f1612c00700 1 -- 172.21.15.159:0/231490682 >> 172.21.15.159:0/231490682 conn(0x7f160c0fc630 msgr2=0x7f160c0fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:42.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.814+0000 7f1612c00700 1 -- 172.21.15.159:0/231490682 shutdown_connections 2024-02-28T23:13:42.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.814+0000 7f1612c00700 1 -- 172.21.15.159:0/231490682 wait complete. 2024-02-28T23:13:42.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.966+0000 7f955c200700 1 -- 172.21.15.159:0/676543922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9554101750 msgr2=0x7f95541057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:42.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.966+0000 7f955c200700 1 --2- 172.21.15.159:0/676543922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9554101750 0x7f95541057a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9540009910 tx=0x7f9540009c20 comp rx=0 tx=0).stop 2024-02-28T23:13:42.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.966+0000 7f955c200700 1 -- 172.21.15.159:0/676543922 shutdown_connections 2024-02-28T23:13:42.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.966+0000 7f955c200700 1 --2- 172.21.15.159:0/676543922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9554101750 0x7f95541057a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.966+0000 7f955c200700 1 --2- 172.21.15.159:0/676543922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9554100da0 0x7f9554101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.966+0000 7f955c200700 1 -- 172.21.15.159:0/676543922 >> 172.21.15.159:0/676543922 conn(0x7f95540fc630 msgr2=0x7f95540fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:42.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.966+0000 7f955c200700 1 -- 172.21.15.159:0/676543922 shutdown_connections 2024-02-28T23:13:42.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.966+0000 7f955c200700 1 -- 172.21.15.159:0/676543922 wait complete. 2024-02-28T23:13:42.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.967+0000 7f955c200700 1 Processor -- start 2024-02-28T23:13:42.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.967+0000 7f955c200700 1 -- start start 2024-02-28T23:13:42.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.967+0000 7f955c200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9554100da0 0x7f9554073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:42.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.967+0000 7f955c200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9554101750 0x7f95540735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:42.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.967+0000 7f955c200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9554073b10 con 0x7f9554100da0 2024-02-28T23:13:42.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.967+0000 7f955c200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9554073c50 con 0x7f9554101750 2024-02-28T23:13:42.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.968+0000 7f9559800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9554100da0 0x7f9554073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:42.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.968+0000 7f9559800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9554100da0 0x7f9554073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60352/0 (socket says 172.21.15.159:60352) 2024-02-28T23:13:42.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.968+0000 7f9559800700 1 -- 172.21.15.159:0/1874032048 learned_addr learned my addr 172.21.15.159:0/1874032048 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:13:42.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.968+0000 7f9559800700 1 -- 172.21.15.159:0/1874032048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9554101750 msgr2=0x7f95540735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:42.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.968+0000 7f9558e00700 1 --2- 172.21.15.159:0/1874032048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9554101750 0x7f95540735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:42.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.968+0000 7f9559800700 1 --2- 172.21.15.159:0/1874032048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9554101750 0x7f95540735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:42.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.968+0000 7f9559800700 1 -- 172.21.15.159:0/1874032048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95400095f0 con 0x7f9554100da0 2024-02-28T23:13:42.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.969+0000 7f9559800700 1 --2- 172.21.15.159:0/1874032048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9554100da0 0x7f9554073090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f954800d8d0 tx=0x7f954800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:42.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.969+0000 7f9552000700 1 -- 172.21.15.159:0/1874032048 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9548009940 con 0x7f9554100da0 2024-02-28T23:13:42.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.969+0000 7f9552000700 1 -- 172.21.15.159:0/1874032048 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9548010460 con 0x7f9554100da0 2024-02-28T23:13:42.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.969+0000 7f955c200700 1 -- 172.21.15.159:0/1874032048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95541a2900 con 0x7f9554100da0 2024-02-28T23:13:42.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.969+0000 7f9552000700 1 -- 172.21.15.159:0/1874032048 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954800f5f0 con 0x7f9554100da0 2024-02-28T23:13:42.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.969+0000 7f955c200700 1 -- 172.21.15.159:0/1874032048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95541a2d10 con 0x7f9554100da0 2024-02-28T23:13:42.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.970+0000 7f955c200700 1 -- 172.21.15.159:0/1874032048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95541091a0 con 0x7f9554100da0 2024-02-28T23:13:42.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.971+0000 7f9552000700 1 -- 172.21.15.159:0/1874032048 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f95480105d0 con 0x7f9554100da0 2024-02-28T23:13:42.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.972+0000 7f9552000700 1 --2- 172.21.15.159:0/1874032048 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f953c06d9d0 0x7f953c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:13:42.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.972+0000 7f9552000700 1 -- 172.21.15.159:0/1874032048 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f954808d600 con 0x7f9554100da0 2024-02-28T23:13:42.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.972+0000 7f9558e00700 1 --2- 172.21.15.159:0/1874032048 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f953c06d9d0 0x7f953c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:13:42.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.973+0000 7f9558e00700 1 --2- 172.21.15.159:0/1874032048 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f953c06d9d0 0x7f953c06fe90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9540000c00 tx=0x7f9540005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:13:42.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:42.977+0000 7f9552000700 1 -- 172.21.15.159:0/1874032048 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9548056cc0 con 0x7f9554100da0 2024-02-28T23:13:43.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.273+0000 7f955c200700 1 -- 172.21.15.159:0/1874032048 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f955404ea90 con 0x7f9554100da0 2024-02-28T23:13:43.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.274+0000 7f9552000700 1 -- 172.21.15.159:0/1874032048 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f954805a380 con 0x7f9554100da0 2024-02-28T23:13:43.273 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_OK 2024-02-28T23:13:43.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.276+0000 7f955c200700 1 -- 172.21.15.159:0/1874032048 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f953c06d9d0 msgr2=0x7f953c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:43.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.276+0000 7f955c200700 1 --2- 172.21.15.159:0/1874032048 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f953c06d9d0 0x7f953c06fe90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9540000c00 tx=0x7f9540005fd0 comp rx=0 tx=0).stop 2024-02-28T23:13:43.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.276+0000 7f955c200700 1 -- 172.21.15.159:0/1874032048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9554100da0 msgr2=0x7f9554073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:13:43.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.276+0000 7f955c200700 1 --2- 172.21.15.159:0/1874032048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9554100da0 0x7f9554073090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f954800d8d0 tx=0x7f954800dc90 comp rx=0 tx=0).stop 2024-02-28T23:13:43.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.276+0000 7f955c200700 1 -- 172.21.15.159:0/1874032048 shutdown_connections 2024-02-28T23:13:43.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.276+0000 7f955c200700 1 --2- 172.21.15.159:0/1874032048 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f953c06d9d0 0x7f953c06fe90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:43.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.276+0000 7f955c200700 1 --2- 172.21.15.159:0/1874032048 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9554100da0 0x7f9554073090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:43.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.276+0000 7f955c200700 1 --2- 172.21.15.159:0/1874032048 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9554101750 0x7f95540735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:13:43.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.276+0000 7f955c200700 1 -- 172.21.15.159:0/1874032048 >> 172.21.15.159:0/1874032048 conn(0x7f95540fc630 msgr2=0x7f95540fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:13:43.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.277+0000 7f955c200700 1 -- 172.21.15.159:0/1874032048 shutdown_connections 2024-02-28T23:13:43.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:13:43.277+0000 7f955c200700 1 -- 172.21.15.159:0/1874032048 wait complete. 2024-02-28T23:13:43.457 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:43 smithi159 ceph-mon[113833]: Reconfiguring osd.0 (monmap changed)... 2024-02-28T23:13:43.457 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:43 smithi159 ceph-mon[113833]: Reconfiguring daemon osd.0 on smithi159 2024-02-28T23:13:43.457 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:43 smithi159 ceph-mon[113833]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:43.457 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:43 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1395390259' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:13:43.457 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:43 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1874032048' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:13:43.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:43 smithi184 ceph-mon[86482]: Reconfiguring osd.0 (monmap changed)... 2024-02-28T23:13:43.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:43 smithi184 ceph-mon[86482]: Reconfiguring daemon osd.0 on smithi159 2024-02-28T23:13:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:43 smithi184 ceph-mon[86482]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:43 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1395390259' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:13:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:43 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1874032048' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:13:44.503 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:44 smithi184 ceph-mon[86482]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:44.503 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:44 smithi184 ceph-mon[86482]: pgmap v28: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:44.503 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:44.503 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:44.503 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T23:13:44.503 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:44.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:44 smithi159 ceph-mon[113833]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:13:44.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:44 smithi159 ceph-mon[113833]: pgmap v28: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:44.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:44.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:44.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T23:13:44.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:45.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:45 smithi184 ceph-mon[86482]: Reconfiguring osd.1 (monmap changed)... 2024-02-28T23:13:45.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:45 smithi184 ceph-mon[86482]: Reconfiguring daemon osd.1 on smithi159 2024-02-28T23:13:45.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:45 smithi159 ceph-mon[113833]: Reconfiguring osd.1 (monmap changed)... 2024-02-28T23:13:45.685 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:45 smithi159 ceph-mon[113833]: Reconfiguring daemon osd.1 on smithi159 2024-02-28T23:13:46.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:46 smithi184 ceph-mon[86482]: pgmap v29: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:46.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:46 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:46.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:46 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:46.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:46 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T23:13:46.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:46 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:46 smithi159 ceph-mon[113833]: pgmap v29: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:46 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:46 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:46 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T23:13:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:46 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:47.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:47 smithi184 ceph-mon[86482]: Reconfiguring osd.2 (monmap changed)... 2024-02-28T23:13:47.325 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:47 smithi184 ceph-mon[86482]: Reconfiguring daemon osd.2 on smithi159 2024-02-28T23:13:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:47 smithi159 ceph-mon[113833]: Reconfiguring osd.2 (monmap changed)... 2024-02-28T23:13:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:47 smithi159 ceph-mon[113833]: Reconfiguring daemon osd.2 on smithi159 2024-02-28T23:13:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:48 smithi184 ceph-mon[86482]: pgmap v30: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:48 smithi159 ceph-mon[113833]: pgmap v30: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:13:49.651 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:49 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:49.651 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:49 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:49.652 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:49 smithi159 ceph-mon[113833]: Reconfiguring mds.cephfs.smithi159.mbaqic (monmap changed)... 2024-02-28T23:13:49.652 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:49 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.mbaqic", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:13:49.652 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:49 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:49.652 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:49 smithi159 ceph-mon[113833]: Reconfiguring daemon mds.cephfs.smithi159.mbaqic on smithi159 2024-02-28T23:13:49.652 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:49 smithi159 ceph-mon[113833]: pgmap v31: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:49.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:49 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:49.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:49 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:49.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:49 smithi184 ceph-mon[86482]: Reconfiguring mds.cephfs.smithi159.mbaqic (monmap changed)... 2024-02-28T23:13:49.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:49 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.mbaqic", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:13:49.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:49 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:49.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:49 smithi184 ceph-mon[86482]: Reconfiguring daemon mds.cephfs.smithi159.mbaqic on smithi159 2024-02-28T23:13:49.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:49 smithi184 ceph-mon[86482]: pgmap v31: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:51.781 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:51 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:51.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:51 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:51.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:51 smithi159 ceph-mon[113833]: Reconfiguring mds.cephfs.smithi159.azxrct (monmap changed)... 2024-02-28T23:13:51.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:51 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.azxrct", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:13:51.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:51 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:51.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:51 smithi159 ceph-mon[113833]: Reconfiguring daemon mds.cephfs.smithi159.azxrct on smithi159 2024-02-28T23:13:51.782 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:51 smithi159 ceph-mon[113833]: pgmap v32: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:13:51.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:51 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:51.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:51 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:51.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:51 smithi184 ceph-mon[86482]: Reconfiguring mds.cephfs.smithi159.azxrct (monmap changed)... 2024-02-28T23:13:51.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:51 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.azxrct", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:13:51.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:51 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:51.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:51 smithi184 ceph-mon[86482]: Reconfiguring daemon mds.cephfs.smithi159.azxrct on smithi159 2024-02-28T23:13:51.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:51 smithi184 ceph-mon[86482]: pgmap v32: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:13:53.940 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:53.940 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:53.940 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: Reconfiguring ceph-exporter.smithi184 (monmap changed)... 2024-02-28T23:13:53.941 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:13:53.941 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:13:53.941 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T23:13:53.941 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: Unable to update caps for client.ceph-exporter.smithi184 2024-02-28T23:13:53.941 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi184"}]: dispatch 2024-02-28T23:13:53.941 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:53.941 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: Reconfiguring daemon ceph-exporter.smithi184 on smithi184 2024-02-28T23:13:53.941 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: pgmap v33: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:13:53.941 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: Reconfiguring ceph-exporter.smithi184 (monmap changed)... 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "auth caps", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: Unable to update caps for client.ceph-exporter.smithi184 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.ceph-exporter.smithi184"}]: dispatch 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: Reconfiguring daemon ceph-exporter.smithi184 on smithi184 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: pgmap v33: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:13:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:13:56.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:56.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:56.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:55 smithi184 ceph-mon[86482]: Reconfiguring crash.smithi184 (monmap changed)... 2024-02-28T23:13:56.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T23:13:56.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:56.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:55 smithi184 ceph-mon[86482]: Reconfiguring daemon crash.smithi184 on smithi184 2024-02-28T23:13:56.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:55 smithi184 ceph-mon[86482]: pgmap v34: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:56.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:56.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:56.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:55 smithi159 ceph-mon[113833]: Reconfiguring crash.smithi184 (monmap changed)... 2024-02-28T23:13:56.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T23:13:56.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:56.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:55 smithi159 ceph-mon[113833]: Reconfiguring daemon crash.smithi184 on smithi184 2024-02-28T23:13:56.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:55 smithi159 ceph-mon[113833]: pgmap v34: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:13:58.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:58 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:58.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:58 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:58.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:58 smithi159 ceph-mon[113833]: pgmap v35: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:13:58.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:58 smithi159 ceph-mon[113833]: Reconfiguring mgr.smithi184.quvmnx (monmap changed)... 2024-02-28T23:13:58.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:58 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.quvmnx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T23:13:58.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:58 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T23:13:58.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:58 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:58.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:13:58 smithi159 ceph-mon[113833]: Reconfiguring daemon mgr.smithi184.quvmnx on smithi184 2024-02-28T23:13:58.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:58 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:58.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:58 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:13:58.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:58 smithi184 ceph-mon[86482]: pgmap v35: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:13:58.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:58 smithi184 ceph-mon[86482]: Reconfiguring mgr.smithi184.quvmnx (monmap changed)... 2024-02-28T23:13:58.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:58 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi184.quvmnx", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-28T23:13:58.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:58 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-28T23:13:58.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:58 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:13:58.313 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:13:58 smithi184 ceph-mon[86482]: Reconfiguring daemon mgr.smithi184.quvmnx on smithi184 2024-02-28T23:14:00.394 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:00 smithi184 ceph-mon[86482]: pgmap v36: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:00.395 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:00.395 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:00.395 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T23:14:00.395 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T23:14:00.395 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:00.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:00 smithi159 ceph-mon[113833]: pgmap v36: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:00.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:00.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:00.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-28T23:14:00.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-28T23:14:00.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:01.443 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:01 smithi184 ceph-mon[86482]: Reconfiguring mon.smithi184 (monmap changed)... 2024-02-28T23:14:01.444 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:01 smithi184 ceph-mon[86482]: Reconfiguring daemon mon.smithi184 on smithi184 2024-02-28T23:14:01.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:01 smithi159 ceph-mon[113833]: Reconfiguring mon.smithi184 (monmap changed)... 2024-02-28T23:14:01.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:01 smithi159 ceph-mon[113833]: Reconfiguring daemon mon.smithi184 on smithi184 2024-02-28T23:14:02.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:02 smithi159 ceph-mon[113833]: pgmap v37: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:14:02.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:02 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:02.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:02 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:02.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:02 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T23:14:02.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:02 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:02 smithi184 ceph-mon[86482]: pgmap v37: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:14:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:02 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:02 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:02 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T23:14:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:02 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:03.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:03 smithi184 ceph-mon[86482]: Reconfiguring osd.3 (monmap changed)... 2024-02-28T23:14:03.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:03 smithi184 ceph-mon[86482]: Reconfiguring daemon osd.3 on smithi184 2024-02-28T23:14:03.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:03 smithi159 ceph-mon[113833]: Reconfiguring osd.3 (monmap changed)... 2024-02-28T23:14:03.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:03 smithi159 ceph-mon[113833]: Reconfiguring daemon osd.3 on smithi184 2024-02-28T23:14:04.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:04 smithi159 ceph-mon[113833]: pgmap v38: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:14:04.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:04 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:04.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:04 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:04.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:04 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T23:14:04.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:04 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:04 smithi184 ceph-mon[86482]: pgmap v38: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:14:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:04 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:04 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:04 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T23:14:04.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:04 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:05.281 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:05 smithi184 ceph-mon[86482]: Reconfiguring osd.4 (monmap changed)... 2024-02-28T23:14:05.281 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:05 smithi184 ceph-mon[86482]: Reconfiguring daemon osd.4 on smithi184 2024-02-28T23:14:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:05 smithi159 ceph-mon[113833]: Reconfiguring osd.4 (monmap changed)... 2024-02-28T23:14:05.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:05 smithi159 ceph-mon[113833]: Reconfiguring daemon osd.4 on smithi184 2024-02-28T23:14:06.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:06 smithi159 ceph-mon[113833]: pgmap v39: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:06.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:06 smithi184 ceph-mon[86482]: pgmap v39: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:07.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:07 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:07.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:07 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:07.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:07 smithi159 ceph-mon[113833]: Reconfiguring osd.5 (monmap changed)... 2024-02-28T23:14:07.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:07 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T23:14:07.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:07 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:07.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:07 smithi159 ceph-mon[113833]: Reconfiguring daemon osd.5 on smithi184 2024-02-28T23:14:07.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:07 smithi159 ceph-mon[113833]: pgmap v40: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:14:07.749 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:07 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:07.750 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:07 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:07.750 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:07 smithi184 ceph-mon[86482]: Reconfiguring osd.5 (monmap changed)... 2024-02-28T23:14:07.750 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:07 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T23:14:07.750 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:07 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:07.750 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:07 smithi184 ceph-mon[86482]: Reconfiguring daemon osd.5 on smithi184 2024-02-28T23:14:07.750 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:07 smithi184 ceph-mon[86482]: pgmap v40: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:14:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:14:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:14:10.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:09 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:10.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:09 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:10.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:09 smithi184 ceph-mon[86482]: Reconfiguring mds.cephfs.smithi184.azwkfx (monmap changed)... 2024-02-28T23:14:10.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:09 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.azwkfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:14:10.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:09 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:10.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:09 smithi184 ceph-mon[86482]: Reconfiguring daemon mds.cephfs.smithi184.azwkfx on smithi184 2024-02-28T23:14:10.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:09 smithi184 ceph-mon[86482]: pgmap v41: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:10.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:09 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:10.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:09 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:10.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:09 smithi159 ceph-mon[113833]: Reconfiguring mds.cephfs.smithi184.azwkfx (monmap changed)... 2024-02-28T23:14:10.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:09 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.azwkfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:14:10.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:09 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:10.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:09 smithi159 ceph-mon[113833]: Reconfiguring daemon mds.cephfs.smithi184.azwkfx on smithi184 2024-02-28T23:14:10.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:09 smithi159 ceph-mon[113833]: pgmap v41: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:12.261 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:12 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:12.262 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:12 smithi184 ceph-mon[86482]: pgmap v42: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:14:12.262 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:12 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:12.262 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:12 smithi184 ceph-mon[86482]: Reconfiguring mds.cephfs.smithi184.pnifob (monmap changed)... 2024-02-28T23:14:12.262 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:12 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.pnifob", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:14:12.262 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:12 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:12.262 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:12 smithi184 ceph-mon[86482]: Reconfiguring daemon mds.cephfs.smithi184.pnifob on smithi184 2024-02-28T23:14:12.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:12 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:12.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:12 smithi159 ceph-mon[113833]: pgmap v42: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:14:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:12 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:12 smithi159 ceph-mon[113833]: Reconfiguring mds.cephfs.smithi184.pnifob (monmap changed)... 2024-02-28T23:14:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:12 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.pnifob", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:14:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:12 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:12 smithi159 ceph-mon[113833]: Reconfiguring daemon mds.cephfs.smithi184.pnifob on smithi184 2024-02-28T23:14:13.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.453+0000 7fde77600700 1 -- 172.21.15.159:0/141122250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde70100da0 msgr2=0x7fde70101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:13.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.453+0000 7fde77600700 1 --2- 172.21.15.159:0/141122250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde70100da0 0x7fde70101180 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fde60009910 tx=0x7fde60009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:13.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.453+0000 7fde77600700 1 -- 172.21.15.159:0/141122250 shutdown_connections 2024-02-28T23:14:13.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.453+0000 7fde77600700 1 --2- 172.21.15.159:0/141122250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde70101750 0x7fde701057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:13.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.453+0000 7fde77600700 1 --2- 172.21.15.159:0/141122250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde70100da0 0x7fde70101180 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:13.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.453+0000 7fde77600700 1 -- 172.21.15.159:0/141122250 >> 172.21.15.159:0/141122250 conn(0x7fde700fc630 msgr2=0x7fde700fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:13.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.453+0000 7fde77600700 1 -- 172.21.15.159:0/141122250 shutdown_connections 2024-02-28T23:14:13.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.453+0000 7fde77600700 1 -- 172.21.15.159:0/141122250 wait complete. 2024-02-28T23:14:13.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.454+0000 7fde77600700 1 Processor -- start 2024-02-28T23:14:13.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.454+0000 7fde77600700 1 -- start start 2024-02-28T23:14:13.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.455+0000 7fde77600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde70100da0 0x7fde7019c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:13.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.455+0000 7fde77600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde70101750 0x7fde7019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:13.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.455+0000 7fde77600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7019d170 con 0x7fde70100da0 2024-02-28T23:14:13.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.455+0000 7fde77600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde70196620 con 0x7fde70101750 2024-02-28T23:14:13.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.455+0000 7fde74c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde70100da0 0x7fde7019c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.455+0000 7fde74c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde70100da0 0x7fde7019c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57956/0 (socket says 172.21.15.159:57956) 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.455+0000 7fde74c00700 1 -- 172.21.15.159:0/3059160693 learned_addr learned my addr 172.21.15.159:0/3059160693 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.456+0000 7fde67e00700 1 --2- 172.21.15.159:0/3059160693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde70101750 0x7fde7019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.456+0000 7fde74c00700 1 -- 172.21.15.159:0/3059160693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde70101750 msgr2=0x7fde7019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.456+0000 7fde74c00700 1 --2- 172.21.15.159:0/3059160693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde70101750 0x7fde7019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.456+0000 7fde74c00700 1 -- 172.21.15.159:0/3059160693 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde600095f0 con 0x7fde70100da0 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.456+0000 7fde74c00700 1 --2- 172.21.15.159:0/3059160693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde70100da0 0x7fde7019c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde6000b5c0 tx=0x7fde6000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.457+0000 7fde6e000700 1 -- 172.21.15.159:0/3059160693 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde6001d070 con 0x7fde70100da0 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.457+0000 7fde77600700 1 -- 172.21.15.159:0/3059160693 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde701968a0 con 0x7fde70100da0 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.457+0000 7fde6e000700 1 -- 172.21.15.159:0/3059160693 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde6000f460 con 0x7fde70100da0 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.457+0000 7fde6e000700 1 -- 172.21.15.159:0/3059160693 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde60017610 con 0x7fde70100da0 2024-02-28T23:14:13.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.457+0000 7fde77600700 1 -- 172.21.15.159:0/3059160693 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde70196d90 con 0x7fde70100da0 2024-02-28T23:14:13.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.458+0000 7fde77600700 1 -- 172.21.15.159:0/3059160693 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde70109140 con 0x7fde70100da0 2024-02-28T23:14:13.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.459+0000 7fde6e000700 1 -- 172.21.15.159:0/3059160693 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fde60003a60 con 0x7fde70100da0 2024-02-28T23:14:13.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.460+0000 7fde6e000700 1 --2- 172.21.15.159:0/3059160693 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5406d9d0 0x7fde5406fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:13.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.460+0000 7fde6e000700 1 -- 172.21.15.159:0/3059160693 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fde6008edc0 con 0x7fde70100da0 2024-02-28T23:14:13.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.461+0000 7fde67e00700 1 --2- 172.21.15.159:0/3059160693 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5406d9d0 0x7fde5406fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:13.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.461+0000 7fde67e00700 1 --2- 172.21.15.159:0/3059160693 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5406d9d0 0x7fde5406fe90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fde5c005fd0 tx=0x7fde5c00a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:13.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.465+0000 7fde6e000700 1 -- 172.21.15.159:0/3059160693 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fde60092030 con 0x7fde70100da0 2024-02-28T23:14:13.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.707+0000 7fde77600700 1 -- 172.21.15.159:0/3059160693 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fde70197070 con 0x7fde5406d9d0 2024-02-28T23:14:13.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.709+0000 7fde6e000700 1 -- 172.21.15.159:0/3059160693 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fde70197070 con 0x7fde5406d9d0 2024-02-28T23:14:13.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.712+0000 7fde77600700 1 -- 172.21.15.159:0/3059160693 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5406d9d0 msgr2=0x7fde5406fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.712+0000 7fde77600700 1 --2- 172.21.15.159:0/3059160693 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5406d9d0 0x7fde5406fe90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fde5c005fd0 tx=0x7fde5c00a560 comp rx=0 tx=0).stop 2024-02-28T23:14:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.712+0000 7fde77600700 1 -- 172.21.15.159:0/3059160693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde70100da0 msgr2=0x7fde7019c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.712+0000 7fde77600700 1 --2- 172.21.15.159:0/3059160693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde70100da0 0x7fde7019c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fde6000b5c0 tx=0x7fde6000be00 comp rx=0 tx=0).stop 2024-02-28T23:14:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.712+0000 7fde77600700 1 -- 172.21.15.159:0/3059160693 shutdown_connections 2024-02-28T23:14:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.712+0000 7fde77600700 1 --2- 172.21.15.159:0/3059160693 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5406d9d0 0x7fde5406fe90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.712+0000 7fde77600700 1 --2- 172.21.15.159:0/3059160693 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde70100da0 0x7fde7019c5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.712+0000 7fde77600700 1 --2- 172.21.15.159:0/3059160693 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde70101750 0x7fde7019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.712+0000 7fde77600700 1 -- 172.21.15.159:0/3059160693 >> 172.21.15.159:0/3059160693 conn(0x7fde700fc630 msgr2=0x7fde700fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.712+0000 7fde77600700 1 -- 172.21.15.159:0/3059160693 shutdown_connections 2024-02-28T23:14:13.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.712+0000 7fde77600700 1 -- 172.21.15.159:0/3059160693 wait complete. 2024-02-28T23:14:13.727 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:14:13.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.862+0000 7f58ad800700 1 -- 172.21.15.159:0/1453755389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8102fe0 msgr2=0x7f58a81033c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:13.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.862+0000 7f58ad800700 1 --2- 172.21.15.159:0/1453755389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8102fe0 0x7f58a81033c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5898009910 tx=0x7f5898009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:13.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.862+0000 7f58ad800700 1 -- 172.21.15.159:0/1453755389 shutdown_connections 2024-02-28T23:14:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.862+0000 7f58ad800700 1 --2- 172.21.15.159:0/1453755389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a8103990 0x7f58a81079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.862+0000 7f58ad800700 1 --2- 172.21.15.159:0/1453755389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8102fe0 0x7f58a81033c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.862+0000 7f58ad800700 1 -- 172.21.15.159:0/1453755389 >> 172.21.15.159:0/1453755389 conn(0x7f58a80fe870 msgr2=0x7f58a8100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.862+0000 7f58ad800700 1 -- 172.21.15.159:0/1453755389 shutdown_connections 2024-02-28T23:14:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.862+0000 7f58ad800700 1 -- 172.21.15.159:0/1453755389 wait complete. 2024-02-28T23:14:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.863+0000 7f58ad800700 1 Processor -- start 2024-02-28T23:14:13.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.863+0000 7f58ad800700 1 -- start start 2024-02-28T23:14:13.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.863+0000 7f58ad800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8102fe0 0x7f58a80752a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:13.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.863+0000 7f58ad800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a8103990 0x7f58a80757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:13.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.863+0000 7f58ad800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8079430 con 0x7f58a8102fe0 2024-02-28T23:14:13.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.863+0000 7f58ad800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8075d20 con 0x7f58a8103990 2024-02-28T23:14:13.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.864+0000 7f58a6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8102fe0 0x7f58a80752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:13.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.864+0000 7f58a6a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8102fe0 0x7f58a80752a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57978/0 (socket says 172.21.15.159:57978) 2024-02-28T23:14:13.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.864+0000 7f58a6a00700 1 -- 172.21.15.159:0/591076997 learned_addr learned my addr 172.21.15.159:0/591076997 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:13.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.864+0000 7f58a6000700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a8103990 0x7f58a80757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:13.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.864+0000 7f58a6a00700 1 -- 172.21.15.159:0/591076997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a8103990 msgr2=0x7f58a80757e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:13.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.864+0000 7f58a6a00700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a8103990 0x7f58a80757e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:13.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.864+0000 7f58a6a00700 1 -- 172.21.15.159:0/591076997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58980095f0 con 0x7f58a8102fe0 2024-02-28T23:14:13.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.864+0000 7f58a6000700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a8103990 0x7f58a80757e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:14:13.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.865+0000 7f58a6a00700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8102fe0 0x7f58a80752a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5898006010 tx=0x7f589800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:13.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.865+0000 7f589f400700 1 -- 172.21.15.159:0/591076997 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f589801d070 con 0x7f58a8102fe0 2024-02-28T23:14:13.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.865+0000 7f589f400700 1 -- 172.21.15.159:0/591076997 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5898004fb0 con 0x7f58a8102fe0 2024-02-28T23:14:13.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.865+0000 7f58ad800700 1 -- 172.21.15.159:0/591076997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a8075fa0 con 0x7f58a8102fe0 2024-02-28T23:14:13.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.865+0000 7f589f400700 1 -- 172.21.15.159:0/591076997 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5898022ea0 con 0x7f58a8102fe0 2024-02-28T23:14:13.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.865+0000 7f58ad800700 1 -- 172.21.15.159:0/591076997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a81a71d0 con 0x7f58a8102fe0 2024-02-28T23:14:13.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.867+0000 7f58ad800700 1 -- 172.21.15.159:0/591076997 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a810b380 con 0x7f58a8102fe0 2024-02-28T23:14:13.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.867+0000 7f589f400700 1 -- 172.21.15.159:0/591076997 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f5898022470 con 0x7f58a8102fe0 2024-02-28T23:14:13.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.868+0000 7f589f400700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f588c06d9e0 0x7f588c06fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:13.866 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.868+0000 7f589f400700 1 -- 172.21.15.159:0/591076997 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f589808edb0 con 0x7f58a8102fe0 2024-02-28T23:14:13.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.868+0000 7f58a6000700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f588c06d9e0 0x7f588c06fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:13.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.869+0000 7f58a6000700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f588c06d9e0 0x7f588c06fea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f58a8076a90 tx=0x7f5894008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:13.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:13.873+0000 7f589f400700 1 -- 172.21.15.159:0/591076997 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f58980585c0 con 0x7f58a8102fe0 2024-02-28T23:14:14.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.146+0000 7f58ad800700 1 -- 172.21.15.159:0/591076997 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f58a802cd30 con 0x7f588c06d9e0 2024-02-28T23:14:14.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.147+0000 7f589f400700 1 -- 172.21.15.159:0/591076997 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f58a802cd30 con 0x7f588c06d9e0 2024-02-28T23:14:14.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.150+0000 7f58ad800700 1 -- 172.21.15.159:0/591076997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f588c06d9e0 msgr2=0x7f588c06fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:14.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.150+0000 7f58ad800700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f588c06d9e0 0x7f588c06fea0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f58a8076a90 tx=0x7f5894008040 comp rx=0 tx=0).stop 2024-02-28T23:14:14.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.150+0000 7f58ad800700 1 -- 172.21.15.159:0/591076997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8102fe0 msgr2=0x7f58a80752a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:14.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.150+0000 7f58ad800700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8102fe0 0x7f58a80752a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5898006010 tx=0x7f589800be20 comp rx=0 tx=0).stop 2024-02-28T23:14:14.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.150+0000 7f58ad800700 1 -- 172.21.15.159:0/591076997 shutdown_connections 2024-02-28T23:14:14.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.150+0000 7f58ad800700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f588c06d9e0 0x7f588c06fea0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.150+0000 7f58ad800700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58a8102fe0 0x7f58a80752a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.150+0000 7f58ad800700 1 --2- 172.21.15.159:0/591076997 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f58a8103990 0x7f58a80757e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.150+0000 7f58ad800700 1 -- 172.21.15.159:0/591076997 >> 172.21.15.159:0/591076997 conn(0x7f58a80fe870 msgr2=0x7f58a80fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:14.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.150+0000 7f58ad800700 1 -- 172.21.15.159:0/591076997 shutdown_connections 2024-02-28T23:14:14.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.150+0000 7f58ad800700 1 -- 172.21.15.159:0/591076997 wait complete. 2024-02-28T23:14:14.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.308+0000 7f5668e00700 1 -- 172.21.15.159:0/3722344449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5664073a80 msgr2=0x7f566410cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:14.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.308+0000 7f5668e00700 1 --2- 172.21.15.159:0/3722344449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5664073a80 0x7f566410cee0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f564c009910 tx=0x7f564c009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:14.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.308+0000 7f5668e00700 1 -- 172.21.15.159:0/3722344449 shutdown_connections 2024-02-28T23:14:14.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.308+0000 7f5668e00700 1 --2- 172.21.15.159:0/3722344449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5664073a80 0x7f566410cee0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.308+0000 7f5668e00700 1 --2- 172.21.15.159:0/3722344449 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5664073160 0x7f5664073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.308+0000 7f5668e00700 1 -- 172.21.15.159:0/3722344449 >> 172.21.15.159:0/3722344449 conn(0x7f56640fc690 msgr2=0x7f56640feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:14.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.309+0000 7f5668e00700 1 -- 172.21.15.159:0/3722344449 shutdown_connections 2024-02-28T23:14:14.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.309+0000 7f5668e00700 1 -- 172.21.15.159:0/3722344449 wait complete. 2024-02-28T23:14:14.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.310+0000 7f5668e00700 1 Processor -- start 2024-02-28T23:14:14.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.310+0000 7f5668e00700 1 -- start start 2024-02-28T23:14:14.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.310+0000 7f5668e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5664073160 0x7f5664198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:14.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.310+0000 7f5668e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5664073a80 0x7f5664198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:14.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.310+0000 7f5668e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5664199530 con 0x7f5664073a80 2024-02-28T23:14:14.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.310+0000 7f5668e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566419d340 con 0x7f5664073160 2024-02-28T23:14:14.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.310+0000 7f5659400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5664073a80 0x7f5664198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:14.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.310+0000 7f5659400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5664073a80 0x7f5664198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57994/0 (socket says 172.21.15.159:57994) 2024-02-28T23:14:14.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.310+0000 7f5659400700 1 -- 172.21.15.159:0/1471277856 learned_addr learned my addr 172.21.15.159:0/1471277856 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:14.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.310+0000 7f5661e00700 1 --2- 172.21.15.159:0/1471277856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5664073160 0x7f5664198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:14.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.311+0000 7f5659400700 1 -- 172.21.15.159:0/1471277856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5664073160 msgr2=0x7f5664198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:14.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.311+0000 7f5659400700 1 --2- 172.21.15.159:0/1471277856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5664073160 0x7f5664198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.311+0000 7f5659400700 1 -- 172.21.15.159:0/1471277856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c0095f0 con 0x7f5664073a80 2024-02-28T23:14:14.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.311+0000 7f5659400700 1 --2- 172.21.15.159:0/1471277856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5664073a80 0x7f5664198ea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f564c0092e0 tx=0x7f564c00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:14.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.311+0000 7f565b400700 1 -- 172.21.15.159:0/1471277856 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f564c01d070 con 0x7f5664073a80 2024-02-28T23:14:14.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.311+0000 7f565b400700 1 -- 172.21.15.159:0/1471277856 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f564c00f460 con 0x7f5664073a80 2024-02-28T23:14:14.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.311+0000 7f5668e00700 1 -- 172.21.15.159:0/1471277856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566419d5c0 con 0x7f5664073a80 2024-02-28T23:14:14.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.311+0000 7f565b400700 1 -- 172.21.15.159:0/1471277856 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f564c017630 con 0x7f5664073a80 2024-02-28T23:14:14.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.311+0000 7f5668e00700 1 -- 172.21.15.159:0/1471277856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566419dab0 con 0x7f5664073a80 2024-02-28T23:14:14.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.312+0000 7f5668e00700 1 -- 172.21.15.159:0/1471277856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566410a5e0 con 0x7f5664073a80 2024-02-28T23:14:14.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.313+0000 7f565b400700 1 -- 172.21.15.159:0/1471277856 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f564c00f5d0 con 0x7f5664073a80 2024-02-28T23:14:14.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.314+0000 7f565b400700 1 --2- 172.21.15.159:0/1471277856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f564806d9d0 0x7f564806fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:14.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.314+0000 7f565b400700 1 -- 172.21.15.159:0/1471277856 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f564c08ece0 con 0x7f5664073a80 2024-02-28T23:14:14.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.315+0000 7f5661e00700 1 --2- 172.21.15.159:0/1471277856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f564806d9d0 0x7f564806fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:14.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.315+0000 7f5661e00700 1 --2- 172.21.15.159:0/1471277856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f564806d9d0 0x7f564806fe90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5654005fd0 tx=0x7f565400a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:14.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.319+0000 7f565b400700 1 -- 172.21.15.159:0/1471277856 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f564c05be30 con 0x7f5664073a80 2024-02-28T23:14:14.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: pgmap v43: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:14.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:14.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:14.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:14:14.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:14.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:14.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: Upgrade: Setting container_image for all mon 2024-02-28T23:14:14.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:14.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]: dispatch 2024-02-28T23:14:14.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]': finished 2024-02-28T23:14:14.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi184"}]: dispatch 2024-02-28T23:14:14.464 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi184"}]': finished 2024-02-28T23:14:14.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.556+0000 7f5668e00700 1 -- 172.21.15.159:0/1471277856 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f566402cce0 con 0x7f564806d9d0 2024-02-28T23:14:14.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.573+0000 7f565b400700 1 -- 172.21.15.159:0/1471277856 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f566402cce0 con 0x7f564806d9d0 2024-02-28T23:14:14.571 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (3m) 74s ago 17m 14.5M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (18m) 74s ago 18m 8384k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (16m) 50s ago 16m 8019k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (18m) 74s ago 18m 6665k - 18.2.1 5be31c24972a b75b07cf3165 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (16m) 50s ago 16m 6665k - 18.2.1 5be31c24972a f2e585f02d81 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (3m) 74s ago 17m 75.1M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (10m) 74s ago 10m 148M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (10m) 74s ago 10m 86.7M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (10m) 50s ago 10m 17.1M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (10m) 50s ago 10m 17.0M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (6m) 74s ago 19m 476M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (5m) 50s ago 16m 448M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:14:14.572 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (91s) 74s ago 20m 28.2M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:14:14.573 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (55s) 50s ago 16m 16.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:14:14.573 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (4m) 74s ago 18m 7578k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:14:14.573 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (4m) 50s ago 16m 7805k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:14:14.573 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (15m) 74s ago 15m 235M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:14:14.573 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (14m) 74s ago 14m 250M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:14:14.573 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (14m) 74s ago 14m 212M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:14:14.573 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (13m) 50s ago 13m 300M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:14:14.573 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (13m) 50s ago 13m 251M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:14:14.573 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (12m) 50s ago 12m 230M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:14:14.573 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (4m) 74s ago 17m 52.6M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:14:14.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.575+0000 7f5668e00700 1 -- 172.21.15.159:0/1471277856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f564806d9d0 msgr2=0x7f564806fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:14.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.575+0000 7f5668e00700 1 --2- 172.21.15.159:0/1471277856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f564806d9d0 0x7f564806fe90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f5654005fd0 tx=0x7f565400a560 comp rx=0 tx=0).stop 2024-02-28T23:14:14.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.575+0000 7f5668e00700 1 -- 172.21.15.159:0/1471277856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5664073a80 msgr2=0x7f5664198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:14.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.575+0000 7f5668e00700 1 --2- 172.21.15.159:0/1471277856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5664073a80 0x7f5664198ea0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f564c0092e0 tx=0x7f564c00be00 comp rx=0 tx=0).stop 2024-02-28T23:14:14.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.576+0000 7f5668e00700 1 -- 172.21.15.159:0/1471277856 shutdown_connections 2024-02-28T23:14:14.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.576+0000 7f5668e00700 1 --2- 172.21.15.159:0/1471277856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5664073160 0x7f5664198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.576+0000 7f5668e00700 1 --2- 172.21.15.159:0/1471277856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f564806d9d0 0x7f564806fe90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.576+0000 7f5668e00700 1 --2- 172.21.15.159:0/1471277856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5664073a80 0x7f5664198ea0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.576+0000 7f5668e00700 1 -- 172.21.15.159:0/1471277856 >> 172.21.15.159:0/1471277856 conn(0x7f56640fc690 msgr2=0x7f5664107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:14.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.576+0000 7f5668e00700 1 -- 172.21.15.159:0/1471277856 shutdown_connections 2024-02-28T23:14:14.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.576+0000 7f5668e00700 1 -- 172.21.15.159:0/1471277856 wait complete. 2024-02-28T23:14:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: pgmap v43: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:14:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: Upgrade: Setting container_image for all mon 2024-02-28T23:14:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]: dispatch 2024-02-28T23:14:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi159"}]': finished 2024-02-28T23:14:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi184"}]: dispatch 2024-02-28T23:14:14.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:14 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi184"}]': finished 2024-02-28T23:14:14.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.724+0000 7f3d39a00700 1 -- 172.21.15.159:0/2748082343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d34100da0 msgr2=0x7f3d34101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:14.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.724+0000 7f3d39a00700 1 --2- 172.21.15.159:0/2748082343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d34100da0 0x7f3d34101180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009910 tx=0x7f3d24009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:14.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.725+0000 7f3d39a00700 1 -- 172.21.15.159:0/2748082343 shutdown_connections 2024-02-28T23:14:14.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.725+0000 7f3d39a00700 1 --2- 172.21.15.159:0/2748082343 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d34101750 0x7f3d341057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.725+0000 7f3d39a00700 1 --2- 172.21.15.159:0/2748082343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d34100da0 0x7f3d34101180 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.725+0000 7f3d39a00700 1 -- 172.21.15.159:0/2748082343 >> 172.21.15.159:0/2748082343 conn(0x7f3d340fc630 msgr2=0x7f3d340fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:14.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.725+0000 7f3d39a00700 1 -- 172.21.15.159:0/2748082343 shutdown_connections 2024-02-28T23:14:14.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.725+0000 7f3d39a00700 1 -- 172.21.15.159:0/2748082343 wait complete. 2024-02-28T23:14:14.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.726+0000 7f3d39a00700 1 Processor -- start 2024-02-28T23:14:14.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.726+0000 7f3d39a00700 1 -- start start 2024-02-28T23:14:14.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.726+0000 7f3d39a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d34100da0 0x7f3d3419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:14.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.726+0000 7f3d39a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d34101750 0x7f3d3419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:14.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.726+0000 7f3d39a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3419d170 con 0x7f3d34100da0 2024-02-28T23:14:14.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.726+0000 7f3d39a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d34196620 con 0x7f3d34101750 2024-02-28T23:14:14.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.727+0000 7f3d32a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d34100da0 0x7f3d3419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:14.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.727+0000 7f3d32a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d34100da0 0x7f3d3419c5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58008/0 (socket says 172.21.15.159:58008) 2024-02-28T23:14:14.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.727+0000 7f3d32a00700 1 -- 172.21.15.159:0/1336856475 learned_addr learned my addr 172.21.15.159:0/1336856475 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:14.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.727+0000 7f3d32000700 1 --2- 172.21.15.159:0/1336856475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d34101750 0x7f3d3419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:14.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.727+0000 7f3d32a00700 1 -- 172.21.15.159:0/1336856475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d34101750 msgr2=0x7f3d3419cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:14.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.727+0000 7f3d32a00700 1 --2- 172.21.15.159:0/1336856475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d34101750 0x7f3d3419cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:14.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.727+0000 7f3d32a00700 1 -- 172.21.15.159:0/1336856475 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d240095f0 con 0x7f3d34100da0 2024-02-28T23:14:14.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.727+0000 7f3d32a00700 1 --2- 172.21.15.159:0/1336856475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d34100da0 0x7f3d3419c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d24006010 tx=0x7f3d2400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:14.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.728+0000 7f3d2b400700 1 -- 172.21.15.159:0/1336856475 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d2401d070 con 0x7f3d34100da0 2024-02-28T23:14:14.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.728+0000 7f3d2b400700 1 -- 172.21.15.159:0/1336856475 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3d24005dc0 con 0x7f3d34100da0 2024-02-28T23:14:14.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.728+0000 7f3d39a00700 1 -- 172.21.15.159:0/1336856475 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d341968a0 con 0x7f3d34100da0 2024-02-28T23:14:14.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.728+0000 7f3d2b400700 1 -- 172.21.15.159:0/1336856475 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3d24017400 con 0x7f3d34100da0 2024-02-28T23:14:14.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.728+0000 7f3d39a00700 1 -- 172.21.15.159:0/1336856475 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d34196d90 con 0x7f3d34100da0 2024-02-28T23:14:14.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.729+0000 7f3d39a00700 1 -- 172.21.15.159:0/1336856475 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d34109140 con 0x7f3d34100da0 2024-02-28T23:14:14.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.730+0000 7f3d2b400700 1 -- 172.21.15.159:0/1336856475 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f3d24003a60 con 0x7f3d34100da0 2024-02-28T23:14:14.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.731+0000 7f3d2b400700 1 --2- 172.21.15.159:0/1336856475 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3d1806d9e0 0x7f3d1806fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:14.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.731+0000 7f3d2b400700 1 -- 172.21.15.159:0/1336856475 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3d2408ec40 con 0x7f3d34100da0 2024-02-28T23:14:14.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.731+0000 7f3d32000700 1 --2- 172.21.15.159:0/1336856475 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3d1806d9e0 0x7f3d1806fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:14.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.732+0000 7f3d32000700 1 --2- 172.21.15.159:0/1336856475 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3d1806d9e0 0x7f3d1806fea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d340fcdb0 tx=0x7f3d2000b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:14.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:14.735+0000 7f3d2b400700 1 -- 172.21.15.159:0/1336856475 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3d2405bd10 con 0x7f3d34100da0 2024-02-28T23:14:15.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.027+0000 7f3d39a00700 1 -- 172.21.15.159:0/1336856475 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3d3404ea90 con 0x7f3d34100da0 2024-02-28T23:14:15.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.028+0000 7f3d2b400700 1 -- 172.21.15.159:0/1336856475 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f3d2405b8a0 con 0x7f3d34100da0 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:14:15.027 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:14:15.028 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:14:15.028 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:14:15.028 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 10, 2024-02-28T23:14:15.028 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T23:14:15.028 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:14:15.028 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:14:15.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.032+0000 7f3d39a00700 1 -- 172.21.15.159:0/1336856475 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3d1806d9e0 msgr2=0x7f3d1806fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:15.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.032+0000 7f3d39a00700 1 --2- 172.21.15.159:0/1336856475 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3d1806d9e0 0x7f3d1806fea0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f3d340fcdb0 tx=0x7f3d2000b410 comp rx=0 tx=0).stop 2024-02-28T23:14:15.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.032+0000 7f3d39a00700 1 -- 172.21.15.159:0/1336856475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d34100da0 msgr2=0x7f3d3419c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:15.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.032+0000 7f3d39a00700 1 --2- 172.21.15.159:0/1336856475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d34100da0 0x7f3d3419c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d24006010 tx=0x7f3d2400bd70 comp rx=0 tx=0).stop 2024-02-28T23:14:15.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.032+0000 7f3d39a00700 1 -- 172.21.15.159:0/1336856475 shutdown_connections 2024-02-28T23:14:15.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.032+0000 7f3d39a00700 1 --2- 172.21.15.159:0/1336856475 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3d1806d9e0 0x7f3d1806fea0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.032+0000 7f3d39a00700 1 --2- 172.21.15.159:0/1336856475 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3d34100da0 0x7f3d3419c5a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.032+0000 7f3d39a00700 1 --2- 172.21.15.159:0/1336856475 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3d34101750 0x7f3d3419cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.032+0000 7f3d39a00700 1 -- 172.21.15.159:0/1336856475 >> 172.21.15.159:0/1336856475 conn(0x7f3d340fc630 msgr2=0x7f3d340fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:15.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.032+0000 7f3d39a00700 1 -- 172.21.15.159:0/1336856475 shutdown_connections 2024-02-28T23:14:15.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.032+0000 7f3d39a00700 1 -- 172.21.15.159:0/1336856475 wait complete. 2024-02-28T23:14:15.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.185+0000 7f0a4d600700 1 -- 172.21.15.159:0/1759046102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a48073160 msgr2=0x7f0a48073540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:15.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.185+0000 7f0a4d600700 1 --2- 172.21.15.159:0/1759046102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a48073160 0x7f0a48073540 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009910 tx=0x7f0a38009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:15.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.185+0000 7f0a4d600700 1 -- 172.21.15.159:0/1759046102 shutdown_connections 2024-02-28T23:14:15.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.185+0000 7f0a4d600700 1 --2- 172.21.15.159:0/1759046102 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a48073a80 0x7f0a4810cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.185+0000 7f0a4d600700 1 --2- 172.21.15.159:0/1759046102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a48073160 0x7f0a48073540 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.185+0000 7f0a4d600700 1 -- 172.21.15.159:0/1759046102 >> 172.21.15.159:0/1759046102 conn(0x7f0a480fc690 msgr2=0x7f0a480feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:15.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.185+0000 7f0a4d600700 1 -- 172.21.15.159:0/1759046102 shutdown_connections 2024-02-28T23:14:15.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.185+0000 7f0a4d600700 1 -- 172.21.15.159:0/1759046102 wait complete. 2024-02-28T23:14:15.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.186+0000 7f0a4d600700 1 Processor -- start 2024-02-28T23:14:15.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.186+0000 7f0a4d600700 1 -- start start 2024-02-28T23:14:15.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.186+0000 7f0a4d600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a48073160 0x7f0a4819e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:15.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.186+0000 7f0a4d600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a48073a80 0x7f0a4819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:15.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.186+0000 7f0a4d600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4819f2b0 con 0x7f0a48073160 2024-02-28T23:14:15.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.186+0000 7f0a4d600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a48198760 con 0x7f0a48073a80 2024-02-28T23:14:15.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.187+0000 7f0a46a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a48073160 0x7f0a4819e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:15.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.187+0000 7f0a46a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a48073160 0x7f0a4819e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58030/0 (socket says 172.21.15.159:58030) 2024-02-28T23:14:15.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.187+0000 7f0a46a00700 1 -- 172.21.15.159:0/2986744571 learned_addr learned my addr 172.21.15.159:0/2986744571 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:15.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.187+0000 7f0a3fe00700 1 --2- 172.21.15.159:0/2986744571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a48073a80 0x7f0a4819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:15.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.187+0000 7f0a46a00700 1 -- 172.21.15.159:0/2986744571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a48073a80 msgr2=0x7f0a4819ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:15.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.187+0000 7f0a46a00700 1 --2- 172.21.15.159:0/2986744571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a48073a80 0x7f0a4819ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.187+0000 7f0a46a00700 1 -- 172.21.15.159:0/2986744571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a380095f0 con 0x7f0a48073160 2024-02-28T23:14:15.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.188+0000 7f0a46a00700 1 --2- 172.21.15.159:0/2986744571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a48073160 0x7f0a4819e6e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a380092e0 tx=0x7f0a38005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:15.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.188+0000 7f0a3f400700 1 -- 172.21.15.159:0/2986744571 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a3801d070 con 0x7f0a48073160 2024-02-28T23:14:15.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.188+0000 7f0a3f400700 1 -- 172.21.15.159:0/2986744571 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a380052a0 con 0x7f0a48073160 2024-02-28T23:14:15.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.188+0000 7f0a3f400700 1 -- 172.21.15.159:0/2986744571 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a38022470 con 0x7f0a48073160 2024-02-28T23:14:15.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.188+0000 7f0a4d600700 1 -- 172.21.15.159:0/2986744571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a481989e0 con 0x7f0a48073160 2024-02-28T23:14:15.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.188+0000 7f0a4d600700 1 -- 172.21.15.159:0/2986744571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a48198ed0 con 0x7f0a48073160 2024-02-28T23:14:15.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.189+0000 7f0a4d600700 1 -- 172.21.15.159:0/2986744571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a4810a5e0 con 0x7f0a48073160 2024-02-28T23:14:15.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.190+0000 7f0a3f400700 1 -- 172.21.15.159:0/2986744571 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f0a38003780 con 0x7f0a48073160 2024-02-28T23:14:15.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.191+0000 7f0a3f400700 1 --2- 172.21.15.159:0/2986744571 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a2c06d9d0 0x7f0a2c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:15.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.191+0000 7f0a3f400700 1 -- 172.21.15.159:0/2986744571 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f0a3808eb90 con 0x7f0a48073160 2024-02-28T23:14:15.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.192+0000 7f0a3fe00700 1 --2- 172.21.15.159:0/2986744571 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a2c06d9d0 0x7f0a2c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:15.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.192+0000 7f0a3fe00700 1 --2- 172.21.15.159:0/2986744571 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a2c06d9d0 0x7f0a2c06fe90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0a48199bd0 tx=0x7f0a30009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:15.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.196+0000 7f0a3f400700 1 -- 172.21.15.159:0/2986744571 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0a3805bd00 con 0x7f0a48073160 2024-02-28T23:14:15.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.464+0000 7f0a4d600700 1 -- 172.21.15.159:0/2986744571 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0a4804ea90 con 0x7f0a48073160 2024-02-28T23:14:15.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:15 smithi159 ceph-mon[113833]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:15.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:15 smithi159 ceph-mon[113833]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:15.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:15 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1336856475' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:15.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.465+0000 7f0a3f400700 1 -- 172.21.15.159:0/2986744571 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f0a3805b890 con 0x7f0a48073160 2024-02-28T23:14:15.464 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:14:15.464 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:14:15.464 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:14:15.464 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:14:15.464 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:14:15.464 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:14:15.464 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:14:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:14:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:14:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:14:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:14:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:14:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:14:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:14:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:14:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:14:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:14:15.465 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:14:15.466 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:14:15.466 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:14:15.466 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:14:15.466 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:14:15.466 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:14:15.466 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:14:15.466 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:14:15.466 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:14:15.466 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:14:15.466 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:14:15.467 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:14:15.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.468+0000 7f0a4d600700 1 -- 172.21.15.159:0/2986744571 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a2c06d9d0 msgr2=0x7f0a2c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:15.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.468+0000 7f0a4d600700 1 --2- 172.21.15.159:0/2986744571 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a2c06d9d0 0x7f0a2c06fe90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f0a48199bd0 tx=0x7f0a30009260 comp rx=0 tx=0).stop 2024-02-28T23:14:15.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.468+0000 7f0a4d600700 1 -- 172.21.15.159:0/2986744571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a48073160 msgr2=0x7f0a4819e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:15.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.468+0000 7f0a4d600700 1 --2- 172.21.15.159:0/2986744571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a48073160 0x7f0a4819e6e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0a380092e0 tx=0x7f0a38005f00 comp rx=0 tx=0).stop 2024-02-28T23:14:15.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.468+0000 7f0a4d600700 1 -- 172.21.15.159:0/2986744571 shutdown_connections 2024-02-28T23:14:15.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.468+0000 7f0a4d600700 1 --2- 172.21.15.159:0/2986744571 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a2c06d9d0 0x7f0a2c06fe90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.468+0000 7f0a4d600700 1 --2- 172.21.15.159:0/2986744571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a48073160 0x7f0a4819e6e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.468+0000 7f0a4d600700 1 --2- 172.21.15.159:0/2986744571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a48073a80 0x7f0a4819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.468+0000 7f0a4d600700 1 -- 172.21.15.159:0/2986744571 >> 172.21.15.159:0/2986744571 conn(0x7f0a480fc690 msgr2=0x7f0a48107720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:15.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.468+0000 7f0a4d600700 1 -- 172.21.15.159:0/2986744571 shutdown_connections 2024-02-28T23:14:15.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.469+0000 7f0a4d600700 1 -- 172.21.15.159:0/2986744571 wait complete. 2024-02-28T23:14:15.469 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:14:15.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:15 smithi184 ceph-mon[86482]: from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:15.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:15 smithi184 ceph-mon[86482]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:15.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:15 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1336856475' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:15.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.628+0000 7fd471c00700 1 -- 172.21.15.159:0/3342893849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c075be0 msgr2=0x7fd46c1114e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:15.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.628+0000 7fd471c00700 1 --2- 172.21.15.159:0/3342893849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c075be0 0x7fd46c1114e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd458009910 tx=0x7fd458009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:15.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.628+0000 7fd471c00700 1 -- 172.21.15.159:0/3342893849 shutdown_connections 2024-02-28T23:14:15.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.628+0000 7fd471c00700 1 --2- 172.21.15.159:0/3342893849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c075be0 0x7fd46c1114e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.628+0000 7fd471c00700 1 --2- 172.21.15.159:0/3342893849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c0752c0 0x7fd46c0756a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.628+0000 7fd471c00700 1 -- 172.21.15.159:0/3342893849 >> 172.21.15.159:0/3342893849 conn(0x7fd46c0fe870 msgr2=0x7fd46c100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:15.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.628+0000 7fd471c00700 1 -- 172.21.15.159:0/3342893849 shutdown_connections 2024-02-28T23:14:15.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.628+0000 7fd471c00700 1 -- 172.21.15.159:0/3342893849 wait complete. 2024-02-28T23:14:15.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.629+0000 7fd471c00700 1 Processor -- start 2024-02-28T23:14:15.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.629+0000 7fd471c00700 1 -- start start 2024-02-28T23:14:15.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.630+0000 7fd471c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c0752c0 0x7fd46c19ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:15.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.630+0000 7fd471c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c075be0 0x7fd46c19d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:15.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.630+0000 7fd471c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c19d890 con 0x7fd46c075be0 2024-02-28T23:14:15.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.630+0000 7fd471c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd46c1a05c0 con 0x7fd46c0752c0 2024-02-28T23:14:15.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.630+0000 7fd46a000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c075be0 0x7fd46c19d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:15.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.630+0000 7fd46a000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c075be0 0x7fd46c19d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58044/0 (socket says 172.21.15.159:58044) 2024-02-28T23:14:15.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.630+0000 7fd46a000700 1 -- 172.21.15.159:0/1750238831 learned_addr learned my addr 172.21.15.159:0/1750238831 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:15.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.630+0000 7fd46aa00700 1 --2- 172.21.15.159:0/1750238831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c0752c0 0x7fd46c19ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:15.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.630+0000 7fd46a000700 1 -- 172.21.15.159:0/1750238831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c0752c0 msgr2=0x7fd46c19ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:15.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.630+0000 7fd46a000700 1 --2- 172.21.15.159:0/1750238831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c0752c0 0x7fd46c19ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.630+0000 7fd46a000700 1 -- 172.21.15.159:0/1750238831 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580095f0 con 0x7fd46c075be0 2024-02-28T23:14:15.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.631+0000 7fd46a000700 1 --2- 172.21.15.159:0/1750238831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c075be0 0x7fd46c19d200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd458006010 tx=0x7fd4580055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:15.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.631+0000 7fd463400700 1 -- 172.21.15.159:0/1750238831 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd45801d070 con 0x7fd46c075be0 2024-02-28T23:14:15.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.631+0000 7fd463400700 1 -- 172.21.15.159:0/1750238831 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd458005dc0 con 0x7fd46c075be0 2024-02-28T23:14:15.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.631+0000 7fd463400700 1 -- 172.21.15.159:0/1750238831 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd458021410 con 0x7fd46c075be0 2024-02-28T23:14:15.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.631+0000 7fd471c00700 1 -- 172.21.15.159:0/1750238831 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd46c1a08a0 con 0x7fd46c075be0 2024-02-28T23:14:15.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.631+0000 7fd471c00700 1 -- 172.21.15.159:0/1750238831 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd46c1a0da0 con 0x7fd46c075be0 2024-02-28T23:14:15.631 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.633+0000 7fd471c00700 1 -- 172.21.15.159:0/1750238831 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46c10ec50 con 0x7fd46c075be0 2024-02-28T23:14:15.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.634+0000 7fd463400700 1 -- 172.21.15.159:0/1750238831 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7fd45800f6d0 con 0x7fd46c075be0 2024-02-28T23:14:15.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.635+0000 7fd463400700 1 --2- 172.21.15.159:0/1750238831 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd45006d9d0 0x7fd45006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:15.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.635+0000 7fd463400700 1 -- 172.21.15.159:0/1750238831 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd45808e9f0 con 0x7fd46c075be0 2024-02-28T23:14:15.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.635+0000 7fd46aa00700 1 --2- 172.21.15.159:0/1750238831 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd45006d9d0 0x7fd45006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:15.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.636+0000 7fd46aa00700 1 --2- 172.21.15.159:0/1750238831 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd45006d9d0 0x7fd45006fe90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd45c007be0 tx=0x7fd45c0073d0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:15.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.640+0000 7fd463400700 1 -- 172.21.15.159:0/1750238831 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd458057f90 con 0x7fd46c075be0 2024-02-28T23:14:15.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.882+0000 7fd471c00700 1 -- 172.21.15.159:0/1750238831 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd46c1a1080 con 0x7fd45006d9d0 2024-02-28T23:14:15.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.884+0000 7fd463400700 1 -- 172.21.15.159:0/1750238831 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fd46c1a1080 con 0x7fd45006d9d0 2024-02-28T23:14:15.882 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:14:15.882 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:14:15.882 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:14:15.882 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:14:15.882 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:14:15.882 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:14:15.883 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:14:15.883 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:14:15.883 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "4/23 daemons upgraded", 2024-02-28T23:14:15.883 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading crash daemons", 2024-02-28T23:14:15.883 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:14:15.883 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:14:15.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.886+0000 7fd471c00700 1 -- 172.21.15.159:0/1750238831 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd45006d9d0 msgr2=0x7fd45006fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:15.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.886+0000 7fd471c00700 1 --2- 172.21.15.159:0/1750238831 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd45006d9d0 0x7fd45006fe90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd45c007be0 tx=0x7fd45c0073d0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.886+0000 7fd471c00700 1 -- 172.21.15.159:0/1750238831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c075be0 msgr2=0x7fd46c19d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:15.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.886+0000 7fd471c00700 1 --2- 172.21.15.159:0/1750238831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c075be0 0x7fd46c19d200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd458006010 tx=0x7fd4580055f0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.886+0000 7fd471c00700 1 -- 172.21.15.159:0/1750238831 shutdown_connections 2024-02-28T23:14:15.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.886+0000 7fd471c00700 1 --2- 172.21.15.159:0/1750238831 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd46c0752c0 0x7fd46c19ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.887+0000 7fd471c00700 1 --2- 172.21.15.159:0/1750238831 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd45006d9d0 0x7fd45006fe90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.887+0000 7fd471c00700 1 --2- 172.21.15.159:0/1750238831 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd46c075be0 0x7fd46c19d200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:15.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.887+0000 7fd471c00700 1 -- 172.21.15.159:0/1750238831 >> 172.21.15.159:0/1750238831 conn(0x7fd46c0fe870 msgr2=0x7fd46c0ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:15.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.887+0000 7fd471c00700 1 -- 172.21.15.159:0/1750238831 shutdown_connections 2024-02-28T23:14:15.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:15.887+0000 7fd471c00700 1 -- 172.21.15.159:0/1750238831 wait complete. 2024-02-28T23:14:16.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.042+0000 7f4f4b600700 1 -- 172.21.15.159:0/1616799673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f44073ae0 msgr2=0x7f4f4410ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:16.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.042+0000 7f4f4b600700 1 --2- 172.21.15.159:0/1616799673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f44073ae0 0x7f4f4410ce40 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009910 tx=0x7f4f30009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:16.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.042+0000 7f4f4b600700 1 -- 172.21.15.159:0/1616799673 shutdown_connections 2024-02-28T23:14:16.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.042+0000 7f4f4b600700 1 --2- 172.21.15.159:0/1616799673 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f44073ae0 0x7f4f4410ce40 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:16.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.042+0000 7f4f4b600700 1 --2- 172.21.15.159:0/1616799673 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f440731c0 0x7f4f440735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:16.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.042+0000 7f4f4b600700 1 -- 172.21.15.159:0/1616799673 >> 172.21.15.159:0/1616799673 conn(0x7f4f440fc630 msgr2=0x7f4f440fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:16.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.042+0000 7f4f4b600700 1 -- 172.21.15.159:0/1616799673 shutdown_connections 2024-02-28T23:14:16.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.042+0000 7f4f4b600700 1 -- 172.21.15.159:0/1616799673 wait complete. 2024-02-28T23:14:16.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.044+0000 7f4f4b600700 1 Processor -- start 2024-02-28T23:14:16.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.044+0000 7f4f4b600700 1 -- start start 2024-02-28T23:14:16.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.044+0000 7f4f4b600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f440731c0 0x7f4f44198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:16.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.044+0000 7f4f4b600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f44073ae0 0x7f4f44198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:16.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.044+0000 7f4f4b600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f44199530 con 0x7f4f44073ae0 2024-02-28T23:14:16.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.044+0000 7f4f4b600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4419d340 con 0x7f4f440731c0 2024-02-28T23:14:16.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.045+0000 7f4f43e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f44073ae0 0x7f4f44198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:16.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.045+0000 7f4f43e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f44073ae0 0x7f4f44198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58056/0 (socket says 172.21.15.159:58056) 2024-02-28T23:14:16.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.045+0000 7f4f43e00700 1 -- 172.21.15.159:0/800300492 learned_addr learned my addr 172.21.15.159:0/800300492 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:16.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.045+0000 7f4f48c00700 1 --2- 172.21.15.159:0/800300492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f440731c0 0x7f4f44198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:16.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.045+0000 7f4f43e00700 1 -- 172.21.15.159:0/800300492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f440731c0 msgr2=0x7f4f44198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:16.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.045+0000 7f4f43e00700 1 --2- 172.21.15.159:0/800300492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f440731c0 0x7f4f44198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:16.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.045+0000 7f4f43e00700 1 -- 172.21.15.159:0/800300492 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300095f0 con 0x7f4f44073ae0 2024-02-28T23:14:16.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.045+0000 7f4f43e00700 1 --2- 172.21.15.159:0/800300492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f44073ae0 0x7f4f44198ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4f300092e0 tx=0x7f4f3000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:16.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.046+0000 7f4f41600700 1 -- 172.21.15.159:0/800300492 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f3001d070 con 0x7f4f44073ae0 2024-02-28T23:14:16.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.046+0000 7f4f41600700 1 -- 172.21.15.159:0/800300492 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4f3000f460 con 0x7f4f44073ae0 2024-02-28T23:14:16.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.046+0000 7f4f4b600700 1 -- 172.21.15.159:0/800300492 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4419d5c0 con 0x7f4f44073ae0 2024-02-28T23:14:16.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.046+0000 7f4f41600700 1 -- 172.21.15.159:0/800300492 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f30017630 con 0x7f4f44073ae0 2024-02-28T23:14:16.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.046+0000 7f4f4b600700 1 -- 172.21.15.159:0/800300492 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4419dab0 con 0x7f4f44073ae0 2024-02-28T23:14:16.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.047+0000 7f4f4b600700 1 -- 172.21.15.159:0/800300492 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4410a540 con 0x7f4f44073ae0 2024-02-28T23:14:16.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.048+0000 7f4f41600700 1 -- 172.21.15.159:0/800300492 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 38) v1 ==== 91589+0+0 (secure 0 0 0) 0x7f4f3000f5d0 con 0x7f4f44073ae0 2024-02-28T23:14:16.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.049+0000 7f4f41600700 1 --2- 172.21.15.159:0/800300492 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4f2c06d9d0 0x7f4f2c06fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:16.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.049+0000 7f4f41600700 1 -- 172.21.15.159:0/800300492 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4f3008ecf0 con 0x7f4f44073ae0 2024-02-28T23:14:16.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.050+0000 7f4f48c00700 1 --2- 172.21.15.159:0/800300492 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4f2c06d9d0 0x7f4f2c06fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:16.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.050+0000 7f4f48c00700 1 --2- 172.21.15.159:0/800300492 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4f2c06d9d0 0x7f4f2c06fe90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4f38005fd0 tx=0x7f4f3800a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:16.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.054+0000 7f4f41600700 1 -- 172.21.15.159:0/800300492 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4f3005be60 con 0x7f4f44073ae0 2024-02-28T23:14:16.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.350+0000 7f4f4b600700 1 -- 172.21.15.159:0/800300492 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4f4404ea90 con 0x7f4f44073ae0 2024-02-28T23:14:16.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.351+0000 7f4f41600700 1 -- 172.21.15.159:0/800300492 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4f3005b9f0 con 0x7f4f44073ae0 2024-02-28T23:14:16.349 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_OK 2024-02-28T23:14:16.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.353+0000 7f4f4b600700 1 -- 172.21.15.159:0/800300492 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4f2c06d9d0 msgr2=0x7f4f2c06fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:16.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.353+0000 7f4f4b600700 1 --2- 172.21.15.159:0/800300492 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4f2c06d9d0 0x7f4f2c06fe90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4f38005fd0 tx=0x7f4f3800a560 comp rx=0 tx=0).stop 2024-02-28T23:14:16.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.353+0000 7f4f4b600700 1 -- 172.21.15.159:0/800300492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f44073ae0 msgr2=0x7f4f44198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:16.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.353+0000 7f4f4b600700 1 --2- 172.21.15.159:0/800300492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f44073ae0 0x7f4f44198ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4f300092e0 tx=0x7f4f3000be00 comp rx=0 tx=0).stop 2024-02-28T23:14:16.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.354+0000 7f4f4b600700 1 -- 172.21.15.159:0/800300492 shutdown_connections 2024-02-28T23:14:16.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.354+0000 7f4f4b600700 1 --2- 172.21.15.159:0/800300492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4f440731c0 0x7f4f44198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:16.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.354+0000 7f4f4b600700 1 --2- 172.21.15.159:0/800300492 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4f2c06d9d0 0x7f4f2c06fe90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:16.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.354+0000 7f4f4b600700 1 --2- 172.21.15.159:0/800300492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f44073ae0 0x7f4f44198ea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:16.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.354+0000 7f4f4b600700 1 -- 172.21.15.159:0/800300492 >> 172.21.15.159:0/800300492 conn(0x7f4f440fc630 msgr2=0x7f4f44107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:16.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.354+0000 7f4f4b600700 1 -- 172.21.15.159:0/800300492 shutdown_connections 2024-02-28T23:14:16.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:16.354+0000 7f4f4b600700 1 -- 172.21.15.159:0/800300492 wait complete. 2024-02-28T23:14:16.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:16 smithi159 ceph-mon[113833]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:16.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:16 smithi159 ceph-mon[113833]: pgmap v44: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:16.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:16 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2986744571' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:14:16.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:16.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T23:14:16.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:16.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:16 smithi184 ceph-mon[86482]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:16.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:16 smithi184 ceph-mon[86482]: pgmap v44: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:16.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:16 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2986744571' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:14:16.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:16.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi159", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T23:14:16.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:17.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:17 smithi159 ceph-mon[113833]: Upgrade: Updating crash.smithi159 (1/2) 2024-02-28T23:14:17.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:17 smithi159 ceph-mon[113833]: Deploying daemon crash.smithi159 on smithi159 2024-02-28T23:14:17.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:17 smithi159 ceph-mon[113833]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:17.346 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:17 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/800300492' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:14:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:17 smithi184 ceph-mon[86482]: Upgrade: Updating crash.smithi159 (1/2) 2024-02-28T23:14:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:17 smithi184 ceph-mon[86482]: Deploying daemon crash.smithi159 on smithi159 2024-02-28T23:14:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:17 smithi184 ceph-mon[86482]: from='client.34206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:17 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/800300492' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:14:18.411 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:18 smithi159 ceph-mon[113833]: pgmap v45: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:18 smithi184 ceph-mon[86482]: pgmap v45: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:20.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:20 smithi184 ceph-mon[86482]: pgmap v46: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:20.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:20 smithi159 ceph-mon[113833]: pgmap v46: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:22.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:21 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:22.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:21 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:22.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:21 smithi159 ceph-mon[113833]: pgmap v47: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:22.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:21 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:22.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:21 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:22.243 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:21 smithi184 ceph-mon[86482]: pgmap v47: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:24.404 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:24 smithi159 ceph-mon[113833]: pgmap v48: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:24.404 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:24 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:14:24.404 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:24 smithi159 ceph-mon[113833]: Upgrade: Updating crash.smithi184 (2/2) 2024-02-28T23:14:24.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:24 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:24.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:24 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T23:14:24.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:24 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:24.405 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:24 smithi159 ceph-mon[113833]: Deploying daemon crash.smithi184 on smithi184 2024-02-28T23:14:24.467 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:24 smithi184 ceph-mon[86482]: pgmap v48: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:24.467 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:24 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:14:24.467 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:24 smithi184 ceph-mon[86482]: Upgrade: Updating crash.smithi184 (2/2) 2024-02-28T23:14:24.467 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:24 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:24.467 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:24 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi184", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-02-28T23:14:24.467 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:24 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:24.467 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:24 smithi184 ceph-mon[86482]: Deploying daemon crash.smithi184 on smithi184 2024-02-28T23:14:26.443 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:26 smithi184 ceph-mon[86482]: pgmap v49: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-28T23:14:26.443 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:26 smithi184 ceph-mon[86482]: mgrmap e39: smithi159.pobewk(active, since 92s), standbys: smithi184.quvmnx 2024-02-28T23:14:26.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:26 smithi159 ceph-mon[113833]: pgmap v49: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-28T23:14:26.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:26 smithi159 ceph-mon[113833]: mgrmap e39: smithi159.pobewk(active, since 92s), standbys: smithi184.quvmnx 2024-02-28T23:14:28.356 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:28 smithi184 ceph-mon[86482]: pgmap v50: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-02-28T23:14:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:28 smithi159 ceph-mon[113833]: pgmap v50: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 255 B/s wr, 1 op/s 2024-02-28T23:14:29.819 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:29.819 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:29.819 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:14:29.819 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:29 smithi184 ceph-mon[86482]: pgmap v51: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-28T23:14:29.893 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:29.893 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:29.893 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:14:29.893 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:29 smithi159 ceph-mon[113833]: pgmap v51: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-28T23:14:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:32 smithi159 ceph-mon[113833]: pgmap v52: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-02-28T23:14:32.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:32 smithi184 ceph-mon[86482]: pgmap v52: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-02-28T23:14:34.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:33 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:34.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:33 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:34.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:33 smithi159 ceph-mon[113833]: pgmap v53: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-02-28T23:14:34.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:33 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:34.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:33 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:34.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:33 smithi184 ceph-mon[86482]: pgmap v53: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 255 B/s wr, 1 op/s 2024-02-28T23:14:36.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:36 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:36.320 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:36 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:36.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:36 smithi184 ceph-mon[86482]: pgmap v54: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-28T23:14:36.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:36 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:36.321 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:36 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:36 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:36 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:36 smithi159 ceph-mon[113833]: pgmap v54: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 255 B/s wr, 2 op/s 2024-02-28T23:14:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:36 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:36 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:38.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:38 smithi184 ceph-mon[86482]: pgmap v55: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-02-28T23:14:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:38.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:14:38.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:38 smithi159 ceph-mon[113833]: pgmap v55: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s 2024-02-28T23:14:38.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:38.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:38.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:14:40.400 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:40 smithi159 ceph-mon[113833]: pgmap v56: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T23:14:40.505 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:40 smithi184 ceph-mon[86482]: pgmap v56: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T23:14:41.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:41 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:41.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:41 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:41.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:41 smithi159 ceph-mon[113833]: pgmap v57: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:42.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:41 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:42.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:41 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:42.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:41 smithi184 ceph-mon[86482]: pgmap v57: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:44.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: pgmap v58: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]: dispatch 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]': finished 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi184"}]: dispatch 2024-02-28T23:14:44.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi184"}]': finished 2024-02-28T23:14:44.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T23:14:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: pgmap v58: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:14:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:14:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:44.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]: dispatch 2024-02-28T23:14:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi159"}]': finished 2024-02-28T23:14:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi184"}]: dispatch 2024-02-28T23:14:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi184"}]': finished 2024-02-28T23:14:44.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T23:14:45.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:45 smithi159 ceph-mon[113833]: Upgrade: Setting container_image for all crash 2024-02-28T23:14:45.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:45 smithi159 ceph-mon[113833]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T23:14:45.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:45 smithi159 ceph-mon[113833]: Upgrade: osd.0 is safe to restart 2024-02-28T23:14:45.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:45 smithi184 ceph-mon[86482]: Upgrade: Setting container_image for all crash 2024-02-28T23:14:45.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:45 smithi184 ceph-mon[86482]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-28T23:14:45.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:45 smithi184 ceph-mon[86482]: Upgrade: osd.0 is safe to restart 2024-02-28T23:14:46.278 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:46 smithi184 ceph-mon[86482]: pgmap v59: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:46.278 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:46 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:46.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:46 smithi159 ceph-mon[113833]: pgmap v59: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:46.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:46 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:46.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.515+0000 7f4c50800700 1 -- 172.21.15.159:0/3329966846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480731c0 msgr2=0x7f4c480735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:46.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.515+0000 7f4c50800700 1 --2- 172.21.15.159:0/3329966846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480731c0 0x7f4c480735a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c009910 tx=0x7f4c3c009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:46.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.515+0000 7f4c50800700 1 -- 172.21.15.159:0/3329966846 shutdown_connections 2024-02-28T23:14:46.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.515+0000 7f4c50800700 1 --2- 172.21.15.159:0/3329966846 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c48073ae0 0x7f4c4810ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:46.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.515+0000 7f4c50800700 1 --2- 172.21.15.159:0/3329966846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480731c0 0x7f4c480735a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:46.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.516+0000 7f4c50800700 1 -- 172.21.15.159:0/3329966846 >> 172.21.15.159:0/3329966846 conn(0x7f4c480fc630 msgr2=0x7f4c480fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:46.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.516+0000 7f4c50800700 1 -- 172.21.15.159:0/3329966846 shutdown_connections 2024-02-28T23:14:46.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.516+0000 7f4c50800700 1 -- 172.21.15.159:0/3329966846 wait complete. 2024-02-28T23:14:46.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.517+0000 7f4c50800700 1 Processor -- start 2024-02-28T23:14:46.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.517+0000 7f4c50800700 1 -- start start 2024-02-28T23:14:46.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.517+0000 7f4c50800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480731c0 0x7f4c48198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:46.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.517+0000 7f4c50800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c48073ae0 0x7f4c48198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:46.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.517+0000 7f4c50800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c48199520 con 0x7f4c480731c0 2024-02-28T23:14:46.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.517+0000 7f4c50800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4819d330 con 0x7f4c48073ae0 2024-02-28T23:14:46.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.518+0000 7f4c4de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480731c0 0x7f4c48198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:46.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.518+0000 7f4c4de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480731c0 0x7f4c48198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52998/0 (socket says 172.21.15.159:52998) 2024-02-28T23:14:46.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.518+0000 7f4c4de00700 1 -- 172.21.15.159:0/507941648 learned_addr learned my addr 172.21.15.159:0/507941648 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:46.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.518+0000 7f4c4d400700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c48073ae0 0x7f4c48198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.518+0000 7f4c4de00700 1 -- 172.21.15.159:0/507941648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c48073ae0 msgr2=0x7f4c48198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.518+0000 7f4c4de00700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c48073ae0 0x7f4c48198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.518+0000 7f4c4de00700 1 -- 172.21.15.159:0/507941648 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c0095f0 con 0x7f4c480731c0 2024-02-28T23:14:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.518+0000 7f4c4d400700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c48073ae0 0x7f4c48198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:14:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.518+0000 7f4c4de00700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480731c0 0x7f4c48198950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0092e0 tx=0x7f4c3c00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.519+0000 7f4c42a00700 1 -- 172.21.15.159:0/507941648 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c3c01d070 con 0x7f4c480731c0 2024-02-28T23:14:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.519+0000 7f4c42a00700 1 -- 172.21.15.159:0/507941648 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c3c00f460 con 0x7f4c480731c0 2024-02-28T23:14:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.519+0000 7f4c42a00700 1 -- 172.21.15.159:0/507941648 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c3c017630 con 0x7f4c480731c0 2024-02-28T23:14:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.519+0000 7f4c50800700 1 -- 172.21.15.159:0/507941648 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4819d5b0 con 0x7f4c480731c0 2024-02-28T23:14:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.519+0000 7f4c50800700 1 -- 172.21.15.159:0/507941648 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4819daa0 con 0x7f4c480731c0 2024-02-28T23:14:46.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.520+0000 7f4c50800700 1 -- 172.21.15.159:0/507941648 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4810a540 con 0x7f4c480731c0 2024-02-28T23:14:46.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.521+0000 7f4c42a00700 1 -- 172.21.15.159:0/507941648 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4c3c00f5d0 con 0x7f4c480731c0 2024-02-28T23:14:46.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.523+0000 7f4c42a00700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c3006d8a0 0x7f4c3006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:46.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.523+0000 7f4c42a00700 1 -- 172.21.15.159:0/507941648 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4c3c08ea40 con 0x7f4c480731c0 2024-02-28T23:14:46.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.523+0000 7f4c4d400700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c3006d8a0 0x7f4c3006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:46.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.524+0000 7f4c4d400700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c3006d8a0 0x7f4c3006fd60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4c38005fd0 tx=0x7f4c38005dc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:46.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.528+0000 7f4c42a00700 1 -- 172.21.15.159:0/507941648 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4c3c05bdb0 con 0x7f4c480731c0 2024-02-28T23:14:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.768+0000 7f4c50800700 1 -- 172.21.15.159:0/507941648 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c4819dd80 con 0x7f4c3006d8a0 2024-02-28T23:14:46.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.772+0000 7f4c42a00700 1 -- 172.21.15.159:0/507941648 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f4c4819dd80 con 0x7f4c3006d8a0 2024-02-28T23:14:46.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.774+0000 7f4c50800700 1 -- 172.21.15.159:0/507941648 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c3006d8a0 msgr2=0x7f4c3006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:46.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.774+0000 7f4c50800700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c3006d8a0 0x7f4c3006fd60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4c38005fd0 tx=0x7f4c38005dc0 comp rx=0 tx=0).stop 2024-02-28T23:14:46.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.774+0000 7f4c50800700 1 -- 172.21.15.159:0/507941648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480731c0 msgr2=0x7f4c48198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:46.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.774+0000 7f4c50800700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480731c0 0x7f4c48198950 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c0092e0 tx=0x7f4c3c00be00 comp rx=0 tx=0).stop 2024-02-28T23:14:46.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.775+0000 7f4c50800700 1 -- 172.21.15.159:0/507941648 shutdown_connections 2024-02-28T23:14:46.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.775+0000 7f4c50800700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c3006d8a0 0x7f4c3006fd60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:46.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.775+0000 7f4c50800700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c480731c0 0x7f4c48198950 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:46.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.775+0000 7f4c50800700 1 --2- 172.21.15.159:0/507941648 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c48073ae0 0x7f4c48198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:46.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.775+0000 7f4c50800700 1 -- 172.21.15.159:0/507941648 >> 172.21.15.159:0/507941648 conn(0x7f4c480fc630 msgr2=0x7f4c48107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:46.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.775+0000 7f4c50800700 1 -- 172.21.15.159:0/507941648 shutdown_connections 2024-02-28T23:14:46.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.775+0000 7f4c50800700 1 -- 172.21.15.159:0/507941648 wait complete. 2024-02-28T23:14:46.790 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:14:46.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.930+0000 7ff28ba00700 1 -- 172.21.15.159:0/2876283304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff284100da0 msgr2=0x7ff284101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:46.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.930+0000 7ff28ba00700 1 --2- 172.21.15.159:0/2876283304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff284100da0 0x7ff284101180 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff278009910 tx=0x7ff278009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:46.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.930+0000 7ff28ba00700 1 -- 172.21.15.159:0/2876283304 shutdown_connections 2024-02-28T23:14:46.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.930+0000 7ff28ba00700 1 --2- 172.21.15.159:0/2876283304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff284101750 0x7ff2841057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:46.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.930+0000 7ff28ba00700 1 --2- 172.21.15.159:0/2876283304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff284100da0 0x7ff284101180 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:46.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.930+0000 7ff28ba00700 1 -- 172.21.15.159:0/2876283304 >> 172.21.15.159:0/2876283304 conn(0x7ff2840fc630 msgr2=0x7ff2840fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:46.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.930+0000 7ff28ba00700 1 -- 172.21.15.159:0/2876283304 shutdown_connections 2024-02-28T23:14:46.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.930+0000 7ff28ba00700 1 -- 172.21.15.159:0/2876283304 wait complete. 2024-02-28T23:14:46.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.931+0000 7ff28ba00700 1 Processor -- start 2024-02-28T23:14:46.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.931+0000 7ff28ba00700 1 -- start start 2024-02-28T23:14:46.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff28ba00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff284100da0 0x7ff28419c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:46.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff28ba00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff284101750 0x7ff28419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:46.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff28ba00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28419d170 con 0x7ff284101750 2024-02-28T23:14:46.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff28ba00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff284196620 con 0x7ff284100da0 2024-02-28T23:14:46.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff283e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff284101750 0x7ff28419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:46.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff283e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff284101750 0x7ff28419cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53018/0 (socket says 172.21.15.159:53018) 2024-02-28T23:14:46.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff283e00700 1 -- 172.21.15.159:0/1188480910 learned_addr learned my addr 172.21.15.159:0/1188480910 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff289000700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff284100da0 0x7ff28419c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff283e00700 1 -- 172.21.15.159:0/1188480910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff284100da0 msgr2=0x7ff28419c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff283e00700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff284100da0 0x7ff28419c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff283e00700 1 -- 172.21.15.159:0/1188480910 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780095f0 con 0x7ff284101750 2024-02-28T23:14:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.932+0000 7ff289000700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff284100da0 0x7ff28419c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:14:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.933+0000 7ff283e00700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff284101750 0x7ff28419cae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff27000d900 tx=0x7ff27000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.933+0000 7ff281600700 1 -- 172.21.15.159:0/1188480910 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff270009900 con 0x7ff284101750 2024-02-28T23:14:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.933+0000 7ff281600700 1 -- 172.21.15.159:0/1188480910 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff270010460 con 0x7ff284101750 2024-02-28T23:14:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.933+0000 7ff281600700 1 -- 172.21.15.159:0/1188480910 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff27000f5f0 con 0x7ff284101750 2024-02-28T23:14:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.933+0000 7ff28ba00700 1 -- 172.21.15.159:0/1188480910 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff284196900 con 0x7ff284101750 2024-02-28T23:14:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.933+0000 7ff28ba00700 1 -- 172.21.15.159:0/1188480910 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff284196e50 con 0x7ff284101750 2024-02-28T23:14:46.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.935+0000 7ff28ba00700 1 -- 172.21.15.159:0/1188480910 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff284109140 con 0x7ff284101750 2024-02-28T23:14:46.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.936+0000 7ff281600700 1 -- 172.21.15.159:0/1188480910 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ff2700105d0 con 0x7ff284101750 2024-02-28T23:14:46.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.937+0000 7ff281600700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff26c06d8a0 0x7ff26c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:46.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.937+0000 7ff281600700 1 -- 172.21.15.159:0/1188480910 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7ff27008d240 con 0x7ff284101750 2024-02-28T23:14:46.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.937+0000 7ff289000700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff26c06d8a0 0x7ff26c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:46.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.938+0000 7ff289000700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff26c06d8a0 0x7ff26c06fd60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff278005b40 tx=0x7ff27801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:46.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:46.943+0000 7ff281600700 1 -- 172.21.15.159:0/1188480910 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff27005a650 con 0x7ff284101750 2024-02-28T23:14:47.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.183+0000 7ff28ba00700 1 -- 172.21.15.159:0/1188480910 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff284197110 con 0x7ff26c06d8a0 2024-02-28T23:14:47.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.185+0000 7ff281600700 1 -- 172.21.15.159:0/1188480910 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff284197110 con 0x7ff26c06d8a0 2024-02-28T23:14:47.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.187+0000 7ff28ba00700 1 -- 172.21.15.159:0/1188480910 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff26c06d8a0 msgr2=0x7ff26c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:47.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.187+0000 7ff28ba00700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff26c06d8a0 0x7ff26c06fd60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff278005b40 tx=0x7ff27801a040 comp rx=0 tx=0).stop 2024-02-28T23:14:47.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.188+0000 7ff28ba00700 1 -- 172.21.15.159:0/1188480910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff284101750 msgr2=0x7ff28419cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:47.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.188+0000 7ff28ba00700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff284101750 0x7ff28419cae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff27000d900 tx=0x7ff27000dcc0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.188+0000 7ff28ba00700 1 -- 172.21.15.159:0/1188480910 shutdown_connections 2024-02-28T23:14:47.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.188+0000 7ff28ba00700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff284100da0 0x7ff28419c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.188+0000 7ff28ba00700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff26c06d8a0 0x7ff26c06fd60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.188+0000 7ff28ba00700 1 --2- 172.21.15.159:0/1188480910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff284101750 0x7ff28419cae0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.188+0000 7ff28ba00700 1 -- 172.21.15.159:0/1188480910 >> 172.21.15.159:0/1188480910 conn(0x7ff2840fc630 msgr2=0x7ff2840fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:47.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.188+0000 7ff28ba00700 1 -- 172.21.15.159:0/1188480910 shutdown_connections 2024-02-28T23:14:47.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.188+0000 7ff28ba00700 1 -- 172.21.15.159:0/1188480910 wait complete. 2024-02-28T23:14:47.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:47 smithi159 ceph-mon[113833]: Upgrade: Updating osd.0 2024-02-28T23:14:47.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:47 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T23:14:47.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:47 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:47.340 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:47 smithi159 ceph-mon[113833]: Deploying daemon osd.0 on smithi159 2024-02-28T23:14:47.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.346+0000 7f4a7be00700 1 -- 172.21.15.159:0/2002737784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a7c073a80 msgr2=0x7f4a7c10cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:47.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.346+0000 7f4a7be00700 1 --2- 172.21.15.159:0/2002737784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a7c073a80 0x7f4a7c10cd20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4a68009910 tx=0x7f4a68009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:47.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.347+0000 7f4a7be00700 1 -- 172.21.15.159:0/2002737784 shutdown_connections 2024-02-28T23:14:47.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.347+0000 7f4a7be00700 1 --2- 172.21.15.159:0/2002737784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a7c073a80 0x7f4a7c10cd20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.347+0000 7f4a7be00700 1 --2- 172.21.15.159:0/2002737784 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a7c073160 0x7f4a7c073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.347+0000 7f4a7be00700 1 -- 172.21.15.159:0/2002737784 >> 172.21.15.159:0/2002737784 conn(0x7f4a7c0fc4d0 msgr2=0x7f4a7c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:47.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.347+0000 7f4a7be00700 1 -- 172.21.15.159:0/2002737784 shutdown_connections 2024-02-28T23:14:47.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.347+0000 7f4a7be00700 1 -- 172.21.15.159:0/2002737784 wait complete. 2024-02-28T23:14:47.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.348+0000 7f4a7be00700 1 Processor -- start 2024-02-28T23:14:47.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.349+0000 7f4a7be00700 1 -- start start 2024-02-28T23:14:47.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.349+0000 7f4a7be00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a7c073160 0x7f4a7c105570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:47.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.349+0000 7f4a7be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a7c073a80 0x7f4a7c105ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:47.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.349+0000 7f4a7be00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c106190 con 0x7f4a7c073a80 2024-02-28T23:14:47.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.349+0000 7f4a7be00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c1af270 con 0x7f4a7c073160 2024-02-28T23:14:47.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.349+0000 7f4a7a000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a7c073a80 0x7f4a7c105ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:47.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.350+0000 7f4a7a000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a7c073a80 0x7f4a7c105ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53044/0 (socket says 172.21.15.159:53044) 2024-02-28T23:14:47.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.350+0000 7f4a7a000700 1 -- 172.21.15.159:0/4285161112 learned_addr learned my addr 172.21.15.159:0/4285161112 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:47.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.350+0000 7f4a7aa00700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a7c073160 0x7f4a7c105570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:47.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.350+0000 7f4a7a000700 1 -- 172.21.15.159:0/4285161112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a7c073160 msgr2=0x7f4a7c105570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:47.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.350+0000 7f4a7a000700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a7c073160 0x7f4a7c105570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.350+0000 7f4a7a000700 1 -- 172.21.15.159:0/4285161112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a680095f0 con 0x7f4a7c073a80 2024-02-28T23:14:47.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.350+0000 7f4a7aa00700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a7c073160 0x7f4a7c105570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:14:47.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.351+0000 7f4a7a000700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a7c073a80 0x7f4a7c105ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4a68006010 tx=0x7f4a6800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:47.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.351+0000 7f4a80a00700 1 -- 172.21.15.159:0/4285161112 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a6801d070 con 0x7f4a7c073a80 2024-02-28T23:14:47.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.351+0000 7f4a80a00700 1 -- 172.21.15.159:0/4285161112 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4a68004fb0 con 0x7f4a7c073a80 2024-02-28T23:14:47.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.351+0000 7f4a80a00700 1 -- 172.21.15.159:0/4285161112 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4a6800f480 con 0x7f4a7c073a80 2024-02-28T23:14:47.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.351+0000 7f4a7be00700 1 -- 172.21.15.159:0/4285161112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7c1af410 con 0x7f4a7c073a80 2024-02-28T23:14:47.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.351+0000 7f4a7be00700 1 -- 172.21.15.159:0/4285161112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7c1af8a0 con 0x7f4a7c073a80 2024-02-28T23:14:47.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.353+0000 7f4a7be00700 1 -- 172.21.15.159:0/4285161112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a7c114410 con 0x7f4a7c073a80 2024-02-28T23:14:47.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.353+0000 7f4a80a00700 1 -- 172.21.15.159:0/4285161112 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4a68022890 con 0x7f4a7c073a80 2024-02-28T23:14:47.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.355+0000 7f4a80a00700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4a6006d8a0 0x7f4a6006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:47.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.355+0000 7f4a80a00700 1 -- 172.21.15.159:0/4285161112 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f4a6808eee0 con 0x7f4a7c073a80 2024-02-28T23:14:47.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.355+0000 7f4a7aa00700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4a6006d8a0 0x7f4a6006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:47.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.356+0000 7f4a7aa00700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4a6006d8a0 0x7f4a6006fd60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0099d0 tx=0x7f4a6c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:47.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.360+0000 7f4a80a00700 1 -- 172.21.15.159:0/4285161112 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4a6805c420 con 0x7f4a7c073a80 2024-02-28T23:14:47.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.593+0000 7f4a7be00700 1 -- 172.21.15.159:0/4285161112 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a7c0611d0 con 0x7f4a6006d8a0 2024-02-28T23:14:47.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:47 smithi184 ceph-mon[86482]: Upgrade: Updating osd.0 2024-02-28T23:14:47.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:47 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-28T23:14:47.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:47 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:14:47.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:47 smithi184 ceph-mon[86482]: Deploying daemon osd.0 on smithi159 2024-02-28T23:14:47.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.605+0000 7f4a80a00700 1 -- 172.21.15.159:0/4285161112 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f4a7c0611d0 con 0x7f4a6006d8a0 2024-02-28T23:14:47.603 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:14:47.603 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (4m) 11s ago 18m 13.8M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (18m) 11s ago 18m 8506k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (17m) 14s ago 17m 8108k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (27s) 11s ago 18m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (19s) 14s ago 17m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (3m) 11s ago 18m 74.5M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (11m) 11s ago 11m 148M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (11m) 11s ago 11m 87.0M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (11m) 14s ago 11m 17.6M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (11m) 14s ago 11m 17.5M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (7m) 11s ago 20m 496M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (5m) 14s ago 17m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (2m) 11s ago 20m 44.1M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (88s) 14s ago 17m 32.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:14:47.604 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (5m) 11s ago 18m 7772k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:14:47.605 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (5m) 14s ago 17m 8174k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:14:47.605 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (16m) 11s ago 16m 236M 1217M 18.2.1 5be31c24972a 803162b68228 2024-02-28T23:14:47.605 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (15m) 11s ago 15m 250M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:14:47.605 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (14m) 11s ago 14m 212M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:14:47.605 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (14m) 14s ago 14m 300M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:14:47.605 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (13m) 14s ago 13m 251M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:14:47.605 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (13m) 14s ago 13m 230M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:14:47.605 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (4m) 11s ago 17m 55.5M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:14:47.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.607+0000 7f4a7be00700 1 -- 172.21.15.159:0/4285161112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4a6006d8a0 msgr2=0x7f4a6006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:47.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.607+0000 7f4a7be00700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4a6006d8a0 0x7f4a6006fd60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c0099d0 tx=0x7f4a6c008040 comp rx=0 tx=0).stop 2024-02-28T23:14:47.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.607+0000 7f4a7be00700 1 -- 172.21.15.159:0/4285161112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a7c073a80 msgr2=0x7f4a7c105ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:47.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.607+0000 7f4a7be00700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a7c073a80 0x7f4a7c105ab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4a68006010 tx=0x7f4a6800be20 comp rx=0 tx=0).stop 2024-02-28T23:14:47.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.607+0000 7f4a7be00700 1 -- 172.21.15.159:0/4285161112 shutdown_connections 2024-02-28T23:14:47.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.607+0000 7f4a7be00700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4a7c073160 0x7f4a7c105570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.607+0000 7f4a7be00700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4a6006d8a0 0x7f4a6006fd60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.607+0000 7f4a7be00700 1 --2- 172.21.15.159:0/4285161112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4a7c073a80 0x7f4a7c105ab0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.607+0000 7f4a7be00700 1 -- 172.21.15.159:0/4285161112 >> 172.21.15.159:0/4285161112 conn(0x7f4a7c0fc4d0 msgr2=0x7f4a7c111550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:47.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.608+0000 7f4a7be00700 1 -- 172.21.15.159:0/4285161112 shutdown_connections 2024-02-28T23:14:47.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.608+0000 7f4a7be00700 1 -- 172.21.15.159:0/4285161112 wait complete. 2024-02-28T23:14:47.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.760+0000 7f5624800700 1 -- 172.21.15.159:0/3369950371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f561c101dc0 msgr2=0x7f561c1021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:47.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.760+0000 7f5624800700 1 --2- 172.21.15.159:0/3369950371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f561c101dc0 0x7f561c1021a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5610009910 tx=0x7f5610009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:47.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.761+0000 7f5624800700 1 -- 172.21.15.159:0/3369950371 shutdown_connections 2024-02-28T23:14:47.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.761+0000 7f5624800700 1 --2- 172.21.15.159:0/3369950371 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f561c1026e0 0x7f561c10abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.761+0000 7f5624800700 1 --2- 172.21.15.159:0/3369950371 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f561c101dc0 0x7f561c1021a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.761+0000 7f5624800700 1 -- 172.21.15.159:0/3369950371 >> 172.21.15.159:0/3369950371 conn(0x7f561c0fb570 msgr2=0x7f561c0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:47.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.761+0000 7f5624800700 1 -- 172.21.15.159:0/3369950371 shutdown_connections 2024-02-28T23:14:47.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.761+0000 7f5624800700 1 -- 172.21.15.159:0/3369950371 wait complete. 2024-02-28T23:14:47.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.762+0000 7f5624800700 1 Processor -- start 2024-02-28T23:14:47.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.762+0000 7f5624800700 1 -- start start 2024-02-28T23:14:47.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.762+0000 7f5624800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f561c101dc0 0x7f561c19e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:47.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.762+0000 7f5624800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f561c1026e0 0x7f561c19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:47.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.762+0000 7f5624800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c19f3d0 con 0x7f561c1026e0 2024-02-28T23:14:47.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.762+0000 7f5624800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f561c198880 con 0x7f561c101dc0 2024-02-28T23:14:47.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.763+0000 7f5621400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f561c1026e0 0x7f561c19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:47.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.763+0000 7f5621400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f561c1026e0 0x7f561c19ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53056/0 (socket says 172.21.15.159:53056) 2024-02-28T23:14:47.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.763+0000 7f5621400700 1 -- 172.21.15.159:0/1130965669 learned_addr learned my addr 172.21.15.159:0/1130965669 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:47.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.763+0000 7f5621e00700 1 --2- 172.21.15.159:0/1130965669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f561c101dc0 0x7f561c19e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:47.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.763+0000 7f5621400700 1 -- 172.21.15.159:0/1130965669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f561c101dc0 msgr2=0x7f561c19e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:47.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.763+0000 7f5621400700 1 --2- 172.21.15.159:0/1130965669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f561c101dc0 0x7f561c19e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:47.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.763+0000 7f5621400700 1 -- 172.21.15.159:0/1130965669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56100095f0 con 0x7f561c1026e0 2024-02-28T23:14:47.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.764+0000 7f5621400700 1 --2- 172.21.15.159:0/1130965669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f561c1026e0 0x7f561c19ed40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f560c00b480 tx=0x7f560c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:47.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.764+0000 7f5616a00700 1 -- 172.21.15.159:0/1130965669 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560c0118c0 con 0x7f561c1026e0 2024-02-28T23:14:47.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.764+0000 7f5616a00700 1 -- 172.21.15.159:0/1130965669 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f560c010380 con 0x7f561c1026e0 2024-02-28T23:14:47.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.764+0000 7f5616a00700 1 -- 172.21.15.159:0/1130965669 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f560c00f4f0 con 0x7f561c1026e0 2024-02-28T23:14:47.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.764+0000 7f5624800700 1 -- 172.21.15.159:0/1130965669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f561c198b60 con 0x7f561c1026e0 2024-02-28T23:14:47.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.764+0000 7f5624800700 1 -- 172.21.15.159:0/1130965669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561c199060 con 0x7f561c1026e0 2024-02-28T23:14:47.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.766+0000 7f5624800700 1 -- 172.21.15.159:0/1130965669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f561c10a730 con 0x7f561c1026e0 2024-02-28T23:14:47.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.767+0000 7f5616a00700 1 -- 172.21.15.159:0/1130965669 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f560c0104f0 con 0x7f561c1026e0 2024-02-28T23:14:47.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.768+0000 7f5616a00700 1 --2- 172.21.15.159:0/1130965669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f560406d8a0 0x7f560406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:47.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.768+0000 7f5616a00700 1 -- 172.21.15.159:0/1130965669 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f560c08d120 con 0x7f561c1026e0 2024-02-28T23:14:47.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.768+0000 7f5621e00700 1 --2- 172.21.15.159:0/1130965669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f560406d8a0 0x7f560406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:47.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.769+0000 7f5621e00700 1 --2- 172.21.15.159:0/1130965669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f560406d8a0 0x7f560406fd60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5610006010 tx=0x7f561001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:47.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:47.773+0000 7f5616a00700 1 -- 172.21.15.159:0/1130965669 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f560c05a450 con 0x7f561c1026e0 2024-02-28T23:14:48.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.087+0000 7f5624800700 1 -- 172.21.15.159:0/1130965669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f561c04ea90 con 0x7f561c1026e0 2024-02-28T23:14:48.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.088+0000 7f5616a00700 1 -- 172.21.15.159:0/1130965669 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+688 (secure 0 0 0) 0x7f560c059fe0 con 0x7f561c1026e0 2024-02-28T23:14:48.087 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:14:48.087 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:14:48.087 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:14:48.087 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 10, 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T23:14:48.088 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:14:48.089 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:14:48.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.091+0000 7f5624800700 1 -- 172.21.15.159:0/1130965669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f560406d8a0 msgr2=0x7f560406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:48.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.091+0000 7f5624800700 1 --2- 172.21.15.159:0/1130965669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f560406d8a0 0x7f560406fd60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5610006010 tx=0x7f561001a040 comp rx=0 tx=0).stop 2024-02-28T23:14:48.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.091+0000 7f5624800700 1 -- 172.21.15.159:0/1130965669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f561c1026e0 msgr2=0x7f561c19ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:48.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.091+0000 7f5624800700 1 --2- 172.21.15.159:0/1130965669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f561c1026e0 0x7f561c19ed40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f560c00b480 tx=0x7f560c00b840 comp rx=0 tx=0).stop 2024-02-28T23:14:48.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.091+0000 7f5624800700 1 -- 172.21.15.159:0/1130965669 shutdown_connections 2024-02-28T23:14:48.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.091+0000 7f5624800700 1 --2- 172.21.15.159:0/1130965669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f561c101dc0 0x7f561c19e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.091+0000 7f5624800700 1 --2- 172.21.15.159:0/1130965669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f560406d8a0 0x7f560406fd60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.091+0000 7f5624800700 1 --2- 172.21.15.159:0/1130965669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f561c1026e0 0x7f561c19ed40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.091+0000 7f5624800700 1 -- 172.21.15.159:0/1130965669 >> 172.21.15.159:0/1130965669 conn(0x7f561c0fb570 msgr2=0x7f561c1001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:48.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.092+0000 7f5624800700 1 -- 172.21.15.159:0/1130965669 shutdown_connections 2024-02-28T23:14:48.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.092+0000 7f5624800700 1 -- 172.21.15.159:0/1130965669 wait complete. 2024-02-28T23:14:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.233+0000 7fd53d800700 1 -- 172.21.15.159:0/3903410646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5381039a0 msgr2=0x7fd5381079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.233+0000 7fd53d800700 1 --2- 172.21.15.159:0/3903410646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5381039a0 0x7fd5381079f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd524009910 tx=0x7fd524009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.234+0000 7fd53d800700 1 -- 172.21.15.159:0/3903410646 shutdown_connections 2024-02-28T23:14:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.234+0000 7fd53d800700 1 --2- 172.21.15.159:0/3903410646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd5381039a0 0x7fd5381079f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.234+0000 7fd53d800700 1 --2- 172.21.15.159:0/3903410646 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd538102ff0 0x7fd5381033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.234+0000 7fd53d800700 1 -- 172.21.15.159:0/3903410646 >> 172.21.15.159:0/3903410646 conn(0x7fd5380fe880 msgr2=0x7fd538100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:48.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.234+0000 7fd53d800700 1 -- 172.21.15.159:0/3903410646 shutdown_connections 2024-02-28T23:14:48.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.234+0000 7fd53d800700 1 -- 172.21.15.159:0/3903410646 wait complete. 2024-02-28T23:14:48.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.235+0000 7fd53d800700 1 Processor -- start 2024-02-28T23:14:48.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.235+0000 7fd53d800700 1 -- start start 2024-02-28T23:14:48.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.235+0000 7fd53d800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd538102ff0 0x7fd5381989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:48.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.235+0000 7fd53d800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5381039a0 0x7fd538198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:48.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.235+0000 7fd53d800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd538199570 con 0x7fd538102ff0 2024-02-28T23:14:48.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.235+0000 7fd53d800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53819d380 con 0x7fd5381039a0 2024-02-28T23:14:48.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.236+0000 7fd536a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd538102ff0 0x7fd5381989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:48.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.236+0000 7fd536a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd538102ff0 0x7fd5381989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35126/0 (socket says 172.21.15.159:35126) 2024-02-28T23:14:48.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.236+0000 7fd536a00700 1 -- 172.21.15.159:0/1735019683 learned_addr learned my addr 172.21.15.159:0/1735019683 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:48.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.236+0000 7fd536000700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5381039a0 0x7fd538198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:48.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.236+0000 7fd536a00700 1 -- 172.21.15.159:0/1735019683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5381039a0 msgr2=0x7fd538198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:48.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.236+0000 7fd536a00700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5381039a0 0x7fd538198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.236+0000 7fd536a00700 1 -- 172.21.15.159:0/1735019683 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240095f0 con 0x7fd538102ff0 2024-02-28T23:14:48.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.236+0000 7fd536000700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5381039a0 0x7fd538198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:14:48.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.236+0000 7fd536a00700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd538102ff0 0x7fd5381989a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd52800c8a0 tx=0x7fd52800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:48.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.237+0000 7fd52f400700 1 -- 172.21.15.159:0/1735019683 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd52800cea0 con 0x7fd538102ff0 2024-02-28T23:14:48.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.237+0000 7fd52f400700 1 -- 172.21.15.159:0/1735019683 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd528004830 con 0x7fd538102ff0 2024-02-28T23:14:48.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.237+0000 7fd53d800700 1 -- 172.21.15.159:0/1735019683 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53819d660 con 0x7fd538102ff0 2024-02-28T23:14:48.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.237+0000 7fd52f400700 1 -- 172.21.15.159:0/1735019683 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd5280055b0 con 0x7fd538102ff0 2024-02-28T23:14:48.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.237+0000 7fd53d800700 1 -- 172.21.15.159:0/1735019683 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53819dbb0 con 0x7fd538102ff0 2024-02-28T23:14:48.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.238+0000 7fd53d800700 1 -- 172.21.15.159:0/1735019683 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53810b3f0 con 0x7fd538102ff0 2024-02-28T23:14:48.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.239+0000 7fd52f400700 1 -- 172.21.15.159:0/1735019683 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd5280049a0 con 0x7fd538102ff0 2024-02-28T23:14:48.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.240+0000 7fd52f400700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd51c06d8a0 0x7fd51c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:48.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.240+0000 7fd52f400700 1 -- 172.21.15.159:0/1735019683 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7fd52808d080 con 0x7fd538102ff0 2024-02-28T23:14:48.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.240+0000 7fd536000700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd51c06d8a0 0x7fd51c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:48.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.241+0000 7fd536000700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd51c06d8a0 0x7fd51c06fd60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd5240059d0 tx=0x7fd524005960 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:48.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.244+0000 7fd52f400700 1 -- 172.21.15.159:0/1735019683 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd52805a490 con 0x7fd538102ff0 2024-02-28T23:14:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:48 smithi159 ceph-mon[113833]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:48 smithi159 ceph-mon[113833]: pgmap v60: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:48 smithi159 ceph-mon[113833]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:48 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1130965669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:48.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.500+0000 7fd53d800700 1 -- 172.21.15.159:0/1735019683 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd53804ea90 con 0x7fd538102ff0 2024-02-28T23:14:48.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.501+0000 7fd52f400700 1 -- 172.21.15.159:0/1735019683 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1879 (secure 0 0 0) 0x7fd52801d070 con 0x7fd538102ff0 2024-02-28T23:14:48.500 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:14:48.500 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:14:48.500 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:14:48.500 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:14:48.500 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:14:48.501 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:14:48.502 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:14:48.503 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:14:48.503 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:14:48.503 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:14:48.503 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:14:48.503 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:14:48.503 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:14:48.503 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:14:48.503 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:14:48.503 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:14:48.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.505+0000 7fd53d800700 1 -- 172.21.15.159:0/1735019683 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd51c06d8a0 msgr2=0x7fd51c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:48.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.505+0000 7fd53d800700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd51c06d8a0 0x7fd51c06fd60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd5240059d0 tx=0x7fd524005960 comp rx=0 tx=0).stop 2024-02-28T23:14:48.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.505+0000 7fd53d800700 1 -- 172.21.15.159:0/1735019683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd538102ff0 msgr2=0x7fd5381989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:48.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.505+0000 7fd53d800700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd538102ff0 0x7fd5381989a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd52800c8a0 tx=0x7fd52800cc60 comp rx=0 tx=0).stop 2024-02-28T23:14:48.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.505+0000 7fd53d800700 1 -- 172.21.15.159:0/1735019683 shutdown_connections 2024-02-28T23:14:48.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.505+0000 7fd53d800700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd51c06d8a0 0x7fd51c06fd60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.505+0000 7fd53d800700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd538102ff0 0x7fd5381989a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.505+0000 7fd53d800700 1 --2- 172.21.15.159:0/1735019683 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd5381039a0 0x7fd538198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.505+0000 7fd53d800700 1 -- 172.21.15.159:0/1735019683 >> 172.21.15.159:0/1735019683 conn(0x7fd5380fe880 msgr2=0x7fd538100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:48.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.506+0000 7fd53d800700 1 -- 172.21.15.159:0/1735019683 shutdown_connections 2024-02-28T23:14:48.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.506+0000 7fd53d800700 1 -- 172.21.15.159:0/1735019683 wait complete. 2024-02-28T23:14:48.506 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:14:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:48 smithi184 ceph-mon[86482]: from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:48 smithi184 ceph-mon[86482]: pgmap v60: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:48 smithi184 ceph-mon[86482]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:48 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1130965669' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:14:48.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.653+0000 7f1e04e00700 1 -- 172.21.15.159:0/3084009246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e00100da0 msgr2=0x7f1e00101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:48.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.653+0000 7f1e04e00700 1 --2- 172.21.15.159:0/3084009246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e00100da0 0x7f1e00101180 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1df0009910 tx=0x7f1df0009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:48.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.653+0000 7f1e04e00700 1 -- 172.21.15.159:0/3084009246 shutdown_connections 2024-02-28T23:14:48.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.653+0000 7f1e04e00700 1 --2- 172.21.15.159:0/3084009246 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e00101750 0x7f1e001057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.653+0000 7f1e04e00700 1 --2- 172.21.15.159:0/3084009246 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e00100da0 0x7f1e00101180 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.653+0000 7f1e04e00700 1 -- 172.21.15.159:0/3084009246 >> 172.21.15.159:0/3084009246 conn(0x7f1e000fc630 msgr2=0x7f1e000fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:48.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.653+0000 7f1e04e00700 1 -- 172.21.15.159:0/3084009246 shutdown_connections 2024-02-28T23:14:48.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.653+0000 7f1e04e00700 1 -- 172.21.15.159:0/3084009246 wait complete. 2024-02-28T23:14:48.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.654+0000 7f1e04e00700 1 Processor -- start 2024-02-28T23:14:48.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.654+0000 7f1e04e00700 1 -- start start 2024-02-28T23:14:48.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.655+0000 7f1e04e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e00100da0 0x7f1e00198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:48.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.655+0000 7f1e04e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e00101750 0x7f1e00198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:48.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.655+0000 7f1e04e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e00199560 con 0x7f1e00101750 2024-02-28T23:14:48.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.655+0000 7f1e04e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0019d370 con 0x7f1e00100da0 2024-02-28T23:14:48.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.655+0000 7f1dfd400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e00101750 0x7f1e00198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:48.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.655+0000 7f1dfd400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e00101750 0x7f1e00198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35150/0 (socket says 172.21.15.159:35150) 2024-02-28T23:14:48.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.655+0000 7f1dfd400700 1 -- 172.21.15.159:0/3671070743 learned_addr learned my addr 172.21.15.159:0/3671070743 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:48.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.655+0000 7f1dfde00700 1 --2- 172.21.15.159:0/3671070743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e00100da0 0x7f1e00198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:48.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.656+0000 7f1dfd400700 1 -- 172.21.15.159:0/3671070743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e00100da0 msgr2=0x7f1e00198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:48.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.656+0000 7f1dfd400700 1 --2- 172.21.15.159:0/3671070743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e00100da0 0x7f1e00198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.656+0000 7f1dfd400700 1 -- 172.21.15.159:0/3671070743 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1df00095f0 con 0x7f1e00101750 2024-02-28T23:14:48.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.656+0000 7f1dfd400700 1 --2- 172.21.15.159:0/3671070743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e00101750 0x7f1e00198ed0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00d900 tx=0x7f1dec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:48.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.656+0000 7f1df6a00700 1 -- 172.21.15.159:0/3671070743 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dec009900 con 0x7f1e00101750 2024-02-28T23:14:48.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.656+0000 7f1df6a00700 1 -- 172.21.15.159:0/3671070743 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1dec010460 con 0x7f1e00101750 2024-02-28T23:14:48.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.656+0000 7f1df6a00700 1 -- 172.21.15.159:0/3671070743 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1dec00f5f0 con 0x7f1e00101750 2024-02-28T23:14:48.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.657+0000 7f1e04e00700 1 -- 172.21.15.159:0/3671070743 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0019d650 con 0x7f1e00101750 2024-02-28T23:14:48.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.657+0000 7f1e04e00700 1 -- 172.21.15.159:0/3671070743 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0019db50 con 0x7f1e00101750 2024-02-28T23:14:48.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.658+0000 7f1e04e00700 1 -- 172.21.15.159:0/3671070743 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e00104f20 con 0x7f1e00101750 2024-02-28T23:14:48.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.659+0000 7f1df6a00700 1 -- 172.21.15.159:0/3671070743 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f1dec0105d0 con 0x7f1e00101750 2024-02-28T23:14:48.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.660+0000 7f1df6a00700 1 --2- 172.21.15.159:0/3671070743 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1de406d8a0 0x7f1de406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:48.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.660+0000 7f1df6a00700 1 -- 172.21.15.159:0/3671070743 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f1dec08d170 con 0x7f1e00101750 2024-02-28T23:14:48.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.661+0000 7f1dfde00700 1 --2- 172.21.15.159:0/3671070743 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1de406d8a0 0x7f1de406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:48.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.662+0000 7f1dfde00700 1 --2- 172.21.15.159:0/3671070743 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1de406d8a0 0x7f1de406fd60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1df0006010 tx=0x7f1df001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:48.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.665+0000 7f1df6a00700 1 -- 172.21.15.159:0/3671070743 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1dec05a460 con 0x7f1e00101750 2024-02-28T23:14:48.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.908+0000 7f1e04e00700 1 -- 172.21.15.159:0/3671070743 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e0019de30 con 0x7f1de406d8a0 2024-02-28T23:14:48.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.911+0000 7f1df6a00700 1 -- 172.21.15.159:0/3671070743 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1e0019de30 con 0x7f1de406d8a0 2024-02-28T23:14:48.909 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "6/23 daemons upgraded", 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:14:48.910 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:14:48.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.913+0000 7f1e04e00700 1 -- 172.21.15.159:0/3671070743 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1de406d8a0 msgr2=0x7f1de406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:48.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.913+0000 7f1e04e00700 1 --2- 172.21.15.159:0/3671070743 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1de406d8a0 0x7f1de406fd60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1df0006010 tx=0x7f1df001a040 comp rx=0 tx=0).stop 2024-02-28T23:14:48.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.913+0000 7f1e04e00700 1 -- 172.21.15.159:0/3671070743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e00101750 msgr2=0x7f1e00198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:48.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.913+0000 7f1e04e00700 1 --2- 172.21.15.159:0/3671070743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e00101750 0x7f1e00198ed0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1dec00d900 tx=0x7f1dec00dcc0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.913+0000 7f1e04e00700 1 -- 172.21.15.159:0/3671070743 shutdown_connections 2024-02-28T23:14:48.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.913+0000 7f1e04e00700 1 --2- 172.21.15.159:0/3671070743 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1e00100da0 0x7f1e00198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.913+0000 7f1e04e00700 1 --2- 172.21.15.159:0/3671070743 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1de406d8a0 0x7f1de406fd60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.913+0000 7f1e04e00700 1 --2- 172.21.15.159:0/3671070743 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e00101750 0x7f1e00198ed0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:48.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.913+0000 7f1e04e00700 1 -- 172.21.15.159:0/3671070743 >> 172.21.15.159:0/3671070743 conn(0x7f1e000fc630 msgr2=0x7f1e000fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:48.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.914+0000 7f1e04e00700 1 -- 172.21.15.159:0/3671070743 shutdown_connections 2024-02-28T23:14:48.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:48.914+0000 7f1e04e00700 1 -- 172.21.15.159:0/3671070743 wait complete. 2024-02-28T23:14:49.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.062+0000 7f3f0f400700 1 -- 172.21.15.159:0/403799579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08103000 msgr2=0x7f3f081033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:49.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.062+0000 7f3f0f400700 1 --2- 172.21.15.159:0/403799579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08103000 0x7f3f081033e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009910 tx=0x7f3efc009c20 comp rx=0 tx=0).stop 2024-02-28T23:14:49.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.062+0000 7f3f0f400700 1 -- 172.21.15.159:0/403799579 shutdown_connections 2024-02-28T23:14:49.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.062+0000 7f3f0f400700 1 --2- 172.21.15.159:0/403799579 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f081039b0 0x7f3f08107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:49.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.062+0000 7f3f0f400700 1 --2- 172.21.15.159:0/403799579 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08103000 0x7f3f081033e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:49.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.062+0000 7f3f0f400700 1 -- 172.21.15.159:0/403799579 >> 172.21.15.159:0/403799579 conn(0x7f3f080fe8d0 msgr2=0x7f3f08100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:49.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.063+0000 7f3f0f400700 1 -- 172.21.15.159:0/403799579 shutdown_connections 2024-02-28T23:14:49.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.063+0000 7f3f0f400700 1 -- 172.21.15.159:0/403799579 wait complete. 2024-02-28T23:14:49.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.064+0000 7f3f0f400700 1 Processor -- start 2024-02-28T23:14:49.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.064+0000 7f3f0f400700 1 -- start start 2024-02-28T23:14:49.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.064+0000 7f3f0f400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08103000 0x7f3f0819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:49.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.064+0000 7f3f0f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f081039b0 0x7f3f0819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:49.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.064+0000 7f3f0f400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0819f3e0 con 0x7f3f081039b0 2024-02-28T23:14:49.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.064+0000 7f3f0f400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f08198890 con 0x7f3f08103000 2024-02-28T23:14:49.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.064+0000 7f3f07e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f081039b0 0x7f3f0819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:49.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.064+0000 7f3f07e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f081039b0 0x7f3f0819ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35174/0 (socket says 172.21.15.159:35174) 2024-02-28T23:14:49.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.064+0000 7f3f07e00700 1 -- 172.21.15.159:0/364308984 learned_addr learned my addr 172.21.15.159:0/364308984 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:14:49.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.065+0000 7f3f0ca00700 1 --2- 172.21.15.159:0/364308984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08103000 0x7f3f0819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:49.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.065+0000 7f3f07e00700 1 -- 172.21.15.159:0/364308984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08103000 msgr2=0x7f3f0819e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:49.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.065+0000 7f3f07e00700 1 --2- 172.21.15.159:0/364308984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08103000 0x7f3f0819e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:49.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.065+0000 7f3f07e00700 1 -- 172.21.15.159:0/364308984 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0095f0 con 0x7f3f081039b0 2024-02-28T23:14:49.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.065+0000 7f3f07e00700 1 --2- 172.21.15.159:0/364308984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f081039b0 0x7f3f0819ed50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400d8d0 tx=0x7f3ef400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.065+0000 7f3f05600700 1 -- 172.21.15.159:0/364308984 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef4004a00 con 0x7f3f081039b0 2024-02-28T23:14:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.065+0000 7f3f05600700 1 -- 172.21.15.159:0/364308984 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3ef40054e0 con 0x7f3f081039b0 2024-02-28T23:14:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.065+0000 7f3f0f400700 1 -- 172.21.15.159:0/364308984 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f08198b70 con 0x7f3f081039b0 2024-02-28T23:14:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.065+0000 7f3f05600700 1 -- 172.21.15.159:0/364308984 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ef4009d40 con 0x7f3f081039b0 2024-02-28T23:14:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.066+0000 7f3f0f400700 1 -- 172.21.15.159:0/364308984 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f081990c0 con 0x7f3f081039b0 2024-02-28T23:14:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.067+0000 7f3f0f400700 1 -- 172.21.15.159:0/364308984 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0810b3a0 con 0x7f3f081039b0 2024-02-28T23:14:49.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.068+0000 7f3f05600700 1 -- 172.21.15.159:0/364308984 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f3ef4005020 con 0x7f3f081039b0 2024-02-28T23:14:49.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.068+0000 7f3f05600700 1 --2- 172.21.15.159:0/364308984 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 0x7f3ef006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:14:49.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.068+0000 7f3f05600700 1 -- 172.21.15.159:0/364308984 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6414+0+0 (secure 0 0 0) 0x7f3ef408ce10 con 0x7f3f081039b0 2024-02-28T23:14:49.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.069+0000 7f3f0ca00700 1 --2- 172.21.15.159:0/364308984 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 0x7f3ef006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:14:49.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.069+0000 7f3f0ca00700 1 --2- 172.21.15.159:0/364308984 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 0x7f3ef006fd60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3efc006010 tx=0x7f3efc00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:14:49.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.073+0000 7f3f05600700 1 -- 172.21.15.159:0/364308984 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3ef405a100 con 0x7f3f081039b0 2024-02-28T23:14:49.365 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:49 smithi159 ceph-mon[113833]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:49.366 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:49 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1735019683' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:14:49.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.382+0000 7f3f0f400700 1 -- 172.21.15.159:0/364308984 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3f0804ea90 con 0x7f3f081039b0 2024-02-28T23:14:49.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.383+0000 7f3f05600700 1 -- 172.21.15.159:0/364308984 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f3ef4017020 con 0x7f3f081039b0 2024-02-28T23:14:49.382 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_OK 2024-02-28T23:14:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.386+0000 7f3f0f400700 1 -- 172.21.15.159:0/364308984 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 msgr2=0x7f3ef006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.386+0000 7f3f0f400700 1 --2- 172.21.15.159:0/364308984 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 0x7f3ef006fd60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3efc006010 tx=0x7f3efc00b540 comp rx=0 tx=0).stop 2024-02-28T23:14:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.386+0000 7f3f0f400700 1 -- 172.21.15.159:0/364308984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f081039b0 msgr2=0x7f3f0819ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:14:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.386+0000 7f3f0f400700 1 --2- 172.21.15.159:0/364308984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f081039b0 0x7f3f0819ed50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400d8d0 tx=0x7f3ef400dc90 comp rx=0 tx=0).stop 2024-02-28T23:14:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.386+0000 7f3f0f400700 1 -- 172.21.15.159:0/364308984 shutdown_connections 2024-02-28T23:14:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.386+0000 7f3f0f400700 1 --2- 172.21.15.159:0/364308984 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08103000 0x7f3f0819e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.386+0000 7f3f0f400700 1 --2- 172.21.15.159:0/364308984 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 0x7f3ef006fd60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.386+0000 7f3f0f400700 1 --2- 172.21.15.159:0/364308984 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f081039b0 0x7f3f0819ed50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:14:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.386+0000 7f3f0f400700 1 -- 172.21.15.159:0/364308984 >> 172.21.15.159:0/364308984 conn(0x7f3f080fe8d0 msgr2=0x7f3f080ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:14:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.387+0000 7f3f0f400700 1 -- 172.21.15.159:0/364308984 shutdown_connections 2024-02-28T23:14:49.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:14:49.387+0000 7f3f0f400700 1 -- 172.21.15.159:0/364308984 wait complete. 2024-02-28T23:14:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:49 smithi184 ceph-mon[86482]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:49.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:49 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1735019683' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:14:50.362 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:50 smithi159 ceph-mon[113833]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:50.362 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:50 smithi159 ceph-mon[113833]: pgmap v61: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:50.362 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:50 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/364308984' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:14:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:50 smithi184 ceph-mon[86482]: from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:14:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:50 smithi184 ceph-mon[86482]: pgmap v61: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:14:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:50 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/364308984' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:14:51.472 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:51 smithi159 systemd[1]: Stopping Ceph osd.0 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:14:51.973 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:51 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0[47510]: 2024-02-28T23:14:51.624+0000 7f0946000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:14:51.973 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:51 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0[47510]: 2024-02-28T23:14:51.624+0000 7f0946000700 -1 osd.0 49 *** Got signal Terminated *** 2024-02-28T23:14:51.973 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:51 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0[47510]: 2024-02-28T23:14:51.624+0000 7f0946000700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:14:52.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:52 smithi159 ceph-mon[113833]: pgmap v62: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:52.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:52 smithi159 ceph-mon[113833]: osd.0 marked itself down and dead 2024-02-28T23:14:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:52 smithi184 ceph-mon[86482]: pgmap v62: 65 pgs: 65 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:14:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:52 smithi184 ceph-mon[86482]: osd.0 marked itself down and dead 2024-02-28T23:14:53.139 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:52 smithi159 podman[125259]: 2024-02-28 23:14:52.859973228 +0000 UTC m=+1.401029271 container died 803162b68228e63ca3d94814cc346d8a903b67233dc52e578bd05b63de41f672 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.29.1, org.label-schema.build-date=20240222) 2024-02-28T23:14:53.472 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:53 smithi159 podman[125259]: 2024-02-28 23:14:53.267904106 +0000 UTC m=+1.808960123 container cleanup 803162b68228e63ca3d94814cc346d8a903b67233dc52e578bd05b63de41f672 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.29.1, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, ceph=True, org.label-schema.build-date=20240222) 2024-02-28T23:14:53.472 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:53 smithi159 bash[125259]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0 2024-02-28T23:14:53.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:14:53.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: osdmap e50: 6 total, 5 up, 6 in 2024-02-28T23:14:53.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 2]}]: dispatch 2024-02-28T23:14:53.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]: dispatch 2024-02-28T23:14:53.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 0]}]: dispatch 2024-02-28T23:14:53.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 5]}]: dispatch 2024-02-28T23:14:53.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 2]}]: dispatch 2024-02-28T23:14:53.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 2]}]: dispatch 2024-02-28T23:14:53.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 5]}]: dispatch 2024-02-28T23:14:53.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]}]: dispatch 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [1, 0]}]: dispatch 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 2]}]': finished 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]': finished 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 0]}]': finished 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 5]}]': finished 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 2]}]': finished 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 2]}]': finished 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 5]}]': finished 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]}]': finished 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [1, 0]}]': finished 2024-02-28T23:14:53.474 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:53 smithi159 ceph-mon[113833]: osdmap e51: 6 total, 5 up, 6 in 2024-02-28T23:14:53.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:14:53.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: osdmap e50: 6 total, 5 up, 6 in 2024-02-28T23:14:53.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 2]}]: dispatch 2024-02-28T23:14:53.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]: dispatch 2024-02-28T23:14:53.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 0]}]: dispatch 2024-02-28T23:14:53.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 5]}]: dispatch 2024-02-28T23:14:53.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 2]}]: dispatch 2024-02-28T23:14:53.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 2]}]: dispatch 2024-02-28T23:14:53.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 5]}]: dispatch 2024-02-28T23:14:53.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]}]: dispatch 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [1, 0]}]: dispatch 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [3, 2]}]': finished 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [3, 0]}]': finished 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.7", "id": [3, 0]}]': finished 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 5]}]': finished 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2", "id": [3, 2]}]': finished 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.b", "id": [1, 2]}]': finished 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 5]}]': finished 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1c", "id": [4, 0]}]': finished 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [1, 0]}]': finished 2024-02-28T23:14:53.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:53 smithi184 ceph-mon[86482]: osdmap e51: 6 total, 5 up, 6 in 2024-02-28T23:14:53.972 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:53 smithi159 podman[125277]: 2024-02-28 23:14:53.536008108 +0000 UTC m=+0.659572023 container remove 803162b68228e63ca3d94814cc346d8a903b67233dc52e578bd05b63de41f672 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=-18.2.1, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-02-28T23:14:54.492 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:54 smithi159 ceph-mon[113833]: pgmap v64: 65 pgs: 9 stale+active+clean, 56 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-02-28T23:14:54.493 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:54 smithi159 ceph-mon[113833]: osdmap e52: 6 total, 5 up, 6 in 2024-02-28T23:14:54.493 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:54 smithi159 podman[125361]: 2024-02-28 23:14:54.214484759 +0000 UTC m=+0.036371401 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:14:54.493 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:54 smithi159 podman[125361]: 2024-02-28 23:14:54.345293569 +0000 UTC m=+0.167180201 container create 393457450b601902bafe26f61e9fd615453c051c6c7394f2d42a2eee96e751d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-02-28T23:14:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:54 smithi184 ceph-mon[86482]: pgmap v64: 65 pgs: 9 stale+active+clean, 56 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-02-28T23:14:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:54 smithi184 ceph-mon[86482]: osdmap e52: 6 total, 5 up, 6 in 2024-02-28T23:14:54.763 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:54 smithi159 podman[125361]: 2024-02-28 23:14:54.615492776 +0000 UTC m=+0.437379409 container init 393457450b601902bafe26f61e9fd615453c051c6c7394f2d42a2eee96e751d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, ceph=True) 2024-02-28T23:14:54.763 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:54 smithi159 podman[125361]: 2024-02-28 23:14:54.630196444 +0000 UTC m=+0.452083038 container start 393457450b601902bafe26f61e9fd615453c051c6c7394f2d42a2eee96e751d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T23:14:54.763 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:54 smithi159 podman[125361]: 2024-02-28 23:14:54.764551339 +0000 UTC m=+0.586437977 container attach 393457450b601902bafe26f61e9fd615453c051c6c7394f2d42a2eee96e751d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-02-28T23:14:55.473 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:55 smithi159 podman[125361]: 2024-02-28 23:14:55.102899294 +0000 UTC m=+0.924785926 container died 393457450b601902bafe26f61e9fd615453c051c6c7394f2d42a2eee96e751d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-28T23:14:55.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:55 smithi184 ceph-mon[86482]: osdmap e53: 6 total, 5 up, 6 in 2024-02-28T23:14:55.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:55 smithi184 ceph-mon[86482]: pgmap v68: 65 pgs: 9 remapped+peering, 17 active+undersized+degraded, 14 active+undersized, 25 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 38/228 objects degraded (16.667%) 2024-02-28T23:14:55.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:55 smithi159 ceph-mon[113833]: osdmap e53: 6 total, 5 up, 6 in 2024-02-28T23:14:55.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:55 smithi159 ceph-mon[113833]: pgmap v68: 65 pgs: 9 remapped+peering, 17 active+undersized+degraded, 14 active+undersized, 25 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 38/228 objects degraded (16.667%) 2024-02-28T23:14:56.472 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:56 smithi159 podman[125387]: 2024-02-28 23:14:56.085924496 +0000 UTC m=+0.966183149 container remove 393457450b601902bafe26f61e9fd615453c051c6c7394f2d42a2eee96e751d7 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-02-28T23:14:56.473 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:56 smithi159 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.0.service: Deactivated successfully. 2024-02-28T23:14:56.473 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:56 smithi159 systemd[1]: Stopped Ceph osd.0 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:14:56.473 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:56 smithi159 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.0.service: Consumed 1min 41.041s CPU time. 2024-02-28T23:14:56.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:56 smithi184 ceph-mon[86482]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-28T23:14:56.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:56 smithi184 ceph-mon[86482]: Health check failed: Degraded data redundancy: 38/228 objects degraded (16.667%), 17 pgs degraded (PG_DEGRADED) 2024-02-28T23:14:56.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:56 smithi184 ceph-mon[86482]: osdmap e54: 6 total, 5 up, 6 in 2024-02-28T23:14:56.901 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:56 smithi159 systemd[1]: Starting Ceph osd.0 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:14:56.901 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:56 smithi159 ceph-mon[113833]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-28T23:14:56.901 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:56 smithi159 ceph-mon[113833]: Health check failed: Degraded data redundancy: 38/228 objects degraded (16.667%), 17 pgs degraded (PG_DEGRADED) 2024-02-28T23:14:56.901 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:56 smithi159 ceph-mon[113833]: osdmap e54: 6 total, 5 up, 6 in 2024-02-28T23:14:57.206 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:56 smithi159 podman[125482]: 2024-02-28 23:14:56.806836152 +0000 UTC m=+0.034128793 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:14:57.206 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:56 smithi159 podman[125482]: 2024-02-28 23:14:56.911598477 +0000 UTC m=+0.138891125 container create 3d1a5316ad528615eb69b990b84ce88de14e3510730011c6dab87aecacad268a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, ceph=True) 2024-02-28T23:14:57.206 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:57 smithi159 podman[125482]: 2024-02-28 23:14:57.207752349 +0000 UTC m=+0.435045076 container init 3d1a5316ad528615eb69b990b84ce88de14e3510730011c6dab87aecacad268a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, RELEASE=main-1fb5d10) 2024-02-28T23:14:57.472 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:57 smithi159 podman[125482]: 2024-02-28 23:14:57.22175242 +0000 UTC m=+0.449045117 container start 3d1a5316ad528615eb69b990b84ce88de14e3510730011c6dab87aecacad268a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222) 2024-02-28T23:14:57.472 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:57 smithi159 podman[125482]: 2024-02-28 23:14:57.315055966 +0000 UTC m=+0.542348667 container attach 3d1a5316ad528615eb69b990b84ce88de14e3510730011c6dab87aecacad268a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222) 2024-02-28T23:14:57.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:57 smithi159 ceph-mon[113833]: osdmap e55: 6 total, 5 up, 6 in 2024-02-28T23:14:57.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:57 smithi159 ceph-mon[113833]: pgmap v71: 65 pgs: 9 remapped+peering, 17 active+undersized+degraded, 14 active+undersized, 25 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 38/228 objects degraded (16.667%) 2024-02-28T23:14:58.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:57 smithi184 ceph-mon[86482]: osdmap e55: 6 total, 5 up, 6 in 2024-02-28T23:14:58.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:57 smithi184 ceph-mon[86482]: pgmap v71: 65 pgs: 9 remapped+peering, 17 active+undersized+degraded, 14 active+undersized, 25 active+clean; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s; 38/228 objects degraded (16.667%) 2024-02-28T23:14:58.473 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate[125496]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T23:14:58.473 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate[125496]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T23:14:58.473 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 bash[125482]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 bash[125482]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 bash[125482]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 bash[125482]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 bash[125482]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 bash[125482]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 bash[125482]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate[125496]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate[125496]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate[125496]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate[125496]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate[125496]: --> ceph-volume raw activate successful for osd ID: 0 2024-02-28T23:14:58.474 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:58 smithi159 podman[125482]: 2024-02-28 23:14:58.177635356 +0000 UTC m=+1.404928048 container died 3d1a5316ad528615eb69b990b84ce88de14e3510730011c6dab87aecacad268a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-28T23:14:58.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:58 smithi159 ceph-mon[113833]: osdmap e56: 6 total, 5 up, 6 in 2024-02-28T23:14:59.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:58 smithi184 ceph-mon[86482]: osdmap e56: 6 total, 5 up, 6 in 2024-02-28T23:14:59.472 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:59 smithi159 podman[125635]: 2024-02-28 23:14:59.136059072 +0000 UTC m=+0.940436036 container remove 3d1a5316ad528615eb69b990b84ce88de14e3510730011c6dab87aecacad268a (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-02-28T23:14:59.972 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:14:59 smithi159 podman[125693]: 2024-02-28 23:14:59.383502032 +0000 UTC m=+0.032642518 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:14:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:59 smithi159 ceph-mon[113833]: osdmap e57: 6 total, 5 up, 6 in 2024-02-28T23:14:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:14:59 smithi159 ceph-mon[113833]: pgmap v74: 65 pgs: 25 active+clean, 1 active+recovery_wait+undersized+remapped, 14 active+undersized, 6 active+clean+remapped, 1 active+undersized+remapped, 17 active+undersized+degraded, 1 active+recovery_wait+undersized+degraded+remapped; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 778/228 objects degraded (341.228%); 730/228 objects misplaced (320.175%); 2.3 MiB/s, 351 objects/s recovering 2024-02-28T23:15:00.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:59 smithi184 ceph-mon[86482]: osdmap e57: 6 total, 5 up, 6 in 2024-02-28T23:15:00.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:14:59 smithi184 ceph-mon[86482]: pgmap v74: 65 pgs: 25 active+clean, 1 active+recovery_wait+undersized+remapped, 14 active+undersized, 6 active+clean+remapped, 1 active+undersized+remapped, 17 active+undersized+degraded, 1 active+recovery_wait+undersized+degraded+remapped; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 778/228 objects degraded (341.228%); 730/228 objects misplaced (320.175%); 2.3 MiB/s, 351 objects/s recovering 2024-02-28T23:15:00.298 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:15:00 smithi159 podman[125693]: 2024-02-28 23:15:00.003780893 +0000 UTC m=+0.652921436 container create bc355acd33650046fcd9db4b379f429383407b8919e4a5098e512434f98ab2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-02-28T23:15:00.298 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:15:00 smithi159 podman[125693]: 2024-02-28 23:15:00.29958401 +0000 UTC m=+0.948724554 container init bc355acd33650046fcd9db4b379f429383407b8919e4a5098e512434f98ab2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, CEPH_POINT_RELEASE=) 2024-02-28T23:15:00.644 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:15:00 smithi159 podman[125693]: 2024-02-28 23:15:00.313103479 +0000 UTC m=+0.962243996 container start bc355acd33650046fcd9db4b379f429383407b8919e4a5098e512434f98ab2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-28T23:15:00.644 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:15:00 smithi159 ceph-osd[125712]: -- 172.21.15.159:0/104780422 <== mon.0 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e580487680 con 0x55e580451000 2024-02-28T23:15:00.645 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:15:00 smithi159 bash[125693]: bc355acd33650046fcd9db4b379f429383407b8919e4a5098e512434f98ab2b8 2024-02-28T23:15:00.645 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:15:00 smithi159 systemd[1]: Started Ceph osd.0 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:15:00.972 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:15:00 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0[125708]: 2024-02-28T23:15:00.885+0000 7fc838a177c0 -1 Falling back to public interface 2024-02-28T23:15:00.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:00 smithi159 ceph-mon[113833]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-28T23:15:00.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:00 smithi159 ceph-mon[113833]: osdmap e58: 6 total, 5 up, 6 in 2024-02-28T23:15:00.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:00.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:00.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:15:01.012 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:00 smithi184 ceph-mon[86482]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-02-28T23:15:01.012 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:00 smithi184 ceph-mon[86482]: osdmap e58: 6 total, 5 up, 6 in 2024-02-28T23:15:01.012 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:01.012 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:01.012 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:15:01.944 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:01 smithi159 ceph-mon[113833]: osdmap e59: 6 total, 5 up, 6 in 2024-02-28T23:15:01.944 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:01 smithi159 ceph-mon[113833]: pgmap v77: 65 pgs: 25 active+clean, 1 active+recovery_wait+undersized+remapped, 14 active+undersized, 6 active+clean+remapped, 1 active+undersized+remapped, 17 active+undersized+degraded, 1 active+recovery_wait+undersized+degraded+remapped; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 778/228 objects degraded (341.228%); 730/228 objects misplaced (320.175%); 2.3 MiB/s, 351 objects/s recovering 2024-02-28T23:15:02.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:01 smithi184 ceph-mon[86482]: osdmap e59: 6 total, 5 up, 6 in 2024-02-28T23:15:02.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:01 smithi184 ceph-mon[86482]: pgmap v77: 65 pgs: 25 active+clean, 1 active+recovery_wait+undersized+remapped, 14 active+undersized, 6 active+clean+remapped, 1 active+undersized+remapped, 17 active+undersized+degraded, 1 active+recovery_wait+undersized+degraded+remapped; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s; 778/228 objects degraded (341.228%); 730/228 objects misplaced (320.175%); 2.3 MiB/s, 351 objects/s recovering 2024-02-28T23:15:04.184 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:03 smithi159 ceph-mon[113833]: osdmap e60: 6 total, 5 up, 6 in 2024-02-28T23:15:04.184 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:03 smithi159 ceph-mon[113833]: pgmap v79: 65 pgs: 25 active+clean, 1 active+recovery_wait+undersized+remapped, 14 active+undersized, 6 active+clean+remapped, 1 active+undersized+remapped, 17 active+undersized+degraded, 1 active+recovery_wait+undersized+degraded+remapped; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 683 B/s rd, 1 op/s; 778/228 objects degraded (341.228%); 730/228 objects misplaced (320.175%); 2.1 MiB/s, 312 objects/s recovering 2024-02-28T23:15:04.184 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:03 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 778/228 objects degraded (341.228%), 18 pgs degraded (PG_DEGRADED) 2024-02-28T23:15:04.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:03 smithi184 ceph-mon[86482]: osdmap e60: 6 total, 5 up, 6 in 2024-02-28T23:15:04.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:03 smithi184 ceph-mon[86482]: pgmap v79: 65 pgs: 25 active+clean, 1 active+recovery_wait+undersized+remapped, 14 active+undersized, 6 active+clean+remapped, 1 active+undersized+remapped, 17 active+undersized+degraded, 1 active+recovery_wait+undersized+degraded+remapped; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 683 B/s rd, 1 op/s; 778/228 objects degraded (341.228%); 730/228 objects misplaced (320.175%); 2.1 MiB/s, 312 objects/s recovering 2024-02-28T23:15:04.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:03 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 778/228 objects degraded (341.228%), 18 pgs degraded (PG_DEGRADED) 2024-02-28T23:15:05.155 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:04 smithi159 ceph-mon[113833]: osdmap e61: 6 total, 5 up, 6 in 2024-02-28T23:15:05.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:04 smithi184 ceph-mon[86482]: osdmap e61: 6 total, 5 up, 6 in 2024-02-28T23:15:06.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:05 smithi159 ceph-mon[113833]: pgmap v81: 65 pgs: 26 active+clean, 1 active+recovering+undersized+remapped, 14 active+undersized, 7 active+clean+remapped, 17 active+undersized+degraded; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 936 B/s rd, 1 op/s; 38/228 objects degraded (16.667%); 6/228 objects misplaced (2.632%); 0 B/s, 220 objects/s recovering 2024-02-28T23:15:06.223 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:15:05 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0[125708]: 2024-02-28T23:15:05.990+0000 7fc838a177c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-02-28T23:15:06.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:05 smithi184 ceph-mon[86482]: pgmap v81: 65 pgs: 26 active+clean, 1 active+recovering+undersized+remapped, 14 active+undersized, 7 active+clean+remapped, 17 active+undersized+degraded; 209 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 936 B/s rd, 1 op/s; 38/228 objects degraded (16.667%); 6/228 objects misplaced (2.632%); 0 B/s, 220 objects/s recovering 2024-02-28T23:15:06.926 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:15:06 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0[125708]: 2024-02-28T23:15:06.563+0000 7fc838a177c0 -1 osd.0 49 log_to_monitors true 2024-02-28T23:15:07.222 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:15:06 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0[125708]: 2024-02-28T23:15:06.953+0000 7fc827e00700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T23:15:07.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:06 smithi159 ceph-mon[113833]: osdmap e62: 6 total, 5 up, 6 in 2024-02-28T23:15:07.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:06 smithi159 ceph-mon[113833]: from='osd.0 [v2:172.21.15.159:6802/3232134603,v1:172.21.15.159:6803/3232134603]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T23:15:07.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:06 smithi184 ceph-mon[86482]: osdmap e62: 6 total, 5 up, 6 in 2024-02-28T23:15:07.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:06 smithi184 ceph-mon[86482]: from='osd.0 [v2:172.21.15.159:6802/3232134603,v1:172.21.15.159:6803/3232134603]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-28T23:15:08.220 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:07 smithi159 ceph-mon[113833]: from='osd.0 [v2:172.21.15.159:6802/3232134603,v1:172.21.15.159:6803/3232134603]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T23:15:08.221 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:07 smithi159 ceph-mon[113833]: osdmap e63: 6 total, 5 up, 6 in 2024-02-28T23:15:08.221 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:07 smithi159 ceph-mon[113833]: from='osd.0 [v2:172.21.15.159:6802/3232134603,v1:172.21.15.159:6803/3232134603]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T23:15:08.221 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:07 smithi159 ceph-mon[113833]: pgmap v84: 65 pgs: 26 active+clean, 1 active+recovering+undersized+remapped, 14 active+undersized, 7 active+clean+remapped, 17 active+undersized+degraded; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 38/228 objects degraded (16.667%); 6/228 objects misplaced (2.632%); 0 B/s, 286 objects/s recovering 2024-02-28T23:15:08.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:07 smithi184 ceph-mon[86482]: from='osd.0 [v2:172.21.15.159:6802/3232134603,v1:172.21.15.159:6803/3232134603]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-28T23:15:08.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:07 smithi184 ceph-mon[86482]: osdmap e63: 6 total, 5 up, 6 in 2024-02-28T23:15:08.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:07 smithi184 ceph-mon[86482]: from='osd.0 [v2:172.21.15.159:6802/3232134603,v1:172.21.15.159:6803/3232134603]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T23:15:08.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:07 smithi184 ceph-mon[86482]: pgmap v84: 65 pgs: 26 active+clean, 1 active+recovering+undersized+remapped, 14 active+undersized, 7 active+clean+remapped, 17 active+undersized+degraded; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 38/228 objects degraded (16.667%); 6/228 objects misplaced (2.632%); 0 B/s, 286 objects/s recovering 2024-02-28T23:15:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:08 smithi159 ceph-mon[113833]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:15:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:08 smithi159 ceph-mon[113833]: osd.0 [v2:172.21.15.159:6802/3232134603,v1:172.21.15.159:6803/3232134603] boot 2024-02-28T23:15:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:08 smithi159 ceph-mon[113833]: osdmap e64: 6 total, 6 up, 6 in 2024-02-28T23:15:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T23:15:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:15:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:08 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 38/228 objects degraded (16.667%), 17 pgs degraded (PG_DEGRADED) 2024-02-28T23:15:09.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:08 smithi159 ceph-mon[113833]: osdmap e65: 6 total, 6 up, 6 in 2024-02-28T23:15:09.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:08 smithi184 ceph-mon[86482]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:15:09.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:08 smithi184 ceph-mon[86482]: osd.0 [v2:172.21.15.159:6802/3232134603,v1:172.21.15.159:6803/3232134603] boot 2024-02-28T23:15:09.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:08 smithi184 ceph-mon[86482]: osdmap e64: 6 total, 6 up, 6 in 2024-02-28T23:15:09.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-28T23:15:09.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:09.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:09.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:09.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:15:09.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:08 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 38/228 objects degraded (16.667%), 17 pgs degraded (PG_DEGRADED) 2024-02-28T23:15:09.352 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:08 smithi184 ceph-mon[86482]: osdmap e65: 6 total, 6 up, 6 in 2024-02-28T23:15:10.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:09 smithi159 ceph-mon[113833]: pgmap v87: 65 pgs: 4 remapped+peering, 2 peering, 50 active+clean, 5 active+undersized, 1 active+clean+remapped, 3 active+undersized+degraded; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 6/228 objects degraded (2.632%); 0 B/s, 64 objects/s recovering 2024-02-28T23:15:10.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:09 smithi159 ceph-mon[113833]: osdmap e66: 6 total, 6 up, 6 in 2024-02-28T23:15:10.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:09 smithi184 ceph-mon[86482]: pgmap v87: 65 pgs: 4 remapped+peering, 2 peering, 50 active+clean, 5 active+undersized, 1 active+clean+remapped, 3 active+undersized+degraded; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 6/228 objects degraded (2.632%); 0 B/s, 64 objects/s recovering 2024-02-28T23:15:10.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:09 smithi184 ceph-mon[86482]: osdmap e66: 6 total, 6 up, 6 in 2024-02-28T23:15:11.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:11 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:11.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:11 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:11.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:11 smithi159 ceph-mon[113833]: osdmap e67: 6 total, 6 up, 6 in 2024-02-28T23:15:11.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:11 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:11.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:11 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:11.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:11 smithi184 ceph-mon[86482]: osdmap e67: 6 total, 6 up, 6 in 2024-02-28T23:15:12.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:12 smithi184 ceph-mon[86482]: pgmap v90: 65 pgs: 4 remapped+peering, 2 peering, 50 active+clean, 5 active+undersized, 1 active+clean+remapped, 3 active+undersized+degraded; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 6/228 objects degraded (2.632%); 0 B/s, 64 objects/s recovering 2024-02-28T23:15:12.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:12 smithi184 ceph-mon[86482]: osdmap e68: 6 total, 6 up, 6 in 2024-02-28T23:15:12.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:12 smithi159 ceph-mon[113833]: pgmap v90: 65 pgs: 4 remapped+peering, 2 peering, 50 active+clean, 5 active+undersized, 1 active+clean+remapped, 3 active+undersized+degraded; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 6/228 objects degraded (2.632%); 0 B/s, 64 objects/s recovering 2024-02-28T23:15:12.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:12 smithi159 ceph-mon[113833]: osdmap e68: 6 total, 6 up, 6 in 2024-02-28T23:15:13.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:13 smithi159 ceph-mon[113833]: osdmap e69: 6 total, 6 up, 6 in 2024-02-28T23:15:13.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:13 smithi159 ceph-mon[113833]: pgmap v93: 65 pgs: 3 remapped+peering, 2 peering, 60 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:15:13.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:13 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 6/228 objects degraded (2.632%), 3 pgs degraded (PG_DEGRADED) 2024-02-28T23:15:13.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:13 smithi159 ceph-mon[113833]: osdmap e70: 6 total, 6 up, 6 in 2024-02-28T23:15:14.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:13 smithi184 ceph-mon[86482]: osdmap e69: 6 total, 6 up, 6 in 2024-02-28T23:15:14.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:13 smithi184 ceph-mon[86482]: pgmap v93: 65 pgs: 3 remapped+peering, 2 peering, 60 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:15:14.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:13 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 6/228 objects degraded (2.632%), 3 pgs degraded (PG_DEGRADED) 2024-02-28T23:15:14.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:13 smithi184 ceph-mon[86482]: osdmap e70: 6 total, 6 up, 6 in 2024-02-28T23:15:14.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:14 smithi159 ceph-mon[113833]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/228 objects degraded (2.632%), 3 pgs degraded) 2024-02-28T23:15:14.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:14 smithi159 ceph-mon[113833]: Cluster is now healthy 2024-02-28T23:15:14.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:14 smithi159 ceph-mon[113833]: osdmap e71: 6 total, 6 up, 6 in 2024-02-28T23:15:15.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:14 smithi184 ceph-mon[86482]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/228 objects degraded (2.632%), 3 pgs degraded) 2024-02-28T23:15:15.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:14 smithi184 ceph-mon[86482]: Cluster is now healthy 2024-02-28T23:15:15.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:14 smithi184 ceph-mon[86482]: osdmap e71: 6 total, 6 up, 6 in 2024-02-28T23:15:15.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:15 smithi159 ceph-mon[113833]: pgmap v96: 65 pgs: 1 peering, 64 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 0 B/s, 356 objects/s recovering 2024-02-28T23:15:16.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:15 smithi184 ceph-mon[86482]: pgmap v96: 65 pgs: 1 peering, 64 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 0 B/s, 356 objects/s recovering 2024-02-28T23:15:17.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:17.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:17.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:15:17.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:15:17.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:17.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:15:17.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:15:17.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:15:17.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:15:17.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T23:15:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:17.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:17.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:15:17.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:15:17.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:17.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:15:17.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:15:17.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:15:17.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:15:17.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T23:15:18.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:18 smithi159 ceph-mon[113833]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T23:15:18.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:18 smithi159 ceph-mon[113833]: Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2024-02-28T23:15:18.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:18 smithi159 ceph-mon[113833]: pgmap v97: 65 pgs: 1 peering, 64 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 742 B/s rd, 1 op/s; 0 B/s, 258 objects/s recovering 2024-02-28T23:15:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:18 smithi184 ceph-mon[86482]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T23:15:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:18 smithi184 ceph-mon[86482]: Upgrade: unsafe to stop osd(s) at this time (1 PGs are or would become offline) 2024-02-28T23:15:18.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:18 smithi184 ceph-mon[86482]: pgmap v97: 65 pgs: 1 peering, 64 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 742 B/s rd, 1 op/s; 0 B/s, 258 objects/s recovering 2024-02-28T23:15:19.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.553+0000 7f80d6600700 1 -- 172.21.15.159:0/1688667348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d0100970 msgr2=0x7f80d0100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:19.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.553+0000 7f80d6600700 1 --2- 172.21.15.159:0/1688667348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d0100970 0x7f80d0100df0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f80bc009910 tx=0x7f80bc009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:19.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.553+0000 7f80d6600700 1 -- 172.21.15.159:0/1688667348 shutdown_connections 2024-02-28T23:15:19.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.553+0000 7f80d6600700 1 --2- 172.21.15.159:0/1688667348 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d0100970 0x7f80d0100df0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:19.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.553+0000 7f80d6600700 1 --2- 172.21.15.159:0/1688667348 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d0106970 0x7f80d0106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:19.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.553+0000 7f80d6600700 1 -- 172.21.15.159:0/1688667348 >> 172.21.15.159:0/1688667348 conn(0x7f80d00fc440 msgr2=0x7f80d00fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:19.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.553+0000 7f80d6600700 1 -- 172.21.15.159:0/1688667348 shutdown_connections 2024-02-28T23:15:19.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.553+0000 7f80d6600700 1 -- 172.21.15.159:0/1688667348 wait complete. 2024-02-28T23:15:19.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.554+0000 7f80d6600700 1 Processor -- start 2024-02-28T23:15:19.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.555+0000 7f80d6600700 1 -- start start 2024-02-28T23:15:19.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.555+0000 7f80d6600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d0100970 0x7f80d0073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:19.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.555+0000 7f80d6600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d0106970 0x7f80d00735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:19.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.555+0000 7f80d6600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0073b10 con 0x7f80d0100970 2024-02-28T23:15:19.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.555+0000 7f80d6600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80d0073c50 con 0x7f80d0106970 2024-02-28T23:15:19.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.555+0000 7f80d5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d0100970 0x7f80d0073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:19.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.555+0000 7f80d5200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d0100970 0x7f80d0073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37790/0 (socket says 172.21.15.159:37790) 2024-02-28T23:15:19.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.555+0000 7f80d5200700 1 -- 172.21.15.159:0/2120205856 learned_addr learned my addr 172.21.15.159:0/2120205856 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:19.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.556+0000 7f80c7e00700 1 --2- 172.21.15.159:0/2120205856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d0106970 0x7f80d00735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:19.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.556+0000 7f80d5200700 1 -- 172.21.15.159:0/2120205856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d0106970 msgr2=0x7f80d00735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:19.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.556+0000 7f80d5200700 1 --2- 172.21.15.159:0/2120205856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d0106970 0x7f80d00735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:19.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.556+0000 7f80d5200700 1 -- 172.21.15.159:0/2120205856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc0095f0 con 0x7f80d0100970 2024-02-28T23:15:19.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.556+0000 7f80d5200700 1 --2- 172.21.15.159:0/2120205856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d0100970 0x7f80d0073090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f80c000ada0 tx=0x7f80c000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:19.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.556+0000 7f80ce000700 1 -- 172.21.15.159:0/2120205856 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c000f070 con 0x7f80d0100970 2024-02-28T23:15:19.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.556+0000 7f80ce000700 1 -- 172.21.15.159:0/2120205856 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f80c0007bf0 con 0x7f80d0100970 2024-02-28T23:15:19.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.556+0000 7f80d6600700 1 -- 172.21.15.159:0/2120205856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80d01a2720 con 0x7f80d0100970 2024-02-28T23:15:19.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.556+0000 7f80ce000700 1 -- 172.21.15.159:0/2120205856 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80c0005690 con 0x7f80d0100970 2024-02-28T23:15:19.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.556+0000 7f80d6600700 1 -- 172.21.15.159:0/2120205856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80d01a2b30 con 0x7f80d0100970 2024-02-28T23:15:19.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.558+0000 7f80d6600700 1 -- 172.21.15.159:0/2120205856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80d0108f00 con 0x7f80d0100970 2024-02-28T23:15:19.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.559+0000 7f80ce000700 1 -- 172.21.15.159:0/2120205856 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f80c0005850 con 0x7f80d0100970 2024-02-28T23:15:19.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.560+0000 7f80ce000700 1 --2- 172.21.15.159:0/2120205856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f80b406d8a0 0x7f80b406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:19.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.560+0000 7f80ce000700 1 -- 172.21.15.159:0/2120205856 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f80c008cf80 con 0x7f80d0100970 2024-02-28T23:15:19.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.560+0000 7f80c7e00700 1 --2- 172.21.15.159:0/2120205856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f80b406d8a0 0x7f80b406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:19.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.561+0000 7f80c7e00700 1 --2- 172.21.15.159:0/2120205856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f80b406d8a0 0x7f80b406fd60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80d0074880 tx=0x7f80bc01a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:19.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.566+0000 7f80ce000700 1 -- 172.21.15.159:0/2120205856 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f80c00566b0 con 0x7f80d0100970 2024-02-28T23:15:19.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.804+0000 7f80d6600700 1 -- 172.21.15.159:0/2120205856 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f80d002cdd0 con 0x7f80b406d8a0 2024-02-28T23:15:19.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.806+0000 7f80ce000700 1 -- 172.21.15.159:0/2120205856 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f80d002cdd0 con 0x7f80b406d8a0 2024-02-28T23:15:19.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.808+0000 7f80d6600700 1 -- 172.21.15.159:0/2120205856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f80b406d8a0 msgr2=0x7f80b406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:19.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.808+0000 7f80d6600700 1 --2- 172.21.15.159:0/2120205856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f80b406d8a0 0x7f80b406fd60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f80d0074880 tx=0x7f80bc01a040 comp rx=0 tx=0).stop 2024-02-28T23:15:19.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.808+0000 7f80d6600700 1 -- 172.21.15.159:0/2120205856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d0100970 msgr2=0x7f80d0073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:19.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.808+0000 7f80d6600700 1 --2- 172.21.15.159:0/2120205856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d0100970 0x7f80d0073090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f80c000ada0 tx=0x7f80c000c330 comp rx=0 tx=0).stop 2024-02-28T23:15:19.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.808+0000 7f80d6600700 1 -- 172.21.15.159:0/2120205856 shutdown_connections 2024-02-28T23:15:19.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.808+0000 7f80d6600700 1 --2- 172.21.15.159:0/2120205856 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f80b406d8a0 0x7f80b406fd60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:19.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.808+0000 7f80d6600700 1 --2- 172.21.15.159:0/2120205856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d0100970 0x7f80d0073090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:19.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.808+0000 7f80d6600700 1 --2- 172.21.15.159:0/2120205856 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f80d0106970 0x7f80d00735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:19.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.808+0000 7f80d6600700 1 -- 172.21.15.159:0/2120205856 >> 172.21.15.159:0/2120205856 conn(0x7f80d00fc440 msgr2=0x7f80d00fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:19.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.809+0000 7f80d6600700 1 -- 172.21.15.159:0/2120205856 shutdown_connections 2024-02-28T23:15:19.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.809+0000 7f80d6600700 1 -- 172.21.15.159:0/2120205856 wait complete. 2024-02-28T23:15:19.823 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:15:19.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.967+0000 7f2efb200700 1 -- 172.21.15.159:0/1985044931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2efc068d30 msgr2=0x7f2efc10d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:19.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.967+0000 7f2efb200700 1 --2- 172.21.15.159:0/1985044931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2efc068d30 0x7f2efc10d080 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009910 tx=0x7f2ee8009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:19.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.967+0000 7f2efb200700 1 -- 172.21.15.159:0/1985044931 shutdown_connections 2024-02-28T23:15:19.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.967+0000 7f2efb200700 1 --2- 172.21.15.159:0/1985044931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2efc068d30 0x7f2efc10d080 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:19.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.967+0000 7f2efb200700 1 --2- 172.21.15.159:0/1985044931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2efc068410 0x7f2efc0687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:19.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.967+0000 7f2efb200700 1 -- 172.21.15.159:0/1985044931 >> 172.21.15.159:0/1985044931 conn(0x7f2efc075330 msgr2=0x7f2efc075740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:19.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.967+0000 7f2efb200700 1 -- 172.21.15.159:0/1985044931 shutdown_connections 2024-02-28T23:15:19.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.967+0000 7f2efb200700 1 -- 172.21.15.159:0/1985044931 wait complete. 2024-02-28T23:15:19.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.968+0000 7f2efb200700 1 Processor -- start 2024-02-28T23:15:19.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.968+0000 7f2efb200700 1 -- start start 2024-02-28T23:15:19.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.969+0000 7f2efb200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2efc068410 0x7f2efc101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:19.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.969+0000 7f2efb200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2efc068d30 0x7f2efc102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:19.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.969+0000 7f2efb200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc105e80 con 0x7f2efc068d30 2024-02-28T23:15:19.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.969+0000 7f2efb200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2efc102770 con 0x7f2efc068410 2024-02-28T23:15:19.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.969+0000 7f2ef9400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2efc068d30 0x7f2efc102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:19.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.969+0000 7f2ef9400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2efc068d30 0x7f2efc102230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37812/0 (socket says 172.21.15.159:37812) 2024-02-28T23:15:19.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.969+0000 7f2ef9400700 1 -- 172.21.15.159:0/699634430 learned_addr learned my addr 172.21.15.159:0/699634430 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:19.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.969+0000 7f2ef9e00700 1 --2- 172.21.15.159:0/699634430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2efc068410 0x7f2efc101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:19.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.969+0000 7f2ef9400700 1 -- 172.21.15.159:0/699634430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2efc068410 msgr2=0x7f2efc101cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:19.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.969+0000 7f2ef9400700 1 --2- 172.21.15.159:0/699634430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2efc068410 0x7f2efc101cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:19.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.969+0000 7f2ef9400700 1 -- 172.21.15.159:0/699634430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee80095f0 con 0x7f2efc068d30 2024-02-28T23:15:19.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.970+0000 7f2ef9400700 1 --2- 172.21.15.159:0/699634430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2efc068d30 0x7f2efc102230 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800b5c0 tx=0x7f2ee800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:19.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.970+0000 7f2ef2a00700 1 -- 172.21.15.159:0/699634430 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ee801d070 con 0x7f2efc068d30 2024-02-28T23:15:19.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.970+0000 7f2ef2a00700 1 -- 172.21.15.159:0/699634430 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2ee800f460 con 0x7f2efc068d30 2024-02-28T23:15:19.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.970+0000 7f2efb200700 1 -- 172.21.15.159:0/699634430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2efc102a50 con 0x7f2efc068d30 2024-02-28T23:15:19.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.970+0000 7f2ef2a00700 1 -- 172.21.15.159:0/699634430 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ee8017630 con 0x7f2efc068d30 2024-02-28T23:15:19.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.970+0000 7f2efb200700 1 -- 172.21.15.159:0/699634430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc1a7010 con 0x7f2efc068d30 2024-02-28T23:15:19.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.971+0000 7f2efb200700 1 -- 172.21.15.159:0/699634430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2efc10a7f0 con 0x7f2efc068d30 2024-02-28T23:15:19.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.972+0000 7f2ef2a00700 1 -- 172.21.15.159:0/699634430 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f2ee800f5d0 con 0x7f2efc068d30 2024-02-28T23:15:19.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.973+0000 7f2ef2a00700 1 --2- 172.21.15.159:0/699634430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2ee006d8a0 0x7f2ee006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:19.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.973+0000 7f2ef2a00700 1 -- 172.21.15.159:0/699634430 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f2ee808eb90 con 0x7f2efc068d30 2024-02-28T23:15:19.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.974+0000 7f2ef9e00700 1 --2- 172.21.15.159:0/699634430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2ee006d8a0 0x7f2ee006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:19.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.974+0000 7f2ef9e00700 1 --2- 172.21.15.159:0/699634430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2ee006d8a0 0x7f2ee006fd60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2eec005fd0 tx=0x7f2eec005dd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:19.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:19.978+0000 7f2ef2a00700 1 -- 172.21.15.159:0/699634430 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2ee8058240 con 0x7f2efc068d30 2024-02-28T23:15:20.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.229+0000 7f2efb200700 1 -- 172.21.15.159:0/699634430 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2efc02cce0 con 0x7f2ee006d8a0 2024-02-28T23:15:20.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.230+0000 7f2ef2a00700 1 -- 172.21.15.159:0/699634430 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2efc02cce0 con 0x7f2ee006d8a0 2024-02-28T23:15:20.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.234+0000 7f2efb200700 1 -- 172.21.15.159:0/699634430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2ee006d8a0 msgr2=0x7f2ee006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:20.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.234+0000 7f2efb200700 1 --2- 172.21.15.159:0/699634430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2ee006d8a0 0x7f2ee006fd60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2eec005fd0 tx=0x7f2eec005dd0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.234+0000 7f2efb200700 1 -- 172.21.15.159:0/699634430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2efc068d30 msgr2=0x7f2efc102230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:20.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.234+0000 7f2efb200700 1 --2- 172.21.15.159:0/699634430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2efc068d30 0x7f2efc102230 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ee800b5c0 tx=0x7f2ee800be00 comp rx=0 tx=0).stop 2024-02-28T23:15:20.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.235+0000 7f2efb200700 1 -- 172.21.15.159:0/699634430 shutdown_connections 2024-02-28T23:15:20.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.235+0000 7f2efb200700 1 --2- 172.21.15.159:0/699634430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2efc068410 0x7f2efc101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.235+0000 7f2efb200700 1 --2- 172.21.15.159:0/699634430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2ee006d8a0 0x7f2ee006fd60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.235+0000 7f2efb200700 1 --2- 172.21.15.159:0/699634430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2efc068d30 0x7f2efc102230 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.235+0000 7f2efb200700 1 -- 172.21.15.159:0/699634430 >> 172.21.15.159:0/699634430 conn(0x7f2efc075330 msgr2=0x7f2efc0fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:20.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.235+0000 7f2efb200700 1 -- 172.21.15.159:0/699634430 shutdown_connections 2024-02-28T23:15:20.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.235+0000 7f2efb200700 1 -- 172.21.15.159:0/699634430 wait complete. 2024-02-28T23:15:20.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.385+0000 7fb373c00700 1 -- 172.21.15.159:0/3787954638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb36c100da0 msgr2=0x7fb36c101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:20.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.385+0000 7fb373c00700 1 --2- 172.21.15.159:0/3787954638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb36c100da0 0x7fb36c101180 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb360009910 tx=0x7fb360009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:20.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.385+0000 7fb373c00700 1 -- 172.21.15.159:0/3787954638 shutdown_connections 2024-02-28T23:15:20.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.385+0000 7fb373c00700 1 --2- 172.21.15.159:0/3787954638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb36c101750 0x7fb36c1057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.385+0000 7fb373c00700 1 --2- 172.21.15.159:0/3787954638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb36c100da0 0x7fb36c101180 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.385+0000 7fb373c00700 1 -- 172.21.15.159:0/3787954638 >> 172.21.15.159:0/3787954638 conn(0x7fb36c0fc630 msgr2=0x7fb36c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:20.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.385+0000 7fb373c00700 1 -- 172.21.15.159:0/3787954638 shutdown_connections 2024-02-28T23:15:20.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.385+0000 7fb373c00700 1 -- 172.21.15.159:0/3787954638 wait complete. 2024-02-28T23:15:20.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.386+0000 7fb373c00700 1 Processor -- start 2024-02-28T23:15:20.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.387+0000 7fb373c00700 1 -- start start 2024-02-28T23:15:20.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.387+0000 7fb373c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb36c100da0 0x7fb36c19c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:20.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.387+0000 7fb373c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb36c101750 0x7fb36c19cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:20.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.387+0000 7fb373c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c19d170 con 0x7fb36c101750 2024-02-28T23:15:20.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.387+0000 7fb373c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36c196620 con 0x7fb36c100da0 2024-02-28T23:15:20.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.387+0000 7fb36be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb36c101750 0x7fb36c19cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:20.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.387+0000 7fb36be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb36c101750 0x7fb36c19cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37840/0 (socket says 172.21.15.159:37840) 2024-02-28T23:15:20.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.387+0000 7fb36be00700 1 -- 172.21.15.159:0/3615802337 learned_addr learned my addr 172.21.15.159:0/3615802337 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:20.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.388+0000 7fb371200700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb36c100da0 0x7fb36c19c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:20.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.388+0000 7fb36be00700 1 -- 172.21.15.159:0/3615802337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb36c100da0 msgr2=0x7fb36c19c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:20.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.388+0000 7fb36be00700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb36c100da0 0x7fb36c19c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.388+0000 7fb36be00700 1 -- 172.21.15.159:0/3615802337 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3600095f0 con 0x7fb36c101750 2024-02-28T23:15:20.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.388+0000 7fb371200700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb36c100da0 0x7fb36c19c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:15:20.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.388+0000 7fb36be00700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb36c101750 0x7fb36c19cae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb35800d900 tx=0x7fb35800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:20.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.388+0000 7fb369600700 1 -- 172.21.15.159:0/3615802337 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb358009900 con 0x7fb36c101750 2024-02-28T23:15:20.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.388+0000 7fb369600700 1 -- 172.21.15.159:0/3615802337 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb358010460 con 0x7fb36c101750 2024-02-28T23:15:20.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.388+0000 7fb373c00700 1 -- 172.21.15.159:0/3615802337 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36c196900 con 0x7fb36c101750 2024-02-28T23:15:20.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.388+0000 7fb369600700 1 -- 172.21.15.159:0/3615802337 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb35800f5f0 con 0x7fb36c101750 2024-02-28T23:15:20.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.388+0000 7fb373c00700 1 -- 172.21.15.159:0/3615802337 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36c196e50 con 0x7fb36c101750 2024-02-28T23:15:20.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.389+0000 7fb373c00700 1 -- 172.21.15.159:0/3615802337 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36c109140 con 0x7fb36c101750 2024-02-28T23:15:20.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.390+0000 7fb369600700 1 -- 172.21.15.159:0/3615802337 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fb3580105d0 con 0x7fb36c101750 2024-02-28T23:15:20.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.392+0000 7fb369600700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb35406d8a0 0x7fb35406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:20.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.392+0000 7fb369600700 1 -- 172.21.15.159:0/3615802337 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fb35808d3b0 con 0x7fb36c101750 2024-02-28T23:15:20.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.392+0000 7fb371200700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb35406d8a0 0x7fb35406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:20.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.393+0000 7fb371200700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb35406d8a0 0x7fb35406fd60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb360006010 tx=0x7fb36000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:20.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.396+0000 7fb369600700 1 -- 172.21.15.159:0/3615802337 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb35805a630 con 0x7fb36c101750 2024-02-28T23:15:20.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:20 smithi159 ceph-mon[113833]: pgmap v98: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 0 B/s, 219 objects/s recovering 2024-02-28T23:15:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:20 smithi184 ceph-mon[86482]: pgmap v98: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 2 op/s; 0 B/s, 219 objects/s recovering 2024-02-28T23:15:20.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.627+0000 7fb373c00700 1 -- 172.21.15.159:0/3615802337 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb36c197100 con 0x7fb35406d8a0 2024-02-28T23:15:20.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.644+0000 7fb369600700 1 -- 172.21.15.159:0/3615802337 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7fb36c197100 con 0x7fb35406d8a0 2024-02-28T23:15:20.644 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:15:20.644 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (4m) 12s ago 19m 13.7M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:15:20.644 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (19m) 12s ago 19m 8544k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:15:20.644 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (17m) 47s ago 17m 8108k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (60s) 12s ago 19m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (52s) 47s ago 17m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (4m) 12s ago 18m 74.8M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (11m) 12s ago 11m 147M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (11m) 12s ago 11m 86.9M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (11m) 47s ago 11m 17.6M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (11m) 47s ago 11m 17.5M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (7m) 12s ago 20m 498M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (6m) 47s ago 17m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (2m) 12s ago 21m 45.9M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (2m) 47s ago 17m 32.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (6m) 12s ago 19m 7872k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (5m) 47s ago 17m 8174k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (21s) 12s ago 16m 11.4M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:15:20.645 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (16m) 12s ago 16m 323M 1217M 18.2.1 5be31c24972a c761dbc91b15 2024-02-28T23:15:20.646 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (15m) 12s ago 15m 227M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:15:20.646 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (14m) 47s ago 14m 300M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:15:20.646 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (14m) 47s ago 14m 251M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:15:20.646 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (13m) 47s ago 13m 230M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:15:20.646 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (5m) 12s ago 18m 51.9M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:15:20.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.647+0000 7fb373c00700 1 -- 172.21.15.159:0/3615802337 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb35406d8a0 msgr2=0x7fb35406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:20.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.647+0000 7fb373c00700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb35406d8a0 0x7fb35406fd60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb360006010 tx=0x7fb36000b540 comp rx=0 tx=0).stop 2024-02-28T23:15:20.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.647+0000 7fb373c00700 1 -- 172.21.15.159:0/3615802337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb36c101750 msgr2=0x7fb36c19cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:20.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.647+0000 7fb373c00700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb36c101750 0x7fb36c19cae0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb35800d900 tx=0x7fb35800dcc0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.647+0000 7fb373c00700 1 -- 172.21.15.159:0/3615802337 shutdown_connections 2024-02-28T23:15:20.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.647+0000 7fb373c00700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb36c100da0 0x7fb36c19c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.647+0000 7fb373c00700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb35406d8a0 0x7fb35406fd60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.647+0000 7fb373c00700 1 --2- 172.21.15.159:0/3615802337 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb36c101750 0x7fb36c19cae0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.647+0000 7fb373c00700 1 -- 172.21.15.159:0/3615802337 >> 172.21.15.159:0/3615802337 conn(0x7fb36c0fc630 msgr2=0x7fb36c0fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:20.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.648+0000 7fb373c00700 1 -- 172.21.15.159:0/3615802337 shutdown_connections 2024-02-28T23:15:20.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.648+0000 7fb373c00700 1 -- 172.21.15.159:0/3615802337 wait complete. 2024-02-28T23:15:20.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.797+0000 7fe604000700 1 -- 172.21.15.159:0/1827021851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5fc103980 msgr2=0x7fe5fc1079d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:20.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.797+0000 7fe604000700 1 --2- 172.21.15.159:0/1827021851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5fc103980 0x7fe5fc1079d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe5e8009910 tx=0x7fe5e8009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:20.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.797+0000 7fe604000700 1 -- 172.21.15.159:0/1827021851 shutdown_connections 2024-02-28T23:15:20.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.797+0000 7fe604000700 1 --2- 172.21.15.159:0/1827021851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5fc103980 0x7fe5fc1079d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.797+0000 7fe604000700 1 --2- 172.21.15.159:0/1827021851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5fc102fd0 0x7fe5fc1033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.797+0000 7fe604000700 1 -- 172.21.15.159:0/1827021851 >> 172.21.15.159:0/1827021851 conn(0x7fe5fc0fe840 msgr2=0x7fe5fc100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:20.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.797+0000 7fe604000700 1 -- 172.21.15.159:0/1827021851 shutdown_connections 2024-02-28T23:15:20.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.797+0000 7fe604000700 1 -- 172.21.15.159:0/1827021851 wait complete. 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.798+0000 7fe604000700 1 Processor -- start 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.798+0000 7fe604000700 1 -- start start 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.799+0000 7fe604000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5fc102fd0 0x7fe5fc198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.799+0000 7fe604000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5fc103980 0x7fe5fc198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.799+0000 7fe604000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc199530 con 0x7fe5fc103980 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.799+0000 7fe604000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc19d340 con 0x7fe5fc102fd0 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.799+0000 7fe600c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5fc103980 0x7fe5fc198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.799+0000 7fe600c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5fc103980 0x7fe5fc198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37856/0 (socket says 172.21.15.159:37856) 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.799+0000 7fe600c00700 1 -- 172.21.15.159:0/112387352 learned_addr learned my addr 172.21.15.159:0/112387352 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.799+0000 7fe601600700 1 --2- 172.21.15.159:0/112387352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5fc102fd0 0x7fe5fc198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.799+0000 7fe600c00700 1 -- 172.21.15.159:0/112387352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5fc102fd0 msgr2=0x7fe5fc198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.799+0000 7fe600c00700 1 --2- 172.21.15.159:0/112387352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5fc102fd0 0x7fe5fc198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:20.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.799+0000 7fe600c00700 1 -- 172.21.15.159:0/112387352 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e80095f0 con 0x7fe5fc103980 2024-02-28T23:15:20.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.800+0000 7fe600c00700 1 --2- 172.21.15.159:0/112387352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5fc103980 0x7fe5fc198ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800bda0 tx=0x7fe5e800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:20.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.800+0000 7fe5fa000700 1 -- 172.21.15.159:0/112387352 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5e801d070 con 0x7fe5fc103980 2024-02-28T23:15:20.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.800+0000 7fe5fa000700 1 -- 172.21.15.159:0/112387352 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe5e800f460 con 0x7fe5fc103980 2024-02-28T23:15:20.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.800+0000 7fe604000700 1 -- 172.21.15.159:0/112387352 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc19d5c0 con 0x7fe5fc103980 2024-02-28T23:15:20.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.800+0000 7fe5fa000700 1 -- 172.21.15.159:0/112387352 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5e8017610 con 0x7fe5fc103980 2024-02-28T23:15:20.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.800+0000 7fe604000700 1 -- 172.21.15.159:0/112387352 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc19dab0 con 0x7fe5fc103980 2024-02-28T23:15:20.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.801+0000 7fe604000700 1 -- 172.21.15.159:0/112387352 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc10b2e0 con 0x7fe5fc103980 2024-02-28T23:15:20.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.803+0000 7fe5fa000700 1 -- 172.21.15.159:0/112387352 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe5e800fa40 con 0x7fe5fc103980 2024-02-28T23:15:20.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.804+0000 7fe5fa000700 1 --2- 172.21.15.159:0/112387352 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe5e406d8a0 0x7fe5e406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:20.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.804+0000 7fe5fa000700 1 -- 172.21.15.159:0/112387352 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fe5e808ecd0 con 0x7fe5fc103980 2024-02-28T23:15:20.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.804+0000 7fe601600700 1 --2- 172.21.15.159:0/112387352 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe5e406d8a0 0x7fe5e406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:20.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.805+0000 7fe601600700 1 --2- 172.21.15.159:0/112387352 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe5e406d8a0 0x7fe5e406fd60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0005950 tx=0x7fe5f00058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:20.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:20.807+0000 7fe5fa000700 1 -- 172.21.15.159:0/112387352 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe5e805bf30 con 0x7fe5fc103980 2024-02-28T23:15:21.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.102+0000 7fe604000700 1 -- 172.21.15.159:0/112387352 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe5fc04ea90 con 0x7fe5fc103980 2024-02-28T23:15:21.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.103+0000 7fe5fa000700 1 -- 172.21.15.159:0/112387352 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fe5e805bac0 con 0x7fe5fc103980 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 5, 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:15:21.103 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:15:21.104 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:15:21.104 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:15:21.104 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 9, 2024-02-28T23:15:21.104 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-02-28T23:15:21.104 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:15:21.104 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:15:21.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.106+0000 7fe604000700 1 -- 172.21.15.159:0/112387352 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe5e406d8a0 msgr2=0x7fe5e406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:21.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.106+0000 7fe604000700 1 --2- 172.21.15.159:0/112387352 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe5e406d8a0 0x7fe5e406fd60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe5f0005950 tx=0x7fe5f00058e0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.106+0000 7fe604000700 1 -- 172.21.15.159:0/112387352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5fc103980 msgr2=0x7fe5fc198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:21.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.106+0000 7fe604000700 1 --2- 172.21.15.159:0/112387352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5fc103980 0x7fe5fc198ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800bda0 tx=0x7fe5e800be80 comp rx=0 tx=0).stop 2024-02-28T23:15:21.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.106+0000 7fe604000700 1 -- 172.21.15.159:0/112387352 shutdown_connections 2024-02-28T23:15:21.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.106+0000 7fe604000700 1 --2- 172.21.15.159:0/112387352 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5fc102fd0 0x7fe5fc198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.106+0000 7fe604000700 1 --2- 172.21.15.159:0/112387352 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe5e406d8a0 0x7fe5e406fd60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.106+0000 7fe604000700 1 --2- 172.21.15.159:0/112387352 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5fc103980 0x7fe5fc198ea0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.106+0000 7fe604000700 1 -- 172.21.15.159:0/112387352 >> 172.21.15.159:0/112387352 conn(0x7fe5fc0fe840 msgr2=0x7fe5fc107240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:21.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.106+0000 7fe604000700 1 -- 172.21.15.159:0/112387352 shutdown_connections 2024-02-28T23:15:21.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.106+0000 7fe604000700 1 -- 172.21.15.159:0/112387352 wait complete. 2024-02-28T23:15:21.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.267+0000 7f9ddc800700 1 -- 172.21.15.159:0/2878802389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd4101750 msgr2=0x7f9dd41057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:21.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.267+0000 7f9ddc800700 1 --2- 172.21.15.159:0/2878802389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd4101750 0x7f9dd41057a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4009910 tx=0x7f9dc4009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.268+0000 7f9ddc800700 1 -- 172.21.15.159:0/2878802389 shutdown_connections 2024-02-28T23:15:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.268+0000 7f9ddc800700 1 --2- 172.21.15.159:0/2878802389 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd4101750 0x7f9dd41057a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.268+0000 7f9ddc800700 1 --2- 172.21.15.159:0/2878802389 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dd4100da0 0x7f9dd4101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.268+0000 7f9ddc800700 1 -- 172.21.15.159:0/2878802389 >> 172.21.15.159:0/2878802389 conn(0x7f9dd40fc630 msgr2=0x7f9dd40fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.268+0000 7f9ddc800700 1 -- 172.21.15.159:0/2878802389 shutdown_connections 2024-02-28T23:15:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.268+0000 7f9ddc800700 1 -- 172.21.15.159:0/2878802389 wait complete. 2024-02-28T23:15:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.269+0000 7f9ddc800700 1 Processor -- start 2024-02-28T23:15:21.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.270+0000 7f9ddc800700 1 -- start start 2024-02-28T23:15:21.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.270+0000 7f9ddc800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd4100da0 0x7f9dd4198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:21.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.270+0000 7f9ddc800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dd4101750 0x7f9dd4198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:21.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.270+0000 7f9ddc800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd4199520 con 0x7f9dd4100da0 2024-02-28T23:15:21.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.270+0000 7f9ddc800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd419d330 con 0x7f9dd4101750 2024-02-28T23:15:21.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.270+0000 7f9dd9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd4100da0 0x7f9dd4198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:21.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.270+0000 7f9dd9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd4100da0 0x7f9dd4198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37878/0 (socket says 172.21.15.159:37878) 2024-02-28T23:15:21.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.270+0000 7f9dd9e00700 1 -- 172.21.15.159:0/2930279742 learned_addr learned my addr 172.21.15.159:0/2930279742 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:21.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.271+0000 7f9dd9400700 1 --2- 172.21.15.159:0/2930279742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dd4101750 0x7f9dd4198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:21.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.271+0000 7f9dd9e00700 1 -- 172.21.15.159:0/2930279742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dd4101750 msgr2=0x7f9dd4198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:21.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.271+0000 7f9dd9e00700 1 --2- 172.21.15.159:0/2930279742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dd4101750 0x7f9dd4198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.271+0000 7f9dd9e00700 1 -- 172.21.15.159:0/2930279742 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc40095f0 con 0x7f9dd4100da0 2024-02-28T23:15:21.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.271+0000 7f9dd9e00700 1 --2- 172.21.15.159:0/2930279742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd4100da0 0x7f9dd4198950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c8a0 tx=0x7f9dc800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:21.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.271+0000 7f9dcea00700 1 -- 172.21.15.159:0/2930279742 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dc800cea0 con 0x7f9dd4100da0 2024-02-28T23:15:21.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.271+0000 7f9dcea00700 1 -- 172.21.15.159:0/2930279742 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9dc8004830 con 0x7f9dd4100da0 2024-02-28T23:15:21.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.272+0000 7f9ddc800700 1 -- 172.21.15.159:0/2930279742 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd419d610 con 0x7f9dd4100da0 2024-02-28T23:15:21.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.272+0000 7f9ddc800700 1 -- 172.21.15.159:0/2930279742 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd419db60 con 0x7f9dd4100da0 2024-02-28T23:15:21.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.272+0000 7f9dcea00700 1 -- 172.21.15.159:0/2930279742 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dc80055b0 con 0x7f9dd4100da0 2024-02-28T23:15:21.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.273+0000 7f9ddc800700 1 -- 172.21.15.159:0/2930279742 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9db8005320 con 0x7f9dd4100da0 2024-02-28T23:15:21.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.274+0000 7f9dcea00700 1 -- 172.21.15.159:0/2930279742 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9dc80049a0 con 0x7f9dd4100da0 2024-02-28T23:15:21.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.275+0000 7f9dcea00700 1 --2- 172.21.15.159:0/2930279742 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9dbc06d8a0 0x7f9dbc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:21.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.276+0000 7f9dcea00700 1 -- 172.21.15.159:0/2930279742 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f9dc808d120 con 0x7f9dd4100da0 2024-02-28T23:15:21.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.276+0000 7f9dd9400700 1 --2- 172.21.15.159:0/2930279742 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9dbc06d8a0 0x7f9dbc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:21.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.276+0000 7f9dd9400700 1 --2- 172.21.15.159:0/2930279742 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9dbc06d8a0 0x7f9dbc06fd60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400b5c0 tx=0x7f9dc4005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:21.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.280+0000 7f9dcea00700 1 -- 172.21.15.159:0/2930279742 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9dc805a420 con 0x7f9dd4100da0 2024-02-28T23:15:21.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:21 smithi159 ceph-mon[113833]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:21.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:21 smithi159 ceph-mon[113833]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:21.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:21 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/112387352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:15:21.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.531+0000 7f9ddc800700 1 -- 172.21.15.159:0/2930279742 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9db8006200 con 0x7f9dd4100da0 2024-02-28T23:15:21.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.531+0000 7f9dcea00700 1 -- 172.21.15.159:0/2930279742 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f9dc801d770 con 0x7f9dd4100da0 2024-02-28T23:15:21.531 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:15:21.531 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:15:21.531 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:15:21.531 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:15:21.531 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:15:21.531 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:15:21.531 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:15:21.532 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:15:21.533 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:15:21.534 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:15:21.534 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:15:21.534 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:15:21.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.535+0000 7f9ddc800700 1 -- 172.21.15.159:0/2930279742 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9dbc06d8a0 msgr2=0x7f9dbc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:21.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.535+0000 7f9ddc800700 1 --2- 172.21.15.159:0/2930279742 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9dbc06d8a0 0x7f9dbc06fd60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400b5c0 tx=0x7f9dc4005fd0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.535+0000 7f9ddc800700 1 -- 172.21.15.159:0/2930279742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd4100da0 msgr2=0x7f9dd4198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:21.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.535+0000 7f9ddc800700 1 --2- 172.21.15.159:0/2930279742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd4100da0 0x7f9dd4198950 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800c8a0 tx=0x7f9dc800cc60 comp rx=0 tx=0).stop 2024-02-28T23:15:21.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.535+0000 7f9ddc800700 1 -- 172.21.15.159:0/2930279742 shutdown_connections 2024-02-28T23:15:21.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.535+0000 7f9ddc800700 1 --2- 172.21.15.159:0/2930279742 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9dbc06d8a0 0x7f9dbc06fd60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.535+0000 7f9ddc800700 1 --2- 172.21.15.159:0/2930279742 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dd4100da0 0x7f9dd4198950 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.535+0000 7f9ddc800700 1 --2- 172.21.15.159:0/2930279742 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9dd4101750 0x7f9dd4198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.535+0000 7f9ddc800700 1 -- 172.21.15.159:0/2930279742 >> 172.21.15.159:0/2930279742 conn(0x7f9dd40fc630 msgr2=0x7f9dd40fe9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:21.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.536+0000 7f9ddc800700 1 -- 172.21.15.159:0/2930279742 shutdown_connections 2024-02-28T23:15:21.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.536+0000 7f9ddc800700 1 -- 172.21.15.159:0/2930279742 wait complete. 2024-02-28T23:15:21.537 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:15:21.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:21 smithi184 ceph-mon[86482]: from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:21.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:21 smithi184 ceph-mon[86482]: from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:21.560 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:21 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/112387352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:15:21.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.687+0000 7f7bb2a00700 1 -- 172.21.15.159:0/3167649922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac1009c0 msgr2=0x7f7bac100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:21.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.687+0000 7f7bb2a00700 1 --2- 172.21.15.159:0/3167649922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac1009c0 0x7f7bac100e40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0009910 tx=0x7f7ba0009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:21.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.687+0000 7f7bb2a00700 1 -- 172.21.15.159:0/3167649922 shutdown_connections 2024-02-28T23:15:21.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.687+0000 7f7bb2a00700 1 --2- 172.21.15.159:0/3167649922 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac1009c0 0x7f7bac100e40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.687+0000 7f7bb2a00700 1 --2- 172.21.15.159:0/3167649922 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bac1069c0 0x7f7bac106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.687+0000 7f7bb2a00700 1 -- 172.21.15.159:0/3167649922 >> 172.21.15.159:0/3167649922 conn(0x7f7bac0fc4d0 msgr2=0x7f7bac0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:21.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.687+0000 7f7bb2a00700 1 -- 172.21.15.159:0/3167649922 shutdown_connections 2024-02-28T23:15:21.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.688+0000 7f7bb2a00700 1 -- 172.21.15.159:0/3167649922 wait complete. 2024-02-28T23:15:21.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.688+0000 7f7bb2a00700 1 Processor -- start 2024-02-28T23:15:21.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.689+0000 7f7bb2a00700 1 -- start start 2024-02-28T23:15:21.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.689+0000 7f7bb2a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bac1009c0 0x7f7bac196590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:21.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.689+0000 7f7bb2a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac1069c0 0x7f7bac196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:21.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.689+0000 7f7bb2a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac197120 con 0x7f7bac1069c0 2024-02-28T23:15:21.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.689+0000 7f7bb2a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bac197260 con 0x7f7bac1009c0 2024-02-28T23:15:21.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.689+0000 7f7bb0c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac1069c0 0x7f7bac196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:21.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.689+0000 7f7bb0c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac1069c0 0x7f7bac196ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37898/0 (socket says 172.21.15.159:37898) 2024-02-28T23:15:21.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.689+0000 7f7bb0c00700 1 -- 172.21.15.159:0/1389563462 learned_addr learned my addr 172.21.15.159:0/1389563462 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:21.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.690+0000 7f7bb0c00700 1 -- 172.21.15.159:0/1389563462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bac1009c0 msgr2=0x7f7bac196590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:21.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.690+0000 7f7bb0c00700 1 --2- 172.21.15.159:0/1389563462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bac1009c0 0x7f7bac196590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.690+0000 7f7bb0c00700 1 -- 172.21.15.159:0/1389563462 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba00095f0 con 0x7f7bac1069c0 2024-02-28T23:15:21.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.690+0000 7f7bb0c00700 1 --2- 172.21.15.159:0/1389563462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac1069c0 0x7f7bac196ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0006010 tx=0x7f7ba000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:21.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.690+0000 7f7baa000700 1 -- 172.21.15.159:0/1389563462 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ba001d070 con 0x7f7bac1069c0 2024-02-28T23:15:21.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.690+0000 7f7baa000700 1 -- 172.21.15.159:0/1389563462 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7ba0004fb0 con 0x7f7bac1069c0 2024-02-28T23:15:21.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.690+0000 7f7bb2a00700 1 -- 172.21.15.159:0/1389563462 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac19b050 con 0x7f7bac1069c0 2024-02-28T23:15:21.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.690+0000 7f7baa000700 1 -- 172.21.15.159:0/1389563462 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ba0022ea0 con 0x7f7bac1069c0 2024-02-28T23:15:21.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.690+0000 7f7bb2a00700 1 -- 172.21.15.159:0/1389563462 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bac19b540 con 0x7f7bac1069c0 2024-02-28T23:15:21.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.691+0000 7f7bb2a00700 1 -- 172.21.15.159:0/1389563462 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bac04f2e0 con 0x7f7bac1069c0 2024-02-28T23:15:21.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.692+0000 7f7baa000700 1 -- 172.21.15.159:0/1389563462 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f7ba0022470 con 0x7f7bac1069c0 2024-02-28T23:15:21.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.693+0000 7f7baa000700 1 --2- 172.21.15.159:0/1389563462 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7b9406d8a0 0x7f7b9406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:21.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.693+0000 7f7baa000700 1 -- 172.21.15.159:0/1389563462 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f7ba008ed00 con 0x7f7bac1069c0 2024-02-28T23:15:21.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.694+0000 7f7bb1600700 1 --2- 172.21.15.159:0/1389563462 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7b9406d8a0 0x7f7b9406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:21.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.694+0000 7f7bb1600700 1 --2- 172.21.15.159:0/1389563462 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7b9406d8a0 0x7f7b9406fd60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c005fd0 tx=0x7f7b9c005d00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:21.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.698+0000 7f7baa000700 1 -- 172.21.15.159:0/1389563462 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7ba0058580 con 0x7f7bac1069c0 2024-02-28T23:15:21.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.919+0000 7f7bb2a00700 1 -- 172.21.15.159:0/1389563462 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bac108c20 con 0x7f7b9406d8a0 2024-02-28T23:15:21.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.921+0000 7f7baa000700 1 -- 172.21.15.159:0/1389563462 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7bac108c20 con 0x7f7b9406d8a0 2024-02-28T23:15:21.921 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:15:21.921 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:15:21.921 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:15:21.921 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:15:21.921 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:15:21.921 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-02-28T23:15:21.921 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:15:21.921 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:15:21.921 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:15:21.922 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "7/23 daemons upgraded", 2024-02-28T23:15:21.922 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T23:15:21.922 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:15:21.922 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:15:21.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.924+0000 7f7bb2a00700 1 -- 172.21.15.159:0/1389563462 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7b9406d8a0 msgr2=0x7f7b9406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:21.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.924+0000 7f7bb2a00700 1 --2- 172.21.15.159:0/1389563462 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7b9406d8a0 0x7f7b9406fd60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c005fd0 tx=0x7f7b9c005d00 comp rx=0 tx=0).stop 2024-02-28T23:15:21.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.924+0000 7f7bb2a00700 1 -- 172.21.15.159:0/1389563462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac1069c0 msgr2=0x7f7bac196ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:21.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.924+0000 7f7bb2a00700 1 --2- 172.21.15.159:0/1389563462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac1069c0 0x7f7bac196ad0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0006010 tx=0x7f7ba000be20 comp rx=0 tx=0).stop 2024-02-28T23:15:21.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.924+0000 7f7bb2a00700 1 -- 172.21.15.159:0/1389563462 shutdown_connections 2024-02-28T23:15:21.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.924+0000 7f7bb2a00700 1 --2- 172.21.15.159:0/1389563462 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7bac1009c0 0x7f7bac196590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.924+0000 7f7bb2a00700 1 --2- 172.21.15.159:0/1389563462 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7b9406d8a0 0x7f7b9406fd60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.924+0000 7f7bb2a00700 1 --2- 172.21.15.159:0/1389563462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac1069c0 0x7f7bac196ad0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:21.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.924+0000 7f7bb2a00700 1 -- 172.21.15.159:0/1389563462 >> 172.21.15.159:0/1389563462 conn(0x7f7bac0fc4d0 msgr2=0x7f7bac0fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:21.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.924+0000 7f7bb2a00700 1 -- 172.21.15.159:0/1389563462 shutdown_connections 2024-02-28T23:15:21.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:21.925+0000 7f7bb2a00700 1 -- 172.21.15.159:0/1389563462 wait complete. 2024-02-28T23:15:22.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.079+0000 7f073f400700 1 -- 172.21.15.159:0/820878707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0738103000 msgr2=0x7f07381033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:22.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.079+0000 7f073f400700 1 --2- 172.21.15.159:0/820878707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0738103000 0x7f07381033e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0728009910 tx=0x7f0728009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:22.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.079+0000 7f073f400700 1 -- 172.21.15.159:0/820878707 shutdown_connections 2024-02-28T23:15:22.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.079+0000 7f073f400700 1 --2- 172.21.15.159:0/820878707 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f07381039b0 0x7f0738107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:22.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.079+0000 7f073f400700 1 --2- 172.21.15.159:0/820878707 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0738103000 0x7f07381033e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:22.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.079+0000 7f073f400700 1 -- 172.21.15.159:0/820878707 >> 172.21.15.159:0/820878707 conn(0x7f07380fe8d0 msgr2=0x7f0738100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:22.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.079+0000 7f073f400700 1 -- 172.21.15.159:0/820878707 shutdown_connections 2024-02-28T23:15:22.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.079+0000 7f073f400700 1 -- 172.21.15.159:0/820878707 wait complete. 2024-02-28T23:15:22.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.080+0000 7f073f400700 1 Processor -- start 2024-02-28T23:15:22.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.080+0000 7f073f400700 1 -- start start 2024-02-28T23:15:22.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.081+0000 7f073f400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0738103000 0x7f073819e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:22.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.081+0000 7f073f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07381039b0 0x7f073819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:22.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.081+0000 7f073f400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073819f3c0 con 0x7f07381039b0 2024-02-28T23:15:22.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.081+0000 7f073f400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0738198870 con 0x7f0738103000 2024-02-28T23:15:22.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.081+0000 7f072fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07381039b0 0x7f073819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:22.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.081+0000 7f072fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07381039b0 0x7f073819ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:37912/0 (socket says 172.21.15.159:37912) 2024-02-28T23:15:22.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.081+0000 7f072fe00700 1 -- 172.21.15.159:0/3380394253 learned_addr learned my addr 172.21.15.159:0/3380394253 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:22.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.081+0000 7f073ca00700 1 --2- 172.21.15.159:0/3380394253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0738103000 0x7f073819e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:22.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.081+0000 7f072fe00700 1 -- 172.21.15.159:0/3380394253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0738103000 msgr2=0x7f073819e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:22.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.081+0000 7f072fe00700 1 --2- 172.21.15.159:0/3380394253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0738103000 0x7f073819e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:22.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.082+0000 7f072fe00700 1 -- 172.21.15.159:0/3380394253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07280095f0 con 0x7f07381039b0 2024-02-28T23:15:22.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.082+0000 7f072fe00700 1 --2- 172.21.15.159:0/3380394253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07381039b0 0x7f073819ed30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f072000d900 tx=0x7f072000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:22.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.082+0000 7f0736000700 1 -- 172.21.15.159:0/3380394253 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0720009900 con 0x7f07381039b0 2024-02-28T23:15:22.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.082+0000 7f0736000700 1 -- 172.21.15.159:0/3380394253 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0720010460 con 0x7f07381039b0 2024-02-28T23:15:22.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.082+0000 7f073f400700 1 -- 172.21.15.159:0/3380394253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0738198b50 con 0x7f07381039b0 2024-02-28T23:15:22.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.082+0000 7f0736000700 1 -- 172.21.15.159:0/3380394253 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f072000f5f0 con 0x7f07381039b0 2024-02-28T23:15:22.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.082+0000 7f073f400700 1 -- 172.21.15.159:0/3380394253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07381990a0 con 0x7f07381039b0 2024-02-28T23:15:22.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.083+0000 7f073f400700 1 -- 172.21.15.159:0/3380394253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f073810b3a0 con 0x7f07381039b0 2024-02-28T23:15:22.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.084+0000 7f0736000700 1 -- 172.21.15.159:0/3380394253 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f0720009c70 con 0x7f07381039b0 2024-02-28T23:15:22.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.085+0000 7f0736000700 1 --2- 172.21.15.159:0/3380394253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f071c06d8a0 0x7f071c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:22.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.085+0000 7f0736000700 1 -- 172.21.15.159:0/3380394253 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f072008cc30 con 0x7f07381039b0 2024-02-28T23:15:22.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.086+0000 7f073ca00700 1 --2- 172.21.15.159:0/3380394253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f071c06d8a0 0x7f071c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:22.085 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.086+0000 7f073ca00700 1 --2- 172.21.15.159:0/3380394253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f071c06d8a0 0x7f071c06fd60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0728006010 tx=0x7f072801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:22.089 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.090+0000 7f0736000700 1 -- 172.21.15.159:0/3380394253 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0720059fd0 con 0x7f07381039b0 2024-02-28T23:15:22.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.395+0000 7f073f400700 1 -- 172.21.15.159:0/3380394253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0738199310 con 0x7f07381039b0 2024-02-28T23:15:22.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.395+0000 7f0736000700 1 -- 172.21.15.159:0/3380394253 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0720059b60 con 0x7f07381039b0 2024-02-28T23:15:22.395 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_OK 2024-02-28T23:15:22.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.399+0000 7f073f400700 1 -- 172.21.15.159:0/3380394253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f071c06d8a0 msgr2=0x7f071c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:22.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.399+0000 7f073f400700 1 --2- 172.21.15.159:0/3380394253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f071c06d8a0 0x7f071c06fd60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0728006010 tx=0x7f072801a040 comp rx=0 tx=0).stop 2024-02-28T23:15:22.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.399+0000 7f073f400700 1 -- 172.21.15.159:0/3380394253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07381039b0 msgr2=0x7f073819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:22.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.399+0000 7f073f400700 1 --2- 172.21.15.159:0/3380394253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07381039b0 0x7f073819ed30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f072000d900 tx=0x7f072000dcc0 comp rx=0 tx=0).stop 2024-02-28T23:15:22.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.399+0000 7f073f400700 1 -- 172.21.15.159:0/3380394253 shutdown_connections 2024-02-28T23:15:22.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.399+0000 7f073f400700 1 --2- 172.21.15.159:0/3380394253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0738103000 0x7f073819e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:22.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.399+0000 7f073f400700 1 --2- 172.21.15.159:0/3380394253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f071c06d8a0 0x7f071c06fd60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:22.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.399+0000 7f073f400700 1 --2- 172.21.15.159:0/3380394253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07381039b0 0x7f073819ed30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:22.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.399+0000 7f073f400700 1 -- 172.21.15.159:0/3380394253 >> 172.21.15.159:0/3380394253 conn(0x7f07380fe8d0 msgr2=0x7f07380ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:22.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.399+0000 7f073f400700 1 -- 172.21.15.159:0/3380394253 shutdown_connections 2024-02-28T23:15:22.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:22.399+0000 7f073f400700 1 -- 172.21.15.159:0/3380394253 wait complete. 2024-02-28T23:15:22.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:22 smithi159 ceph-mon[113833]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:22.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:22 smithi159 ceph-mon[113833]: pgmap v99: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 178 objects/s recovering 2024-02-28T23:15:22.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:22 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2930279742' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:15:22.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:22 smithi184 ceph-mon[86482]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:22.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:22 smithi184 ceph-mon[86482]: pgmap v99: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 0 B/s, 178 objects/s recovering 2024-02-28T23:15:22.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:22 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2930279742' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:15:23.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:23 smithi159 ceph-mon[113833]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:23.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:23 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3380394253' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:15:23.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:23.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:15:23.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:23 smithi184 ceph-mon[86482]: from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:23.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:23 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3380394253' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:15:23.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:23.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:15:24.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:24 smithi159 ceph-mon[113833]: pgmap v100: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 966 B/s rd, 1 op/s; 0 B/s, 149 objects/s recovering 2024-02-28T23:15:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:24 smithi184 ceph-mon[86482]: pgmap v100: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 966 B/s rd, 1 op/s; 0 B/s, 149 objects/s recovering 2024-02-28T23:15:26.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:26 smithi159 ceph-mon[113833]: pgmap v101: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 972 B/s rd, 1 op/s 2024-02-28T23:15:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:26 smithi184 ceph-mon[86482]: pgmap v101: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 972 B/s rd, 1 op/s 2024-02-28T23:15:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:28 smithi159 ceph-mon[113833]: pgmap v102: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:15:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:28 smithi184 ceph-mon[86482]: pgmap v102: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:15:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:30.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:30 smithi159 ceph-mon[113833]: pgmap v103: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:15:30.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:30 smithi184 ceph-mon[86482]: pgmap v103: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:15:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:32 smithi159 ceph-mon[113833]: pgmap v104: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:15:32.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:32 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T23:15:32.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:32 smithi184 ceph-mon[86482]: pgmap v104: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:15:32.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:32 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T23:15:33.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:33 smithi159 ceph-mon[113833]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T23:15:33.524 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:33 smithi159 ceph-mon[113833]: Upgrade: osd.1 is safe to restart 2024-02-28T23:15:33.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:33 smithi184 ceph-mon[86482]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-28T23:15:33.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:33 smithi184 ceph-mon[86482]: Upgrade: osd.1 is safe to restart 2024-02-28T23:15:34.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:34 smithi184 ceph-mon[86482]: pgmap v105: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:15:34.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:34 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:34.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:34 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T23:15:34.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:34 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:15:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:34 smithi159 ceph-mon[113833]: pgmap v105: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:15:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:34 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:34 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-28T23:15:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:34 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:15:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:35 smithi159 ceph-mon[113833]: Upgrade: Updating osd.1 2024-02-28T23:15:35.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:35 smithi159 ceph-mon[113833]: Deploying daemon osd.1 on smithi159 2024-02-28T23:15:35.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:35 smithi184 ceph-mon[86482]: Upgrade: Updating osd.1 2024-02-28T23:15:35.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:35 smithi184 ceph-mon[86482]: Deploying daemon osd.1 on smithi159 2024-02-28T23:15:36.548 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:36 smithi159 ceph-mon[113833]: pgmap v106: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:15:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:36 smithi184 ceph-mon[86482]: pgmap v106: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:15:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:38 smithi184 ceph-mon[86482]: pgmap v107: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:15:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:15:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:38 smithi159 ceph-mon[113833]: pgmap v107: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:15:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:15:39.170 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:38 smithi159 systemd[1]: Stopping Ceph osd.1 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:15:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:39 smithi159 ceph-mon[113833]: osd.1 marked itself down and dead 2024-02-28T23:15:39.473 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:39 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1[55384]: 2024-02-28T23:15:39.170+0000 7fa42c400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:15:39.473 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:39 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1[55384]: 2024-02-28T23:15:39.170+0000 7fa42c400700 -1 osd.1 71 *** Got signal Terminated *** 2024-02-28T23:15:39.473 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:39 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1[55384]: 2024-02-28T23:15:39.170+0000 7fa42c400700 -1 osd.1 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:15:39.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:39 smithi184 ceph-mon[86482]: osd.1 marked itself down and dead 2024-02-28T23:15:40.146 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:39 smithi159 podman[130800]: 2024-02-28 23:15:39.80711201 +0000 UTC m=+0.803653749 container died c761dbc91b15f2a5d844545252719bc9098f8aa8fb370bf0ed58caaa8d5e5402 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222) 2024-02-28T23:15:40.472 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:40 smithi159 podman[130800]: 2024-02-28 23:15:40.355008408 +0000 UTC m=+1.351550174 container cleanup c761dbc91b15f2a5d844545252719bc9098f8aa8fb370bf0ed58caaa8d5e5402 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1) 2024-02-28T23:15:40.472 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:40 smithi159 bash[130800]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1 2024-02-28T23:15:40.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:40 smithi159 ceph-mon[113833]: pgmap v108: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:15:40.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:40 smithi159 ceph-mon[113833]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:15:40.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:40 smithi159 ceph-mon[113833]: osdmap e72: 6 total, 5 up, 6 in 2024-02-28T23:15:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:40 smithi184 ceph-mon[86482]: pgmap v108: 65 pgs: 65 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:15:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:40 smithi184 ceph-mon[86482]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:15:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:40 smithi184 ceph-mon[86482]: osdmap e72: 6 total, 5 up, 6 in 2024-02-28T23:15:40.972 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:40 smithi159 podman[130818]: 2024-02-28 23:15:40.606686153 +0000 UTC m=+0.785932102 container remove c761dbc91b15f2a5d844545252719bc9098f8aa8fb370bf0ed58caaa8d5e5402 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1, maintainer=Guillaume Abrioux , io.buildah.version=1.29.1, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222) 2024-02-28T23:15:41.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:41 smithi159 ceph-mon[113833]: osdmap e73: 6 total, 5 up, 6 in 2024-02-28T23:15:41.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:41 smithi184 ceph-mon[86482]: osdmap e73: 6 total, 5 up, 6 in 2024-02-28T23:15:41.793 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:41 smithi159 podman[130905]: 2024-02-28 23:15:41.390746961 +0000 UTC m=+0.037664512 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:15:41.794 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:41 smithi159 podman[130905]: 2024-02-28 23:15:41.524081397 +0000 UTC m=+0.170998988 container create a4c275b19ca4edebd6f6ec57d30df9eb245e4bfdd9e70ffa112df1dde75dc5b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-02-28T23:15:41.794 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:41 smithi159 podman[130905]: 2024-02-28 23:15:41.794828975 +0000 UTC m=+0.441746610 container init a4c275b19ca4edebd6f6ec57d30df9eb245e4bfdd9e70ffa112df1dde75dc5b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, ceph=True, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:15:42.223 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:41 smithi159 podman[130905]: 2024-02-28 23:15:41.807035824 +0000 UTC m=+0.453953422 container start a4c275b19ca4edebd6f6ec57d30df9eb245e4bfdd9e70ffa112df1dde75dc5b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-28T23:15:42.223 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:41 smithi159 podman[130905]: 2024-02-28 23:15:41.952017147 +0000 UTC m=+0.598934745 container attach a4c275b19ca4edebd6f6ec57d30df9eb245e4bfdd9e70ffa112df1dde75dc5b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T23:15:42.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:42 smithi184 ceph-mon[86482]: pgmap v111: 65 pgs: 11 stale+active+clean, 54 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:15:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:42 smithi159 ceph-mon[113833]: pgmap v111: 65 pgs: 11 stale+active+clean, 54 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:15:42.723 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:42 smithi159 podman[130905]: 2024-02-28 23:15:42.244228724 +0000 UTC m=+0.891146275 container died a4c275b19ca4edebd6f6ec57d30df9eb245e4bfdd9e70ffa112df1dde75dc5b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-02-28T23:15:43.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:43 smithi184 ceph-mon[86482]: Health check failed: Degraded data redundancy: 2/228 objects degraded (0.877%), 2 pgs degraded (PG_DEGRADED) 2024-02-28T23:15:43.695 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:43 smithi159 ceph-mon[113833]: Health check failed: Degraded data redundancy: 2/228 objects degraded (0.877%), 2 pgs degraded (PG_DEGRADED) 2024-02-28T23:15:43.695 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:43 smithi159 podman[130930]: 2024-02-28 23:15:43.289253215 +0000 UTC m=+1.017465166 container remove a4c275b19ca4edebd6f6ec57d30df9eb245e4bfdd9e70ffa112df1dde75dc5b0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10) 2024-02-28T23:15:43.695 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:43 smithi159 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.1.service: Deactivated successfully. 2024-02-28T23:15:43.695 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:43 smithi159 systemd[1]: Stopped Ceph osd.1 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:15:43.696 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:43 smithi159 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.1.service: Consumed 2min 473ms CPU time. 2024-02-28T23:15:43.972 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:43 smithi159 systemd[1]: Starting Ceph osd.1 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:15:44.330 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:44 smithi159 podman[131034]: 2024-02-28 23:15:43.947460743 +0000 UTC m=+0.031521171 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:15:44.330 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:44 smithi159 podman[131034]: 2024-02-28 23:15:44.073764368 +0000 UTC m=+0.157824830 container create 823680c408e513e361d8c6b93980adbd6643b77572ef9ac98dde635ebe446993 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T23:15:44.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:44 smithi184 ceph-mon[86482]: pgmap v112: 65 pgs: 3 active+undersized, 2 active+undersized+degraded, 8 stale+active+clean, 52 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 2/228 objects degraded (0.877%) 2024-02-28T23:15:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:44 smithi159 ceph-mon[113833]: pgmap v112: 65 pgs: 3 active+undersized, 2 active+undersized+degraded, 8 stale+active+clean, 52 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 2/228 objects degraded (0.877%) 2024-02-28T23:15:44.723 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:44 smithi159 podman[131034]: 2024-02-28 23:15:44.403441866 +0000 UTC m=+0.487502334 container init 823680c408e513e361d8c6b93980adbd6643b77572ef9ac98dde635ebe446993 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:15:44.723 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:44 smithi159 podman[131034]: 2024-02-28 23:15:44.41583205 +0000 UTC m=+0.499892516 container start 823680c408e513e361d8c6b93980adbd6643b77572ef9ac98dde635ebe446993 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, ceph=True) 2024-02-28T23:15:44.723 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:44 smithi159 podman[131034]: 2024-02-28 23:15:44.493121532 +0000 UTC m=+0.577182038 container attach 823680c408e513e361d8c6b93980adbd6643b77572ef9ac98dde635ebe446993 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=) 2024-02-28T23:15:45.721 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate[131048]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T23:15:45.721 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate[131048]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T23:15:45.721 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 bash[131034]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T23:15:45.721 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 bash[131034]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T23:15:45.721 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 bash[131034]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T23:15:45.721 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 bash[131034]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T23:15:45.721 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 bash[131034]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-28T23:15:45.721 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 bash[131034]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T23:15:45.722 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 bash[131034]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-28T23:15:45.722 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate[131048]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T23:15:45.722 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate[131048]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T23:15:45.722 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate[131048]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-28T23:15:45.722 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate[131048]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-28T23:15:45.722 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate[131048]: --> ceph-volume raw activate successful for osd ID: 1 2024-02-28T23:15:45.722 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:45 smithi159 podman[131034]: 2024-02-28 23:15:45.325580538 +0000 UTC m=+1.409641007 container died 823680c408e513e361d8c6b93980adbd6643b77572ef9ac98dde635ebe446993 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate, ceph=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-02-28T23:15:46.334 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:46 smithi159 podman[131188]: 2024-02-28 23:15:46.11337714 +0000 UTC m=+0.766711346 container remove 823680c408e513e361d8c6b93980adbd6643b77572ef9ac98dde635ebe446993 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-28T23:15:46.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:46 smithi184 ceph-mon[86482]: pgmap v113: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:46.613 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:46 smithi159 podman[131251]: 2024-02-28 23:15:46.447712955 +0000 UTC m=+0.127856882 container create 9120e23d80c04a18f729568efc6a8f0a94e42f3b4d439d1f27a1907087d81e0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-02-28T23:15:46.613 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:46 smithi159 podman[131251]: 2024-02-28 23:15:46.355961637 +0000 UTC m=+0.036105534 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:15:46.613 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:46 smithi159 ceph-mon[113833]: pgmap v113: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:47.077 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:46 smithi159 podman[131251]: 2024-02-28 23:15:46.75362617 +0000 UTC m=+0.433770117 container init 9120e23d80c04a18f729568efc6a8f0a94e42f3b4d439d1f27a1907087d81e0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True) 2024-02-28T23:15:47.077 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:46 smithi159 podman[131251]: 2024-02-28 23:15:46.764821147 +0000 UTC m=+0.444965047 container start 9120e23d80c04a18f729568efc6a8f0a94e42f3b4d439d1f27a1907087d81e0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-02-28T23:15:47.077 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:46 smithi159 ceph-osd[131270]: -- 172.21.15.159:0/3764456903 <== mon.0 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c307ab1680 con 0x55c307a7ac00 2024-02-28T23:15:47.077 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:46 smithi159 bash[131251]: 9120e23d80c04a18f729568efc6a8f0a94e42f3b4d439d1f27a1907087d81e0d 2024-02-28T23:15:47.077 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:46 smithi159 systemd[1]: Started Ceph osd.1 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:15:47.722 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:47 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1[131266]: 2024-02-28T23:15:47.329+0000 7f03f42437c0 -1 Falling back to public interface 2024-02-28T23:15:48.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:48.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:48.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:15:48.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:48 smithi184 ceph-mon[86482]: pgmap v114: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T23:15:48.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:48.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:15:48.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:48 smithi159 ceph-mon[113833]: pgmap v114: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 28/228 objects degraded (12.281%) 2024-02-28T23:15:48.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:48.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:49.335 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:49 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 28/228 objects degraded (12.281%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T23:15:49.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:49 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 28/228 objects degraded (12.281%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T23:15:50.345 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:50 smithi159 ceph-mon[113833]: pgmap v115: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:50.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:50 smithi184 ceph-mon[86482]: pgmap v115: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:52.355 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:52 smithi159 ceph-mon[113833]: pgmap v116: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:52.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.568+0000 7f1a86400700 1 -- 172.21.15.159:0/2050002293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a80068670 msgr2=0x7f1a80068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:52.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.568+0000 7f1a86400700 1 --2- 172.21.15.159:0/2050002293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a80068670 0x7f1a80068a50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a70009910 tx=0x7f1a70009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:52.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.569+0000 7f1a86400700 1 -- 172.21.15.159:0/2050002293 shutdown_connections 2024-02-28T23:15:52.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.569+0000 7f1a86400700 1 --2- 172.21.15.159:0/2050002293 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a80069020 0x7f1a80105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:52.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.569+0000 7f1a86400700 1 --2- 172.21.15.159:0/2050002293 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a80068670 0x7f1a80068a50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:52.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.569+0000 7f1a86400700 1 -- 172.21.15.159:0/2050002293 >> 172.21.15.159:0/2050002293 conn(0x7f1a800755a0 msgr2=0x7f1a800759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:52.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.569+0000 7f1a86400700 1 -- 172.21.15.159:0/2050002293 shutdown_connections 2024-02-28T23:15:52.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.569+0000 7f1a86400700 1 -- 172.21.15.159:0/2050002293 wait complete. 2024-02-28T23:15:52.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.570+0000 7f1a86400700 1 Processor -- start 2024-02-28T23:15:52.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.570+0000 7f1a86400700 1 -- start start 2024-02-28T23:15:52.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.571+0000 7f1a86400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a80068670 0x7f1a800ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:52.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.571+0000 7f1a86400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a80069020 0x7f1a801001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:52.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.571+0000 7f1a86400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a80100720 con 0x7f1a80068670 2024-02-28T23:15:52.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.571+0000 7f1a86400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a80100860 con 0x7f1a80069020 2024-02-28T23:15:52.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.571+0000 7f1a7f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a80068670 0x7f1a800ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:52.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.571+0000 7f1a7f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a80068670 0x7f1a800ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54720/0 (socket says 172.21.15.159:54720) 2024-02-28T23:15:52.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.571+0000 7f1a7f400700 1 -- 172.21.15.159:0/3846494050 learned_addr learned my addr 172.21.15.159:0/3846494050 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:52.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.571+0000 7f1a7ea00700 1 --2- 172.21.15.159:0/3846494050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a80069020 0x7f1a801001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:52.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.571+0000 7f1a7f400700 1 -- 172.21.15.159:0/3846494050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a80069020 msgr2=0x7f1a801001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:52.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.571+0000 7f1a7f400700 1 --2- 172.21.15.159:0/3846494050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a80069020 0x7f1a801001e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:52.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.571+0000 7f1a7f400700 1 -- 172.21.15.159:0/3846494050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a700095f0 con 0x7f1a80068670 2024-02-28T23:15:52.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.572+0000 7f1a7f400700 1 --2- 172.21.15.159:0/3846494050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a80068670 0x7f1a800ffca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a700059d0 tx=0x7f1a7000be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:52.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.572+0000 7f1a77e00700 1 -- 172.21.15.159:0/3846494050 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7001d070 con 0x7f1a80068670 2024-02-28T23:15:52.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.572+0000 7f1a77e00700 1 -- 172.21.15.159:0/3846494050 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1a70004fb0 con 0x7f1a80068670 2024-02-28T23:15:52.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.573+0000 7f1a86400700 1 -- 172.21.15.159:0/3846494050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a80100ae0 con 0x7f1a80068670 2024-02-28T23:15:52.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.573+0000 7f1a77e00700 1 -- 172.21.15.159:0/3846494050 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a7000f460 con 0x7f1a80068670 2024-02-28T23:15:52.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.573+0000 7f1a86400700 1 -- 172.21.15.159:0/3846494050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a801a2c40 con 0x7f1a80068670 2024-02-28T23:15:52.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.574+0000 7f1a86400700 1 -- 172.21.15.159:0/3846494050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a80109130 con 0x7f1a80068670 2024-02-28T23:15:52.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.575+0000 7f1a77e00700 1 -- 172.21.15.159:0/3846494050 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f1a70022890 con 0x7f1a80068670 2024-02-28T23:15:52.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.577+0000 7f1a77e00700 1 --2- 172.21.15.159:0/3846494050 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1a6406d8a0 0x7f1a6406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:52.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.577+0000 7f1a77e00700 1 -- 172.21.15.159:0/3846494050 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f1a7008ec20 con 0x7f1a80068670 2024-02-28T23:15:52.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.577+0000 7f1a7ea00700 1 --2- 172.21.15.159:0/3846494050 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1a6406d8a0 0x7f1a6406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:52.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.578+0000 7f1a7ea00700 1 --2- 172.21.15.159:0/3846494050 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1a6406d8a0 0x7f1a6406fd60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a80101490 tx=0x7f1a6c005cf0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:52.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.583+0000 7f1a77e00700 1 -- 172.21.15.159:0/3846494050 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1a700584a0 con 0x7f1a80068670 2024-02-28T23:15:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:52 smithi184 ceph-mon[86482]: pgmap v116: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:52.722 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:52 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1[131266]: 2024-02-28T23:15:52.484+0000 7f03f42437c0 -1 osd.1 0 read_superblock omap replica is missing. 2024-02-28T23:15:52.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.871+0000 7f1a86400700 1 -- 172.21.15.159:0/3846494050 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a8002cce0 con 0x7f1a6406d8a0 2024-02-28T23:15:52.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.874+0000 7f1a77e00700 1 -- 172.21.15.159:0/3846494050 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f1a8002cce0 con 0x7f1a6406d8a0 2024-02-28T23:15:52.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.877+0000 7f1a86400700 1 -- 172.21.15.159:0/3846494050 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1a6406d8a0 msgr2=0x7f1a6406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.877+0000 7f1a86400700 1 --2- 172.21.15.159:0/3846494050 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1a6406d8a0 0x7f1a6406fd60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a80101490 tx=0x7f1a6c005cf0 comp rx=0 tx=0).stop 2024-02-28T23:15:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.877+0000 7f1a86400700 1 -- 172.21.15.159:0/3846494050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a80068670 msgr2=0x7f1a800ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.877+0000 7f1a86400700 1 --2- 172.21.15.159:0/3846494050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a80068670 0x7f1a800ffca0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1a700059d0 tx=0x7f1a7000be90 comp rx=0 tx=0).stop 2024-02-28T23:15:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.877+0000 7f1a86400700 1 -- 172.21.15.159:0/3846494050 shutdown_connections 2024-02-28T23:15:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.877+0000 7f1a86400700 1 --2- 172.21.15.159:0/3846494050 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1a6406d8a0 0x7f1a6406fd60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.877+0000 7f1a86400700 1 --2- 172.21.15.159:0/3846494050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a80068670 0x7f1a800ffca0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.877+0000 7f1a86400700 1 --2- 172.21.15.159:0/3846494050 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1a80069020 0x7f1a801001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.877+0000 7f1a86400700 1 -- 172.21.15.159:0/3846494050 >> 172.21.15.159:0/3846494050 conn(0x7f1a800755a0 msgr2=0x7f1a800fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.877+0000 7f1a86400700 1 -- 172.21.15.159:0/3846494050 shutdown_connections 2024-02-28T23:15:52.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:52.877+0000 7f1a86400700 1 -- 172.21.15.159:0/3846494050 wait complete. 2024-02-28T23:15:52.892 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:15:53.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.038+0000 7efe5d800700 1 -- 172.21.15.159:0/3176315994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe580731c0 msgr2=0x7efe580735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:53.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.038+0000 7efe5d800700 1 --2- 172.21.15.159:0/3176315994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe580731c0 0x7efe580735a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efe48009910 tx=0x7efe48009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:53.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.038+0000 7efe5d800700 1 -- 172.21.15.159:0/3176315994 shutdown_connections 2024-02-28T23:15:53.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.038+0000 7efe5d800700 1 --2- 172.21.15.159:0/3176315994 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe58073ae0 0x7efe5810ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.038+0000 7efe5d800700 1 --2- 172.21.15.159:0/3176315994 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe580731c0 0x7efe580735a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.038+0000 7efe5d800700 1 -- 172.21.15.159:0/3176315994 >> 172.21.15.159:0/3176315994 conn(0x7efe580fc630 msgr2=0x7efe580fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:53.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.039+0000 7efe5d800700 1 -- 172.21.15.159:0/3176315994 shutdown_connections 2024-02-28T23:15:53.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.039+0000 7efe5d800700 1 -- 172.21.15.159:0/3176315994 wait complete. 2024-02-28T23:15:53.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.040+0000 7efe5d800700 1 Processor -- start 2024-02-28T23:15:53.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.040+0000 7efe5d800700 1 -- start start 2024-02-28T23:15:53.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.041+0000 7efe5d800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe580731c0 0x7efe58072a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:53.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.041+0000 7efe5d800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe58073ae0 0x7efe5806da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:53.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.041+0000 7efe5d800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5806e0e0 con 0x7efe580731c0 2024-02-28T23:15:53.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.041+0000 7efe5d800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5806e250 con 0x7efe58073ae0 2024-02-28T23:15:53.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.041+0000 7efe56a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe580731c0 0x7efe58072a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:53.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.041+0000 7efe56a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe580731c0 0x7efe58072a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54738/0 (socket says 172.21.15.159:54738) 2024-02-28T23:15:53.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.041+0000 7efe56a00700 1 -- 172.21.15.159:0/3758890894 learned_addr learned my addr 172.21.15.159:0/3758890894 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:53.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.042+0000 7efe56000700 1 --2- 172.21.15.159:0/3758890894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe58073ae0 0x7efe5806da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:53.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.042+0000 7efe56a00700 1 -- 172.21.15.159:0/3758890894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe58073ae0 msgr2=0x7efe5806da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:53.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.042+0000 7efe56a00700 1 --2- 172.21.15.159:0/3758890894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe58073ae0 0x7efe5806da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.042+0000 7efe56a00700 1 -- 172.21.15.159:0/3758890894 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe480095f0 con 0x7efe580731c0 2024-02-28T23:15:53.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.042+0000 7efe56a00700 1 --2- 172.21.15.159:0/3758890894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe580731c0 0x7efe58072a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efe48006010 tx=0x7efe4800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:53.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.043+0000 7efe4f400700 1 -- 172.21.15.159:0/3758890894 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4801d070 con 0x7efe580731c0 2024-02-28T23:15:53.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.043+0000 7efe4f400700 1 -- 172.21.15.159:0/3758890894 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe48004fb0 con 0x7efe580731c0 2024-02-28T23:15:53.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.043+0000 7efe5d800700 1 -- 172.21.15.159:0/3758890894 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5806e4d0 con 0x7efe580731c0 2024-02-28T23:15:53.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.043+0000 7efe4f400700 1 -- 172.21.15.159:0/3758890894 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe4800f480 con 0x7efe580731c0 2024-02-28T23:15:53.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.043+0000 7efe5d800700 1 -- 172.21.15.159:0/3758890894 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe581ab690 con 0x7efe580731c0 2024-02-28T23:15:53.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.045+0000 7efe5d800700 1 -- 172.21.15.159:0/3758890894 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe5810a540 con 0x7efe580731c0 2024-02-28T23:15:53.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.046+0000 7efe4f400700 1 -- 172.21.15.159:0/3758890894 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7efe48022890 con 0x7efe580731c0 2024-02-28T23:15:53.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.047+0000 7efe4f400700 1 --2- 172.21.15.159:0/3758890894 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe3c06d8a0 0x7efe3c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:53.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.048+0000 7efe4f400700 1 -- 172.21.15.159:0/3758890894 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6675+0+0 (secure 0 0 0) 0x7efe4808ebd0 con 0x7efe580731c0 2024-02-28T23:15:53.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.048+0000 7efe56000700 1 --2- 172.21.15.159:0/3758890894 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe3c06d8a0 0x7efe3c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:53.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.049+0000 7efe56000700 1 --2- 172.21.15.159:0/3758890894 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe3c06d8a0 0x7efe3c06fd60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe44006fd0 tx=0x7efe44008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:53.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.052+0000 7efe4f400700 1 -- 172.21.15.159:0/3758890894 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efe4805c000 con 0x7efe580731c0 2024-02-28T23:15:53.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.307+0000 7efe5d800700 1 -- 172.21.15.159:0/3758890894 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe5802cce0 con 0x7efe3c06d8a0 2024-02-28T23:15:53.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.309+0000 7efe4f400700 1 -- 172.21.15.159:0/3758890894 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7efe5802cce0 con 0x7efe3c06d8a0 2024-02-28T23:15:53.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.312+0000 7efe5d800700 1 -- 172.21.15.159:0/3758890894 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe3c06d8a0 msgr2=0x7efe3c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:53.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.312+0000 7efe5d800700 1 --2- 172.21.15.159:0/3758890894 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe3c06d8a0 0x7efe3c06fd60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efe44006fd0 tx=0x7efe44008040 comp rx=0 tx=0).stop 2024-02-28T23:15:53.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.312+0000 7efe5d800700 1 -- 172.21.15.159:0/3758890894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe580731c0 msgr2=0x7efe58072a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:53.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.312+0000 7efe5d800700 1 --2- 172.21.15.159:0/3758890894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe580731c0 0x7efe58072a00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efe48006010 tx=0x7efe4800be20 comp rx=0 tx=0).stop 2024-02-28T23:15:53.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.312+0000 7efe5d800700 1 -- 172.21.15.159:0/3758890894 shutdown_connections 2024-02-28T23:15:53.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.312+0000 7efe5d800700 1 --2- 172.21.15.159:0/3758890894 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe3c06d8a0 0x7efe3c06fd60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.312+0000 7efe5d800700 1 --2- 172.21.15.159:0/3758890894 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe580731c0 0x7efe58072a00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.312+0000 7efe5d800700 1 --2- 172.21.15.159:0/3758890894 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe58073ae0 0x7efe5806da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.312+0000 7efe5d800700 1 -- 172.21.15.159:0/3758890894 >> 172.21.15.159:0/3758890894 conn(0x7efe580fc630 msgr2=0x7efe58107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:53.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.312+0000 7efe5d800700 1 -- 172.21.15.159:0/3758890894 shutdown_connections 2024-02-28T23:15:53.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.312+0000 7efe5d800700 1 -- 172.21.15.159:0/3758890894 wait complete. 2024-02-28T23:15:53.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.459+0000 7f1ebfe00700 1 -- 172.21.15.159:0/725921030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec0102e10 msgr2=0x7f1ec01031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:53.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.459+0000 7f1ebfe00700 1 --2- 172.21.15.159:0/725921030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec0102e10 0x7f1ec01031f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1eb0009910 tx=0x7f1eb0009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:53.458 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:53 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1[131266]: 2024-02-28T23:15:53.157+0000 7f03f42437c0 -1 osd.1 71 log_to_monitors true 2024-02-28T23:15:53.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.459+0000 7f1ebfe00700 1 -- 172.21.15.159:0/725921030 shutdown_connections 2024-02-28T23:15:53.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.459+0000 7f1ebfe00700 1 --2- 172.21.15.159:0/725921030 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ec01037c0 0x7f1ec0107810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.459+0000 7f1ebfe00700 1 --2- 172.21.15.159:0/725921030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec0102e10 0x7f1ec01031f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.459+0000 7f1ebfe00700 1 -- 172.21.15.159:0/725921030 >> 172.21.15.159:0/725921030 conn(0x7f1ec00fe6c0 msgr2=0x7f1ec0100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:53.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.459+0000 7f1ebfe00700 1 -- 172.21.15.159:0/725921030 shutdown_connections 2024-02-28T23:15:53.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.460+0000 7f1ebfe00700 1 -- 172.21.15.159:0/725921030 wait complete. 2024-02-28T23:15:53.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.461+0000 7f1ebfe00700 1 Processor -- start 2024-02-28T23:15:53.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.461+0000 7f1ebfe00700 1 -- start start 2024-02-28T23:15:53.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.461+0000 7f1ebfe00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ec0102e10 0x7f1ec019e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:53.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.461+0000 7f1ebfe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec01037c0 0x7f1ec019eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:53.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.461+0000 7f1ebfe00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec019f190 con 0x7f1ec01037c0 2024-02-28T23:15:53.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.461+0000 7f1ebfe00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ec0198640 con 0x7f1ec0102e10 2024-02-28T23:15:53.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.462+0000 7f1ebe000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec01037c0 0x7f1ec019eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:53.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.462+0000 7f1ebe000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec01037c0 0x7f1ec019eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54770/0 (socket says 172.21.15.159:54770) 2024-02-28T23:15:53.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.462+0000 7f1ebe000700 1 -- 172.21.15.159:0/4259047992 learned_addr learned my addr 172.21.15.159:0/4259047992 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:53.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.462+0000 7f1ebea00700 1 --2- 172.21.15.159:0/4259047992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ec0102e10 0x7f1ec019e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:53.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.462+0000 7f1ebe000700 1 -- 172.21.15.159:0/4259047992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ec0102e10 msgr2=0x7f1ec019e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:53.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.462+0000 7f1ebe000700 1 --2- 172.21.15.159:0/4259047992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ec0102e10 0x7f1ec019e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.462+0000 7f1ebe000700 1 -- 172.21.15.159:0/4259047992 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1eb00095f0 con 0x7f1ec01037c0 2024-02-28T23:15:53.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.463+0000 7f1ebe000700 1 --2- 172.21.15.159:0/4259047992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec01037c0 0x7f1ec019eb00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00d8d0 tx=0x7f1eac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:53.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.463+0000 7f1eb7400700 1 -- 172.21.15.159:0/4259047992 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac004a00 con 0x7f1ec01037c0 2024-02-28T23:15:53.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.463+0000 7f1eb7400700 1 -- 172.21.15.159:0/4259047992 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1eac0054e0 con 0x7f1ec01037c0 2024-02-28T23:15:53.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.463+0000 7f1ebfe00700 1 -- 172.21.15.159:0/4259047992 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ec0198920 con 0x7f1ec01037c0 2024-02-28T23:15:53.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.463+0000 7f1eb7400700 1 -- 172.21.15.159:0/4259047992 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1eac009d40 con 0x7f1ec01037c0 2024-02-28T23:15:53.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.463+0000 7f1ebfe00700 1 -- 172.21.15.159:0/4259047992 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ec0198e70 con 0x7f1ec01037c0 2024-02-28T23:15:53.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.464+0000 7f1ebfe00700 1 -- 172.21.15.159:0/4259047992 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ec010b1b0 con 0x7f1ec01037c0 2024-02-28T23:15:53.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.465+0000 7f1eb7400700 1 -- 172.21.15.159:0/4259047992 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f1eac005020 con 0x7f1ec01037c0 2024-02-28T23:15:53.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.466+0000 7f1eb7400700 1 --2- 172.21.15.159:0/4259047992 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1ea406d8a0 0x7f1ea406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:53.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.466+0000 7f1eb7400700 1 -- 172.21.15.159:0/4259047992 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f1eac08ce80 con 0x7f1ec01037c0 2024-02-28T23:15:53.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.466+0000 7f1ebea00700 1 --2- 172.21.15.159:0/4259047992 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1ea406d8a0 0x7f1ea406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:53.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.467+0000 7f1ebea00700 1 --2- 172.21.15.159:0/4259047992 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1ea406d8a0 0x7f1ea406fd60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000b5c0 tx=0x7f1eb001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:53.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.471+0000 7f1eb7400700 1 -- 172.21.15.159:0/4259047992 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1eac05a0e0 con 0x7f1ec01037c0 2024-02-28T23:15:53.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.708+0000 7f1ebfe00700 1 -- 172.21.15.159:0/4259047992 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1ec0199110 con 0x7f1ea406d8a0 2024-02-28T23:15:53.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.720+0000 7f1eb7400700 1 -- 172.21.15.159:0/4259047992 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f1ec0199110 con 0x7f1ea406d8a0 2024-02-28T23:15:53.719 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:15:53.719 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (5m) 45s ago 19m 13.7M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (20m) 45s ago 19m 8544k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (18m) 80s ago 18m 8108k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (93s) 45s ago 19m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (85s) 80s ago 18m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (4m) 45s ago 19m 74.8M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (12m) 45s ago 12m 147M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (12m) 45s ago 12m 86.9M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (12m) 80s ago 12m 17.6M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (12m) 80s ago 12m 17.5M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (8m) 45s ago 21m 498M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (7m) 80s ago 18m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (3m) 45s ago 21m 45.9M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:15:53.720 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (2m) 80s ago 18m 32.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:15:53.721 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (6m) 45s ago 19m 7872k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:15:53.721 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (6m) 80s ago 18m 8174k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:15:53.721 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (54s) 45s ago 17m 11.4M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:15:53.721 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 starting - - - 1217M 2024-02-28T23:15:53.721 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (15m) 45s ago 15m 227M 1217M 18.2.1 5be31c24972a 6016d93b9096 2024-02-28T23:15:53.721 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (15m) 80s ago 15m 300M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:15:53.721 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (14m) 80s ago 14m 251M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:15:53.721 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (14m) 80s ago 14m 230M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:15:53.721 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (5m) 45s ago 18m 51.9M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:15:53.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.724+0000 7f1ebfe00700 1 -- 172.21.15.159:0/4259047992 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1ea406d8a0 msgr2=0x7f1ea406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:53.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.724+0000 7f1ebfe00700 1 --2- 172.21.15.159:0/4259047992 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1ea406d8a0 0x7f1ea406fd60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1eb000b5c0 tx=0x7f1eb001a040 comp rx=0 tx=0).stop 2024-02-28T23:15:53.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.724+0000 7f1ebfe00700 1 -- 172.21.15.159:0/4259047992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec01037c0 msgr2=0x7f1ec019eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:53.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.724+0000 7f1ebfe00700 1 --2- 172.21.15.159:0/4259047992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec01037c0 0x7f1ec019eb00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1eac00d8d0 tx=0x7f1eac00dc90 comp rx=0 tx=0).stop 2024-02-28T23:15:53.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.724+0000 7f1ebfe00700 1 -- 172.21.15.159:0/4259047992 shutdown_connections 2024-02-28T23:15:53.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.724+0000 7f1ebfe00700 1 --2- 172.21.15.159:0/4259047992 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1ec0102e10 0x7f1ec019e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.724+0000 7f1ebfe00700 1 --2- 172.21.15.159:0/4259047992 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1ea406d8a0 0x7f1ea406fd60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.724+0000 7f1ebfe00700 1 --2- 172.21.15.159:0/4259047992 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec01037c0 0x7f1ec019eb00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.724+0000 7f1ebfe00700 1 -- 172.21.15.159:0/4259047992 >> 172.21.15.159:0/4259047992 conn(0x7f1ec00fe6c0 msgr2=0x7f1ec00ffe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:53.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.724+0000 7f1ebfe00700 1 -- 172.21.15.159:0/4259047992 shutdown_connections 2024-02-28T23:15:53.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.724+0000 7f1ebfe00700 1 -- 172.21.15.159:0/4259047992 wait complete. 2024-02-28T23:15:53.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.881+0000 7fbe02e00700 1 -- 172.21.15.159:0/1426019637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdfc1071d0 msgr2=0x7fbdfc107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:53.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.881+0000 7fbe02e00700 1 --2- 172.21.15.159:0/1426019637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdfc1071d0 0x7fbdfc107650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbde4009910 tx=0x7fbde4009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:53.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.881+0000 7fbe02e00700 1 -- 172.21.15.159:0/1426019637 shutdown_connections 2024-02-28T23:15:53.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.881+0000 7fbe02e00700 1 --2- 172.21.15.159:0/1426019637 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdfc1071d0 0x7fbdfc107650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.881+0000 7fbe02e00700 1 --2- 172.21.15.159:0/1426019637 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdfc10d280 0x7fbdfc10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.881+0000 7fbe02e00700 1 -- 172.21.15.159:0/1426019637 >> 172.21.15.159:0/1426019637 conn(0x7fbdfc0769e0 msgr2=0x7fbdfc078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:53.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.881+0000 7fbe02e00700 1 -- 172.21.15.159:0/1426019637 shutdown_connections 2024-02-28T23:15:53.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.881+0000 7fbe02e00700 1 -- 172.21.15.159:0/1426019637 wait complete. 2024-02-28T23:15:53.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.882+0000 7fbe02e00700 1 Processor -- start 2024-02-28T23:15:53.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.883+0000 7fbe02e00700 1 -- start start 2024-02-28T23:15:53.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.883+0000 7fbe02e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdfc1071d0 0x7fbdfc19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:53.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.883+0000 7fbe02e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdfc10d280 0x7fbdfc19d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:53.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.883+0000 7fbe02e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc19da30 con 0x7fbdfc1071d0 2024-02-28T23:15:53.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.883+0000 7fbe02e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc1a17c0 con 0x7fbdfc10d280 2024-02-28T23:15:53.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.883+0000 7fbdfbe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdfc1071d0 0x7fbdfc19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:53.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.883+0000 7fbdfbe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdfc1071d0 0x7fbdfc19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54786/0 (socket says 172.21.15.159:54786) 2024-02-28T23:15:53.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.883+0000 7fbdfbe00700 1 -- 172.21.15.159:0/3732750483 learned_addr learned my addr 172.21.15.159:0/3732750483 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:53.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.884+0000 7fbdfb400700 1 --2- 172.21.15.159:0/3732750483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdfc10d280 0x7fbdfc19d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:53.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.884+0000 7fbdfbe00700 1 -- 172.21.15.159:0/3732750483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdfc10d280 msgr2=0x7fbdfc19d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:53.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.884+0000 7fbdfbe00700 1 --2- 172.21.15.159:0/3732750483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdfc10d280 0x7fbdfc19d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:53.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.884+0000 7fbdfbe00700 1 -- 172.21.15.159:0/3732750483 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde40095f0 con 0x7fbdfc1071d0 2024-02-28T23:15:53.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.884+0000 7fbdfbe00700 1 --2- 172.21.15.159:0/3732750483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdfc1071d0 0x7fbdfc19ce10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00b4b0 tx=0x7fbdec00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:53.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.884+0000 7fbdf8c00700 1 -- 172.21.15.159:0/3732750483 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdec011800 con 0x7fbdfc1071d0 2024-02-28T23:15:53.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.884+0000 7fbdf8c00700 1 -- 172.21.15.159:0/3732750483 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbdec011e20 con 0x7fbdfc1071d0 2024-02-28T23:15:53.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.884+0000 7fbe02e00700 1 -- 172.21.15.159:0/3732750483 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc1a1aa0 con 0x7fbdfc1071d0 2024-02-28T23:15:53.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.884+0000 7fbdf8c00700 1 -- 172.21.15.159:0/3732750483 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdec00f2e0 con 0x7fbdfc1071d0 2024-02-28T23:15:53.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.885+0000 7fbe02e00700 1 -- 172.21.15.159:0/3732750483 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc1a2070 con 0x7fbdfc1071d0 2024-02-28T23:15:53.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.886+0000 7fbe02e00700 1 -- 172.21.15.159:0/3732750483 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdfc10f6f0 con 0x7fbdfc1071d0 2024-02-28T23:15:53.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.886+0000 7fbdf8c00700 1 -- 172.21.15.159:0/3732750483 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fbdec010380 con 0x7fbdfc1071d0 2024-02-28T23:15:53.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.887+0000 7fbdf8c00700 1 --2- 172.21.15.159:0/3732750483 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbde006d8a0 0x7fbde006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:53.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.887+0000 7fbdf8c00700 1 -- 172.21.15.159:0/3732750483 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fbdec08d160 con 0x7fbdfc1071d0 2024-02-28T23:15:53.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.888+0000 7fbdfb400700 1 --2- 172.21.15.159:0/3732750483 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbde006d8a0 0x7fbde006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:53.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.888+0000 7fbdfb400700 1 --2- 172.21.15.159:0/3732750483 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbde006d8a0 0x7fbde006fd60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbde4000c00 tx=0x7fbde4005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:53.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:53.892+0000 7fbdf8c00700 1 -- 172.21.15.159:0/3732750483 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbdec0568b0 con 0x7fbdfc1071d0 2024-02-28T23:15:54.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.208+0000 7fbe02e00700 1 -- 172.21.15.159:0/3732750483 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbdfc1a23b0 con 0x7fbdfc1071d0 2024-02-28T23:15:54.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.209+0000 7fbdf8c00700 1 -- 172.21.15.159:0/3732750483 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fbdec059f70 con 0x7fbdfc1071d0 2024-02-28T23:15:54.208 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:15:54.208 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:15:54.208 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:15:54.208 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:15:54.208 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:15:54.208 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:15:54.208 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:15:54.208 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:15:54.209 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4, 2024-02-28T23:15:54.209 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:15:54.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:15:54.209 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:15:54.209 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:15:54.209 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:15:54.209 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:15:54.209 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 8, 2024-02-28T23:15:54.209 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-02-28T23:15:54.209 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:15:54.209 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:15:54.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.212+0000 7fbe02e00700 1 -- 172.21.15.159:0/3732750483 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbde006d8a0 msgr2=0x7fbde006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:54.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.212+0000 7fbe02e00700 1 --2- 172.21.15.159:0/3732750483 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbde006d8a0 0x7fbde006fd60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbde4000c00 tx=0x7fbde4005fd0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.212+0000 7fbe02e00700 1 -- 172.21.15.159:0/3732750483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdfc1071d0 msgr2=0x7fbdfc19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:54.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.212+0000 7fbe02e00700 1 --2- 172.21.15.159:0/3732750483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdfc1071d0 0x7fbdfc19ce10 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbdec00b4b0 tx=0x7fbdec00b870 comp rx=0 tx=0).stop 2024-02-28T23:15:54.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.213+0000 7fbe02e00700 1 -- 172.21.15.159:0/3732750483 shutdown_connections 2024-02-28T23:15:54.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.213+0000 7fbe02e00700 1 --2- 172.21.15.159:0/3732750483 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbde006d8a0 0x7fbde006fd60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.213+0000 7fbe02e00700 1 --2- 172.21.15.159:0/3732750483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbdfc1071d0 0x7fbdfc19ce10 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.213+0000 7fbe02e00700 1 --2- 172.21.15.159:0/3732750483 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbdfc10d280 0x7fbdfc19d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.213+0000 7fbe02e00700 1 -- 172.21.15.159:0/3732750483 >> 172.21.15.159:0/3732750483 conn(0x7fbdfc0769e0 msgr2=0x7fbdfc0784d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:54.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.213+0000 7fbe02e00700 1 -- 172.21.15.159:0/3732750483 shutdown_connections 2024-02-28T23:15:54.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.213+0000 7fbe02e00700 1 -- 172.21.15.159:0/3732750483 wait complete. 2024-02-28T23:15:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:54 smithi159 ceph-mon[113833]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:54.295 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:54 smithi159 ceph-mon[113833]: pgmap v117: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:15:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:54 smithi159 ceph-mon[113833]: from='osd.1 [v2:172.21.15.159:6810/3750692109,v1:172.21.15.159:6811/3750692109]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T23:15:54.296 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:54 smithi159 ceph-mon[113833]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:54.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.371+0000 7f026ca00700 1 -- 172.21.15.159:0/3637148083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02680ffbd0 msgr2=0x7f0268100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:54.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.371+0000 7f026ca00700 1 --2- 172.21.15.159:0/3637148083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02680ffbd0 0x7f0268100050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0254009910 tx=0x7f0254009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:54.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.371+0000 7f026ca00700 1 -- 172.21.15.159:0/3637148083 shutdown_connections 2024-02-28T23:15:54.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.371+0000 7f026ca00700 1 --2- 172.21.15.159:0/3637148083 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f02680ffbd0 0x7f0268100050 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.371+0000 7f026ca00700 1 --2- 172.21.15.159:0/3637148083 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0268105a40 0x7f0268105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.371+0000 7f026ca00700 1 -- 172.21.15.159:0/3637148083 >> 172.21.15.159:0/3637148083 conn(0x7f02680755a0 msgr2=0x7f02680759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:54.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.371+0000 7f026ca00700 1 -- 172.21.15.159:0/3637148083 shutdown_connections 2024-02-28T23:15:54.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.372+0000 7f026ca00700 1 -- 172.21.15.159:0/3637148083 wait complete. 2024-02-28T23:15:54.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.372+0000 7f026ca00700 1 Processor -- start 2024-02-28T23:15:54.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.373+0000 7f026ca00700 1 -- start start 2024-02-28T23:15:54.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.373+0000 7f026ca00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02680ffbd0 0x7f026819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:54.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.373+0000 7f026ca00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0268105a40 0x7f026819ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:54.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.373+0000 7f026ca00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026819f2c0 con 0x7f0268105a40 2024-02-28T23:15:54.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.373+0000 7f026ca00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0268198770 con 0x7f02680ffbd0 2024-02-28T23:15:54.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.373+0000 7f0265400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0268105a40 0x7f026819ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:54.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.373+0000 7f0265400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0268105a40 0x7f026819ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54814/0 (socket says 172.21.15.159:54814) 2024-02-28T23:15:54.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.373+0000 7f0265400700 1 -- 172.21.15.159:0/2370480867 learned_addr learned my addr 172.21.15.159:0/2370480867 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:54.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.374+0000 7f0265e00700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02680ffbd0 0x7f026819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:54.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.374+0000 7f0265400700 1 -- 172.21.15.159:0/2370480867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02680ffbd0 msgr2=0x7f026819e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:54.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.374+0000 7f0265400700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02680ffbd0 0x7f026819e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.374+0000 7f0265400700 1 -- 172.21.15.159:0/2370480867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02540095f0 con 0x7f0268105a40 2024-02-28T23:15:54.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.374+0000 7f0265e00700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02680ffbd0 0x7f026819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:15:54.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.374+0000 7f0265400700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0268105a40 0x7f026819ec30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f02540092e0 tx=0x7f025400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:54.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.374+0000 7f025ea00700 1 -- 172.21.15.159:0/2370480867 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f025401d070 con 0x7f0268105a40 2024-02-28T23:15:54.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.374+0000 7f025ea00700 1 -- 172.21.15.159:0/2370480867 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0254005e00 con 0x7f0268105a40 2024-02-28T23:15:54.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.374+0000 7f026ca00700 1 -- 172.21.15.159:0/2370480867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02681989f0 con 0x7f0268105a40 2024-02-28T23:15:54.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.375+0000 7f025ea00700 1 -- 172.21.15.159:0/2370480867 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0254017400 con 0x7f0268105a40 2024-02-28T23:15:54.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.375+0000 7f026ca00700 1 -- 172.21.15.159:0/2370480867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0268198ee0 con 0x7f0268105a40 2024-02-28T23:15:54.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.376+0000 7f026ca00700 1 -- 172.21.15.159:0/2370480867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026804ea90 con 0x7f0268105a40 2024-02-28T23:15:54.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.378+0000 7f025ea00700 1 -- 172.21.15.159:0/2370480867 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f025400f460 con 0x7f0268105a40 2024-02-28T23:15:54.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.379+0000 7f025ea00700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f024c06d8a0 0x7f024c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:54.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.379+0000 7f025ea00700 1 -- 172.21.15.159:0/2370480867 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f025408ead0 con 0x7f0268105a40 2024-02-28T23:15:54.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.379+0000 7f0265e00700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f024c06d8a0 0x7f024c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:54.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.380+0000 7f0265e00700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f024c06d8a0 0x7f024c06fd60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0258005fd0 tx=0x7f0258005ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:54.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.384+0000 7f025ea00700 1 -- 172.21.15.159:0/2370480867 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f025405bd50 con 0x7f0268105a40 2024-02-28T23:15:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:54 smithi184 ceph-mon[86482]: from='client.34276 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:54 smithi184 ceph-mon[86482]: pgmap v117: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:54.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:54.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:15:54.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:54 smithi184 ceph-mon[86482]: from='osd.1 [v2:172.21.15.159:6810/3750692109,v1:172.21.15.159:6811/3750692109]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-28T23:15:54.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:54 smithi184 ceph-mon[86482]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:54.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.674+0000 7f026ca00700 1 -- 172.21.15.159:0/2370480867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f0268199c80 con 0x7f0268105a40 2024-02-28T23:15:54.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.675+0000 7f025ea00700 1 -- 172.21.15.159:0/2370480867 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f025405b8e0 con 0x7f0268105a40 2024-02-28T23:15:54.674 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:15:54.674 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:15:54.674 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:15:54.674 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:15:54.675 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:15:54.676 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:15:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:15:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:15:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:15:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:15:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:15:54.677 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:15:54.677 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:15:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:15:54.677 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:15:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:15:54.677 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:15:54.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.680+0000 7f026ca00700 1 -- 172.21.15.159:0/2370480867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f024c06d8a0 msgr2=0x7f024c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:54.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.680+0000 7f026ca00700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f024c06d8a0 0x7f024c06fd60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0258005fd0 tx=0x7f0258005ee0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.680+0000 7f026ca00700 1 -- 172.21.15.159:0/2370480867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0268105a40 msgr2=0x7f026819ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:54.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.680+0000 7f026ca00700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0268105a40 0x7f026819ec30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f02540092e0 tx=0x7f025400be20 comp rx=0 tx=0).stop 2024-02-28T23:15:54.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.681+0000 7f026ca00700 1 -- 172.21.15.159:0/2370480867 shutdown_connections 2024-02-28T23:15:54.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.681+0000 7f026ca00700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f02680ffbd0 0x7f026819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.681+0000 7f026ca00700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f024c06d8a0 0x7f024c06fd60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.681+0000 7f026ca00700 1 --2- 172.21.15.159:0/2370480867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0268105a40 0x7f026819ec30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.681+0000 7f026ca00700 1 -- 172.21.15.159:0/2370480867 >> 172.21.15.159:0/2370480867 conn(0x7f02680755a0 msgr2=0x7f0268068410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:54.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.682+0000 7f026ca00700 1 -- 172.21.15.159:0/2370480867 shutdown_connections 2024-02-28T23:15:54.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.682+0000 7f026ca00700 1 -- 172.21.15.159:0/2370480867 wait complete. 2024-02-28T23:15:54.682 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:15:54.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.880+0000 7f7c54c00700 1 -- 172.21.15.159:0/3961518690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c50068670 msgr2=0x7f7c50068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:54.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.880+0000 7f7c54c00700 1 --2- 172.21.15.159:0/3961518690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c50068670 0x7f7c50068a50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7c40009910 tx=0x7f7c40009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:54.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.880+0000 7f7c54c00700 1 -- 172.21.15.159:0/3961518690 shutdown_connections 2024-02-28T23:15:54.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.880+0000 7f7c54c00700 1 --2- 172.21.15.159:0/3961518690 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50069020 0x7f7c50105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.880+0000 7f7c54c00700 1 --2- 172.21.15.159:0/3961518690 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c50068670 0x7f7c50068a50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.880+0000 7f7c54c00700 1 -- 172.21.15.159:0/3961518690 >> 172.21.15.159:0/3961518690 conn(0x7f7c500755a0 msgr2=0x7f7c500759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:54.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.881+0000 7f7c54c00700 1 -- 172.21.15.159:0/3961518690 shutdown_connections 2024-02-28T23:15:54.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.881+0000 7f7c54c00700 1 -- 172.21.15.159:0/3961518690 wait complete. 2024-02-28T23:15:54.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.882+0000 7f7c54c00700 1 Processor -- start 2024-02-28T23:15:54.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.882+0000 7f7c54c00700 1 -- start start 2024-02-28T23:15:54.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.883+0000 7f7c54c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c50068670 0x7f7c50194360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:54.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.883+0000 7f7c54c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50069020 0x7f7c501948a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:54.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.883+0000 7f7c54c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c50197450 con 0x7f7c50068670 2024-02-28T23:15:54.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.883+0000 7f7c54c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c501975c0 con 0x7f7c50069020 2024-02-28T23:15:54.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.883+0000 7f7c4de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c50068670 0x7f7c50194360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:54.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.883+0000 7f7c47e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50069020 0x7f7c501948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:54.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.883+0000 7f7c4de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c50068670 0x7f7c50194360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54834/0 (socket says 172.21.15.159:54834) 2024-02-28T23:15:54.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.883+0000 7f7c4de00700 1 -- 172.21.15.159:0/3532288431 learned_addr learned my addr 172.21.15.159:0/3532288431 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:54.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.883+0000 7f7c47e00700 1 --2- 172.21.15.159:0/3532288431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50069020 0x7f7c501948a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:39606/0 (socket says 172.21.15.159:39606) 2024-02-28T23:15:54.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.884+0000 7f7c47e00700 1 -- 172.21.15.159:0/3532288431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c50068670 msgr2=0x7f7c50194360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:54.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.884+0000 7f7c47e00700 1 --2- 172.21.15.159:0/3532288431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c50068670 0x7f7c50194360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:54.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.884+0000 7f7c47e00700 1 -- 172.21.15.159:0/3532288431 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c400095f0 con 0x7f7c50069020 2024-02-28T23:15:54.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.885+0000 7f7c47e00700 1 --2- 172.21.15.159:0/3532288431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50069020 0x7f7c501948a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800c8c0 tx=0x7f7c3800cbd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:54.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.885+0000 7f7c46a00700 1 -- 172.21.15.159:0/3532288431 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c38004410 con 0x7f7c50069020 2024-02-28T23:15:54.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.885+0000 7f7c54c00700 1 -- 172.21.15.159:0/3532288431 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c50194e40 con 0x7f7c50069020 2024-02-28T23:15:54.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.886+0000 7f7c54c00700 1 -- 172.21.15.159:0/3532288431 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c501951c0 con 0x7f7c50069020 2024-02-28T23:15:54.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.886+0000 7f7c46a00700 1 -- 172.21.15.159:0/3532288431 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7c38004570 con 0x7f7c50069020 2024-02-28T23:15:54.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.886+0000 7f7c46a00700 1 -- 172.21.15.159:0/3532288431 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c38007ce0 con 0x7f7c50069020 2024-02-28T23:15:54.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.887+0000 7f7c54c00700 1 -- 172.21.15.159:0/3532288431 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c005320 con 0x7f7c50069020 2024-02-28T23:15:54.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.891+0000 7f7c46a00700 1 -- 172.21.15.159:0/3532288431 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f7c380074c0 con 0x7f7c50069020 2024-02-28T23:15:54.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.892+0000 7f7c46a00700 1 --2- 172.21.15.159:0/3532288431 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7c3406d8f0 0x7f7c3406fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:54.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.892+0000 7f7c46a00700 1 -- 172.21.15.159:0/3532288431 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f7c3808d6a0 con 0x7f7c50069020 2024-02-28T23:15:54.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.893+0000 7f7c4de00700 1 --2- 172.21.15.159:0/3532288431 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7c3406d8f0 0x7f7c3406fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:54.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.894+0000 7f7c4de00700 1 --2- 172.21.15.159:0/3532288431 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7c3406d8f0 0x7f7c3406fdb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c40006010 tx=0x7f7c4001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:54.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:54.906+0000 7f7c46a00700 1 -- 172.21.15.159:0/3532288431 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7c38056e50 con 0x7f7c50069020 2024-02-28T23:15:55.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.226+0000 7f7c54c00700 1 -- 172.21.15.159:0/3532288431 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c2c000bf0 con 0x7f7c3406d8f0 2024-02-28T23:15:55.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.228+0000 7f7c46a00700 1 -- 172.21.15.159:0/3532288431 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7c2c000bf0 con 0x7f7c3406d8f0 2024-02-28T23:15:55.226 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "7/23 daemons upgraded", 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:15:55.227 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:15:55.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.231+0000 7f7c54c00700 1 -- 172.21.15.159:0/3532288431 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7c3406d8f0 msgr2=0x7f7c3406fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:55.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.231+0000 7f7c54c00700 1 --2- 172.21.15.159:0/3532288431 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7c3406d8f0 0x7f7c3406fdb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7c40006010 tx=0x7f7c4001a040 comp rx=0 tx=0).stop 2024-02-28T23:15:55.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.231+0000 7f7c54c00700 1 -- 172.21.15.159:0/3532288431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50069020 msgr2=0x7f7c501948a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:55.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.231+0000 7f7c54c00700 1 --2- 172.21.15.159:0/3532288431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50069020 0x7f7c501948a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800c8c0 tx=0x7f7c3800cbd0 comp rx=0 tx=0).stop 2024-02-28T23:15:55.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.232+0000 7f7c54c00700 1 -- 172.21.15.159:0/3532288431 shutdown_connections 2024-02-28T23:15:55.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.232+0000 7f7c54c00700 1 --2- 172.21.15.159:0/3532288431 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7c3406d8f0 0x7f7c3406fdb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:55.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.232+0000 7f7c54c00700 1 --2- 172.21.15.159:0/3532288431 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7c50068670 0x7f7c50194360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:55.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.232+0000 7f7c54c00700 1 --2- 172.21.15.159:0/3532288431 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7c50069020 0x7f7c501948a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:55.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.232+0000 7f7c54c00700 1 -- 172.21.15.159:0/3532288431 >> 172.21.15.159:0/3532288431 conn(0x7f7c500755a0 msgr2=0x7f7c50102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:55.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.232+0000 7f7c54c00700 1 -- 172.21.15.159:0/3532288431 shutdown_connections 2024-02-28T23:15:55.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.233+0000 7f7c54c00700 1 -- 172.21.15.159:0/3532288431 wait complete. 2024-02-28T23:15:55.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.379+0000 7f2446400700 1 -- 172.21.15.159:0/787290306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24400731c0 msgr2=0x7f24400735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:55.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.379+0000 7f2446400700 1 --2- 172.21.15.159:0/787290306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24400731c0 0x7f24400735a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2430009910 tx=0x7f2430009c20 comp rx=0 tx=0).stop 2024-02-28T23:15:55.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.379+0000 7f2446400700 1 -- 172.21.15.159:0/787290306 shutdown_connections 2024-02-28T23:15:55.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.379+0000 7f2446400700 1 --2- 172.21.15.159:0/787290306 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2440073ae0 0x7f244010ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:55.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.379+0000 7f2446400700 1 --2- 172.21.15.159:0/787290306 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24400731c0 0x7f24400735a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:55.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.379+0000 7f2446400700 1 -- 172.21.15.159:0/787290306 >> 172.21.15.159:0/787290306 conn(0x7f24400fc630 msgr2=0x7f24400fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:55.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.379+0000 7f2446400700 1 -- 172.21.15.159:0/787290306 shutdown_connections 2024-02-28T23:15:55.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.379+0000 7f2446400700 1 -- 172.21.15.159:0/787290306 wait complete. 2024-02-28T23:15:55.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.380+0000 7f2446400700 1 Processor -- start 2024-02-28T23:15:55.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.380+0000 7f2446400700 1 -- start start 2024-02-28T23:15:55.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.380+0000 7f2446400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24400731c0 0x7f244019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:55.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.380+0000 7f2446400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2440073ae0 0x7f244019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:55.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.381+0000 7f2446400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244019f430 con 0x7f24400731c0 2024-02-28T23:15:55.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.381+0000 7f2446400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24401988e0 con 0x7f2440073ae0 2024-02-28T23:15:55.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.381+0000 7f243f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24400731c0 0x7f244019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:55.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.381+0000 7f243f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24400731c0 0x7f244019e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:54852/0 (socket says 172.21.15.159:54852) 2024-02-28T23:15:55.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.381+0000 7f243f400700 1 -- 172.21.15.159:0/1653783771 learned_addr learned my addr 172.21.15.159:0/1653783771 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:15:55.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.381+0000 7f2437e00700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2440073ae0 0x7f244019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:55.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.381+0000 7f243f400700 1 -- 172.21.15.159:0/1653783771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2440073ae0 msgr2=0x7f244019eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:55.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.381+0000 7f243f400700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2440073ae0 0x7f244019eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:55.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.381+0000 7f243f400700 1 -- 172.21.15.159:0/1653783771 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24300095f0 con 0x7f24400731c0 2024-02-28T23:15:55.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.381+0000 7f2437e00700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2440073ae0 0x7f244019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:15:55.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.382+0000 7f243f400700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24400731c0 0x7f244019e860 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2430006010 tx=0x7f243000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:55.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.382+0000 7f243cc00700 1 -- 172.21.15.159:0/1653783771 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f243001d070 con 0x7f24400731c0 2024-02-28T23:15:55.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.382+0000 7f243cc00700 1 -- 172.21.15.159:0/1653783771 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2430022470 con 0x7f24400731c0 2024-02-28T23:15:55.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.382+0000 7f243cc00700 1 -- 172.21.15.159:0/1653783771 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f243000f690 con 0x7f24400731c0 2024-02-28T23:15:55.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.382+0000 7f2446400700 1 -- 172.21.15.159:0/1653783771 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2440198b60 con 0x7f24400731c0 2024-02-28T23:15:55.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.382+0000 7f2446400700 1 -- 172.21.15.159:0/1653783771 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2440199050 con 0x7f24400731c0 2024-02-28T23:15:55.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.383+0000 7f2446400700 1 -- 172.21.15.159:0/1653783771 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244010a540 con 0x7f24400731c0 2024-02-28T23:15:55.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.384+0000 7f243cc00700 1 -- 172.21.15.159:0/1653783771 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f24300225e0 con 0x7f24400731c0 2024-02-28T23:15:55.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.385+0000 7f243cc00700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f242406d8a0 0x7f242406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:15:55.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.385+0000 7f243cc00700 1 -- 172.21.15.159:0/1653783771 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f243008ea80 con 0x7f24400731c0 2024-02-28T23:15:55.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.386+0000 7f2437e00700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f242406d8a0 0x7f242406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:15:55.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.386+0000 7f2437e00700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f242406d8a0 0x7f242406fd60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f24400fddc0 tx=0x7f2428008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:15:55.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.390+0000 7f243cc00700 1 -- 172.21.15.159:0/1653783771 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f243005be30 con 0x7f24400731c0 2024-02-28T23:15:55.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:55 smithi159 ceph-mon[113833]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:55.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:55 smithi159 ceph-mon[113833]: from='osd.1 [v2:172.21.15.159:6810/3750692109,v1:172.21.15.159:6811/3750692109]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T23:15:55.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:55 smithi159 ceph-mon[113833]: osdmap e74: 6 total, 5 up, 6 in 2024-02-28T23:15:55.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:55 smithi159 ceph-mon[113833]: from='osd.1 [v2:172.21.15.159:6810/3750692109,v1:172.21.15.159:6811/3750692109]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T23:15:55.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:55 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3732750483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:15:55.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:55 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2370480867' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:15:55.473 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:15:55 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1[131266]: 2024-02-28T23:15:55.221+0000 7f03de600700 -1 osd.1 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T23:15:55.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:55 smithi184 ceph-mon[86482]: from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:55.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:55 smithi184 ceph-mon[86482]: from='osd.1 [v2:172.21.15.159:6810/3750692109,v1:172.21.15.159:6811/3750692109]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-28T23:15:55.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:55 smithi184 ceph-mon[86482]: osdmap e74: 6 total, 5 up, 6 in 2024-02-28T23:15:55.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:55 smithi184 ceph-mon[86482]: from='osd.1 [v2:172.21.15.159:6810/3750692109,v1:172.21.15.159:6811/3750692109]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T23:15:55.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:55 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3732750483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:15:55.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:55 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2370480867' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:15:55.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.682+0000 7f2446400700 1 -- 172.21.15.159:0/1653783771 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2440199330 con 0x7f24400731c0 2024-02-28T23:15:55.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.683+0000 7f243cc00700 1 -- 172.21.15.159:0/1653783771 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+936 (secure 0 0 0) 0x7f243005b9c0 con 0x7f24400731c0 2024-02-28T23:15:55.681 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 28/228 objects degraded (12.281%), 12 pgs degraded 2024-02-28T23:15:55.681 INFO:teuthology.orchestra.run.smithi159.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-28T23:15:55.681 INFO:teuthology.orchestra.run.smithi159.stdout: osd.1 (root=default,host=smithi159) is down 2024-02-28T23:15:55.681 INFO:teuthology.orchestra.run.smithi159.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 28/228 objects degraded (12.281%), 12 pgs degraded 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.6 is active+undersized+degraded, acting [0,4] 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-02-28T23:15:55.682 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-02-28T23:15:55.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.685+0000 7f2446400700 1 -- 172.21.15.159:0/1653783771 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f242406d8a0 msgr2=0x7f242406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:55.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.685+0000 7f2446400700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f242406d8a0 0x7f242406fd60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f24400fddc0 tx=0x7f2428008040 comp rx=0 tx=0).stop 2024-02-28T23:15:55.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.685+0000 7f2446400700 1 -- 172.21.15.159:0/1653783771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24400731c0 msgr2=0x7f244019e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:15:55.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.685+0000 7f2446400700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24400731c0 0x7f244019e860 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2430006010 tx=0x7f243000be20 comp rx=0 tx=0).stop 2024-02-28T23:15:55.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.686+0000 7f2446400700 1 -- 172.21.15.159:0/1653783771 shutdown_connections 2024-02-28T23:15:55.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.686+0000 7f2446400700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f242406d8a0 0x7f242406fd60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:55.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.686+0000 7f2446400700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f24400731c0 0x7f244019e860 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:55.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.686+0000 7f2446400700 1 --2- 172.21.15.159:0/1653783771 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2440073ae0 0x7f244019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:15:55.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.686+0000 7f2446400700 1 -- 172.21.15.159:0/1653783771 >> 172.21.15.159:0/1653783771 conn(0x7f24400fc630 msgr2=0x7f2440107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:15:55.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.686+0000 7f2446400700 1 -- 172.21.15.159:0/1653783771 shutdown_connections 2024-02-28T23:15:55.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:15:55.686+0000 7f2446400700 1 -- 172.21.15.159:0/1653783771 wait complete. 2024-02-28T23:15:56.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:56 smithi184 ceph-mon[86482]: pgmap v119: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:56.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:56 smithi184 ceph-mon[86482]: from='osd.1 [v2:172.21.15.159:6810/3750692109,v1:172.21.15.159:6811/3750692109]' entity='osd.1' 2024-02-28T23:15:56.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:56 smithi184 ceph-mon[86482]: from='client.44161 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:56.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:56 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:56.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:56 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:56.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:56 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1653783771' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:15:56.640 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:56 smithi159 ceph-mon[113833]: pgmap v119: 65 pgs: 20 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:56.640 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:56 smithi159 ceph-mon[113833]: from='osd.1 [v2:172.21.15.159:6810/3750692109,v1:172.21.15.159:6811/3750692109]' entity='osd.1' 2024-02-28T23:15:56.640 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:56 smithi159 ceph-mon[113833]: from='client.44161 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:15:56.640 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:56 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:56.640 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:56 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:56.640 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:56 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1653783771' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:15:57.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:57 smithi159 ceph-mon[113833]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:15:57.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:57 smithi159 ceph-mon[113833]: osd.1 [v2:172.21.15.159:6810/3750692109,v1:172.21.15.159:6811/3750692109] boot 2024-02-28T23:15:57.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:57 smithi159 ceph-mon[113833]: osdmap e75: 6 total, 6 up, 6 in 2024-02-28T23:15:57.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:57 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T23:15:57.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:57 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:57.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:57 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:57.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:57 smithi159 ceph-mon[113833]: osdmap e76: 6 total, 6 up, 6 in 2024-02-28T23:15:57.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:57 smithi184 ceph-mon[86482]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:15:57.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:57 smithi184 ceph-mon[86482]: osd.1 [v2:172.21.15.159:6810/3750692109,v1:172.21.15.159:6811/3750692109] boot 2024-02-28T23:15:57.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:57 smithi184 ceph-mon[86482]: osdmap e75: 6 total, 6 up, 6 in 2024-02-28T23:15:57.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:57 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-28T23:15:57.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:57 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:57.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:57 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:15:57.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:57 smithi184 ceph-mon[86482]: osdmap e76: 6 total, 6 up, 6 in 2024-02-28T23:15:58.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:58 smithi159 ceph-mon[113833]: pgmap v121: 65 pgs: 2 peering, 18 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:58.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:58 smithi184 ceph-mon[86482]: pgmap v121: 65 pgs: 2 peering, 18 active+undersized, 12 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 28/228 objects degraded (12.281%) 2024-02-28T23:15:59.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:15:59 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 15/228 objects degraded (6.579%), 6 pgs degraded (PG_DEGRADED) 2024-02-28T23:15:59.633 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:15:59 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 15/228 objects degraded (6.579%), 6 pgs degraded (PG_DEGRADED) 2024-02-28T23:16:00.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:00 smithi184 ceph-mon[86482]: pgmap v123: 65 pgs: 2 peering, 5 active+undersized, 6 active+undersized+degraded, 52 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 15/228 objects degraded (6.579%) 2024-02-28T23:16:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:00 smithi159 ceph-mon[113833]: pgmap v123: 65 pgs: 2 peering, 5 active+undersized, 6 active+undersized+degraded, 52 active+clean; 209 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 15/228 objects degraded (6.579%) 2024-02-28T23:16:01.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:01 smithi159 ceph-mon[113833]: pgmap v124: 65 pgs: 2 peering, 63 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 734 B/s rd, 1 op/s 2024-02-28T23:16:01.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:01 smithi159 ceph-mon[113833]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/228 objects degraded (6.579%), 6 pgs degraded) 2024-02-28T23:16:01.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:01 smithi159 ceph-mon[113833]: Cluster is now healthy 2024-02-28T23:16:01.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:01 smithi184 ceph-mon[86482]: pgmap v124: 65 pgs: 2 peering, 63 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 734 B/s rd, 1 op/s 2024-02-28T23:16:01.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:01 smithi184 ceph-mon[86482]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 15/228 objects degraded (6.579%), 6 pgs degraded) 2024-02-28T23:16:01.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:01 smithi184 ceph-mon[86482]: Cluster is now healthy 2024-02-28T23:16:04.087 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:04.087 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:04.087 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:16:04.087 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:16:04.087 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:04.087 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: pgmap v125: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-02-28T23:16:04.087 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:16:04.088 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:04.088 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:04.088 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:04.088 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T23:16:04.088 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T23:16:04.088 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:03 smithi159 ceph-mon[113833]: Upgrade: osd.2 is safe to restart 2024-02-28T23:16:04.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: pgmap v125: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-28T23:16:04.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:03 smithi184 ceph-mon[86482]: Upgrade: osd.2 is safe to restart 2024-02-28T23:16:06.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:06 smithi159 ceph-mon[113833]: pgmap v126: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-02-28T23:16:06.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:06 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:06.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:06 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T23:16:06.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:06 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:16:06.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:06 smithi184 ceph-mon[86482]: pgmap v126: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s 2024-02-28T23:16:06.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:06 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:06.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:06 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-28T23:16:06.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:06 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:16:07.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:07 smithi159 ceph-mon[113833]: Upgrade: Updating osd.2 2024-02-28T23:16:07.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:07 smithi159 ceph-mon[113833]: Deploying daemon osd.2 on smithi159 2024-02-28T23:16:07.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:07 smithi184 ceph-mon[86482]: Upgrade: Updating osd.2 2024-02-28T23:16:07.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:07 smithi184 ceph-mon[86482]: Deploying daemon osd.2 on smithi159 2024-02-28T23:16:08.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:08 smithi159 ceph-mon[113833]: pgmap v127: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-02-28T23:16:08.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:08.467 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:16:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:08 smithi184 ceph-mon[86482]: pgmap v127: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-02-28T23:16:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:16:09.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:09 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:09.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:09 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:10.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:10 smithi159 ceph-mon[113833]: pgmap v128: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T23:16:10.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:10 smithi184 ceph-mon[86482]: pgmap v128: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T23:16:10.722 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:10 smithi159 systemd[1]: Stopping Ceph osd.2 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:16:11.214 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:10 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2[63163]: 2024-02-28T23:16:10.844+0000 7f9043200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:16:11.214 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:10 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2[63163]: 2024-02-28T23:16:10.844+0000 7f9043200700 -1 osd.2 76 *** Got signal Terminated *** 2024-02-28T23:16:11.214 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:10 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2[63163]: 2024-02-28T23:16:10.844+0000 7f9043200700 -1 osd.2 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:16:11.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:11 smithi159 ceph-mon[113833]: osd.2 marked itself down and dead 2024-02-28T23:16:11.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:11 smithi184 ceph-mon[86482]: osd.2 marked itself down and dead 2024-02-28T23:16:12.211 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:11 smithi159 podman[136755]: 2024-02-28 23:16:11.893935377 +0000 UTC m=+1.162128706 container died 6016d93b909668d92b59c0bbedc3fc3827a23c7ac1236c790d991b9974e3ab73 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, RELEASE=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-02-28T23:16:12.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:12 smithi159 ceph-mon[113833]: pgmap v129: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:16:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:12 smithi159 ceph-mon[113833]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:16:12.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:12 smithi159 ceph-mon[113833]: osdmap e77: 6 total, 5 up, 6 in 2024-02-28T23:16:12.473 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:12 smithi159 podman[136755]: 2024-02-28 23:16:12.338910469 +0000 UTC m=+1.607103802 container cleanup 6016d93b909668d92b59c0bbedc3fc3827a23c7ac1236c790d991b9974e3ab73 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.29.1, RELEASE=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:16:12.473 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:12 smithi159 bash[136755]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2 2024-02-28T23:16:12.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:12 smithi184 ceph-mon[86482]: pgmap v129: 65 pgs: 65 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:16:12.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:12 smithi184 ceph-mon[86482]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:16:12.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:12 smithi184 ceph-mon[86482]: osdmap e77: 6 total, 5 up, 6 in 2024-02-28T23:16:12.972 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:12 smithi159 podman[136774]: 2024-02-28 23:16:12.632248944 +0000 UTC m=+0.724777600 container remove 6016d93b909668d92b59c0bbedc3fc3827a23c7ac1236c790d991b9974e3ab73 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, io.buildah.version=1.29.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-28T23:16:13.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:13 smithi184 ceph-mon[86482]: osdmap e78: 6 total, 5 up, 6 in 2024-02-28T23:16:13.622 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:13 smithi159 podman[136864]: 2024-02-28 23:16:13.339169419 +0000 UTC m=+0.038816526 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:16:13.622 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:13 smithi159 podman[136864]: 2024-02-28 23:16:13.474886123 +0000 UTC m=+0.174533248 container create 50d8b5c81b2d39ff089d085597dbf212f87339991466cb872e1e244959b8c487 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-02-28T23:16:13.623 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:13 smithi159 ceph-mon[113833]: osdmap e78: 6 total, 5 up, 6 in 2024-02-28T23:16:13.973 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:13 smithi159 podman[136864]: 2024-02-28 23:16:13.721368742 +0000 UTC m=+0.421015900 container init 50d8b5c81b2d39ff089d085597dbf212f87339991466cb872e1e244959b8c487 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, ceph=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-02-28T23:16:13.973 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:13 smithi159 podman[136864]: 2024-02-28 23:16:13.73513794 +0000 UTC m=+0.434785092 container start 50d8b5c81b2d39ff089d085597dbf212f87339991466cb872e1e244959b8c487 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:16:13.973 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:13 smithi159 podman[136864]: 2024-02-28 23:16:13.841967212 +0000 UTC m=+0.541614340 container attach 50d8b5c81b2d39ff089d085597dbf212f87339991466cb872e1e244959b8c487 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, ceph=True, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-02-28T23:16:14.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:14 smithi159 ceph-mon[113833]: pgmap v132: 65 pgs: 11 peering, 6 stale+active+clean, 48 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:16:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:14 smithi159 ceph-mon[113833]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-02-28T23:16:14.473 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:14 smithi159 podman[136864]: 2024-02-28 23:16:14.163652473 +0000 UTC m=+0.863299587 container died 50d8b5c81b2d39ff089d085597dbf212f87339991466cb872e1e244959b8c487 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222) 2024-02-28T23:16:14.503 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:14 smithi184 ceph-mon[86482]: pgmap v132: 65 pgs: 11 peering, 6 stale+active+clean, 48 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-02-28T23:16:14.503 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:14 smithi184 ceph-mon[86482]: Health check failed: Reduced data availability: 5 pgs peering (PG_AVAILABILITY) 2024-02-28T23:16:15.222 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:14 smithi159 podman[136890]: 2024-02-28 23:16:14.956133375 +0000 UTC m=+0.777822570 container remove 50d8b5c81b2d39ff089d085597dbf212f87339991466cb872e1e244959b8c487 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux ) 2024-02-28T23:16:15.223 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:14 smithi159 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.2.service: Deactivated successfully. 2024-02-28T23:16:15.223 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:14 smithi159 systemd[1]: Stopped Ceph osd.2 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:16:15.223 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:14 smithi159 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.2.service: Consumed 1min 42.680s CPU time. 2024-02-28T23:16:15.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:15 smithi184 ceph-mon[86482]: Health check failed: Degraded data redundancy: 19/228 objects degraded (8.333%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T23:16:15.721 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:15 smithi159 ceph-mon[113833]: Health check failed: Degraded data redundancy: 19/228 objects degraded (8.333%), 7 pgs degraded (PG_DEGRADED) 2024-02-28T23:16:15.722 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:15 smithi159 systemd[1]: Starting Ceph osd.2 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:16:15.972 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:15 smithi159 podman[136992]: 2024-02-28 23:16:15.628574887 +0000 UTC m=+0.032695423 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:16:15.973 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:15 smithi159 podman[136992]: 2024-02-28 23:16:15.82408198 +0000 UTC m=+0.228202572 container create 742cb48121bec92322a705a7b34778078a133237bc95426161aae8c938c11a69 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-28T23:16:16.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:16 smithi159 ceph-mon[113833]: pgmap v133: 65 pgs: 12 active+undersized, 7 active+undersized+degraded, 11 peering, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 19/228 objects degraded (8.333%) 2024-02-28T23:16:16.472 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 podman[136992]: 2024-02-28 23:16:16.060958343 +0000 UTC m=+0.465078917 container init 742cb48121bec92322a705a7b34778078a133237bc95426161aae8c938c11a69 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-28T23:16:16.473 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 podman[136992]: 2024-02-28 23:16:16.073214054 +0000 UTC m=+0.477334628 container start 742cb48121bec92322a705a7b34778078a133237bc95426161aae8c938c11a69 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T23:16:16.473 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 podman[136992]: 2024-02-28 23:16:16.151319498 +0000 UTC m=+0.555440112 container attach 742cb48121bec92322a705a7b34778078a133237bc95426161aae8c938c11a69 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:16:16.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:16 smithi184 ceph-mon[86482]: pgmap v133: 65 pgs: 12 active+undersized, 7 active+undersized+degraded, 11 peering, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 19/228 objects degraded (8.333%) 2024-02-28T23:16:17.223 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate[137006]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T23:16:17.223 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate[137006]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 bash[136992]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 bash[136992]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 bash[136992]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 bash[136992]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 bash[136992]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 bash[136992]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 bash[136992]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate[137006]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate[137006]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate[137006]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate[137006]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:16 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate[137006]: --> ceph-volume raw activate successful for osd ID: 2 2024-02-28T23:16:17.224 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:17 smithi159 podman[136992]: 2024-02-28 23:16:17.015829757 +0000 UTC m=+1.419950365 container died 742cb48121bec92322a705a7b34778078a133237bc95426161aae8c938c11a69 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-28T23:16:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:17 smithi184 ceph-mon[86482]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-02-28T23:16:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:17 smithi159 ceph-mon[113833]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 5 pgs peering) 2024-02-28T23:16:18.222 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:17 smithi159 podman[137146]: 2024-02-28 23:16:17.93083653 +0000 UTC m=+0.894026112 container remove 742cb48121bec92322a705a7b34778078a133237bc95426161aae8c938c11a69 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10) 2024-02-28T23:16:18.634 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:18 smithi159 ceph-mon[113833]: pgmap v134: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 32/228 objects degraded (14.035%) 2024-02-28T23:16:18.635 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:18 smithi159 podman[137208]: 2024-02-28 23:16:18.188661105 +0000 UTC m=+0.038104909 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:16:18.635 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:18 smithi159 podman[137208]: 2024-02-28 23:16:18.323958534 +0000 UTC m=+0.173402361 container create 952e59c5816586830b12094096d35f3b65c2a7bbfb27028ddefe6030934c6221 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T23:16:18.635 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:18 smithi159 podman[137208]: 2024-02-28 23:16:18.636009973 +0000 UTC m=+0.485453846 container init 952e59c5816586830b12094096d35f3b65c2a7bbfb27028ddefe6030934c6221 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-02-28T23:16:18.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:18 smithi184 ceph-mon[86482]: pgmap v134: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 32/228 objects degraded (14.035%) 2024-02-28T23:16:18.972 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:18 smithi159 podman[137208]: 2024-02-28 23:16:18.646908881 +0000 UTC m=+0.496352731 container start 952e59c5816586830b12094096d35f3b65c2a7bbfb27028ddefe6030934c6221 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2, org.label-schema.build-date=20240222, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=main-1fb5d10) 2024-02-28T23:16:18.972 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:18 smithi159 ceph-osd[137227]: -- 172.21.15.159:0/1558765290 <== mon.0 v2:172.21.15.159:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c76bb37680 con 0x55c76bb01000 2024-02-28T23:16:18.972 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:18 smithi159 bash[137208]: 952e59c5816586830b12094096d35f3b65c2a7bbfb27028ddefe6030934c6221 2024-02-28T23:16:18.972 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:18 smithi159 systemd[1]: Started Ceph osd.2 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:16:19.391 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:19 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2[137223]: 2024-02-28T23:16:19.215+0000 7fdeb0dad7c0 -1 Falling back to public interface 2024-02-28T23:16:19.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:19 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:19.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:19 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:19.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:19 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:16:19.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:19 smithi159 ceph-mon[113833]: pgmap v135: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 32/228 objects degraded (14.035%) 2024-02-28T23:16:20.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:19 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:20.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:19 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:20.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:19 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:16:20.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:19 smithi184 ceph-mon[86482]: pgmap v135: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 32/228 objects degraded (14.035%) 2024-02-28T23:16:22.394 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:22 smithi159 ceph-mon[113833]: pgmap v136: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 32/228 objects degraded (14.035%) 2024-02-28T23:16:22.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:22 smithi184 ceph-mon[86482]: pgmap v136: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 32/228 objects degraded (14.035%) 2024-02-28T23:16:24.222 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:24 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2[137223]: 2024-02-28T23:16:24.068+0000 7fdeb0dad7c0 -1 osd.2 0 read_superblock omap replica is missing. 2024-02-28T23:16:24.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:24 smithi159 ceph-mon[113833]: pgmap v137: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 563 B/s rd, 1 op/s; 32/228 objects degraded (14.035%) 2024-02-28T23:16:24.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:24 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:24.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:24 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:16:24.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:24 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 32/228 objects degraded (14.035%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T23:16:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:24 smithi184 ceph-mon[86482]: pgmap v137: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 563 B/s rd, 1 op/s; 32/228 objects degraded (14.035%) 2024-02-28T23:16:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:24 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:24.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:24 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:16:24.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:24 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 32/228 objects degraded (14.035%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T23:16:24.876 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:24 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2[137223]: 2024-02-28T23:16:24.654+0000 7fdeb0dad7c0 -1 osd.2 76 log_to_monitors true 2024-02-28T23:16:25.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:25 smithi159 ceph-mon[113833]: from='osd.2 [v2:172.21.15.159:6818/1285075477,v1:172.21.15.159:6819/1285075477]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T23:16:25.472 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:16:25 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2[137223]: 2024-02-28T23:16:25.183+0000 7fdea0200700 -1 osd.2 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T23:16:25.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:25 smithi184 ceph-mon[86482]: from='osd.2 [v2:172.21.15.159:6818/1285075477,v1:172.21.15.159:6819/1285075477]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-28T23:16:25.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.852+0000 7f545fe00700 1 -- 172.21.15.159:0/2283540395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54601037c0 msgr2=0x7f5460107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:25.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.852+0000 7f545fe00700 1 --2- 172.21.15.159:0/2283540395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54601037c0 0x7f5460107810 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5448009910 tx=0x7f5448009c20 comp rx=0 tx=0).stop 2024-02-28T23:16:25.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.852+0000 7f545fe00700 1 -- 172.21.15.159:0/2283540395 shutdown_connections 2024-02-28T23:16:25.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.852+0000 7f545fe00700 1 --2- 172.21.15.159:0/2283540395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54601037c0 0x7f5460107810 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:25.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.852+0000 7f545fe00700 1 --2- 172.21.15.159:0/2283540395 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5460102e10 0x7f54601031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:25.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.852+0000 7f545fe00700 1 -- 172.21.15.159:0/2283540395 >> 172.21.15.159:0/2283540395 conn(0x7f54600fe6c0 msgr2=0x7f5460100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:25.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.853+0000 7f545fe00700 1 -- 172.21.15.159:0/2283540395 shutdown_connections 2024-02-28T23:16:25.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.853+0000 7f545fe00700 1 -- 172.21.15.159:0/2283540395 wait complete. 2024-02-28T23:16:25.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.854+0000 7f545fe00700 1 Processor -- start 2024-02-28T23:16:25.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.854+0000 7f545fe00700 1 -- start start 2024-02-28T23:16:25.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.855+0000 7f545fe00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5460102e10 0x7f54600752a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:25.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.855+0000 7f545fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54601037c0 0x7f54600757e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:25.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.855+0000 7f545fe00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5460079430 con 0x7f54601037c0 2024-02-28T23:16:25.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.855+0000 7f545fe00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5460075d20 con 0x7f5460102e10 2024-02-28T23:16:25.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.855+0000 7f5457e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54601037c0 0x7f54600757e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:25.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.855+0000 7f5457e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54601037c0 0x7f54600757e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58698/0 (socket says 172.21.15.159:58698) 2024-02-28T23:16:25.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.855+0000 7f5457e00700 1 -- 172.21.15.159:0/3002478061 learned_addr learned my addr 172.21.15.159:0/3002478061 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:16:25.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.855+0000 7f545ea00700 1 --2- 172.21.15.159:0/3002478061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5460102e10 0x7f54600752a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:25.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.856+0000 7f5457e00700 1 -- 172.21.15.159:0/3002478061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5460102e10 msgr2=0x7f54600752a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:25.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.856+0000 7f5457e00700 1 --2- 172.21.15.159:0/3002478061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5460102e10 0x7f54600752a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:25.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.856+0000 7f5457e00700 1 -- 172.21.15.159:0/3002478061 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480095f0 con 0x7f54601037c0 2024-02-28T23:16:25.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.856+0000 7f5457e00700 1 --2- 172.21.15.159:0/3002478061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54601037c0 0x7f54600757e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f544800bda0 tx=0x7f544800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:25.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.856+0000 7f5457400700 1 -- 172.21.15.159:0/3002478061 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f544801d070 con 0x7f54601037c0 2024-02-28T23:16:25.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.856+0000 7f5457400700 1 -- 172.21.15.159:0/3002478061 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5448004fb0 con 0x7f54601037c0 2024-02-28T23:16:25.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.856+0000 7f5457400700 1 -- 172.21.15.159:0/3002478061 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f544800f460 con 0x7f54601037c0 2024-02-28T23:16:25.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.856+0000 7f545fe00700 1 -- 172.21.15.159:0/3002478061 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5460075fa0 con 0x7f54601037c0 2024-02-28T23:16:25.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.856+0000 7f545fe00700 1 -- 172.21.15.159:0/3002478061 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54601a6f20 con 0x7f54601037c0 2024-02-28T23:16:25.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.858+0000 7f545fe00700 1 -- 172.21.15.159:0/3002478061 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f546010b120 con 0x7f54601037c0 2024-02-28T23:16:25.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.859+0000 7f5457400700 1 -- 172.21.15.159:0/3002478061 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f5448022800 con 0x7f54601037c0 2024-02-28T23:16:25.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.860+0000 7f5457400700 1 --2- 172.21.15.159:0/3002478061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f544406d8a0 0x7f544406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:25.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.860+0000 7f5457400700 1 -- 172.21.15.159:0/3002478061 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f544808ea90 con 0x7f54601037c0 2024-02-28T23:16:25.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.860+0000 7f545ea00700 1 --2- 172.21.15.159:0/3002478061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f544406d8a0 0x7f544406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:25.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.861+0000 7f545ea00700 1 --2- 172.21.15.159:0/3002478061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f544406d8a0 0x7f544406fd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54500060b0 tx=0x7f5450007790 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:25.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:25.865+0000 7f5457400700 1 -- 172.21.15.159:0/3002478061 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5448058390 con 0x7f54601037c0 2024-02-28T23:16:26.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.116+0000 7f545fe00700 1 -- 172.21.15.159:0/3002478061 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54600611d0 con 0x7f544406d8a0 2024-02-28T23:16:26.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.120+0000 7f5457400700 1 -- 172.21.15.159:0/3002478061 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f54600611d0 con 0x7f544406d8a0 2024-02-28T23:16:26.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.123+0000 7f545fe00700 1 -- 172.21.15.159:0/3002478061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f544406d8a0 msgr2=0x7f544406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:26.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.123+0000 7f545fe00700 1 --2- 172.21.15.159:0/3002478061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f544406d8a0 0x7f544406fd60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f54500060b0 tx=0x7f5450007790 comp rx=0 tx=0).stop 2024-02-28T23:16:26.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.123+0000 7f545fe00700 1 -- 172.21.15.159:0/3002478061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54601037c0 msgr2=0x7f54600757e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:26.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.123+0000 7f545fe00700 1 --2- 172.21.15.159:0/3002478061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54601037c0 0x7f54600757e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f544800bda0 tx=0x7f544800be80 comp rx=0 tx=0).stop 2024-02-28T23:16:26.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.123+0000 7f545fe00700 1 -- 172.21.15.159:0/3002478061 shutdown_connections 2024-02-28T23:16:26.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.123+0000 7f545fe00700 1 --2- 172.21.15.159:0/3002478061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5460102e10 0x7f54600752a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.123+0000 7f545fe00700 1 --2- 172.21.15.159:0/3002478061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f544406d8a0 0x7f544406fd60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.123+0000 7f545fe00700 1 --2- 172.21.15.159:0/3002478061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f54601037c0 0x7f54600757e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.123+0000 7f545fe00700 1 -- 172.21.15.159:0/3002478061 >> 172.21.15.159:0/3002478061 conn(0x7f54600fe6c0 msgr2=0x7f5460107080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:26.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.124+0000 7f545fe00700 1 -- 172.21.15.159:0/3002478061 shutdown_connections 2024-02-28T23:16:26.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.124+0000 7f545fe00700 1 -- 172.21.15.159:0/3002478061 wait complete. 2024-02-28T23:16:26.138 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:16:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.296+0000 7f5cb1200700 1 -- 172.21.15.159:0/692625849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cac1071d0 msgr2=0x7f5cac107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.296+0000 7f5cb1200700 1 --2- 172.21.15.159:0/692625849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cac1071d0 0x7f5cac107650 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009910 tx=0x7f5c98009c20 comp rx=0 tx=0).stop 2024-02-28T23:16:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.296+0000 7f5cb1200700 1 -- 172.21.15.159:0/692625849 shutdown_connections 2024-02-28T23:16:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.296+0000 7f5cb1200700 1 --2- 172.21.15.159:0/692625849 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cac1071d0 0x7f5cac107650 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.296+0000 7f5cb1200700 1 --2- 172.21.15.159:0/692625849 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cac10d280 0x7f5cac10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.296+0000 7f5cb1200700 1 -- 172.21.15.159:0/692625849 >> 172.21.15.159:0/692625849 conn(0x7f5cac0769e0 msgr2=0x7f5cac078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.296+0000 7f5cb1200700 1 -- 172.21.15.159:0/692625849 shutdown_connections 2024-02-28T23:16:26.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.296+0000 7f5cb1200700 1 -- 172.21.15.159:0/692625849 wait complete. 2024-02-28T23:16:26.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.297+0000 7f5cb1200700 1 Processor -- start 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.297+0000 7f5cb1200700 1 -- start start 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5cb1200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cac1071d0 0x7f5cac19ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5cb1200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cac10d280 0x7f5cac19d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5cb1200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac19da30 con 0x7f5cac1071d0 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5cb1200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cac1a17c0 con 0x7f5cac10d280 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5ca9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cac1071d0 0x7f5cac19ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5ca9e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cac1071d0 0x7f5cac19ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58710/0 (socket says 172.21.15.159:58710) 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5ca9e00700 1 -- 172.21.15.159:0/2755313420 learned_addr learned my addr 172.21.15.159:0/2755313420 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5ca9400700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cac10d280 0x7f5cac19d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5ca9e00700 1 -- 172.21.15.159:0/2755313420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cac10d280 msgr2=0x7f5cac19d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5ca9e00700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cac10d280 0x7f5cac19d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5ca9e00700 1 -- 172.21.15.159:0/2755313420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c980095f0 con 0x7f5cac1071d0 2024-02-28T23:16:26.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.298+0000 7f5ca9400700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cac10d280 0x7f5cac19d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:16:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.299+0000 7f5ca9e00700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cac1071d0 0x7f5cac19ce10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00b4b0 tx=0x7f5c9c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.299+0000 7f5ca2a00700 1 -- 172.21.15.159:0/2755313420 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c9c011800 con 0x7f5cac1071d0 2024-02-28T23:16:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.299+0000 7f5ca2a00700 1 -- 172.21.15.159:0/2755313420 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5c9c011e20 con 0x7f5cac1071d0 2024-02-28T23:16:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.299+0000 7f5cb1200700 1 -- 172.21.15.159:0/2755313420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cac1a1aa0 con 0x7f5cac1071d0 2024-02-28T23:16:26.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.299+0000 7f5ca2a00700 1 -- 172.21.15.159:0/2755313420 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c9c00f2e0 con 0x7f5cac1071d0 2024-02-28T23:16:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.299+0000 7f5cb1200700 1 -- 172.21.15.159:0/2755313420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cac1a2070 con 0x7f5cac1071d0 2024-02-28T23:16:26.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.300+0000 7f5cb1200700 1 -- 172.21.15.159:0/2755313420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cac10f6f0 con 0x7f5cac1071d0 2024-02-28T23:16:26.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.302+0000 7f5ca2a00700 1 -- 172.21.15.159:0/2755313420 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f5c9c010380 con 0x7f5cac1071d0 2024-02-28T23:16:26.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.302+0000 7f5ca2a00700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5c9006d8a0 0x7f5c9006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:26.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.303+0000 7f5ca2a00700 1 -- 172.21.15.159:0/2755313420 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f5c9c08d150 con 0x7f5cac1071d0 2024-02-28T23:16:26.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.303+0000 7f5ca9400700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5c9006d8a0 0x7f5c9006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:26.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.303+0000 7f5ca9400700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5c9006d8a0 0x7f5c9006fd60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5c98006010 tx=0x7f5c9800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:26.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.307+0000 7f5ca2a00700 1 -- 172.21.15.159:0/2755313420 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5c9c056930 con 0x7f5cac1071d0 2024-02-28T23:16:26.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:26 smithi159 ceph-mon[113833]: pgmap v138: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s; 32/228 objects degraded (14.035%) 2024-02-28T23:16:26.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:26 smithi159 ceph-mon[113833]: from='osd.2 [v2:172.21.15.159:6818/1285075477,v1:172.21.15.159:6819/1285075477]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T23:16:26.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:26 smithi159 ceph-mon[113833]: osdmap e79: 6 total, 5 up, 6 in 2024-02-28T23:16:26.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:26 smithi159 ceph-mon[113833]: from='osd.2 [v2:172.21.15.159:6818/1285075477,v1:172.21.15.159:6819/1285075477]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T23:16:26.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.552+0000 7f5cb1200700 1 -- 172.21.15.159:0/2755313420 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cac1a2420 con 0x7f5c9006d8a0 2024-02-28T23:16:26.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.554+0000 7f5ca2a00700 1 -- 172.21.15.159:0/2755313420 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f5cac1a2420 con 0x7f5c9006d8a0 2024-02-28T23:16:26.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.556+0000 7f5cb1200700 1 -- 172.21.15.159:0/2755313420 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5c9006d8a0 msgr2=0x7f5c9006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:26.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.556+0000 7f5cb1200700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5c9006d8a0 0x7f5c9006fd60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5c98006010 tx=0x7f5c9800b540 comp rx=0 tx=0).stop 2024-02-28T23:16:26.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.556+0000 7f5cb1200700 1 -- 172.21.15.159:0/2755313420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cac1071d0 msgr2=0x7f5cac19ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:26.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.556+0000 7f5cb1200700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cac1071d0 0x7f5cac19ce10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00b4b0 tx=0x7f5c9c00b870 comp rx=0 tx=0).stop 2024-02-28T23:16:26.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.556+0000 7f5cb1200700 1 -- 172.21.15.159:0/2755313420 shutdown_connections 2024-02-28T23:16:26.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.556+0000 7f5cb1200700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5c9006d8a0 0x7f5c9006fd60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.556+0000 7f5cb1200700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5cac1071d0 0x7f5cac19ce10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.556+0000 7f5cb1200700 1 --2- 172.21.15.159:0/2755313420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5cac10d280 0x7f5cac19d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.556+0000 7f5cb1200700 1 -- 172.21.15.159:0/2755313420 >> 172.21.15.159:0/2755313420 conn(0x7f5cac0769e0 msgr2=0x7f5cac0784d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:26.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.557+0000 7f5cb1200700 1 -- 172.21.15.159:0/2755313420 shutdown_connections 2024-02-28T23:16:26.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.557+0000 7f5cb1200700 1 -- 172.21.15.159:0/2755313420 wait complete. 2024-02-28T23:16:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:26 smithi184 ceph-mon[86482]: pgmap v138: 65 pgs: 17 active+undersized, 13 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 1 op/s; 32/228 objects degraded (14.035%) 2024-02-28T23:16:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:26 smithi184 ceph-mon[86482]: from='osd.2 [v2:172.21.15.159:6818/1285075477,v1:172.21.15.159:6819/1285075477]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-28T23:16:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:26 smithi184 ceph-mon[86482]: osdmap e79: 6 total, 5 up, 6 in 2024-02-28T23:16:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:26 smithi184 ceph-mon[86482]: from='osd.2 [v2:172.21.15.159:6818/1285075477,v1:172.21.15.159:6819/1285075477]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi159", "root=default"]}]: dispatch 2024-02-28T23:16:26.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.708+0000 7f9fe1800700 1 -- 172.21.15.159:0/104148521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fdc068670 msgr2=0x7f9fdc068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:26.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.708+0000 7f9fe1800700 1 --2- 172.21.15.159:0/104148521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fdc068670 0x7f9fdc068a50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc009910 tx=0x7f9fcc009c20 comp rx=0 tx=0).stop 2024-02-28T23:16:26.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.709+0000 7f9fe1800700 1 -- 172.21.15.159:0/104148521 shutdown_connections 2024-02-28T23:16:26.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.709+0000 7f9fe1800700 1 --2- 172.21.15.159:0/104148521 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc069020 0x7f9fdc105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.709+0000 7f9fe1800700 1 --2- 172.21.15.159:0/104148521 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fdc068670 0x7f9fdc068a50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.709+0000 7f9fe1800700 1 -- 172.21.15.159:0/104148521 >> 172.21.15.159:0/104148521 conn(0x7f9fdc0755a0 msgr2=0x7f9fdc0759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:26.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.709+0000 7f9fe1800700 1 -- 172.21.15.159:0/104148521 shutdown_connections 2024-02-28T23:16:26.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.709+0000 7f9fe1800700 1 -- 172.21.15.159:0/104148521 wait complete. 2024-02-28T23:16:26.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.710+0000 7f9fe1800700 1 Processor -- start 2024-02-28T23:16:26.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.710+0000 7f9fe1800700 1 -- start start 2024-02-28T23:16:26.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.711+0000 7f9fe1800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc068670 0x7f9fdc0ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:26.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.711+0000 7f9fe1800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fdc069020 0x7f9fdc1001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:26.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.711+0000 7f9fe1800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc100720 con 0x7f9fdc069020 2024-02-28T23:16:26.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.711+0000 7f9fe1800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fdc100860 con 0x7f9fdc068670 2024-02-28T23:16:26.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.711+0000 7f9fda000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fdc069020 0x7f9fdc1001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:26.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.711+0000 7f9fda000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fdc069020 0x7f9fdc1001e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58736/0 (socket says 172.21.15.159:58736) 2024-02-28T23:16:26.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.711+0000 7f9fda000700 1 -- 172.21.15.159:0/403440610 learned_addr learned my addr 172.21.15.159:0/403440610 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:16:26.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.712+0000 7f9fdaa00700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc068670 0x7f9fdc0ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:26.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.712+0000 7f9fda000700 1 -- 172.21.15.159:0/403440610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc068670 msgr2=0x7f9fdc0ffca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:26.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.712+0000 7f9fda000700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc068670 0x7f9fdc0ffca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.712+0000 7f9fda000700 1 -- 172.21.15.159:0/403440610 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc0095f0 con 0x7f9fdc069020 2024-02-28T23:16:26.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.712+0000 7f9fdaa00700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc068670 0x7f9fdc0ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:16:26.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.712+0000 7f9fda000700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fdc069020 0x7f9fdc1001e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800d900 tx=0x7f9fc800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:26.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.712+0000 7f9fd3400700 1 -- 172.21.15.159:0/403440610 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fc8009900 con 0x7f9fdc069020 2024-02-28T23:16:26.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.712+0000 7f9fe1800700 1 -- 172.21.15.159:0/403440610 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fdc1a2910 con 0x7f9fdc069020 2024-02-28T23:16:26.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.712+0000 7f9fd3400700 1 -- 172.21.15.159:0/403440610 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9fc8010460 con 0x7f9fdc069020 2024-02-28T23:16:26.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.712+0000 7f9fd3400700 1 -- 172.21.15.159:0/403440610 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9fc800f5f0 con 0x7f9fdc069020 2024-02-28T23:16:26.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.713+0000 7f9fe1800700 1 -- 172.21.15.159:0/403440610 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fdc1a2d20 con 0x7f9fdc069020 2024-02-28T23:16:26.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.714+0000 7f9fe1800700 1 -- 172.21.15.159:0/403440610 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fdc109130 con 0x7f9fdc069020 2024-02-28T23:16:26.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.715+0000 7f9fd3400700 1 -- 172.21.15.159:0/403440610 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9fc80105d0 con 0x7f9fdc069020 2024-02-28T23:16:26.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.716+0000 7f9fd3400700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9fc006d8a0 0x7f9fc006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:26.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.716+0000 7f9fd3400700 1 -- 172.21.15.159:0/403440610 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f9fc808d3f0 con 0x7f9fdc069020 2024-02-28T23:16:26.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.716+0000 7f9fdaa00700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9fc006d8a0 0x7f9fc006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:26.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.717+0000 7f9fdaa00700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9fc006d8a0 0x7f9fc006fd60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc006010 tx=0x7f9fcc00b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:26.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.721+0000 7f9fd3400700 1 -- 172.21.15.159:0/403440610 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9fc8056b20 con 0x7f9fdc069020 2024-02-28T23:16:26.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.948+0000 7f9fe1800700 1 -- 172.21.15.159:0/403440610 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9fdc02cda0 con 0x7f9fc006d8a0 2024-02-28T23:16:26.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.960+0000 7f9fd3400700 1 -- 172.21.15.159:0/403440610 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f9fdc02cda0 con 0x7f9fc006d8a0 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (5m) 0s ago 20m 13.9M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (20m) 0s ago 20m 8988k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (19m) 113s ago 19m 8108k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (2m) 0s ago 20m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (118s) 113s ago 18m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (5m) 0s ago 19m 73.5M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (12m) 0s ago 12m 147M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (13m) 0s ago 12m 86.9M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (12m) 113s ago 12m 17.6M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (12m) 113s ago 12m 17.5M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (8m) 0s ago 22m 502M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (7m) 113s ago 18m 450M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:16:26.959 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (3m) 0s ago 22m 48.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:16:26.960 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (3m) 113s ago 18m 32.6M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:16:26.960 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (7m) 0s ago 20m 7884k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:16:26.960 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (6m) 113s ago 18m 8174k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:16:26.960 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (87s) 0s ago 17m 114M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:16:26.960 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (40s) 0s ago 17m 97.5M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9120e23d80c0 2024-02-28T23:16:26.960 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (8s) 0s ago 16m 11.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 952e59c58165 2024-02-28T23:16:26.960 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (15m) 113s ago 15m 300M 2241M 18.2.1 5be31c24972a 195b5ccea550 2024-02-28T23:16:26.960 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (15m) 113s ago 15m 251M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:16:26.960 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (14m) 113s ago 14m 230M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:16:26.960 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (6m) 0s ago 19m 55.0M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:16:26.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.962+0000 7f9fe1800700 1 -- 172.21.15.159:0/403440610 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9fc006d8a0 msgr2=0x7f9fc006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:26.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.962+0000 7f9fe1800700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9fc006d8a0 0x7f9fc006fd60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc006010 tx=0x7f9fcc00b540 comp rx=0 tx=0).stop 2024-02-28T23:16:26.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.962+0000 7f9fe1800700 1 -- 172.21.15.159:0/403440610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fdc069020 msgr2=0x7f9fdc1001e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:26.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.962+0000 7f9fe1800700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fdc069020 0x7f9fdc1001e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800d900 tx=0x7f9fc800dcc0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.963+0000 7f9fe1800700 1 -- 172.21.15.159:0/403440610 shutdown_connections 2024-02-28T23:16:26.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.963+0000 7f9fe1800700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9fdc068670 0x7f9fdc0ffca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.963+0000 7f9fe1800700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9fc006d8a0 0x7f9fc006fd60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.963+0000 7f9fe1800700 1 --2- 172.21.15.159:0/403440610 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9fdc069020 0x7f9fdc1001e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:26.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.963+0000 7f9fe1800700 1 -- 172.21.15.159:0/403440610 >> 172.21.15.159:0/403440610 conn(0x7f9fdc0755a0 msgr2=0x7f9fdc0fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:26.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.963+0000 7f9fe1800700 1 -- 172.21.15.159:0/403440610 shutdown_connections 2024-02-28T23:16:26.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:26.963+0000 7f9fe1800700 1 -- 172.21.15.159:0/403440610 wait complete. 2024-02-28T23:16:27.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.108+0000 7fa6ef000700 1 -- 172.21.15.159:0/2172926891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e8073a80 msgr2=0x7fa6e810cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:27.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.108+0000 7fa6ef000700 1 --2- 172.21.15.159:0/2172926891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e8073a80 0x7fa6e810cea0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009910 tx=0x7fa6d4009c20 comp rx=0 tx=0).stop 2024-02-28T23:16:27.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.108+0000 7fa6ef000700 1 -- 172.21.15.159:0/2172926891 shutdown_connections 2024-02-28T23:16:27.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.108+0000 7fa6ef000700 1 --2- 172.21.15.159:0/2172926891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e8073a80 0x7fa6e810cea0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.108+0000 7fa6ef000700 1 --2- 172.21.15.159:0/2172926891 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6e8073160 0x7fa6e8073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.108+0000 7fa6ef000700 1 -- 172.21.15.159:0/2172926891 >> 172.21.15.159:0/2172926891 conn(0x7fa6e80fc630 msgr2=0x7fa6e80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:27.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.108+0000 7fa6ef000700 1 -- 172.21.15.159:0/2172926891 shutdown_connections 2024-02-28T23:16:27.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.109+0000 7fa6ef000700 1 -- 172.21.15.159:0/2172926891 wait complete. 2024-02-28T23:16:27.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.110+0000 7fa6ef000700 1 Processor -- start 2024-02-28T23:16:27.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.110+0000 7fa6ef000700 1 -- start start 2024-02-28T23:16:27.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.110+0000 7fa6ef000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6e8073160 0x7fa6e819e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:27.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.110+0000 7fa6ef000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e8073a80 0x7fa6e819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:27.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.110+0000 7fa6ef000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e819f3f0 con 0x7fa6e8073a80 2024-02-28T23:16:27.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.110+0000 7fa6ef000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e81988a0 con 0x7fa6e8073160 2024-02-28T23:16:27.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.110+0000 7fa6e7400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e8073a80 0x7fa6e819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:27.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.110+0000 7fa6e7400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e8073a80 0x7fa6e819ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58756/0 (socket says 172.21.15.159:58756) 2024-02-28T23:16:27.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.110+0000 7fa6e7400700 1 -- 172.21.15.159:0/2772550835 learned_addr learned my addr 172.21.15.159:0/2772550835 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:16:27.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.111+0000 7fa6e7e00700 1 --2- 172.21.15.159:0/2772550835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6e8073160 0x7fa6e819e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:27.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.111+0000 7fa6e7400700 1 -- 172.21.15.159:0/2772550835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6e8073160 msgr2=0x7fa6e819e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:27.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.111+0000 7fa6e7400700 1 --2- 172.21.15.159:0/2772550835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6e8073160 0x7fa6e819e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.111+0000 7fa6e7400700 1 -- 172.21.15.159:0/2772550835 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40095f0 con 0x7fa6e8073a80 2024-02-28T23:16:27.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.111+0000 7fa6e7400700 1 --2- 172.21.15.159:0/2772550835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e8073a80 0x7fa6e819ed60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4006010 tx=0x7fa6d400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:27.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.112+0000 7fa6e4c00700 1 -- 172.21.15.159:0/2772550835 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6d401d070 con 0x7fa6e8073a80 2024-02-28T23:16:27.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.112+0000 7fa6e4c00700 1 -- 172.21.15.159:0/2772550835 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa6d400f460 con 0x7fa6e8073a80 2024-02-28T23:16:27.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.112+0000 7fa6ef000700 1 -- 172.21.15.159:0/2772550835 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e8198b20 con 0x7fa6e8073a80 2024-02-28T23:16:27.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.112+0000 7fa6e4c00700 1 -- 172.21.15.159:0/2772550835 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6d40175f0 con 0x7fa6e8073a80 2024-02-28T23:16:27.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.112+0000 7fa6ef000700 1 -- 172.21.15.159:0/2772550835 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e8199010 con 0x7fa6e8073a80 2024-02-28T23:16:27.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.113+0000 7fa6ef000700 1 -- 172.21.15.159:0/2772550835 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e810a5a0 con 0x7fa6e8073a80 2024-02-28T23:16:27.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.115+0000 7fa6e4c00700 1 -- 172.21.15.159:0/2772550835 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa6d400f5d0 con 0x7fa6e8073a80 2024-02-28T23:16:27.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.116+0000 7fa6e4c00700 1 --2- 172.21.15.159:0/2772550835 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa6cc06d8a0 0x7fa6cc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:27.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.116+0000 7fa6e4c00700 1 -- 172.21.15.159:0/2772550835 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fa6d408ea20 con 0x7fa6e8073a80 2024-02-28T23:16:27.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.116+0000 7fa6e7e00700 1 --2- 172.21.15.159:0/2772550835 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa6cc06d8a0 0x7fa6cc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:27.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.117+0000 7fa6e7e00700 1 --2- 172.21.15.159:0/2772550835 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa6cc06d8a0 0x7fa6cc06fd60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009a10 tx=0x7fa6d8009190 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:27.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.124+0000 7fa6e4c00700 1 -- 172.21.15.159:0/2772550835 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa6d405bd20 con 0x7fa6e8073a80 2024-02-28T23:16:27.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.470+0000 7fa6ef000700 1 -- 172.21.15.159:0/2772550835 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa6e804ea90 con 0x7fa6e8073a80 2024-02-28T23:16:27.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:27 smithi159 ceph-mon[113833]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:16:27.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:27 smithi159 ceph-mon[113833]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:16:27.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:27 smithi159 ceph-mon[113833]: osd.2 [v2:172.21.15.159:6818/1285075477,v1:172.21.15.159:6819/1285075477] boot 2024-02-28T23:16:27.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:27 smithi159 ceph-mon[113833]: osdmap e80: 6 total, 6 up, 6 in 2024-02-28T23:16:27.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:27 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:16:27.469 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:27 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:27.470 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:27 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:27.470 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:27 smithi159 ceph-mon[113833]: osdmap e81: 6 total, 6 up, 6 in 2024-02-28T23:16:27.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.471+0000 7fa6e4c00700 1 -- 172.21.15.159:0/2772550835 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fa6d405b8b0 con 0x7fa6e8073a80 2024-02-28T23:16:27.470 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:16:27.470 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:16:27.470 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:16:27.470 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 3, 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 7, 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 7 2024-02-28T23:16:27.471 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:16:27.472 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:16:27.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.474+0000 7fa6ef000700 1 -- 172.21.15.159:0/2772550835 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa6cc06d8a0 msgr2=0x7fa6cc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:27.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.474+0000 7fa6ef000700 1 --2- 172.21.15.159:0/2772550835 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa6cc06d8a0 0x7fa6cc06fd60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8009a10 tx=0x7fa6d8009190 comp rx=0 tx=0).stop 2024-02-28T23:16:27.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.474+0000 7fa6ef000700 1 -- 172.21.15.159:0/2772550835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e8073a80 msgr2=0x7fa6e819ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:27.472 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.474+0000 7fa6ef000700 1 --2- 172.21.15.159:0/2772550835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e8073a80 0x7fa6e819ed60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4006010 tx=0x7fa6d400bd70 comp rx=0 tx=0).stop 2024-02-28T23:16:27.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.474+0000 7fa6ef000700 1 -- 172.21.15.159:0/2772550835 shutdown_connections 2024-02-28T23:16:27.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.474+0000 7fa6ef000700 1 --2- 172.21.15.159:0/2772550835 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa6e8073160 0x7fa6e819e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.474+0000 7fa6ef000700 1 --2- 172.21.15.159:0/2772550835 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa6cc06d8a0 0x7fa6cc06fd60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.474+0000 7fa6ef000700 1 --2- 172.21.15.159:0/2772550835 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6e8073a80 0x7fa6e819ed60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.474+0000 7fa6ef000700 1 -- 172.21.15.159:0/2772550835 >> 172.21.15.159:0/2772550835 conn(0x7fa6e80fc630 msgr2=0x7fa6e81076e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:27.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.474+0000 7fa6ef000700 1 -- 172.21.15.159:0/2772550835 shutdown_connections 2024-02-28T23:16:27.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.474+0000 7fa6ef000700 1 -- 172.21.15.159:0/2772550835 wait complete. 2024-02-28T23:16:27.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:27 smithi184 ceph-mon[86482]: from='client.34310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:16:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:27 smithi184 ceph-mon[86482]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:16:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:27 smithi184 ceph-mon[86482]: osd.2 [v2:172.21.15.159:6818/1285075477,v1:172.21.15.159:6819/1285075477] boot 2024-02-28T23:16:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:27 smithi184 ceph-mon[86482]: osdmap e80: 6 total, 6 up, 6 in 2024-02-28T23:16:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:27 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-28T23:16:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:27 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:27 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:27 smithi184 ceph-mon[86482]: osdmap e81: 6 total, 6 up, 6 in 2024-02-28T23:16:27.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.623+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1114655794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c94068410 msgr2=0x7f4c940687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:27.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.623+0000 7f4c9ba00700 1 --2- 172.21.15.159:0/1114655794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c94068410 0x7f4c940687f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4c88009910 tx=0x7f4c88009c20 comp rx=0 tx=0).stop 2024-02-28T23:16:27.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.623+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1114655794 shutdown_connections 2024-02-28T23:16:27.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.623+0000 7f4c9ba00700 1 --2- 172.21.15.159:0/1114655794 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c94068d30 0x7f4c9410d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.623+0000 7f4c9ba00700 1 --2- 172.21.15.159:0/1114655794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c94068410 0x7f4c940687f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.623+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1114655794 >> 172.21.15.159:0/1114655794 conn(0x7f4c940755a0 msgr2=0x7f4c940759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:27.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.623+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1114655794 shutdown_connections 2024-02-28T23:16:27.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.623+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1114655794 wait complete. 2024-02-28T23:16:27.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.624+0000 7f4c9ba00700 1 Processor -- start 2024-02-28T23:16:27.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.624+0000 7f4c9ba00700 1 -- start start 2024-02-28T23:16:27.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.625+0000 7f4c9ba00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c94068410 0x7f4c9419e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:27.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.625+0000 7f4c9ba00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c94068d30 0x7f4c9419ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:27.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.625+0000 7f4c9ba00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9419f280 con 0x7f4c94068410 2024-02-28T23:16:27.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.625+0000 7f4c9ba00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c94198730 con 0x7f4c94068d30 2024-02-28T23:16:27.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.625+0000 7f4c99000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c94068410 0x7f4c9419e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:27.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.625+0000 7f4c99000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c94068410 0x7f4c9419e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58774/0 (socket says 172.21.15.159:58774) 2024-02-28T23:16:27.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.625+0000 7f4c99000700 1 -- 172.21.15.159:0/1826907167 learned_addr learned my addr 172.21.15.159:0/1826907167 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:16:27.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.625+0000 7f4c93e00700 1 --2- 172.21.15.159:0/1826907167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c94068d30 0x7f4c9419ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:27.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.625+0000 7f4c99000700 1 -- 172.21.15.159:0/1826907167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c94068d30 msgr2=0x7f4c9419ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:27.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.626+0000 7f4c99000700 1 --2- 172.21.15.159:0/1826907167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c94068d30 0x7f4c9419ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.626+0000 7f4c99000700 1 -- 172.21.15.159:0/1826907167 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c880095f0 con 0x7f4c94068410 2024-02-28T23:16:27.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.626+0000 7f4c99000700 1 --2- 172.21.15.159:0/1826907167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c94068410 0x7f4c9419e6b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800bda0 tx=0x7f4c8800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:27.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.626+0000 7f4c91600700 1 -- 172.21.15.159:0/1826907167 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c8801d070 con 0x7f4c94068410 2024-02-28T23:16:27.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.626+0000 7f4c91600700 1 -- 172.21.15.159:0/1826907167 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4c88004fb0 con 0x7f4c94068410 2024-02-28T23:16:27.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.626+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1826907167 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c94198a10 con 0x7f4c94068410 2024-02-28T23:16:27.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.626+0000 7f4c91600700 1 -- 172.21.15.159:0/1826907167 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4c8800f460 con 0x7f4c94068410 2024-02-28T23:16:27.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.626+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1826907167 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c94198f60 con 0x7f4c94068410 2024-02-28T23:16:27.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.627+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1826907167 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c74005320 con 0x7f4c94068410 2024-02-28T23:16:27.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.628+0000 7f4c91600700 1 -- 172.21.15.159:0/1826907167 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4c88004af0 con 0x7f4c94068410 2024-02-28T23:16:27.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.630+0000 7f4c91600700 1 --2- 172.21.15.159:0/1826907167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c7c06d8a0 0x7f4c7c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:27.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.630+0000 7f4c91600700 1 -- 172.21.15.159:0/1826907167 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f4c8808ea80 con 0x7f4c94068410 2024-02-28T23:16:27.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.630+0000 7f4c93e00700 1 --2- 172.21.15.159:0/1826907167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c7c06d8a0 0x7f4c7c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:27.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.631+0000 7f4c93e00700 1 --2- 172.21.15.159:0/1826907167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c7c06d8a0 0x7f4c7c06fd60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c80005fd0 tx=0x7f4c8000a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:27.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.634+0000 7f4c91600700 1 -- 172.21.15.159:0/1826907167 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4c8805bd10 con 0x7f4c94068410 2024-02-28T23:16:27.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.903+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1826907167 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4c74006200 con 0x7f4c94068410 2024-02-28T23:16:27.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.903+0000 7f4c91600700 1 -- 172.21.15.159:0/1826907167 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1879 (secure 0 0 0) 0x7f4c8805b8a0 con 0x7f4c94068410 2024-02-28T23:16:27.902 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:16:27.902 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:16:27.902 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:16:27.903 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:16:27.904 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:16:27.904 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:16:27.904 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:16:27.904 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:16:27.904 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:16:27.904 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:16:27.904 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:16:27.904 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:16:27.904 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:16:27.904 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:16:27.904 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:16:27.905 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:16:27.906 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:16:27.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.906+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1826907167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c7c06d8a0 msgr2=0x7f4c7c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:27.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.906+0000 7f4c9ba00700 1 --2- 172.21.15.159:0/1826907167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c7c06d8a0 0x7f4c7c06fd60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c80005fd0 tx=0x7f4c8000a560 comp rx=0 tx=0).stop 2024-02-28T23:16:27.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.906+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1826907167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c94068410 msgr2=0x7f4c9419e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:27.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.906+0000 7f4c9ba00700 1 --2- 172.21.15.159:0/1826907167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c94068410 0x7f4c9419e6b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4c8800bda0 tx=0x7f4c8800be80 comp rx=0 tx=0).stop 2024-02-28T23:16:27.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.906+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1826907167 shutdown_connections 2024-02-28T23:16:27.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.906+0000 7f4c9ba00700 1 --2- 172.21.15.159:0/1826907167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4c7c06d8a0 0x7f4c7c06fd60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.906+0000 7f4c9ba00700 1 --2- 172.21.15.159:0/1826907167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c94068410 0x7f4c9419e6b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.906+0000 7f4c9ba00700 1 --2- 172.21.15.159:0/1826907167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4c94068d30 0x7f4c9419ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:27.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.906+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1826907167 >> 172.21.15.159:0/1826907167 conn(0x7f4c940755a0 msgr2=0x7f4c940fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:27.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.906+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1826907167 shutdown_connections 2024-02-28T23:16:27.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:27.907+0000 7f4c9ba00700 1 -- 172.21.15.159:0/1826907167 wait complete. 2024-02-28T23:16:27.908 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:16:28.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.056+0000 7fd706e00700 1 -- 172.21.15.159:0/2844516802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd700100970 msgr2=0x7fd700100df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:28.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.056+0000 7fd706e00700 1 --2- 172.21.15.159:0/2844516802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd700100970 0x7fd700100df0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec009910 tx=0x7fd6ec009c20 comp rx=0 tx=0).stop 2024-02-28T23:16:28.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.056+0000 7fd706e00700 1 -- 172.21.15.159:0/2844516802 shutdown_connections 2024-02-28T23:16:28.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.056+0000 7fd706e00700 1 --2- 172.21.15.159:0/2844516802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd700100970 0x7fd700100df0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.056+0000 7fd706e00700 1 --2- 172.21.15.159:0/2844516802 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd700106970 0x7fd700106d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.056+0000 7fd706e00700 1 -- 172.21.15.159:0/2844516802 >> 172.21.15.159:0/2844516802 conn(0x7fd7000fc440 msgr2=0x7fd7000fe860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:28.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.056+0000 7fd706e00700 1 -- 172.21.15.159:0/2844516802 shutdown_connections 2024-02-28T23:16:28.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.056+0000 7fd706e00700 1 -- 172.21.15.159:0/2844516802 wait complete. 2024-02-28T23:16:28.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.058+0000 7fd706e00700 1 Processor -- start 2024-02-28T23:16:28.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.058+0000 7fd706e00700 1 -- start start 2024-02-28T23:16:28.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.058+0000 7fd706e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd700100970 0x7fd70019e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:28.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.058+0000 7fd706e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd700106970 0x7fd70019ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:28.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.058+0000 7fd706e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70019f0c0 con 0x7fd700106970 2024-02-28T23:16:28.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.058+0000 7fd706e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd700198570 con 0x7fd700100970 2024-02-28T23:16:28.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.059+0000 7fd705000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd700106970 0x7fd70019ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:28.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.059+0000 7fd705000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd700106970 0x7fd70019ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42916/0 (socket says 172.21.15.159:42916) 2024-02-28T23:16:28.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.059+0000 7fd705000700 1 -- 172.21.15.159:0/184514001 learned_addr learned my addr 172.21.15.159:0/184514001 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:16:28.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.059+0000 7fd705a00700 1 --2- 172.21.15.159:0/184514001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd700100970 0x7fd70019e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:28.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.059+0000 7fd705000700 1 -- 172.21.15.159:0/184514001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd700100970 msgr2=0x7fd70019e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:28.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.059+0000 7fd705000700 1 --2- 172.21.15.159:0/184514001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd700100970 0x7fd70019e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.059+0000 7fd705000700 1 -- 172.21.15.159:0/184514001 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec0095f0 con 0x7fd700106970 2024-02-28T23:16:28.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.059+0000 7fd705000700 1 --2- 172.21.15.159:0/184514001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd700106970 0x7fd70019ea30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00b5c0 tx=0x7fd6ec00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:28.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.060+0000 7fd6fe000700 1 -- 172.21.15.159:0/184514001 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ec01d070 con 0x7fd700106970 2024-02-28T23:16:28.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.060+0000 7fd6fe000700 1 -- 172.21.15.159:0/184514001 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd6ec00f460 con 0x7fd700106970 2024-02-28T23:16:28.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.060+0000 7fd706e00700 1 -- 172.21.15.159:0/184514001 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7001987f0 con 0x7fd700106970 2024-02-28T23:16:28.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.060+0000 7fd6fe000700 1 -- 172.21.15.159:0/184514001 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6ec017610 con 0x7fd700106970 2024-02-28T23:16:28.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.060+0000 7fd706e00700 1 -- 172.21.15.159:0/184514001 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd700198ce0 con 0x7fd700106970 2024-02-28T23:16:28.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.061+0000 7fd706e00700 1 -- 172.21.15.159:0/184514001 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70004f2e0 con 0x7fd700106970 2024-02-28T23:16:28.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.062+0000 7fd6fe000700 1 -- 172.21.15.159:0/184514001 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd6ec00f5d0 con 0x7fd700106970 2024-02-28T23:16:28.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.063+0000 7fd6fe000700 1 --2- 172.21.15.159:0/184514001 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd6e806d8a0 0x7fd6e806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:28.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.063+0000 7fd6fe000700 1 -- 172.21.15.159:0/184514001 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fd6ec08ebc0 con 0x7fd700106970 2024-02-28T23:16:28.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.063+0000 7fd705a00700 1 --2- 172.21.15.159:0/184514001 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd6e806d8a0 0x7fd6e806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:28.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.064+0000 7fd705a00700 1 --2- 172.21.15.159:0/184514001 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd6e806d8a0 0x7fd6e806fd60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4005fd0 tx=0x7fd6f400a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:28.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.068+0000 7fd6fe000700 1 -- 172.21.15.159:0/184514001 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd6ec05be40 con 0x7fd700106970 2024-02-28T23:16:28.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.306+0000 7fd706e00700 1 -- 172.21.15.159:0/184514001 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd700199160 con 0x7fd6e806d8a0 2024-02-28T23:16:28.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.307+0000 7fd6fe000700 1 -- 172.21.15.159:0/184514001 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fd700199160 con 0x7fd6e806d8a0 2024-02-28T23:16:28.306 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:16:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:16:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:16:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:16:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:16:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-02-28T23:16:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:16:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:16:28.306 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:16:28.307 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "9/23 daemons upgraded", 2024-02-28T23:16:28.307 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T23:16:28.307 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:16:28.307 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:16:28.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.310+0000 7fd706e00700 1 -- 172.21.15.159:0/184514001 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd6e806d8a0 msgr2=0x7fd6e806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:28.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.310+0000 7fd706e00700 1 --2- 172.21.15.159:0/184514001 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd6e806d8a0 0x7fd6e806fd60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6f4005fd0 tx=0x7fd6f400a560 comp rx=0 tx=0).stop 2024-02-28T23:16:28.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.310+0000 7fd706e00700 1 -- 172.21.15.159:0/184514001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd700106970 msgr2=0x7fd70019ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:28.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.310+0000 7fd706e00700 1 --2- 172.21.15.159:0/184514001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd700106970 0x7fd70019ea30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00b5c0 tx=0x7fd6ec00be00 comp rx=0 tx=0).stop 2024-02-28T23:16:28.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.310+0000 7fd706e00700 1 -- 172.21.15.159:0/184514001 shutdown_connections 2024-02-28T23:16:28.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.310+0000 7fd706e00700 1 --2- 172.21.15.159:0/184514001 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd700100970 0x7fd70019e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.310+0000 7fd706e00700 1 --2- 172.21.15.159:0/184514001 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd6e806d8a0 0x7fd6e806fd60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.310+0000 7fd706e00700 1 --2- 172.21.15.159:0/184514001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd700106970 0x7fd70019ea30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.310+0000 7fd706e00700 1 -- 172.21.15.159:0/184514001 >> 172.21.15.159:0/184514001 conn(0x7fd7000fc440 msgr2=0x7fd700073000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:28.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.310+0000 7fd706e00700 1 -- 172.21.15.159:0/184514001 shutdown_connections 2024-02-28T23:16:28.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.310+0000 7fd706e00700 1 -- 172.21.15.159:0/184514001 wait complete. 2024-02-28T23:16:28.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.463+0000 7f2664e00700 1 -- 172.21.15.159:0/2680649598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2660105b50 msgr2=0x7f2660068410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.463+0000 7f2664e00700 1 --2- 172.21.15.159:0/2680649598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2660105b50 0x7f2660068410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2650009910 tx=0x7f2650009c20 comp rx=0 tx=0).stop 2024-02-28T23:16:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.463+0000 7f2664e00700 1 -- 172.21.15.159:0/2680649598 shutdown_connections 2024-02-28T23:16:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.463+0000 7f2664e00700 1 --2- 172.21.15.159:0/2680649598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2660068950 0x7f2660068dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.463+0000 7f2664e00700 1 --2- 172.21.15.159:0/2680649598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2660105b50 0x7f2660068410 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.463+0000 7f2664e00700 1 -- 172.21.15.159:0/2680649598 >> 172.21.15.159:0/2680649598 conn(0x7f26600755a0 msgr2=0x7f26600759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.463+0000 7f2664e00700 1 -- 172.21.15.159:0/2680649598 shutdown_connections 2024-02-28T23:16:28.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.463+0000 7f2664e00700 1 -- 172.21.15.159:0/2680649598 wait complete. 2024-02-28T23:16:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:28 smithi159 ceph-mon[113833]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:16:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:28 smithi159 ceph-mon[113833]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:16:28.462 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:28 smithi159 ceph-mon[113833]: pgmap v141: 65 pgs: 6 peering, 14 active+undersized, 10 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 27/228 objects degraded (11.842%) 2024-02-28T23:16:28.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:28 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2772550835' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:28.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:28 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1826907167' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:16:28.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.465+0000 7f2664e00700 1 Processor -- start 2024-02-28T23:16:28.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.465+0000 7f2664e00700 1 -- start start 2024-02-28T23:16:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.465+0000 7f2664e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2660068950 0x7f26601a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.465+0000 7f2664e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2660105b50 0x7f26601a2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.465+0000 7f2664e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26601a3680 con 0x7f2660105b50 2024-02-28T23:16:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.465+0000 7f2664e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266019cb30 con 0x7f2660068950 2024-02-28T23:16:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.466+0000 7f265d400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2660105b50 0x7f26601a2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.466+0000 7f265d400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2660105b50 0x7f26601a2ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:42926/0 (socket says 172.21.15.159:42926) 2024-02-28T23:16:28.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.466+0000 7f265d400700 1 -- 172.21.15.159:0/1310613119 learned_addr learned my addr 172.21.15.159:0/1310613119 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:16:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.466+0000 7f265de00700 1 --2- 172.21.15.159:0/1310613119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2660068950 0x7f26601a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.467+0000 7f265d400700 1 -- 172.21.15.159:0/1310613119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2660068950 msgr2=0x7f26601a2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.467+0000 7f265d400700 1 --2- 172.21.15.159:0/1310613119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2660068950 0x7f26601a2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.467+0000 7f265d400700 1 -- 172.21.15.159:0/1310613119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26500095f0 con 0x7f2660105b50 2024-02-28T23:16:28.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.467+0000 7f265d400700 1 --2- 172.21.15.159:0/1310613119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2660105b50 0x7f26601a2ff0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f264c00c8a0 tx=0x7f264c00cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:28.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.467+0000 7f2656a00700 1 -- 172.21.15.159:0/1310613119 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f264c0078e0 con 0x7f2660105b50 2024-02-28T23:16:28.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.467+0000 7f2656a00700 1 -- 172.21.15.159:0/1310613119 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f264c00f450 con 0x7f2660105b50 2024-02-28T23:16:28.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.467+0000 7f2664e00700 1 -- 172.21.15.159:0/1310613119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266019ce10 con 0x7f2660105b50 2024-02-28T23:16:28.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.467+0000 7f2656a00700 1 -- 172.21.15.159:0/1310613119 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f264c00e5e0 con 0x7f2660105b50 2024-02-28T23:16:28.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.468+0000 7f2664e00700 1 -- 172.21.15.159:0/1310613119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266019d3e0 con 0x7f2660105b50 2024-02-28T23:16:28.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.469+0000 7f2664e00700 1 -- 172.21.15.159:0/1310613119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2640005320 con 0x7f2660105b50 2024-02-28T23:16:28.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.470+0000 7f2656a00700 1 -- 172.21.15.159:0/1310613119 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f264c007a40 con 0x7f2660105b50 2024-02-28T23:16:28.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.471+0000 7f2656a00700 1 --2- 172.21.15.159:0/1310613119 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f264406d8a0 0x7f264406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:28.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.471+0000 7f2656a00700 1 -- 172.21.15.159:0/1310613119 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f264c08d330 con 0x7f2660105b50 2024-02-28T23:16:28.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.472+0000 7f265de00700 1 --2- 172.21.15.159:0/1310613119 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f264406d8a0 0x7f264406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:28.470 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.472+0000 7f265de00700 1 --2- 172.21.15.159:0/1310613119 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f264406d8a0 0x7f264406fd60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2650006010 tx=0x7f265001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:28.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.476+0000 7f2656a00700 1 -- 172.21.15.159:0/1310613119 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f264c05a3a0 con 0x7f2660105b50 2024-02-28T23:16:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:28 smithi184 ceph-mon[86482]: from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:16:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:28 smithi184 ceph-mon[86482]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:16:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:28 smithi184 ceph-mon[86482]: pgmap v141: 65 pgs: 6 peering, 14 active+undersized, 10 active+undersized+degraded, 35 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s; 27/228 objects degraded (11.842%) 2024-02-28T23:16:28.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:28 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2772550835' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:28.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:28 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1826907167' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:16:28.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.789+0000 7f2664e00700 1 -- 172.21.15.159:0/1310613119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2640005190 con 0x7f2660105b50 2024-02-28T23:16:28.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.789+0000 7f2656a00700 1 -- 172.21.15.159:0/1310613119 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+739 (secure 0 0 0) 0x7f264c05a1c0 con 0x7f2660105b50 2024-02-28T23:16:28.788 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_WARN Degraded data redundancy: 27/228 objects degraded (11.842%), 10 pgs degraded 2024-02-28T23:16:28.788 INFO:teuthology.orchestra.run.smithi159.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 27/228 objects degraded (11.842%), 10 pgs degraded 2024-02-28T23:16:28.788 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-02-28T23:16:28.788 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-02-28T23:16:28.788 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-02-28T23:16:28.789 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-02-28T23:16:28.789 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-02-28T23:16:28.789 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-02-28T23:16:28.789 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-02-28T23:16:28.789 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-02-28T23:16:28.789 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-02-28T23:16:28.789 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-02-28T23:16:28.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.793+0000 7f2664e00700 1 -- 172.21.15.159:0/1310613119 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f264406d8a0 msgr2=0x7f264406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:28.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.793+0000 7f2664e00700 1 --2- 172.21.15.159:0/1310613119 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f264406d8a0 0x7f264406fd60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2650006010 tx=0x7f265001a040 comp rx=0 tx=0).stop 2024-02-28T23:16:28.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.793+0000 7f2664e00700 1 -- 172.21.15.159:0/1310613119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2660105b50 msgr2=0x7f26601a2ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:28.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.793+0000 7f2664e00700 1 --2- 172.21.15.159:0/1310613119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2660105b50 0x7f26601a2ff0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f264c00c8a0 tx=0x7f264c00cbb0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.794+0000 7f2664e00700 1 -- 172.21.15.159:0/1310613119 shutdown_connections 2024-02-28T23:16:28.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.794+0000 7f2664e00700 1 --2- 172.21.15.159:0/1310613119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2660068950 0x7f26601a2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.794+0000 7f2664e00700 1 --2- 172.21.15.159:0/1310613119 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f264406d8a0 0x7f264406fd60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.794+0000 7f2664e00700 1 --2- 172.21.15.159:0/1310613119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2660105b50 0x7f26601a2ff0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:28.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.794+0000 7f2664e00700 1 -- 172.21.15.159:0/1310613119 >> 172.21.15.159:0/1310613119 conn(0x7f26600755a0 msgr2=0x7f26601014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:28.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.794+0000 7f2664e00700 1 -- 172.21.15.159:0/1310613119 shutdown_connections 2024-02-28T23:16:28.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:28.794+0000 7f2664e00700 1 -- 172.21.15.159:0/1310613119 wait complete. 2024-02-28T23:16:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:29 smithi159 ceph-mon[113833]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:16:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:29 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 27/228 objects degraded (11.842%), 10 pgs degraded (PG_DEGRADED) 2024-02-28T23:16:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:29 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1310613119' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:16:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:29.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:29.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:29 smithi184 ceph-mon[86482]: from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:16:29.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:29 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 27/228 objects degraded (11.842%), 10 pgs degraded (PG_DEGRADED) 2024-02-28T23:16:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:29 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1310613119' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:16:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:30.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:30 smithi159 ceph-mon[113833]: pgmap v143: 65 pgs: 6 peering, 8 active+undersized, 7 active+undersized+degraded, 44 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s; 20/228 objects degraded (8.772%) 2024-02-28T23:16:30.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:30 smithi184 ceph-mon[86482]: pgmap v143: 65 pgs: 6 peering, 8 active+undersized, 7 active+undersized+degraded, 44 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s; 20/228 objects degraded (8.772%) 2024-02-28T23:16:31.393 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:31 smithi159 ceph-mon[113833]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/228 objects degraded (8.772%), 7 pgs degraded) 2024-02-28T23:16:31.393 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:31 smithi159 ceph-mon[113833]: Cluster is now healthy 2024-02-28T23:16:31.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:31 smithi184 ceph-mon[86482]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 20/228 objects degraded (8.772%), 7 pgs degraded) 2024-02-28T23:16:31.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:31 smithi184 ceph-mon[86482]: Cluster is now healthy 2024-02-28T23:16:32.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:32 smithi184 ceph-mon[86482]: pgmap v144: 65 pgs: 6 peering, 59 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2024-02-28T23:16:32.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:32 smithi159 ceph-mon[113833]: pgmap v144: 65 pgs: 6 peering, 59 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 682 B/s rd, 1 op/s 2024-02-28T23:16:34.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:34 smithi184 ceph-mon[86482]: pgmap v145: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 513 B/s rd, 1 op/s 2024-02-28T23:16:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:34 smithi159 ceph-mon[113833]: pgmap v145: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 513 B/s rd, 1 op/s 2024-02-28T23:16:35.698 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:35.698 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:35.698 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:16:35.698 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:16:35.698 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:35.698 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:16:35.699 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:35.699 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:35.699 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:35.699 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T23:16:35.699 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T23:16:35.699 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: Upgrade: osd.3 is safe to restart 2024-02-28T23:16:35.699 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:35 smithi184 ceph-mon[86482]: pgmap v146: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-28T23:16:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:35.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:16:35.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:16:35.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:35.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:16:35.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:35.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:35.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:16:35.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T23:16:35.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-28T23:16:35.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: Upgrade: osd.3 is safe to restart 2024-02-28T23:16:35.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:35 smithi159 ceph-mon[113833]: pgmap v146: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-28T23:16:38.261 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:38 smithi184 ceph-mon[86482]: Upgrade: Updating osd.3 2024-02-28T23:16:38.261 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:38.261 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T23:16:38.261 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:16:38.261 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:38 smithi184 ceph-mon[86482]: Deploying daemon osd.3 on smithi184 2024-02-28T23:16:38.261 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:38 smithi184 ceph-mon[86482]: pgmap v147: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-02-28T23:16:38.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:37 smithi159 ceph-mon[113833]: Upgrade: Updating osd.3 2024-02-28T23:16:38.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:37 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:38.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:37 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-28T23:16:38.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:16:38.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:38 smithi159 ceph-mon[113833]: Deploying daemon osd.3 on smithi184 2024-02-28T23:16:38.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:38 smithi159 ceph-mon[113833]: pgmap v147: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 921 B/s rd, 1 op/s 2024-02-28T23:16:39.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:39 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:39.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:39 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:16:39.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:39 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:39 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:39 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:16:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:39 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:40.565 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:40 smithi184 ceph-mon[86482]: pgmap v148: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:16:40.589 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:40 smithi159 ceph-mon[113833]: pgmap v148: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:16:42.082 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:41 smithi184 systemd[1]: Stopping Ceph osd.3 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:16:42.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:42 smithi184 ceph-mon[86482]: pgmap v149: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:16:42.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:42 smithi184 ceph-mon[86482]: osd.3 marked itself down and dead 2024-02-28T23:16:42.351 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:42 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[42257]: 2024-02-28T23:16:42.081+0000 7f8b18800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:16:42.351 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:42 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[42257]: 2024-02-28T23:16:42.081+0000 7f8b18800700 -1 osd.3 81 *** Got signal Terminated *** 2024-02-28T23:16:42.351 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:42 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[42257]: 2024-02-28T23:16:42.081+0000 7f8b18800700 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:16:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:42 smithi159 ceph-mon[113833]: pgmap v149: 65 pgs: 65 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:16:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:42 smithi159 ceph-mon[113833]: osd.3 marked itself down and dead 2024-02-28T23:16:43.007 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:42 smithi184 podman[95595]: 2024-02-28 23:16:42.698639267 +0000 UTC m=+0.750230090 container died 195b5ccea550b85f2132787dfabef167185f1289eae1dc42d9bf96c7ee25b643 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=HEAD, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, GIT_CLEAN=True) 2024-02-28T23:16:43.283 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:43 smithi184 podman[95595]: 2024-02-28 23:16:43.124053283 +0000 UTC m=+1.175644130 container cleanup 195b5ccea550b85f2132787dfabef167185f1289eae1dc42d9bf96c7ee25b643 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.29.1, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD) 2024-02-28T23:16:43.284 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:43 smithi184 bash[95595]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3 2024-02-28T23:16:43.600 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:43 smithi184 podman[95614]: 2024-02-28 23:16:43.400621484 +0000 UTC m=+0.691730212 container remove 195b5ccea550b85f2132787dfabef167185f1289eae1dc42d9bf96c7ee25b643 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.29.1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-18.2.1) 2024-02-28T23:16:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:43 smithi184 ceph-mon[86482]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:16:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:43 smithi184 ceph-mon[86482]: osdmap e82: 6 total, 5 up, 6 in 2024-02-28T23:16:43.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:43 smithi184 ceph-mon[86482]: osdmap e83: 6 total, 5 up, 6 in 2024-02-28T23:16:43.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:43 smithi159 ceph-mon[113833]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:16:43.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:43 smithi159 ceph-mon[113833]: osdmap e82: 6 total, 5 up, 6 in 2024-02-28T23:16:43.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:43 smithi159 ceph-mon[113833]: osdmap e83: 6 total, 5 up, 6 in 2024-02-28T23:16:44.356 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:44 smithi184 ceph-mon[86482]: pgmap v151: 65 pgs: 14 stale+active+clean, 51 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-02-28T23:16:44.356 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:44 smithi184 podman[95702]: 2024-02-28 23:16:44.093888104 +0000 UTC m=+0.035138089 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:16:44.356 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:44 smithi184 podman[95702]: 2024-02-28 23:16:44.201444576 +0000 UTC m=+0.142694593 container create e68e973309063e9cc9456b2c112583aa907d757a3e1369fce219d86dce25916f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-28T23:16:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:44 smithi159 ceph-mon[113833]: pgmap v151: 65 pgs: 14 stale+active+clean, 51 active+clean; 209 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-02-28T23:16:44.850 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:44 smithi184 podman[95702]: 2024-02-28 23:16:44.480706681 +0000 UTC m=+0.421956741 container init e68e973309063e9cc9456b2c112583aa907d757a3e1369fce219d86dce25916f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-deactivate, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_CLEAN=True) 2024-02-28T23:16:44.851 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:44 smithi184 podman[95702]: 2024-02-28 23:16:44.493289153 +0000 UTC m=+0.434539140 container start e68e973309063e9cc9456b2c112583aa907d757a3e1369fce219d86dce25916f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-02-28T23:16:44.851 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:44 smithi184 podman[95702]: 2024-02-28 23:16:44.578858405 +0000 UTC m=+0.520108462 container attach e68e973309063e9cc9456b2c112583aa907d757a3e1369fce219d86dce25916f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-02-28T23:16:45.271 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:44 smithi184 podman[95702]: 2024-02-28 23:16:44.925176058 +0000 UTC m=+0.866426081 container died e68e973309063e9cc9456b2c112583aa907d757a3e1369fce219d86dce25916f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-02-28T23:16:45.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:45 smithi184 ceph-mon[86482]: Health check failed: Degraded data redundancy: 40/228 objects degraded (17.544%), 11 pgs degraded (PG_DEGRADED) 2024-02-28T23:16:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:45 smithi159 ceph-mon[113833]: Health check failed: Degraded data redundancy: 40/228 objects degraded (17.544%), 11 pgs degraded (PG_DEGRADED) 2024-02-28T23:16:46.073 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:45 smithi184 podman[95728]: 2024-02-28 23:16:45.632752326 +0000 UTC m=+0.688567540 container remove e68e973309063e9cc9456b2c112583aa907d757a3e1369fce219d86dce25916f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:16:46.073 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:45 smithi184 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.3.service: Deactivated successfully. 2024-02-28T23:16:46.074 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:45 smithi184 systemd[1]: Stopped Ceph osd.3 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:16:46.074 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:45 smithi184 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.3.service: Consumed 2min 32.726s CPU time. 2024-02-28T23:16:46.340 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:46 smithi184 systemd[1]: Starting Ceph osd.3 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:16:46.592 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:46 smithi184 ceph-mon[86482]: pgmap v153: 65 pgs: 13 active+undersized, 11 active+undersized+degraded, 3 stale+active+clean, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T23:16:46.592 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:46 smithi184 podman[95830]: 2024-02-28 23:16:46.339648641 +0000 UTC m=+0.032388471 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:16:46.593 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:46 smithi184 podman[95830]: 2024-02-28 23:16:46.45082394 +0000 UTC m=+0.143563800 container create d97dc209257d6bca37bc49f7611e4b25d7a5a32931c96d65f2b500df402e1915 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:16:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:46 smithi159 ceph-mon[113833]: pgmap v153: 65 pgs: 13 active+undersized, 11 active+undersized+degraded, 3 stale+active+clean, 38 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 40/228 objects degraded (17.544%) 2024-02-28T23:16:46.850 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:46 smithi184 podman[95830]: 2024-02-28 23:16:46.704242348 +0000 UTC m=+0.396982252 container init d97dc209257d6bca37bc49f7611e4b25d7a5a32931c96d65f2b500df402e1915 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-02-28T23:16:46.851 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:46 smithi184 podman[95830]: 2024-02-28 23:16:46.721442818 +0000 UTC m=+0.414182684 container start d97dc209257d6bca37bc49f7611e4b25d7a5a32931c96d65f2b500df402e1915 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=main-1fb5d10, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:16:46.851 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:46 smithi184 podman[95830]: 2024-02-28 23:16:46.836646563 +0000 UTC m=+0.529386509 container attach d97dc209257d6bca37bc49f7611e4b25d7a5a32931c96d65f2b500df402e1915 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:16:47.851 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate[95844]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T23:16:47.851 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate[95844]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T23:16:47.851 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 bash[95830]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T23:16:47.851 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 bash[95830]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-02-28T23:16:47.851 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 bash[95830]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T23:16:47.851 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 bash[95830]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T23:16:47.852 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 bash[95830]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-28T23:16:47.852 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 bash[95830]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T23:16:47.852 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 bash[95830]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-28T23:16:47.852 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate[95844]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-02-28T23:16:47.852 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate[95844]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-28T23:16:47.852 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate[95844]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-02-28T23:16:47.852 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate[95844]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-28T23:16:47.852 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate[95844]: --> ceph-volume raw activate successful for osd ID: 3 2024-02-28T23:16:47.852 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:47 smithi184 podman[95830]: 2024-02-28 23:16:47.648688111 +0000 UTC m=+1.341428011 container died d97dc209257d6bca37bc49f7611e4b25d7a5a32931c96d65f2b500df402e1915 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:16:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:48 smithi184 ceph-mon[86482]: pgmap v154: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 49/228 objects degraded (21.491%) 2024-02-28T23:16:48.600 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:48 smithi184 podman[95975]: 2024-02-28 23:16:48.398964542 +0000 UTC m=+0.730106720 container remove d97dc209257d6bca37bc49f7611e4b25d7a5a32931c96d65f2b500df402e1915 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-activate, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222) 2024-02-28T23:16:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:48 smithi159 ceph-mon[113833]: pgmap v154: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 49/228 objects degraded (21.491%) 2024-02-28T23:16:48.954 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:48 smithi184 podman[96036]: 2024-02-28 23:16:48.656348908 +0000 UTC m=+0.031640200 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:16:48.954 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:48 smithi184 podman[96036]: 2024-02-28 23:16:48.783056949 +0000 UTC m=+0.158348278 container create 643ebdb823be81e7270f147c1af59cb7cb4a9056406d761ed0588ef55c827fa8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:16:49.351 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:49 smithi184 podman[96036]: 2024-02-28 23:16:49.046004715 +0000 UTC m=+0.421296068 container init 643ebdb823be81e7270f147c1af59cb7cb4a9056406d761ed0588ef55c827fa8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux ) 2024-02-28T23:16:49.351 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:49 smithi184 podman[96036]: 2024-02-28 23:16:49.057149463 +0000 UTC m=+0.432440799 container start 643ebdb823be81e7270f147c1af59cb7cb4a9056406d761ed0588ef55c827fa8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-02-28T23:16:49.351 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:49 smithi184 ceph-osd[96054]: -- 172.21.15.184:0/4113334524 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55da8490d680 con 0x55da848d7000 2024-02-28T23:16:49.351 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:49 smithi184 bash[96036]: 643ebdb823be81e7270f147c1af59cb7cb4a9056406d761ed0588ef55c827fa8 2024-02-28T23:16:49.351 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:49 smithi184 systemd[1]: Started Ceph osd.3 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:16:50.100 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:49 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[96050]: 2024-02-28T23:16:49.624+0000 7f6183ff57c0 -1 Falling back to public interface 2024-02-28T23:16:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:50 smithi184 ceph-mon[86482]: pgmap v155: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 49/228 objects degraded (21.491%) 2024-02-28T23:16:50.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:50.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:50.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:16:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:50 smithi159 ceph-mon[113833]: pgmap v155: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 49/228 objects degraded (21.491%) 2024-02-28T23:16:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:50.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:50.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:16:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:52 smithi184 ceph-mon[86482]: pgmap v156: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 49/228 objects degraded (21.491%) 2024-02-28T23:16:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:52 smithi159 ceph-mon[113833]: pgmap v156: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 49/228 objects degraded (21.491%) 2024-02-28T23:16:54.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:54 smithi159 ceph-mon[113833]: pgmap v157: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 49/228 objects degraded (21.491%) 2024-02-28T23:16:54.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:54.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:16:54.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:54.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:54.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:54 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 49/228 objects degraded (21.491%), 15 pgs degraded (PG_DEGRADED) 2024-02-28T23:16:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:54 smithi184 ceph-mon[86482]: pgmap v157: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 49/228 objects degraded (21.491%) 2024-02-28T23:16:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:16:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:54.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:54.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:54 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 49/228 objects degraded (21.491%), 15 pgs degraded (PG_DEGRADED) 2024-02-28T23:16:55.850 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:55 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[96050]: 2024-02-28T23:16:55.368+0000 7f6183ff57c0 -1 osd.3 0 read_superblock omap replica is missing. 2024-02-28T23:16:56.350 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:56 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[96050]: 2024-02-28T23:16:56.017+0000 7f6183ff57c0 -1 osd.3 81 log_to_monitors true 2024-02-28T23:16:56.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:56 smithi184 ceph-mon[86482]: pgmap v158: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 49/228 objects degraded (21.491%) 2024-02-28T23:16:56.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:56 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:56.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:56 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:56.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:56 smithi184 ceph-mon[86482]: from='osd.3 [v2:172.21.15.184:6800/29498664,v1:172.21.15.184:6801/29498664]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T23:16:56.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:56 smithi184 ceph-mon[86482]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T23:16:56.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:56 smithi159 ceph-mon[113833]: pgmap v158: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 49/228 objects degraded (21.491%) 2024-02-28T23:16:56.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:56 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:56.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:56 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:16:56.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:56 smithi159 ceph-mon[113833]: from='osd.3 [v2:172.21.15.184:6800/29498664,v1:172.21.15.184:6801/29498664]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T23:16:56.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:56 smithi159 ceph-mon[113833]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-28T23:16:56.798 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:16:56 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[96050]: 2024-02-28T23:16:56.652+0000 7f6173400700 -1 osd.3 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T23:16:57.832 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:57 smithi184 ceph-mon[86482]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T23:16:57.832 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:57 smithi184 ceph-mon[86482]: osdmap e84: 6 total, 5 up, 6 in 2024-02-28T23:16:57.832 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:57 smithi184 ceph-mon[86482]: from='osd.3 [v2:172.21.15.184:6800/29498664,v1:172.21.15.184:6801/29498664]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:16:57.832 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:57 smithi184 ceph-mon[86482]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:16:57.832 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:57 smithi184 ceph-mon[86482]: pgmap v160: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 49/228 objects degraded (21.491%) 2024-02-28T23:16:57.883 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:57 smithi159 ceph-mon[113833]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-28T23:16:57.884 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:57 smithi159 ceph-mon[113833]: osdmap e84: 6 total, 5 up, 6 in 2024-02-28T23:16:57.884 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:57 smithi159 ceph-mon[113833]: from='osd.3 [v2:172.21.15.184:6800/29498664,v1:172.21.15.184:6801/29498664]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:16:57.884 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:57 smithi159 ceph-mon[113833]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:16:57.884 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:57 smithi159 ceph-mon[113833]: pgmap v160: 65 pgs: 18 active+undersized, 15 active+undersized+degraded, 32 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 49/228 objects degraded (21.491%) 2024-02-28T23:16:58.908 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:58 smithi184 ceph-mon[86482]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:16:58.909 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:58 smithi184 ceph-mon[86482]: osd.3 [v2:172.21.15.184:6800/29498664,v1:172.21.15.184:6801/29498664] boot 2024-02-28T23:16:58.909 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:58 smithi184 ceph-mon[86482]: osdmap e85: 6 total, 6 up, 6 in 2024-02-28T23:16:58.909 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:58 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:16:58.962 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:58 smithi159 ceph-mon[113833]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:16:58.963 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:58 smithi159 ceph-mon[113833]: osd.3 [v2:172.21.15.184:6800/29498664,v1:172.21.15.184:6801/29498664] boot 2024-02-28T23:16:58.963 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:58 smithi159 ceph-mon[113833]: osdmap e85: 6 total, 6 up, 6 in 2024-02-28T23:16:58.963 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:58 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-28T23:16:58.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.962+0000 7f3f0e000700 1 -- 172.21.15.159:0/3316357609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08107220 msgr2=0x7f3f08107600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:58.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.962+0000 7f3f0e000700 1 --2- 172.21.15.159:0/3316357609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08107220 0x7f3f08107600 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3efc009910 tx=0x7f3efc009c20 comp rx=0 tx=0).stop 2024-02-28T23:16:58.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.962+0000 7f3f0e000700 1 -- 172.21.15.159:0/3316357609 shutdown_connections 2024-02-28T23:16:58.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.962+0000 7f3f0e000700 1 --2- 172.21.15.159:0/3316357609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08107bd0 0x7f3f0810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:58.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.962+0000 7f3f0e000700 1 --2- 172.21.15.159:0/3316357609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08107220 0x7f3f08107600 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:58.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.962+0000 7f3f0e000700 1 -- 172.21.15.159:0/3316357609 >> 172.21.15.159:0/3316357609 conn(0x7f3f080767e0 msgr2=0x7f3f08078c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:58.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.962+0000 7f3f0e000700 1 -- 172.21.15.159:0/3316357609 shutdown_connections 2024-02-28T23:16:58.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.963+0000 7f3f0e000700 1 -- 172.21.15.159:0/3316357609 wait complete. 2024-02-28T23:16:58.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.964+0000 7f3f0e000700 1 Processor -- start 2024-02-28T23:16:58.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.964+0000 7f3f0e000700 1 -- start start 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.964+0000 7f3f0e000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08107220 0x7f3f081a2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.964+0000 7f3f0e000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08107bd0 0x7f3f081a2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.964+0000 7f3f0e000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f081a35f0 con 0x7f3f08107220 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.964+0000 7f3f0e000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0819caa0 con 0x7f3f08107bd0 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.965+0000 7f3f0cc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08107220 0x7f3f081a2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.965+0000 7f3f0cc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08107220 0x7f3f081a2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40130/0 (socket says 172.21.15.159:40130) 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.965+0000 7f3f0cc00700 1 -- 172.21.15.159:0/2852535167 learned_addr learned my addr 172.21.15.159:0/2852535167 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.965+0000 7f3f07e00700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08107bd0 0x7f3f081a2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.965+0000 7f3f0cc00700 1 -- 172.21.15.159:0/2852535167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08107bd0 msgr2=0x7f3f081a2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.965+0000 7f3f0cc00700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08107bd0 0x7f3f081a2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.965+0000 7f3f0cc00700 1 -- 172.21.15.159:0/2852535167 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc0095f0 con 0x7f3f08107220 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.965+0000 7f3f07e00700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08107bd0 0x7f3f081a2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.965+0000 7f3f0cc00700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08107220 0x7f3f081a2a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00b5c0 tx=0x7f3efc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:58.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.966+0000 7f3f05600700 1 -- 172.21.15.159:0/2852535167 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3efc01d070 con 0x7f3f08107220 2024-02-28T23:16:58.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.966+0000 7f3f05600700 1 -- 172.21.15.159:0/2852535167 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3efc005e00 con 0x7f3f08107220 2024-02-28T23:16:58.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.966+0000 7f3f0e000700 1 -- 172.21.15.159:0/2852535167 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0819cd20 con 0x7f3f08107220 2024-02-28T23:16:58.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.966+0000 7f3f05600700 1 -- 172.21.15.159:0/2852535167 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3efc017400 con 0x7f3f08107220 2024-02-28T23:16:58.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.966+0000 7f3f0e000700 1 -- 172.21.15.159:0/2852535167 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0819d210 con 0x7f3f08107220 2024-02-28T23:16:58.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.967+0000 7f3f0e000700 1 -- 172.21.15.159:0/2852535167 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0810f5b0 con 0x7f3f08107220 2024-02-28T23:16:58.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.969+0000 7f3f05600700 1 -- 172.21.15.159:0/2852535167 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f3efc00f460 con 0x7f3f08107220 2024-02-28T23:16:58.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.969+0000 7f3f05600700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 0x7f3ef006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:58.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.970+0000 7f3f05600700 1 -- 172.21.15.159:0/2852535167 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f3efc08ea80 con 0x7f3f08107220 2024-02-28T23:16:58.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.970+0000 7f3f07e00700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 0x7f3ef006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:58.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.970+0000 7f3f07e00700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 0x7f3ef006fd60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4005fd0 tx=0x7f3ef4005ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:58.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:58.975+0000 7f3f05600700 1 -- 172.21.15.159:0/2852535167 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3efc05bce0 con 0x7f3f08107220 2024-02-28T23:16:59.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.215+0000 7f3f0e000700 1 -- 172.21.15.159:0/2852535167 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f0802cce0 con 0x7f3ef006d8a0 2024-02-28T23:16:59.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.218+0000 7f3f05600700 1 -- 172.21.15.159:0/2852535167 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f3f0802cce0 con 0x7f3ef006d8a0 2024-02-28T23:16:59.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.221+0000 7f3f0e000700 1 -- 172.21.15.159:0/2852535167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 msgr2=0x7f3ef006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:59.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.221+0000 7f3f0e000700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 0x7f3ef006fd60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4005fd0 tx=0x7f3ef4005ee0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.221+0000 7f3f0e000700 1 -- 172.21.15.159:0/2852535167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08107220 msgr2=0x7f3f081a2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:59.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.221+0000 7f3f0e000700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08107220 0x7f3f081a2a20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00b5c0 tx=0x7f3efc00be20 comp rx=0 tx=0).stop 2024-02-28T23:16:59.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.221+0000 7f3f0e000700 1 -- 172.21.15.159:0/2852535167 shutdown_connections 2024-02-28T23:16:59.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.221+0000 7f3f0e000700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f3ef006d8a0 0x7f3ef006fd60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.221+0000 7f3f0e000700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3f08107220 0x7f3f081a2a20 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.221+0000 7f3f0e000700 1 --2- 172.21.15.159:0/2852535167 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3f08107bd0 0x7f3f081a2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.221+0000 7f3f0e000700 1 -- 172.21.15.159:0/2852535167 >> 172.21.15.159:0/2852535167 conn(0x7f3f080767e0 msgr2=0x7f3f08077e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:59.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.222+0000 7f3f0e000700 1 -- 172.21.15.159:0/2852535167 shutdown_connections 2024-02-28T23:16:59.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.222+0000 7f3f0e000700 1 -- 172.21.15.159:0/2852535167 wait complete. 2024-02-28T23:16:59.236 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:16:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.369+0000 7f560d400700 1 -- 172.21.15.159:0/336402038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5608069020 msgr2=0x7f5608105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.369+0000 7f560d400700 1 --2- 172.21.15.159:0/336402038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5608069020 0x7f5608105790 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009910 tx=0x7f55f4009c20 comp rx=0 tx=0).stop 2024-02-28T23:16:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.369+0000 7f560d400700 1 -- 172.21.15.159:0/336402038 shutdown_connections 2024-02-28T23:16:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.369+0000 7f560d400700 1 --2- 172.21.15.159:0/336402038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5608069020 0x7f5608105790 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.369+0000 7f560d400700 1 --2- 172.21.15.159:0/336402038 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5608068670 0x7f5608068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.369+0000 7f560d400700 1 -- 172.21.15.159:0/336402038 >> 172.21.15.159:0/336402038 conn(0x7f56080755a0 msgr2=0x7f56080759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:59.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.369+0000 7f560d400700 1 -- 172.21.15.159:0/336402038 shutdown_connections 2024-02-28T23:16:59.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.369+0000 7f560d400700 1 -- 172.21.15.159:0/336402038 wait complete. 2024-02-28T23:16:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.370+0000 7f560d400700 1 Processor -- start 2024-02-28T23:16:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.371+0000 7f560d400700 1 -- start start 2024-02-28T23:16:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.371+0000 7f560d400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5608068670 0x7f560819e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.371+0000 7f560d400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5608069020 0x7f560819ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.371+0000 7f560d400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560819f3b0 con 0x7f5608068670 2024-02-28T23:16:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.371+0000 7f560d400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5608198860 con 0x7f5608069020 2024-02-28T23:16:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.371+0000 7f5606800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5608068670 0x7f560819e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.371+0000 7f5606800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5608068670 0x7f560819e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40154/0 (socket says 172.21.15.159:40154) 2024-02-28T23:16:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.371+0000 7f5606800700 1 -- 172.21.15.159:0/1046225319 learned_addr learned my addr 172.21.15.159:0/1046225319 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:16:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.371+0000 7f5605e00700 1 --2- 172.21.15.159:0/1046225319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5608069020 0x7f560819ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:59.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.372+0000 7f5606800700 1 -- 172.21.15.159:0/1046225319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5608069020 msgr2=0x7f560819ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:59.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.372+0000 7f5606800700 1 --2- 172.21.15.159:0/1046225319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5608069020 0x7f560819ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.372+0000 7f5606800700 1 -- 172.21.15.159:0/1046225319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f40095f0 con 0x7f5608068670 2024-02-28T23:16:59.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.372+0000 7f5606800700 1 --2- 172.21.15.159:0/1046225319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5608068670 0x7f560819e7e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f55f800e920 tx=0x7f55f800ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:59.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.372+0000 7f55ff400700 1 -- 172.21.15.159:0/1046225319 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f800c9d0 con 0x7f5608068670 2024-02-28T23:16:59.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.372+0000 7f55ff400700 1 -- 172.21.15.159:0/1046225319 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f55f8010430 con 0x7f5608068670 2024-02-28T23:16:59.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.372+0000 7f55ff400700 1 -- 172.21.15.159:0/1046225319 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55f8018630 con 0x7f5608068670 2024-02-28T23:16:59.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.372+0000 7f560d400700 1 -- 172.21.15.159:0/1046225319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5608198b40 con 0x7f5608068670 2024-02-28T23:16:59.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.373+0000 7f560d400700 1 -- 172.21.15.159:0/1046225319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5608199060 con 0x7f5608068670 2024-02-28T23:16:59.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.374+0000 7f560d400700 1 -- 172.21.15.159:0/1046225319 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560804ea90 con 0x7f5608068670 2024-02-28T23:16:59.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.375+0000 7f55ff400700 1 -- 172.21.15.159:0/1046225319 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f55f80105a0 con 0x7f5608068670 2024-02-28T23:16:59.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.376+0000 7f55ff400700 1 --2- 172.21.15.159:0/1046225319 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f55ec06d8a0 0x7f55ec06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:59.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.376+0000 7f55ff400700 1 -- 172.21.15.159:0/1046225319 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f55f8014070 con 0x7f5608068670 2024-02-28T23:16:59.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.377+0000 7f5605e00700 1 --2- 172.21.15.159:0/1046225319 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f55ec06d8a0 0x7f55ec06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:59.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.378+0000 7f5605e00700 1 --2- 172.21.15.159:0/1046225319 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f55ec06d8a0 0x7f55ec06fd60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55f4005b40 tx=0x7f55f4005a90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:59.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.382+0000 7f55ff400700 1 -- 172.21.15.159:0/1046225319 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f55f8052d20 con 0x7f5608068670 2024-02-28T23:16:59.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.604+0000 7f560d400700 1 -- 172.21.15.159:0/1046225319 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56081993c0 con 0x7f55ec06d8a0 2024-02-28T23:16:59.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.607+0000 7f55ff400700 1 -- 172.21.15.159:0/1046225319 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f56081993c0 con 0x7f55ec06d8a0 2024-02-28T23:16:59.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.610+0000 7f560d400700 1 -- 172.21.15.159:0/1046225319 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f55ec06d8a0 msgr2=0x7f55ec06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:59.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.610+0000 7f560d400700 1 --2- 172.21.15.159:0/1046225319 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f55ec06d8a0 0x7f55ec06fd60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f55f4005b40 tx=0x7f55f4005a90 comp rx=0 tx=0).stop 2024-02-28T23:16:59.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.610+0000 7f560d400700 1 -- 172.21.15.159:0/1046225319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5608068670 msgr2=0x7f560819e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:59.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.610+0000 7f560d400700 1 --2- 172.21.15.159:0/1046225319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5608068670 0x7f560819e7e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f55f800e920 tx=0x7f55f800ec30 comp rx=0 tx=0).stop 2024-02-28T23:16:59.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.610+0000 7f560d400700 1 -- 172.21.15.159:0/1046225319 shutdown_connections 2024-02-28T23:16:59.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.610+0000 7f560d400700 1 --2- 172.21.15.159:0/1046225319 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f55ec06d8a0 0x7f55ec06fd60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.610+0000 7f560d400700 1 --2- 172.21.15.159:0/1046225319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5608068670 0x7f560819e7e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.610+0000 7f560d400700 1 --2- 172.21.15.159:0/1046225319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5608069020 0x7f560819ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.610+0000 7f560d400700 1 -- 172.21.15.159:0/1046225319 >> 172.21.15.159:0/1046225319 conn(0x7f56080755a0 msgr2=0x7f5608102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:59.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.610+0000 7f560d400700 1 -- 172.21.15.159:0/1046225319 shutdown_connections 2024-02-28T23:16:59.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.610+0000 7f560d400700 1 -- 172.21.15.159:0/1046225319 wait complete. 2024-02-28T23:16:59.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.763+0000 7f0de7a00700 1 -- 172.21.15.159:0/179356954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de01071d0 msgr2=0x7f0de0107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:59.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.763+0000 7f0de7a00700 1 --2- 172.21.15.159:0/179356954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de01071d0 0x7f0de0107650 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc009910 tx=0x7f0dcc009c20 comp rx=0 tx=0).stop 2024-02-28T23:16:59.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.763+0000 7f0de7a00700 1 -- 172.21.15.159:0/179356954 shutdown_connections 2024-02-28T23:16:59.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.763+0000 7f0de7a00700 1 --2- 172.21.15.159:0/179356954 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de01071d0 0x7f0de0107650 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.763+0000 7f0de7a00700 1 --2- 172.21.15.159:0/179356954 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0de010d280 0x7f0de010d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.763+0000 7f0de7a00700 1 -- 172.21.15.159:0/179356954 >> 172.21.15.159:0/179356954 conn(0x7f0de00769e0 msgr2=0x7f0de0078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:16:59.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.763+0000 7f0de7a00700 1 -- 172.21.15.159:0/179356954 shutdown_connections 2024-02-28T23:16:59.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.763+0000 7f0de7a00700 1 -- 172.21.15.159:0/179356954 wait complete. 2024-02-28T23:16:59.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.764+0000 7f0de7a00700 1 Processor -- start 2024-02-28T23:16:59.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.764+0000 7f0de7a00700 1 -- start start 2024-02-28T23:16:59.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.765+0000 7f0de7a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de01071d0 0x7f0de019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:59.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.765+0000 7f0de7a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0de010d280 0x7f0de019d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:59.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.765+0000 7f0de7a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de019d880 con 0x7f0de01071d0 2024-02-28T23:16:59.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.765+0000 7f0de7a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0de01a05b0 con 0x7f0de010d280 2024-02-28T23:16:59.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.765+0000 7f0de5000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de01071d0 0x7f0de019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:59.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.765+0000 7f0de5000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de01071d0 0x7f0de019ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40164/0 (socket says 172.21.15.159:40164) 2024-02-28T23:16:59.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.765+0000 7f0de5000700 1 -- 172.21.15.159:0/2656572872 learned_addr learned my addr 172.21.15.159:0/2656572872 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:16:59.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.766+0000 7f0ddfe00700 1 --2- 172.21.15.159:0/2656572872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0de010d280 0x7f0de019d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:59.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.766+0000 7f0de5000700 1 -- 172.21.15.159:0/2656572872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0de010d280 msgr2=0x7f0de019d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:16:59.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.766+0000 7f0de5000700 1 --2- 172.21.15.159:0/2656572872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0de010d280 0x7f0de019d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:16:59.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.766+0000 7f0de5000700 1 -- 172.21.15.159:0/2656572872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dcc0095f0 con 0x7f0de01071d0 2024-02-28T23:16:59.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.766+0000 7f0de5000700 1 --2- 172.21.15.159:0/2656572872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de01071d0 0x7f0de019ccb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400e920 tx=0x7f0dd400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:59.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.766+0000 7f0ddd600700 1 -- 172.21.15.159:0/2656572872 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd4009790 con 0x7f0de01071d0 2024-02-28T23:16:59.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.766+0000 7f0ddd600700 1 -- 172.21.15.159:0/2656572872 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0dd400cba0 con 0x7f0de01071d0 2024-02-28T23:16:59.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.766+0000 7f0de7a00700 1 -- 172.21.15.159:0/2656572872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0de01a0890 con 0x7f0de01071d0 2024-02-28T23:16:59.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.766+0000 7f0ddd600700 1 -- 172.21.15.159:0/2656572872 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0dd4018650 con 0x7f0de01071d0 2024-02-28T23:16:59.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.766+0000 7f0de7a00700 1 -- 172.21.15.159:0/2656572872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0de01a0e60 con 0x7f0de01071d0 2024-02-28T23:16:59.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.768+0000 7f0de7a00700 1 -- 172.21.15.159:0/2656572872 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0de010f6c0 con 0x7f0de01071d0 2024-02-28T23:16:59.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.769+0000 7f0ddd600700 1 -- 172.21.15.159:0/2656572872 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f0dd400cd10 con 0x7f0de01071d0 2024-02-28T23:16:59.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.770+0000 7f0ddd600700 1 --2- 172.21.15.159:0/2656572872 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0dc806d8a0 0x7f0dc806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:16:59.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.770+0000 7f0ddd600700 1 -- 172.21.15.159:0/2656572872 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f0dd4014070 con 0x7f0de01071d0 2024-02-28T23:16:59.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.770+0000 7f0ddfe00700 1 --2- 172.21.15.159:0/2656572872 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0dc806d8a0 0x7f0dc806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:16:59.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.771+0000 7f0ddfe00700 1 --2- 172.21.15.159:0/2656572872 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0dc806d8a0 0x7f0dc806fd60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00b760 tx=0x7f0dcc009f90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:16:59.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:16:59.775+0000 7f0ddd600700 1 -- 172.21.15.159:0/2656572872 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0dd4052d20 con 0x7f0de01071d0 2024-02-28T23:16:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:59 smithi159 ceph-mon[113833]: osdmap e86: 6 total, 6 up, 6 in 2024-02-28T23:16:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:59 smithi159 ceph-mon[113833]: pgmap v163: 65 pgs: 12 active+undersized, 13 active+undersized+degraded, 40 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-02-28T23:16:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:16:59 smithi159 ceph-mon[113833]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:00.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.006+0000 7f0de7a00700 1 -- 172.21.15.159:0/2656572872 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0de01a1080 con 0x7f0dc806d8a0 2024-02-28T23:17:00.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.039+0000 7f0ddd600700 1 -- 172.21.15.159:0/2656572872 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f0de01a1080 con 0x7f0dc806d8a0 2024-02-28T23:17:00.038 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (6m) 33s ago 20m 13.9M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (21m) 33s ago 21m 8988k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (19m) 6s ago 19m 8292k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (2m) 33s ago 21m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (2m) 6s ago 19m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (5m) 33s ago 20m 73.5M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (13m) 33s ago 13m 147M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (13m) 33s ago 13m 86.9M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (13m) 6s ago 13m 18.5M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (13m) 6s ago 13m 18.4M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (9m) 33s ago 22m 502M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:17:00.039 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (8m) 6s ago 19m 451M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:17:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (4m) 33s ago 22m 48.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:17:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (3m) 6s ago 19m 36.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:17:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (7m) 33s ago 20m 7884k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:17:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (7m) 6s ago 19m 8044k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:17:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (2m) 33s ago 18m 114M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:17:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (73s) 33s ago 17m 97.5M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9120e23d80c0 2024-02-28T23:17:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (41s) 33s ago 17m 11.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 952e59c58165 2024-02-28T23:17:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (11s) 6s ago 16m 11.1M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 643ebdb823be 2024-02-28T23:17:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (15m) 6s ago 15m 252M 2241M 18.2.1 5be31c24972a 9f99133f227b 2024-02-28T23:17:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (15m) 6s ago 15m 267M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:17:00.040 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (6m) 33s ago 20m 55.0M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:17:00.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.043+0000 7f0de7a00700 1 -- 172.21.15.159:0/2656572872 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0dc806d8a0 msgr2=0x7f0dc806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:00.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.043+0000 7f0de7a00700 1 --2- 172.21.15.159:0/2656572872 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0dc806d8a0 0x7f0dc806fd60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0dcc00b760 tx=0x7f0dcc009f90 comp rx=0 tx=0).stop 2024-02-28T23:17:00.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.043+0000 7f0de7a00700 1 -- 172.21.15.159:0/2656572872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de01071d0 msgr2=0x7f0de019ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:00.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.043+0000 7f0de7a00700 1 --2- 172.21.15.159:0/2656572872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de01071d0 0x7f0de019ccb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0dd400e920 tx=0x7f0dd400ece0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.043+0000 7f0de7a00700 1 -- 172.21.15.159:0/2656572872 shutdown_connections 2024-02-28T23:17:00.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.043+0000 7f0de7a00700 1 --2- 172.21.15.159:0/2656572872 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0dc806d8a0 0x7f0dc806fd60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.043+0000 7f0de7a00700 1 --2- 172.21.15.159:0/2656572872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0de01071d0 0x7f0de019ccb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.043+0000 7f0de7a00700 1 --2- 172.21.15.159:0/2656572872 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0de010d280 0x7f0de019d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.043+0000 7f0de7a00700 1 -- 172.21.15.159:0/2656572872 >> 172.21.15.159:0/2656572872 conn(0x7f0de00769e0 msgr2=0x7f0de0078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:00.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.043+0000 7f0de7a00700 1 -- 172.21.15.159:0/2656572872 shutdown_connections 2024-02-28T23:17:00.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.043+0000 7f0de7a00700 1 -- 172.21.15.159:0/2656572872 wait complete. 2024-02-28T23:17:00.045 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:59 smithi184 ceph-mon[86482]: osdmap e86: 6 total, 6 up, 6 in 2024-02-28T23:17:00.045 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:59 smithi184 ceph-mon[86482]: pgmap v163: 65 pgs: 12 active+undersized, 13 active+undersized+degraded, 40 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-02-28T23:17:00.045 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:16:59 smithi184 ceph-mon[86482]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:00.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.201+0000 7f1050e00700 1 -- 172.21.15.159:0/3540956492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104c068d30 msgr2=0x7f104c10d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:00.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.201+0000 7f1050e00700 1 --2- 172.21.15.159:0/3540956492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104c068d30 0x7f104c10d240 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1038009910 tx=0x7f1038009c20 comp rx=0 tx=0).stop 2024-02-28T23:17:00.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.201+0000 7f1050e00700 1 -- 172.21.15.159:0/3540956492 shutdown_connections 2024-02-28T23:17:00.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.201+0000 7f1050e00700 1 --2- 172.21.15.159:0/3540956492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104c068d30 0x7f104c10d240 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.201+0000 7f1050e00700 1 --2- 172.21.15.159:0/3540956492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f104c068410 0x7f104c0687f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.201+0000 7f1050e00700 1 -- 172.21.15.159:0/3540956492 >> 172.21.15.159:0/3540956492 conn(0x7f104c0755a0 msgr2=0x7f104c0759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:00.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.201+0000 7f1050e00700 1 -- 172.21.15.159:0/3540956492 shutdown_connections 2024-02-28T23:17:00.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.201+0000 7f1050e00700 1 -- 172.21.15.159:0/3540956492 wait complete. 2024-02-28T23:17:00.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.202+0000 7f1050e00700 1 Processor -- start 2024-02-28T23:17:00.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.202+0000 7f1050e00700 1 -- start start 2024-02-28T23:17:00.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1050e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104c068410 0x7f104c19e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:00.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1050e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f104c068d30 0x7f104c19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:00.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1050e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c19f380 con 0x7f104c068410 2024-02-28T23:17:00.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1050e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104c198830 con 0x7f104c068d30 2024-02-28T23:17:00.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1049e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104c068410 0x7f104c19e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:00.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1049e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104c068410 0x7f104c19e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40184/0 (socket says 172.21.15.159:40184) 2024-02-28T23:17:00.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1049e00700 1 -- 172.21.15.159:0/666053263 learned_addr learned my addr 172.21.15.159:0/666053263 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:17:00.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1049400700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f104c068d30 0x7f104c19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:00.204 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1049e00700 1 -- 172.21.15.159:0/666053263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f104c068d30 msgr2=0x7f104c19ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:00.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1049e00700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f104c068d30 0x7f104c19ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1049e00700 1 -- 172.21.15.159:0/666053263 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10380095f0 con 0x7f104c068410 2024-02-28T23:17:00.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.203+0000 7f1049400700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f104c068d30 0x7f104c19ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:17:00.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.204+0000 7f1049e00700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104c068410 0x7f104c19e7b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f103c00b480 tx=0x7f103c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:00.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.204+0000 7f1042a00700 1 -- 172.21.15.159:0/666053263 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103c0118c0 con 0x7f104c068410 2024-02-28T23:17:00.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.204+0000 7f1042a00700 1 -- 172.21.15.159:0/666053263 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f103c010380 con 0x7f104c068410 2024-02-28T23:17:00.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.204+0000 7f1042a00700 1 -- 172.21.15.159:0/666053263 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f103c00f4f0 con 0x7f104c068410 2024-02-28T23:17:00.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.204+0000 7f1050e00700 1 -- 172.21.15.159:0/666053263 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f104c198b10 con 0x7f104c068410 2024-02-28T23:17:00.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.204+0000 7f1050e00700 1 -- 172.21.15.159:0/666053263 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f104c199060 con 0x7f104c068410 2024-02-28T23:17:00.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.205+0000 7f1050e00700 1 -- 172.21.15.159:0/666053263 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104c10a9b0 con 0x7f104c068410 2024-02-28T23:17:00.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.206+0000 7f1042a00700 1 -- 172.21.15.159:0/666053263 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f103c0104f0 con 0x7f104c068410 2024-02-28T23:17:00.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.207+0000 7f1042a00700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f103006d8a0 0x7f103006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:00.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.207+0000 7f1042a00700 1 -- 172.21.15.159:0/666053263 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f103c08d210 con 0x7f104c068410 2024-02-28T23:17:00.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.207+0000 7f1049400700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f103006d8a0 0x7f103006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:00.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.208+0000 7f1049400700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f103006d8a0 0x7f103006fd60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1038006010 tx=0x7f103800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:00.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.212+0000 7f1042a00700 1 -- 172.21.15.159:0/666053263 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f103c05a470 con 0x7f104c068410 2024-02-28T23:17:00.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.511+0000 7f1050e00700 1 -- 172.21.15.159:0/666053263 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f104c199330 con 0x7f104c068410 2024-02-28T23:17:00.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.512+0000 7f1042a00700 1 -- 172.21.15.159:0/666053263 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7f103c05a000 con 0x7f104c068410 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2, 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:17:00.512 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:17:00.513 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:17:00.513 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:17:00.513 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 6, 2024-02-28T23:17:00.513 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 8 2024-02-28T23:17:00.513 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:17:00.513 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:17:00.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.514+0000 7f1050e00700 1 -- 172.21.15.159:0/666053263 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f103006d8a0 msgr2=0x7f103006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:00.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.514+0000 7f1050e00700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f103006d8a0 0x7f103006fd60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1038006010 tx=0x7f103800b540 comp rx=0 tx=0).stop 2024-02-28T23:17:00.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.515+0000 7f1050e00700 1 -- 172.21.15.159:0/666053263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104c068410 msgr2=0x7f104c19e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:00.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.515+0000 7f1050e00700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104c068410 0x7f104c19e7b0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f103c00b480 tx=0x7f103c00b840 comp rx=0 tx=0).stop 2024-02-28T23:17:00.514 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.515+0000 7f1050e00700 1 -- 172.21.15.159:0/666053263 shutdown_connections 2024-02-28T23:17:00.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.515+0000 7f1050e00700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f103006d8a0 0x7f103006fd60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.515+0000 7f1050e00700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f104c068410 0x7f104c19e7b0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.515+0000 7f1050e00700 1 --2- 172.21.15.159:0/666053263 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f104c068d30 0x7f104c19ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.515+0000 7f1050e00700 1 -- 172.21.15.159:0/666053263 >> 172.21.15.159:0/666053263 conn(0x7f104c0755a0 msgr2=0x7f104c0fe7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:00.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.515+0000 7f1050e00700 1 -- 172.21.15.159:0/666053263 shutdown_connections 2024-02-28T23:17:00.515 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.515+0000 7f1050e00700 1 -- 172.21.15.159:0/666053263 wait complete. 2024-02-28T23:17:00.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.669+0000 7febd7000700 1 -- 172.21.15.159:0/3507476411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0068670 msgr2=0x7febd0068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:00.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.669+0000 7febd7000700 1 --2- 172.21.15.159:0/3507476411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0068670 0x7febd0068a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7febc0009910 tx=0x7febc0009c20 comp rx=0 tx=0).stop 2024-02-28T23:17:00.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.669+0000 7febd7000700 1 -- 172.21.15.159:0/3507476411 shutdown_connections 2024-02-28T23:17:00.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.669+0000 7febd7000700 1 --2- 172.21.15.159:0/3507476411 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd0069020 0x7febd0105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.669+0000 7febd7000700 1 --2- 172.21.15.159:0/3507476411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0068670 0x7febd0068a50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.669+0000 7febd7000700 1 -- 172.21.15.159:0/3507476411 >> 172.21.15.159:0/3507476411 conn(0x7febd00755a0 msgr2=0x7febd00759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:00.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.669+0000 7febd7000700 1 -- 172.21.15.159:0/3507476411 shutdown_connections 2024-02-28T23:17:00.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.669+0000 7febd7000700 1 -- 172.21.15.159:0/3507476411 wait complete. 2024-02-28T23:17:00.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.670+0000 7febd7000700 1 Processor -- start 2024-02-28T23:17:00.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.671+0000 7febd7000700 1 -- start start 2024-02-28T23:17:00.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.671+0000 7febd7000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0068670 0x7febd019c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:00.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.671+0000 7febd7000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd0069020 0x7febd019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:00.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.671+0000 7febd7000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd019d0e0 con 0x7febd0068670 2024-02-28T23:17:00.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.671+0000 7febd7000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd0196590 con 0x7febd0069020 2024-02-28T23:17:00.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.671+0000 7febcfe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0068670 0x7febd019c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:00.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.671+0000 7febcfe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0068670 0x7febd019c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40200/0 (socket says 172.21.15.159:40200) 2024-02-28T23:17:00.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.671+0000 7febcfe00700 1 -- 172.21.15.159:0/244648093 learned_addr learned my addr 172.21.15.159:0/244648093 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:17:00.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.671+0000 7febc7e00700 1 --2- 172.21.15.159:0/244648093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd0069020 0x7febd019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:00.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.672+0000 7febcfe00700 1 -- 172.21.15.159:0/244648093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd0069020 msgr2=0x7febd019ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:00.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.672+0000 7febcfe00700 1 --2- 172.21.15.159:0/244648093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd0069020 0x7febd019ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.672+0000 7febcfe00700 1 -- 172.21.15.159:0/244648093 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc00095f0 con 0x7febd0068670 2024-02-28T23:17:00.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.672+0000 7febcfe00700 1 --2- 172.21.15.159:0/244648093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0068670 0x7febd019c510 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febc000b5c0 tx=0x7febc000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:00.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.672+0000 7febcd600700 1 -- 172.21.15.159:0/244648093 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc001d070 con 0x7febd0068670 2024-02-28T23:17:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.672+0000 7febcd600700 1 -- 172.21.15.159:0/244648093 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7febc0005e00 con 0x7febd0068670 2024-02-28T23:17:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.672+0000 7febd7000700 1 -- 172.21.15.159:0/244648093 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febd0196810 con 0x7febd0068670 2024-02-28T23:17:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.672+0000 7febcd600700 1 -- 172.21.15.159:0/244648093 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7febc0017400 con 0x7febd0068670 2024-02-28T23:17:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.673+0000 7febd7000700 1 -- 172.21.15.159:0/244648093 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febd0196d00 con 0x7febd0068670 2024-02-28T23:17:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.674+0000 7febd7000700 1 -- 172.21.15.159:0/244648093 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febd0109130 con 0x7febd0068670 2024-02-28T23:17:00.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.675+0000 7febcd600700 1 -- 172.21.15.159:0/244648093 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7febc000f6f0 con 0x7febd0068670 2024-02-28T23:17:00.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.676+0000 7febcd600700 1 --2- 172.21.15.159:0/244648093 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7febb406d8a0 0x7febb406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:00.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.676+0000 7febcd600700 1 -- 172.21.15.159:0/244648093 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6675+0+0 (secure 0 0 0) 0x7febc008e9e0 con 0x7febd0068670 2024-02-28T23:17:00.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.676+0000 7febc7e00700 1 --2- 172.21.15.159:0/244648093 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7febb406d8a0 0x7febb406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:00.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.677+0000 7febc7e00700 1 --2- 172.21.15.159:0/244648093 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7febb406d8a0 0x7febb406fd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febd0107750 tx=0x7febb80073d0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:00.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.681+0000 7febcd600700 1 -- 172.21.15.159:0/244648093 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7febc005bc60 con 0x7febd0068670 2024-02-28T23:17:00.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.948+0000 7febd7000700 1 -- 172.21.15.159:0/244648093 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7febd004ea90 con 0x7febd0068670 2024-02-28T23:17:00.948 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:00 smithi159 ceph-mon[113833]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:00.948 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:00 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 40/228 objects degraded (17.544%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T23:17:00.948 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:00 smithi159 ceph-mon[113833]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:00.948 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:00.948 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:00.948 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:17:00.948 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:17:00.949 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:00.949 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:00 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/666053263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:00.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.949+0000 7febcd600700 1 -- 172.21.15.159:0/244648093 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1879 (secure 0 0 0) 0x7febc005b7f0 con 0x7febd0068670 2024-02-28T23:17:00.949 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:17:00.949 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:17:00.950 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:17:00.951 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:17:00.951 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:17:00.951 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:17:00.951 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:17:00.951 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:17:00.951 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:17:00.951 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:17:00.951 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:17:00.951 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:17:00.952 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:17:00.952 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:17:00.952 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:17:00.952 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:17:00.952 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:17:00.952 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:17:00.952 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:17:00.952 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:17:00.952 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:17:00.952 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:17:00.953 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:17:00.953 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:17:00.953 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:17:00.953 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:17:00.953 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:17:00.953 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:17:00.953 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:17:00.953 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:17:00.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.953+0000 7febd7000700 1 -- 172.21.15.159:0/244648093 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7febb406d8a0 msgr2=0x7febb406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:00.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.953+0000 7febd7000700 1 --2- 172.21.15.159:0/244648093 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7febb406d8a0 0x7febb406fd60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7febd0107750 tx=0x7febb80073d0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.953+0000 7febd7000700 1 -- 172.21.15.159:0/244648093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0068670 msgr2=0x7febd019c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:00.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.953+0000 7febd7000700 1 --2- 172.21.15.159:0/244648093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0068670 0x7febd019c510 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7febc000b5c0 tx=0x7febc000bd70 comp rx=0 tx=0).stop 2024-02-28T23:17:00.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.953+0000 7febd7000700 1 -- 172.21.15.159:0/244648093 shutdown_connections 2024-02-28T23:17:00.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.953+0000 7febd7000700 1 --2- 172.21.15.159:0/244648093 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7febb406d8a0 0x7febb406fd60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.953+0000 7febd7000700 1 --2- 172.21.15.159:0/244648093 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7febd0068670 0x7febd019c510 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.953+0000 7febd7000700 1 --2- 172.21.15.159:0/244648093 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7febd0069020 0x7febd019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:00.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.953+0000 7febd7000700 1 -- 172.21.15.159:0/244648093 >> 172.21.15.159:0/244648093 conn(0x7febd00755a0 msgr2=0x7febd00fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:00.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.954+0000 7febd7000700 1 -- 172.21.15.159:0/244648093 shutdown_connections 2024-02-28T23:17:00.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:00.954+0000 7febd7000700 1 -- 172.21.15.159:0/244648093 wait complete. 2024-02-28T23:17:00.955 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:17:01.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:00 smithi184 ceph-mon[86482]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:01.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:00 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 40/228 objects degraded (17.544%), 13 pgs degraded (PG_DEGRADED) 2024-02-28T23:17:01.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:00 smithi184 ceph-mon[86482]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:01.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:01.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:01.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:17:01.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:17:01.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:01.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:00 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/666053263' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:01.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.113+0000 7f6663200700 1 -- 172.21.15.159:0/2652433084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f665c1039b0 msgr2=0x7f665c107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:01.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.113+0000 7f6663200700 1 --2- 172.21.15.159:0/2652433084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f665c1039b0 0x7f665c107a00 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6648009910 tx=0x7f6648009c20 comp rx=0 tx=0).stop 2024-02-28T23:17:01.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.113+0000 7f6663200700 1 -- 172.21.15.159:0/2652433084 shutdown_connections 2024-02-28T23:17:01.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.113+0000 7f6663200700 1 --2- 172.21.15.159:0/2652433084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f665c1039b0 0x7f665c107a00 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.113+0000 7f6663200700 1 --2- 172.21.15.159:0/2652433084 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f665c103000 0x7f665c1033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.113+0000 7f6663200700 1 -- 172.21.15.159:0/2652433084 >> 172.21.15.159:0/2652433084 conn(0x7f665c0fe8d0 msgr2=0x7f665c100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:01.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.113+0000 7f6663200700 1 -- 172.21.15.159:0/2652433084 shutdown_connections 2024-02-28T23:17:01.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.113+0000 7f6663200700 1 -- 172.21.15.159:0/2652433084 wait complete. 2024-02-28T23:17:01.113 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.114+0000 7f6663200700 1 Processor -- start 2024-02-28T23:17:01.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.114+0000 7f6663200700 1 -- start start 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.115+0000 7f6663200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f665c103000 0x7f665c19e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.115+0000 7f6663200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f665c1039b0 0x7f665c19ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.115+0000 7f6663200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c19f300 con 0x7f665c103000 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.115+0000 7f6663200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665c198840 con 0x7f665c1039b0 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.115+0000 7f665be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f665c103000 0x7f665c19e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.115+0000 7f665be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f665c103000 0x7f665c19e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40216/0 (socket says 172.21.15.159:40216) 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.115+0000 7f665be00700 1 -- 172.21.15.159:0/3800551418 learned_addr learned my addr 172.21.15.159:0/3800551418 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.115+0000 7f665b400700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f665c1039b0 0x7f665c19ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.115+0000 7f665be00700 1 -- 172.21.15.159:0/3800551418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f665c1039b0 msgr2=0x7f665c19ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.116+0000 7f665be00700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f665c1039b0 0x7f665c19ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.116+0000 7f665be00700 1 -- 172.21.15.159:0/3800551418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66480095f0 con 0x7f665c103000 2024-02-28T23:17:01.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.116+0000 7f665b400700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f665c1039b0 0x7f665c19ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:17:01.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.116+0000 7f665be00700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f665c103000 0x7f665c19e7c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c930 tx=0x7f664c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:01.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.116+0000 7f6658c00700 1 -- 172.21.15.159:0/3800551418 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f664c007ad0 con 0x7f665c103000 2024-02-28T23:17:01.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.116+0000 7f6658c00700 1 -- 172.21.15.159:0/3800551418 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f664c007c30 con 0x7f665c103000 2024-02-28T23:17:01.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.116+0000 7f6663200700 1 -- 172.21.15.159:0/3800551418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f665c198b20 con 0x7f665c103000 2024-02-28T23:17:01.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.116+0000 7f6658c00700 1 -- 172.21.15.159:0/3800551418 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f664c018610 con 0x7f665c103000 2024-02-28T23:17:01.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.116+0000 7f6663200700 1 -- 172.21.15.159:0/3800551418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f665c199070 con 0x7f665c103000 2024-02-28T23:17:01.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.117+0000 7f6663200700 1 -- 172.21.15.159:0/3800551418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f665c10b400 con 0x7f665c103000 2024-02-28T23:17:01.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.118+0000 7f6658c00700 1 -- 172.21.15.159:0/3800551418 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f664c00f450 con 0x7f665c103000 2024-02-28T23:17:01.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.119+0000 7f6658c00700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f664006d8a0 0x7f664006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:01.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.119+0000 7f6658c00700 1 -- 172.21.15.159:0/3800551418 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f664c08d6e0 con 0x7f665c103000 2024-02-28T23:17:01.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.119+0000 7f665b400700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f664006d8a0 0x7f664006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:01.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.120+0000 7f665b400700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f664006d8a0 0x7f664006fd60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6648006010 tx=0x7f664800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:01.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.124+0000 7f6658c00700 1 -- 172.21.15.159:0/3800551418 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f664c05a9e0 con 0x7f665c103000 2024-02-28T23:17:01.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.356+0000 7f6663200700 1 -- 172.21.15.159:0/3800551418 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f665c1992f0 con 0x7f664006d8a0 2024-02-28T23:17:01.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.359+0000 7f6658c00700 1 -- 172.21.15.159:0/3800551418 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f665c1992f0 con 0x7f664006d8a0 2024-02-28T23:17:01.358 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:17:01.358 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:17:01.358 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:17:01.358 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:17:01.358 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:17:01.359 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-02-28T23:17:01.359 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:17:01.359 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:17:01.359 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:17:01.359 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "10/23 daemons upgraded", 2024-02-28T23:17:01.359 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T23:17:01.359 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:17:01.359 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:17:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.362+0000 7f6663200700 1 -- 172.21.15.159:0/3800551418 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f664006d8a0 msgr2=0x7f664006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.362+0000 7f6663200700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f664006d8a0 0x7f664006fd60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6648006010 tx=0x7f664800b540 comp rx=0 tx=0).stop 2024-02-28T23:17:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.362+0000 7f6663200700 1 -- 172.21.15.159:0/3800551418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f665c103000 msgr2=0x7f665c19e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.362+0000 7f6663200700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f665c103000 0x7f665c19e7c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c930 tx=0x7f664c00ccf0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.362+0000 7f6663200700 1 -- 172.21.15.159:0/3800551418 shutdown_connections 2024-02-28T23:17:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.362+0000 7f6663200700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f664006d8a0 0x7f664006fd60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.362+0000 7f6663200700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f665c103000 0x7f665c19e7c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.362+0000 7f6663200700 1 --2- 172.21.15.159:0/3800551418 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f665c1039b0 0x7f665c19ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.362+0000 7f6663200700 1 -- 172.21.15.159:0/3800551418 >> 172.21.15.159:0/3800551418 conn(0x7f665c0fe8d0 msgr2=0x7f665c100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:01.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.362+0000 7f6663200700 1 -- 172.21.15.159:0/3800551418 shutdown_connections 2024-02-28T23:17:01.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.363+0000 7f6663200700 1 -- 172.21.15.159:0/3800551418 wait complete. 2024-02-28T23:17:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.521+0000 7fc9df200700 1 -- 172.21.15.159:0/232245250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d8068670 msgr2=0x7fc9d8068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.521+0000 7fc9df200700 1 --2- 172.21.15.159:0/232245250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d8068670 0x7fc9d8068a50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0009910 tx=0x7fc9c0009c20 comp rx=0 tx=0).stop 2024-02-28T23:17:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.521+0000 7fc9df200700 1 -- 172.21.15.159:0/232245250 shutdown_connections 2024-02-28T23:17:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.521+0000 7fc9df200700 1 --2- 172.21.15.159:0/232245250 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9d8069020 0x7fc9d8105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.521+0000 7fc9df200700 1 --2- 172.21.15.159:0/232245250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d8068670 0x7fc9d8068a50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.521+0000 7fc9df200700 1 -- 172.21.15.159:0/232245250 >> 172.21.15.159:0/232245250 conn(0x7fc9d80755a0 msgr2=0x7fc9d80759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.521+0000 7fc9df200700 1 -- 172.21.15.159:0/232245250 shutdown_connections 2024-02-28T23:17:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.521+0000 7fc9df200700 1 -- 172.21.15.159:0/232245250 wait complete. 2024-02-28T23:17:01.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.522+0000 7fc9df200700 1 Processor -- start 2024-02-28T23:17:01.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.523+0000 7fc9df200700 1 -- start start 2024-02-28T23:17:01.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.523+0000 7fc9df200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d8068670 0x7fc9d819e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:01.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.523+0000 7fc9df200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9d8069020 0x7fc9d819ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:01.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.523+0000 7fc9df200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d819f2e0 con 0x7fc9d8068670 2024-02-28T23:17:01.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.523+0000 7fc9df200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d8198790 con 0x7fc9d8069020 2024-02-28T23:17:01.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.523+0000 7fc9d7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d8068670 0x7fc9d819e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:01.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.523+0000 7fc9d7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d8068670 0x7fc9d819e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40226/0 (socket says 172.21.15.159:40226) 2024-02-28T23:17:01.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.523+0000 7fc9d7e00700 1 -- 172.21.15.159:0/103068854 learned_addr learned my addr 172.21.15.159:0/103068854 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:17:01.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.524+0000 7fc9cf400700 1 --2- 172.21.15.159:0/103068854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9d8069020 0x7fc9d819ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:01.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.524+0000 7fc9d7e00700 1 -- 172.21.15.159:0/103068854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9d8069020 msgr2=0x7fc9d819ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:01.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.524+0000 7fc9d7e00700 1 --2- 172.21.15.159:0/103068854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9d8069020 0x7fc9d819ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.524+0000 7fc9d7e00700 1 -- 172.21.15.159:0/103068854 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00095f0 con 0x7fc9d8068670 2024-02-28T23:17:01.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.524+0000 7fc9d7e00700 1 --2- 172.21.15.159:0/103068854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d8068670 0x7fc9d819e710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0006010 tx=0x7fc9c000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:01.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.524+0000 7fc9d5600700 1 -- 172.21.15.159:0/103068854 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c001d070 con 0x7fc9d8068670 2024-02-28T23:17:01.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.525+0000 7fc9d5600700 1 -- 172.21.15.159:0/103068854 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9c0004fb0 con 0x7fc9d8068670 2024-02-28T23:17:01.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.525+0000 7fc9df200700 1 -- 172.21.15.159:0/103068854 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d8198a10 con 0x7fc9d8068670 2024-02-28T23:17:01.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.525+0000 7fc9d5600700 1 -- 172.21.15.159:0/103068854 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9c0022ea0 con 0x7fc9d8068670 2024-02-28T23:17:01.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.525+0000 7fc9df200700 1 -- 172.21.15.159:0/103068854 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d8198f00 con 0x7fc9d8068670 2024-02-28T23:17:01.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.526+0000 7fc9df200700 1 -- 172.21.15.159:0/103068854 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d804ea90 con 0x7fc9d8068670 2024-02-28T23:17:01.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.527+0000 7fc9d5600700 1 -- 172.21.15.159:0/103068854 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc9c0022470 con 0x7fc9d8068670 2024-02-28T23:17:01.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.528+0000 7fc9d5600700 1 --2- 172.21.15.159:0/103068854 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9bc06d8a0 0x7fc9bc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:01.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.528+0000 7fc9d5600700 1 -- 172.21.15.159:0/103068854 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fc9c008ec00 con 0x7fc9d8068670 2024-02-28T23:17:01.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.528+0000 7fc9cf400700 1 --2- 172.21.15.159:0/103068854 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9bc06d8a0 0x7fc9bc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:01.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.529+0000 7fc9cf400700 1 --2- 172.21.15.159:0/103068854 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9bc06d8a0 0x7fc9bc06fd60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8199c00 tx=0x7fc9c8007b80 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:01.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.536+0000 7fc9d5600700 1 -- 172.21.15.159:0/103068854 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc9c0094020 con 0x7fc9d8068670 2024-02-28T23:17:01.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.836+0000 7fc9df200700 1 -- 172.21.15.159:0/103068854 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc9d8199280 con 0x7fc9d8068670 2024-02-28T23:17:01.836 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:01 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:17:01.836 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:01 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:01.836 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:01 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:01.837 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:01 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:01.837 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:01 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T23:17:01.837 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:01 smithi159 ceph-mon[113833]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T23:17:01.837 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:01 smithi159 ceph-mon[113833]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-28T23:17:01.837 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:01 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/244648093' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:17:01.837 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:01 smithi159 ceph-mon[113833]: pgmap v164: 65 pgs: 9 active+undersized, 8 active+undersized+degraded, 48 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 24/228 objects degraded (10.526%) 2024-02-28T23:17:01.837 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:01 smithi159 ceph-mon[113833]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:01.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.837+0000 7fc9d5600700 1 -- 172.21.15.159:0/103068854 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+627 (secure 0 0 0) 0x7fc9c0027090 con 0x7fc9d8068670 2024-02-28T23:17:01.837 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_WARN Degraded data redundancy: 24/228 objects degraded (10.526%), 8 pgs degraded 2024-02-28T23:17:01.838 INFO:teuthology.orchestra.run.smithi159.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 24/228 objects degraded (10.526%), 8 pgs degraded 2024-02-28T23:17:01.838 INFO:teuthology.orchestra.run.smithi159.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-02-28T23:17:01.838 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-02-28T23:17:01.838 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-02-28T23:17:01.838 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-02-28T23:17:01.838 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-02-28T23:17:01.838 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-02-28T23:17:01.838 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-02-28T23:17:01.838 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-02-28T23:17:01.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.840+0000 7fc9df200700 1 -- 172.21.15.159:0/103068854 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9bc06d8a0 msgr2=0x7fc9bc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:01.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.840+0000 7fc9df200700 1 --2- 172.21.15.159:0/103068854 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9bc06d8a0 0x7fc9bc06fd60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc9d8199c00 tx=0x7fc9c8007b80 comp rx=0 tx=0).stop 2024-02-28T23:17:01.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.840+0000 7fc9df200700 1 -- 172.21.15.159:0/103068854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d8068670 msgr2=0x7fc9d819e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:01.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.840+0000 7fc9df200700 1 --2- 172.21.15.159:0/103068854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d8068670 0x7fc9d819e710 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0006010 tx=0x7fc9c000be20 comp rx=0 tx=0).stop 2024-02-28T23:17:01.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.841+0000 7fc9df200700 1 -- 172.21.15.159:0/103068854 shutdown_connections 2024-02-28T23:17:01.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.841+0000 7fc9df200700 1 --2- 172.21.15.159:0/103068854 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9bc06d8a0 0x7fc9bc06fd60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.841+0000 7fc9df200700 1 --2- 172.21.15.159:0/103068854 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9d8068670 0x7fc9d819e710 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.841+0000 7fc9df200700 1 --2- 172.21.15.159:0/103068854 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc9d8069020 0x7fc9d819ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:01.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.841+0000 7fc9df200700 1 -- 172.21.15.159:0/103068854 >> 172.21.15.159:0/103068854 conn(0x7fc9d80755a0 msgr2=0x7fc9d8102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:01.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.841+0000 7fc9df200700 1 -- 172.21.15.159:0/103068854 shutdown_connections 2024-02-28T23:17:01.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:01.841+0000 7fc9df200700 1 -- 172.21.15.159:0/103068854 wait complete. 2024-02-28T23:17:02.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:01 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:17:02.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:01 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:02.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:01 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:02.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:01 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:02.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:01 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T23:17:02.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:01 smithi184 ceph-mon[86482]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T23:17:02.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:01 smithi184 ceph-mon[86482]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-02-28T23:17:02.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:01 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/244648093' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:17:02.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:01 smithi184 ceph-mon[86482]: pgmap v164: 65 pgs: 9 active+undersized, 8 active+undersized+degraded, 48 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 24/228 objects degraded (10.526%) 2024-02-28T23:17:02.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:01 smithi184 ceph-mon[86482]: from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:02.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:02 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/103068854' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:17:03.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:02 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/103068854' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:17:03.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:03 smithi159 ceph-mon[113833]: pgmap v165: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 939 B/s rd, 1 op/s 2024-02-28T23:17:04.029 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:03 smithi184 ceph-mon[86482]: pgmap v165: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 939 B/s rd, 1 op/s 2024-02-28T23:17:04.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:04 smithi159 ceph-mon[113833]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/228 objects degraded (10.526%), 8 pgs degraded) 2024-02-28T23:17:04.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:04 smithi159 ceph-mon[113833]: Cluster is now healthy 2024-02-28T23:17:05.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:04 smithi184 ceph-mon[86482]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 24/228 objects degraded (10.526%), 8 pgs degraded) 2024-02-28T23:17:05.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:04 smithi184 ceph-mon[86482]: Cluster is now healthy 2024-02-28T23:17:05.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:05 smithi159 ceph-mon[113833]: pgmap v166: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:17:06.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:05 smithi184 ceph-mon[86482]: pgmap v166: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:17:08.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:08 smithi159 ceph-mon[113833]: pgmap v167: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:17:08.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:08.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:17:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:08 smithi184 ceph-mon[86482]: pgmap v167: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:17:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:17:09.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:09 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:09 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:10.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:10 smithi184 ceph-mon[86482]: pgmap v168: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-28T23:17:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:10 smithi159 ceph-mon[113833]: pgmap v168: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.0 KiB/s rd, 1 op/s 2024-02-28T23:17:12.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:12 smithi184 ceph-mon[86482]: pgmap v169: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 2 op/s 2024-02-28T23:17:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:12 smithi159 ceph-mon[113833]: pgmap v169: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 938 B/s rd, 2 op/s 2024-02-28T23:17:14.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:14 smithi184 ceph-mon[86482]: pgmap v170: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T23:17:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:14 smithi159 ceph-mon[113833]: pgmap v170: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-02-28T23:17:16.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:16 smithi184 ceph-mon[86482]: pgmap v171: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:17:16.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T23:17:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:16 smithi159 ceph-mon[113833]: pgmap v171: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:17:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T23:17:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:17 smithi184 ceph-mon[86482]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T23:17:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:17 smithi184 ceph-mon[86482]: Upgrade: osd.4 is safe to restart 2024-02-28T23:17:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:17 smithi159 ceph-mon[113833]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-28T23:17:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:17 smithi159 ceph-mon[113833]: Upgrade: osd.4 is safe to restart 2024-02-28T23:17:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:18 smithi184 ceph-mon[86482]: pgmap v172: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:17:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T23:17:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:17:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:18 smithi159 ceph-mon[113833]: pgmap v172: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:17:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-28T23:17:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:17:19.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:19 smithi184 ceph-mon[86482]: Upgrade: Updating osd.4 2024-02-28T23:17:19.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:19 smithi184 ceph-mon[86482]: Deploying daemon osd.4 on smithi184 2024-02-28T23:17:19.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:19 smithi159 ceph-mon[113833]: Upgrade: Updating osd.4 2024-02-28T23:17:19.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:19 smithi159 ceph-mon[113833]: Deploying daemon osd.4 on smithi184 2024-02-28T23:17:20.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:20 smithi184 ceph-mon[86482]: pgmap v173: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:17:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:20 smithi159 ceph-mon[113833]: pgmap v173: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:17:22.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:22 smithi184 ceph-mon[86482]: pgmap v174: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:17:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:22 smithi159 ceph-mon[113833]: pgmap v174: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:17:23.098 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:22 smithi184 systemd[1]: Stopping Ceph osd.4 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:17:23.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:23 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[49172]: 2024-02-28T23:17:23.098+0000 7f6543000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:17:23.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:23 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[49172]: 2024-02-28T23:17:23.098+0000 7f6543000700 -1 osd.4 86 *** Got signal Terminated *** 2024-02-28T23:17:23.351 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:23 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[49172]: 2024-02-28T23:17:23.098+0000 7f6543000700 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:17:23.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:23 smithi184 ceph-mon[86482]: osd.4 marked itself down and dead 2024-02-28T23:17:23.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:17:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:23 smithi159 ceph-mon[113833]: osd.4 marked itself down and dead 2024-02-28T23:17:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:17:24.182 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:23 smithi184 podman[100506]: 2024-02-28 23:17:23.900723105 +0000 UTC m=+0.930680731 container died 9f99133f227b38ca78bb87f71c8e2a12987fb8e8063185de717bda8cb6abf083 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4, org.label-schema.build-date=20240222, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=-18.2.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.29.1, org.label-schema.schema-version=1.0) 2024-02-28T23:17:24.509 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:24 smithi184 ceph-mon[86482]: pgmap v175: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:17:24.509 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:24 smithi184 ceph-mon[86482]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:17:24.510 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:24 smithi184 ceph-mon[86482]: osdmap e87: 6 total, 5 up, 6 in 2024-02-28T23:17:24.510 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:24 smithi184 podman[100506]: 2024-02-28 23:17:24.317319995 +0000 UTC m=+1.347277658 container cleanup 9f99133f227b38ca78bb87f71c8e2a12987fb8e8063185de717bda8cb6abf083 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.29.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-02-28T23:17:24.510 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:24 smithi184 bash[100506]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4 2024-02-28T23:17:24.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:24 smithi159 ceph-mon[113833]: pgmap v175: 65 pgs: 65 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:17:24.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:24 smithi159 ceph-mon[113833]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:17:24.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:24 smithi159 ceph-mon[113833]: osdmap e87: 6 total, 5 up, 6 in 2024-02-28T23:17:24.850 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:24 smithi184 podman[100525]: 2024-02-28 23:17:24.510068145 +0000 UTC m=+0.593937632 container remove 9f99133f227b38ca78bb87f71c8e2a12987fb8e8063185de717bda8cb6abf083 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4, io.buildah.version=1.29.1, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:17:25.600 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:25 smithi184 podman[100611]: 2024-02-28 23:17:25.228682721 +0000 UTC m=+0.033989917 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:17:25.600 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:25 smithi184 podman[100611]: 2024-02-28 23:17:25.355151683 +0000 UTC m=+0.160458938 container create 526ee04481a24542099a0b515be1b1a6257429fd07c5bcbad05b2f684f45f532 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T23:17:25.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:25 smithi184 ceph-mon[86482]: osdmap e88: 6 total, 5 up, 6 in 2024-02-28T23:17:25.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:25 smithi159 ceph-mon[113833]: osdmap e88: 6 total, 5 up, 6 in 2024-02-28T23:17:26.090 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:25 smithi184 podman[100611]: 2024-02-28 23:17:25.650672864 +0000 UTC m=+0.455980109 container init 526ee04481a24542099a0b515be1b1a6257429fd07c5bcbad05b2f684f45f532 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-deactivate, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T23:17:26.090 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:25 smithi184 podman[100611]: 2024-02-28 23:17:25.661680536 +0000 UTC m=+0.466987797 container start 526ee04481a24542099a0b515be1b1a6257429fd07c5bcbad05b2f684f45f532 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, ceph=True, org.label-schema.schema-version=1.0) 2024-02-28T23:17:26.090 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:25 smithi184 podman[100611]: 2024-02-28 23:17:25.749192809 +0000 UTC m=+0.554500014 container attach 526ee04481a24542099a0b515be1b1a6257429fd07c5bcbad05b2f684f45f532 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T23:17:26.345 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:26 smithi184 podman[100611]: 2024-02-28 23:17:26.091721028 +0000 UTC m=+0.897028285 container died 526ee04481a24542099a0b515be1b1a6257429fd07c5bcbad05b2f684f45f532 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0) 2024-02-28T23:17:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:26 smithi184 ceph-mon[86482]: pgmap v178: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-02-28T23:17:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:26 smithi184 ceph-mon[86482]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-28T23:17:26.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:26 smithi159 ceph-mon[113833]: pgmap v178: 65 pgs: 10 peering, 4 stale+active+clean, 51 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-02-28T23:17:26.625 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:26 smithi159 ceph-mon[113833]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-02-28T23:17:27.100 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:26 smithi184 podman[100637]: 2024-02-28 23:17:26.802865267 +0000 UTC m=+0.693270919 container remove 526ee04481a24542099a0b515be1b1a6257429fd07c5bcbad05b2f684f45f532 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, ceph=True) 2024-02-28T23:17:27.100 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:26 smithi184 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.4.service: Deactivated successfully. 2024-02-28T23:17:27.101 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:26 smithi184 systemd[1]: Stopped Ceph osd.4 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:17:27.101 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:26 smithi184 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.4.service: Consumed 2min 5.071s CPU time. 2024-02-28T23:17:27.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:27 smithi159 ceph-mon[113833]: pgmap v179: 65 pgs: 13 active+undersized, 9 active+undersized+degraded, 10 peering, 33 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 27/228 objects degraded (11.842%) 2024-02-28T23:17:27.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:27 smithi159 ceph-mon[113833]: Health check failed: Degraded data redundancy: 27/228 objects degraded (11.842%), 9 pgs degraded (PG_DEGRADED) 2024-02-28T23:17:27.600 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:27 smithi184 systemd[1]: Starting Ceph osd.4 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:17:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:27 smithi184 ceph-mon[86482]: pgmap v179: 65 pgs: 13 active+undersized, 9 active+undersized+degraded, 10 peering, 33 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 2 op/s; 27/228 objects degraded (11.842%) 2024-02-28T23:17:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:27 smithi184 ceph-mon[86482]: Health check failed: Degraded data redundancy: 27/228 objects degraded (11.842%), 9 pgs degraded (PG_DEGRADED) 2024-02-28T23:17:27.922 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:27 smithi184 podman[100736]: 2024-02-28 23:17:27.529909967 +0000 UTC m=+0.045543983 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:17:27.922 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:27 smithi184 podman[100736]: 2024-02-28 23:17:27.771126586 +0000 UTC m=+0.286760568 container create a30356ca0554e7aeaecb8b550ce3f7d54e4ae817f786cab4fd5cdf7dae3ee256 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-02-28T23:17:28.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 podman[100736]: 2024-02-28 23:17:28.024976252 +0000 UTC m=+0.540610274 container init a30356ca0554e7aeaecb8b550ce3f7d54e4ae817f786cab4fd5cdf7dae3ee256 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T23:17:28.351 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 podman[100736]: 2024-02-28 23:17:28.035840046 +0000 UTC m=+0.551474031 container start a30356ca0554e7aeaecb8b550ce3f7d54e4ae817f786cab4fd5cdf7dae3ee256 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-02-28T23:17:28.351 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 podman[100736]: 2024-02-28 23:17:28.164976872 +0000 UTC m=+0.680610895 container attach a30356ca0554e7aeaecb8b550ce3f7d54e4ae817f786cab4fd5cdf7dae3ee256 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.build-date=20240222) 2024-02-28T23:17:29.201 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate[100751]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T23:17:29.201 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate[100751]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T23:17:29.201 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 bash[100736]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T23:17:29.201 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 bash[100736]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-02-28T23:17:29.201 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 bash[100736]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T23:17:29.201 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 bash[100736]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T23:17:29.202 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 bash[100736]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-28T23:17:29.202 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 bash[100736]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T23:17:29.202 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 bash[100736]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-28T23:17:29.202 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate[100751]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-02-28T23:17:29.202 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate[100751]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-28T23:17:29.202 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate[100751]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-02-28T23:17:29.202 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate[100751]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-28T23:17:29.202 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate[100751]: --> ceph-volume raw activate successful for osd ID: 4 2024-02-28T23:17:29.202 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:28 smithi184 podman[100736]: 2024-02-28 23:17:28.950152225 +0000 UTC m=+1.465786211 container died a30356ca0554e7aeaecb8b550ce3f7d54e4ae817f786cab4fd5cdf7dae3ee256 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-02-28T23:17:30.002 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:29 smithi184 podman[100887]: 2024-02-28 23:17:29.64376898 +0000 UTC m=+0.674813667 container remove a30356ca0554e7aeaecb8b550ce3f7d54e4ae817f786cab4fd5cdf7dae3ee256 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-activate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222) 2024-02-28T23:17:30.281 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:30 smithi184 ceph-mon[86482]: pgmap v180: 65 pgs: 15 active+undersized, 11 active+undersized+degraded, 6 peering, 33 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 34/228 objects degraded (14.912%) 2024-02-28T23:17:30.281 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:30 smithi184 podman[100945]: 2024-02-28 23:17:29.908116162 +0000 UTC m=+0.035337739 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:17:30.281 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:30 smithi184 podman[100945]: 2024-02-28 23:17:30.011184001 +0000 UTC m=+0.138405610 container create dc8cef678e653fd60ec6533aa4734dba0e3d7d1a08c9b31c144cb3dcf5247888 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-02-28T23:17:30.281 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:30 smithi184 podman[100945]: 2024-02-28 23:17:30.282190618 +0000 UTC m=+0.409412234 container init dc8cef678e653fd60ec6533aa4734dba0e3d7d1a08c9b31c144cb3dcf5247888 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4, ceph=True, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-02-28T23:17:30.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:30 smithi159 ceph-mon[113833]: pgmap v180: 65 pgs: 15 active+undersized, 11 active+undersized+degraded, 6 peering, 33 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s rd, 1 op/s; 34/228 objects degraded (14.912%) 2024-02-28T23:17:30.600 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:30 smithi184 podman[100945]: 2024-02-28 23:17:30.294359205 +0000 UTC m=+0.421580792 container start dc8cef678e653fd60ec6533aa4734dba0e3d7d1a08c9b31c144cb3dcf5247888 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=) 2024-02-28T23:17:30.600 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:30 smithi184 ceph-osd[100964]: -- 172.21.15.184:0/2131451755 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55755cdeb680 con 0x55755cdb4c00 2024-02-28T23:17:30.600 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:30 smithi184 bash[100945]: dc8cef678e653fd60ec6533aa4734dba0e3d7d1a08c9b31c144cb3dcf5247888 2024-02-28T23:17:30.600 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:30 smithi184 systemd[1]: Started Ceph osd.4 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:17:31.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:30 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:17:30.861+0000 7f4514f7a7c0 -1 Falling back to public interface 2024-02-28T23:17:31.769 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:31 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:31.769 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:31 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:31.769 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:31 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:17:31.769 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:31 smithi184 ceph-mon[86482]: pgmap v181: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-02-28T23:17:31.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:31 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:31.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:31 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:31.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:31 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:17:31.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:31 smithi159 ceph-mon[113833]: pgmap v181: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 511 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-02-28T23:17:32.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.014+0000 7fda2b400700 1 -- 172.21.15.159:0/1334612159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda24073a80 msgr2=0x7fda2410cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.014+0000 7fda2b400700 1 --2- 172.21.15.159:0/1334612159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda24073a80 0x7fda2410cea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fda0c009910 tx=0x7fda0c009c20 comp rx=0 tx=0).stop 2024-02-28T23:17:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.015+0000 7fda2b400700 1 -- 172.21.15.159:0/1334612159 shutdown_connections 2024-02-28T23:17:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.015+0000 7fda2b400700 1 --2- 172.21.15.159:0/1334612159 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda24073a80 0x7fda2410cea0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.015+0000 7fda2b400700 1 --2- 172.21.15.159:0/1334612159 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda24073160 0x7fda24073540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.015+0000 7fda2b400700 1 -- 172.21.15.159:0/1334612159 >> 172.21.15.159:0/1334612159 conn(0x7fda240fc630 msgr2=0x7fda240fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:32.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.018+0000 7fda2b400700 1 -- 172.21.15.159:0/1334612159 shutdown_connections 2024-02-28T23:17:32.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.018+0000 7fda2b400700 1 -- 172.21.15.159:0/1334612159 wait complete. 2024-02-28T23:17:32.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.019+0000 7fda2b400700 1 Processor -- start 2024-02-28T23:17:32.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.019+0000 7fda2b400700 1 -- start start 2024-02-28T23:17:32.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.020+0000 7fda2b400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda24073160 0x7fda241a1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:32.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.020+0000 7fda2b400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda24073a80 0x7fda241a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:32.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.020+0000 7fda2b400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda241a25c0 con 0x7fda24073160 2024-02-28T23:17:32.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.020+0000 7fda2b400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda2410c1e0 con 0x7fda24073a80 2024-02-28T23:17:32.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.020+0000 7fda28a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda24073160 0x7fda241a1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:32.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.020+0000 7fda28a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda24073160 0x7fda241a1ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40906/0 (socket says 172.21.15.159:40906) 2024-02-28T23:17:32.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.020+0000 7fda28a00700 1 -- 172.21.15.159:0/1874693060 learned_addr learned my addr 172.21.15.159:0/1874693060 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:17:32.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.021+0000 7fda1be00700 1 --2- 172.21.15.159:0/1874693060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda24073a80 0x7fda241a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:32.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.021+0000 7fda28a00700 1 -- 172.21.15.159:0/1874693060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda24073a80 msgr2=0x7fda241a1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:32.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.021+0000 7fda28a00700 1 --2- 172.21.15.159:0/1874693060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda24073a80 0x7fda241a1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.021+0000 7fda28a00700 1 -- 172.21.15.159:0/1874693060 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda0c0095f0 con 0x7fda24073160 2024-02-28T23:17:32.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.021+0000 7fda28a00700 1 --2- 172.21.15.159:0/1874693060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda24073160 0x7fda241a1ab0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fda1400e920 tx=0x7fda1400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:32.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.021+0000 7fda22000700 1 -- 172.21.15.159:0/1874693060 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda14009790 con 0x7fda24073160 2024-02-28T23:17:32.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.021+0000 7fda22000700 1 -- 172.21.15.159:0/1874693060 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fda1400cba0 con 0x7fda24073160 2024-02-28T23:17:32.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.021+0000 7fda22000700 1 -- 172.21.15.159:0/1874693060 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fda14018650 con 0x7fda24073160 2024-02-28T23:17:32.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.021+0000 7fda2b400700 1 -- 172.21.15.159:0/1874693060 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda2410c4c0 con 0x7fda24073160 2024-02-28T23:17:32.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.022+0000 7fda2b400700 1 -- 172.21.15.159:0/1874693060 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda2410ca10 con 0x7fda24073160 2024-02-28T23:17:32.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.023+0000 7fda2b400700 1 -- 172.21.15.159:0/1874693060 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda24105fe0 con 0x7fda24073160 2024-02-28T23:17:32.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.024+0000 7fda22000700 1 -- 172.21.15.159:0/1874693060 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fda1400cd10 con 0x7fda24073160 2024-02-28T23:17:32.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.025+0000 7fda22000700 1 --2- 172.21.15.159:0/1874693060 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fda0406d8a0 0x7fda0406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:32.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.026+0000 7fda22000700 1 -- 172.21.15.159:0/1874693060 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fda14014070 con 0x7fda24073160 2024-02-28T23:17:32.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.026+0000 7fda1be00700 1 --2- 172.21.15.159:0/1874693060 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fda0406d8a0 0x7fda0406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:32.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.027+0000 7fda1be00700 1 --2- 172.21.15.159:0/1874693060 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fda0406d8a0 0x7fda0406fd60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda2419de50 tx=0x7fda0c005fb0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:32.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.030+0000 7fda22000700 1 -- 172.21.15.159:0/1874693060 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fda14052d20 con 0x7fda24073160 2024-02-28T23:17:32.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.272+0000 7fda2b400700 1 -- 172.21.15.159:0/1874693060 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fda2410ccf0 con 0x7fda0406d8a0 2024-02-28T23:17:32.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.274+0000 7fda22000700 1 -- 172.21.15.159:0/1874693060 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fda2410ccf0 con 0x7fda0406d8a0 2024-02-28T23:17:32.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.277+0000 7fda2b400700 1 -- 172.21.15.159:0/1874693060 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fda0406d8a0 msgr2=0x7fda0406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:32.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.277+0000 7fda2b400700 1 --2- 172.21.15.159:0/1874693060 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fda0406d8a0 0x7fda0406fd60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda2419de50 tx=0x7fda0c005fb0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.277+0000 7fda2b400700 1 -- 172.21.15.159:0/1874693060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda24073160 msgr2=0x7fda241a1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:32.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.277+0000 7fda2b400700 1 --2- 172.21.15.159:0/1874693060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda24073160 0x7fda241a1ab0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fda1400e920 tx=0x7fda1400ece0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.277+0000 7fda2b400700 1 -- 172.21.15.159:0/1874693060 shutdown_connections 2024-02-28T23:17:32.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.278+0000 7fda2b400700 1 --2- 172.21.15.159:0/1874693060 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fda0406d8a0 0x7fda0406fd60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.278+0000 7fda2b400700 1 --2- 172.21.15.159:0/1874693060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fda24073160 0x7fda241a1ab0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.278+0000 7fda2b400700 1 --2- 172.21.15.159:0/1874693060 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fda24073a80 0x7fda241a1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.278+0000 7fda2b400700 1 -- 172.21.15.159:0/1874693060 >> 172.21.15.159:0/1874693060 conn(0x7fda240fc630 msgr2=0x7fda24103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:32.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.278+0000 7fda2b400700 1 -- 172.21.15.159:0/1874693060 shutdown_connections 2024-02-28T23:17:32.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.278+0000 7fda2b400700 1 -- 172.21.15.159:0/1874693060 wait complete. 2024-02-28T23:17:32.293 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:17:32.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.443+0000 7efe2a200700 1 -- 172.21.15.159:0/2040289940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe24073ae0 msgr2=0x7efe2410ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:32.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.443+0000 7efe2a200700 1 --2- 172.21.15.159:0/2040289940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe24073ae0 0x7efe2410ce40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efe10009910 tx=0x7efe10009c20 comp rx=0 tx=0).stop 2024-02-28T23:17:32.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.443+0000 7efe2a200700 1 -- 172.21.15.159:0/2040289940 shutdown_connections 2024-02-28T23:17:32.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.443+0000 7efe2a200700 1 --2- 172.21.15.159:0/2040289940 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe24073ae0 0x7efe2410ce40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.443+0000 7efe2a200700 1 --2- 172.21.15.159:0/2040289940 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe240731c0 0x7efe240735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.443+0000 7efe2a200700 1 -- 172.21.15.159:0/2040289940 >> 172.21.15.159:0/2040289940 conn(0x7efe240fc630 msgr2=0x7efe240fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:32.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.443+0000 7efe2a200700 1 -- 172.21.15.159:0/2040289940 shutdown_connections 2024-02-28T23:17:32.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.443+0000 7efe2a200700 1 -- 172.21.15.159:0/2040289940 wait complete. 2024-02-28T23:17:32.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.444+0000 7efe2a200700 1 Processor -- start 2024-02-28T23:17:32.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.444+0000 7efe2a200700 1 -- start start 2024-02-28T23:17:32.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.445+0000 7efe2a200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe240731c0 0x7efe2419e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:32.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.445+0000 7efe2a200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe24073ae0 0x7efe2419ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:32.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.445+0000 7efe2a200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2419f3e0 con 0x7efe240731c0 2024-02-28T23:17:32.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.445+0000 7efe2a200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe24198890 con 0x7efe24073ae0 2024-02-28T23:17:32.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.445+0000 7efe23400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe240731c0 0x7efe2419e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:32.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.445+0000 7efe23400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe240731c0 0x7efe2419e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40926/0 (socket says 172.21.15.159:40926) 2024-02-28T23:17:32.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.445+0000 7efe23400700 1 -- 172.21.15.159:0/2567848754 learned_addr learned my addr 172.21.15.159:0/2567848754 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:17:32.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.445+0000 7efe23400700 1 -- 172.21.15.159:0/2567848754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe24073ae0 msgr2=0x7efe2419ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:32.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.445+0000 7efe23400700 1 --2- 172.21.15.159:0/2567848754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe24073ae0 0x7efe2419ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.445+0000 7efe23400700 1 -- 172.21.15.159:0/2567848754 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe100095f0 con 0x7efe240731c0 2024-02-28T23:17:32.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.446+0000 7efe23400700 1 --2- 172.21.15.159:0/2567848754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe240731c0 0x7efe2419e810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efe1400b4b0 tx=0x7efe1400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:32.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.446+0000 7efe1be00700 1 -- 172.21.15.159:0/2567848754 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe14011800 con 0x7efe240731c0 2024-02-28T23:17:32.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.446+0000 7efe1be00700 1 -- 172.21.15.159:0/2567848754 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7efe14011e20 con 0x7efe240731c0 2024-02-28T23:17:32.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.446+0000 7efe1be00700 1 -- 172.21.15.159:0/2567848754 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe1400f2e0 con 0x7efe240731c0 2024-02-28T23:17:32.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.446+0000 7efe2a200700 1 -- 172.21.15.159:0/2567848754 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe24198b70 con 0x7efe240731c0 2024-02-28T23:17:32.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.446+0000 7efe2a200700 1 -- 172.21.15.159:0/2567848754 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe24199070 con 0x7efe240731c0 2024-02-28T23:17:32.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.448+0000 7efe2a200700 1 -- 172.21.15.159:0/2567848754 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2410a540 con 0x7efe240731c0 2024-02-28T23:17:32.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.449+0000 7efe1be00700 1 -- 172.21.15.159:0/2567848754 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7efe14010380 con 0x7efe240731c0 2024-02-28T23:17:32.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.450+0000 7efe1be00700 1 --2- 172.21.15.159:0/2567848754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe0806d8a0 0x7efe0806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:32.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.450+0000 7efe1be00700 1 -- 172.21.15.159:0/2567848754 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6675+0+0 (secure 0 0 0) 0x7efe1408d1e0 con 0x7efe240731c0 2024-02-28T23:17:32.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.451+0000 7efe22a00700 1 --2- 172.21.15.159:0/2567848754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe0806d8a0 0x7efe0806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:32.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.452+0000 7efe22a00700 1 --2- 172.21.15.159:0/2567848754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe0806d8a0 0x7efe0806fd60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efe10006010 tx=0x7efe1000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:32.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.456+0000 7efe1be00700 1 -- 172.21.15.159:0/2567848754 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7efe1405a3c0 con 0x7efe240731c0 2024-02-28T23:17:32.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.697+0000 7efe2a200700 1 -- 172.21.15.159:0/2567848754 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe24199410 con 0x7efe0806d8a0 2024-02-28T23:17:32.696 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:32 smithi159 ceph-mon[113833]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-28T23:17:32.696 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:32 smithi159 ceph-mon[113833]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:32.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.698+0000 7efe1be00700 1 -- 172.21.15.159:0/2567848754 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7efe24199410 con 0x7efe0806d8a0 2024-02-28T23:17:32.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.701+0000 7efe2a200700 1 -- 172.21.15.159:0/2567848754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe0806d8a0 msgr2=0x7efe0806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:32.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.701+0000 7efe2a200700 1 --2- 172.21.15.159:0/2567848754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe0806d8a0 0x7efe0806fd60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7efe10006010 tx=0x7efe1000b540 comp rx=0 tx=0).stop 2024-02-28T23:17:32.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.701+0000 7efe2a200700 1 -- 172.21.15.159:0/2567848754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe240731c0 msgr2=0x7efe2419e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:32.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.701+0000 7efe2a200700 1 --2- 172.21.15.159:0/2567848754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe240731c0 0x7efe2419e810 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7efe1400b4b0 tx=0x7efe1400b870 comp rx=0 tx=0).stop 2024-02-28T23:17:32.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.701+0000 7efe2a200700 1 -- 172.21.15.159:0/2567848754 shutdown_connections 2024-02-28T23:17:32.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.701+0000 7efe2a200700 1 --2- 172.21.15.159:0/2567848754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7efe0806d8a0 0x7efe0806fd60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.701+0000 7efe2a200700 1 --2- 172.21.15.159:0/2567848754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe240731c0 0x7efe2419e810 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.701+0000 7efe2a200700 1 --2- 172.21.15.159:0/2567848754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7efe24073ae0 0x7efe2419ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.701+0000 7efe2a200700 1 -- 172.21.15.159:0/2567848754 >> 172.21.15.159:0/2567848754 conn(0x7efe240fc630 msgr2=0x7efe24107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:32.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.702+0000 7efe2a200700 1 -- 172.21.15.159:0/2567848754 shutdown_connections 2024-02-28T23:17:32.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.702+0000 7efe2a200700 1 -- 172.21.15.159:0/2567848754 wait complete. 2024-02-28T23:17:32.801 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:32 smithi184 ceph-mon[86482]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-02-28T23:17:32.801 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:32 smithi184 ceph-mon[86482]: from='client.34372 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:32.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.857+0000 7f926ae00700 1 -- 172.21.15.159:0/2503098039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92641071d0 msgr2=0x7f9264107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:32.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.857+0000 7f926ae00700 1 --2- 172.21.15.159:0/2503098039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92641071d0 0x7f9264107650 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9250009910 tx=0x7f9250009c20 comp rx=0 tx=0).stop 2024-02-28T23:17:32.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.857+0000 7f926ae00700 1 -- 172.21.15.159:0/2503098039 shutdown_connections 2024-02-28T23:17:32.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.857+0000 7f926ae00700 1 --2- 172.21.15.159:0/2503098039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92641071d0 0x7f9264107650 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.857+0000 7f926ae00700 1 --2- 172.21.15.159:0/2503098039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f926410d280 0x7f926410d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.857+0000 7f926ae00700 1 -- 172.21.15.159:0/2503098039 >> 172.21.15.159:0/2503098039 conn(0x7f92640769e0 msgr2=0x7f9264078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:32.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.858+0000 7f926ae00700 1 -- 172.21.15.159:0/2503098039 shutdown_connections 2024-02-28T23:17:32.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.858+0000 7f926ae00700 1 -- 172.21.15.159:0/2503098039 wait complete. 2024-02-28T23:17:32.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.859+0000 7f926ae00700 1 Processor -- start 2024-02-28T23:17:32.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.859+0000 7f926ae00700 1 -- start start 2024-02-28T23:17:32.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.859+0000 7f926ae00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92641071d0 0x7f926419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:32.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.859+0000 7f926ae00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f926410d280 0x7f926419d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:32.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.859+0000 7f926ae00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f926419d880 con 0x7f92641071d0 2024-02-28T23:17:32.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.859+0000 7f926ae00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92641a05b0 con 0x7f926410d280 2024-02-28T23:17:32.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.860+0000 7f9263e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92641071d0 0x7f926419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:32.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.860+0000 7f9263e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92641071d0 0x7f926419ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40942/0 (socket says 172.21.15.159:40942) 2024-02-28T23:17:32.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.860+0000 7f9263e00700 1 -- 172.21.15.159:0/3721890253 learned_addr learned my addr 172.21.15.159:0/3721890253 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:17:32.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.860+0000 7f9263400700 1 --2- 172.21.15.159:0/3721890253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f926410d280 0x7f926419d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:32.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.860+0000 7f9263e00700 1 -- 172.21.15.159:0/3721890253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f926410d280 msgr2=0x7f926419d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:32.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.860+0000 7f9263e00700 1 --2- 172.21.15.159:0/3721890253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f926410d280 0x7f926419d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:32.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.860+0000 7f9263e00700 1 -- 172.21.15.159:0/3721890253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92500095f0 con 0x7f92641071d0 2024-02-28T23:17:32.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.861+0000 7f9263e00700 1 --2- 172.21.15.159:0/3721890253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92641071d0 0x7f926419ccb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f925400e920 tx=0x7f925400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:32.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.861+0000 7f9260c00700 1 -- 172.21.15.159:0/3721890253 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9254009790 con 0x7f92641071d0 2024-02-28T23:17:32.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.861+0000 7f9260c00700 1 -- 172.21.15.159:0/3721890253 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f925400cba0 con 0x7f92641071d0 2024-02-28T23:17:32.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.861+0000 7f926ae00700 1 -- 172.21.15.159:0/3721890253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92641a0890 con 0x7f92641071d0 2024-02-28T23:17:32.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.861+0000 7f9260c00700 1 -- 172.21.15.159:0/3721890253 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9254018650 con 0x7f92641071d0 2024-02-28T23:17:32.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.861+0000 7f926ae00700 1 -- 172.21.15.159:0/3721890253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92641a0e60 con 0x7f92641071d0 2024-02-28T23:17:32.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.862+0000 7f926ae00700 1 -- 172.21.15.159:0/3721890253 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926410f6c0 con 0x7f92641071d0 2024-02-28T23:17:32.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.863+0000 7f9260c00700 1 -- 172.21.15.159:0/3721890253 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f925400cd10 con 0x7f92641071d0 2024-02-28T23:17:32.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.864+0000 7f9260c00700 1 --2- 172.21.15.159:0/3721890253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f924806d8a0 0x7f924806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:32.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.864+0000 7f9260c00700 1 -- 172.21.15.159:0/3721890253 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f9254014070 con 0x7f92641071d0 2024-02-28T23:17:32.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.864+0000 7f9263400700 1 --2- 172.21.15.159:0/3721890253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f924806d8a0 0x7f924806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:32.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.865+0000 7f9263400700 1 --2- 172.21.15.159:0/3721890253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f924806d8a0 0x7f924806fd60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9250009fd0 tx=0x7f9250005940 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:32.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:32.869+0000 7f9260c00700 1 -- 172.21.15.159:0/3721890253 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9254052d20 con 0x7f92641071d0 2024-02-28T23:17:33.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.099+0000 7f926ae00700 1 -- 172.21.15.159:0/3721890253 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f92641a10d0 con 0x7f924806d8a0 2024-02-28T23:17:33.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.116+0000 7f9260c00700 1 -- 172.21.15.159:0/3721890253 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f92641a10d0 con 0x7f924806d8a0 2024-02-28T23:17:33.115 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:17:33.115 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (7m) 66s ago 21m 13.9M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:17:33.115 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (21m) 66s ago 21m 8988k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:17:33.115 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (20m) 39s ago 20m 8292k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:17:33.115 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (3m) 66s ago 21m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:17:33.115 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (3m) 39s ago 20m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:17:33.116 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (6m) 66s ago 20m 73.5M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:17:33.116 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (13m) 66s ago 13m 147M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:17:33.116 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (14m) 66s ago 14m 86.9M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:17:33.116 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (14m) 39s ago 14m 18.5M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:17:33.116 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (13m) 39s ago 13m 18.4M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:17:33.116 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (9m) 66s ago 23m 502M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:17:33.116 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (8m) 39s ago 19m 451M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:17:33.116 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (4m) 66s ago 23m 48.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:17:33.116 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (4m) 39s ago 19m 36.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:17:33.117 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (8m) 66s ago 21m 7884k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:17:33.117 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (8m) 39s ago 19m 8044k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:17:33.117 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (2m) 66s ago 18m 114M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:17:33.117 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (106s) 66s ago 18m 97.5M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9120e23d80c0 2024-02-28T23:17:33.117 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (74s) 66s ago 17m 11.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 952e59c58165 2024-02-28T23:17:33.117 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (44s) 39s ago 17m 11.1M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 643ebdb823be 2024-02-28T23:17:33.117 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 starting - - - 2241M 2024-02-28T23:17:33.117 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (15m) 39s ago 15m 267M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:17:33.117 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (7m) 66s ago 20m 55.0M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:17:33.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.118+0000 7f926ae00700 1 -- 172.21.15.159:0/3721890253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f924806d8a0 msgr2=0x7f924806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:33.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.118+0000 7f926ae00700 1 --2- 172.21.15.159:0/3721890253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f924806d8a0 0x7f924806fd60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9250009fd0 tx=0x7f9250005940 comp rx=0 tx=0).stop 2024-02-28T23:17:33.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.118+0000 7f926ae00700 1 -- 172.21.15.159:0/3721890253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92641071d0 msgr2=0x7f926419ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:33.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.118+0000 7f926ae00700 1 --2- 172.21.15.159:0/3721890253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92641071d0 0x7f926419ccb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f925400e920 tx=0x7f925400ece0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.119+0000 7f926ae00700 1 -- 172.21.15.159:0/3721890253 shutdown_connections 2024-02-28T23:17:33.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.119+0000 7f926ae00700 1 --2- 172.21.15.159:0/3721890253 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f924806d8a0 0x7f924806fd60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.119+0000 7f926ae00700 1 --2- 172.21.15.159:0/3721890253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f92641071d0 0x7f926419ccb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.119+0000 7f926ae00700 1 --2- 172.21.15.159:0/3721890253 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f926410d280 0x7f926419d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.119+0000 7f926ae00700 1 -- 172.21.15.159:0/3721890253 >> 172.21.15.159:0/3721890253 conn(0x7f92640769e0 msgr2=0x7f9264078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:33.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.119+0000 7f926ae00700 1 -- 172.21.15.159:0/3721890253 shutdown_connections 2024-02-28T23:17:33.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.119+0000 7f926ae00700 1 -- 172.21.15.159:0/3721890253 wait complete. 2024-02-28T23:17:33.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.276+0000 7fe54d600700 1 -- 172.21.15.159:0/1552977061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5481071d0 msgr2=0x7fe548107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:33.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.276+0000 7fe54d600700 1 --2- 172.21.15.159:0/1552977061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5481071d0 0x7fe548107650 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe534009870 tx=0x7fe534009b80 comp rx=0 tx=0).stop 2024-02-28T23:17:33.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.276+0000 7fe54d600700 1 -- 172.21.15.159:0/1552977061 shutdown_connections 2024-02-28T23:17:33.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.276+0000 7fe54d600700 1 --2- 172.21.15.159:0/1552977061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe5481071d0 0x7fe548107650 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.276+0000 7fe54d600700 1 --2- 172.21.15.159:0/1552977061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe54810d280 0x7fe54810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.276+0000 7fe54d600700 1 -- 172.21.15.159:0/1552977061 >> 172.21.15.159:0/1552977061 conn(0x7fe5480769e0 msgr2=0x7fe548078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:33.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.277+0000 7fe54d600700 1 -- 172.21.15.159:0/1552977061 shutdown_connections 2024-02-28T23:17:33.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.277+0000 7fe54d600700 1 -- 172.21.15.159:0/1552977061 wait complete. 2024-02-28T23:17:33.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.278+0000 7fe54d600700 1 Processor -- start 2024-02-28T23:17:33.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.278+0000 7fe54d600700 1 -- start start 2024-02-28T23:17:33.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.278+0000 7fe54d600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5481071d0 0x7fe54819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:33.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.278+0000 7fe54d600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe54810d280 0x7fe54819d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:33.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.278+0000 7fe54d600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54819d880 con 0x7fe54810d280 2024-02-28T23:17:33.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.278+0000 7fe54d600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5481a05b0 con 0x7fe5481071d0 2024-02-28T23:17:33.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.278+0000 7fe546000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe54810d280 0x7fe54819d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:33.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.278+0000 7fe546000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe54810d280 0x7fe54819d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40954/0 (socket says 172.21.15.159:40954) 2024-02-28T23:17:33.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.278+0000 7fe546000700 1 -- 172.21.15.159:0/2632315516 learned_addr learned my addr 172.21.15.159:0/2632315516 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:17:33.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.279+0000 7fe546a00700 1 --2- 172.21.15.159:0/2632315516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5481071d0 0x7fe54819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:33.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.279+0000 7fe546000700 1 -- 172.21.15.159:0/2632315516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5481071d0 msgr2=0x7fe54819ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:33.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.279+0000 7fe546000700 1 --2- 172.21.15.159:0/2632315516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5481071d0 0x7fe54819ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.279+0000 7fe546000700 1 -- 172.21.15.159:0/2632315516 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe534009520 con 0x7fe54810d280 2024-02-28T23:17:33.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.279+0000 7fe546000700 1 --2- 172.21.15.159:0/2632315516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe54810d280 0x7fe54819d1f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe534009230 tx=0x7fe5340047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:33.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.279+0000 7fe53f400700 1 -- 172.21.15.159:0/2632315516 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe53401c070 con 0x7fe54810d280 2024-02-28T23:17:33.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.279+0000 7fe53f400700 1 -- 172.21.15.159:0/2632315516 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe53400fcd0 con 0x7fe54810d280 2024-02-28T23:17:33.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.279+0000 7fe54d600700 1 -- 172.21.15.159:0/2632315516 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5481a0830 con 0x7fe54810d280 2024-02-28T23:17:33.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.280+0000 7fe53f400700 1 -- 172.21.15.159:0/2632315516 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe534022d20 con 0x7fe54810d280 2024-02-28T23:17:33.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.280+0000 7fe54d600700 1 -- 172.21.15.159:0/2632315516 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5481a0da0 con 0x7fe54810d280 2024-02-28T23:17:33.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.281+0000 7fe54d600700 1 -- 172.21.15.159:0/2632315516 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54810f6c0 con 0x7fe54810d280 2024-02-28T23:17:33.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.282+0000 7fe53f400700 1 -- 172.21.15.159:0/2632315516 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe534020070 con 0x7fe54810d280 2024-02-28T23:17:33.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.282+0000 7fe53f400700 1 --2- 172.21.15.159:0/2632315516 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe52c06d8a0 0x7fe52c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:33.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.283+0000 7fe53f400700 1 -- 172.21.15.159:0/2632315516 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fe53408e660 con 0x7fe54810d280 2024-02-28T23:17:33.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.283+0000 7fe546a00700 1 --2- 172.21.15.159:0/2632315516 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe52c06d8a0 0x7fe52c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:33.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.284+0000 7fe546a00700 1 --2- 172.21.15.159:0/2632315516 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe52c06d8a0 0x7fe52c06fd60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe538005fd0 tx=0x7fe538009310 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:33.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.288+0000 7fe53f400700 1 -- 172.21.15.159:0/2632315516 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe534057dc0 con 0x7fe54810d280 2024-02-28T23:17:33.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.596+0000 7fe54d600700 1 -- 172.21.15.159:0/2632315516 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe54804ea90 con 0x7fe54810d280 2024-02-28T23:17:33.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.597+0000 7fe53f400700 1 -- 172.21.15.159:0/2632315516 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+791 (secure 0 0 0) 0x7fe53405b480 con 0x7fe54810d280 2024-02-28T23:17:33.595 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:17:33.596 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:17:33.596 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:17:33.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:17:33.596 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:17:33.596 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:17:33.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:17:33.596 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:17:33.596 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-02-28T23:17:33.596 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T23:17:33.596 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:17:33.597 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:17:33.597 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:17:33.597 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:17:33.597 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:17:33.597 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 5, 2024-02-28T23:17:33.597 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 8 2024-02-28T23:17:33.597 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:17:33.597 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:17:33.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.599+0000 7fe54d600700 1 -- 172.21.15.159:0/2632315516 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe52c06d8a0 msgr2=0x7fe52c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:33.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.599+0000 7fe54d600700 1 --2- 172.21.15.159:0/2632315516 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe52c06d8a0 0x7fe52c06fd60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe538005fd0 tx=0x7fe538009310 comp rx=0 tx=0).stop 2024-02-28T23:17:33.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.599+0000 7fe54d600700 1 -- 172.21.15.159:0/2632315516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe54810d280 msgr2=0x7fe54819d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:33.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.599+0000 7fe54d600700 1 --2- 172.21.15.159:0/2632315516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe54810d280 0x7fe54819d1f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe534009230 tx=0x7fe5340047b0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.600+0000 7fe54d600700 1 -- 172.21.15.159:0/2632315516 shutdown_connections 2024-02-28T23:17:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.600+0000 7fe54d600700 1 --2- 172.21.15.159:0/2632315516 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe5481071d0 0x7fe54819ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.600+0000 7fe54d600700 1 --2- 172.21.15.159:0/2632315516 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe52c06d8a0 0x7fe52c06fd60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.600+0000 7fe54d600700 1 --2- 172.21.15.159:0/2632315516 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe54810d280 0x7fe54819d1f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.600+0000 7fe54d600700 1 -- 172.21.15.159:0/2632315516 >> 172.21.15.159:0/2632315516 conn(0x7fe5480769e0 msgr2=0x7fe548078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.600+0000 7fe54d600700 1 -- 172.21.15.159:0/2632315516 shutdown_connections 2024-02-28T23:17:33.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.600+0000 7fe54d600700 1 -- 172.21.15.159:0/2632315516 wait complete. 2024-02-28T23:17:33.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.757+0000 7fd3c6e00700 1 -- 172.21.15.159:0/95249628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c01009c0 msgr2=0x7fd3c0100e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:33.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.757+0000 7fd3c6e00700 1 --2- 172.21.15.159:0/95249628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c01009c0 0x7fd3c0100e40 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009910 tx=0x7fd3ac009c20 comp rx=0 tx=0).stop 2024-02-28T23:17:33.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.757+0000 7fd3c6e00700 1 -- 172.21.15.159:0/95249628 shutdown_connections 2024-02-28T23:17:33.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.757+0000 7fd3c6e00700 1 --2- 172.21.15.159:0/95249628 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c01009c0 0x7fd3c0100e40 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.757+0000 7fd3c6e00700 1 --2- 172.21.15.159:0/95249628 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3c01069c0 0x7fd3c0106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.757+0000 7fd3c6e00700 1 -- 172.21.15.159:0/95249628 >> 172.21.15.159:0/95249628 conn(0x7fd3c00fc4d0 msgr2=0x7fd3c00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:33.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.757+0000 7fd3c6e00700 1 -- 172.21.15.159:0/95249628 shutdown_connections 2024-02-28T23:17:33.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.757+0000 7fd3c6e00700 1 -- 172.21.15.159:0/95249628 wait complete. 2024-02-28T23:17:33.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.758+0000 7fd3c6e00700 1 Processor -- start 2024-02-28T23:17:33.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.759+0000 7fd3c6e00700 1 -- start start 2024-02-28T23:17:33.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.759+0000 7fd3c6e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3c01009c0 0x7fd3c0073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:33.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.759+0000 7fd3c6e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c01069c0 0x7fd3c00735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:33.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.759+0000 7fd3c6e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0073b10 con 0x7fd3c01069c0 2024-02-28T23:17:33.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.759+0000 7fd3c6e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0073c80 con 0x7fd3c01009c0 2024-02-28T23:17:33.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.759+0000 7fd3c5000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c01069c0 0x7fd3c00735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:33.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.759+0000 7fd3c5000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c01069c0 0x7fd3c00735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40972/0 (socket says 172.21.15.159:40972) 2024-02-28T23:17:33.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.759+0000 7fd3c5000700 1 -- 172.21.15.159:0/1817682621 learned_addr learned my addr 172.21.15.159:0/1817682621 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:17:33.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.759+0000 7fd3c5a00700 1 --2- 172.21.15.159:0/1817682621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3c01009c0 0x7fd3c0073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:33.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.760+0000 7fd3c5000700 1 -- 172.21.15.159:0/1817682621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3c01009c0 msgr2=0x7fd3c0073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:33.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.760+0000 7fd3c5000700 1 --2- 172.21.15.159:0/1817682621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3c01009c0 0x7fd3c0073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:33.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.760+0000 7fd3c5000700 1 -- 172.21.15.159:0/1817682621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac0095f0 con 0x7fd3c01069c0 2024-02-28T23:17:33.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.760+0000 7fd3c5000700 1 --2- 172.21.15.159:0/1817682621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c01069c0 0x7fd3c00735d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00b5c0 tx=0x7fd3ac00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:33.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.760+0000 7fd3be000700 1 -- 172.21.15.159:0/1817682621 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ac01d070 con 0x7fd3c01069c0 2024-02-28T23:17:33.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.760+0000 7fd3be000700 1 -- 172.21.15.159:0/1817682621 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd3ac005e00 con 0x7fd3c01069c0 2024-02-28T23:17:33.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.760+0000 7fd3be000700 1 -- 172.21.15.159:0/1817682621 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3ac017400 con 0x7fd3c01069c0 2024-02-28T23:17:33.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.760+0000 7fd3c6e00700 1 -- 172.21.15.159:0/1817682621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c0073f00 con 0x7fd3c01069c0 2024-02-28T23:17:33.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.760+0000 7fd3c6e00700 1 -- 172.21.15.159:0/1817682621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c01a2ac0 con 0x7fd3c01069c0 2024-02-28T23:17:33.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.762+0000 7fd3c6e00700 1 -- 172.21.15.159:0/1817682621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c0108f50 con 0x7fd3c01069c0 2024-02-28T23:17:33.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:33 smithi159 ceph-mon[113833]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:33.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:33 smithi159 ceph-mon[113833]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:33.761 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:33 smithi159 ceph-mon[113833]: pgmap v182: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 937 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-02-28T23:17:33.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.763+0000 7fd3be000700 1 -- 172.21.15.159:0/1817682621 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd3ac00f460 con 0x7fd3c01069c0 2024-02-28T23:17:33.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.764+0000 7fd3be000700 1 --2- 172.21.15.159:0/1817682621 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd3a806d8a0 0x7fd3a806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:33.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.764+0000 7fd3be000700 1 -- 172.21.15.159:0/1817682621 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fd3ac08e8d0 con 0x7fd3c01069c0 2024-02-28T23:17:33.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.765+0000 7fd3c5a00700 1 --2- 172.21.15.159:0/1817682621 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd3a806d8a0 0x7fd3a806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:33.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.765+0000 7fd3c5a00700 1 --2- 172.21.15.159:0/1817682621 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd3a806d8a0 0x7fd3a806fd60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4005950 tx=0x7fd3b40058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:33.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:33.769+0000 7fd3be000700 1 -- 172.21.15.159:0/1817682621 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd3ac058000 con 0x7fd3c01069c0 2024-02-28T23:17:33.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:33 smithi184 ceph-mon[86482]: from='client.34376 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:33.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:33 smithi184 ceph-mon[86482]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:33.853 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:33 smithi184 ceph-mon[86482]: pgmap v182: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 937 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-02-28T23:17:34.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.032+0000 7fd3c6e00700 1 -- 172.21.15.159:0/1817682621 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3c0073e40 con 0x7fd3c01069c0 2024-02-28T23:17:34.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.033+0000 7fd3be000700 1 -- 172.21.15.159:0/1817682621 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1879 (secure 0 0 0) 0x7fd3ac05b6c0 con 0x7fd3c01069c0 2024-02-28T23:17:34.032 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:17:34.032 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:17:34.033 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:17:34.034 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:17:34.035 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:17:34.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.036+0000 7fd3c6e00700 1 -- 172.21.15.159:0/1817682621 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd3a806d8a0 msgr2=0x7fd3a806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:34.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.036+0000 7fd3c6e00700 1 --2- 172.21.15.159:0/1817682621 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd3a806d8a0 0x7fd3a806fd60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4005950 tx=0x7fd3b40058e0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.036+0000 7fd3c6e00700 1 -- 172.21.15.159:0/1817682621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c01069c0 msgr2=0x7fd3c00735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:34.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.036+0000 7fd3c6e00700 1 --2- 172.21.15.159:0/1817682621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c01069c0 0x7fd3c00735d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00b5c0 tx=0x7fd3ac00be20 comp rx=0 tx=0).stop 2024-02-28T23:17:34.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.037+0000 7fd3c6e00700 1 -- 172.21.15.159:0/1817682621 shutdown_connections 2024-02-28T23:17:34.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.037+0000 7fd3c6e00700 1 --2- 172.21.15.159:0/1817682621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd3c01009c0 0x7fd3c0073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.037+0000 7fd3c6e00700 1 --2- 172.21.15.159:0/1817682621 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd3a806d8a0 0x7fd3a806fd60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.037+0000 7fd3c6e00700 1 --2- 172.21.15.159:0/1817682621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd3c01069c0 0x7fd3c00735d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.037+0000 7fd3c6e00700 1 -- 172.21.15.159:0/1817682621 >> 172.21.15.159:0/1817682621 conn(0x7fd3c00fc4d0 msgr2=0x7fd3c00fcf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:34.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.037+0000 7fd3c6e00700 1 -- 172.21.15.159:0/1817682621 shutdown_connections 2024-02-28T23:17:34.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.037+0000 7fd3c6e00700 1 -- 172.21.15.159:0/1817682621 wait complete. 2024-02-28T23:17:34.037 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:17:34.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.189+0000 7f0a31000700 1 -- 172.21.15.159:0/313301845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c102e10 msgr2=0x7f0a2c1031f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:34.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.189+0000 7f0a31000700 1 --2- 172.21.15.159:0/313301845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c102e10 0x7f0a2c1031f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c009910 tx=0x7f0a1c009c20 comp rx=0 tx=0).stop 2024-02-28T23:17:34.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.189+0000 7f0a31000700 1 -- 172.21.15.159:0/313301845 shutdown_connections 2024-02-28T23:17:34.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.189+0000 7f0a31000700 1 --2- 172.21.15.159:0/313301845 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c1037c0 0x7f0a2c107810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.189+0000 7f0a31000700 1 --2- 172.21.15.159:0/313301845 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c102e10 0x7f0a2c1031f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.189+0000 7f0a31000700 1 -- 172.21.15.159:0/313301845 >> 172.21.15.159:0/313301845 conn(0x7f0a2c0fe6c0 msgr2=0x7f0a2c100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:34.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.189+0000 7f0a31000700 1 -- 172.21.15.159:0/313301845 shutdown_connections 2024-02-28T23:17:34.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.189+0000 7f0a31000700 1 -- 172.21.15.159:0/313301845 wait complete. 2024-02-28T23:17:34.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.190+0000 7f0a31000700 1 Processor -- start 2024-02-28T23:17:34.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.190+0000 7f0a31000700 1 -- start start 2024-02-28T23:17:34.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.191+0000 7f0a31000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c102e10 0x7f0a2c19e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:34.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.191+0000 7f0a31000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c1037c0 0x7f0a2c19eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:34.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.191+0000 7f0a31000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c19f150 con 0x7f0a2c1037c0 2024-02-28T23:17:34.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.191+0000 7f0a31000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c198600 con 0x7f0a2c102e10 2024-02-28T23:17:34.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.191+0000 7f0a2aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c1037c0 0x7f0a2c19eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:34.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.191+0000 7f0a2aa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c1037c0 0x7f0a2c19eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40998/0 (socket says 172.21.15.159:40998) 2024-02-28T23:17:34.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.191+0000 7f0a2aa00700 1 -- 172.21.15.159:0/1674861238 learned_addr learned my addr 172.21.15.159:0/1674861238 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:17:34.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.191+0000 7f0a2b400700 1 --2- 172.21.15.159:0/1674861238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c102e10 0x7f0a2c19e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:34.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.192+0000 7f0a2aa00700 1 -- 172.21.15.159:0/1674861238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c102e10 msgr2=0x7f0a2c19e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:34.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.192+0000 7f0a2aa00700 1 --2- 172.21.15.159:0/1674861238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c102e10 0x7f0a2c19e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.192+0000 7f0a2aa00700 1 -- 172.21.15.159:0/1674861238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1c0095f0 con 0x7f0a2c1037c0 2024-02-28T23:17:34.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.192+0000 7f0a2aa00700 1 --2- 172.21.15.159:0/1674861238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c1037c0 0x7f0a2c19eac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800e8f0 tx=0x7f0a1800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:34.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.192+0000 7f0a23e00700 1 -- 172.21.15.159:0/1674861238 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a18009790 con 0x7f0a2c1037c0 2024-02-28T23:17:34.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.192+0000 7f0a23e00700 1 -- 172.21.15.159:0/1674861238 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0a1800c810 con 0x7f0a2c1037c0 2024-02-28T23:17:34.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.192+0000 7f0a23e00700 1 -- 172.21.15.159:0/1674861238 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0a18005580 con 0x7f0a2c1037c0 2024-02-28T23:17:34.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.192+0000 7f0a31000700 1 -- 172.21.15.159:0/1674861238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c1988e0 con 0x7f0a2c1037c0 2024-02-28T23:17:34.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.192+0000 7f0a31000700 1 -- 172.21.15.159:0/1674861238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c198e30 con 0x7f0a2c1037c0 2024-02-28T23:17:34.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.193+0000 7f0a31000700 1 -- 172.21.15.159:0/1674861238 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2c10b1b0 con 0x7f0a2c1037c0 2024-02-28T23:17:34.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.194+0000 7f0a23e00700 1 -- 172.21.15.159:0/1674861238 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f0a1800c980 con 0x7f0a2c1037c0 2024-02-28T23:17:34.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.195+0000 7f0a23e00700 1 --2- 172.21.15.159:0/1674861238 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a1006d8a0 0x7f0a1006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:34.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.195+0000 7f0a23e00700 1 -- 172.21.15.159:0/1674861238 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f0a18014070 con 0x7f0a2c1037c0 2024-02-28T23:17:34.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.196+0000 7f0a2b400700 1 --2- 172.21.15.159:0/1674861238 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a1006d8a0 0x7f0a1006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:34.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.196+0000 7f0a2b400700 1 --2- 172.21.15.159:0/1674861238 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a1006d8a0 0x7f0a1006fd60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0059d0 tx=0x7f0a1c005940 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:34.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.200+0000 7f0a23e00700 1 -- 172.21.15.159:0/1674861238 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0a1805aaa0 con 0x7f0a2c1037c0 2024-02-28T23:17:34.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.424+0000 7f0a31000700 1 -- 172.21.15.159:0/1674861238 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a2c199190 con 0x7f0a1006d8a0 2024-02-28T23:17:34.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.426+0000 7f0a23e00700 1 -- 172.21.15.159:0/1674861238 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f0a2c199190 con 0x7f0a1006d8a0 2024-02-28T23:17:34.425 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:17:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:17:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:17:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:17:34.425 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:17:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-02-28T23:17:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:17:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:17:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:17:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "10/23 daemons upgraded", 2024-02-28T23:17:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T23:17:34.426 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:17:34.426 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:17:34.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.430+0000 7f0a31000700 1 -- 172.21.15.159:0/1674861238 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a1006d8a0 msgr2=0x7f0a1006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:34.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.430+0000 7f0a31000700 1 --2- 172.21.15.159:0/1674861238 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a1006d8a0 0x7f0a1006fd60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c0059d0 tx=0x7f0a1c005940 comp rx=0 tx=0).stop 2024-02-28T23:17:34.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.430+0000 7f0a31000700 1 -- 172.21.15.159:0/1674861238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c1037c0 msgr2=0x7f0a2c19eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:34.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.430+0000 7f0a31000700 1 --2- 172.21.15.159:0/1674861238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c1037c0 0x7f0a2c19eac0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800e8f0 tx=0x7f0a1800ec00 comp rx=0 tx=0).stop 2024-02-28T23:17:34.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.430+0000 7f0a31000700 1 -- 172.21.15.159:0/1674861238 shutdown_connections 2024-02-28T23:17:34.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.430+0000 7f0a31000700 1 --2- 172.21.15.159:0/1674861238 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0a2c102e10 0x7f0a2c19e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.430+0000 7f0a31000700 1 --2- 172.21.15.159:0/1674861238 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0a1006d8a0 0x7f0a1006fd60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.430+0000 7f0a31000700 1 --2- 172.21.15.159:0/1674861238 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a2c1037c0 0x7f0a2c19eac0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.430+0000 7f0a31000700 1 -- 172.21.15.159:0/1674861238 >> 172.21.15.159:0/1674861238 conn(0x7f0a2c0fe6c0 msgr2=0x7f0a2c0ffd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:34.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.430+0000 7f0a31000700 1 -- 172.21.15.159:0/1674861238 shutdown_connections 2024-02-28T23:17:34.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.430+0000 7f0a31000700 1 -- 172.21.15.159:0/1674861238 wait complete. 2024-02-28T23:17:34.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.582+0000 7ff35da00700 1 -- 172.21.15.159:0/3304317670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3581071d0 msgr2=0x7ff358107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:34.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.582+0000 7ff35da00700 1 --2- 172.21.15.159:0/3304317670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3581071d0 0x7ff358107650 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff344009910 tx=0x7ff344009c20 comp rx=0 tx=0).stop 2024-02-28T23:17:34.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.582+0000 7ff35da00700 1 -- 172.21.15.159:0/3304317670 shutdown_connections 2024-02-28T23:17:34.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.582+0000 7ff35da00700 1 --2- 172.21.15.159:0/3304317670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3581071d0 0x7ff358107650 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.582+0000 7ff35da00700 1 --2- 172.21.15.159:0/3304317670 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff35810d280 0x7ff35810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.582+0000 7ff35da00700 1 -- 172.21.15.159:0/3304317670 >> 172.21.15.159:0/3304317670 conn(0x7ff3580769e0 msgr2=0x7ff358078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:34.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.582+0000 7ff35da00700 1 -- 172.21.15.159:0/3304317670 shutdown_connections 2024-02-28T23:17:34.581 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.582+0000 7ff35da00700 1 -- 172.21.15.159:0/3304317670 wait complete. 2024-02-28T23:17:34.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.583+0000 7ff35da00700 1 Processor -- start 2024-02-28T23:17:34.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.583+0000 7ff35da00700 1 -- start start 2024-02-28T23:17:34.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.584+0000 7ff35da00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3581071d0 0x7ff35819ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:34.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.584+0000 7ff35da00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff35810d280 0x7ff35819d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:34.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.584+0000 7ff35da00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35819d880 con 0x7ff3581071d0 2024-02-28T23:17:34.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.584+0000 7ff35da00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3581a05b0 con 0x7ff35810d280 2024-02-28T23:17:34.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.584+0000 7ff356a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3581071d0 0x7ff35819ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:34.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.584+0000 7ff356a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3581071d0 0x7ff35819ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41026/0 (socket says 172.21.15.159:41026) 2024-02-28T23:17:34.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.584+0000 7ff356a00700 1 -- 172.21.15.159:0/2544572669 learned_addr learned my addr 172.21.15.159:0/2544572669 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:17:34.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.584+0000 7ff356000700 1 --2- 172.21.15.159:0/2544572669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff35810d280 0x7ff35819d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:34.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.584+0000 7ff356a00700 1 -- 172.21.15.159:0/2544572669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff35810d280 msgr2=0x7ff35819d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:34.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.584+0000 7ff356a00700 1 --2- 172.21.15.159:0/2544572669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff35810d280 0x7ff35819d1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.585+0000 7ff356a00700 1 -- 172.21.15.159:0/2544572669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3440095f0 con 0x7ff3581071d0 2024-02-28T23:17:34.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.585+0000 7ff356a00700 1 --2- 172.21.15.159:0/2544572669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3581071d0 0x7ff35819ccb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff34800e920 tx=0x7ff34800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:34.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.585+0000 7ff34f400700 1 -- 172.21.15.159:0/2544572669 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff348009790 con 0x7ff3581071d0 2024-02-28T23:17:34.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.585+0000 7ff34f400700 1 -- 172.21.15.159:0/2544572669 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff34800cba0 con 0x7ff3581071d0 2024-02-28T23:17:34.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.585+0000 7ff34f400700 1 -- 172.21.15.159:0/2544572669 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff348018650 con 0x7ff3581071d0 2024-02-28T23:17:34.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.585+0000 7ff35da00700 1 -- 172.21.15.159:0/2544572669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3581a0890 con 0x7ff3581071d0 2024-02-28T23:17:34.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.585+0000 7ff35da00700 1 -- 172.21.15.159:0/2544572669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3581a0e10 con 0x7ff3581071d0 2024-02-28T23:17:34.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.586+0000 7ff35da00700 1 -- 172.21.15.159:0/2544572669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35810f6c0 con 0x7ff3581071d0 2024-02-28T23:17:34.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.587+0000 7ff34f400700 1 -- 172.21.15.159:0/2544572669 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ff34800cd10 con 0x7ff3581071d0 2024-02-28T23:17:34.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.588+0000 7ff34f400700 1 --2- 172.21.15.159:0/2544572669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff33c06d8a0 0x7ff33c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:17:34.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.588+0000 7ff34f400700 1 -- 172.21.15.159:0/2544572669 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 6675+0+0 (secure 0 0 0) 0x7ff348014070 con 0x7ff3581071d0 2024-02-28T23:17:34.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.588+0000 7ff356000700 1 --2- 172.21.15.159:0/2544572669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff33c06d8a0 0x7ff33c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:17:34.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.589+0000 7ff356000700 1 --2- 172.21.15.159:0/2544572669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff33c06d8a0 0x7ff33c06fd60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff35819e290 tx=0x7ff344009f70 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:17:34.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.593+0000 7ff34f400700 1 -- 172.21.15.159:0/2544572669 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff348052d20 con 0x7ff3581071d0 2024-02-28T23:17:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:34 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2632315516' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:34 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded (PG_DEGRADED) 2024-02-28T23:17:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:34 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1817682621' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:17:34.772 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:34 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2632315516' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:34.772 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:34 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded (PG_DEGRADED) 2024-02-28T23:17:34.772 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:34 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1817682621' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:17:34.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.886+0000 7ff35da00700 1 -- 172.21.15.159:0/2544572669 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff35804ea90 con 0x7ff3581071d0 2024-02-28T23:17:34.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.887+0000 7ff34f400700 1 -- 172.21.15.159:0/2544572669 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1106 (secure 0 0 0) 0x7ff34805ac50 con 0x7ff3581071d0 2024-02-28T23:17:34.886 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: osd.4 (root=default,host=smithi184) is down 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 40/228 objects degraded (17.544%), 15 pgs degraded 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.5 is active+undersized+degraded, acting [2,0] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.6 is active+undersized+degraded, acting [1,0] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.7 is active+undersized+degraded, acting [0,2] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-02-28T23:17:34.887 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-02-28T23:17:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-02-28T23:17:34.888 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-02-28T23:17:34.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.890+0000 7ff35da00700 1 -- 172.21.15.159:0/2544572669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff33c06d8a0 msgr2=0x7ff33c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:34.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.890+0000 7ff35da00700 1 --2- 172.21.15.159:0/2544572669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff33c06d8a0 0x7ff33c06fd60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff35819e290 tx=0x7ff344009f70 comp rx=0 tx=0).stop 2024-02-28T23:17:34.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.890+0000 7ff35da00700 1 -- 172.21.15.159:0/2544572669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3581071d0 msgr2=0x7ff35819ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:17:34.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.890+0000 7ff35da00700 1 --2- 172.21.15.159:0/2544572669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3581071d0 0x7ff35819ccb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff34800e920 tx=0x7ff34800ece0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.890+0000 7ff35da00700 1 -- 172.21.15.159:0/2544572669 shutdown_connections 2024-02-28T23:17:34.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.890+0000 7ff35da00700 1 --2- 172.21.15.159:0/2544572669 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff33c06d8a0 0x7ff33c06fd60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.890+0000 7ff35da00700 1 --2- 172.21.15.159:0/2544572669 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3581071d0 0x7ff35819ccb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.890+0000 7ff35da00700 1 --2- 172.21.15.159:0/2544572669 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff35810d280 0x7ff35819d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:17:34.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.890+0000 7ff35da00700 1 -- 172.21.15.159:0/2544572669 >> 172.21.15.159:0/2544572669 conn(0x7ff3580769e0 msgr2=0x7ff358078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:17:34.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.890+0000 7ff35da00700 1 -- 172.21.15.159:0/2544572669 shutdown_connections 2024-02-28T23:17:34.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:17:34.891+0000 7ff35da00700 1 -- 172.21.15.159:0/2544572669 wait complete. 2024-02-28T23:17:36.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:35 smithi184 ceph-mon[86482]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:36.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:36.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:35 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:36.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:35 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2544572669' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:17:36.062 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:35 smithi184 ceph-mon[86482]: pgmap v183: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 850 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-02-28T23:17:36.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:35 smithi159 ceph-mon[113833]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:17:36.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:36.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:35 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:36.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:35 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2544572669' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:17:36.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:35 smithi159 ceph-mon[113833]: pgmap v183: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 209 MiB data, 1.0 GiB used, 535 GiB / 536 GiB avail; 850 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-02-28T23:17:36.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:36 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:17:36.062+0000 7f4514f7a7c0 -1 osd.4 0 read_superblock omap replica is missing. 2024-02-28T23:17:37.100 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:36 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:17:36.604+0000 7f4514f7a7c0 -1 osd.4 86 log_to_monitors true 2024-02-28T23:17:37.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:36 smithi184 ceph-mon[86482]: from='osd.4 [v2:172.21.15.184:6808/1173196285,v1:172.21.15.184:6809/1173196285]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T23:17:37.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:36 smithi184 ceph-mon[86482]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T23:17:37.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:36 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:37.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:36 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:37.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:36 smithi159 ceph-mon[113833]: from='osd.4 [v2:172.21.15.184:6808/1173196285,v1:172.21.15.184:6809/1173196285]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T23:17:37.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:36 smithi159 ceph-mon[113833]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-28T23:17:37.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:36 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:37.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:36 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:38.100 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:17:37 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:17:37.814+0000 7f44ff400700 -1 osd.4 86 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T23:17:38.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:37 smithi184 ceph-mon[86482]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T23:17:38.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:37 smithi184 ceph-mon[86482]: from='osd.4 [v2:172.21.15.184:6808/1173196285,v1:172.21.15.184:6809/1173196285]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:17:38.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:37 smithi184 ceph-mon[86482]: osdmap e89: 6 total, 5 up, 6 in 2024-02-28T23:17:38.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:37 smithi184 ceph-mon[86482]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:17:38.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:37 smithi184 ceph-mon[86482]: pgmap v185: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 209 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-02-28T23:17:38.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:37 smithi159 ceph-mon[113833]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-28T23:17:38.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:37 smithi159 ceph-mon[113833]: from='osd.4 [v2:172.21.15.184:6808/1173196285,v1:172.21.15.184:6809/1173196285]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:17:38.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:37 smithi159 ceph-mon[113833]: osdmap e89: 6 total, 5 up, 6 in 2024-02-28T23:17:38.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:37 smithi159 ceph-mon[113833]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:17:38.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:37 smithi159 ceph-mon[113833]: pgmap v185: 65 pgs: 17 active+undersized, 15 active+undersized+degraded, 33 active+clean; 209 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 40/228 objects degraded (17.544%) 2024-02-28T23:17:38.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:38 smithi159 ceph-mon[113833]: from='osd.4 ' entity='osd.4' 2024-02-28T23:17:38.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:38.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:17:39.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:38 smithi184 ceph-mon[86482]: from='osd.4 ' entity='osd.4' 2024-02-28T23:17:39.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:39.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:17:40.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:39 smithi184 ceph-mon[86482]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:17:40.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:39 smithi184 ceph-mon[86482]: osd.4 [v2:172.21.15.184:6808/1173196285,v1:172.21.15.184:6809/1173196285] boot 2024-02-28T23:17:40.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:39 smithi184 ceph-mon[86482]: osdmap e90: 6 total, 6 up, 6 in 2024-02-28T23:17:40.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:39 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:17:40.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:39 smithi184 ceph-mon[86482]: pgmap v187: 65 pgs: 3 peering, 15 active+undersized, 14 active+undersized+degraded, 33 active+clean; 209 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:17:40.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:39 smithi159 ceph-mon[113833]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:17:40.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:39 smithi159 ceph-mon[113833]: osd.4 [v2:172.21.15.184:6808/1173196285,v1:172.21.15.184:6809/1173196285] boot 2024-02-28T23:17:40.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:39 smithi159 ceph-mon[113833]: osdmap e90: 6 total, 6 up, 6 in 2024-02-28T23:17:40.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:39 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-28T23:17:40.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:39 smithi159 ceph-mon[113833]: pgmap v187: 65 pgs: 3 peering, 15 active+undersized, 14 active+undersized+degraded, 33 active+clean; 209 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:17:41.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:40 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 35/228 objects degraded (15.351%), 14 pgs degraded (PG_DEGRADED) 2024-02-28T23:17:41.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:40 smithi184 ceph-mon[86482]: osdmap e91: 6 total, 6 up, 6 in 2024-02-28T23:17:41.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:40 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 35/228 objects degraded (15.351%), 14 pgs degraded (PG_DEGRADED) 2024-02-28T23:17:41.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:40 smithi159 ceph-mon[113833]: osdmap e91: 6 total, 6 up, 6 in 2024-02-28T23:17:42.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:41 smithi184 ceph-mon[86482]: pgmap v189: 65 pgs: 8 peering, 12 active+undersized, 9 active+undersized+degraded, 36 active+clean; 209 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 2 op/s; 26/228 objects degraded (11.404%) 2024-02-28T23:17:42.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:41 smithi159 ceph-mon[113833]: pgmap v189: 65 pgs: 8 peering, 12 active+undersized, 9 active+undersized+degraded, 36 active+clean; 209 MiB data, 966 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 2 op/s; 26/228 objects degraded (11.404%) 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T23:17:42.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:42 smithi159 ceph-mon[113833]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-02-28T23:17:43.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:43.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:43.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:17:43.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:17:43.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:43.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:17:43.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:43.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:43.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:17:43.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T23:17:43.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T23:17:43.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:42 smithi184 ceph-mon[86482]: Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-02-28T23:17:44.224 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:43 smithi159 ceph-mon[113833]: pgmap v190: 65 pgs: 8 peering, 57 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 320 B/s rd, 0 op/s 2024-02-28T23:17:44.252 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:43 smithi184 ceph-mon[86482]: pgmap v190: 65 pgs: 8 peering, 57 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 320 B/s rd, 0 op/s 2024-02-28T23:17:45.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:44 smithi159 ceph-mon[113833]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/228 objects degraded (11.404%), 9 pgs degraded) 2024-02-28T23:17:45.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:44 smithi159 ceph-mon[113833]: Cluster is now healthy 2024-02-28T23:17:45.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:44 smithi184 ceph-mon[86482]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 26/228 objects degraded (11.404%), 9 pgs degraded) 2024-02-28T23:17:45.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:44 smithi184 ceph-mon[86482]: Cluster is now healthy 2024-02-28T23:17:46.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:45 smithi184 ceph-mon[86482]: pgmap v191: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-02-28T23:17:46.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:45 smithi159 ceph-mon[113833]: pgmap v191: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 255 B/s rd, 0 op/s 2024-02-28T23:17:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:48 smithi184 ceph-mon[86482]: pgmap v192: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 858 B/s rd, 1 op/s 2024-02-28T23:17:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:48 smithi159 ceph-mon[113833]: pgmap v192: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 858 B/s rd, 1 op/s 2024-02-28T23:17:50.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:50 smithi184 ceph-mon[86482]: pgmap v193: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s 2024-02-28T23:17:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:50 smithi159 ceph-mon[113833]: pgmap v193: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 716 B/s rd, 1 op/s 2024-02-28T23:17:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:52 smithi184 ceph-mon[86482]: pgmap v194: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 632 B/s rd, 1 op/s 2024-02-28T23:17:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:52 smithi159 ceph-mon[113833]: pgmap v194: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 632 B/s rd, 1 op/s 2024-02-28T23:17:54.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:54.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:17:54.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:54 smithi159 ceph-mon[113833]: pgmap v195: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-02-28T23:17:54.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:17:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:54 smithi184 ceph-mon[86482]: pgmap v195: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s 2024-02-28T23:17:54.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:17:56.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:56 smithi184 ceph-mon[86482]: pgmap v196: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:17:56.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:56 smithi159 ceph-mon[113833]: pgmap v196: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:17:58.565 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:58 smithi184 ceph-mon[86482]: pgmap v197: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:17:58.565 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:58 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T23:17:58.565 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:58 smithi184 ceph-mon[86482]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T23:17:58.566 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:17:58 smithi184 ceph-mon[86482]: Upgrade: osd.5 is safe to restart 2024-02-28T23:17:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:58 smithi159 ceph-mon[113833]: pgmap v197: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:17:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:58 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T23:17:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:58 smithi159 ceph-mon[113833]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-28T23:17:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:17:58 smithi159 ceph-mon[113833]: Upgrade: osd.5 is safe to restart 2024-02-28T23:18:00.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:00 smithi184 ceph-mon[86482]: pgmap v198: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:18:00.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:00.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T23:18:00.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:00 smithi159 ceph-mon[113833]: pgmap v198: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:18:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:00.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-28T23:18:00.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:01.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:01 smithi184 ceph-mon[86482]: Upgrade: Updating osd.5 2024-02-28T23:18:01.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:01 smithi184 ceph-mon[86482]: Deploying daemon osd.5 on smithi184 2024-02-28T23:18:01.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:01 smithi159 ceph-mon[113833]: Upgrade: Updating osd.5 2024-02-28T23:18:01.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:01 smithi159 ceph-mon[113833]: Deploying daemon osd.5 on smithi184 2024-02-28T23:18:02.410 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:02 smithi184 ceph-mon[86482]: pgmap v199: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:18:02.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:02 smithi159 ceph-mon[113833]: pgmap v199: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:18:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:04 smithi184 ceph-mon[86482]: pgmap v200: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:18:04.601 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:04 smithi184 systemd[1]: Stopping Ceph osd.5 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:18:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:04 smithi159 ceph-mon[113833]: pgmap v200: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:18:05.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.063+0000 7f3036800700 1 -- 172.21.15.159:0/381532414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3030102fe0 msgr2=0x7f30301033c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:05.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.063+0000 7f3036800700 1 --2- 172.21.15.159:0/381532414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3030102fe0 0x7f30301033c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f3020009910 tx=0x7f3020009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:05.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.063+0000 7f3036800700 1 -- 172.21.15.159:0/381532414 shutdown_connections 2024-02-28T23:18:05.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.063+0000 7f3036800700 1 --2- 172.21.15.159:0/381532414 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3030103990 0x7f30301079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.063+0000 7f3036800700 1 --2- 172.21.15.159:0/381532414 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3030102fe0 0x7f30301033c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.063+0000 7f3036800700 1 -- 172.21.15.159:0/381532414 >> 172.21.15.159:0/381532414 conn(0x7f30300fe8d0 msgr2=0x7f3030100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:05.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.063+0000 7f3036800700 1 -- 172.21.15.159:0/381532414 shutdown_connections 2024-02-28T23:18:05.063 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.063+0000 7f3036800700 1 -- 172.21.15.159:0/381532414 wait complete. 2024-02-28T23:18:05.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.064+0000 7f3036800700 1 Processor -- start 2024-02-28T23:18:05.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.064+0000 7f3036800700 1 -- start start 2024-02-28T23:18:05.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.065+0000 7f3036800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3030102fe0 0x7f30301989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:05.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.065+0000 7f3036800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3030103990 0x7f3030198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:05.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.065+0000 7f3036800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3030199570 con 0x7f3030102fe0 2024-02-28T23:18:05.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.065+0000 7f3036800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303019d380 con 0x7f3030103990 2024-02-28T23:18:05.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.065+0000 7f302f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3030102fe0 0x7f30301989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:05.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.065+0000 7f302f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3030102fe0 0x7f30301989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49690/0 (socket says 172.21.15.159:49690) 2024-02-28T23:18:05.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.065+0000 7f302f400700 1 -- 172.21.15.159:0/1686740223 learned_addr learned my addr 172.21.15.159:0/1686740223 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:05.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.065+0000 7f302ea00700 1 --2- 172.21.15.159:0/1686740223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3030103990 0x7f3030198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:05.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.066+0000 7f302f400700 1 -- 172.21.15.159:0/1686740223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3030103990 msgr2=0x7f3030198ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:05.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.066+0000 7f302f400700 1 --2- 172.21.15.159:0/1686740223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3030103990 0x7f3030198ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.066+0000 7f302f400700 1 -- 172.21.15.159:0/1686740223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30200095f0 con 0x7f3030102fe0 2024-02-28T23:18:05.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.066+0000 7f302f400700 1 --2- 172.21.15.159:0/1686740223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3030102fe0 0x7f30301989a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f30200092e0 tx=0x7f302000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:05.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.066+0000 7f3027e00700 1 -- 172.21.15.159:0/1686740223 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f302001d070 con 0x7f3030102fe0 2024-02-28T23:18:05.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.066+0000 7f3027e00700 1 -- 172.21.15.159:0/1686740223 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3020005e00 con 0x7f3030102fe0 2024-02-28T23:18:05.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.066+0000 7f3036800700 1 -- 172.21.15.159:0/1686740223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303019d600 con 0x7f3030102fe0 2024-02-28T23:18:05.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.066+0000 7f3027e00700 1 -- 172.21.15.159:0/1686740223 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3020017400 con 0x7f3030102fe0 2024-02-28T23:18:05.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.067+0000 7f3036800700 1 -- 172.21.15.159:0/1686740223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303019daf0 con 0x7f3030102fe0 2024-02-28T23:18:05.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.068+0000 7f3036800700 1 -- 172.21.15.159:0/1686740223 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303010b380 con 0x7f3030102fe0 2024-02-28T23:18:05.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.069+0000 7f3027e00700 1 -- 172.21.15.159:0/1686740223 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f302000f460 con 0x7f3030102fe0 2024-02-28T23:18:05.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.070+0000 7f3027e00700 1 --2- 172.21.15.159:0/1686740223 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f301406d8a0 0x7f301406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:05.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.070+0000 7f3027e00700 1 -- 172.21.15.159:0/1686740223 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f302008eb60 con 0x7f3030102fe0 2024-02-28T23:18:05.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.071+0000 7f302ea00700 1 --2- 172.21.15.159:0/1686740223 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f301406d8a0 0x7f301406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:05.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.072+0000 7f302ea00700 1 --2- 172.21.15.159:0/1686740223 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f301406d8a0 0x7f301406fd60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f301c005950 tx=0x7f301c0058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:05.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.076+0000 7f3027e00700 1 -- 172.21.15.159:0/1686740223 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f302005bd40 con 0x7f3030102fe0 2024-02-28T23:18:05.100 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:04 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[55763]: 2024-02-28T23:18:04.745+0000 7fdb20e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:18:05.100 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:04 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[55763]: 2024-02-28T23:18:04.745+0000 7fdb20e00700 -1 osd.5 91 *** Got signal Terminated *** 2024-02-28T23:18:05.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:04 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[55763]: 2024-02-28T23:18:04.745+0000 7fdb20e00700 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:18:05.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.327+0000 7f3036800700 1 -- 172.21.15.159:0/1686740223 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f303019ddd0 con 0x7f301406d8a0 2024-02-28T23:18:05.326 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:05 smithi159 ceph-mon[113833]: osd.5 marked itself down and dead 2024-02-28T23:18:05.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.330+0000 7f3027e00700 1 -- 172.21.15.159:0/1686740223 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f303019ddd0 con 0x7f301406d8a0 2024-02-28T23:18:05.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.333+0000 7f3036800700 1 -- 172.21.15.159:0/1686740223 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f301406d8a0 msgr2=0x7f301406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:05.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.333+0000 7f3036800700 1 --2- 172.21.15.159:0/1686740223 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f301406d8a0 0x7f301406fd60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f301c005950 tx=0x7f301c0058e0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.333+0000 7f3036800700 1 -- 172.21.15.159:0/1686740223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3030102fe0 msgr2=0x7f30301989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:05.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.333+0000 7f3036800700 1 --2- 172.21.15.159:0/1686740223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3030102fe0 0x7f30301989a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f30200092e0 tx=0x7f302000be20 comp rx=0 tx=0).stop 2024-02-28T23:18:05.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.333+0000 7f3036800700 1 -- 172.21.15.159:0/1686740223 shutdown_connections 2024-02-28T23:18:05.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.333+0000 7f3036800700 1 --2- 172.21.15.159:0/1686740223 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f301406d8a0 0x7f301406fd60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.333+0000 7f3036800700 1 --2- 172.21.15.159:0/1686740223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3030102fe0 0x7f30301989a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.333+0000 7f3036800700 1 --2- 172.21.15.159:0/1686740223 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3030103990 0x7f3030198ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.333+0000 7f3036800700 1 -- 172.21.15.159:0/1686740223 >> 172.21.15.159:0/1686740223 conn(0x7f30300fe8d0 msgr2=0x7f30300fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:05.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.334+0000 7f3036800700 1 -- 172.21.15.159:0/1686740223 shutdown_connections 2024-02-28T23:18:05.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.334+0000 7f3036800700 1 -- 172.21.15.159:0/1686740223 wait complete. 2024-02-28T23:18:05.347 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:18:05.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.487+0000 7f7e29600700 1 -- 172.21.15.159:0/1800955270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e24103970 msgr2=0x7f7e241079c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:05.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.487+0000 7f7e29600700 1 --2- 172.21.15.159:0/1800955270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e24103970 0x7f7e241079c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c009910 tx=0x7f7e0c009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:05.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.487+0000 7f7e29600700 1 -- 172.21.15.159:0/1800955270 shutdown_connections 2024-02-28T23:18:05.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.487+0000 7f7e29600700 1 --2- 172.21.15.159:0/1800955270 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e24103970 0x7f7e241079c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.487+0000 7f7e29600700 1 --2- 172.21.15.159:0/1800955270 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e24102fc0 0x7f7e241033a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.487+0000 7f7e29600700 1 -- 172.21.15.159:0/1800955270 >> 172.21.15.159:0/1800955270 conn(0x7f7e240fe870 msgr2=0x7f7e24100c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:05.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.487+0000 7f7e29600700 1 -- 172.21.15.159:0/1800955270 shutdown_connections 2024-02-28T23:18:05.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.487+0000 7f7e29600700 1 -- 172.21.15.159:0/1800955270 wait complete. 2024-02-28T23:18:05.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.488+0000 7f7e29600700 1 Processor -- start 2024-02-28T23:18:05.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.489+0000 7f7e29600700 1 -- start start 2024-02-28T23:18:05.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.489+0000 7f7e29600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e24102fc0 0x7f7e2419e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:05.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.489+0000 7f7e29600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e24103970 0x7f7e2419ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:05.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.489+0000 7f7e29600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2419f490 con 0x7f7e24102fc0 2024-02-28T23:18:05.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.489+0000 7f7e29600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e24198940 con 0x7f7e24103970 2024-02-28T23:18:05.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.489+0000 7f7e22a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e24102fc0 0x7f7e2419e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:05.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.489+0000 7f7e22a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e24102fc0 0x7f7e2419e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49720/0 (socket says 172.21.15.159:49720) 2024-02-28T23:18:05.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.489+0000 7f7e22a00700 1 -- 172.21.15.159:0/1230754977 learned_addr learned my addr 172.21.15.159:0/1230754977 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:05.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.490+0000 7f7e22a00700 1 -- 172.21.15.159:0/1230754977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e24103970 msgr2=0x7f7e2419ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:05.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.490+0000 7f7e22a00700 1 --2- 172.21.15.159:0/1230754977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e24103970 0x7f7e2419ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.490+0000 7f7e22a00700 1 -- 172.21.15.159:0/1230754977 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0095f0 con 0x7f7e24102fc0 2024-02-28T23:18:05.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.490+0000 7f7e22a00700 1 --2- 172.21.15.159:0/1230754977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e24102fc0 0x7f7e2419e8c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400b4b0 tx=0x7f7e1400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:05.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.490+0000 7f7e1be00700 1 -- 172.21.15.159:0/1230754977 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e14011800 con 0x7f7e24102fc0 2024-02-28T23:18:05.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.490+0000 7f7e1be00700 1 -- 172.21.15.159:0/1230754977 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7e14011e20 con 0x7f7e24102fc0 2024-02-28T23:18:05.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.490+0000 7f7e29600700 1 -- 172.21.15.159:0/1230754977 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e24198c20 con 0x7f7e24102fc0 2024-02-28T23:18:05.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.490+0000 7f7e1be00700 1 -- 172.21.15.159:0/1230754977 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e1400f2e0 con 0x7f7e24102fc0 2024-02-28T23:18:05.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.490+0000 7f7e29600700 1 -- 172.21.15.159:0/1230754977 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e24199170 con 0x7f7e24102fc0 2024-02-28T23:18:05.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.492+0000 7f7e29600700 1 -- 172.21.15.159:0/1230754977 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2410b2f0 con 0x7f7e24102fc0 2024-02-28T23:18:05.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.492+0000 7f7e1be00700 1 -- 172.21.15.159:0/1230754977 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f7e14010380 con 0x7f7e24102fc0 2024-02-28T23:18:05.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.494+0000 7f7e1be00700 1 --2- 172.21.15.159:0/1230754977 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7e0806d8a0 0x7f7e0806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:05.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.494+0000 7f7e1be00700 1 -- 172.21.15.159:0/1230754977 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f7e1408d150 con 0x7f7e24102fc0 2024-02-28T23:18:05.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.494+0000 7f7e1a000700 1 --2- 172.21.15.159:0/1230754977 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7e0806d8a0 0x7f7e0806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:05.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.495+0000 7f7e1a000700 1 --2- 172.21.15.159:0/1230754977 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7e0806d8a0 0x7f7e0806fd60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00b5c0 tx=0x7f7e0c005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:05.497 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.499+0000 7f7e1be00700 1 -- 172.21.15.159:0/1230754977 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7e1405a460 con 0x7f7e24102fc0 2024-02-28T23:18:05.530 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:05 smithi184 ceph-mon[86482]: osd.5 marked itself down and dead 2024-02-28T23:18:05.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.736+0000 7f7e29600700 1 -- 172.21.15.159:0/1230754977 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e241994b0 con 0x7f7e0806d8a0 2024-02-28T23:18:05.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.739+0000 7f7e1be00700 1 -- 172.21.15.159:0/1230754977 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7e241994b0 con 0x7f7e0806d8a0 2024-02-28T23:18:05.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.741+0000 7f7e29600700 1 -- 172.21.15.159:0/1230754977 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7e0806d8a0 msgr2=0x7f7e0806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:05.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.741+0000 7f7e29600700 1 --2- 172.21.15.159:0/1230754977 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7e0806d8a0 0x7f7e0806fd60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00b5c0 tx=0x7f7e0c005fd0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.741+0000 7f7e29600700 1 -- 172.21.15.159:0/1230754977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e24102fc0 msgr2=0x7f7e2419e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:05.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.741+0000 7f7e29600700 1 --2- 172.21.15.159:0/1230754977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e24102fc0 0x7f7e2419e8c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400b4b0 tx=0x7f7e1400b870 comp rx=0 tx=0).stop 2024-02-28T23:18:05.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.742+0000 7f7e29600700 1 -- 172.21.15.159:0/1230754977 shutdown_connections 2024-02-28T23:18:05.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.742+0000 7f7e29600700 1 --2- 172.21.15.159:0/1230754977 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7e0806d8a0 0x7f7e0806fd60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.742+0000 7f7e29600700 1 --2- 172.21.15.159:0/1230754977 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e24102fc0 0x7f7e2419e8c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.742+0000 7f7e29600700 1 --2- 172.21.15.159:0/1230754977 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7e24103970 0x7f7e2419ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.742+0000 7f7e29600700 1 -- 172.21.15.159:0/1230754977 >> 172.21.15.159:0/1230754977 conn(0x7f7e240fe870 msgr2=0x7f7e240fffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:05.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.742+0000 7f7e29600700 1 -- 172.21.15.159:0/1230754977 shutdown_connections 2024-02-28T23:18:05.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.742+0000 7f7e29600700 1 -- 172.21.15.159:0/1230754977 wait complete. 2024-02-28T23:18:05.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.885+0000 7fa473200700 1 -- 172.21.15.159:0/2048053821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c100da0 msgr2=0x7fa46c101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:05.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.885+0000 7fa473200700 1 --2- 172.21.15.159:0/2048053821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c100da0 0x7fa46c101180 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009910 tx=0x7fa45c009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:05.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.885+0000 7fa473200700 1 -- 172.21.15.159:0/2048053821 shutdown_connections 2024-02-28T23:18:05.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.885+0000 7fa473200700 1 --2- 172.21.15.159:0/2048053821 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa46c101750 0x7fa46c1057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.885+0000 7fa473200700 1 --2- 172.21.15.159:0/2048053821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c100da0 0x7fa46c101180 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.885+0000 7fa473200700 1 -- 172.21.15.159:0/2048053821 >> 172.21.15.159:0/2048053821 conn(0x7fa46c0fc630 msgr2=0x7fa46c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:05.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.885+0000 7fa473200700 1 -- 172.21.15.159:0/2048053821 shutdown_connections 2024-02-28T23:18:05.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.885+0000 7fa473200700 1 -- 172.21.15.159:0/2048053821 wait complete. 2024-02-28T23:18:05.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.886+0000 7fa473200700 1 Processor -- start 2024-02-28T23:18:05.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.886+0000 7fa473200700 1 -- start start 2024-02-28T23:18:05.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.886+0000 7fa473200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c100da0 0x7fa46c073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:05.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.886+0000 7fa473200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa46c101750 0x7fa46c0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:05.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.886+0000 7fa473200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c073b10 con 0x7fa46c100da0 2024-02-28T23:18:05.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.886+0000 7fa473200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c073c50 con 0x7fa46c101750 2024-02-28T23:18:05.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.887+0000 7fa46be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c100da0 0x7fa46c073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:05.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.887+0000 7fa46be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c100da0 0x7fa46c073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49738/0 (socket says 172.21.15.159:49738) 2024-02-28T23:18:05.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.887+0000 7fa46be00700 1 -- 172.21.15.159:0/1671307634 learned_addr learned my addr 172.21.15.159:0/1671307634 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:05.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.887+0000 7fa46be00700 1 -- 172.21.15.159:0/1671307634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa46c101750 msgr2=0x7fa46c0735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:05.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.887+0000 7fa46be00700 1 --2- 172.21.15.159:0/1671307634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa46c101750 0x7fa46c0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:05.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.887+0000 7fa46be00700 1 -- 172.21.15.159:0/1671307634 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c0095f0 con 0x7fa46c100da0 2024-02-28T23:18:05.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.887+0000 7fa46be00700 1 --2- 172.21.15.159:0/1671307634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c100da0 0x7fa46c073090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00b5c0 tx=0x7fa45c00be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:05.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.888+0000 7fa468c00700 1 -- 172.21.15.159:0/1671307634 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa45c01d070 con 0x7fa46c100da0 2024-02-28T23:18:05.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.888+0000 7fa468c00700 1 -- 172.21.15.159:0/1671307634 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa45c00f460 con 0x7fa46c100da0 2024-02-28T23:18:05.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.888+0000 7fa468c00700 1 -- 172.21.15.159:0/1671307634 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa45c017610 con 0x7fa46c100da0 2024-02-28T23:18:05.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.888+0000 7fa473200700 1 -- 172.21.15.159:0/1671307634 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c073ed0 con 0x7fa46c100da0 2024-02-28T23:18:05.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.888+0000 7fa473200700 1 -- 172.21.15.159:0/1671307634 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c1a2d70 con 0x7fa46c100da0 2024-02-28T23:18:05.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.889+0000 7fa473200700 1 -- 172.21.15.159:0/1671307634 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c109140 con 0x7fa46c100da0 2024-02-28T23:18:05.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.890+0000 7fa468c00700 1 -- 172.21.15.159:0/1671307634 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa45c00f5d0 con 0x7fa46c100da0 2024-02-28T23:18:05.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.891+0000 7fa468c00700 1 --2- 172.21.15.159:0/1671307634 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa45006d8a0 0x7fa45006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:05.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.891+0000 7fa468c00700 1 -- 172.21.15.159:0/1671307634 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fa45c08eaf0 con 0x7fa46c100da0 2024-02-28T23:18:05.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.891+0000 7fa46b400700 1 --2- 172.21.15.159:0/1671307634 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa45006d8a0 0x7fa45006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:05.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.892+0000 7fa46b400700 1 --2- 172.21.15.159:0/1671307634 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa45006d8a0 0x7fa45006fd60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa46c074880 tx=0x7fa458006d20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:05.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:05.896+0000 7fa468c00700 1 -- 172.21.15.159:0/1671307634 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa45c0582c0 con 0x7fa46c100da0 2024-02-28T23:18:06.100 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:05 smithi184 podman[105879]: 2024-02-28 23:18:05.833858651 +0000 UTC m=+1.220855885 container died f9b09e5af5276ad8204a5fa8a9f17b85fda44a8a94a8883c0b8d16917e9d3532 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5, RELEASE=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=-18.2.1, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.29.1, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-28T23:18:06.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.123+0000 7fa473200700 1 -- 172.21.15.159:0/1671307634 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa46c02cce0 con 0x7fa45006d8a0 2024-02-28T23:18:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.137+0000 7fa468c00700 1 -- 172.21.15.159:0/1671307634 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fa46c02cce0 con 0x7fa45006d8a0 2024-02-28T23:18:06.135 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (7m) 99s ago 21m 13.9M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (22m) 99s ago 22m 8988k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (20m) 31s ago 20m 8430k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (3m) 99s ago 22m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (3m) 31s ago 20m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (6m) 99s ago 21m 73.5M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (14m) 99s ago 14m 147M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (14m) 99s ago 14m 86.9M - 18.2.1 5be31c24972a 11973cddcdb6 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (14m) 31s ago 14m 18.8M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (14m) 31s ago 14m 18.7M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (10m) 99s ago 23m 502M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (9m) 31s ago 20m 451M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (5m) 99s ago 23m 48.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:18:06.136 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (4m) 31s ago 20m 35.1M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:18:06.137 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (8m) 99s ago 22m 7884k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:18:06.137 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (8m) 31s ago 20m 7801k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:18:06.137 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (3m) 99s ago 19m 114M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:18:06.137 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (2m) 99s ago 18m 97.5M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9120e23d80c0 2024-02-28T23:18:06.137 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (107s) 99s ago 18m 11.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 952e59c58165 2024-02-28T23:18:06.137 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (77s) 31s ago 17m 100M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 643ebdb823be 2024-02-28T23:18:06.137 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (36s) 31s ago 17m 11.1M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b dc8cef678e65 2024-02-28T23:18:06.137 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (16m) 31s ago 16m 267M 2241M 18.2.1 5be31c24972a f9b09e5af527 2024-02-28T23:18:06.137 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (8m) 99s ago 21m 55.0M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:18:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.139+0000 7fa473200700 1 -- 172.21.15.159:0/1671307634 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa45006d8a0 msgr2=0x7fa45006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.139+0000 7fa473200700 1 --2- 172.21.15.159:0/1671307634 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa45006d8a0 0x7fa45006fd60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa46c074880 tx=0x7fa458006d20 comp rx=0 tx=0).stop 2024-02-28T23:18:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.139+0000 7fa473200700 1 -- 172.21.15.159:0/1671307634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c100da0 msgr2=0x7fa46c073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.139+0000 7fa473200700 1 --2- 172.21.15.159:0/1671307634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c100da0 0x7fa46c073090 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa45c00b5c0 tx=0x7fa45c00be00 comp rx=0 tx=0).stop 2024-02-28T23:18:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.140+0000 7fa473200700 1 -- 172.21.15.159:0/1671307634 shutdown_connections 2024-02-28T23:18:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.140+0000 7fa473200700 1 --2- 172.21.15.159:0/1671307634 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa45006d8a0 0x7fa45006fd60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.140+0000 7fa473200700 1 --2- 172.21.15.159:0/1671307634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa46c100da0 0x7fa46c073090 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.140+0000 7fa473200700 1 --2- 172.21.15.159:0/1671307634 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa46c101750 0x7fa46c0735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.140+0000 7fa473200700 1 -- 172.21.15.159:0/1671307634 >> 172.21.15.159:0/1671307634 conn(0x7fa46c0fc630 msgr2=0x7fa46c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.140+0000 7fa473200700 1 -- 172.21.15.159:0/1671307634 shutdown_connections 2024-02-28T23:18:06.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.140+0000 7fa473200700 1 -- 172.21.15.159:0/1671307634 wait complete. 2024-02-28T23:18:06.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.282+0000 7fac33a00700 1 -- 172.21.15.159:0/2671120138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c073ae0 msgr2=0x7fac2c10ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:06.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.282+0000 7fac33a00700 1 --2- 172.21.15.159:0/2671120138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c073ae0 0x7fac2c10ce40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fac18009910 tx=0x7fac18009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:06.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.282+0000 7fac33a00700 1 -- 172.21.15.159:0/2671120138 shutdown_connections 2024-02-28T23:18:06.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.282+0000 7fac33a00700 1 --2- 172.21.15.159:0/2671120138 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c073ae0 0x7fac2c10ce40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.282+0000 7fac33a00700 1 --2- 172.21.15.159:0/2671120138 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0731c0 0x7fac2c0735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.282+0000 7fac33a00700 1 -- 172.21.15.159:0/2671120138 >> 172.21.15.159:0/2671120138 conn(0x7fac2c0fc630 msgr2=0x7fac2c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:06.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.282+0000 7fac33a00700 1 -- 172.21.15.159:0/2671120138 shutdown_connections 2024-02-28T23:18:06.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.282+0000 7fac33a00700 1 -- 172.21.15.159:0/2671120138 wait complete. 2024-02-28T23:18:06.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.283+0000 7fac33a00700 1 Processor -- start 2024-02-28T23:18:06.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.283+0000 7fac33a00700 1 -- start start 2024-02-28T23:18:06.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.283+0000 7fac33a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0731c0 0x7fac2c198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:06.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.283+0000 7fac33a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c073ae0 0x7fac2c198ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:06.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.283+0000 7fac33a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c199530 con 0x7fac2c073ae0 2024-02-28T23:18:06.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.283+0000 7fac33a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c19d340 con 0x7fac2c0731c0 2024-02-28T23:18:06.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.284+0000 7fac2be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c073ae0 0x7fac2c198ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:06.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.284+0000 7fac2be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c073ae0 0x7fac2c198ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49750/0 (socket says 172.21.15.159:49750) 2024-02-28T23:18:06.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.284+0000 7fac2be00700 1 -- 172.21.15.159:0/3018173304 learned_addr learned my addr 172.21.15.159:0/3018173304 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:06.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.284+0000 7fac31000700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0731c0 0x7fac2c198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:06.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.284+0000 7fac2be00700 1 -- 172.21.15.159:0/3018173304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0731c0 msgr2=0x7fac2c198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:06.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.284+0000 7fac2be00700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0731c0 0x7fac2c198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.284+0000 7fac2be00700 1 -- 172.21.15.159:0/3018173304 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac180095f0 con 0x7fac2c073ae0 2024-02-28T23:18:06.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.284+0000 7fac31000700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0731c0 0x7fac2c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:18:06.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.285+0000 7fac2be00700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c073ae0 0x7fac2c198ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac180092e0 tx=0x7fac1800be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:06.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.287+0000 7fac29600700 1 -- 172.21.15.159:0/3018173304 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac1801d070 con 0x7fac2c073ae0 2024-02-28T23:18:06.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.288+0000 7fac29600700 1 -- 172.21.15.159:0/3018173304 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fac1800f460 con 0x7fac2c073ae0 2024-02-28T23:18:06.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.288+0000 7fac33a00700 1 -- 172.21.15.159:0/3018173304 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c19d5c0 con 0x7fac2c073ae0 2024-02-28T23:18:06.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.288+0000 7fac29600700 1 -- 172.21.15.159:0/3018173304 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac18017630 con 0x7fac2c073ae0 2024-02-28T23:18:06.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.288+0000 7fac33a00700 1 -- 172.21.15.159:0/3018173304 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c19dab0 con 0x7fac2c073ae0 2024-02-28T23:18:06.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.292+0000 7fac1ea00700 1 -- 172.21.15.159:0/3018173304 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c04ea90 con 0x7fac2c073ae0 2024-02-28T23:18:06.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.292+0000 7fac29600700 1 -- 172.21.15.159:0/3018173304 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fac1800f5d0 con 0x7fac2c073ae0 2024-02-28T23:18:06.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.294+0000 7fac29600700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fac1406d940 0x7fac1406fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:06.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.294+0000 7fac29600700 1 -- 172.21.15.159:0/3018173304 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fac1808eb60 con 0x7fac2c073ae0 2024-02-28T23:18:06.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.294+0000 7fac31000700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fac1406d940 0x7fac1406fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:06.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.295+0000 7fac31000700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fac1406d940 0x7fac1406fe00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac20007fd0 tx=0x7fac20007830 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:06.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.307+0000 7fac29600700 1 -- 172.21.15.159:0/3018173304 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fac1805bdc0 con 0x7fac2c073ae0 2024-02-28T23:18:06.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:06 smithi159 ceph-mon[113833]: pgmap v201: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:18:06.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:06 smithi159 ceph-mon[113833]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:18:06.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:06 smithi159 ceph-mon[113833]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-28T23:18:06.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:06 smithi159 ceph-mon[113833]: osdmap e92: 6 total, 5 up, 6 in 2024-02-28T23:18:06.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:06 smithi159 ceph-mon[113833]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:06.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:06 smithi184 podman[105879]: 2024-02-28 23:18:06.421651007 +0000 UTC m=+1.808648247 container cleanup f9b09e5af5276ad8204a5fa8a9f17b85fda44a8a94a8883c0b8d16917e9d3532 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5, io.buildah.version=1.29.1, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=-18.2.1, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=HEAD, ceph=True, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:18:06.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:06 smithi184 bash[105879]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5 2024-02-28T23:18:06.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:06 smithi184 ceph-mon[86482]: pgmap v201: 65 pgs: 65 active+clean; 209 MiB data, 970 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:18:06.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:06 smithi184 ceph-mon[86482]: Health check failed: 1 osds down (OSD_DOWN) 2024-02-28T23:18:06.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:06 smithi184 ceph-mon[86482]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-02-28T23:18:06.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:06 smithi184 ceph-mon[86482]: osdmap e92: 6 total, 5 up, 6 in 2024-02-28T23:18:06.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:06 smithi184 ceph-mon[86482]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:06.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.603+0000 7fac1ea00700 1 -- 172.21.15.159:0/3018173304 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fac2c19dd90 con 0x7fac2c073ae0 2024-02-28T23:18:06.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.604+0000 7fac29600700 1 -- 172.21.15.159:0/3018173304 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+700 (secure 0 0 0) 0x7fac1805b950 con 0x7fac2c073ae0 2024-02-28T23:18:06.602 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 5 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4 2024-02-28T23:18:06.603 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:18:06.604 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:18:06.604 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 4, 2024-02-28T23:18:06.604 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 9 2024-02-28T23:18:06.604 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:18:06.604 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:18:06.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.607+0000 7fac1ea00700 1 -- 172.21.15.159:0/3018173304 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fac1406d940 msgr2=0x7fac1406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:06.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.607+0000 7fac1ea00700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fac1406d940 0x7fac1406fe00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac20007fd0 tx=0x7fac20007830 comp rx=0 tx=0).stop 2024-02-28T23:18:06.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.607+0000 7fac1ea00700 1 -- 172.21.15.159:0/3018173304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c073ae0 msgr2=0x7fac2c198ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:06.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.607+0000 7fac1ea00700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c073ae0 0x7fac2c198ea0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fac180092e0 tx=0x7fac1800be00 comp rx=0 tx=0).stop 2024-02-28T23:18:06.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.607+0000 7fac1ea00700 1 -- 172.21.15.159:0/3018173304 shutdown_connections 2024-02-28T23:18:06.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.607+0000 7fac1ea00700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fac2c0731c0 0x7fac2c198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.607+0000 7fac1ea00700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fac1406d940 0x7fac1406fe00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.607+0000 7fac1ea00700 1 --2- 172.21.15.159:0/3018173304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac2c073ae0 0x7fac2c198ea0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.607+0000 7fac1ea00700 1 -- 172.21.15.159:0/3018173304 >> 172.21.15.159:0/3018173304 conn(0x7fac2c0fc630 msgr2=0x7fac2c107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:06.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.607+0000 7fac1ea00700 1 -- 172.21.15.159:0/3018173304 shutdown_connections 2024-02-28T23:18:06.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.607+0000 7fac1ea00700 1 -- 172.21.15.159:0/3018173304 wait complete. 2024-02-28T23:18:06.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.751+0000 7fcefe000700 1 -- 172.21.15.159:0/2972932621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef8069020 msgr2=0x7fcef8105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:06.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.751+0000 7fcefe000700 1 --2- 172.21.15.159:0/2972932621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef8069020 0x7fcef8105790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcee0009910 tx=0x7fcee0009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:06.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.751+0000 7fcefe000700 1 -- 172.21.15.159:0/2972932621 shutdown_connections 2024-02-28T23:18:06.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.751+0000 7fcefe000700 1 --2- 172.21.15.159:0/2972932621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef8069020 0x7fcef8105790 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.751+0000 7fcefe000700 1 --2- 172.21.15.159:0/2972932621 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef8068670 0x7fcef8068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.751+0000 7fcefe000700 1 -- 172.21.15.159:0/2972932621 >> 172.21.15.159:0/2972932621 conn(0x7fcef80755a0 msgr2=0x7fcef80759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:06.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.752+0000 7fcefe000700 1 -- 172.21.15.159:0/2972932621 shutdown_connections 2024-02-28T23:18:06.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.752+0000 7fcefe000700 1 -- 172.21.15.159:0/2972932621 wait complete. 2024-02-28T23:18:06.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.753+0000 7fcefe000700 1 Processor -- start 2024-02-28T23:18:06.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.753+0000 7fcefe000700 1 -- start start 2024-02-28T23:18:06.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.753+0000 7fcefe000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef8068670 0x7fcef8196700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:06.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.753+0000 7fcefe000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef8069020 0x7fcef8196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:06.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.753+0000 7fcefe000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef81972d0 con 0x7fcef8069020 2024-02-28T23:18:06.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.753+0000 7fcefe000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef819a000 con 0x7fcef8068670 2024-02-28T23:18:06.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.753+0000 7fceefe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef8069020 0x7fcef8196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:06.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.753+0000 7fceefe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef8069020 0x7fcef8196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49772/0 (socket says 172.21.15.159:49772) 2024-02-28T23:18:06.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.753+0000 7fceefe00700 1 -- 172.21.15.159:0/3624981692 learned_addr learned my addr 172.21.15.159:0/3624981692 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:06.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.754+0000 7fceefe00700 1 -- 172.21.15.159:0/3624981692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef8068670 msgr2=0x7fcef8196700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:06.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.754+0000 7fceefe00700 1 --2- 172.21.15.159:0/3624981692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef8068670 0x7fcef8196700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:06.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.754+0000 7fceefe00700 1 -- 172.21.15.159:0/3624981692 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee00095f0 con 0x7fcef8069020 2024-02-28T23:18:06.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.754+0000 7fceefe00700 1 --2- 172.21.15.159:0/3624981692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef8069020 0x7fcef8196c40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcee000bda0 tx=0x7fcee000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:06.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.754+0000 7fcef4c00700 1 -- 172.21.15.159:0/3624981692 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcee001d070 con 0x7fcef8069020 2024-02-28T23:18:06.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.754+0000 7fcef4c00700 1 -- 172.21.15.159:0/3624981692 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcee000f460 con 0x7fcef8069020 2024-02-28T23:18:06.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.754+0000 7fcef4c00700 1 -- 172.21.15.159:0/3624981692 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcee0017630 con 0x7fcef8069020 2024-02-28T23:18:06.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.754+0000 7fcefe000700 1 -- 172.21.15.159:0/3624981692 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef819a280 con 0x7fcef8069020 2024-02-28T23:18:06.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.755+0000 7fcefe000700 1 -- 172.21.15.159:0/3624981692 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef819a770 con 0x7fcef8069020 2024-02-28T23:18:06.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.755+0000 7fcefe000700 1 -- 172.21.15.159:0/3624981692 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef81090a0 con 0x7fcef8069020 2024-02-28T23:18:06.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.756+0000 7fcef4c00700 1 -- 172.21.15.159:0/3624981692 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fcee000fa40 con 0x7fcef8069020 2024-02-28T23:18:06.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.757+0000 7fcef4c00700 1 --2- 172.21.15.159:0/3624981692 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcedc06d8a0 0x7fcedc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:06.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.757+0000 7fcef4c00700 1 -- 172.21.15.159:0/3624981692 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fcee008ea20 con 0x7fcef8069020 2024-02-28T23:18:06.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.758+0000 7fcef7400700 1 --2- 172.21.15.159:0/3624981692 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcedc06d8a0 0x7fcedc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:06.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.758+0000 7fcef7400700 1 --2- 172.21.15.159:0/3624981692 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcedc06d8a0 0x7fcedc06fd60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcee8005950 tx=0x7fcee80058e0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:06.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:06.762+0000 7fcef4c00700 1 -- 172.21.15.159:0/3624981692 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcee0058170 con 0x7fcef8069020 2024-02-28T23:18:07.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.023+0000 7fcefe000700 1 -- 172.21.15.159:0/3624981692 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcef802cc70 con 0x7fcef8069020 2024-02-28T23:18:07.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.023+0000 7fcef4c00700 1 -- 172.21.15.159:0/3624981692 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 18 v18) v1 ==== 76+0+1879 (secure 0 0 0) 0x7fcee005b830 con 0x7fcef8069020 2024-02-28T23:18:07.022 INFO:teuthology.orchestra.run.smithi159.stdout:e18 2024-02-28T23:18:07.022 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:18:07.022 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:18:07.022 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:18:07.022 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:18:07.022 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 18 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:03:44.517625+0000 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:18:07.023 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 46 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:18:07.024 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:18:07.025 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:14484} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/2161666204,v1:172.21.15.159:6827/2161666204] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:18:07.025 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:18:07.025 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:18:07.025 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:18:07.025 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:18:07.025 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:18:07.025 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:18:07.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.026+0000 7fcefe000700 1 -- 172.21.15.159:0/3624981692 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcedc06d8a0 msgr2=0x7fcedc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:07.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.026+0000 7fcefe000700 1 --2- 172.21.15.159:0/3624981692 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcedc06d8a0 0x7fcedc06fd60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcee8005950 tx=0x7fcee80058e0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.026+0000 7fcefe000700 1 -- 172.21.15.159:0/3624981692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef8069020 msgr2=0x7fcef8196c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:07.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.026+0000 7fcefe000700 1 --2- 172.21.15.159:0/3624981692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef8069020 0x7fcef8196c40 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcee000bda0 tx=0x7fcee000be80 comp rx=0 tx=0).stop 2024-02-28T23:18:07.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.026+0000 7fcefe000700 1 -- 172.21.15.159:0/3624981692 shutdown_connections 2024-02-28T23:18:07.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.026+0000 7fcefe000700 1 --2- 172.21.15.159:0/3624981692 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcef8068670 0x7fcef8196700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.026+0000 7fcefe000700 1 --2- 172.21.15.159:0/3624981692 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcedc06d8a0 0x7fcedc06fd60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.026+0000 7fcefe000700 1 --2- 172.21.15.159:0/3624981692 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcef8069020 0x7fcef8196c40 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.026+0000 7fcefe000700 1 -- 172.21.15.159:0/3624981692 >> 172.21.15.159:0/3624981692 conn(0x7fcef80755a0 msgr2=0x7fcef8105000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:07.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.026+0000 7fcefe000700 1 -- 172.21.15.159:0/3624981692 shutdown_connections 2024-02-28T23:18:07.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.027+0000 7fcefe000700 1 -- 172.21.15.159:0/3624981692 wait complete. 2024-02-28T23:18:07.027 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-02-28T23:18:07.100 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:06 smithi184 podman[105898]: 2024-02-28 23:18:06.606187311 +0000 UTC m=+0.755004014 container remove f9b09e5af5276ad8204a5fa8a9f17b85fda44a8a94a8883c0b8d16917e9d3532 (image=quay.io/ceph/ceph@sha256:632158bcaab42d1034c1fa4a9a4d90a2d910f8d87f7b8d97a9e58af7a17db9e8, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.29.1, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=-18.2.1, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=https://github.com/ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-02-28T23:18:07.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.176+0000 7fadb4400700 1 -- 172.21.15.159:0/392583319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadac102fe0 msgr2=0x7fadac1033c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:07.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.176+0000 7fadb4400700 1 --2- 172.21.15.159:0/392583319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadac102fe0 0x7fadac1033c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fada0009910 tx=0x7fada0009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:07.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.176+0000 7fadb4400700 1 -- 172.21.15.159:0/392583319 shutdown_connections 2024-02-28T23:18:07.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.176+0000 7fadb4400700 1 --2- 172.21.15.159:0/392583319 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadac103990 0x7fadac1079e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.176+0000 7fadb4400700 1 --2- 172.21.15.159:0/392583319 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadac102fe0 0x7fadac1033c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.176+0000 7fadb4400700 1 -- 172.21.15.159:0/392583319 >> 172.21.15.159:0/392583319 conn(0x7fadac0fe8d0 msgr2=0x7fadac100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:07.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.176+0000 7fadb4400700 1 -- 172.21.15.159:0/392583319 shutdown_connections 2024-02-28T23:18:07.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.176+0000 7fadb4400700 1 -- 172.21.15.159:0/392583319 wait complete. 2024-02-28T23:18:07.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.177+0000 7fadb4400700 1 Processor -- start 2024-02-28T23:18:07.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.178+0000 7fadb4400700 1 -- start start 2024-02-28T23:18:07.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.178+0000 7fadb4400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadac102fe0 0x7fadac1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:07.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.178+0000 7fadb4400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadac103990 0x7fadac198ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:07.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.178+0000 7fadb4400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac199570 con 0x7fadac103990 2024-02-28T23:18:07.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.178+0000 7fadb4400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadac19d380 con 0x7fadac102fe0 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.178+0000 7fadb1000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadac103990 0x7fadac198ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.178+0000 7fadb1a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadac102fe0 0x7fadac1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.178+0000 7fadb1000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadac103990 0x7fadac198ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49790/0 (socket says 172.21.15.159:49790) 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.178+0000 7fadb1a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadac102fe0 0x7fadac1989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:39972/0 (socket says 172.21.15.159:39972) 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.178+0000 7fadb1000700 1 -- 172.21.15.159:0/898767706 learned_addr learned my addr 172.21.15.159:0/898767706 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.179+0000 7fadb1000700 1 -- 172.21.15.159:0/898767706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadac102fe0 msgr2=0x7fadac1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.179+0000 7fadb1000700 1 --2- 172.21.15.159:0/898767706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadac102fe0 0x7fadac1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.179+0000 7fadb1000700 1 -- 172.21.15.159:0/898767706 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fada00095f0 con 0x7fadac103990 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.179+0000 7fadb1a00700 1 --2- 172.21.15.159:0/898767706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadac102fe0 0x7fadac1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.179+0000 7fadb1000700 1 --2- 172.21.15.159:0/898767706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadac103990 0x7fadac198ee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fad9800e8f0 tx=0x7fad9800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.179+0000 7fadaa000700 1 -- 172.21.15.159:0/898767706 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad98009790 con 0x7fadac103990 2024-02-28T23:18:07.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.179+0000 7fadaa000700 1 -- 172.21.15.159:0/898767706 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fad9800c810 con 0x7fadac103990 2024-02-28T23:18:07.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.179+0000 7fadaa000700 1 -- 172.21.15.159:0/898767706 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad98005580 con 0x7fadac103990 2024-02-28T23:18:07.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.179+0000 7fadb4400700 1 -- 172.21.15.159:0/898767706 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadac19d660 con 0x7fadac103990 2024-02-28T23:18:07.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.180+0000 7fadb4400700 1 -- 172.21.15.159:0/898767706 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadac19dbb0 con 0x7fadac103990 2024-02-28T23:18:07.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.181+0000 7fadb4400700 1 -- 172.21.15.159:0/898767706 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadac10b380 con 0x7fadac103990 2024-02-28T23:18:07.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.182+0000 7fadaa000700 1 -- 172.21.15.159:0/898767706 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fad9800c980 con 0x7fadac103990 2024-02-28T23:18:07.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.182+0000 7fadaa000700 1 --2- 172.21.15.159:0/898767706 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad9406d8a0 0x7fad9406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:07.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.183+0000 7fadaa000700 1 -- 172.21.15.159:0/898767706 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fad98014070 con 0x7fadac103990 2024-02-28T23:18:07.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.183+0000 7fadb1a00700 1 --2- 172.21.15.159:0/898767706 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad9406d8a0 0x7fad9406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:07.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.183+0000 7fadb1a00700 1 --2- 172.21.15.159:0/898767706 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad9406d8a0 0x7fad9406fd60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fada0005b40 tx=0x7fada0005a90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:07.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.187+0000 7fadaa000700 1 -- 172.21.15.159:0/898767706 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fad9805aa40 con 0x7fadac103990 2024-02-28T23:18:07.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.424+0000 7fadb4400700 1 -- 172.21.15.159:0/898767706 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fadac19de80 con 0x7fad9406d8a0 2024-02-28T23:18:07.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.427+0000 7fadaa000700 1 -- 172.21.15.159:0/898767706 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fadac19de80 con 0x7fad9406d8a0 2024-02-28T23:18:07.425 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:18:07.425 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:18:07.426 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:18:07.426 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:18:07.426 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:18:07.426 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-02-28T23:18:07.426 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:18:07.426 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:18:07.426 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:18:07.426 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "11/23 daemons upgraded", 2024-02-28T23:18:07.426 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading osd daemons", 2024-02-28T23:18:07.426 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:18:07.426 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:18:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.430+0000 7fadb4400700 1 -- 172.21.15.159:0/898767706 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad9406d8a0 msgr2=0x7fad9406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.430+0000 7fadb4400700 1 --2- 172.21.15.159:0/898767706 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad9406d8a0 0x7fad9406fd60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fada0005b40 tx=0x7fada0005a90 comp rx=0 tx=0).stop 2024-02-28T23:18:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.430+0000 7fadb4400700 1 -- 172.21.15.159:0/898767706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadac103990 msgr2=0x7fadac198ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.430+0000 7fadb4400700 1 --2- 172.21.15.159:0/898767706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadac103990 0x7fadac198ee0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fad9800e8f0 tx=0x7fad9800ec00 comp rx=0 tx=0).stop 2024-02-28T23:18:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.430+0000 7fadb4400700 1 -- 172.21.15.159:0/898767706 shutdown_connections 2024-02-28T23:18:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.430+0000 7fadb4400700 1 --2- 172.21.15.159:0/898767706 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fadac102fe0 0x7fadac1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.430+0000 7fadb4400700 1 --2- 172.21.15.159:0/898767706 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fad9406d8a0 0x7fad9406fd60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.430+0000 7fadb4400700 1 --2- 172.21.15.159:0/898767706 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fadac103990 0x7fadac198ee0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.430+0000 7fadb4400700 1 -- 172.21.15.159:0/898767706 >> 172.21.15.159:0/898767706 conn(0x7fadac0fe8d0 msgr2=0x7fadac0fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:07.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.430+0000 7fadb4400700 1 -- 172.21.15.159:0/898767706 shutdown_connections 2024-02-28T23:18:07.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.431+0000 7fadb4400700 1 -- 172.21.15.159:0/898767706 wait complete. 2024-02-28T23:18:07.579 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:07 smithi184 ceph-mon[86482]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:07.579 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:07 smithi184 ceph-mon[86482]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:07.579 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:07 smithi184 ceph-mon[86482]: osdmap e93: 6 total, 5 up, 6 in 2024-02-28T23:18:07.579 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:07 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3018173304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:07.579 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:07 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3624981692' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:18:07.579 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:07 smithi184 podman[105983]: 2024-02-28 23:18:07.274516572 +0000 UTC m=+0.032789854 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:18:07.579 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:07 smithi184 podman[105983]: 2024-02-28 23:18:07.40770007 +0000 UTC m=+0.165973389 container create 9babcebda35818669dac1375cae2294bfb4465ffa0dd5befa7c7dd04b882dba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10) 2024-02-28T23:18:07.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.586+0000 7fa599000700 1 -- 172.21.15.159:0/1685803296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5941039b0 msgr2=0x7fa594107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:07.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.586+0000 7fa599000700 1 --2- 172.21.15.159:0/1685803296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5941039b0 0x7fa594107a00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa580009910 tx=0x7fa580009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:07.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.586+0000 7fa599000700 1 -- 172.21.15.159:0/1685803296 shutdown_connections 2024-02-28T23:18:07.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.586+0000 7fa599000700 1 --2- 172.21.15.159:0/1685803296 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5941039b0 0x7fa594107a00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.586+0000 7fa599000700 1 --2- 172.21.15.159:0/1685803296 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa594103000 0x7fa5941033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.586+0000 7fa599000700 1 -- 172.21.15.159:0/1685803296 >> 172.21.15.159:0/1685803296 conn(0x7fa5940fe8d0 msgr2=0x7fa594100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:07.585 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:07 smithi159 ceph-mon[113833]: from='client.34404 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:07.585 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:07 smithi159 ceph-mon[113833]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:07.585 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:07 smithi159 ceph-mon[113833]: osdmap e93: 6 total, 5 up, 6 in 2024-02-28T23:18:07.585 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:07 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3018173304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:07.585 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:07 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3624981692' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:18:07.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.586+0000 7fa599000700 1 -- 172.21.15.159:0/1685803296 shutdown_connections 2024-02-28T23:18:07.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.586+0000 7fa599000700 1 -- 172.21.15.159:0/1685803296 wait complete. 2024-02-28T23:18:07.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.588+0000 7fa599000700 1 Processor -- start 2024-02-28T23:18:07.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.588+0000 7fa599000700 1 -- start start 2024-02-28T23:18:07.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.589+0000 7fa599000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa594103000 0x7fa59419e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:07.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.589+0000 7fa599000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5941039b0 0x7fa59419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:07.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.589+0000 7fa599000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59419f300 con 0x7fa5941039b0 2024-02-28T23:18:07.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.589+0000 7fa599000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa594198840 con 0x7fa594103000 2024-02-28T23:18:07.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.589+0000 7fa591400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5941039b0 0x7fa59419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:07.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.589+0000 7fa591400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5941039b0 0x7fa59419ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49818/0 (socket says 172.21.15.159:49818) 2024-02-28T23:18:07.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.589+0000 7fa591400700 1 -- 172.21.15.159:0/2309566586 learned_addr learned my addr 172.21.15.159:0/2309566586 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:07.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.589+0000 7fa591e00700 1 --2- 172.21.15.159:0/2309566586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa594103000 0x7fa59419e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:07.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.590+0000 7fa591400700 1 -- 172.21.15.159:0/2309566586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa594103000 msgr2=0x7fa59419e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:07.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.590+0000 7fa591400700 1 --2- 172.21.15.159:0/2309566586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa594103000 0x7fa59419e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.590+0000 7fa591400700 1 -- 172.21.15.159:0/2309566586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5800095f0 con 0x7fa5941039b0 2024-02-28T23:18:07.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.590+0000 7fa591400700 1 --2- 172.21.15.159:0/2309566586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5941039b0 0x7fa59419ed00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa58000bda0 tx=0x7fa58000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:07.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.590+0000 7fa58aa00700 1 -- 172.21.15.159:0/2309566586 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa58001d070 con 0x7fa5941039b0 2024-02-28T23:18:07.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.591+0000 7fa58aa00700 1 -- 172.21.15.159:0/2309566586 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa58000f460 con 0x7fa5941039b0 2024-02-28T23:18:07.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.591+0000 7fa599000700 1 -- 172.21.15.159:0/2309566586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa594198ac0 con 0x7fa5941039b0 2024-02-28T23:18:07.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.591+0000 7fa599000700 1 -- 172.21.15.159:0/2309566586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa594198fb0 con 0x7fa5941039b0 2024-02-28T23:18:07.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.591+0000 7fa58aa00700 1 -- 172.21.15.159:0/2309566586 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa580017630 con 0x7fa5941039b0 2024-02-28T23:18:07.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.592+0000 7fa599000700 1 -- 172.21.15.159:0/2309566586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa59410b400 con 0x7fa5941039b0 2024-02-28T23:18:07.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.593+0000 7fa58aa00700 1 -- 172.21.15.159:0/2309566586 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa58000fab0 con 0x7fa5941039b0 2024-02-28T23:18:07.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.594+0000 7fa58aa00700 1 --2- 172.21.15.159:0/2309566586 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa57806d8a0 0x7fa57806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:07.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.594+0000 7fa58aa00700 1 -- 172.21.15.159:0/2309566586 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fa58008ecb0 con 0x7fa5941039b0 2024-02-28T23:18:07.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.595+0000 7fa591e00700 1 --2- 172.21.15.159:0/2309566586 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa57806d8a0 0x7fa57806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:07.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.595+0000 7fa591e00700 1 --2- 172.21.15.159:0/2309566586 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa57806d8a0 0x7fa57806fd60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa58400ac50 tx=0x7fa58400a380 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:07.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.598+0000 7fa58aa00700 1 -- 172.21.15.159:0/2309566586 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa58005c030 con 0x7fa5941039b0 2024-02-28T23:18:07.851 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:07 smithi184 podman[105983]: 2024-02-28 23:18:07.703072994 +0000 UTC m=+0.461346373 container init 9babcebda35818669dac1375cae2294bfb4465ffa0dd5befa7c7dd04b882dba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-02-28T23:18:07.851 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:07 smithi184 podman[105983]: 2024-02-28 23:18:07.714954872 +0000 UTC m=+0.473228198 container start 9babcebda35818669dac1375cae2294bfb4465ffa0dd5befa7c7dd04b882dba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, ceph=True, org.label-schema.vendor=CentOS) 2024-02-28T23:18:07.851 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:07 smithi184 podman[105983]: 2024-02-28 23:18:07.8185452 +0000 UTC m=+0.576818545 container attach 9babcebda35818669dac1375cae2294bfb4465ffa0dd5befa7c7dd04b882dba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240222, ceph=True, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-28T23:18:07.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.880+0000 7fa599000700 1 -- 172.21.15.159:0/2309566586 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa59404ea90 con 0x7fa5941039b0 2024-02-28T23:18:07.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.881+0000 7fa58aa00700 1 -- 172.21.15.159:0/2309566586 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1010 (secure 0 0 0) 0x7fa5800163b0 con 0x7fa5941039b0 2024-02-28T23:18:07.880 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 31/228 objects degraded (13.596%), 9 pgs degraded 2024-02-28T23:18:07.880 INFO:teuthology.orchestra.run.smithi159.stdout:[WRN] OSD_DOWN: 1 osds down 2024-02-28T23:18:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: osd.5 (root=default,host=smithi184) is down 2024-02-28T23:18:07.880 INFO:teuthology.orchestra.run.smithi159.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-02-28T23:18:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-02-28T23:18:07.881 INFO:teuthology.orchestra.run.smithi159.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 31/228 objects degraded (13.596%), 9 pgs degraded 2024-02-28T23:18:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-02-28T23:18:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-02-28T23:18:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-02-28T23:18:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-02-28T23:18:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-02-28T23:18:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-02-28T23:18:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-02-28T23:18:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-02-28T23:18:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-02-28T23:18:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.885+0000 7fa599000700 1 -- 172.21.15.159:0/2309566586 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa57806d8a0 msgr2=0x7fa57806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.885+0000 7fa599000700 1 --2- 172.21.15.159:0/2309566586 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa57806d8a0 0x7fa57806fd60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa58400ac50 tx=0x7fa58400a380 comp rx=0 tx=0).stop 2024-02-28T23:18:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.885+0000 7fa599000700 1 -- 172.21.15.159:0/2309566586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5941039b0 msgr2=0x7fa59419ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.885+0000 7fa599000700 1 --2- 172.21.15.159:0/2309566586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5941039b0 0x7fa59419ed00 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa58000bda0 tx=0x7fa58000bdd0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.885+0000 7fa599000700 1 -- 172.21.15.159:0/2309566586 shutdown_connections 2024-02-28T23:18:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.885+0000 7fa599000700 1 --2- 172.21.15.159:0/2309566586 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa594103000 0x7fa59419e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.885+0000 7fa599000700 1 --2- 172.21.15.159:0/2309566586 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa57806d8a0 0x7fa57806fd60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.885+0000 7fa599000700 1 --2- 172.21.15.159:0/2309566586 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5941039b0 0x7fa59419ed00 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.885+0000 7fa599000700 1 -- 172.21.15.159:0/2309566586 >> 172.21.15.159:0/2309566586 conn(0x7fa5940fe8d0 msgr2=0x7fa594100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.885+0000 7fa599000700 1 -- 172.21.15.159:0/2309566586 shutdown_connections 2024-02-28T23:18:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:07.885+0000 7fa599000700 1 -- 172.21.15.159:0/2309566586 wait complete. 2024-02-28T23:18:08.440 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:08 smithi184 podman[105983]: 2024-02-28 23:18:08.15216898 +0000 UTC m=+0.910442309 container died 9babcebda35818669dac1375cae2294bfb4465ffa0dd5befa7c7dd04b882dba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:18:08.441 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:08 smithi184 ceph-mon[86482]: pgmap v204: 65 pgs: 12 active+undersized, 9 active+undersized+degraded, 4 stale+active+clean, 40 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 31/228 objects degraded (13.596%) 2024-02-28T23:18:08.441 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:08 smithi184 ceph-mon[86482]: Health check failed: Degraded data redundancy: 31/228 objects degraded (13.596%), 9 pgs degraded (PG_DEGRADED) 2024-02-28T23:18:08.441 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:08 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2309566586' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:18:08.441 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:08.441 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:18:08.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:08 smithi159 ceph-mon[113833]: pgmap v204: 65 pgs: 12 active+undersized, 9 active+undersized+degraded, 4 stale+active+clean, 40 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 31/228 objects degraded (13.596%) 2024-02-28T23:18:08.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:08 smithi159 ceph-mon[113833]: Health check failed: Degraded data redundancy: 31/228 objects degraded (13.596%), 9 pgs degraded (PG_DEGRADED) 2024-02-28T23:18:08.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:08 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2309566586' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:18:08.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:08.606 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:18:09.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:08 smithi184 podman[106009]: 2024-02-28 23:18:08.813689374 +0000 UTC m=+0.640658021 container remove 9babcebda35818669dac1375cae2294bfb4465ffa0dd5befa7c7dd04b882dba1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222) 2024-02-28T23:18:09.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:08 smithi184 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.5.service: Deactivated successfully. 2024-02-28T23:18:09.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:08 smithi184 systemd[1]: Stopped Ceph osd.5 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:18:09.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:08 smithi184 systemd[1]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.5.service: Consumed 2min 12.187s CPU time. 2024-02-28T23:18:09.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:09 smithi184 ceph-mon[86482]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:09.601 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:09 smithi184 systemd[1]: Starting Ceph osd.5 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:18:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:09 smithi159 ceph-mon[113833]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:09.918 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:09 smithi184 podman[106111]: 2024-02-28 23:18:09.50783422 +0000 UTC m=+0.033443007 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:18:09.918 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:09 smithi184 podman[106111]: 2024-02-28 23:18:09.614982021 +0000 UTC m=+0.140590832 container create e8b98d7f6a7fd8aa5de28a5288dd1cb8757a65e2d3c38e1f46a0d679f86dfbc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-02-28T23:18:09.918 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:09 smithi184 podman[106111]: 2024-02-28 23:18:09.918986056 +0000 UTC m=+0.444594907 container init e8b98d7f6a7fd8aa5de28a5288dd1cb8757a65e2d3c38e1f46a0d679f86dfbc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:18:10.304 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:09 smithi184 podman[106111]: 2024-02-28 23:18:09.931136803 +0000 UTC m=+0.456745651 container start e8b98d7f6a7fd8aa5de28a5288dd1cb8757a65e2d3c38e1f46a0d679f86dfbc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-02-28T23:18:10.304 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 podman[106111]: 2024-02-28 23:18:10.017601874 +0000 UTC m=+0.543210745 container attach e8b98d7f6a7fd8aa5de28a5288dd1cb8757a65e2d3c38e1f46a0d679f86dfbc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10) 2024-02-28T23:18:10.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:10 smithi184 ceph-mon[86482]: pgmap v205: 65 pgs: 12 active+undersized, 9 active+undersized+degraded, 4 stale+active+clean, 40 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 31/228 objects degraded (13.596%) 2024-02-28T23:18:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:10 smithi159 ceph-mon[113833]: pgmap v205: 65 pgs: 12 active+undersized, 9 active+undersized+degraded, 4 stale+active+clean, 40 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 31/228 objects degraded (13.596%) 2024-02-28T23:18:11.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate[106126]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T23:18:11.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate[106126]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T23:18:11.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate[106126]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T23:18:11.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 bash[106111]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T23:18:11.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 bash[106111]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-02-28T23:18:11.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 bash[106111]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-02-28T23:18:11.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 bash[106111]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T23:18:11.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 bash[106111]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-28T23:18:11.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 bash[106111]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T23:18:11.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 bash[106111]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-28T23:18:11.101 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate[106126]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-28T23:18:11.102 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate[106126]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-02-28T23:18:11.102 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate[106126]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-28T23:18:11.102 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate[106126]: --> ceph-volume raw activate successful for osd ID: 5 2024-02-28T23:18:11.102 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:10 smithi184 podman[106111]: 2024-02-28 23:18:10.8072679 +0000 UTC m=+1.332876695 container died e8b98d7f6a7fd8aa5de28a5288dd1cb8757a65e2d3c38e1f46a0d679f86dfbc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_CLEAN=True, ceph=True, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-28T23:18:12.094 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:11 smithi184 podman[106257]: 2024-02-28 23:18:11.738151933 +0000 UTC m=+0.909382483 container remove e8b98d7f6a7fd8aa5de28a5288dd1cb8757a65e2d3c38e1f46a0d679f86dfbc0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-activate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-02-28T23:18:12.350 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:12 smithi184 podman[106318]: 2024-02-28 23:18:12.002333025 +0000 UTC m=+0.034154607 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:18:12.350 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:12 smithi184 podman[106318]: 2024-02-28 23:18:12.097220155 +0000 UTC m=+0.129041796 container create 1426063f8d8e0724c566f4d48840ff8c11884bde799d7e6e782438df28590038 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-02-28T23:18:12.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:12 smithi184 ceph-mon[86482]: pgmap v206: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:12 smithi159 ceph-mon[113833]: pgmap v206: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 383 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:12.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:12 smithi184 podman[106318]: 2024-02-28 23:18:12.359600885 +0000 UTC m=+0.391422495 container init 1426063f8d8e0724c566f4d48840ff8c11884bde799d7e6e782438df28590038 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-02-28T23:18:12.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:12 smithi184 podman[106318]: 2024-02-28 23:18:12.368542193 +0000 UTC m=+0.400363782 container start 1426063f8d8e0724c566f4d48840ff8c11884bde799d7e6e782438df28590038 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:18:12.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:12 smithi184 ceph-osd[106336]: -- 172.21.15.184:0/1321418340 <== mon.1 v2:172.21.15.184:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c87425b680 con 0x55c874224c00 2024-02-28T23:18:12.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:12 smithi184 bash[106318]: 1426063f8d8e0724c566f4d48840ff8c11884bde799d7e6e782438df28590038 2024-02-28T23:18:12.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:12 smithi184 systemd[1]: Started Ceph osd.5 for 24bd0fca-d68c-11ee-95c3-87774f69a715. 2024-02-28T23:18:13.350 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:12 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:18:12.937+0000 7f27399587c0 -1 Falling back to public interface 2024-02-28T23:18:13.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:13 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:13.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:13 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:13.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:13 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:13.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:13 smithi159 ceph-mon[113833]: pgmap v207: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:13.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:13 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:13.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:13 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:13.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:13 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 35/228 objects degraded (15.351%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T23:18:14.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:13 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:14.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:13 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:14.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:13 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:14.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:13 smithi184 ceph-mon[86482]: pgmap v207: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:14.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:13 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:14.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:13 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:14.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:13 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 35/228 objects degraded (15.351%), 12 pgs degraded (PG_DEGRADED) 2024-02-28T23:18:16.584 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:16 smithi184 ceph-mon[86482]: pgmap v208: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 826 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:16 smithi159 ceph-mon[113833]: pgmap v208: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 826 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:18.100 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:17 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:18:17.801+0000 7f27399587c0 -1 osd.5 0 read_superblock omap replica is missing. 2024-02-28T23:18:18.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:18 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:18:18.325+0000 7f27399587c0 -1 osd.5 91 log_to_monitors true 2024-02-28T23:18:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:18 smithi184 ceph-mon[86482]: pgmap v209: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:18.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:18 smithi159 ceph-mon[113833]: pgmap v209: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:19 smithi184 ceph-mon[86482]: from='osd.5 [v2:172.21.15.184:6816/1609921388,v1:172.21.15.184:6817/1609921388]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T23:18:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:19 smithi184 ceph-mon[86482]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T23:18:19.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:19 smithi159 ceph-mon[113833]: from='osd.5 [v2:172.21.15.184:6816/1609921388,v1:172.21.15.184:6817/1609921388]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T23:18:19.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:19 smithi159 ceph-mon[113833]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-28T23:18:20.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:20 smithi184 ceph-mon[86482]: pgmap v210: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:20.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:20 smithi184 ceph-mon[86482]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T23:18:20.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:20 smithi184 ceph-mon[86482]: osdmap e94: 6 total, 5 up, 6 in 2024-02-28T23:18:20.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:20 smithi184 ceph-mon[86482]: from='osd.5 [v2:172.21.15.184:6816/1609921388,v1:172.21.15.184:6817/1609921388]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:18:20.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:20 smithi184 ceph-mon[86482]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:18:20.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:20 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:20.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:20 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:20.601 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:18:20 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:18:20.300+0000 7f2723c00700 -1 osd.5 91 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-28T23:18:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:20 smithi159 ceph-mon[113833]: pgmap v210: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 852 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:20 smithi159 ceph-mon[113833]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-28T23:18:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:20 smithi159 ceph-mon[113833]: osdmap e94: 6 total, 5 up, 6 in 2024-02-28T23:18:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:20 smithi159 ceph-mon[113833]: from='osd.5 [v2:172.21.15.184:6816/1609921388,v1:172.21.15.184:6817/1609921388]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:18:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:20 smithi159 ceph-mon[113833]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi184", "root=default"]}]: dispatch 2024-02-28T23:18:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:20 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:20.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:20 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:21 smithi184 ceph-mon[86482]: from='osd.5 ' entity='osd.5' 2024-02-28T23:18:21.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:21 smithi159 ceph-mon[113833]: from='osd.5 ' entity='osd.5' 2024-02-28T23:18:22.591 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:22 smithi184 ceph-mon[86482]: pgmap v212: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 878 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:22.591 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:22 smithi184 ceph-mon[86482]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:18:22.591 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:22 smithi184 ceph-mon[86482]: osd.5 [v2:172.21.15.184:6816/1609921388,v1:172.21.15.184:6817/1609921388] boot 2024-02-28T23:18:22.591 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:22 smithi184 ceph-mon[86482]: osdmap e95: 6 total, 6 up, 6 in 2024-02-28T23:18:22.591 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:22 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:18:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:22 smithi159 ceph-mon[113833]: pgmap v212: 65 pgs: 18 active+undersized, 12 active+undersized+degraded, 35 active+clean; 209 MiB data, 878 MiB used, 536 GiB / 536 GiB avail; 1023 B/s rd, 1 op/s; 35/228 objects degraded (15.351%) 2024-02-28T23:18:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:22 smithi159 ceph-mon[113833]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-28T23:18:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:22 smithi159 ceph-mon[113833]: osd.5 [v2:172.21.15.184:6816/1609921388,v1:172.21.15.184:6817/1609921388] boot 2024-02-28T23:18:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:22 smithi159 ceph-mon[113833]: osdmap e95: 6 total, 6 up, 6 in 2024-02-28T23:18:22.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:22 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-28T23:18:23.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:23 smithi184 ceph-mon[86482]: osdmap e96: 6 total, 6 up, 6 in 2024-02-28T23:18:23.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:23.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:18:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:23 smithi159 ceph-mon[113833]: osdmap e96: 6 total, 6 up, 6 in 2024-02-28T23:18:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:18:24.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:24 smithi159 ceph-mon[113833]: pgmap v215: 65 pgs: 12 peering, 13 active+undersized, 5 active+undersized+degraded, 35 active+clean; 209 MiB data, 878 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 1 op/s; 13/228 objects degraded (5.702%) 2024-02-28T23:18:24.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:24 smithi159 ceph-mon[113833]: Health check update: Degraded data redundancy: 13/228 objects degraded (5.702%), 5 pgs degraded (PG_DEGRADED) 2024-02-28T23:18:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:24 smithi184 ceph-mon[86482]: pgmap v215: 65 pgs: 12 peering, 13 active+undersized, 5 active+undersized+degraded, 35 active+clean; 209 MiB data, 878 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 1 op/s; 13/228 objects degraded (5.702%) 2024-02-28T23:18:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:24 smithi184 ceph-mon[86482]: Health check update: Degraded data redundancy: 13/228 objects degraded (5.702%), 5 pgs degraded (PG_DEGRADED) 2024-02-28T23:18:26.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: pgmap v216: 65 pgs: 12 peering, 1 active+undersized, 1 active+undersized+degraded, 51 active+clean; 209 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 1 op/s; 2/228 objects degraded (0.877%) 2024-02-28T23:18:26.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:26.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:26.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:26.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:18:26.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:26.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:26.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:26.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:26.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:26.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:26.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:26.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-28T23:18:26.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-28T23:18:26.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-28T23:18:26.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-28T23:18:26.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-28T23:18:26.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-28T23:18:26.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-28T23:18:26.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-28T23:18:26.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-28T23:18:26.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-28T23:18:26.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-28T23:18:26.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-28T23:18:26.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: pgmap v216: 65 pgs: 12 peering, 1 active+undersized, 1 active+undersized+degraded, 51 active+clean; 209 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 341 B/s rd, 1 op/s; 2/228 objects degraded (0.877%) 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:26.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-28T23:18:26.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-02-28T23:18:27.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:27 smithi184 ceph-mon[86482]: Upgrade: Setting container_image for all osd 2024-02-28T23:18:27.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:27 smithi184 ceph-mon[86482]: Upgrade: Setting require_osd_release to 19 squid 2024-02-28T23:18:27.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:27 smithi184 ceph-mon[86482]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-28T23:18:27.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:27 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-28T23:18:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:27 smithi184 ceph-mon[86482]: osdmap e97: 6 total, 6 up, 6 in 2024-02-28T23:18:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:27 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:27.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:27 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-28T23:18:27.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:27 smithi159 ceph-mon[113833]: Upgrade: Setting container_image for all osd 2024-02-28T23:18:27.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:27 smithi159 ceph-mon[113833]: Upgrade: Setting require_osd_release to 19 squid 2024-02-28T23:18:27.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:27 smithi159 ceph-mon[113833]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-02-28T23:18:27.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:27 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-02-28T23:18:27.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:27 smithi159 ceph-mon[113833]: osdmap e97: 6 total, 6 up, 6 in 2024-02-28T23:18:27.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:27 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:27.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:27 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-02-28T23:18:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:28 smithi159 ceph-mon[113833]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-28T23:18:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:28 smithi159 ceph-mon[113833]: pgmap v218: 65 pgs: 65 active+clean; 209 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:18:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:28 smithi159 ceph-mon[113833]: osdmap e98: 6 total, 6 up, 6 in 2024-02-28T23:18:28.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:28 smithi159 ceph-mon[113833]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/228 objects degraded (0.877%), 1 pg degraded) 2024-02-28T23:18:28.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:28 smithi159 ceph-mon[113833]: Cluster is now healthy 2024-02-28T23:18:28.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-28T23:18:28.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:28 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 2 up:standby 2024-02-28T23:18:28.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:28.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:28.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:18:28.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:28.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:28 smithi184 ceph-mon[86482]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-02-28T23:18:28.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:28 smithi184 ceph-mon[86482]: pgmap v218: 65 pgs: 65 active+clean; 209 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:18:28.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:28 smithi184 ceph-mon[86482]: osdmap e98: 6 total, 6 up, 6 in 2024-02-28T23:18:28.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:28 smithi184 ceph-mon[86482]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/228 objects degraded (0.877%), 1 pg degraded) 2024-02-28T23:18:28.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:28 smithi184 ceph-mon[86482]: Cluster is now healthy 2024-02-28T23:18:28.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-02-28T23:18:28.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:28 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 2 up:standby 2024-02-28T23:18:28.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:28.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:28.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:18:28.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:29.528 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:29.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:29.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:29.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:29.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:29.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:29 smithi159 ceph-mon[113833]: mds.? [v2:172.21.15.159:6826/675860228,v1:172.21.15.159:6827/675860228] up:boot 2024-02-28T23:18:29.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:29 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 3 up:standby 2024-02-28T23:18:29.529 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:18:29.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:29.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:29.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:29 smithi184 ceph-mon[86482]: mds.? [v2:172.21.15.159:6826/675860228,v1:172.21.15.159:6827/675860228] up:boot 2024-02-28T23:18:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:29 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 3 up:standby 2024-02-28T23:18:29.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:18:30.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:30 smithi159 ceph-mon[113833]: pgmap v220: 65 pgs: 65 active+clean; 209 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 746 B/s rd, 1 op/s 2024-02-28T23:18:30.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:30 smithi184 ceph-mon[86482]: pgmap v220: 65 pgs: 65 active+clean; 209 MiB data, 886 MiB used, 536 GiB / 536 GiB avail; 746 B/s rd, 1 op/s 2024-02-28T23:18:31.912 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:31 smithi159 ceph-mon[113833]: Upgrade: Updating mds.cephfs.smithi159.mbaqic 2024-02-28T23:18:31.912 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:31 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:31.912 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:31 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.mbaqic", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:18:31.912 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:31 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:31.912 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:31 smithi159 ceph-mon[113833]: Deploying daemon mds.cephfs.smithi159.mbaqic on smithi159 2024-02-28T23:18:31.912 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:31 smithi159 ceph-mon[113833]: pgmap v221: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-02-28T23:18:32.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:31 smithi184 ceph-mon[86482]: Upgrade: Updating mds.cephfs.smithi159.mbaqic 2024-02-28T23:18:32.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:31 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:32.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:31 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.mbaqic", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:18:32.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:31 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:32.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:31 smithi184 ceph-mon[86482]: Deploying daemon mds.cephfs.smithi159.mbaqic on smithi159 2024-02-28T23:18:32.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:31 smithi184 ceph-mon[86482]: pgmap v221: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 639 B/s rd, 1 op/s 2024-02-28T23:18:34.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:34 smithi184 ceph-mon[86482]: pgmap v222: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:18:34.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:34 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:34 smithi159 ceph-mon[113833]: pgmap v222: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:18:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:34 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:35.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:35 smithi184 ceph-mon[86482]: osdmap e99: 6 total, 6 up, 6 in 2024-02-28T23:18:35.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:35 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 2 up:standby 2024-02-28T23:18:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:35 smithi159 ceph-mon[113833]: osdmap e99: 6 total, 6 up, 6 in 2024-02-28T23:18:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:35 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 2 up:standby 2024-02-28T23:18:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:36 smithi159 ceph-mon[113833]: pgmap v224: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 127 B/s rd, 0 op/s 2024-02-28T23:18:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:36 smithi184 ceph-mon[86482]: pgmap v224: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 127 B/s rd, 0 op/s 2024-02-28T23:18:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.062+0000 7f634cc00700 1 -- 172.21.15.159:0/2469761013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6348069020 msgr2=0x7f6348105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.062+0000 7f634cc00700 1 --2- 172.21.15.159:0/2469761013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6348069020 0x7f6348105790 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6334009910 tx=0x7f6334009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.063+0000 7f634cc00700 1 -- 172.21.15.159:0/2469761013 shutdown_connections 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.063+0000 7f634cc00700 1 --2- 172.21.15.159:0/2469761013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6348069020 0x7f6348105790 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.063+0000 7f634cc00700 1 --2- 172.21.15.159:0/2469761013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6348068670 0x7f6348068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.063+0000 7f634cc00700 1 -- 172.21.15.159:0/2469761013 >> 172.21.15.159:0/2469761013 conn(0x7f63480755a0 msgr2=0x7f63480759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.063+0000 7f634cc00700 1 -- 172.21.15.159:0/2469761013 shutdown_connections 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.063+0000 7f634cc00700 1 -- 172.21.15.159:0/2469761013 wait complete. 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.064+0000 7f634cc00700 1 Processor -- start 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.064+0000 7f634cc00700 1 -- start start 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.065+0000 7f634cc00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6348068670 0x7f634819e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.065+0000 7f634cc00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6348069020 0x7f634819ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.065+0000 7f634cc00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634819f3f0 con 0x7f6348069020 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.065+0000 7f634cc00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63481988a0 con 0x7f6348068670 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.065+0000 7f6345400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6348069020 0x7f634819ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.065+0000 7f6345400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6348069020 0x7f634819ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35418/0 (socket says 172.21.15.159:35418) 2024-02-28T23:18:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.065+0000 7f6345400700 1 -- 172.21.15.159:0/1371204430 learned_addr learned my addr 172.21.15.159:0/1371204430 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:38.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.065+0000 7f6345e00700 1 --2- 172.21.15.159:0/1371204430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6348068670 0x7f634819e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:38.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.065+0000 7f6345400700 1 -- 172.21.15.159:0/1371204430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6348068670 msgr2=0x7f634819e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:38.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.065+0000 7f6345400700 1 --2- 172.21.15.159:0/1371204430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6348068670 0x7f634819e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.066+0000 7f6345400700 1 -- 172.21.15.159:0/1371204430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63340095f0 con 0x7f6348069020 2024-02-28T23:18:38.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.066+0000 7f6345400700 1 --2- 172.21.15.159:0/1371204430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6348069020 0x7f634819ed60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f633400bda0 tx=0x7f633400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:38.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.066+0000 7f633ea00700 1 -- 172.21.15.159:0/1371204430 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f633401d070 con 0x7f6348069020 2024-02-28T23:18:38.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.066+0000 7f633ea00700 1 -- 172.21.15.159:0/1371204430 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6334004fb0 con 0x7f6348069020 2024-02-28T23:18:38.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.066+0000 7f633ea00700 1 -- 172.21.15.159:0/1371204430 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f633400f480 con 0x7f6348069020 2024-02-28T23:18:38.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.066+0000 7f634cc00700 1 -- 172.21.15.159:0/1371204430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6348198b20 con 0x7f6348069020 2024-02-28T23:18:38.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.066+0000 7f634cc00700 1 -- 172.21.15.159:0/1371204430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6348199010 con 0x7f6348069020 2024-02-28T23:18:38.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.068+0000 7f634cc00700 1 -- 172.21.15.159:0/1371204430 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634804ea90 con 0x7f6348069020 2024-02-28T23:18:38.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.069+0000 7f633ea00700 1 -- 172.21.15.159:0/1371204430 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f6334022870 con 0x7f6348069020 2024-02-28T23:18:38.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.069+0000 7f633ea00700 1 --2- 172.21.15.159:0/1371204430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f632c06d8a0 0x7f632c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:38.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.070+0000 7f633ea00700 1 -- 172.21.15.159:0/1371204430 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f633408eda0 con 0x7f6348069020 2024-02-28T23:18:38.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.070+0000 7f6345e00700 1 --2- 172.21.15.159:0/1371204430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f632c06d8a0 0x7f632c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:38.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.070+0000 7f6345e00700 1 --2- 172.21.15.159:0/1371204430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f632c06d8a0 0x7f632c06fd60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6338006fd0 tx=0x7f6338008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:38.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.075+0000 7f633ea00700 1 -- 172.21.15.159:0/1371204430 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f633405c150 con 0x7f6348069020 2024-02-28T23:18:38.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.321+0000 7f634cc00700 1 -- 172.21.15.159:0/1371204430 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6348199500 con 0x7f632c06d8a0 2024-02-28T23:18:38.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.323+0000 7f633ea00700 1 -- 172.21.15.159:0/1371204430 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f6348199500 con 0x7f632c06d8a0 2024-02-28T23:18:38.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.326+0000 7f634cc00700 1 -- 172.21.15.159:0/1371204430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f632c06d8a0 msgr2=0x7f632c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:38.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.326+0000 7f634cc00700 1 --2- 172.21.15.159:0/1371204430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f632c06d8a0 0x7f632c06fd60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6338006fd0 tx=0x7f6338008040 comp rx=0 tx=0).stop 2024-02-28T23:18:38.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.326+0000 7f634cc00700 1 -- 172.21.15.159:0/1371204430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6348069020 msgr2=0x7f634819ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:38.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.326+0000 7f634cc00700 1 --2- 172.21.15.159:0/1371204430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6348069020 0x7f634819ed60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f633400bda0 tx=0x7f633400be80 comp rx=0 tx=0).stop 2024-02-28T23:18:38.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.326+0000 7f634cc00700 1 -- 172.21.15.159:0/1371204430 shutdown_connections 2024-02-28T23:18:38.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.326+0000 7f634cc00700 1 --2- 172.21.15.159:0/1371204430 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6348068670 0x7f634819e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.326+0000 7f634cc00700 1 --2- 172.21.15.159:0/1371204430 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f632c06d8a0 0x7f632c06fd60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.326+0000 7f634cc00700 1 --2- 172.21.15.159:0/1371204430 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6348069020 0x7f634819ed60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.326+0000 7f634cc00700 1 -- 172.21.15.159:0/1371204430 >> 172.21.15.159:0/1371204430 conn(0x7f63480755a0 msgr2=0x7f63481027c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:38.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.327+0000 7f634cc00700 1 -- 172.21.15.159:0/1371204430 shutdown_connections 2024-02-28T23:18:38.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.327+0000 7f634cc00700 1 -- 172.21.15.159:0/1371204430 wait complete. 2024-02-28T23:18:38.342 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:18:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.484+0000 7f49a3a00700 1 -- 172.21.15.159:0/3689763190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f499c100da0 msgr2=0x7f499c101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.484+0000 7f49a3a00700 1 --2- 172.21.15.159:0/3689763190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f499c100da0 0x7f499c101180 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f4990009910 tx=0x7f4990009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.484+0000 7f49a3a00700 1 -- 172.21.15.159:0/3689763190 shutdown_connections 2024-02-28T23:18:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.484+0000 7f49a3a00700 1 --2- 172.21.15.159:0/3689763190 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f499c101750 0x7f499c1057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.484+0000 7f49a3a00700 1 --2- 172.21.15.159:0/3689763190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f499c100da0 0x7f499c101180 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.484+0000 7f49a3a00700 1 -- 172.21.15.159:0/3689763190 >> 172.21.15.159:0/3689763190 conn(0x7f499c0fc630 msgr2=0x7f499c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.484+0000 7f49a3a00700 1 -- 172.21.15.159:0/3689763190 shutdown_connections 2024-02-28T23:18:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.484+0000 7f49a3a00700 1 -- 172.21.15.159:0/3689763190 wait complete. 2024-02-28T23:18:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.485+0000 7f49a3a00700 1 Processor -- start 2024-02-28T23:18:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.485+0000 7f49a3a00700 1 -- start start 2024-02-28T23:18:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.486+0000 7f49a3a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f499c100da0 0x7f499c073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.486+0000 7f49a3a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f499c101750 0x7f499c0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.486+0000 7f49a3a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c073b10 con 0x7f499c101750 2024-02-28T23:18:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.486+0000 7f49a3a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499c073c50 con 0x7f499c100da0 2024-02-28T23:18:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.486+0000 7f499be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f499c101750 0x7f499c0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.486+0000 7f499be00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f499c101750 0x7f499c0735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35424/0 (socket says 172.21.15.159:35424) 2024-02-28T23:18:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.486+0000 7f499be00700 1 -- 172.21.15.159:0/3107989481 learned_addr learned my addr 172.21.15.159:0/3107989481 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.486+0000 7f49a1000700 1 --2- 172.21.15.159:0/3107989481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f499c100da0 0x7f499c073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.487+0000 7f499be00700 1 -- 172.21.15.159:0/3107989481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f499c100da0 msgr2=0x7f499c073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.487+0000 7f499be00700 1 --2- 172.21.15.159:0/3107989481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f499c100da0 0x7f499c073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.487+0000 7f499be00700 1 -- 172.21.15.159:0/3107989481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49900095f0 con 0x7f499c101750 2024-02-28T23:18:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.487+0000 7f499be00700 1 --2- 172.21.15.159:0/3107989481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f499c101750 0x7f499c0735d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f498800b480 tx=0x7f498800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:38.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.487+0000 7f4999600700 1 -- 172.21.15.159:0/3107989481 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49880118c0 con 0x7f499c101750 2024-02-28T23:18:38.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.487+0000 7f4999600700 1 -- 172.21.15.159:0/3107989481 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4988010380 con 0x7f499c101750 2024-02-28T23:18:38.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.487+0000 7f4999600700 1 -- 172.21.15.159:0/3107989481 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f498800f4f0 con 0x7f499c101750 2024-02-28T23:18:38.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.487+0000 7f49a3a00700 1 -- 172.21.15.159:0/3107989481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499c1a2a40 con 0x7f499c101750 2024-02-28T23:18:38.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.487+0000 7f49a3a00700 1 -- 172.21.15.159:0/3107989481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499c1a2e50 con 0x7f499c101750 2024-02-28T23:18:38.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.489+0000 7f49a3a00700 1 -- 172.21.15.159:0/3107989481 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499c109140 con 0x7f499c101750 2024-02-28T23:18:38.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.490+0000 7f4999600700 1 -- 172.21.15.159:0/3107989481 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f49880104f0 con 0x7f499c101750 2024-02-28T23:18:38.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.490+0000 7f4999600700 1 --2- 172.21.15.159:0/3107989481 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f498406d8a0 0x7f498406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:38.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.491+0000 7f4999600700 1 -- 172.21.15.159:0/3107989481 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f498808d270 con 0x7f499c101750 2024-02-28T23:18:38.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.491+0000 7f49a1000700 1 --2- 172.21.15.159:0/3107989481 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f498406d8a0 0x7f498406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:38.492 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.492+0000 7f49a1000700 1 --2- 172.21.15.159:0/3107989481 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f498406d8a0 0x7f498406fd60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4990006010 tx=0x7f499001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:38.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.496+0000 7f4999600700 1 -- 172.21.15.159:0/3107989481 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4988056920 con 0x7f499c101750 2024-02-28T23:18:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:38 smithi184 ceph-mon[86482]: pgmap v225: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 103 B/s rd, 0 op/s 2024-02-28T23:18:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:18:38.618 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:38 smithi159 ceph-mon[113833]: pgmap v225: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 103 B/s rd, 0 op/s 2024-02-28T23:18:38.618 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:38.618 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:18:38.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.773+0000 7f49a3a00700 1 -- 172.21.15.159:0/3107989481 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f499c02cd30 con 0x7f498406d8a0 2024-02-28T23:18:38.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.775+0000 7f4999600700 1 -- 172.21.15.159:0/3107989481 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f499c02cd30 con 0x7f498406d8a0 2024-02-28T23:18:38.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.778+0000 7f49a3a00700 1 -- 172.21.15.159:0/3107989481 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f498406d8a0 msgr2=0x7f498406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:38.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.778+0000 7f49a3a00700 1 --2- 172.21.15.159:0/3107989481 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f498406d8a0 0x7f498406fd60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4990006010 tx=0x7f499001a040 comp rx=0 tx=0).stop 2024-02-28T23:18:38.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.778+0000 7f49a3a00700 1 -- 172.21.15.159:0/3107989481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f499c101750 msgr2=0x7f499c0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:38.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.778+0000 7f49a3a00700 1 --2- 172.21.15.159:0/3107989481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f499c101750 0x7f499c0735d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f498800b480 tx=0x7f498800b840 comp rx=0 tx=0).stop 2024-02-28T23:18:38.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.779+0000 7f49a3a00700 1 -- 172.21.15.159:0/3107989481 shutdown_connections 2024-02-28T23:18:38.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.779+0000 7f49a3a00700 1 --2- 172.21.15.159:0/3107989481 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f499c100da0 0x7f499c073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.779+0000 7f49a3a00700 1 --2- 172.21.15.159:0/3107989481 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f498406d8a0 0x7f498406fd60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.779+0000 7f49a3a00700 1 --2- 172.21.15.159:0/3107989481 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f499c101750 0x7f499c0735d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.779+0000 7f49a3a00700 1 -- 172.21.15.159:0/3107989481 >> 172.21.15.159:0/3107989481 conn(0x7f499c0fc630 msgr2=0x7f499c0fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:38.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.779+0000 7f49a3a00700 1 -- 172.21.15.159:0/3107989481 shutdown_connections 2024-02-28T23:18:38.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.779+0000 7f49a3a00700 1 -- 172.21.15.159:0/3107989481 wait complete. 2024-02-28T23:18:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.942+0000 7f7661800700 1 -- 172.21.15.159:0/2560644039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f765c100da0 msgr2=0x7f765c101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.942+0000 7f7661800700 1 --2- 172.21.15.159:0/2560644039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f765c100da0 0x7f765c101180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f764c009910 tx=0x7f764c009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.942+0000 7f7661800700 1 -- 172.21.15.159:0/2560644039 shutdown_connections 2024-02-28T23:18:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.942+0000 7f7661800700 1 --2- 172.21.15.159:0/2560644039 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f765c101750 0x7f765c1057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.942+0000 7f7661800700 1 --2- 172.21.15.159:0/2560644039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f765c100da0 0x7f765c101180 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.942+0000 7f7661800700 1 -- 172.21.15.159:0/2560644039 >> 172.21.15.159:0/2560644039 conn(0x7f765c0fc630 msgr2=0x7f765c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:38.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.943+0000 7f7661800700 1 -- 172.21.15.159:0/2560644039 shutdown_connections 2024-02-28T23:18:38.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.943+0000 7f7661800700 1 -- 172.21.15.159:0/2560644039 wait complete. 2024-02-28T23:18:38.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.944+0000 7f7661800700 1 Processor -- start 2024-02-28T23:18:38.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.944+0000 7f7661800700 1 -- start start 2024-02-28T23:18:38.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.945+0000 7f7661800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f765c100da0 0x7f765c073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:38.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.945+0000 7f7661800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f765c101750 0x7f765c0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:38.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.945+0000 7f7661800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c073b10 con 0x7f765c101750 2024-02-28T23:18:38.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.945+0000 7f7661800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f765c073c50 con 0x7f765c100da0 2024-02-28T23:18:38.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.945+0000 7f7653e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f765c101750 0x7f765c0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:38.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.945+0000 7f7653e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f765c101750 0x7f765c0735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35466/0 (socket says 172.21.15.159:35466) 2024-02-28T23:18:38.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.945+0000 7f7653e00700 1 -- 172.21.15.159:0/1985559609 learned_addr learned my addr 172.21.15.159:0/1985559609 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:38.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.946+0000 7f765aa00700 1 --2- 172.21.15.159:0/1985559609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f765c100da0 0x7f765c073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:38.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.946+0000 7f7653e00700 1 -- 172.21.15.159:0/1985559609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f765c100da0 msgr2=0x7f765c073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:38.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.946+0000 7f7653e00700 1 --2- 172.21.15.159:0/1985559609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f765c100da0 0x7f765c073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:38.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.946+0000 7f7653e00700 1 -- 172.21.15.159:0/1985559609 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c0095f0 con 0x7f765c101750 2024-02-28T23:18:38.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.946+0000 7f7653e00700 1 --2- 172.21.15.159:0/1985559609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f765c101750 0x7f765c0735d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f764400d900 tx=0x7f764400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:38.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.946+0000 7f7653400700 1 -- 172.21.15.159:0/1985559609 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7644009900 con 0x7f765c101750 2024-02-28T23:18:38.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.947+0000 7f7661800700 1 -- 172.21.15.159:0/1985559609 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f765c1a29a0 con 0x7f765c101750 2024-02-28T23:18:38.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.947+0000 7f7653400700 1 -- 172.21.15.159:0/1985559609 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7644010460 con 0x7f765c101750 2024-02-28T23:18:38.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.947+0000 7f7653400700 1 -- 172.21.15.159:0/1985559609 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f764400f5f0 con 0x7f765c101750 2024-02-28T23:18:38.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.947+0000 7f7661800700 1 -- 172.21.15.159:0/1985559609 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f765c1a2db0 con 0x7f765c101750 2024-02-28T23:18:38.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.948+0000 7f7661800700 1 -- 172.21.15.159:0/1985559609 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f765c109140 con 0x7f765c101750 2024-02-28T23:18:38.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.949+0000 7f7653400700 1 -- 172.21.15.159:0/1985559609 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f76440105d0 con 0x7f765c101750 2024-02-28T23:18:38.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.950+0000 7f7653400700 1 --2- 172.21.15.159:0/1985559609 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f764006d8a0 0x7f764006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:38.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.950+0000 7f7653400700 1 -- 172.21.15.159:0/1985559609 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f764408d2e0 con 0x7f765c101750 2024-02-28T23:18:38.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.950+0000 7f765aa00700 1 --2- 172.21.15.159:0/1985559609 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f764006d8a0 0x7f764006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:38.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.951+0000 7f765aa00700 1 --2- 172.21.15.159:0/1985559609 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f764006d8a0 0x7f764006fd60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f764c006010 tx=0x7f764c01a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:38.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:38.955+0000 7f7653400700 1 -- 172.21.15.159:0/1985559609 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7644056ab0 con 0x7f765c101750 2024-02-28T23:18:39.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.188+0000 7f7661800700 1 -- 172.21.15.159:0/1985559609 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f765c02cd30 con 0x7f764006d8a0 2024-02-28T23:18:39.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.211+0000 7f7653400700 1 -- 172.21.15.159:0/1985559609 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f765c02cd30 con 0x7f764006d8a0 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (8m) 2m ago 22m 13.9M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (22m) 2m ago 22m 8988k - 18.2.1 5be31c24972a 82cdd8d3ab81 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (21m) 21s ago 21m 8724k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (4m) 2m ago 22m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (4m) 21s ago 21m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (7m) 2m ago 22m 73.5M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (15m) 2m ago 15m 147M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 starting - - - - 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (15m) 21s ago 15m 19.1M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (14m) 21s ago 14m 19.0M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (11m) 2m ago 24m 502M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:18:39.211 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (9m) 21s ago 21m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:18:39.212 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (5m) 2m ago 24m 48.0M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:18:39.212 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (5m) 21s ago 20m 37.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:18:39.212 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (9m) 2m ago 22m 7884k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:18:39.212 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (9m) 21s ago 21m 7990k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:18:39.212 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (3m) 2m ago 19m 114M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:18:39.212 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (2m) 2m ago 19m 97.5M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9120e23d80c0 2024-02-28T23:18:39.212 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (2m) 2m ago 18m 11.1M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 952e59c58165 2024-02-28T23:18:39.212 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (110s) 21s ago 18m 100M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 643ebdb823be 2024-02-28T23:18:39.212 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (69s) 21s ago 17m 99.1M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b dc8cef678e65 2024-02-28T23:18:39.212 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (27s) 21s ago 17m 11.3M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 1426063f8d8e 2024-02-28T23:18:39.212 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (8m) 2m ago 21m 55.0M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:18:39.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.214+0000 7f7661800700 1 -- 172.21.15.159:0/1985559609 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f764006d8a0 msgr2=0x7f764006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:39.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.214+0000 7f7661800700 1 --2- 172.21.15.159:0/1985559609 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f764006d8a0 0x7f764006fd60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f764c006010 tx=0x7f764c01a040 comp rx=0 tx=0).stop 2024-02-28T23:18:39.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.214+0000 7f7661800700 1 -- 172.21.15.159:0/1985559609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f765c101750 msgr2=0x7f765c0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:39.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.214+0000 7f7661800700 1 --2- 172.21.15.159:0/1985559609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f765c101750 0x7f765c0735d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f764400d900 tx=0x7f764400dcc0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.214+0000 7f7661800700 1 -- 172.21.15.159:0/1985559609 shutdown_connections 2024-02-28T23:18:39.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.214+0000 7f7661800700 1 --2- 172.21.15.159:0/1985559609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f765c100da0 0x7f765c073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.214+0000 7f7661800700 1 --2- 172.21.15.159:0/1985559609 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f764006d8a0 0x7f764006fd60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.214+0000 7f7661800700 1 --2- 172.21.15.159:0/1985559609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f765c101750 0x7f765c0735d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.214+0000 7f7661800700 1 -- 172.21.15.159:0/1985559609 >> 172.21.15.159:0/1985559609 conn(0x7f765c0fc630 msgr2=0x7f765c0fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:39.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.214+0000 7f7661800700 1 -- 172.21.15.159:0/1985559609 shutdown_connections 2024-02-28T23:18:39.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.214+0000 7f7661800700 1 -- 172.21.15.159:0/1985559609 wait complete. 2024-02-28T23:18:39.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.374+0000 7faea5800700 1 -- 172.21.15.159:0/3838871824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea0073a50 msgr2=0x7faea0111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:39.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.375+0000 7faea5800700 1 --2- 172.21.15.159:0/3838871824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea0073a50 0x7faea0111610 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fae88009910 tx=0x7fae88009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:39.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.375+0000 7faea5800700 1 -- 172.21.15.159:0/3838871824 shutdown_connections 2024-02-28T23:18:39.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.375+0000 7faea5800700 1 --2- 172.21.15.159:0/3838871824 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea0073a50 0x7faea0111610 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.375+0000 7faea5800700 1 --2- 172.21.15.159:0/3838871824 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faea0073130 0x7faea0073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.375+0000 7faea5800700 1 -- 172.21.15.159:0/3838871824 >> 172.21.15.159:0/3838871824 conn(0x7faea00fc630 msgr2=0x7faea00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:39.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.375+0000 7faea5800700 1 -- 172.21.15.159:0/3838871824 shutdown_connections 2024-02-28T23:18:39.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.375+0000 7faea5800700 1 -- 172.21.15.159:0/3838871824 wait complete. 2024-02-28T23:18:39.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.377+0000 7faea5800700 1 Processor -- start 2024-02-28T23:18:39.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.377+0000 7faea5800700 1 -- start start 2024-02-28T23:18:39.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.377+0000 7faea5800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faea0073130 0x7faea019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:39.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.378+0000 7faea5800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea0073a50 0x7faea019d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:39.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.378+0000 7faea5800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea019d930 con 0x7faea0073a50 2024-02-28T23:18:39.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.378+0000 7faea5800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faea01a16c0 con 0x7faea0073130 2024-02-28T23:18:39.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.378+0000 7fae97e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea0073a50 0x7faea019d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:39.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.378+0000 7fae97e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea0073a50 0x7faea019d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35486/0 (socket says 172.21.15.159:35486) 2024-02-28T23:18:39.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.378+0000 7fae97e00700 1 -- 172.21.15.159:0/2993833396 learned_addr learned my addr 172.21.15.159:0/2993833396 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:39.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.378+0000 7fae9ea00700 1 --2- 172.21.15.159:0/2993833396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faea0073130 0x7faea019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:39.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.379+0000 7fae97e00700 1 -- 172.21.15.159:0/2993833396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faea0073130 msgr2=0x7faea019cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:39.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.379+0000 7fae97e00700 1 --2- 172.21.15.159:0/2993833396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faea0073130 0x7faea019cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.379+0000 7fae97e00700 1 -- 172.21.15.159:0/2993833396 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae880095f0 con 0x7faea0073a50 2024-02-28T23:18:39.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.379+0000 7fae97e00700 1 --2- 172.21.15.159:0/2993833396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea0073a50 0x7faea019d250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fae8800b5c0 tx=0x7fae8800bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:39.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.380+0000 7fae97400700 1 -- 172.21.15.159:0/2993833396 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae8801d070 con 0x7faea0073a50 2024-02-28T23:18:39.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.380+0000 7fae97400700 1 -- 172.21.15.159:0/2993833396 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fae8800f460 con 0x7faea0073a50 2024-02-28T23:18:39.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.380+0000 7fae97400700 1 -- 172.21.15.159:0/2993833396 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae88017610 con 0x7faea0073a50 2024-02-28T23:18:39.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.380+0000 7faea5800700 1 -- 172.21.15.159:0/2993833396 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faea01a19a0 con 0x7faea0073a50 2024-02-28T23:18:39.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.380+0000 7faea5800700 1 -- 172.21.15.159:0/2993833396 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faea01a1ef0 con 0x7faea0073a50 2024-02-28T23:18:39.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.381+0000 7faea5800700 1 -- 172.21.15.159:0/2993833396 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faea010ed90 con 0x7faea0073a50 2024-02-28T23:18:39.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.382+0000 7fae97400700 1 -- 172.21.15.159:0/2993833396 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fae8800f5d0 con 0x7faea0073a50 2024-02-28T23:18:39.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.383+0000 7fae97400700 1 --2- 172.21.15.159:0/2993833396 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fae8406d8a0 0x7fae8406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:39.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.383+0000 7fae97400700 1 -- 172.21.15.159:0/2993833396 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fae8808ea40 con 0x7faea0073a50 2024-02-28T23:18:39.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.383+0000 7fae9ea00700 1 --2- 172.21.15.159:0/2993833396 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fae8406d8a0 0x7fae8406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:39.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.384+0000 7fae9ea00700 1 --2- 172.21.15.159:0/2993833396 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fae8406d8a0 0x7fae8406fd60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae90005950 tx=0x7fae9000a300 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.388+0000 7fae97400700 1 -- 172.21.15.159:0/2993833396 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fae88058170 con 0x7faea0073a50 2024-02-28T23:18:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:39 smithi159 ceph-mon[113833]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:39 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:39 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:39 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:39.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:39 smithi184 ceph-mon[86482]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:39.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:39 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:39.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:39 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:39.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:39 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:39.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.720+0000 7faea5800700 1 -- 172.21.15.159:0/2993833396 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7faea004ea90 con 0x7faea0073a50 2024-02-28T23:18:39.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.720+0000 7fae97400700 1 -- 172.21.15.159:0/2993833396 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7fae8805b830 con 0x7faea0073a50 2024-02-28T23:18:39.720 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:18:39.720 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:18:39.720 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:18:39.720 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:18:39.720 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:18:39.720 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:18:39.720 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:18:39.720 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:18:39.721 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T23:18:39.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:18:39.721 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:18:39.721 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 3, 2024-02-28T23:18:39.721 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 1 2024-02-28T23:18:39.721 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:18:39.721 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:18:39.721 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 3, 2024-02-28T23:18:39.721 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 11 2024-02-28T23:18:39.721 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:18:39.721 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:18:39.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.723+0000 7faea5800700 1 -- 172.21.15.159:0/2993833396 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fae8406d8a0 msgr2=0x7fae8406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:39.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.723+0000 7faea5800700 1 --2- 172.21.15.159:0/2993833396 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fae8406d8a0 0x7fae8406fd60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fae90005950 tx=0x7fae9000a300 comp rx=0 tx=0).stop 2024-02-28T23:18:39.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.723+0000 7faea5800700 1 -- 172.21.15.159:0/2993833396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea0073a50 msgr2=0x7faea019d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:39.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.723+0000 7faea5800700 1 --2- 172.21.15.159:0/2993833396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea0073a50 0x7faea019d250 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fae8800b5c0 tx=0x7fae8800bd50 comp rx=0 tx=0).stop 2024-02-28T23:18:39.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.723+0000 7faea5800700 1 -- 172.21.15.159:0/2993833396 shutdown_connections 2024-02-28T23:18:39.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.723+0000 7faea5800700 1 --2- 172.21.15.159:0/2993833396 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faea0073130 0x7faea019cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.723+0000 7faea5800700 1 --2- 172.21.15.159:0/2993833396 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fae8406d8a0 0x7fae8406fd60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.723+0000 7faea5800700 1 --2- 172.21.15.159:0/2993833396 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faea0073a50 0x7faea019d250 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.723+0000 7faea5800700 1 -- 172.21.15.159:0/2993833396 >> 172.21.15.159:0/2993833396 conn(0x7faea00fc630 msgr2=0x7faea0103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:39.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.724+0000 7faea5800700 1 -- 172.21.15.159:0/2993833396 shutdown_connections 2024-02-28T23:18:39.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.724+0000 7faea5800700 1 -- 172.21.15.159:0/2993833396 wait complete. 2024-02-28T23:18:39.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.882+0000 7f6e97600700 1 -- 172.21.15.159:0/4277220874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e901071d0 msgr2=0x7f6e90107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:39.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.882+0000 7f6e97600700 1 --2- 172.21.15.159:0/4277220874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e901071d0 0x7f6e90107650 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c009910 tx=0x7f6e7c009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:39.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.882+0000 7f6e97600700 1 -- 172.21.15.159:0/4277220874 shutdown_connections 2024-02-28T23:18:39.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.882+0000 7f6e97600700 1 --2- 172.21.15.159:0/4277220874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e901071d0 0x7f6e90107650 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.882+0000 7f6e97600700 1 --2- 172.21.15.159:0/4277220874 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e9010d280 0x7f6e9010d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.882+0000 7f6e97600700 1 -- 172.21.15.159:0/4277220874 >> 172.21.15.159:0/4277220874 conn(0x7f6e900769e0 msgr2=0x7f6e90078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:39.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.882+0000 7f6e97600700 1 -- 172.21.15.159:0/4277220874 shutdown_connections 2024-02-28T23:18:39.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.882+0000 7f6e97600700 1 -- 172.21.15.159:0/4277220874 wait complete. 2024-02-28T23:18:39.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.883+0000 7f6e97600700 1 Processor -- start 2024-02-28T23:18:39.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.883+0000 7f6e97600700 1 -- start start 2024-02-28T23:18:39.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.883+0000 7f6e97600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e901071d0 0x7f6e9019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:39.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.883+0000 7f6e97600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e9010d280 0x7f6e9019d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:39.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.883+0000 7f6e97600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9019da30 con 0x7f6e9010d280 2024-02-28T23:18:39.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.883+0000 7f6e97600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e901a17c0 con 0x7f6e901071d0 2024-02-28T23:18:39.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.884+0000 7f6e8fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e9010d280 0x7f6e9019d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:39.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.884+0000 7f6e8fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e9010d280 0x7f6e9019d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35504/0 (socket says 172.21.15.159:35504) 2024-02-28T23:18:39.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.884+0000 7f6e8fe00700 1 -- 172.21.15.159:0/1188093274 learned_addr learned my addr 172.21.15.159:0/1188093274 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:39.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.884+0000 7f6e8fe00700 1 -- 172.21.15.159:0/1188093274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e901071d0 msgr2=0x7f6e9019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:39.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.884+0000 7f6e8fe00700 1 --2- 172.21.15.159:0/1188093274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e901071d0 0x7f6e9019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:39.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.884+0000 7f6e8fe00700 1 -- 172.21.15.159:0/1188093274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7c0095f0 con 0x7f6e9010d280 2024-02-28T23:18:39.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.884+0000 7f6e8fe00700 1 --2- 172.21.15.159:0/1188093274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e9010d280 0x7f6e9019d350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c006010 tx=0x7f6e7c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:39.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.885+0000 7f6e8d600700 1 -- 172.21.15.159:0/1188093274 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7c01d070 con 0x7f6e9010d280 2024-02-28T23:18:39.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.885+0000 7f6e8d600700 1 -- 172.21.15.159:0/1188093274 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f6e7c004fb0 con 0x7f6e9010d280 2024-02-28T23:18:39.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.885+0000 7f6e8d600700 1 -- 172.21.15.159:0/1188093274 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e7c022ea0 con 0x7f6e9010d280 2024-02-28T23:18:39.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.885+0000 7f6e97600700 1 -- 172.21.15.159:0/1188093274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e901a1a40 con 0x7f6e9010d280 2024-02-28T23:18:39.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.885+0000 7f6e97600700 1 -- 172.21.15.159:0/1188093274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e901a1fb0 con 0x7f6e9010d280 2024-02-28T23:18:39.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.886+0000 7f6e97600700 1 -- 172.21.15.159:0/1188093274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9010f710 con 0x7f6e9010d280 2024-02-28T23:18:39.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.887+0000 7f6e8d600700 1 -- 172.21.15.159:0/1188093274 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f6e7c022470 con 0x7f6e9010d280 2024-02-28T23:18:39.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.888+0000 7f6e8d600700 1 --2- 172.21.15.159:0/1188093274 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6e7806d8a0 0x7f6e7806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:39.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.888+0000 7f6e8d600700 1 -- 172.21.15.159:0/1188093274 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f6e7c08eab0 con 0x7f6e9010d280 2024-02-28T23:18:39.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.888+0000 7f6e94c00700 1 --2- 172.21.15.159:0/1188093274 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6e7806d8a0 0x7f6e7806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:39.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.889+0000 7f6e94c00700 1 --2- 172.21.15.159:0/1188093274 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6e7806d8a0 0x7f6e7806fd60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e840097b0 tx=0x7f6e84006d20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:39.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:39.893+0000 7f6e8d600700 1 -- 172.21.15.159:0/1188093274 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6e7c090e60 con 0x7f6e9010d280 2024-02-28T23:18:40.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.158+0000 7f6e97600700 1 -- 172.21.15.159:0/1188093274 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6e9004ea90 con 0x7f6e9010d280 2024-02-28T23:18:40.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.159+0000 7f6e8d600700 1 -- 172.21.15.159:0/1188093274 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f6e7c058290 con 0x7f6e9010d280 2024-02-28T23:18:40.159 INFO:teuthology.orchestra.run.smithi159.stdout:e22 2024-02-28T23:18:40.159 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:18:40.159 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:18:40.159 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:18:40.159 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:18:40.159 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:18:40.159 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 19 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:18:27.005585+0000 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 0 2024-02-28T23:18:40.160 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=14472} 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:18:40.161 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:14472} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.159:6828/455979918,v1:172.21.15.159:6829/455979918] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:18:40.162 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:18:40.162 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:18:40.162 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:18:40.162 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:18:40.162 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:24265} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:18:40.162 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:18:40.162 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{-1:34440} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:18:40.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.162+0000 7f6e97600700 1 -- 172.21.15.159:0/1188093274 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6e7806d8a0 msgr2=0x7f6e7806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:40.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.162+0000 7f6e97600700 1 --2- 172.21.15.159:0/1188093274 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6e7806d8a0 0x7f6e7806fd60 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6e840097b0 tx=0x7f6e84006d20 comp rx=0 tx=0).stop 2024-02-28T23:18:40.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.162+0000 7f6e97600700 1 -- 172.21.15.159:0/1188093274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e9010d280 msgr2=0x7f6e9019d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:40.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.162+0000 7f6e97600700 1 --2- 172.21.15.159:0/1188093274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e9010d280 0x7f6e9019d350 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c006010 tx=0x7f6e7c00be20 comp rx=0 tx=0).stop 2024-02-28T23:18:40.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.162+0000 7f6e97600700 1 -- 172.21.15.159:0/1188093274 shutdown_connections 2024-02-28T23:18:40.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.162+0000 7f6e97600700 1 --2- 172.21.15.159:0/1188093274 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6e901071d0 0x7f6e9019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.162+0000 7f6e97600700 1 --2- 172.21.15.159:0/1188093274 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f6e7806d8a0 0x7f6e7806fd60 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.162+0000 7f6e97600700 1 --2- 172.21.15.159:0/1188093274 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e9010d280 0x7f6e9019d350 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.162+0000 7f6e97600700 1 -- 172.21.15.159:0/1188093274 >> 172.21.15.159:0/1188093274 conn(0x7f6e900769e0 msgr2=0x7f6e900784d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:40.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.162+0000 7f6e97600700 1 -- 172.21.15.159:0/1188093274 shutdown_connections 2024-02-28T23:18:40.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.162+0000 7f6e97600700 1 -- 172.21.15.159:0/1188093274 wait complete. 2024-02-28T23:18:40.164 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 22 2024-02-28T23:18:40.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.313+0000 7f98eea00700 1 -- 172.21.15.159:0/1395195627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98e80ffbd0 msgr2=0x7f98e8100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:40.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.313+0000 7f98eea00700 1 --2- 172.21.15.159:0/1395195627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98e80ffbd0 0x7f98e8100050 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009910 tx=0x7f98d4009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:40.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.313+0000 7f98eea00700 1 -- 172.21.15.159:0/1395195627 shutdown_connections 2024-02-28T23:18:40.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.313+0000 7f98eea00700 1 --2- 172.21.15.159:0/1395195627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98e80ffbd0 0x7f98e8100050 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.313+0000 7f98eea00700 1 --2- 172.21.15.159:0/1395195627 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e8105a40 0x7f98e8105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.313+0000 7f98eea00700 1 -- 172.21.15.159:0/1395195627 >> 172.21.15.159:0/1395195627 conn(0x7f98e80755a0 msgr2=0x7f98e80759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:40.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.313+0000 7f98eea00700 1 -- 172.21.15.159:0/1395195627 shutdown_connections 2024-02-28T23:18:40.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.313+0000 7f98eea00700 1 -- 172.21.15.159:0/1395195627 wait complete. 2024-02-28T23:18:40.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.314+0000 7f98eea00700 1 Processor -- start 2024-02-28T23:18:40.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.314+0000 7f98eea00700 1 -- start start 2024-02-28T23:18:40.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.315+0000 7f98eea00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e80ffbd0 0x7f98e819e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:40.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.315+0000 7f98eea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98e8105a40 0x7f98e819ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:40.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.315+0000 7f98eea00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e819f2c0 con 0x7f98e8105a40 2024-02-28T23:18:40.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.315+0000 7f98eea00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8198770 con 0x7f98e80ffbd0 2024-02-28T23:18:40.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.315+0000 7f98e7400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98e8105a40 0x7f98e819ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:40.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.315+0000 7f98e7400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98e8105a40 0x7f98e819ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35520/0 (socket says 172.21.15.159:35520) 2024-02-28T23:18:40.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.315+0000 7f98e7400700 1 -- 172.21.15.159:0/3620575594 learned_addr learned my addr 172.21.15.159:0/3620575594 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:40.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.315+0000 7f98e7e00700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e80ffbd0 0x7f98e819e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:40.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.316+0000 7f98e7400700 1 -- 172.21.15.159:0/3620575594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e80ffbd0 msgr2=0x7f98e819e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:40.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.316+0000 7f98e7400700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e80ffbd0 0x7f98e819e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.316+0000 7f98e7400700 1 -- 172.21.15.159:0/3620575594 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d40095f0 con 0x7f98e8105a40 2024-02-28T23:18:40.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.316+0000 7f98e7e00700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e80ffbd0 0x7f98e819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:18:40.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.316+0000 7f98e7400700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98e8105a40 0x7f98e819ec30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f98d40092e0 tx=0x7f98d400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:40.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.316+0000 7f98e4c00700 1 -- 172.21.15.159:0/3620575594 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d401d070 con 0x7f98e8105a40 2024-02-28T23:18:40.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.316+0000 7f98e4c00700 1 -- 172.21.15.159:0/3620575594 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f98d4005e00 con 0x7f98e8105a40 2024-02-28T23:18:40.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.316+0000 7f98e4c00700 1 -- 172.21.15.159:0/3620575594 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d4017400 con 0x7f98e8105a40 2024-02-28T23:18:40.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.316+0000 7f98eea00700 1 -- 172.21.15.159:0/3620575594 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e81989f0 con 0x7f98e8105a40 2024-02-28T23:18:40.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.316+0000 7f98eea00700 1 -- 172.21.15.159:0/3620575594 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e8198e90 con 0x7f98e8105a40 2024-02-28T23:18:40.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.318+0000 7f98eea00700 1 -- 172.21.15.159:0/3620575594 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e804ea90 con 0x7f98e8105a40 2024-02-28T23:18:40.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.319+0000 7f98e4c00700 1 -- 172.21.15.159:0/3620575594 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f98d400f460 con 0x7f98e8105a40 2024-02-28T23:18:40.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.319+0000 7f98e4c00700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f98cc06d8a0 0x7f98cc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:40.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.320+0000 7f98e4c00700 1 -- 172.21.15.159:0/3620575594 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6675+0+0 (secure 0 0 0) 0x7f98d408eac0 con 0x7f98e8105a40 2024-02-28T23:18:40.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.320+0000 7f98e7e00700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f98cc06d8a0 0x7f98cc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:40.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.320+0000 7f98e7e00700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f98cc06d8a0 0x7f98cc06fd60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f98d8005fd0 tx=0x7f98d8005ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:40.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.325+0000 7f98e4c00700 1 -- 172.21.15.159:0/3620575594 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f98d405bd40 con 0x7f98e8105a40 2024-02-28T23:18:40.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.590+0000 7f98eea00700 1 -- 172.21.15.159:0/3620575594 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f98e8199270 con 0x7f98cc06d8a0 2024-02-28T23:18:40.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:40 smithi159 ceph-mon[113833]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:40.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:40 smithi159 ceph-mon[113833]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:40.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:40 smithi159 ceph-mon[113833]: pgmap v226: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-02-28T23:18:40.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:40 smithi159 ceph-mon[113833]: mds.? [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] up:boot 2024-02-28T23:18:40.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:40 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 3 up:standby 2024-02-28T23:18:40.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:40 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:18:40.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:40 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2993833396' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:40.590 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:40 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1188093274' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:18:40.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.592+0000 7f98e4c00700 1 -- 172.21.15.159:0/3620575594 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f98e8199270 con 0x7f98cc06d8a0 2024-02-28T23:18:40.591 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:18:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:18:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:18:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:18:40.591 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:18:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-02-28T23:18:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "osd", 2024-02-28T23:18:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:18:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:18:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:18:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "12/23 daemons upgraded", 2024-02-28T23:18:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T23:18:40.592 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:18:40.592 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:18:40.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.594+0000 7f98eea00700 1 -- 172.21.15.159:0/3620575594 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f98cc06d8a0 msgr2=0x7f98cc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:40.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.594+0000 7f98eea00700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f98cc06d8a0 0x7f98cc06fd60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f98d8005fd0 tx=0x7f98d8005ee0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.594+0000 7f98eea00700 1 -- 172.21.15.159:0/3620575594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98e8105a40 msgr2=0x7f98e819ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:40.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.594+0000 7f98eea00700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98e8105a40 0x7f98e819ec30 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f98d40092e0 tx=0x7f98d400be20 comp rx=0 tx=0).stop 2024-02-28T23:18:40.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.594+0000 7f98eea00700 1 -- 172.21.15.159:0/3620575594 shutdown_connections 2024-02-28T23:18:40.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.594+0000 7f98eea00700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f98e80ffbd0 0x7f98e819e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.594+0000 7f98eea00700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f98cc06d8a0 0x7f98cc06fd60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.594+0000 7f98eea00700 1 --2- 172.21.15.159:0/3620575594 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f98e8105a40 0x7f98e819ec30 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.594+0000 7f98eea00700 1 -- 172.21.15.159:0/3620575594 >> 172.21.15.159:0/3620575594 conn(0x7f98e80755a0 msgr2=0x7f98e8068410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:40.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.594+0000 7f98eea00700 1 -- 172.21.15.159:0/3620575594 shutdown_connections 2024-02-28T23:18:40.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.594+0000 7f98eea00700 1 -- 172.21.15.159:0/3620575594 wait complete. 2024-02-28T23:18:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:40 smithi184 ceph-mon[86482]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:40 smithi184 ceph-mon[86482]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:40 smithi184 ceph-mon[86482]: pgmap v226: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-02-28T23:18:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:40 smithi184 ceph-mon[86482]: mds.? [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] up:boot 2024-02-28T23:18:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:40 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi159.azxrct=up:active} 3 up:standby 2024-02-28T23:18:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:40 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:18:40.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:40 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2993833396' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:40.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:40 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1188093274' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:18:40.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.754+0000 7fb7cfa00700 1 -- 172.21.15.159:0/2293857236 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8073ae0 msgr2=0x7fb7c810ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:40.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.754+0000 7fb7cfa00700 1 --2- 172.21.15.159:0/2293857236 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8073ae0 0x7fb7c810ce40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4009910 tx=0x7fb7b4009c20 comp rx=0 tx=0).stop 2024-02-28T23:18:40.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.754+0000 7fb7cfa00700 1 -- 172.21.15.159:0/2293857236 shutdown_connections 2024-02-28T23:18:40.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.754+0000 7fb7cfa00700 1 --2- 172.21.15.159:0/2293857236 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8073ae0 0x7fb7c810ce40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.754+0000 7fb7cfa00700 1 --2- 172.21.15.159:0/2293857236 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c80731c0 0x7fb7c80735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.754+0000 7fb7cfa00700 1 -- 172.21.15.159:0/2293857236 >> 172.21.15.159:0/2293857236 conn(0x7fb7c80fc630 msgr2=0x7fb7c80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:40.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.755+0000 7fb7cfa00700 1 -- 172.21.15.159:0/2293857236 shutdown_connections 2024-02-28T23:18:40.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.755+0000 7fb7cfa00700 1 -- 172.21.15.159:0/2293857236 wait complete. 2024-02-28T23:18:40.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.756+0000 7fb7cfa00700 1 Processor -- start 2024-02-28T23:18:40.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.756+0000 7fb7cfa00700 1 -- start start 2024-02-28T23:18:40.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.756+0000 7fb7cfa00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c80731c0 0x7fb7c819e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:40.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.756+0000 7fb7cfa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8073ae0 0x7fb7c819ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:40.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.756+0000 7fb7cfa00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c819f3e0 con 0x7fb7c8073ae0 2024-02-28T23:18:40.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.756+0000 7fb7cfa00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c8198890 con 0x7fb7c80731c0 2024-02-28T23:18:40.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.756+0000 7fb7c7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8073ae0 0x7fb7c819ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:40.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.756+0000 7fb7c7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8073ae0 0x7fb7c819ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35530/0 (socket says 172.21.15.159:35530) 2024-02-28T23:18:40.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.756+0000 7fb7c7e00700 1 -- 172.21.15.159:0/1214466061 learned_addr learned my addr 172.21.15.159:0/1214466061 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:18:40.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.757+0000 7fb7cd000700 1 --2- 172.21.15.159:0/1214466061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c80731c0 0x7fb7c819e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:40.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.757+0000 7fb7c7e00700 1 -- 172.21.15.159:0/1214466061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c80731c0 msgr2=0x7fb7c819e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:40.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.757+0000 7fb7c7e00700 1 --2- 172.21.15.159:0/1214466061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c80731c0 0x7fb7c819e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:40.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.757+0000 7fb7c7e00700 1 -- 172.21.15.159:0/1214466061 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b40095f0 con 0x7fb7c8073ae0 2024-02-28T23:18:40.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.757+0000 7fb7c7e00700 1 --2- 172.21.15.159:0/1214466061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8073ae0 0x7fb7c819ed50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7b40092e0 tx=0x7fb7b400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:40.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.757+0000 7fb7c5600700 1 -- 172.21.15.159:0/1214466061 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7b401d070 con 0x7fb7c8073ae0 2024-02-28T23:18:40.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.757+0000 7fb7c5600700 1 -- 172.21.15.159:0/1214466061 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb7b400f460 con 0x7fb7c8073ae0 2024-02-28T23:18:40.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.757+0000 7fb7c5600700 1 -- 172.21.15.159:0/1214466061 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7b4017630 con 0x7fb7c8073ae0 2024-02-28T23:18:40.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.757+0000 7fb7cfa00700 1 -- 172.21.15.159:0/1214466061 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c8198b10 con 0x7fb7c8073ae0 2024-02-28T23:18:40.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.758+0000 7fb7cfa00700 1 -- 172.21.15.159:0/1214466061 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c8199000 con 0x7fb7c8073ae0 2024-02-28T23:18:40.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.759+0000 7fb7cfa00700 1 -- 172.21.15.159:0/1214466061 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c810a540 con 0x7fb7c8073ae0 2024-02-28T23:18:40.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.760+0000 7fb7c5600700 1 -- 172.21.15.159:0/1214466061 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fb7b400f5d0 con 0x7fb7c8073ae0 2024-02-28T23:18:40.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.761+0000 7fb7c5600700 1 --2- 172.21.15.159:0/1214466061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb7b006d8a0 0x7fb7b006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:18:40.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.761+0000 7fb7c5600700 1 -- 172.21.15.159:0/1214466061 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 6675+0+0 (secure 0 0 0) 0x7fb7b408ed90 con 0x7fb7c8073ae0 2024-02-28T23:18:40.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.761+0000 7fb7cd000700 1 --2- 172.21.15.159:0/1214466061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb7b006d8a0 0x7fb7b006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:18:40.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.762+0000 7fb7cd000700 1 --2- 172.21.15.159:0/1214466061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb7b006d8a0 0x7fb7b006fd60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc006fd0 tx=0x7fb7bc008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:18:40.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:40.764+0000 7fb7c5600700 1 -- 172.21.15.159:0/1214466061 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb7b405c070 con 0x7fb7c8073ae0 2024-02-28T23:18:41.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.073+0000 7fb7cfa00700 1 -- 172.21.15.159:0/1214466061 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb7c804ea90 con 0x7fb7c8073ae0 2024-02-28T23:18:41.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.074+0000 7fb7c5600700 1 -- 172.21.15.159:0/1214466061 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb7b405bc00 con 0x7fb7c8073ae0 2024-02-28T23:18:41.074 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_OK 2024-02-28T23:18:41.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.078+0000 7fb7cfa00700 1 -- 172.21.15.159:0/1214466061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb7b006d8a0 msgr2=0x7fb7b006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:41.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.078+0000 7fb7cfa00700 1 --2- 172.21.15.159:0/1214466061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb7b006d8a0 0x7fb7b006fd60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc006fd0 tx=0x7fb7bc008040 comp rx=0 tx=0).stop 2024-02-28T23:18:41.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.079+0000 7fb7cfa00700 1 -- 172.21.15.159:0/1214466061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8073ae0 msgr2=0x7fb7c819ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:18:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.079+0000 7fb7cfa00700 1 --2- 172.21.15.159:0/1214466061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8073ae0 0x7fb7c819ed50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb7b40092e0 tx=0x7fb7b400be00 comp rx=0 tx=0).stop 2024-02-28T23:18:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.079+0000 7fb7cfa00700 1 -- 172.21.15.159:0/1214466061 shutdown_connections 2024-02-28T23:18:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.079+0000 7fb7cfa00700 1 --2- 172.21.15.159:0/1214466061 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb7c80731c0 0x7fb7c819e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.079+0000 7fb7cfa00700 1 --2- 172.21.15.159:0/1214466061 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb7b006d8a0 0x7fb7b006fd60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.079+0000 7fb7cfa00700 1 --2- 172.21.15.159:0/1214466061 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb7c8073ae0 0x7fb7c819ed50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:18:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.079+0000 7fb7cfa00700 1 -- 172.21.15.159:0/1214466061 >> 172.21.15.159:0/1214466061 conn(0x7fb7c80fc630 msgr2=0x7fb7c8107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:18:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.079+0000 7fb7cfa00700 1 -- 172.21.15.159:0/1214466061 shutdown_connections 2024-02-28T23:18:41.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:18:41.079+0000 7fb7cfa00700 1 -- 172.21.15.159:0/1214466061 wait complete. 2024-02-28T23:18:41.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:41 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1214466061' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:18:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:41 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1214466061' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:18:42.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:42 smithi184 ceph-mon[86482]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:42.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:42 smithi184 ceph-mon[86482]: pgmap v227: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-02-28T23:18:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:42 smithi159 ceph-mon[113833]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:18:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:42 smithi159 ceph-mon[113833]: pgmap v227: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 102 B/s rd, 0 op/s 2024-02-28T23:18:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:44 smithi159 ceph-mon[113833]: pgmap v228: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:44.762 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:44 smithi184 ceph-mon[86482]: pgmap v228: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:46.617 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:46 smithi184 ceph-mon[86482]: pgmap v229: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:46.618 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:46 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:46.618 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:46 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:46 smithi159 ceph-mon[113833]: pgmap v229: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:46 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:46 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:48 smithi159 ceph-mon[113833]: pgmap v230: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:48.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:48 smithi184 ceph-mon[86482]: pgmap v230: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:48.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:48.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:50 smithi159 ceph-mon[113833]: pgmap v231: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:50 smithi184 ceph-mon[86482]: pgmap v231: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:52 smithi159 ceph-mon[113833]: pgmap v232: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:52 smithi184 ceph-mon[86482]: pgmap v232: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:53.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:18:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:18:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:54 smithi159 ceph-mon[113833]: pgmap v233: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:54.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:54.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:54.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:54.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:18:54.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:54.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:54 smithi184 ceph-mon[86482]: pgmap v233: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:54.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:54.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:54.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:54.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:18:54.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:55.676 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:55.676 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:55.676 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:55.676 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:55.676 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:55.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:18:55.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:55.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:55.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:55.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:18:56.661 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:56 smithi159 ceph-mon[113833]: pgmap v234: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:56.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:56 smithi184 ceph-mon[86482]: pgmap v234: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:57.949 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:57 smithi159 ceph-mon[113833]: Upgrade: Updating mds.cephfs.smithi159.azxrct 2024-02-28T23:18:57.949 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:57 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:57.949 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:57 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.azxrct", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:18:57.949 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:57 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:57.949 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:57 smithi159 ceph-mon[113833]: Deploying daemon mds.cephfs.smithi159.azxrct on smithi159 2024-02-28T23:18:57.949 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:57 smithi159 ceph-mon[113833]: pgmap v235: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:18:58.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:57 smithi184 ceph-mon[86482]: Upgrade: Updating mds.cephfs.smithi159.azxrct 2024-02-28T23:18:58.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:57 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:18:58.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:57 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi159.azxrct", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:18:58.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:57 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:18:58.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:57 smithi184 ceph-mon[86482]: Deploying daemon mds.cephfs.smithi159.azxrct on smithi159 2024-02-28T23:18:58.101 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:18:57 smithi184 ceph-mon[86482]: pgmap v235: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:00.193 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:18:59 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159[113829]: 2024-02-28T23:18:59.876+0000 7f1ccca00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T23:19:00.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:00 smithi159 ceph-mon[113833]: pgmap v236: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:00.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:00 smithi159 ceph-mon[113833]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T23:19:00.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:00 smithi159 ceph-mon[113833]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T23:19:00.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:00 smithi159 ceph-mon[113833]: osdmap e100: 6 total, 6 up, 6 in 2024-02-28T23:19:00.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:00 smithi159 ceph-mon[113833]: Standby daemon mds.cephfs.smithi184.pnifob assigned to filesystem cephfs as rank 0 2024-02-28T23:19:00.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:00 smithi159 ceph-mon[113833]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T23:19:00.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:00 smithi159 ceph-mon[113833]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T23:19:00.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:00 smithi159 ceph-mon[113833]: fsmap cephfs:1/1 {0=cephfs.smithi184.pnifob=up:replay} 2 up:standby 2024-02-28T23:19:00.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:00 smithi184 ceph-mon[86482]: pgmap v236: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:00.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:00 smithi184 ceph-mon[86482]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T23:19:00.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:00 smithi184 ceph-mon[86482]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T23:19:00.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:00 smithi184 ceph-mon[86482]: osdmap e100: 6 total, 6 up, 6 in 2024-02-28T23:19:00.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:00 smithi184 ceph-mon[86482]: Standby daemon mds.cephfs.smithi184.pnifob assigned to filesystem cephfs as rank 0 2024-02-28T23:19:00.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:00 smithi184 ceph-mon[86482]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T23:19:00.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:00 smithi184 ceph-mon[86482]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T23:19:00.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:00 smithi184 ceph-mon[86482]: fsmap cephfs:1/1 {0=cephfs.smithi184.pnifob=up:replay} 2 up:standby 2024-02-28T23:19:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:02 smithi184 ceph-mon[86482]: pgmap v238: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 409 KiB/s rd, 0 op/s 2024-02-28T23:19:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:02 smithi159 ceph-mon[113833]: pgmap v238: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 409 KiB/s rd, 0 op/s 2024-02-28T23:19:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:04 smithi184 ceph-mon[86482]: pgmap v239: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s rd, 2 op/s 2024-02-28T23:19:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:04 smithi159 ceph-mon[113833]: pgmap v239: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 5.2 MiB/s rd, 2 op/s 2024-02-28T23:19:06.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:06 smithi184 ceph-mon[86482]: pgmap v240: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-02-28T23:19:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:06 smithi159 ceph-mon[113833]: pgmap v240: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-02-28T23:19:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:08 smithi184 ceph-mon[86482]: pgmap v241: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T23:19:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:19:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:08 smithi159 ceph-mon[113833]: pgmap v241: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T23:19:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:19:10.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:10 smithi184 ceph-mon[86482]: pgmap v242: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T23:19:10.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:10 smithi184 ceph-mon[86482]: reconnect by client.24307 192.168.0.1:0/975766746 after 0.00299994 2024-02-28T23:19:10.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:10 smithi184 ceph-mon[86482]: reconnect by client.14528 192.168.0.1:0/432838846 after 0.00399992 2024-02-28T23:19:10.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:10 smithi184 ceph-mon[86482]: mds.? [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] up:reconnect 2024-02-28T23:19:10.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:10 smithi184 ceph-mon[86482]: fsmap cephfs:1/1 {0=cephfs.smithi184.pnifob=up:reconnect} 2 up:standby 2024-02-28T23:19:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:10 smithi159 ceph-mon[113833]: pgmap v242: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T23:19:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:10 smithi159 ceph-mon[113833]: reconnect by client.24307 192.168.0.1:0/975766746 after 0.00299994 2024-02-28T23:19:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:10 smithi159 ceph-mon[113833]: reconnect by client.14528 192.168.0.1:0/432838846 after 0.00399992 2024-02-28T23:19:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:10 smithi159 ceph-mon[113833]: mds.? [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] up:reconnect 2024-02-28T23:19:10.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:10 smithi159 ceph-mon[113833]: fsmap cephfs:1/1 {0=cephfs.smithi184.pnifob=up:reconnect} 2 up:standby 2024-02-28T23:19:11.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.256+0000 7f0578200700 1 -- 172.21.15.159:0/4223426538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05700731c0 msgr2=0x7f05700735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:11.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.256+0000 7f0578200700 1 --2- 172.21.15.159:0/4223426538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05700731c0 0x7f05700735a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0564009910 tx=0x7f0564009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:11.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.256+0000 7f0578200700 1 -- 172.21.15.159:0/4223426538 shutdown_connections 2024-02-28T23:19:11.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.256+0000 7f0578200700 1 --2- 172.21.15.159:0/4223426538 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0570073ae0 0x7f057010ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:11.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.256+0000 7f0578200700 1 --2- 172.21.15.159:0/4223426538 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f05700731c0 0x7f05700735a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:11.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.256+0000 7f0578200700 1 -- 172.21.15.159:0/4223426538 >> 172.21.15.159:0/4223426538 conn(0x7f05700fc630 msgr2=0x7f05700fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:11.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.256+0000 7f0578200700 1 -- 172.21.15.159:0/4223426538 shutdown_connections 2024-02-28T23:19:11.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.256+0000 7f0578200700 1 -- 172.21.15.159:0/4223426538 wait complete. 2024-02-28T23:19:11.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.257+0000 7f0578200700 1 Processor -- start 2024-02-28T23:19:11.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.257+0000 7f0578200700 1 -- start start 2024-02-28T23:19:11.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.258+0000 7f0578200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05700731c0 0x7f0570198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:11.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.258+0000 7f0578200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0570073ae0 0x7f0570198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:11.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.258+0000 7f0578200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0570199520 con 0x7f0570073ae0 2024-02-28T23:19:11.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.258+0000 7f0578200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057019d330 con 0x7f05700731c0 2024-02-28T23:19:11.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.258+0000 7f0574e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0570073ae0 0x7f0570198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.258+0000 7f0574e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0570073ae0 0x7f0570198e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38272/0 (socket says 172.21.15.159:38272) 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.258+0000 7f0574e00700 1 -- 172.21.15.159:0/1720916162 learned_addr learned my addr 172.21.15.159:0/1720916162 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.259+0000 7f0575800700 1 --2- 172.21.15.159:0/1720916162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05700731c0 0x7f0570198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.259+0000 7f0574e00700 1 -- 172.21.15.159:0/1720916162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05700731c0 msgr2=0x7f0570198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.259+0000 7f0574e00700 1 --2- 172.21.15.159:0/1720916162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05700731c0 0x7f0570198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.259+0000 7f0574e00700 1 -- 172.21.15.159:0/1720916162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640095f0 con 0x7f0570073ae0 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.259+0000 7f0574e00700 1 --2- 172.21.15.159:0/1720916162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0570073ae0 0x7f0570198e90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f055c00d8d0 tx=0x7f055c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.259+0000 7f056e000700 1 -- 172.21.15.159:0/1720916162 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f055c009940 con 0x7f0570073ae0 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.259+0000 7f056e000700 1 -- 172.21.15.159:0/1720916162 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f055c010460 con 0x7f0570073ae0 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.259+0000 7f0578200700 1 -- 172.21.15.159:0/1720916162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057019d610 con 0x7f0570073ae0 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.260+0000 7f056e000700 1 -- 172.21.15.159:0/1720916162 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f055c00f5f0 con 0x7f0570073ae0 2024-02-28T23:19:11.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.260+0000 7f0578200700 1 -- 172.21.15.159:0/1720916162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f057019db60 con 0x7f0570073ae0 2024-02-28T23:19:11.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.261+0000 7f0578200700 1 -- 172.21.15.159:0/1720916162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057010a540 con 0x7f0570073ae0 2024-02-28T23:19:11.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.262+0000 7f056e000700 1 -- 172.21.15.159:0/1720916162 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f055c0105d0 con 0x7f0570073ae0 2024-02-28T23:19:11.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.263+0000 7f056e000700 1 --2- 172.21.15.159:0/1720916162 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f055806d8a0 0x7f055806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:11.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.263+0000 7f056e000700 1 -- 172.21.15.159:0/1720916162 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f055c08d5e0 con 0x7f0570073ae0 2024-02-28T23:19:11.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.263+0000 7f0575800700 1 --2- 172.21.15.159:0/1720916162 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f055806d8a0 0x7f055806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:11.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.264+0000 7f0575800700 1 --2- 172.21.15.159:0/1720916162 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f055806d8a0 0x7f055806fd60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0564005b40 tx=0x7f056401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:11.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.268+0000 7f056e000700 1 -- 172.21.15.159:0/1720916162 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f055c05a810 con 0x7f0570073ae0 2024-02-28T23:19:11.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.536+0000 7f0578200700 1 -- 172.21.15.159:0/1720916162 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f057019dd80 con 0x7f055806d8a0 2024-02-28T23:19:11.536 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:11 smithi159 ceph-mon[113833]: mds.? [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] up:rejoin 2024-02-28T23:19:11.536 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:11 smithi159 ceph-mon[113833]: fsmap cephfs:1/1 {0=cephfs.smithi184.pnifob=up:rejoin} 2 up:standby 2024-02-28T23:19:11.536 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:11 smithi159 ceph-mon[113833]: daemon mds.cephfs.smithi184.pnifob is now active in filesystem cephfs as rank 0 2024-02-28T23:19:11.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.538+0000 7f056e000700 1 -- 172.21.15.159:0/1720916162 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f057019dd80 con 0x7f055806d8a0 2024-02-28T23:19:11.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.542+0000 7f0578200700 1 -- 172.21.15.159:0/1720916162 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f055806d8a0 msgr2=0x7f055806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:11.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.542+0000 7f0578200700 1 --2- 172.21.15.159:0/1720916162 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f055806d8a0 0x7f055806fd60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0564005b40 tx=0x7f056401a040 comp rx=0 tx=0).stop 2024-02-28T23:19:11.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.542+0000 7f0578200700 1 -- 172.21.15.159:0/1720916162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0570073ae0 msgr2=0x7f0570198e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:11.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.542+0000 7f0578200700 1 --2- 172.21.15.159:0/1720916162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0570073ae0 0x7f0570198e90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f055c00d8d0 tx=0x7f055c00dc90 comp rx=0 tx=0).stop 2024-02-28T23:19:11.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.542+0000 7f0578200700 1 -- 172.21.15.159:0/1720916162 shutdown_connections 2024-02-28T23:19:11.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.542+0000 7f0578200700 1 --2- 172.21.15.159:0/1720916162 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f05700731c0 0x7f0570198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:11.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.542+0000 7f0578200700 1 --2- 172.21.15.159:0/1720916162 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f055806d8a0 0x7f055806fd60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:11.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.542+0000 7f0578200700 1 --2- 172.21.15.159:0/1720916162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0570073ae0 0x7f0570198e90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:11.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.542+0000 7f0578200700 1 -- 172.21.15.159:0/1720916162 >> 172.21.15.159:0/1720916162 conn(0x7f05700fc630 msgr2=0x7f0570107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:11.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.542+0000 7f0578200700 1 -- 172.21.15.159:0/1720916162 shutdown_connections 2024-02-28T23:19:11.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.542+0000 7f0578200700 1 -- 172.21.15.159:0/1720916162 wait complete. 2024-02-28T23:19:11.557 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:19:11.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:11 smithi184 ceph-mon[86482]: mds.? [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] up:rejoin 2024-02-28T23:19:11.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:11 smithi184 ceph-mon[86482]: fsmap cephfs:1/1 {0=cephfs.smithi184.pnifob=up:rejoin} 2 up:standby 2024-02-28T23:19:11.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:11 smithi184 ceph-mon[86482]: daemon mds.cephfs.smithi184.pnifob is now active in filesystem cephfs as rank 0 2024-02-28T23:19:11.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.699+0000 7f1c83e00700 1 -- 172.21.15.159:0/2604525946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c7c0ffbd0 msgr2=0x7f1c7c100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:11.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.699+0000 7f1c83e00700 1 --2- 172.21.15.159:0/2604525946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c7c0ffbd0 0x7f1c7c100050 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1c68009910 tx=0x7f1c68009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:11.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.700+0000 7f1c83e00700 1 -- 172.21.15.159:0/2604525946 shutdown_connections 2024-02-28T23:19:11.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.700+0000 7f1c83e00700 1 --2- 172.21.15.159:0/2604525946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c7c0ffbd0 0x7f1c7c100050 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:11.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.700+0000 7f1c83e00700 1 --2- 172.21.15.159:0/2604525946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7c105a40 0x7f1c7c105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:11.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.700+0000 7f1c83e00700 1 -- 172.21.15.159:0/2604525946 >> 172.21.15.159:0/2604525946 conn(0x7f1c7c0755a0 msgr2=0x7f1c7c0759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:11.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.700+0000 7f1c83e00700 1 -- 172.21.15.159:0/2604525946 shutdown_connections 2024-02-28T23:19:11.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.700+0000 7f1c83e00700 1 -- 172.21.15.159:0/2604525946 wait complete. 2024-02-28T23:19:11.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.701+0000 7f1c83e00700 1 Processor -- start 2024-02-28T23:19:11.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.701+0000 7f1c83e00700 1 -- start start 2024-02-28T23:19:11.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.701+0000 7f1c83e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c7c0ffbd0 0x7f1c7c101610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:11.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.701+0000 7f1c83e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7c105a40 0x7f1c7c101b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:11.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.701+0000 7f1c83e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c102090 con 0x7f1c7c0ffbd0 2024-02-28T23:19:11.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.701+0000 7f1c83e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7c1021d0 con 0x7f1c7c105a40 2024-02-28T23:19:11.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.702+0000 7f1c81400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c7c0ffbd0 0x7f1c7c101610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:11.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.702+0000 7f1c81400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c7c0ffbd0 0x7f1c7c101610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38304/0 (socket says 172.21.15.159:38304) 2024-02-28T23:19:11.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.702+0000 7f1c81400700 1 -- 172.21.15.159:0/3275749754 learned_addr learned my addr 172.21.15.159:0/3275749754 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:11.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.702+0000 7f1c80a00700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7c105a40 0x7f1c7c101b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:11.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.702+0000 7f1c81400700 1 -- 172.21.15.159:0/3275749754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7c105a40 msgr2=0x7f1c7c101b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:11.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.702+0000 7f1c81400700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7c105a40 0x7f1c7c101b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:11.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.702+0000 7f1c81400700 1 -- 172.21.15.159:0/3275749754 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c680095f0 con 0x7f1c7c0ffbd0 2024-02-28T23:19:11.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.702+0000 7f1c80a00700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7c105a40 0x7f1c7c101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:19:11.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.703+0000 7f1c81400700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c7c0ffbd0 0x7f1c7c101610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000b4b0 tx=0x7f1c7000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:11.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.703+0000 7f1c7a000700 1 -- 172.21.15.159:0/3275749754 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c70011800 con 0x7f1c7c0ffbd0 2024-02-28T23:19:11.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.703+0000 7f1c7a000700 1 -- 172.21.15.159:0/3275749754 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c70011e20 con 0x7f1c7c0ffbd0 2024-02-28T23:19:11.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.703+0000 7f1c83e00700 1 -- 172.21.15.159:0/3275749754 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7c1a2a10 con 0x7f1c7c0ffbd0 2024-02-28T23:19:11.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.703+0000 7f1c7a000700 1 -- 172.21.15.159:0/3275749754 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c7000f2e0 con 0x7f1c7c0ffbd0 2024-02-28T23:19:11.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.703+0000 7f1c83e00700 1 -- 172.21.15.159:0/3275749754 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7c1a2e20 con 0x7f1c7c0ffbd0 2024-02-28T23:19:11.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.704+0000 7f1c83e00700 1 -- 172.21.15.159:0/3275749754 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c7c109070 con 0x7f1c7c0ffbd0 2024-02-28T23:19:11.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.705+0000 7f1c7a000700 1 -- 172.21.15.159:0/3275749754 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f1c70010380 con 0x7f1c7c0ffbd0 2024-02-28T23:19:11.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.706+0000 7f1c7a000700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1c6406d8a0 0x7f1c6406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:11.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.706+0000 7f1c7a000700 1 -- 172.21.15.159:0/3275749754 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f1c7008d180 con 0x7f1c7c0ffbd0 2024-02-28T23:19:11.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.707+0000 7f1c80a00700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1c6406d8a0 0x7f1c6406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:11.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.708+0000 7f1c80a00700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1c6406d8a0 0x7f1c6406fd60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1c68006010 tx=0x7f1c6800b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:11.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:11.711+0000 7f1c7a000700 1 -- 172.21.15.159:0/3275749754 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1c70056910 con 0x7f1c7c0ffbd0 2024-02-28T23:19:12.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.002+0000 7f1c83e00700 1 -- 172.21.15.159:0/3275749754 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c7c02cda0 con 0x7f1c6406d8a0 2024-02-28T23:19:12.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.004+0000 7f1c7a000700 1 -- 172.21.15.159:0/3275749754 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f1c7c02cda0 con 0x7f1c6406d8a0 2024-02-28T23:19:12.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.007+0000 7f1c83e00700 1 -- 172.21.15.159:0/3275749754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1c6406d8a0 msgr2=0x7f1c6406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:12.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.007+0000 7f1c83e00700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1c6406d8a0 0x7f1c6406fd60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1c68006010 tx=0x7f1c6800b540 comp rx=0 tx=0).stop 2024-02-28T23:19:12.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.007+0000 7f1c83e00700 1 -- 172.21.15.159:0/3275749754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c7c0ffbd0 msgr2=0x7f1c7c101610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:12.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.007+0000 7f1c83e00700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c7c0ffbd0 0x7f1c7c101610 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1c7000b4b0 tx=0x7f1c7000b870 comp rx=0 tx=0).stop 2024-02-28T23:19:12.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.007+0000 7f1c83e00700 1 -- 172.21.15.159:0/3275749754 shutdown_connections 2024-02-28T23:19:12.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.007+0000 7f1c83e00700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1c6406d8a0 0x7f1c6406fd60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.007+0000 7f1c83e00700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c7c0ffbd0 0x7f1c7c101610 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.007+0000 7f1c83e00700 1 --2- 172.21.15.159:0/3275749754 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c7c105a40 0x7f1c7c101b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.007+0000 7f1c83e00700 1 -- 172.21.15.159:0/3275749754 >> 172.21.15.159:0/3275749754 conn(0x7f1c7c0755a0 msgr2=0x7f1c7c068690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:12.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.007+0000 7f1c83e00700 1 -- 172.21.15.159:0/3275749754 shutdown_connections 2024-02-28T23:19:12.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.007+0000 7f1c83e00700 1 -- 172.21.15.159:0/3275749754 wait complete. 2024-02-28T23:19:12.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.162+0000 7f3565200700 1 -- 172.21.15.159:0/4082545209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35601037c0 msgr2=0x7f3560107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:12.161 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.162+0000 7f3565200700 1 --2- 172.21.15.159:0/4082545209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35601037c0 0x7f3560107810 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f354c009910 tx=0x7f354c009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:12.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.163+0000 7f3565200700 1 -- 172.21.15.159:0/4082545209 shutdown_connections 2024-02-28T23:19:12.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.163+0000 7f3565200700 1 --2- 172.21.15.159:0/4082545209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f35601037c0 0x7f3560107810 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.163+0000 7f3565200700 1 --2- 172.21.15.159:0/4082545209 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f3560102e10 0x7f35601031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.163+0000 7f3565200700 1 -- 172.21.15.159:0/4082545209 >> 172.21.15.159:0/4082545209 conn(0x7f35600fe6c0 msgr2=0x7f3560100ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:12.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.163+0000 7f3565200700 1 -- 172.21.15.159:0/4082545209 shutdown_connections 2024-02-28T23:19:12.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.163+0000 7f3565200700 1 -- 172.21.15.159:0/4082545209 wait complete. 2024-02-28T23:19:12.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.164+0000 7f3565200700 1 Processor -- start 2024-02-28T23:19:12.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.164+0000 7f3565200700 1 -- start start 2024-02-28T23:19:12.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.164+0000 7f3565200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3560102e10 0x7f356019e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:12.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.164+0000 7f3565200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35601037c0 0x7f356019eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:12.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.164+0000 7f3565200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f356019f0b0 con 0x7f3560102e10 2024-02-28T23:19:12.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.164+0000 7f3565200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35601985f0 con 0x7f35601037c0 2024-02-28T23:19:12.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.165+0000 7f355f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3560102e10 0x7f356019e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:12.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.165+0000 7f355f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3560102e10 0x7f356019e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38316/0 (socket says 172.21.15.159:38316) 2024-02-28T23:19:12.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.165+0000 7f355f400700 1 -- 172.21.15.159:0/4150117623 learned_addr learned my addr 172.21.15.159:0/4150117623 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:12.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.165+0000 7f355ea00700 1 --2- 172.21.15.159:0/4150117623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35601037c0 0x7f356019eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:12.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.165+0000 7f355f400700 1 -- 172.21.15.159:0/4150117623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35601037c0 msgr2=0x7f356019eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:12.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.165+0000 7f355f400700 1 --2- 172.21.15.159:0/4150117623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35601037c0 0x7f356019eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.165+0000 7f355f400700 1 -- 172.21.15.159:0/4150117623 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c0095f0 con 0x7f3560102e10 2024-02-28T23:19:12.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.165+0000 7f355f400700 1 --2- 172.21.15.159:0/4150117623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3560102e10 0x7f356019e570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f355000c930 tx=0x7f355000ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:12.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.166+0000 7f3557e00700 1 -- 172.21.15.159:0/4150117623 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3550007ad0 con 0x7f3560102e10 2024-02-28T23:19:12.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.166+0000 7f3557e00700 1 -- 172.21.15.159:0/4150117623 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3550007c30 con 0x7f3560102e10 2024-02-28T23:19:12.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.166+0000 7f3557e00700 1 -- 172.21.15.159:0/4150117623 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3550018610 con 0x7f3560102e10 2024-02-28T23:19:12.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.166+0000 7f3565200700 1 -- 172.21.15.159:0/4150117623 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35601988d0 con 0x7f3560102e10 2024-02-28T23:19:12.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.166+0000 7f3565200700 1 -- 172.21.15.159:0/4150117623 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3560198d80 con 0x7f3560102e10 2024-02-28T23:19:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.167+0000 7f3565200700 1 -- 172.21.15.159:0/4150117623 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f356010b210 con 0x7f3560102e10 2024-02-28T23:19:12.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.168+0000 7f3557e00700 1 -- 172.21.15.159:0/4150117623 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f355000f450 con 0x7f3560102e10 2024-02-28T23:19:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.169+0000 7f3557e00700 1 --2- 172.21.15.159:0/4150117623 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f354406d8a0 0x7f354406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:12.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.169+0000 7f3557e00700 1 -- 172.21.15.159:0/4150117623 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f355008d8c0 con 0x7f3560102e10 2024-02-28T23:19:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.169+0000 7f355ea00700 1 --2- 172.21.15.159:0/4150117623 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f354406d8a0 0x7f354406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:12.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.170+0000 7f355ea00700 1 --2- 172.21.15.159:0/4150117623 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f354406d8a0 0x7f354406fd60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f35600feec0 tx=0x7f354c01a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:12.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.174+0000 7f3557e00700 1 -- 172.21.15.159:0/4150117623 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f355005aa50 con 0x7f3560102e10 2024-02-28T23:19:12.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.414+0000 7f3565200700 1 -- 172.21.15.159:0/4150117623 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f3560199050 con 0x7f354406d8a0 2024-02-28T23:19:12.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.446+0000 7f3557e00700 1 -- 172.21.15.159:0/4150117623 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f3560199050 con 0x7f354406d8a0 2024-02-28T23:19:12.445 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:19:12.445 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (8m) 26s ago 22m 14.2M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:19:12.445 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (2m) 26s ago 23m 8166k - 18.2.1 5be31c24972a f9515936ed5d 2024-02-28T23:19:12.445 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (21m) 54s ago 21m 8724k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (4m) 26s ago 23m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (4m) 54s ago 21m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (8m) 26s ago 22m 74.3M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (15m) 26s ago 15m 147M - 18.2.1 5be31c24972a 877db662a19a 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (34s) 26s ago 15m 10.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b aa9a201d4df0 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (15m) 54s ago 15m 19.1M - 18.2.1 5be31c24972a 61676daa6fcc 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (15m) 54s ago 15m 19.0M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (11m) 26s ago 24m 509M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (10m) 54s ago 21m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (6m) 26s ago 25m 55.1M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (5m) 54s ago 21m 37.3M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (9m) 26s ago 23m 7822k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (9m) 54s ago 21m 7990k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:19:12.446 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (4m) 26s ago 20m 117M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:19:12.447 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (3m) 26s ago 19m 100M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9120e23d80c0 2024-02-28T23:19:12.447 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (2m) 26s ago 19m 92.6M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 952e59c58165 2024-02-28T23:19:12.447 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (2m) 54s ago 18m 100M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 643ebdb823be 2024-02-28T23:19:12.447 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (102s) 54s ago 18m 99.1M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b dc8cef678e65 2024-02-28T23:19:12.447 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (60s) 54s ago 17m 11.3M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 1426063f8d8e 2024-02-28T23:19:12.447 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (9m) 26s ago 22m 59.2M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:19:12.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.449+0000 7f3565200700 1 -- 172.21.15.159:0/4150117623 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f354406d8a0 msgr2=0x7f354406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:12.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.449+0000 7f3565200700 1 --2- 172.21.15.159:0/4150117623 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f354406d8a0 0x7f354406fd60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f35600feec0 tx=0x7f354c01a040 comp rx=0 tx=0).stop 2024-02-28T23:19:12.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.449+0000 7f3565200700 1 -- 172.21.15.159:0/4150117623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3560102e10 msgr2=0x7f356019e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:12.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.449+0000 7f3565200700 1 --2- 172.21.15.159:0/4150117623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3560102e10 0x7f356019e570 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f355000c930 tx=0x7f355000ccf0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.450+0000 7f3565200700 1 -- 172.21.15.159:0/4150117623 shutdown_connections 2024-02-28T23:19:12.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.450+0000 7f3565200700 1 --2- 172.21.15.159:0/4150117623 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f354406d8a0 0x7f354406fd60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.450+0000 7f3565200700 1 --2- 172.21.15.159:0/4150117623 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3560102e10 0x7f356019e570 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.450+0000 7f3565200700 1 --2- 172.21.15.159:0/4150117623 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f35601037c0 0x7f356019eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.450+0000 7f3565200700 1 -- 172.21.15.159:0/4150117623 >> 172.21.15.159:0/4150117623 conn(0x7f35600fe6c0 msgr2=0x7f3560100ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:12.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.450+0000 7f3565200700 1 -- 172.21.15.159:0/4150117623 shutdown_connections 2024-02-28T23:19:12.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.450+0000 7f3565200700 1 -- 172.21.15.159:0/4150117623 wait complete. 2024-02-28T23:19:12.577 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:12 smithi159 ceph-mon[113833]: pgmap v243: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T23:19:12.578 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:12 smithi159 ceph-mon[113833]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T23:19:12.578 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:12 smithi159 ceph-mon[113833]: Cluster is now healthy 2024-02-28T23:19:12.578 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:12 smithi159 ceph-mon[113833]: mds.? [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] up:active 2024-02-28T23:19:12.578 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:12 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi184.pnifob=up:active} 2 up:standby 2024-02-28T23:19:12.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:12 smithi184 ceph-mon[86482]: pgmap v243: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 18 MiB/s rd, 5 op/s 2024-02-28T23:19:12.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:12 smithi184 ceph-mon[86482]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T23:19:12.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:12 smithi184 ceph-mon[86482]: Cluster is now healthy 2024-02-28T23:19:12.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:12 smithi184 ceph-mon[86482]: mds.? [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] up:active 2024-02-28T23:19:12.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:12 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi184.pnifob=up:active} 2 up:standby 2024-02-28T23:19:12.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.611+0000 7fab7f600700 1 -- 172.21.15.159:0/2454247606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78073a50 msgr2=0x7fab78111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:12.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.611+0000 7fab7f600700 1 --2- 172.21.15.159:0/2454247606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78073a50 0x7fab78111610 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fab64009910 tx=0x7fab64009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:12.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.611+0000 7fab7f600700 1 -- 172.21.15.159:0/2454247606 shutdown_connections 2024-02-28T23:19:12.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.611+0000 7fab7f600700 1 --2- 172.21.15.159:0/2454247606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78073a50 0x7fab78111610 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.611+0000 7fab7f600700 1 --2- 172.21.15.159:0/2454247606 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab78073130 0x7fab78073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.611+0000 7fab7f600700 1 -- 172.21.15.159:0/2454247606 >> 172.21.15.159:0/2454247606 conn(0x7fab780fc630 msgr2=0x7fab780fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:12.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.611+0000 7fab7f600700 1 -- 172.21.15.159:0/2454247606 shutdown_connections 2024-02-28T23:19:12.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.611+0000 7fab7f600700 1 -- 172.21.15.159:0/2454247606 wait complete. 2024-02-28T23:19:12.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.612+0000 7fab7f600700 1 Processor -- start 2024-02-28T23:19:12.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.613+0000 7fab7f600700 1 -- start start 2024-02-28T23:19:12.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.613+0000 7fab7f600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab78073130 0x7fab7819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:12.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.613+0000 7fab7f600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78073a50 0x7fab7819d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:12.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.613+0000 7fab7f600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7819d930 con 0x7fab78073a50 2024-02-28T23:19:12.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.613+0000 7fab7f600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab781a16c0 con 0x7fab78073130 2024-02-28T23:19:12.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.614+0000 7fab77e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78073a50 0x7fab7819d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:12.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.614+0000 7fab77e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78073a50 0x7fab7819d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38350/0 (socket says 172.21.15.159:38350) 2024-02-28T23:19:12.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.614+0000 7fab77e00700 1 -- 172.21.15.159:0/1217211598 learned_addr learned my addr 172.21.15.159:0/1217211598 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:12.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.614+0000 7fab7cc00700 1 --2- 172.21.15.159:0/1217211598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab78073130 0x7fab7819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:12.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.614+0000 7fab77e00700 1 -- 172.21.15.159:0/1217211598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab78073130 msgr2=0x7fab7819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:12.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.614+0000 7fab77e00700 1 --2- 172.21.15.159:0/1217211598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab78073130 0x7fab7819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.614+0000 7fab77e00700 1 -- 172.21.15.159:0/1217211598 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab640095f0 con 0x7fab78073a50 2024-02-28T23:19:12.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.615+0000 7fab77e00700 1 --2- 172.21.15.159:0/1217211598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78073a50 0x7fab7819d250 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fab64006010 tx=0x7fab6400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:12.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.615+0000 7fab75600700 1 -- 172.21.15.159:0/1217211598 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab6401d070 con 0x7fab78073a50 2024-02-28T23:19:12.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.615+0000 7fab75600700 1 -- 172.21.15.159:0/1217211598 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fab64005dc0 con 0x7fab78073a50 2024-02-28T23:19:12.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.615+0000 7fab7f600700 1 -- 172.21.15.159:0/1217211598 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab781a19a0 con 0x7fab78073a50 2024-02-28T23:19:12.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.615+0000 7fab7f600700 1 -- 172.21.15.159:0/1217211598 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab781a1ef0 con 0x7fab78073a50 2024-02-28T23:19:12.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.615+0000 7fab75600700 1 -- 172.21.15.159:0/1217211598 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab64017400 con 0x7fab78073a50 2024-02-28T23:19:12.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.617+0000 7fab7f600700 1 -- 172.21.15.159:0/1217211598 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7810ed90 con 0x7fab78073a50 2024-02-28T23:19:12.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.618+0000 7fab75600700 1 -- 172.21.15.159:0/1217211598 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fab6400f460 con 0x7fab78073a50 2024-02-28T23:19:12.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.619+0000 7fab75600700 1 --2- 172.21.15.159:0/1217211598 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fab6006d8a0 0x7fab6006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:12.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.619+0000 7fab75600700 1 -- 172.21.15.159:0/1217211598 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fab6408ea00 con 0x7fab78073a50 2024-02-28T23:19:12.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.619+0000 7fab7cc00700 1 --2- 172.21.15.159:0/1217211598 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fab6006d8a0 0x7fab6006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:12.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.620+0000 7fab7cc00700 1 --2- 172.21.15.159:0/1217211598 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fab6006d8a0 0x7fab6006fd60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab6c005950 tx=0x7fab6c00b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:12.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.624+0000 7fab75600700 1 -- 172.21.15.159:0/1217211598 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fab64058120 con 0x7fab78073a50 2024-02-28T23:19:12.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.937+0000 7fab7f600700 1 -- 172.21.15.159:0/1217211598 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fab7804ea90 con 0x7fab78073a50 2024-02-28T23:19:12.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.938+0000 7fab75600700 1 -- 172.21.15.159:0/1217211598 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7fab6405b7e0 con 0x7fab78073a50 2024-02-28T23:19:12.936 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:19:12.936 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:19:12.936 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:19:12.936 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2, 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 2, 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 12 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:19:12.937 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:19:12.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.941+0000 7fab7f600700 1 -- 172.21.15.159:0/1217211598 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fab6006d8a0 msgr2=0x7fab6006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:12.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.941+0000 7fab7f600700 1 --2- 172.21.15.159:0/1217211598 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fab6006d8a0 0x7fab6006fd60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fab6c005950 tx=0x7fab6c00b410 comp rx=0 tx=0).stop 2024-02-28T23:19:12.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.941+0000 7fab7f600700 1 -- 172.21.15.159:0/1217211598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78073a50 msgr2=0x7fab7819d250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:12.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.941+0000 7fab7f600700 1 --2- 172.21.15.159:0/1217211598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78073a50 0x7fab7819d250 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fab64006010 tx=0x7fab6400bd70 comp rx=0 tx=0).stop 2024-02-28T23:19:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.941+0000 7fab7f600700 1 -- 172.21.15.159:0/1217211598 shutdown_connections 2024-02-28T23:19:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.941+0000 7fab7f600700 1 --2- 172.21.15.159:0/1217211598 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fab78073130 0x7fab7819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.941+0000 7fab7f600700 1 --2- 172.21.15.159:0/1217211598 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fab6006d8a0 0x7fab6006fd60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.941+0000 7fab7f600700 1 --2- 172.21.15.159:0/1217211598 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab78073a50 0x7fab7819d250 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.941+0000 7fab7f600700 1 -- 172.21.15.159:0/1217211598 >> 172.21.15.159:0/1217211598 conn(0x7fab780fc630 msgr2=0x7fab78103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.942+0000 7fab7f600700 1 -- 172.21.15.159:0/1217211598 shutdown_connections 2024-02-28T23:19:12.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:12.942+0000 7fab7f600700 1 -- 172.21.15.159:0/1217211598 wait complete. 2024-02-28T23:19:13.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.094+0000 7ffb94a00700 1 -- 172.21.15.159:0/1803198593 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb90100da0 msgr2=0x7ffb90101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:13.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.094+0000 7ffb94a00700 1 --2- 172.21.15.159:0/1803198593 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb90100da0 0x7ffb90101180 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ffb80009910 tx=0x7ffb80009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:13.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.094+0000 7ffb94a00700 1 -- 172.21.15.159:0/1803198593 shutdown_connections 2024-02-28T23:19:13.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.094+0000 7ffb94a00700 1 --2- 172.21.15.159:0/1803198593 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb90101750 0x7ffb901057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.094+0000 7ffb94a00700 1 --2- 172.21.15.159:0/1803198593 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb90100da0 0x7ffb90101180 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.094+0000 7ffb94a00700 1 -- 172.21.15.159:0/1803198593 >> 172.21.15.159:0/1803198593 conn(0x7ffb900fc630 msgr2=0x7ffb900fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:13.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.094+0000 7ffb94a00700 1 -- 172.21.15.159:0/1803198593 shutdown_connections 2024-02-28T23:19:13.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.094+0000 7ffb94a00700 1 -- 172.21.15.159:0/1803198593 wait complete. 2024-02-28T23:19:13.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.096+0000 7ffb94a00700 1 Processor -- start 2024-02-28T23:19:13.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.096+0000 7ffb94a00700 1 -- start start 2024-02-28T23:19:13.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.096+0000 7ffb94a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb90100da0 0x7ffb9019e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:13.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.096+0000 7ffb94a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb90101750 0x7ffb9019ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:13.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.096+0000 7ffb94a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb9019f2e0 con 0x7ffb90101750 2024-02-28T23:19:13.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.096+0000 7ffb94a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb90198790 con 0x7ffb90100da0 2024-02-28T23:19:13.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.096+0000 7ffb8d400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb90101750 0x7ffb9019ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:13.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.097+0000 7ffb8d400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb90101750 0x7ffb9019ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38380/0 (socket says 172.21.15.159:38380) 2024-02-28T23:19:13.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.097+0000 7ffb8d400700 1 -- 172.21.15.159:0/2865140353 learned_addr learned my addr 172.21.15.159:0/2865140353 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:13.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.097+0000 7ffb8de00700 1 --2- 172.21.15.159:0/2865140353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb90100da0 0x7ffb9019e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:13.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.097+0000 7ffb8d400700 1 -- 172.21.15.159:0/2865140353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb90100da0 msgr2=0x7ffb9019e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:13.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.097+0000 7ffb8d400700 1 --2- 172.21.15.159:0/2865140353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb90100da0 0x7ffb9019e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.097+0000 7ffb8d400700 1 -- 172.21.15.159:0/2865140353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb800095f0 con 0x7ffb90101750 2024-02-28T23:19:13.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.097+0000 7ffb8d400700 1 --2- 172.21.15.159:0/2865140353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb90101750 0x7ffb9019ec50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00d900 tx=0x7ffb7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:13.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.098+0000 7ffb86a00700 1 -- 172.21.15.159:0/2865140353 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7c009900 con 0x7ffb90101750 2024-02-28T23:19:13.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.098+0000 7ffb86a00700 1 -- 172.21.15.159:0/2865140353 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ffb7c010460 con 0x7ffb90101750 2024-02-28T23:19:13.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.098+0000 7ffb86a00700 1 -- 172.21.15.159:0/2865140353 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffb7c00f5f0 con 0x7ffb90101750 2024-02-28T23:19:13.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.098+0000 7ffb94a00700 1 -- 172.21.15.159:0/2865140353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb90198a70 con 0x7ffb90101750 2024-02-28T23:19:13.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.098+0000 7ffb94a00700 1 -- 172.21.15.159:0/2865140353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb90198fc0 con 0x7ffb90101750 2024-02-28T23:19:13.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.099+0000 7ffb94a00700 1 -- 172.21.15.159:0/2865140353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb90104f20 con 0x7ffb90101750 2024-02-28T23:19:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.100+0000 7ffb86a00700 1 -- 172.21.15.159:0/2865140353 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ffb7c0105d0 con 0x7ffb90101750 2024-02-28T23:19:13.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.102+0000 7ffb86a00700 1 --2- 172.21.15.159:0/2865140353 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ffb7406d8a0 0x7ffb7406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:13.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.102+0000 7ffb86a00700 1 -- 172.21.15.159:0/2865140353 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6761+0+0 (secure 0 0 0) 0x7ffb7c08d440 con 0x7ffb90101750 2024-02-28T23:19:13.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.102+0000 7ffb8de00700 1 --2- 172.21.15.159:0/2865140353 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ffb7406d8a0 0x7ffb7406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:13.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.103+0000 7ffb8de00700 1 --2- 172.21.15.159:0/2865140353 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ffb7406d8a0 0x7ffb7406fd60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffb80006010 tx=0x7ffb8001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:13.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.106+0000 7ffb86a00700 1 -- 172.21.15.159:0/2865140353 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ffb7c05a650 con 0x7ffb90101750 2024-02-28T23:19:13.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.382+0000 7ffb94a00700 1 -- 172.21.15.159:0/2865140353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ffb9004ea90 con 0x7ffb90101750 2024-02-28T23:19:13.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.383+0000 7ffb86a00700 1 -- 172.21.15.159:0/2865140353 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1857 (secure 0 0 0) 0x7ffb7c017760 con 0x7ffb90101750 2024-02-28T23:19:13.382 INFO:teuthology.orchestra.run.smithi159.stdout:e28 2024-02-28T23:19:13.382 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:19:13.382 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:19:13.382 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:19:13.382 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:19:13.382 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:19:13.382 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:19:13.382 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 27 2024-02-28T23:19:13.382 INFO:teuthology.orchestra.run.smithi159.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T23:19:13.382 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:19:10.445722+0000 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 100 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:19:13.383 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=24265} 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{0:24265} state up:active seq 235 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:19:13.384 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:19:13.385 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:19:13.385 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:24269} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2280748719,v1:172.21.15.184:6825/2280748719] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:19:13.385 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{-1:34440} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:19:13.385 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{-1:34476} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6828/1030084771,v1:172.21.15.159:6829/1030084771] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:19:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.387+0000 7ffb94a00700 1 -- 172.21.15.159:0/2865140353 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ffb7406d8a0 msgr2=0x7ffb7406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.387+0000 7ffb94a00700 1 --2- 172.21.15.159:0/2865140353 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ffb7406d8a0 0x7ffb7406fd60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ffb80006010 tx=0x7ffb8001a040 comp rx=0 tx=0).stop 2024-02-28T23:19:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.387+0000 7ffb94a00700 1 -- 172.21.15.159:0/2865140353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb90101750 msgr2=0x7ffb9019ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.387+0000 7ffb94a00700 1 --2- 172.21.15.159:0/2865140353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb90101750 0x7ffb9019ec50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c00d900 tx=0x7ffb7c00dcc0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.387+0000 7ffb94a00700 1 -- 172.21.15.159:0/2865140353 shutdown_connections 2024-02-28T23:19:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.387+0000 7ffb94a00700 1 --2- 172.21.15.159:0/2865140353 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ffb90100da0 0x7ffb9019e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.387+0000 7ffb94a00700 1 --2- 172.21.15.159:0/2865140353 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ffb7406d8a0 0x7ffb7406fd60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.387+0000 7ffb94a00700 1 --2- 172.21.15.159:0/2865140353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb90101750 0x7ffb9019ec50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.387+0000 7ffb94a00700 1 -- 172.21.15.159:0/2865140353 >> 172.21.15.159:0/2865140353 conn(0x7ffb900fc630 msgr2=0x7ffb900fdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.387+0000 7ffb94a00700 1 -- 172.21.15.159:0/2865140353 shutdown_connections 2024-02-28T23:19:13.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.387+0000 7ffb94a00700 1 -- 172.21.15.159:0/2865140353 wait complete. 2024-02-28T23:19:13.387 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 28 2024-02-28T23:19:13.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.547+0000 7ff96b800700 1 -- 172.21.15.159:0/1837723497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff964068670 msgr2=0x7ff964068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:13.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.547+0000 7ff96b800700 1 --2- 172.21.15.159:0/1837723497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff964068670 0x7ff964068a50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff958009910 tx=0x7ff958009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:13.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.548+0000 7ff96b800700 1 -- 172.21.15.159:0/1837723497 shutdown_connections 2024-02-28T23:19:13.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.548+0000 7ff96b800700 1 --2- 172.21.15.159:0/1837723497 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff964069020 0x7ff964105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.548+0000 7ff96b800700 1 --2- 172.21.15.159:0/1837723497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff964068670 0x7ff964068a50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.548+0000 7ff96b800700 1 -- 172.21.15.159:0/1837723497 >> 172.21.15.159:0/1837723497 conn(0x7ff9640755a0 msgr2=0x7ff9640759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:13.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.549+0000 7ff96b800700 1 -- 172.21.15.159:0/1837723497 shutdown_connections 2024-02-28T23:19:13.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.549+0000 7ff96b800700 1 -- 172.21.15.159:0/1837723497 wait complete. 2024-02-28T23:19:13.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.550+0000 7ff96b800700 1 Processor -- start 2024-02-28T23:19:13.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.550+0000 7ff96b800700 1 -- start start 2024-02-28T23:19:13.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.550+0000 7ff96b800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff964068670 0x7ff96419e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:13.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.550+0000 7ff96b800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff964069020 0x7ff96419edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:13.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.550+0000 7ff96b800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96419f480 con 0x7ff964069020 2024-02-28T23:19:13.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.550+0000 7ff96b800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff964198930 con 0x7ff964068670 2024-02-28T23:19:13.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.551+0000 7ff963e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff964069020 0x7ff96419edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:13.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.551+0000 7ff963e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff964069020 0x7ff96419edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38402/0 (socket says 172.21.15.159:38402) 2024-02-28T23:19:13.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.551+0000 7ff963e00700 1 -- 172.21.15.159:0/3269406948 learned_addr learned my addr 172.21.15.159:0/3269406948 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:13.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.551+0000 7ff968e00700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff964068670 0x7ff96419e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:13.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.552+0000 7ff968e00700 1 -- 172.21.15.159:0/3269406948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff964069020 msgr2=0x7ff96419edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:13.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.552+0000 7ff968e00700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff964069020 0x7ff96419edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.552+0000 7ff968e00700 1 -- 172.21.15.159:0/3269406948 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9580095f0 con 0x7ff964068670 2024-02-28T23:19:13.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.552+0000 7ff963e00700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff964069020 0x7ff96419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T23:19:13.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.552+0000 7ff968e00700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff964068670 0x7ff96419e8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff958009910 tx=0x7ff95800bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:13.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.553+0000 7ff961600700 1 -- 172.21.15.159:0/3269406948 <== mon.1 v2:172.21.15.184:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff95801d070 con 0x7ff964068670 2024-02-28T23:19:13.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.553+0000 7ff96b800700 1 -- 172.21.15.159:0/3269406948 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff964198bb0 con 0x7ff964068670 2024-02-28T23:19:13.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.553+0000 7ff96b800700 1 -- 172.21.15.159:0/3269406948 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9641990a0 con 0x7ff964068670 2024-02-28T23:19:13.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.553+0000 7ff961600700 1 -- 172.21.15.159:0/3269406948 <== mon.1 v2:172.21.15.184:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff95800f460 con 0x7ff964068670 2024-02-28T23:19:13.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.553+0000 7ff961600700 1 -- 172.21.15.159:0/3269406948 <== mon.1 v2:172.21.15.184:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff958017630 con 0x7ff964068670 2024-02-28T23:19:13.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.554+0000 7ff96b800700 1 -- 172.21.15.159:0/3269406948 --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff944005320 con 0x7ff964068670 2024-02-28T23:19:13.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.556+0000 7ff961600700 1 -- 172.21.15.159:0/3269406948 <== mon.1 v2:172.21.15.184:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ff958003a60 con 0x7ff964068670 2024-02-28T23:19:13.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.557+0000 7ff961600700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff94c06d8a0 0x7ff94c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:13.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.557+0000 7ff961600700 1 -- 172.21.15.159:0/3269406948 <== mon.1 v2:172.21.15.184:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6761+0+0 (secure 0 0 0) 0x7ff95808ea60 con 0x7ff964068670 2024-02-28T23:19:13.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.557+0000 7ff963e00700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff94c06d8a0 0x7ff94c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:13.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.558+0000 7ff963e00700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff94c06d8a0 0x7ff94c06fd60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff964107740 tx=0x7ff950009240 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:13.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.572+0000 7ff961600700 1 -- 172.21.15.159:0/3269406948 <== mon.1 v2:172.21.15.184:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff95805bcf0 con 0x7ff964068670 2024-02-28T23:19:13.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:13 smithi184 ceph-mon[86482]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:13.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:13 smithi184 ceph-mon[86482]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:13.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:13 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:13.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:13 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:13.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:13 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:19:13.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:13 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1217211598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:13.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:13 smithi159 ceph-mon[113833]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:13.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:13 smithi159 ceph-mon[113833]: from='client.34468 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:13.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:13 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:13.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:13 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:13.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:13 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:19:13.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:13 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1217211598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:13.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.812+0000 7ff96b800700 1 -- 172.21.15.159:0/3269406948 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff944000bf0 con 0x7ff94c06d8a0 2024-02-28T23:19:13.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.814+0000 7ff961600700 1 -- 172.21.15.159:0/3269406948 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff944000bf0 con 0x7ff94c06d8a0 2024-02-28T23:19:13.812 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: "osd", 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "13/23 daemons upgraded", 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:19:13.813 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:19:13.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.817+0000 7ff96b800700 1 -- 172.21.15.159:0/3269406948 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff94c06d8a0 msgr2=0x7ff94c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:13.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.817+0000 7ff96b800700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff94c06d8a0 0x7ff94c06fd60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff964107740 tx=0x7ff950009240 comp rx=0 tx=0).stop 2024-02-28T23:19:13.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.817+0000 7ff96b800700 1 -- 172.21.15.159:0/3269406948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff964068670 msgr2=0x7ff96419e8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:13.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.817+0000 7ff96b800700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff964068670 0x7ff96419e8b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff958009910 tx=0x7ff95800bd70 comp rx=0 tx=0).stop 2024-02-28T23:19:13.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.817+0000 7ff96b800700 1 -- 172.21.15.159:0/3269406948 shutdown_connections 2024-02-28T23:19:13.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.817+0000 7ff96b800700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff964068670 0x7ff96419e8b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.817+0000 7ff96b800700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff94c06d8a0 0x7ff94c06fd60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.817+0000 7ff96b800700 1 --2- 172.21.15.159:0/3269406948 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff964069020 0x7ff96419edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.817+0000 7ff96b800700 1 -- 172.21.15.159:0/3269406948 >> 172.21.15.159:0/3269406948 conn(0x7ff9640755a0 msgr2=0x7ff964102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:13.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.817+0000 7ff96b800700 1 -- 172.21.15.159:0/3269406948 shutdown_connections 2024-02-28T23:19:13.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.817+0000 7ff96b800700 1 -- 172.21.15.159:0/3269406948 wait complete. 2024-02-28T23:19:13.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.968+0000 7fbf0c200700 1 -- 172.21.15.159:0/1762846721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf040ffbd0 msgr2=0x7fbf04100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:13.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.968+0000 7fbf0c200700 1 --2- 172.21.15.159:0/1762846721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf040ffbd0 0x7fbf04100050 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009910 tx=0x7fbef0009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:13.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.968+0000 7fbf0c200700 1 -- 172.21.15.159:0/1762846721 shutdown_connections 2024-02-28T23:19:13.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.968+0000 7fbf0c200700 1 --2- 172.21.15.159:0/1762846721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf040ffbd0 0x7fbf04100050 secure :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbef0009910 tx=0x7fbef0009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:13.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.968+0000 7fbf0c200700 1 --2- 172.21.15.159:0/1762846721 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf04105a40 0x7fbf04105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.968+0000 7fbf0c200700 1 -- 172.21.15.159:0/1762846721 >> 172.21.15.159:0/1762846721 conn(0x7fbf040755a0 msgr2=0x7fbf040759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:13.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.968+0000 7fbf0c200700 1 -- 172.21.15.159:0/1762846721 shutdown_connections 2024-02-28T23:19:13.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.968+0000 7fbf0c200700 1 -- 172.21.15.159:0/1762846721 wait complete. 2024-02-28T23:19:13.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.969+0000 7fbf0c200700 1 Processor -- start 2024-02-28T23:19:13.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.969+0000 7fbf0c200700 1 -- start start 2024-02-28T23:19:13.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.970+0000 7fbf0c200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf04105a40 0x7fbf0419e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:13.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.970+0000 7fbf0c200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0419eea0 0x7fbf041989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:13.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.970+0000 7fbf0c200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0419f470 con 0x7fbf0419eea0 2024-02-28T23:19:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.970+0000 7fbf0c200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04198f20 con 0x7fbf04105a40 2024-02-28T23:19:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.970+0000 7fbf08e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0419eea0 0x7fbf041989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.970+0000 7fbf08e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0419eea0 0x7fbf041989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38416/0 (socket says 172.21.15.159:38416) 2024-02-28T23:19:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.970+0000 7fbf08e00700 1 -- 172.21.15.159:0/2818412502 learned_addr learned my addr 172.21.15.159:0/2818412502 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.970+0000 7fbf09800700 1 --2- 172.21.15.159:0/2818412502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf04105a40 0x7fbf0419e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:13.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.971+0000 7fbf08e00700 1 -- 172.21.15.159:0/2818412502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf04105a40 msgr2=0x7fbf0419e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:13.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.971+0000 7fbf08e00700 1 --2- 172.21.15.159:0/2818412502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf04105a40 0x7fbf0419e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:13.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.971+0000 7fbf08e00700 1 -- 172.21.15.159:0/2818412502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef00095f0 con 0x7fbf0419eea0 2024-02-28T23:19:13.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.971+0000 7fbf08e00700 1 --2- 172.21.15.159:0/2818412502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0419eea0 0x7fbf041989e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbef0015000 tx=0x7fbef000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:13.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.971+0000 7fbf02000700 1 -- 172.21.15.159:0/2818412502 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbef001d070 con 0x7fbf0419eea0 2024-02-28T23:19:13.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.971+0000 7fbf0c200700 1 -- 172.21.15.159:0/2818412502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf041991a0 con 0x7fbf0419eea0 2024-02-28T23:19:13.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.972+0000 7fbf0c200700 1 -- 172.21.15.159:0/2818412502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf04199690 con 0x7fbf0419eea0 2024-02-28T23:19:13.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.972+0000 7fbf02000700 1 -- 172.21.15.159:0/2818412502 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbef000f460 con 0x7fbf0419eea0 2024-02-28T23:19:13.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.972+0000 7fbf02000700 1 -- 172.21.15.159:0/2818412502 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbef0017630 con 0x7fbf0419eea0 2024-02-28T23:19:13.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.973+0000 7fbf0c200700 1 -- 172.21.15.159:0/2818412502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee40052f0 con 0x7fbf0419eea0 2024-02-28T23:19:13.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.974+0000 7fbf02000700 1 -- 172.21.15.159:0/2818412502 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fbef0003a60 con 0x7fbf0419eea0 2024-02-28T23:19:13.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.975+0000 7fbf02000700 1 --2- 172.21.15.159:0/2818412502 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbeec06d8a0 0x7fbeec06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:13.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.975+0000 7fbf02000700 1 -- 172.21.15.159:0/2818412502 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fbef008ea70 con 0x7fbf0419eea0 2024-02-28T23:19:13.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.975+0000 7fbf09800700 1 --2- 172.21.15.159:0/2818412502 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbeec06d8a0 0x7fbeec06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:13.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.976+0000 7fbf09800700 1 --2- 172.21.15.159:0/2818412502 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbeec06d8a0 0x7fbeec06fd60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbef8005fd0 tx=0x7fbef800a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:13.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:13.980+0000 7fbf02000700 1 -- 172.21.15.159:0/2818412502 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbef005bc80 con 0x7fbf0419eea0 2024-02-28T23:19:14.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.284+0000 7fbf0c200700 1 -- 172.21.15.159:0/2818412502 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fbee40059c0 con 0x7fbf0419eea0 2024-02-28T23:19:14.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.285+0000 7fbf02000700 1 -- 172.21.15.159:0/2818412502 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fbef005b810 con 0x7fbf0419eea0 2024-02-28T23:19:14.283 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_OK 2024-02-28T23:19:14.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.287+0000 7fbf0c200700 1 -- 172.21.15.159:0/2818412502 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbeec06d8a0 msgr2=0x7fbeec06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:14.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.287+0000 7fbf0c200700 1 --2- 172.21.15.159:0/2818412502 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbeec06d8a0 0x7fbeec06fd60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbef8005fd0 tx=0x7fbef800a560 comp rx=0 tx=0).stop 2024-02-28T23:19:14.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.287+0000 7fbf0c200700 1 -- 172.21.15.159:0/2818412502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0419eea0 msgr2=0x7fbf041989e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:14.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.287+0000 7fbf0c200700 1 --2- 172.21.15.159:0/2818412502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0419eea0 0x7fbf041989e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fbef0015000 tx=0x7fbef000be20 comp rx=0 tx=0).stop 2024-02-28T23:19:14.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.288+0000 7fbf0c200700 1 -- 172.21.15.159:0/2818412502 shutdown_connections 2024-02-28T23:19:14.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.288+0000 7fbf0c200700 1 --2- 172.21.15.159:0/2818412502 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbf04105a40 0x7fbf0419e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:14.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.288+0000 7fbf0c200700 1 --2- 172.21.15.159:0/2818412502 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbeec06d8a0 0x7fbeec06fd60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:14.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.288+0000 7fbf0c200700 1 --2- 172.21.15.159:0/2818412502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbf0419eea0 0x7fbf041989e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:14.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.288+0000 7fbf0c200700 1 -- 172.21.15.159:0/2818412502 >> 172.21.15.159:0/2818412502 conn(0x7fbf040755a0 msgr2=0x7fbf040fe090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:14.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.288+0000 7fbf0c200700 1 -- 172.21.15.159:0/2818412502 shutdown_connections 2024-02-28T23:19:14.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:14.288+0000 7fbf0c200700 1 -- 172.21.15.159:0/2818412502 wait complete. 2024-02-28T23:19:14.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:14 smithi184 ceph-mon[86482]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:14.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:14 smithi184 ceph-mon[86482]: pgmap v244: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 6 op/s 2024-02-28T23:19:14.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:14 smithi184 ceph-mon[86482]: mds.? [v2:172.21.15.159:6828/1030084771,v1:172.21.15.159:6829/1030084771] up:boot 2024-02-28T23:19:14.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:14 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi184.pnifob=up:active} 3 up:standby 2024-02-28T23:19:14.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:14 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:19:14.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:14 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2865140353' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:19:14.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:14 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2818412502' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:19:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:14 smithi159 ceph-mon[113833]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:14 smithi159 ceph-mon[113833]: pgmap v244: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 85 B/s wr, 6 op/s 2024-02-28T23:19:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:14 smithi159 ceph-mon[113833]: mds.? [v2:172.21.15.159:6828/1030084771,v1:172.21.15.159:6829/1030084771] up:boot 2024-02-28T23:19:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:14 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi184.pnifob=up:active} 3 up:standby 2024-02-28T23:19:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:14 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:19:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:14 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2865140353' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:19:14.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:14 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2818412502' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:19:15.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:15 smithi159 ceph-mon[113833]: from='client.44277 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:15.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:15 smithi184 ceph-mon[86482]: from='client.44277 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:16.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:16 smithi159 ceph-mon[113833]: pgmap v245: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 85 B/s wr, 5 op/s 2024-02-28T23:19:16.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:16 smithi184 ceph-mon[86482]: pgmap v245: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 85 B/s wr, 5 op/s 2024-02-28T23:19:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:18 smithi184 ceph-mon[86482]: pgmap v246: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s rd, 170 B/s wr, 4 op/s 2024-02-28T23:19:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:18 smithi159 ceph-mon[113833]: pgmap v246: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s rd, 170 B/s wr, 4 op/s 2024-02-28T23:19:19.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:19 smithi159 ceph-mon[113833]: pgmap v247: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 170 B/s wr, 3 op/s 2024-02-28T23:19:20.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:19 smithi184 ceph-mon[86482]: pgmap v247: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 170 B/s wr, 3 op/s 2024-02-28T23:19:21.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:21 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:21.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:21 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:21 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:21 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:22.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:22 smithi159 ceph-mon[113833]: pgmap v248: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T23:19:22.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:22 smithi184 ceph-mon[86482]: pgmap v248: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 2.1 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T23:19:23.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:23.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:23.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:23.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:19:23.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:23.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:23.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:23.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:19:24.220 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:24 smithi159 ceph-mon[113833]: pgmap v249: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T23:19:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:24 smithi184 ceph-mon[86482]: pgmap v249: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T23:19:26.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:26 smithi159 ceph-mon[113833]: pgmap v250: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-28T23:19:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:26 smithi184 ceph-mon[86482]: pgmap v250: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-28T23:19:28.562 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:28 smithi159 ceph-mon[113833]: pgmap v251: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-28T23:19:28.562 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:28.562 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:28.562 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:19:28.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:19:28.563 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:28 smithi184 ceph-mon[86482]: pgmap v251: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-02-28T23:19:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:19:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:19:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:29.551 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:19:29.551 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:29.552 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:29.552 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:29.552 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:29 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:29.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:19:29.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:29.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:29.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:29.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:29 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:30.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:30 smithi184 ceph-mon[86482]: pgmap v252: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-02-28T23:19:30.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:30 smithi159 ceph-mon[113833]: pgmap v252: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-02-28T23:19:31.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:31 smithi184 ceph-mon[86482]: Upgrade: Updating mds.cephfs.smithi184.azwkfx 2024-02-28T23:19:31.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:31 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:31.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:31 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.azwkfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:19:31.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:31 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:19:31.816 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:31 smithi184 ceph-mon[86482]: Deploying daemon mds.cephfs.smithi184.azwkfx on smithi184 2024-02-28T23:19:31.817 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:31 smithi184 ceph-mon[86482]: pgmap v253: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-02-28T23:19:31.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:31 smithi159 ceph-mon[113833]: Upgrade: Updating mds.cephfs.smithi184.azwkfx 2024-02-28T23:19:31.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:31 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:31.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:31 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.azwkfx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:19:31.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:31 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:19:31.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:31 smithi159 ceph-mon[113833]: Deploying daemon mds.cephfs.smithi184.azwkfx on smithi184 2024-02-28T23:19:31.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:31 smithi159 ceph-mon[113833]: pgmap v253: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-02-28T23:19:34.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:34 smithi184 ceph-mon[86482]: pgmap v254: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:34 smithi159 ceph-mon[113833]: pgmap v254: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:35.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:35 smithi184 ceph-mon[86482]: osdmap e101: 6 total, 6 up, 6 in 2024-02-28T23:19:35.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:35 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi184.pnifob=up:active} 2 up:standby 2024-02-28T23:19:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:35 smithi159 ceph-mon[113833]: osdmap e101: 6 total, 6 up, 6 in 2024-02-28T23:19:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:35 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi184.pnifob=up:active} 2 up:standby 2024-02-28T23:19:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:36 smithi159 ceph-mon[113833]: pgmap v256: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:36 smithi184 ceph-mon[86482]: pgmap v256: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:38 smithi184 ceph-mon[86482]: pgmap v257: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:19:38.668 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:38 smithi159 ceph-mon[113833]: pgmap v257: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:38.668 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:19:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:40 smithi184 ceph-mon[86482]: pgmap v258: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:40 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:40 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:40 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:19:40.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:40 smithi159 ceph-mon[113833]: pgmap v258: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:40.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:40 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:40.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:40 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:40.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:40 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:19:41.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:41 smithi184 ceph-mon[86482]: mds.? [v2:172.21.15.184:6824/2221421248,v1:172.21.15.184:6825/2221421248] up:boot 2024-02-28T23:19:41.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:41 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi184.pnifob=up:active} 3 up:standby 2024-02-28T23:19:41.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:41 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:19:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:41 smithi159 ceph-mon[113833]: mds.? [v2:172.21.15.184:6824/2221421248,v1:172.21.15.184:6825/2221421248] up:boot 2024-02-28T23:19:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:41 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi184.pnifob=up:active} 3 up:standby 2024-02-28T23:19:41.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:41 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:19:42.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:42 smithi184 ceph-mon[86482]: pgmap v259: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:42 smithi159 ceph-mon[113833]: pgmap v259: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:44.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.457+0000 7f3411200700 1 -- 172.21.15.159:0/76330200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f340c101750 msgr2=0x7f340c1057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.457+0000 7f3411200700 1 --2- 172.21.15.159:0/76330200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f340c101750 0x7f340c1057a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009910 tx=0x7f33f8009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.457+0000 7f3411200700 1 -- 172.21.15.159:0/76330200 shutdown_connections 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.457+0000 7f3411200700 1 --2- 172.21.15.159:0/76330200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f340c101750 0x7f340c1057a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.457+0000 7f3411200700 1 --2- 172.21.15.159:0/76330200 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f340c100da0 0x7f340c101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.457+0000 7f3411200700 1 -- 172.21.15.159:0/76330200 >> 172.21.15.159:0/76330200 conn(0x7f340c0fc630 msgr2=0x7f340c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.457+0000 7f3411200700 1 -- 172.21.15.159:0/76330200 shutdown_connections 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.457+0000 7f3411200700 1 -- 172.21.15.159:0/76330200 wait complete. 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.458+0000 7f3411200700 1 Processor -- start 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.458+0000 7f3411200700 1 -- start start 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.459+0000 7f3411200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f340c100da0 0x7f340c073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.459+0000 7f3411200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f340c101750 0x7f340c0735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.459+0000 7f3411200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c073b10 con 0x7f340c101750 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.459+0000 7f3411200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f340c073c50 con 0x7f340c100da0 2024-02-28T23:19:44.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.459+0000 7f3409400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f340c101750 0x7f340c0735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:44.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.459+0000 7f3409400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f340c101750 0x7f340c0735d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33816/0 (socket says 172.21.15.159:33816) 2024-02-28T23:19:44.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.459+0000 7f3409400700 1 -- 172.21.15.159:0/1263826201 learned_addr learned my addr 172.21.15.159:0/1263826201 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:44.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.459+0000 7f3409e00700 1 --2- 172.21.15.159:0/1263826201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f340c100da0 0x7f340c073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:44.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.460+0000 7f3409400700 1 -- 172.21.15.159:0/1263826201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f340c100da0 msgr2=0x7f340c073090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:44.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.460+0000 7f3409400700 1 --2- 172.21.15.159:0/1263826201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f340c100da0 0x7f340c073090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:44.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.460+0000 7f3409400700 1 -- 172.21.15.159:0/1263826201 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f80095f0 con 0x7f340c101750 2024-02-28T23:19:44.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.460+0000 7f3409400700 1 --2- 172.21.15.159:0/1263826201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f340c101750 0x7f340c0735d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f33f800bda0 tx=0x7f33f800bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:44.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.460+0000 7f3402a00700 1 -- 172.21.15.159:0/1263826201 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f801d070 con 0x7f340c101750 2024-02-28T23:19:44.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.460+0000 7f3402a00700 1 -- 172.21.15.159:0/1263826201 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f33f8005dc0 con 0x7f340c101750 2024-02-28T23:19:44.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.460+0000 7f3402a00700 1 -- 172.21.15.159:0/1263826201 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33f8017400 con 0x7f340c101750 2024-02-28T23:19:44.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.460+0000 7f3411200700 1 -- 172.21.15.159:0/1263826201 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340c073ed0 con 0x7f340c101750 2024-02-28T23:19:44.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.460+0000 7f3411200700 1 -- 172.21.15.159:0/1263826201 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f340c1a2c30 con 0x7f340c101750 2024-02-28T23:19:44.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.462+0000 7f3411200700 1 -- 172.21.15.159:0/1263826201 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340c1091a0 con 0x7f340c101750 2024-02-28T23:19:44.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.463+0000 7f3402a00700 1 -- 172.21.15.159:0/1263826201 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f33f800f6f0 con 0x7f340c101750 2024-02-28T23:19:44.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.463+0000 7f3402a00700 1 --2- 172.21.15.159:0/1263826201 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f33f006d8a0 0x7f33f006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:44.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.464+0000 7f3402a00700 1 -- 172.21.15.159:0/1263826201 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f33f808e980 con 0x7f340c101750 2024-02-28T23:19:44.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.464+0000 7f3409e00700 1 --2- 172.21.15.159:0/1263826201 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f33f006d8a0 0x7f33f006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:44.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.464+0000 7f3409e00700 1 --2- 172.21.15.159:0/1263826201 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f33f006d8a0 0x7f33f006fd60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009550 tx=0x7f33fc0091f0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:44.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.469+0000 7f3402a00700 1 -- 172.21.15.159:0/1263826201 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f33f8058060 con 0x7f340c101750 2024-02-28T23:19:44.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:44 smithi184 ceph-mon[86482]: pgmap v260: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:44.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:44.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:44 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:44.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.708+0000 7f3411200700 1 -- 172.21.15.159:0/1263826201 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f340c02cce0 con 0x7f33f006d8a0 2024-02-28T23:19:44.708 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:44 smithi159 ceph-mon[113833]: pgmap v260: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:44.708 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:44.708 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:44 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:44.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.710+0000 7f3402a00700 1 -- 172.21.15.159:0/1263826201 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f340c02cce0 con 0x7f33f006d8a0 2024-02-28T23:19:44.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.713+0000 7f3411200700 1 -- 172.21.15.159:0/1263826201 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f33f006d8a0 msgr2=0x7f33f006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:44.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.713+0000 7f3411200700 1 --2- 172.21.15.159:0/1263826201 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f33f006d8a0 0x7f33f006fd60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f33fc009550 tx=0x7f33fc0091f0 comp rx=0 tx=0).stop 2024-02-28T23:19:44.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.713+0000 7f3411200700 1 -- 172.21.15.159:0/1263826201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f340c101750 msgr2=0x7f340c0735d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:44.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.713+0000 7f3411200700 1 --2- 172.21.15.159:0/1263826201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f340c101750 0x7f340c0735d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f33f800bda0 tx=0x7f33f800bdd0 comp rx=0 tx=0).stop 2024-02-28T23:19:44.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.713+0000 7f3411200700 1 -- 172.21.15.159:0/1263826201 shutdown_connections 2024-02-28T23:19:44.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.713+0000 7f3411200700 1 --2- 172.21.15.159:0/1263826201 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f340c100da0 0x7f340c073090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:44.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.713+0000 7f3411200700 1 --2- 172.21.15.159:0/1263826201 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f33f006d8a0 0x7f33f006fd60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:44.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.713+0000 7f3411200700 1 --2- 172.21.15.159:0/1263826201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f340c101750 0x7f340c0735d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:44.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.713+0000 7f3411200700 1 -- 172.21.15.159:0/1263826201 >> 172.21.15.159:0/1263826201 conn(0x7f340c0fc630 msgr2=0x7f340c0fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:44.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.713+0000 7f3411200700 1 -- 172.21.15.159:0/1263826201 shutdown_connections 2024-02-28T23:19:44.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.714+0000 7f3411200700 1 -- 172.21.15.159:0/1263826201 wait complete. 2024-02-28T23:19:44.729 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:19:44.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.873+0000 7f689c800700 1 -- 172.21.15.159:0/2460428571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f689410d280 msgr2=0x7f689410d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:44.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.873+0000 7f689c800700 1 --2- 172.21.15.159:0/2460428571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f689410d280 0x7f689410d660 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f6888009910 tx=0x7f6888009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:44.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.873+0000 7f689c800700 1 -- 172.21.15.159:0/2460428571 shutdown_connections 2024-02-28T23:19:44.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.873+0000 7f689c800700 1 --2- 172.21.15.159:0/2460428571 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f68941071d0 0x7f6894107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:44.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.873+0000 7f689c800700 1 --2- 172.21.15.159:0/2460428571 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f689410d280 0x7f689410d660 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:44.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.873+0000 7f689c800700 1 -- 172.21.15.159:0/2460428571 >> 172.21.15.159:0/2460428571 conn(0x7f68940769e0 msgr2=0x7f6894078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:44.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.873+0000 7f689c800700 1 -- 172.21.15.159:0/2460428571 shutdown_connections 2024-02-28T23:19:44.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.873+0000 7f689c800700 1 -- 172.21.15.159:0/2460428571 wait complete. 2024-02-28T23:19:44.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.874+0000 7f689c800700 1 Processor -- start 2024-02-28T23:19:44.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.875+0000 7f689c800700 1 -- start start 2024-02-28T23:19:44.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.875+0000 7f689c800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68941071d0 0x7f689419ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:44.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.875+0000 7f689c800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f689410d280 0x7f689419d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:44.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.875+0000 7f689c800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f689419d8a0 con 0x7f68941071d0 2024-02-28T23:19:44.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.875+0000 7f689c800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68941a05d0 con 0x7f689410d280 2024-02-28T23:19:44.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.875+0000 7f6899e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68941071d0 0x7f689419ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:44.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.875+0000 7f6899e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68941071d0 0x7f689419ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33832/0 (socket says 172.21.15.159:33832) 2024-02-28T23:19:44.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.875+0000 7f6899e00700 1 -- 172.21.15.159:0/349824937 learned_addr learned my addr 172.21.15.159:0/349824937 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:44.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.875+0000 7f6899400700 1 --2- 172.21.15.159:0/349824937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f689410d280 0x7f689419d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:44.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.876+0000 7f6899e00700 1 -- 172.21.15.159:0/349824937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f689410d280 msgr2=0x7f689419d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:44.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.876+0000 7f6899e00700 1 --2- 172.21.15.159:0/349824937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f689410d280 0x7f689419d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:44.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.876+0000 7f6899e00700 1 -- 172.21.15.159:0/349824937 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68880095f0 con 0x7f68941071d0 2024-02-28T23:19:44.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.876+0000 7f6899e00700 1 --2- 172.21.15.159:0/349824937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68941071d0 0x7f689419ccd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f688800f690 tx=0x7f688800f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:44.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.876+0000 7f688ea00700 1 -- 172.21.15.159:0/349824937 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f688801d070 con 0x7f68941071d0 2024-02-28T23:19:44.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.876+0000 7f688ea00700 1 -- 172.21.15.159:0/349824937 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f68880050d0 con 0x7f68941071d0 2024-02-28T23:19:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.876+0000 7f689c800700 1 -- 172.21.15.159:0/349824937 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68941a0850 con 0x7f68941071d0 2024-02-28T23:19:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.876+0000 7f688ea00700 1 -- 172.21.15.159:0/349824937 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6888022470 con 0x7f68941071d0 2024-02-28T23:19:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.877+0000 7f689c800700 1 -- 172.21.15.159:0/349824937 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68941a0dc0 con 0x7f68941071d0 2024-02-28T23:19:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.878+0000 7f689c800700 1 -- 172.21.15.159:0/349824937 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f689404ea90 con 0x7f68941071d0 2024-02-28T23:19:44.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.879+0000 7f688ea00700 1 -- 172.21.15.159:0/349824937 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f6888003780 con 0x7f68941071d0 2024-02-28T23:19:44.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.880+0000 7f688ea00700 1 --2- 172.21.15.159:0/349824937 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f687c06d8a0 0x7f687c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:44.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.880+0000 7f688ea00700 1 -- 172.21.15.159:0/349824937 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f688808e6b0 con 0x7f68941071d0 2024-02-28T23:19:44.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.880+0000 7f6899400700 1 --2- 172.21.15.159:0/349824937 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f687c06d8a0 0x7f687c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:44.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.881+0000 7f6899400700 1 --2- 172.21.15.159:0/349824937 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f687c06d8a0 0x7f687c06fd60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f689419e2b0 tx=0x7f6884009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:44.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:44.886+0000 7f688ea00700 1 -- 172.21.15.159:0/349824937 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6888057e70 con 0x7f68941071d0 2024-02-28T23:19:45.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.118+0000 7f689c800700 1 -- 172.21.15.159:0/349824937 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f68941a1130 con 0x7f687c06d8a0 2024-02-28T23:19:45.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.121+0000 7f688ea00700 1 -- 172.21.15.159:0/349824937 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f68941a1130 con 0x7f687c06d8a0 2024-02-28T23:19:45.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.123+0000 7f689c800700 1 -- 172.21.15.159:0/349824937 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f687c06d8a0 msgr2=0x7f687c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:45.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.123+0000 7f689c800700 1 --2- 172.21.15.159:0/349824937 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f687c06d8a0 0x7f687c06fd60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f689419e2b0 tx=0x7f6884009260 comp rx=0 tx=0).stop 2024-02-28T23:19:45.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.123+0000 7f689c800700 1 -- 172.21.15.159:0/349824937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68941071d0 msgr2=0x7f689419ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:45.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.123+0000 7f689c800700 1 --2- 172.21.15.159:0/349824937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68941071d0 0x7f689419ccd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f688800f690 tx=0x7f688800f6c0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.124+0000 7f689c800700 1 -- 172.21.15.159:0/349824937 shutdown_connections 2024-02-28T23:19:45.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.124+0000 7f689c800700 1 --2- 172.21.15.159:0/349824937 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f687c06d8a0 0x7f687c06fd60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.124+0000 7f689c800700 1 --2- 172.21.15.159:0/349824937 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68941071d0 0x7f689419ccd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.124+0000 7f689c800700 1 --2- 172.21.15.159:0/349824937 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f689410d280 0x7f689419d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.124+0000 7f689c800700 1 -- 172.21.15.159:0/349824937 >> 172.21.15.159:0/349824937 conn(0x7f68940769e0 msgr2=0x7f6894078320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:45.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.124+0000 7f689c800700 1 -- 172.21.15.159:0/349824937 shutdown_connections 2024-02-28T23:19:45.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.124+0000 7f689c800700 1 -- 172.21.15.159:0/349824937 wait complete. 2024-02-28T23:19:45.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.280+0000 7f9ceea00700 1 -- 172.21.15.159:0/3242798485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce8101750 msgr2=0x7f9ce81057a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:45.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.280+0000 7f9ceea00700 1 --2- 172.21.15.159:0/3242798485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce8101750 0x7f9ce81057a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f9cd0009910 tx=0x7f9cd0009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:45.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.280+0000 7f9ceea00700 1 -- 172.21.15.159:0/3242798485 shutdown_connections 2024-02-28T23:19:45.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.280+0000 7f9ceea00700 1 --2- 172.21.15.159:0/3242798485 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce8101750 0x7f9ce81057a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.280+0000 7f9ceea00700 1 --2- 172.21.15.159:0/3242798485 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce8100da0 0x7f9ce8101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.280+0000 7f9ceea00700 1 -- 172.21.15.159:0/3242798485 >> 172.21.15.159:0/3242798485 conn(0x7f9ce80fc630 msgr2=0x7f9ce80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:45.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.281+0000 7f9ceea00700 1 -- 172.21.15.159:0/3242798485 shutdown_connections 2024-02-28T23:19:45.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.281+0000 7f9ceea00700 1 -- 172.21.15.159:0/3242798485 wait complete. 2024-02-28T23:19:45.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.282+0000 7f9ceea00700 1 Processor -- start 2024-02-28T23:19:45.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.282+0000 7f9ceea00700 1 -- start start 2024-02-28T23:19:45.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.282+0000 7f9ceea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce8100da0 0x7f9ce8073090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:45.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.282+0000 7f9ceea00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce8101750 0x7f9ce80735d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:45.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.282+0000 7f9ceea00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce8073b10 con 0x7f9ce8100da0 2024-02-28T23:19:45.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.282+0000 7f9ceea00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce8073c50 con 0x7f9ce8101750 2024-02-28T23:19:45.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.282+0000 7f9ce7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce8100da0 0x7f9ce8073090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:45.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.283+0000 7f9ce7e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce8100da0 0x7f9ce8073090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33844/0 (socket says 172.21.15.159:33844) 2024-02-28T23:19:45.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.283+0000 7f9ce7e00700 1 -- 172.21.15.159:0/2157634287 learned_addr learned my addr 172.21.15.159:0/2157634287 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.283+0000 7f9cdf400700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce8101750 0x7f9ce80735d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.283+0000 7f9ce7e00700 1 -- 172.21.15.159:0/2157634287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce8101750 msgr2=0x7f9ce80735d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:45.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.283+0000 7f9ce7e00700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce8101750 0x7f9ce80735d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.283+0000 7f9ce7e00700 1 -- 172.21.15.159:0/2157634287 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd00095f0 con 0x7f9ce8100da0 2024-02-28T23:19:45.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.283+0000 7f9cdf400700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce8101750 0x7f9ce80735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:19:45.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.283+0000 7f9ce7e00700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce8100da0 0x7f9ce8073090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800ada0 tx=0x7f9cd800c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:45.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.284+0000 7f9ce5600700 1 -- 172.21.15.159:0/2157634287 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cd800f070 con 0x7f9ce8100da0 2024-02-28T23:19:45.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.284+0000 7f9ce5600700 1 -- 172.21.15.159:0/2157634287 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9cd8007bf0 con 0x7f9ce8100da0 2024-02-28T23:19:45.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.284+0000 7f9ceea00700 1 -- 172.21.15.159:0/2157634287 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce81a2900 con 0x7f9ce8100da0 2024-02-28T23:19:45.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.284+0000 7f9ce5600700 1 -- 172.21.15.159:0/2157634287 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9cd8005690 con 0x7f9ce8100da0 2024-02-28T23:19:45.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.284+0000 7f9ceea00700 1 -- 172.21.15.159:0/2157634287 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce81a2d10 con 0x7f9ce8100da0 2024-02-28T23:19:45.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.285+0000 7f9ceea00700 1 -- 172.21.15.159:0/2157634287 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce81091a0 con 0x7f9ce8100da0 2024-02-28T23:19:45.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.286+0000 7f9ce5600700 1 -- 172.21.15.159:0/2157634287 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9cd8005900 con 0x7f9ce8100da0 2024-02-28T23:19:45.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.287+0000 7f9ce5600700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9ccc06d8a0 0x7f9ccc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:45.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.287+0000 7f9ce5600700 1 -- 172.21.15.159:0/2157634287 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f9cd808d090 con 0x7f9ce8100da0 2024-02-28T23:19:45.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.287+0000 7f9cdf400700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9ccc06d8a0 0x7f9ccc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:45.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.288+0000 7f9cdf400700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9ccc06d8a0 0x7f9ccc06fd60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8074880 tx=0x7f9cd001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:45.291 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.293+0000 7f9ce5600700 1 -- 172.21.15.159:0/2157634287 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9cd80566f0 con 0x7f9ce8100da0 2024-02-28T23:19:45.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.522+0000 7f9ceea00700 1 -- 172.21.15.159:0/2157634287 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ce802cdd0 con 0x7f9ccc06d8a0 2024-02-28T23:19:45.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.540+0000 7f9ce5600700 1 -- 172.21.15.159:0/2157634287 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3816 (secure 0 0 0) 0x7f9ce802cdd0 con 0x7f9ccc06d8a0 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (9m) 25s ago 23m 14.2M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (3m) 25s ago 23m 8212k - 18.2.1 5be31c24972a f9515936ed5d 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (22m) 1s ago 22m 9118k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (5m) 25s ago 23m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (5m) 1s ago 22m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (8m) 25s ago 23m 75.3M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (33s) 25s ago 16m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 8da78eb84d38 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (67s) 25s ago 16m 11.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b aa9a201d4df0 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (6s) 1s ago 16m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 27fe678d733e 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (16m) 1s ago 16m 87.7M - 18.2.1 5be31c24972a e9beac8605f7 2024-02-28T23:19:45.540 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (12m) 25s ago 25m 510M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (10m) 1s ago 22m 452M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (7m) 25s ago 25m 56.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (6m) 1s ago 22m 38.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (10m) 25s ago 23m 7977k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (10m) 1s ago 22m 8274k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (4m) 25s ago 21m 120M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (3m) 25s ago 20m 108M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9120e23d80c0 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (3m) 25s ago 19m 100M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 952e59c58165 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (2m) 1s ago 19m 109M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 643ebdb823be 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (2m) 1s ago 18m 103M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b dc8cef678e65 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (93s) 1s ago 18m 106M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 1426063f8d8e 2024-02-28T23:19:45.541 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (9m) 25s ago 22m 60.2M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:19:45.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.544+0000 7f9ceea00700 1 -- 172.21.15.159:0/2157634287 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9ccc06d8a0 msgr2=0x7f9ccc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:45.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.544+0000 7f9ceea00700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9ccc06d8a0 0x7f9ccc06fd60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9ce8074880 tx=0x7f9cd001a040 comp rx=0 tx=0).stop 2024-02-28T23:19:45.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.544+0000 7f9ceea00700 1 -- 172.21.15.159:0/2157634287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce8100da0 msgr2=0x7f9ce8073090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:45.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.544+0000 7f9ceea00700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce8100da0 0x7f9ce8073090 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800ada0 tx=0x7f9cd800c330 comp rx=0 tx=0).stop 2024-02-28T23:19:45.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.544+0000 7f9ceea00700 1 -- 172.21.15.159:0/2157634287 shutdown_connections 2024-02-28T23:19:45.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.544+0000 7f9ceea00700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f9ccc06d8a0 0x7f9ccc06fd60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.544+0000 7f9ceea00700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ce8100da0 0x7f9ce8073090 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.544+0000 7f9ceea00700 1 --2- 172.21.15.159:0/2157634287 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9ce8101750 0x7f9ce80735d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.544+0000 7f9ceea00700 1 -- 172.21.15.159:0/2157634287 >> 172.21.15.159:0/2157634287 conn(0x7f9ce80fc630 msgr2=0x7f9ce80fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:45.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.544+0000 7f9ceea00700 1 -- 172.21.15.159:0/2157634287 shutdown_connections 2024-02-28T23:19:45.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.544+0000 7f9ceea00700 1 -- 172.21.15.159:0/2157634287 wait complete. 2024-02-28T23:19:45.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.691+0000 7fbe0b000700 1 -- 172.21.15.159:0/4071669242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe04068410 msgr2=0x7fbe040687f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:45.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.691+0000 7fbe0b000700 1 --2- 172.21.15.159:0/4071669242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe04068410 0x7fbe040687f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbdf800b0a0 tx=0x7fbdf800b3b0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.691+0000 7fbe0b000700 1 -- 172.21.15.159:0/4071669242 shutdown_connections 2024-02-28T23:19:45.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.691+0000 7fbe0b000700 1 --2- 172.21.15.159:0/4071669242 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe04068d30 0x7fbe0410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.691+0000 7fbe0b000700 1 --2- 172.21.15.159:0/4071669242 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe04068410 0x7fbe040687f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.691+0000 7fbe0b000700 1 -- 172.21.15.159:0/4071669242 >> 172.21.15.159:0/4071669242 conn(0x7fbe04075330 msgr2=0x7fbe04075740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:45.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.692+0000 7fbe0b000700 1 -- 172.21.15.159:0/4071669242 shutdown_connections 2024-02-28T23:19:45.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.692+0000 7fbe0b000700 1 -- 172.21.15.159:0/4071669242 wait complete. 2024-02-28T23:19:45.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.692+0000 7fbe0b000700 1 Processor -- start 2024-02-28T23:19:45.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.693+0000 7fbe0b000700 1 -- start start 2024-02-28T23:19:45.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.693+0000 7fbe0b000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe04068410 0x7fbe0419e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:45.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.693+0000 7fbe0b000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe04068d30 0x7fbe0419eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:45.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.693+0000 7fbe0b000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe0419f180 con 0x7fbe04068410 2024-02-28T23:19:45.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.693+0000 7fbe0b000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe04198630 con 0x7fbe04068d30 2024-02-28T23:19:45.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.693+0000 7fbe09c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe04068410 0x7fbe0419e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:45.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.693+0000 7fbe09c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe04068410 0x7fbe0419e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33856/0 (socket says 172.21.15.159:33856) 2024-02-28T23:19:45.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.693+0000 7fbe09c00700 1 -- 172.21.15.159:0/823198268 learned_addr learned my addr 172.21.15.159:0/823198268 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:45.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.693+0000 7fbe09200700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe04068d30 0x7fbe0419eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:45.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.694+0000 7fbe09c00700 1 -- 172.21.15.159:0/823198268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe04068d30 msgr2=0x7fbe0419eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:45.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.694+0000 7fbe09c00700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe04068d30 0x7fbe0419eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.694+0000 7fbe09c00700 1 -- 172.21.15.159:0/823198268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf8009d00 con 0x7fbe04068410 2024-02-28T23:19:45.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.694+0000 7fbe09200700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe04068d30 0x7fbe0419eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:19:45.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.694+0000 7fbe09c00700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe04068410 0x7fbe0419e5b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8000f80 tx=0x7fbdf800bd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:45.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.694+0000 7fbe02000700 1 -- 172.21.15.159:0/823198268 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdf800e040 con 0x7fbe04068410 2024-02-28T23:19:45.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.694+0000 7fbe02000700 1 -- 172.21.15.159:0/823198268 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbdf8003c10 con 0x7fbe04068410 2024-02-28T23:19:45.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.694+0000 7fbe0b000700 1 -- 172.21.15.159:0/823198268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe041988b0 con 0x7fbe04068410 2024-02-28T23:19:45.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.694+0000 7fbe02000700 1 -- 172.21.15.159:0/823198268 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbdf801d710 con 0x7fbe04068410 2024-02-28T23:19:45.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.694+0000 7fbe0b000700 1 -- 172.21.15.159:0/823198268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe04198e00 con 0x7fbe04068410 2024-02-28T23:19:45.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.695+0000 7fbe0b000700 1 -- 172.21.15.159:0/823198268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe0410a7f0 con 0x7fbe04068410 2024-02-28T23:19:45.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.696+0000 7fbe02000700 1 -- 172.21.15.159:0/823198268 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fbdf8019070 con 0x7fbe04068410 2024-02-28T23:19:45.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.697+0000 7fbe02000700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbdec06d8a0 0x7fbdec06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:45.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.697+0000 7fbe02000700 1 -- 172.21.15.159:0/823198268 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fbdf808eb00 con 0x7fbe04068410 2024-02-28T23:19:45.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.697+0000 7fbe09200700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbdec06d8a0 0x7fbdec06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:45.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.698+0000 7fbe09200700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbdec06d8a0 0x7fbdec06fd60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbe04101180 tx=0x7fbdf0009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:45.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.702+0000 7fbe02000700 1 -- 172.21.15.159:0/823198268 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbdf805bd30 con 0x7fbe04068410 2024-02-28T23:19:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.994+0000 7fbe0b000700 1 -- 172.21.15.159:0/823198268 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbe0404f2e0 con 0x7fbe04068410 2024-02-28T23:19:45.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.995+0000 7fbe02000700 1 -- 172.21.15.159:0/823198268 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+805 (secure 0 0 0) 0x7fbdf8003d80 con 0x7fbe04068410 2024-02-28T23:19:45.994 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:19:45.994 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:19:45.994 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:19:45.994 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:19:45.994 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:19:45.994 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 3 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 18.2.1 (7fe91d5d5842e04be3b4f514d6dd990c54b29c76) reef (stable)": 1, 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 13 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:19:45.995 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:19:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.998+0000 7fbe0b000700 1 -- 172.21.15.159:0/823198268 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbdec06d8a0 msgr2=0x7fbdec06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.998+0000 7fbe0b000700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbdec06d8a0 0x7fbdec06fd60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbe04101180 tx=0x7fbdf0009260 comp rx=0 tx=0).stop 2024-02-28T23:19:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.998+0000 7fbe0b000700 1 -- 172.21.15.159:0/823198268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe04068410 msgr2=0x7fbe0419e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:45.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.998+0000 7fbe0b000700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe04068410 0x7fbe0419e5b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fbdf8000f80 tx=0x7fbdf800bd10 comp rx=0 tx=0).stop 2024-02-28T23:19:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.998+0000 7fbe0b000700 1 -- 172.21.15.159:0/823198268 shutdown_connections 2024-02-28T23:19:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.998+0000 7fbe0b000700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbdec06d8a0 0x7fbdec06fd60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.998+0000 7fbe0b000700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe04068410 0x7fbe0419e5b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.998+0000 7fbe0b000700 1 --2- 172.21.15.159:0/823198268 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbe04068d30 0x7fbe0419eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.998+0000 7fbe0b000700 1 -- 172.21.15.159:0/823198268 >> 172.21.15.159:0/823198268 conn(0x7fbe04075330 msgr2=0x7fbe040fe540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.998+0000 7fbe0b000700 1 -- 172.21.15.159:0/823198268 shutdown_connections 2024-02-28T23:19:45.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:45.999+0000 7fbe0b000700 1 -- 172.21.15.159:0/823198268 wait complete. 2024-02-28T23:19:46.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.148+0000 7f738c000700 1 -- 172.21.15.159:0/1038701531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73841039b0 msgr2=0x7f7384107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:46.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.148+0000 7f738c000700 1 --2- 172.21.15.159:0/1038701531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73841039b0 0x7f7384107a00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7370009910 tx=0x7f7370009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:46.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.148+0000 7f738c000700 1 -- 172.21.15.159:0/1038701531 shutdown_connections 2024-02-28T23:19:46.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.148+0000 7f738c000700 1 --2- 172.21.15.159:0/1038701531 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f73841039b0 0x7f7384107a00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.148+0000 7f738c000700 1 --2- 172.21.15.159:0/1038701531 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7384103000 0x7f73841033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.148+0000 7f738c000700 1 -- 172.21.15.159:0/1038701531 >> 172.21.15.159:0/1038701531 conn(0x7f73840fe8d0 msgr2=0x7f7384100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:46.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.148+0000 7f738c000700 1 -- 172.21.15.159:0/1038701531 shutdown_connections 2024-02-28T23:19:46.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.148+0000 7f738c000700 1 -- 172.21.15.159:0/1038701531 wait complete. 2024-02-28T23:19:46.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.149+0000 7f738c000700 1 Processor -- start 2024-02-28T23:19:46.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.149+0000 7f738c000700 1 -- start start 2024-02-28T23:19:46.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.150+0000 7f738c000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7384103000 0x7f738419e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:46.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.150+0000 7f738c000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73841039b0 0x7f738419ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:46.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.150+0000 7f738c000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738419f390 con 0x7f7384103000 2024-02-28T23:19:46.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.150+0000 7f738c000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7384198840 con 0x7f73841039b0 2024-02-28T23:19:46.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.150+0000 7f7389600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7384103000 0x7f738419e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.150+0000 7f7389600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7384103000 0x7f738419e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33872/0 (socket says 172.21.15.159:33872) 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.150+0000 7f7389600700 1 -- 172.21.15.159:0/1420881399 learned_addr learned my addr 172.21.15.159:0/1420881399 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.150+0000 7f7388c00700 1 --2- 172.21.15.159:0/1420881399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73841039b0 0x7f738419ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.150+0000 7f7389600700 1 -- 172.21.15.159:0/1420881399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73841039b0 msgr2=0x7f738419ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.150+0000 7f7389600700 1 --2- 172.21.15.159:0/1420881399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73841039b0 0x7f738419ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.150+0000 7f7389600700 1 -- 172.21.15.159:0/1420881399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73700095f0 con 0x7f7384103000 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.151+0000 7f7389600700 1 --2- 172.21.15.159:0/1420881399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7384103000 0x7f738419e7c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f737800d8d0 tx=0x7f737800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.151+0000 7f7382000700 1 -- 172.21.15.159:0/1420881399 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73780098a0 con 0x7f7384103000 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.151+0000 7f7382000700 1 -- 172.21.15.159:0/1420881399 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7378010460 con 0x7f7384103000 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.151+0000 7f738c000700 1 -- 172.21.15.159:0/1420881399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7384198b20 con 0x7f7384103000 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.151+0000 7f7382000700 1 -- 172.21.15.159:0/1420881399 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f737800f5f0 con 0x7f7384103000 2024-02-28T23:19:46.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.151+0000 7f738c000700 1 -- 172.21.15.159:0/1420881399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7384199070 con 0x7f7384103000 2024-02-28T23:19:46.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.152+0000 7f738c000700 1 -- 172.21.15.159:0/1420881399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738410b400 con 0x7f7384103000 2024-02-28T23:19:46.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.153+0000 7f7382000700 1 -- 172.21.15.159:0/1420881399 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f7378009a00 con 0x7f7384103000 2024-02-28T23:19:46.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.154+0000 7f7382000700 1 --2- 172.21.15.159:0/1420881399 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f736c06d8a0 0x7f736c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:46.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.154+0000 7f7382000700 1 -- 172.21.15.159:0/1420881399 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6761+0+0 (secure 0 0 0) 0x7f737808d4a0 con 0x7f7384103000 2024-02-28T23:19:46.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.154+0000 7f7388c00700 1 --2- 172.21.15.159:0/1420881399 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f736c06d8a0 0x7f736c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:46.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.155+0000 7f7388c00700 1 --2- 172.21.15.159:0/1420881399 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f736c06d8a0 0x7f736c06fd60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f73840ff0a0 tx=0x7f737001a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:46.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.158+0000 7f7382000700 1 -- 172.21.15.159:0/1420881399 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f737805a6d0 con 0x7f7384103000 2024-02-28T23:19:46.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:46 smithi184 ceph-mon[86482]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:46.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:46 smithi184 ceph-mon[86482]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:46.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:46 smithi184 ceph-mon[86482]: pgmap v261: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:46.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:46 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/823198268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:46.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:46 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:46.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:46 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:46.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.414+0000 7f738c000700 1 -- 172.21.15.159:0/1420881399 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7384199290 con 0x7f7384103000 2024-02-28T23:19:46.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.415+0000 7f7382000700 1 -- 172.21.15.159:0/1420881399 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 30 v30) v1 ==== 76+0+1857 (secure 0 0 0) 0x7f737805a260 con 0x7f7384103000 2024-02-28T23:19:46.414 INFO:teuthology.orchestra.run.smithi159.stdout:e30 2024-02-28T23:19:46.414 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 27 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:19:10.445722+0000 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:19:46.415 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 100 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=24265} 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:19:46.416 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:19:46.417 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:19:46.417 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:19:46.417 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{0:24265} state up:active seq 235 join_fscid=1 addr [v2:172.21.15.184:6826/3142391154,v1:172.21.15.184:6827/3142391154] compat {c=[1],r=[1],i=[7ff]}] 2024-02-28T23:19:46.417 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:19:46.417 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:19:46.417 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:19:46.417 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:19:46.417 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{-1:34440} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:19:46.417 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{-1:34476} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.159:6828/1030084771,v1:172.21.15.159:6829/1030084771] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:19:46.417 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:44283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2221421248,v1:172.21.15.184:6825/2221421248] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:19:46.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.418+0000 7f738c000700 1 -- 172.21.15.159:0/1420881399 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f736c06d8a0 msgr2=0x7f736c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:46.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.418+0000 7f738c000700 1 --2- 172.21.15.159:0/1420881399 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f736c06d8a0 0x7f736c06fd60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f73840ff0a0 tx=0x7f737001a040 comp rx=0 tx=0).stop 2024-02-28T23:19:46.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.418+0000 7f738c000700 1 -- 172.21.15.159:0/1420881399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7384103000 msgr2=0x7f738419e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:46.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.418+0000 7f738c000700 1 --2- 172.21.15.159:0/1420881399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7384103000 0x7f738419e7c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f737800d8d0 tx=0x7f737800dbe0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.418+0000 7f738c000700 1 -- 172.21.15.159:0/1420881399 shutdown_connections 2024-02-28T23:19:46.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.418+0000 7f738c000700 1 --2- 172.21.15.159:0/1420881399 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f736c06d8a0 0x7f736c06fd60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.418+0000 7f738c000700 1 --2- 172.21.15.159:0/1420881399 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7384103000 0x7f738419e7c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.418+0000 7f738c000700 1 --2- 172.21.15.159:0/1420881399 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f73841039b0 0x7f738419ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.418+0000 7f738c000700 1 -- 172.21.15.159:0/1420881399 >> 172.21.15.159:0/1420881399 conn(0x7f73840fe8d0 msgr2=0x7f7384100cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:46.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.418+0000 7f738c000700 1 -- 172.21.15.159:0/1420881399 shutdown_connections 2024-02-28T23:19:46.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.418+0000 7f738c000700 1 -- 172.21.15.159:0/1420881399 wait complete. 2024-02-28T23:19:46.419 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 30 2024-02-28T23:19:46.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.584+0000 7fd646400700 1 -- 172.21.15.159:0/3255810956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd640073a50 msgr2=0x7fd640111610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:46.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.584+0000 7fd646400700 1 --2- 172.21.15.159:0/3255810956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd640073a50 0x7fd640111610 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd628009910 tx=0x7fd628009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:46.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.585+0000 7fd646400700 1 -- 172.21.15.159:0/3255810956 shutdown_connections 2024-02-28T23:19:46.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.585+0000 7fd646400700 1 --2- 172.21.15.159:0/3255810956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd640073a50 0x7fd640111610 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.585+0000 7fd646400700 1 --2- 172.21.15.159:0/3255810956 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd640073130 0x7fd640073510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.585+0000 7fd646400700 1 -- 172.21.15.159:0/3255810956 >> 172.21.15.159:0/3255810956 conn(0x7fd6400fc630 msgr2=0x7fd6400fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:46.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.585+0000 7fd646400700 1 -- 172.21.15.159:0/3255810956 shutdown_connections 2024-02-28T23:19:46.584 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:46 smithi159 ceph-mon[113833]: from='client.34496 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:46.584 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:46 smithi159 ceph-mon[113833]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:46.584 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:46 smithi159 ceph-mon[113833]: pgmap v261: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:46.584 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:46 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/823198268' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:46.585 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:46 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:46.585 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:46 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.585+0000 7fd646400700 1 -- 172.21.15.159:0/3255810956 wait complete. 2024-02-28T23:19:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.586+0000 7fd646400700 1 Processor -- start 2024-02-28T23:19:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.586+0000 7fd646400700 1 -- start start 2024-02-28T23:19:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.587+0000 7fd646400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd640073130 0x7fd64019cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.587+0000 7fd646400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd640073a50 0x7fd64019d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.587+0000 7fd646400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64019d930 con 0x7fd640073130 2024-02-28T23:19:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.587+0000 7fd646400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6401a16c0 con 0x7fd640073a50 2024-02-28T23:19:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.587+0000 7fd63f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd640073130 0x7fd64019cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.587+0000 7fd63f400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd640073130 0x7fd64019cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33886/0 (socket says 172.21.15.159:33886) 2024-02-28T23:19:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.587+0000 7fd63f400700 1 -- 172.21.15.159:0/317147230 learned_addr learned my addr 172.21.15.159:0/317147230 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.588+0000 7fd637e00700 1 --2- 172.21.15.159:0/317147230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd640073a50 0x7fd64019d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:46.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.588+0000 7fd63f400700 1 -- 172.21.15.159:0/317147230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd640073a50 msgr2=0x7fd64019d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:46.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.588+0000 7fd63f400700 1 --2- 172.21.15.159:0/317147230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd640073a50 0x7fd64019d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.588+0000 7fd63f400700 1 -- 172.21.15.159:0/317147230 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6280095f0 con 0x7fd640073130 2024-02-28T23:19:46.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.588+0000 7fd63f400700 1 --2- 172.21.15.159:0/317147230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd640073130 0x7fd64019cd10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd63000c8a0 tx=0x7fd63000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:46.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.588+0000 7fd63cc00700 1 -- 172.21.15.159:0/317147230 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd63000cea0 con 0x7fd640073130 2024-02-28T23:19:46.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.588+0000 7fd63cc00700 1 -- 172.21.15.159:0/317147230 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd630004830 con 0x7fd640073130 2024-02-28T23:19:46.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.589+0000 7fd646400700 1 -- 172.21.15.159:0/317147230 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6401a19a0 con 0x7fd640073130 2024-02-28T23:19:46.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.589+0000 7fd63cc00700 1 -- 172.21.15.159:0/317147230 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6300055b0 con 0x7fd640073130 2024-02-28T23:19:46.588 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.589+0000 7fd646400700 1 -- 172.21.15.159:0/317147230 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6401a1ef0 con 0x7fd640073130 2024-02-28T23:19:46.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.590+0000 7fd646400700 1 -- 172.21.15.159:0/317147230 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64010ed90 con 0x7fd640073130 2024-02-28T23:19:46.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.591+0000 7fd63cc00700 1 -- 172.21.15.159:0/317147230 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd6300049a0 con 0x7fd640073130 2024-02-28T23:19:46.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.593+0000 7fd63cc00700 1 --2- 172.21.15.159:0/317147230 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd62406d8a0 0x7fd62406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:46.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.593+0000 7fd63cc00700 1 -- 172.21.15.159:0/317147230 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fd63008d230 con 0x7fd640073130 2024-02-28T23:19:46.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.593+0000 7fd637e00700 1 --2- 172.21.15.159:0/317147230 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd62406d8a0 0x7fd62406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:46.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.594+0000 7fd637e00700 1 --2- 172.21.15.159:0/317147230 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd62406d8a0 0x7fd62406fd60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd628005f50 tx=0x7fd62801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:46.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.597+0000 7fd63cc00700 1 -- 172.21.15.159:0/317147230 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd630056910 con 0x7fd640073130 2024-02-28T23:19:46.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.839+0000 7fd646400700 1 -- 172.21.15.159:0/317147230 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6401a2230 con 0x7fd62406d8a0 2024-02-28T23:19:46.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.841+0000 7fd63cc00700 1 -- 172.21.15.159:0/317147230 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd6401a2230 con 0x7fd62406d8a0 2024-02-28T23:19:46.840 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:19:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:19:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:19:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:19:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:19:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-02-28T23:19:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "osd", 2024-02-28T23:19:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "mon", 2024-02-28T23:19:46.840 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr" 2024-02-28T23:19:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:19:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "15/23 daemons upgraded", 2024-02-28T23:19:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading mds daemons", 2024-02-28T23:19:46.841 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:19:46.841 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:19:46.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.844+0000 7fd646400700 1 -- 172.21.15.159:0/317147230 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd62406d8a0 msgr2=0x7fd62406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:46.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.844+0000 7fd646400700 1 --2- 172.21.15.159:0/317147230 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd62406d8a0 0x7fd62406fd60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd628005f50 tx=0x7fd62801a040 comp rx=0 tx=0).stop 2024-02-28T23:19:46.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.844+0000 7fd646400700 1 -- 172.21.15.159:0/317147230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd640073130 msgr2=0x7fd64019cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:46.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.844+0000 7fd646400700 1 --2- 172.21.15.159:0/317147230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd640073130 0x7fd64019cd10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd63000c8a0 tx=0x7fd63000cc60 comp rx=0 tx=0).stop 2024-02-28T23:19:46.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.844+0000 7fd646400700 1 -- 172.21.15.159:0/317147230 shutdown_connections 2024-02-28T23:19:46.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.844+0000 7fd646400700 1 --2- 172.21.15.159:0/317147230 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd62406d8a0 0x7fd62406fd60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.844+0000 7fd646400700 1 --2- 172.21.15.159:0/317147230 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd640073130 0x7fd64019cd10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.844+0000 7fd646400700 1 --2- 172.21.15.159:0/317147230 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd640073a50 0x7fd64019d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.844+0000 7fd646400700 1 -- 172.21.15.159:0/317147230 >> 172.21.15.159:0/317147230 conn(0x7fd6400fc630 msgr2=0x7fd640103120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:46.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.844+0000 7fd646400700 1 -- 172.21.15.159:0/317147230 shutdown_connections 2024-02-28T23:19:46.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.845+0000 7fd646400700 1 -- 172.21.15.159:0/317147230 wait complete. 2024-02-28T23:19:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.999+0000 7fb94fa00700 1 -- 172.21.15.159:0/3792774420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9481071d0 msgr2=0x7fb948107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.999+0000 7fb94fa00700 1 --2- 172.21.15.159:0/3792774420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9481071d0 0x7fb948107650 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb934009910 tx=0x7fb934009c20 comp rx=0 tx=0).stop 2024-02-28T23:19:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.999+0000 7fb94fa00700 1 -- 172.21.15.159:0/3792774420 shutdown_connections 2024-02-28T23:19:46.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.999+0000 7fb94fa00700 1 --2- 172.21.15.159:0/3792774420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9481071d0 0x7fb948107650 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.999+0000 7fb94fa00700 1 --2- 172.21.15.159:0/3792774420 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb94810d280 0x7fb94810d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.999+0000 7fb94fa00700 1 -- 172.21.15.159:0/3792774420 >> 172.21.15.159:0/3792774420 conn(0x7fb948076990 msgr2=0x7fb948078db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.999+0000 7fb94fa00700 1 -- 172.21.15.159:0/3792774420 shutdown_connections 2024-02-28T23:19:46.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:46.999+0000 7fb94fa00700 1 -- 172.21.15.159:0/3792774420 wait complete. 2024-02-28T23:19:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.000+0000 7fb94fa00700 1 Processor -- start 2024-02-28T23:19:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.000+0000 7fb94fa00700 1 -- start start 2024-02-28T23:19:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.001+0000 7fb94fa00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9481071d0 0x7fb94819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.001+0000 7fb94fa00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb94810d280 0x7fb94819d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:46.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.001+0000 7fb94fa00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94819d940 con 0x7fb94810d280 2024-02-28T23:19:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.001+0000 7fb94fa00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9481a16d0 con 0x7fb9481071d0 2024-02-28T23:19:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.001+0000 7fb947e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb94810d280 0x7fb94819d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.001+0000 7fb94d000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9481071d0 0x7fb94819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.001+0000 7fb947e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb94810d280 0x7fb94819d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:33892/0 (socket says 172.21.15.159:33892) 2024-02-28T23:19:47.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.001+0000 7fb947e00700 1 -- 172.21.15.159:0/2942834950 learned_addr learned my addr 172.21.15.159:0/2942834950 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:19:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.001+0000 7fb947e00700 1 -- 172.21.15.159:0/2942834950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9481071d0 msgr2=0x7fb94819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.001+0000 7fb947e00700 1 --2- 172.21.15.159:0/2942834950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9481071d0 0x7fb94819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.001+0000 7fb947e00700 1 -- 172.21.15.159:0/2942834950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340095f0 con 0x7fb94810d280 2024-02-28T23:19:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.002+0000 7fb947e00700 1 --2- 172.21.15.159:0/2942834950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb94810d280 0x7fb94819d260 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb934009fd0 tx=0x7fb93400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.002+0000 7fb945600700 1 -- 172.21.15.159:0/2942834950 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb93401d070 con 0x7fb94810d280 2024-02-28T23:19:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.002+0000 7fb945600700 1 -- 172.21.15.159:0/2942834950 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb9340050d0 con 0x7fb94810d280 2024-02-28T23:19:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.002+0000 7fb945600700 1 -- 172.21.15.159:0/2942834950 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb934017400 con 0x7fb94810d280 2024-02-28T23:19:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.002+0000 7fb94fa00700 1 -- 172.21.15.159:0/2942834950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9481a1950 con 0x7fb94810d280 2024-02-28T23:19:47.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.002+0000 7fb94fa00700 1 -- 172.21.15.159:0/2942834950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9481a1e40 con 0x7fb94810d280 2024-02-28T23:19:47.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.003+0000 7fb94fa00700 1 -- 172.21.15.159:0/2942834950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94810f6c0 con 0x7fb94810d280 2024-02-28T23:19:47.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.004+0000 7fb945600700 1 -- 172.21.15.159:0/2942834950 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fb934003710 con 0x7fb94810d280 2024-02-28T23:19:47.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.005+0000 7fb945600700 1 --2- 172.21.15.159:0/2942834950 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb93006d8a0 0x7fb93006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:19:47.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.005+0000 7fb945600700 1 -- 172.21.15.159:0/2942834950 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 6761+0+0 (secure 0 0 0) 0x7fb93408e830 con 0x7fb94810d280 2024-02-28T23:19:47.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.006+0000 7fb94d000700 1 --2- 172.21.15.159:0/2942834950 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb93006d8a0 0x7fb93006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:19:47.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.006+0000 7fb94d000700 1 --2- 172.21.15.159:0/2942834950 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb93006d8a0 0x7fb93006fd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009c60 tx=0x7fb93c009260 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:19:47.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.010+0000 7fb945600700 1 -- 172.21.15.159:0/2942834950 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb934057fb0 con 0x7fb94810d280 2024-02-28T23:19:47.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.301+0000 7fb94fa00700 1 -- 172.21.15.159:0/2942834950 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb9481a2170 con 0x7fb94810d280 2024-02-28T23:19:47.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.301+0000 7fb945600700 1 -- 172.21.15.159:0/2942834950 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb93405b670 con 0x7fb94810d280 2024-02-28T23:19:47.300 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_OK 2024-02-28T23:19:47.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.304+0000 7fb94fa00700 1 -- 172.21.15.159:0/2942834950 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb93006d8a0 msgr2=0x7fb93006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:47.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.304+0000 7fb94fa00700 1 --2- 172.21.15.159:0/2942834950 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb93006d8a0 0x7fb93006fd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb93c009c60 tx=0x7fb93c009260 comp rx=0 tx=0).stop 2024-02-28T23:19:47.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.304+0000 7fb94fa00700 1 -- 172.21.15.159:0/2942834950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb94810d280 msgr2=0x7fb94819d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:19:47.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.304+0000 7fb94fa00700 1 --2- 172.21.15.159:0/2942834950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb94810d280 0x7fb94819d260 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb934009fd0 tx=0x7fb93400bfd0 comp rx=0 tx=0).stop 2024-02-28T23:19:47.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.304+0000 7fb94fa00700 1 -- 172.21.15.159:0/2942834950 shutdown_connections 2024-02-28T23:19:47.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.304+0000 7fb94fa00700 1 --2- 172.21.15.159:0/2942834950 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb9481071d0 0x7fb94819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:47.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.304+0000 7fb94fa00700 1 --2- 172.21.15.159:0/2942834950 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb93006d8a0 0x7fb93006fd60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:47.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.304+0000 7fb94fa00700 1 --2- 172.21.15.159:0/2942834950 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb94810d280 0x7fb94819d260 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:19:47.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.304+0000 7fb94fa00700 1 -- 172.21.15.159:0/2942834950 >> 172.21.15.159:0/2942834950 conn(0x7fb948076990 msgr2=0x7fb948078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:19:47.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.304+0000 7fb94fa00700 1 -- 172.21.15.159:0/2942834950 shutdown_connections 2024-02-28T23:19:47.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:19:47.305+0000 7fb94fa00700 1 -- 172.21.15.159:0/2942834950 wait complete. 2024-02-28T23:19:47.533 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:47 smithi184 ceph-mon[86482]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:47.533 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:47 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1420881399' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:19:47.534 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:47 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2942834950' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:19:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:47 smithi159 ceph-mon[113833]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:47 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1420881399' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:19:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:47 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2942834950' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:19:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:48 smithi184 ceph-mon[86482]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:48 smithi184 ceph-mon[86482]: pgmap v262: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:48 smithi159 ceph-mon[113833]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:19:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:48 smithi159 ceph-mon[113833]: pgmap v262: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:50 smithi159 ceph-mon[113833]: pgmap v263: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:50.792 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:50 smithi184 ceph-mon[86482]: pgmap v263: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:52.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:52 smithi159 ceph-mon[113833]: pgmap v264: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:52.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:52.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:52.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:19:52.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:19:52.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:52.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:19:52.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:52.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:52.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:52.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:52 smithi184 ceph-mon[86482]: pgmap v264: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:19:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:19:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:19:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:19:53.642 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:19:53.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:19:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:54 smithi184 ceph-mon[86482]: pgmap v265: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:54 smithi159 ceph-mon[113833]: pgmap v265: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:55.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:55 smithi184 ceph-mon[86482]: Upgrade: Updating mds.cephfs.smithi184.pnifob 2024-02-28T23:19:55.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:55.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.pnifob", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:19:55.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:19:55.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:55 smithi184 ceph-mon[86482]: Deploying daemon mds.cephfs.smithi184.pnifob on smithi184 2024-02-28T23:19:55.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:55 smithi184 ceph-mon[86482]: pgmap v266: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:55.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:55 smithi159 ceph-mon[113833]: Upgrade: Updating mds.cephfs.smithi184.pnifob 2024-02-28T23:19:55.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:19:55.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi184.pnifob", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-02-28T23:19:55.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:19:55.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:55 smithi159 ceph-mon[113833]: Deploying daemon mds.cephfs.smithi184.pnifob on smithi184 2024-02-28T23:19:55.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:55 smithi159 ceph-mon[113833]: pgmap v266: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:57.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:57 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159[113829]: 2024-02-28T23:19:57.396+0000 7f1ccca00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T23:19:58.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:58 smithi184 ceph-mon[86482]: pgmap v267: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:58.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:58 smithi184 ceph-mon[86482]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T23:19:58.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:58 smithi184 ceph-mon[86482]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T23:19:58.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:58 smithi184 ceph-mon[86482]: osdmap e102: 6 total, 6 up, 6 in 2024-02-28T23:19:58.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:58 smithi184 ceph-mon[86482]: Standby daemon mds.cephfs.smithi159.mbaqic assigned to filesystem cephfs as rank 0 2024-02-28T23:19:58.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:58 smithi184 ceph-mon[86482]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T23:19:58.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:58 smithi184 ceph-mon[86482]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T23:19:58.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:19:58 smithi184 ceph-mon[86482]: fsmap cephfs:1/1 {0=cephfs.smithi159.mbaqic=up:replay} 2 up:standby 2024-02-28T23:19:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:58 smithi159 ceph-mon[113833]: pgmap v267: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:19:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:58 smithi159 ceph-mon[113833]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-02-28T23:19:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:58 smithi159 ceph-mon[113833]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-02-28T23:19:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:58 smithi159 ceph-mon[113833]: osdmap e102: 6 total, 6 up, 6 in 2024-02-28T23:19:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:58 smithi159 ceph-mon[113833]: Standby daemon mds.cephfs.smithi159.mbaqic assigned to filesystem cephfs as rank 0 2024-02-28T23:19:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:58 smithi159 ceph-mon[113833]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-02-28T23:19:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:58 smithi159 ceph-mon[113833]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-02-28T23:19:58.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:19:58 smithi159 ceph-mon[113833]: fsmap cephfs:1/1 {0=cephfs.smithi159.mbaqic=up:replay} 2 up:standby 2024-02-28T23:20:00.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:00 smithi184 ceph-mon[86482]: pgmap v269: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:20:00.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:00 smithi184 ceph-mon[86482]: Health detail: HEALTH_WARN 1 filesystem is degraded 2024-02-28T23:20:00.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:00 smithi184 ceph-mon[86482]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-28T23:20:00.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:00 smithi184 ceph-mon[86482]: fs cephfs is degraded 2024-02-28T23:20:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:00 smithi159 ceph-mon[113833]: pgmap v269: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail 2024-02-28T23:20:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:00 smithi159 ceph-mon[113833]: Health detail: HEALTH_WARN 1 filesystem is degraded 2024-02-28T23:20:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:00 smithi159 ceph-mon[113833]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-02-28T23:20:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:00 smithi159 ceph-mon[113833]: fs cephfs is degraded 2024-02-28T23:20:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:02 smithi184 ceph-mon[86482]: pgmap v270: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 1 op/s 2024-02-28T23:20:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:02 smithi159 ceph-mon[113833]: pgmap v270: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 5.4 MiB/s rd, 1 op/s 2024-02-28T23:20:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:04 smithi184 ceph-mon[86482]: pgmap v271: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-02-28T23:20:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:04 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:04 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:04.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:04 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:04 smithi159 ceph-mon[113833]: pgmap v271: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-02-28T23:20:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:04 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:04 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:04 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:05.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:05 smithi184 ceph-mon[86482]: mds.? [v2:172.21.15.184:6826/146669833,v1:172.21.15.184:6827/146669833] up:boot 2024-02-28T23:20:05.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:05 smithi184 ceph-mon[86482]: fsmap cephfs:1/1 {0=cephfs.smithi159.mbaqic=up:replay} 3 up:standby 2024-02-28T23:20:05.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:05 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:20:05.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:05 smithi159 ceph-mon[113833]: mds.? [v2:172.21.15.184:6826/146669833,v1:172.21.15.184:6827/146669833] up:boot 2024-02-28T23:20:05.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:05 smithi159 ceph-mon[113833]: fsmap cephfs:1/1 {0=cephfs.smithi159.mbaqic=up:replay} 3 up:standby 2024-02-28T23:20:05.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:05 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:20:06.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:06 smithi184 ceph-mon[86482]: pgmap v272: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-28T23:20:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:06 smithi159 ceph-mon[113833]: pgmap v272: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-28T23:20:07.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:07 smithi184 ceph-mon[86482]: mds.? [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] up:reconnect 2024-02-28T23:20:07.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:07 smithi184 ceph-mon[86482]: fsmap cephfs:1/1 {0=cephfs.smithi159.mbaqic=up:reconnect} 3 up:standby 2024-02-28T23:20:07.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:07 smithi184 ceph-mon[86482]: reconnect by client.14528 192.168.0.1:0/432838846 after 0.00299994 2024-02-28T23:20:07.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:07 smithi184 ceph-mon[86482]: reconnect by client.24307 192.168.0.1:0/975766746 after 0.00399992 2024-02-28T23:20:07.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:07 smithi159 ceph-mon[113833]: mds.? [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] up:reconnect 2024-02-28T23:20:07.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:07 smithi159 ceph-mon[113833]: fsmap cephfs:1/1 {0=cephfs.smithi159.mbaqic=up:reconnect} 3 up:standby 2024-02-28T23:20:07.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:07 smithi159 ceph-mon[113833]: reconnect by client.14528 192.168.0.1:0/432838846 after 0.00299994 2024-02-28T23:20:07.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:07 smithi159 ceph-mon[113833]: reconnect by client.24307 192.168.0.1:0/975766746 after 0.00399992 2024-02-28T23:20:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:08 smithi184 ceph-mon[86482]: pgmap v273: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-02-28T23:20:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:08 smithi184 ceph-mon[86482]: mds.? [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] up:rejoin 2024-02-28T23:20:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:08 smithi184 ceph-mon[86482]: fsmap cephfs:1/1 {0=cephfs.smithi159.mbaqic=up:rejoin} 3 up:standby 2024-02-28T23:20:08.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:08 smithi184 ceph-mon[86482]: daemon mds.cephfs.smithi159.mbaqic is now active in filesystem cephfs as rank 0 2024-02-28T23:20:08.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:08.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:08.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:08.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:20:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:08 smithi159 ceph-mon[113833]: pgmap v273: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-02-28T23:20:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:08 smithi159 ceph-mon[113833]: mds.? [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] up:rejoin 2024-02-28T23:20:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:08 smithi159 ceph-mon[113833]: fsmap cephfs:1/1 {0=cephfs.smithi159.mbaqic=up:rejoin} 3 up:standby 2024-02-28T23:20:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:08 smithi159 ceph-mon[113833]: daemon mds.cephfs.smithi159.mbaqic is now active in filesystem cephfs as rank 0 2024-02-28T23:20:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:20:09.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:09 smithi184 ceph-mon[86482]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T23:20:09.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:09 smithi184 ceph-mon[86482]: Cluster is now healthy 2024-02-28T23:20:09.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:09 smithi184 ceph-mon[86482]: mds.? [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] up:active 2024-02-28T23:20:09.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:09 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 3 up:standby 2024-02-28T23:20:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:09 smithi159 ceph-mon[113833]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-02-28T23:20:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:09 smithi159 ceph-mon[113833]: Cluster is now healthy 2024-02-28T23:20:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:09 smithi159 ceph-mon[113833]: mds.? [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] up:active 2024-02-28T23:20:09.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:09 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 3 up:standby 2024-02-28T23:20:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:10 smithi159 ceph-mon[113833]: pgmap v274: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-28T23:20:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:10 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:10 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:10.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:10 smithi184 ceph-mon[86482]: pgmap v274: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-28T23:20:10.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:10 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:10.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:10 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:12.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:12 smithi184 ceph-mon[86482]: pgmap v275: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-02-28T23:20:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:12 smithi159 ceph-mon[113833]: pgmap v275: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-02-28T23:20:14.506 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:14 smithi184 ceph-mon[86482]: pgmap v276: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-02-28T23:20:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:14 smithi159 ceph-mon[113833]: pgmap v276: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-02-28T23:20:16.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: pgmap v277: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T23:20:16.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:16.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:16.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:16.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:20:16.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.azxrct"}]': finished 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.mbaqic"}]': finished 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:20:16.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi184.azwkfx"}]': finished 2024-02-28T23:20:16.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:20:16.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi184.pnifob"}]': finished 2024-02-28T23:20:16.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:16 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-28T23:20:16.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: pgmap v277: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 7.1 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T23:20:16.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:16.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:16.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:16.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:20:16.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.azxrct"}]: dispatch 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.azxrct"}]': finished 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.mbaqic"}]: dispatch 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi159.mbaqic"}]': finished 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi184.azwkfx"}]: dispatch 2024-02-28T23:20:16.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi184.azwkfx"}]': finished 2024-02-28T23:20:16.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi184.pnifob"}]: dispatch 2024-02-28T23:20:16.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi184.pnifob"}]': finished 2024-02-28T23:20:16.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:16 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-28T23:20:17.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.476+0000 7f9403400700 1 -- 172.21.15.159:0/2999853728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc100da0 msgr2=0x7f93fc101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:17.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.476+0000 7f9403400700 1 --2- 172.21.15.159:0/2999853728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc100da0 0x7f93fc101180 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f93f0009910 tx=0x7f93f0009c20 comp rx=0 tx=0).stop 2024-02-28T23:20:17.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.476+0000 7f9403400700 1 -- 172.21.15.159:0/2999853728 shutdown_connections 2024-02-28T23:20:17.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.476+0000 7f9403400700 1 --2- 172.21.15.159:0/2999853728 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93fc101750 0x7f93fc1057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:17.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.476+0000 7f9403400700 1 --2- 172.21.15.159:0/2999853728 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc100da0 0x7f93fc101180 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:17.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.476+0000 7f9403400700 1 -- 172.21.15.159:0/2999853728 >> 172.21.15.159:0/2999853728 conn(0x7f93fc0fc630 msgr2=0x7f93fc0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:17.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.477+0000 7f9403400700 1 -- 172.21.15.159:0/2999853728 shutdown_connections 2024-02-28T23:20:17.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.477+0000 7f9403400700 1 -- 172.21.15.159:0/2999853728 wait complete. 2024-02-28T23:20:17.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.478+0000 7f9403400700 1 Processor -- start 2024-02-28T23:20:17.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.478+0000 7f9403400700 1 -- start start 2024-02-28T23:20:17.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.478+0000 7f9403400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc100da0 0x7f93fc19e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:17.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.478+0000 7f9403400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93fc101750 0x7f93fc19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:17.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.478+0000 7f9403400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc19f420 con 0x7f93fc100da0 2024-02-28T23:20:17.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.478+0000 7f9403400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93fc1988d0 con 0x7f93fc101750 2024-02-28T23:20:17.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.479+0000 7f9400a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc100da0 0x7f93fc19e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:17.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.479+0000 7f9400a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc100da0 0x7f93fc19e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:36412/0 (socket says 172.21.15.159:36412) 2024-02-28T23:20:17.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.479+0000 7f9400a00700 1 -- 172.21.15.159:0/3566949468 learned_addr learned my addr 172.21.15.159:0/3566949468 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:20:17.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.479+0000 7f93fbe00700 1 --2- 172.21.15.159:0/3566949468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93fc101750 0x7f93fc19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:17.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.479+0000 7f9400a00700 1 -- 172.21.15.159:0/3566949468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93fc101750 msgr2=0x7f93fc19ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:17.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.479+0000 7f9400a00700 1 --2- 172.21.15.159:0/3566949468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93fc101750 0x7f93fc19ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:17.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.479+0000 7f9400a00700 1 -- 172.21.15.159:0/3566949468 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f00095f0 con 0x7f93fc100da0 2024-02-28T23:20:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.480+0000 7f9400a00700 1 --2- 172.21.15.159:0/3566949468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc100da0 0x7f93fc19e850 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f93f0006010 tx=0x7f93f000be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.480+0000 7f93f9600700 1 -- 172.21.15.159:0/3566949468 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93f001d070 con 0x7f93fc100da0 2024-02-28T23:20:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.480+0000 7f93f9600700 1 -- 172.21.15.159:0/3566949468 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f93f0004fb0 con 0x7f93fc100da0 2024-02-28T23:20:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.480+0000 7f9403400700 1 -- 172.21.15.159:0/3566949468 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93fc198b50 con 0x7f93fc100da0 2024-02-28T23:20:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.480+0000 7f93f9600700 1 -- 172.21.15.159:0/3566949468 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f93f0022ea0 con 0x7f93fc100da0 2024-02-28T23:20:17.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.480+0000 7f9403400700 1 -- 172.21.15.159:0/3566949468 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93fc199040 con 0x7f93fc100da0 2024-02-28T23:20:17.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.481+0000 7f9403400700 1 -- 172.21.15.159:0/3566949468 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc104f20 con 0x7f93fc100da0 2024-02-28T23:20:17.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.482+0000 7f93f9600700 1 -- 172.21.15.159:0/3566949468 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f93f0022470 con 0x7f93fc100da0 2024-02-28T23:20:17.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.483+0000 7f93f9600700 1 --2- 172.21.15.159:0/3566949468 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f93e406d8a0 0x7f93e406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:17.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.483+0000 7f93f9600700 1 -- 172.21.15.159:0/3566949468 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f93f008eb50 con 0x7f93fc100da0 2024-02-28T23:20:17.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.484+0000 7f93fbe00700 1 --2- 172.21.15.159:0/3566949468 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f93e406d8a0 0x7f93e406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:17.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.484+0000 7f93fbe00700 1 --2- 172.21.15.159:0/3566949468 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f93e406d8a0 0x7f93e406fd60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f93e8006fd0 tx=0x7f93e8008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:17.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.488+0000 7f93f9600700 1 -- 172.21.15.159:0/3566949468 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f93f005bdc0 con 0x7f93fc100da0 2024-02-28T23:20:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:17 smithi184 ceph-mon[86482]: Upgrade: Setting container_image for all mds 2024-02-28T23:20:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:17 smithi184 ceph-mon[86482]: Upgrade: Setting filesystem cephfs Joinable 2024-02-28T23:20:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-28T23:20:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:17 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 3 up:standby 2024-02-28T23:20:17.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:17 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-28T23:20:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:17 smithi159 ceph-mon[113833]: Upgrade: Setting container_image for all mds 2024-02-28T23:20:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:17 smithi159 ceph-mon[113833]: Upgrade: Setting filesystem cephfs Joinable 2024-02-28T23:20:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-28T23:20:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:17 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 3 up:standby 2024-02-28T23:20:17.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:17 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-02-28T23:20:17.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.729+0000 7f9403400700 1 -- 172.21.15.159:0/3566949468 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f93fc199370 con 0x7f93e406d8a0 2024-02-28T23:20:17.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.731+0000 7f93f9600700 1 -- 172.21.15.159:0/3566949468 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f93fc199370 con 0x7f93e406d8a0 2024-02-28T23:20:17.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.734+0000 7f9403400700 1 -- 172.21.15.159:0/3566949468 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f93e406d8a0 msgr2=0x7f93e406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:17.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.734+0000 7f9403400700 1 --2- 172.21.15.159:0/3566949468 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f93e406d8a0 0x7f93e406fd60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f93e8006fd0 tx=0x7f93e8008040 comp rx=0 tx=0).stop 2024-02-28T23:20:17.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.734+0000 7f9403400700 1 -- 172.21.15.159:0/3566949468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc100da0 msgr2=0x7f93fc19e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:17.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.734+0000 7f9403400700 1 --2- 172.21.15.159:0/3566949468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc100da0 0x7f93fc19e850 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f93f0006010 tx=0x7f93f000be20 comp rx=0 tx=0).stop 2024-02-28T23:20:17.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.734+0000 7f9403400700 1 -- 172.21.15.159:0/3566949468 shutdown_connections 2024-02-28T23:20:17.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.734+0000 7f9403400700 1 --2- 172.21.15.159:0/3566949468 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f93e406d8a0 0x7f93e406fd60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:17.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.734+0000 7f9403400700 1 --2- 172.21.15.159:0/3566949468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f93fc100da0 0x7f93fc19e850 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:17.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.734+0000 7f9403400700 1 --2- 172.21.15.159:0/3566949468 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f93fc101750 0x7f93fc19ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:17.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.735+0000 7f9403400700 1 -- 172.21.15.159:0/3566949468 >> 172.21.15.159:0/3566949468 conn(0x7f93fc0fc630 msgr2=0x7f93fc0fdd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:17.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.735+0000 7f9403400700 1 -- 172.21.15.159:0/3566949468 shutdown_connections 2024-02-28T23:20:17.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.735+0000 7f9403400700 1 -- 172.21.15.159:0/3566949468 wait complete. 2024-02-28T23:20:17.752 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:20:17.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.932+0000 7ff6d9c00700 1 -- 172.21.15.159:0/2080823429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d4068670 msgr2=0x7ff6d4068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:17.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.932+0000 7ff6d9c00700 1 --2- 172.21.15.159:0/2080823429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d4068670 0x7ff6d4068a50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009910 tx=0x7ff6c4009c20 comp rx=0 tx=0).stop 2024-02-28T23:20:17.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.932+0000 7ff6d9c00700 1 -- 172.21.15.159:0/2080823429 shutdown_connections 2024-02-28T23:20:17.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.932+0000 7ff6d9c00700 1 --2- 172.21.15.159:0/2080823429 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d4069020 0x7ff6d4105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:17.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.932+0000 7ff6d9c00700 1 --2- 172.21.15.159:0/2080823429 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d4068670 0x7ff6d4068a50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:17.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.932+0000 7ff6d9c00700 1 -- 172.21.15.159:0/2080823429 >> 172.21.15.159:0/2080823429 conn(0x7ff6d40755a0 msgr2=0x7ff6d40759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:17.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.932+0000 7ff6d9c00700 1 -- 172.21.15.159:0/2080823429 shutdown_connections 2024-02-28T23:20:17.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.933+0000 7ff6d9c00700 1 -- 172.21.15.159:0/2080823429 wait complete. 2024-02-28T23:20:17.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.934+0000 7ff6d9c00700 1 Processor -- start 2024-02-28T23:20:17.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.934+0000 7ff6d9c00700 1 -- start start 2024-02-28T23:20:17.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.934+0000 7ff6d9c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d4068670 0x7ff6d419e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:17.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.934+0000 7ff6d9c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d4069020 0x7ff6d419ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:17.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.934+0000 7ff6d9c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d419f370 con 0x7ff6d4069020 2024-02-28T23:20:17.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.934+0000 7ff6d9c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d4198820 con 0x7ff6d4068670 2024-02-28T23:20:17.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.935+0000 7ff6d2000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d4069020 0x7ff6d419ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:17.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.935+0000 7ff6d2000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d4069020 0x7ff6d419ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35364/0 (socket says 172.21.15.159:35364) 2024-02-28T23:20:17.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.935+0000 7ff6d2000700 1 -- 172.21.15.159:0/3292794206 learned_addr learned my addr 172.21.15.159:0/3292794206 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:20:17.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.935+0000 7ff6d2a00700 1 --2- 172.21.15.159:0/3292794206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d4068670 0x7ff6d419e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:17.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.935+0000 7ff6d2000700 1 -- 172.21.15.159:0/3292794206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d4068670 msgr2=0x7ff6d419e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:17.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.935+0000 7ff6d2000700 1 --2- 172.21.15.159:0/3292794206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d4068670 0x7ff6d419e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:17.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.935+0000 7ff6d2000700 1 -- 172.21.15.159:0/3292794206 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40095f0 con 0x7ff6d4069020 2024-02-28T23:20:17.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.935+0000 7ff6d2000700 1 --2- 172.21.15.159:0/3292794206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d4069020 0x7ff6d419ece0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000d8d0 tx=0x7ff6c000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:17.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.936+0000 7ff6cb400700 1 -- 172.21.15.159:0/3292794206 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c0004a00 con 0x7ff6d4069020 2024-02-28T23:20:17.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.936+0000 7ff6cb400700 1 -- 172.21.15.159:0/3292794206 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff6c00054e0 con 0x7ff6d4069020 2024-02-28T23:20:17.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.936+0000 7ff6cb400700 1 -- 172.21.15.159:0/3292794206 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff6c0009d40 con 0x7ff6d4069020 2024-02-28T23:20:17.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.936+0000 7ff6d9c00700 1 -- 172.21.15.159:0/3292794206 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d4198b00 con 0x7ff6d4069020 2024-02-28T23:20:17.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.936+0000 7ff6d9c00700 1 -- 172.21.15.159:0/3292794206 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d4199050 con 0x7ff6d4069020 2024-02-28T23:20:17.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.937+0000 7ff6d9c00700 1 -- 172.21.15.159:0/3292794206 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d404ea90 con 0x7ff6d4069020 2024-02-28T23:20:17.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.939+0000 7ff6cb400700 1 -- 172.21.15.159:0/3292794206 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ff6c0005020 con 0x7ff6d4069020 2024-02-28T23:20:17.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.941+0000 7ff6cb400700 1 --2- 172.21.15.159:0/3292794206 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff6b806d8a0 0x7ff6b806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:17.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.941+0000 7ff6cb400700 1 -- 172.21.15.159:0/3292794206 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7ff6c008cfc0 con 0x7ff6d4069020 2024-02-28T23:20:17.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.941+0000 7ff6d2a00700 1 --2- 172.21.15.159:0/3292794206 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff6b806d8a0 0x7ff6b806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:17.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.942+0000 7ff6d2a00700 1 --2- 172.21.15.159:0/3292794206 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff6b806d8a0 0x7ff6b806fd60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4006010 tx=0x7ff6c401a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:17.945 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:17.946+0000 7ff6cb400700 1 -- 172.21.15.159:0/3292794206 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff6c00c0d20 con 0x7ff6d4069020 2024-02-28T23:20:18.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.180+0000 7ff6d9c00700 1 -- 172.21.15.159:0/3292794206 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6d41993a0 con 0x7ff6b806d8a0 2024-02-28T23:20:18.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.182+0000 7ff6cb400700 1 -- 172.21.15.159:0/3292794206 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7ff6d41993a0 con 0x7ff6b806d8a0 2024-02-28T23:20:18.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.185+0000 7ff6d9c00700 1 -- 172.21.15.159:0/3292794206 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff6b806d8a0 msgr2=0x7ff6b806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:18.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.185+0000 7ff6d9c00700 1 --2- 172.21.15.159:0/3292794206 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff6b806d8a0 0x7ff6b806fd60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4006010 tx=0x7ff6c401a040 comp rx=0 tx=0).stop 2024-02-28T23:20:18.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.185+0000 7ff6d9c00700 1 -- 172.21.15.159:0/3292794206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d4069020 msgr2=0x7ff6d419ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:18.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.185+0000 7ff6d9c00700 1 --2- 172.21.15.159:0/3292794206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d4069020 0x7ff6d419ece0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000d8d0 tx=0x7ff6c000dc90 comp rx=0 tx=0).stop 2024-02-28T23:20:18.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.185+0000 7ff6d9c00700 1 -- 172.21.15.159:0/3292794206 shutdown_connections 2024-02-28T23:20:18.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.185+0000 7ff6d9c00700 1 --2- 172.21.15.159:0/3292794206 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6d4068670 0x7ff6d419e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.185+0000 7ff6d9c00700 1 --2- 172.21.15.159:0/3292794206 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff6b806d8a0 0x7ff6b806fd60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.185+0000 7ff6d9c00700 1 --2- 172.21.15.159:0/3292794206 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6d4069020 0x7ff6d419ece0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.185 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.185+0000 7ff6d9c00700 1 -- 172.21.15.159:0/3292794206 >> 172.21.15.159:0/3292794206 conn(0x7ff6d40755a0 msgr2=0x7ff6d4102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:18.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.186+0000 7ff6d9c00700 1 -- 172.21.15.159:0/3292794206 shutdown_connections 2024-02-28T23:20:18.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.186+0000 7ff6d9c00700 1 -- 172.21.15.159:0/3292794206 wait complete. 2024-02-28T23:20:18.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.349+0000 7f5374a00700 1 -- 172.21.15.159:0/1922726749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53700731c0 msgr2=0x7f53700735a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:18.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.349+0000 7f5374a00700 1 --2- 172.21.15.159:0/1922726749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53700731c0 0x7f53700735a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5360009910 tx=0x7f5360009c20 comp rx=0 tx=0).stop 2024-02-28T23:20:18.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.349+0000 7f5374a00700 1 -- 172.21.15.159:0/1922726749 shutdown_connections 2024-02-28T23:20:18.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.349+0000 7f5374a00700 1 --2- 172.21.15.159:0/1922726749 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5370073ae0 0x7f537010ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.349+0000 7f5374a00700 1 --2- 172.21.15.159:0/1922726749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53700731c0 0x7f53700735a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.349+0000 7f5374a00700 1 -- 172.21.15.159:0/1922726749 >> 172.21.15.159:0/1922726749 conn(0x7f53700fc630 msgr2=0x7f53700fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:18.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.349+0000 7f5374a00700 1 -- 172.21.15.159:0/1922726749 shutdown_connections 2024-02-28T23:20:18.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.349+0000 7f5374a00700 1 -- 172.21.15.159:0/1922726749 wait complete. 2024-02-28T23:20:18.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.350+0000 7f5374a00700 1 Processor -- start 2024-02-28T23:20:18.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.350+0000 7f5374a00700 1 -- start start 2024-02-28T23:20:18.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.351+0000 7f5374a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53700731c0 0x7f5370198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:18.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.351+0000 7f5374a00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5370073ae0 0x7f5370198e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:18.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.351+0000 7f5374a00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5370199520 con 0x7f53700731c0 2024-02-28T23:20:18.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.351+0000 7f5374a00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f537019d330 con 0x7f5370073ae0 2024-02-28T23:20:18.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.351+0000 7f536de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53700731c0 0x7f5370198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:18.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.351+0000 7f536de00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53700731c0 0x7f5370198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35382/0 (socket says 172.21.15.159:35382) 2024-02-28T23:20:18.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.351+0000 7f536de00700 1 -- 172.21.15.159:0/295325925 learned_addr learned my addr 172.21.15.159:0/295325925 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:20:18.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.351+0000 7f5367e00700 1 --2- 172.21.15.159:0/295325925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5370073ae0 0x7f5370198e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:18.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.352+0000 7f536de00700 1 -- 172.21.15.159:0/295325925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5370073ae0 msgr2=0x7f5370198e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:18.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.352+0000 7f536de00700 1 --2- 172.21.15.159:0/295325925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5370073ae0 0x7f5370198e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.352+0000 7f536de00700 1 -- 172.21.15.159:0/295325925 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53600095f0 con 0x7f53700731c0 2024-02-28T23:20:18.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.352+0000 7f536de00700 1 --2- 172.21.15.159:0/295325925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53700731c0 0x7f5370198950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f53600092e0 tx=0x7f536000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:18.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.353+0000 7f5366a00700 1 -- 172.21.15.159:0/295325925 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f536001d070 con 0x7f53700731c0 2024-02-28T23:20:18.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.353+0000 7f5366a00700 1 -- 172.21.15.159:0/295325925 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f536000f460 con 0x7f53700731c0 2024-02-28T23:20:18.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.353+0000 7f5366a00700 1 -- 172.21.15.159:0/295325925 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5360017630 con 0x7f53700731c0 2024-02-28T23:20:18.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.353+0000 7f5374a00700 1 -- 172.21.15.159:0/295325925 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f537019d5b0 con 0x7f53700731c0 2024-02-28T23:20:18.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.353+0000 7f5374a00700 1 -- 172.21.15.159:0/295325925 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f537019daa0 con 0x7f53700731c0 2024-02-28T23:20:18.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.355+0000 7f5374a00700 1 -- 172.21.15.159:0/295325925 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f537010a540 con 0x7f53700731c0 2024-02-28T23:20:18.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.355+0000 7f5366a00700 1 -- 172.21.15.159:0/295325925 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f536000f5d0 con 0x7f53700731c0 2024-02-28T23:20:18.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.356+0000 7f5366a00700 1 --2- 172.21.15.159:0/295325925 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f535406d8a0 0x7f535406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:18.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.357+0000 7f5366a00700 1 -- 172.21.15.159:0/295325925 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f536008eac0 con 0x7f53700731c0 2024-02-28T23:20:18.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.357+0000 7f5367e00700 1 --2- 172.21.15.159:0/295325925 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f535406d8a0 0x7f535406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:18.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.358+0000 7f5367e00700 1 --2- 172.21.15.159:0/295325925 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f535406d8a0 0x7f535406fd60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5370199f70 tx=0x7f535800a300 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:18.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.361+0000 7f5366a00700 1 -- 172.21.15.159:0/295325925 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f536005bd20 con 0x7f53700731c0 2024-02-28T23:20:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:18 smithi159 ceph-mon[113833]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-28T23:20:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:18 smithi159 ceph-mon[113833]: pgmap v278: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T23:20:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-28T23:20:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:18 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 3 up:standby 2024-02-28T23:20:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:18 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:20:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:18.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:18.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:18.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:18 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:18 smithi184 ceph-mon[86482]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-02-28T23:20:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:18 smithi184 ceph-mon[86482]: pgmap v278: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 2.4 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T23:20:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-02-28T23:20:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:18 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 3 up:standby 2024-02-28T23:20:18.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:18 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:20:18.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:18.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:18.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:18.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:18.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:18.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:18 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:18.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.621+0000 7f5374a00700 1 -- 172.21.15.159:0/295325925 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f537019ddd0 con 0x7f535406d8a0 2024-02-28T23:20:18.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.633+0000 7f5366a00700 1 -- 172.21.15.159:0/295325925 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f537019ddd0 con 0x7f535406d8a0 2024-02-28T23:20:18.632 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:20:18.632 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (9m) 58s ago 24m 14.2M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (3m) 58s ago 24m 8212k - 18.2.1 5be31c24972a f9515936ed5d 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (22m) 10s ago 22m 9168k - 18.2.1 5be31c24972a 48ea41337278 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (5m) 58s ago 24m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (5m) 10s ago 22m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (9m) 58s ago 23m 75.3M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (66s) 58s ago 16m 10.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 8da78eb84d38 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (100s) 58s ago 16m 11.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b aa9a201d4df0 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (39s) 10s ago 16m 11.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 27fe678d733e 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (15s) 10s ago 16m 11.1M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 157b654aead0 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (12m) 58s ago 25m 510M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (11m) 10s ago 22m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (7m) 58s ago 26m 56.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (6m) 10s ago 22m 40.7M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (11m) 58s ago 24m 7977k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:20:18.633 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (10m) 10s ago 22m 7826k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:20:18.634 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (5m) 58s ago 21m 120M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:20:18.634 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (4m) 58s ago 20m 108M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9120e23d80c0 2024-02-28T23:20:18.634 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (4m) 58s ago 20m 100M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 952e59c58165 2024-02-28T23:20:18.634 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (3m) 10s ago 19m 111M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 643ebdb823be 2024-02-28T23:20:18.634 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (2m) 10s ago 19m 104M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b dc8cef678e65 2024-02-28T23:20:18.634 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (2m) 10s ago 18m 107M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 1426063f8d8e 2024-02-28T23:20:18.634 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (10m) 58s ago 23m 60.2M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:20:18.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.636+0000 7f5374a00700 1 -- 172.21.15.159:0/295325925 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f535406d8a0 msgr2=0x7f535406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:18.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.636+0000 7f5374a00700 1 --2- 172.21.15.159:0/295325925 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f535406d8a0 0x7f535406fd60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5370199f70 tx=0x7f535800a300 comp rx=0 tx=0).stop 2024-02-28T23:20:18.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.636+0000 7f5374a00700 1 -- 172.21.15.159:0/295325925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53700731c0 msgr2=0x7f5370198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:18.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.636+0000 7f5374a00700 1 --2- 172.21.15.159:0/295325925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53700731c0 0x7f5370198950 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f53600092e0 tx=0x7f536000bd50 comp rx=0 tx=0).stop 2024-02-28T23:20:18.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.636+0000 7f5374a00700 1 -- 172.21.15.159:0/295325925 shutdown_connections 2024-02-28T23:20:18.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.636+0000 7f5374a00700 1 --2- 172.21.15.159:0/295325925 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f535406d8a0 0x7f535406fd60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.636+0000 7f5374a00700 1 --2- 172.21.15.159:0/295325925 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f53700731c0 0x7f5370198950 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.636+0000 7f5374a00700 1 --2- 172.21.15.159:0/295325925 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5370073ae0 0x7f5370198e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.636+0000 7f5374a00700 1 -- 172.21.15.159:0/295325925 >> 172.21.15.159:0/295325925 conn(0x7f53700fc630 msgr2=0x7f5370107680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:18.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.636+0000 7f5374a00700 1 -- 172.21.15.159:0/295325925 shutdown_connections 2024-02-28T23:20:18.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.637+0000 7f5374a00700 1 -- 172.21.15.159:0/295325925 wait complete. 2024-02-28T23:20:18.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.791+0000 7f412f200700 1 -- 172.21.15.159:0/4094960155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4128068410 msgr2=0x7f4128068890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:18.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.791+0000 7f412f200700 1 --2- 172.21.15.159:0/4094960155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4128068410 0x7f4128068890 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4118009910 tx=0x7f4118009c20 comp rx=0 tx=0).stop 2024-02-28T23:20:18.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.791+0000 7f412f200700 1 -- 172.21.15.159:0/4094960155 shutdown_connections 2024-02-28T23:20:18.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.791+0000 7f412f200700 1 --2- 172.21.15.159:0/4094960155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4128068410 0x7f4128068890 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.791+0000 7f412f200700 1 --2- 172.21.15.159:0/4094960155 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4128106a40 0x7f4128106e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.791+0000 7f412f200700 1 -- 172.21.15.159:0/4094960155 >> 172.21.15.159:0/4094960155 conn(0x7f4128075330 msgr2=0x7f4128075740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:18.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.792+0000 7f412f200700 1 -- 172.21.15.159:0/4094960155 shutdown_connections 2024-02-28T23:20:18.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.792+0000 7f412f200700 1 -- 172.21.15.159:0/4094960155 wait complete. 2024-02-28T23:20:18.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.793+0000 7f412f200700 1 Processor -- start 2024-02-28T23:20:18.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.793+0000 7f412f200700 1 -- start start 2024-02-28T23:20:18.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.794+0000 7f412f200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4128068410 0x7f412819e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:18.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.794+0000 7f412f200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4128106a40 0x7f412819ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:18.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.794+0000 7f412f200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412819f110 con 0x7f4128106a40 2024-02-28T23:20:18.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.794+0000 7f412f200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41281985c0 con 0x7f4128068410 2024-02-28T23:20:18.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.795+0000 7f412de00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4128068410 0x7f412819e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:18.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.795+0000 7f412de00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4128068410 0x7f412819e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.184:3300/0 says I am v2:172.21.15.159:51640/0 (socket says 172.21.15.159:51640) 2024-02-28T23:20:18.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.795+0000 7f412d400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4128106a40 0x7f412819ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:18.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.795+0000 7f412de00700 1 -- 172.21.15.159:0/488196788 learned_addr learned my addr 172.21.15.159:0/488196788 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:20:18.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.796+0000 7f412d400700 1 -- 172.21.15.159:0/488196788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4128068410 msgr2=0x7f412819e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:18.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.796+0000 7f412d400700 1 --2- 172.21.15.159:0/488196788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4128068410 0x7f412819e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:18.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.796+0000 7f412d400700 1 -- 172.21.15.159:0/488196788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41180095f0 con 0x7f4128106a40 2024-02-28T23:20:18.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.796+0000 7f412de00700 1 --2- 172.21.15.159:0/488196788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4128068410 0x7f412819e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-02-28T23:20:18.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.796+0000 7f412d400700 1 --2- 172.21.15.159:0/488196788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4128106a40 0x7f412819ea80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4118009910 tx=0x7f411800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:18.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.797+0000 7f4122a00700 1 -- 172.21.15.159:0/488196788 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f411801d070 con 0x7f4128106a40 2024-02-28T23:20:18.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.797+0000 7f412f200700 1 -- 172.21.15.159:0/488196788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4128198840 con 0x7f4128106a40 2024-02-28T23:20:18.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.797+0000 7f4122a00700 1 -- 172.21.15.159:0/488196788 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f411800f460 con 0x7f4128106a40 2024-02-28T23:20:18.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.797+0000 7f4122a00700 1 -- 172.21.15.159:0/488196788 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4118017630 con 0x7f4128106a40 2024-02-28T23:20:18.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.797+0000 7f412f200700 1 -- 172.21.15.159:0/488196788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4128198d30 con 0x7f4128106a40 2024-02-28T23:20:18.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.799+0000 7f412f200700 1 -- 172.21.15.159:0/488196788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f412804f2e0 con 0x7f4128106a40 2024-02-28T23:20:18.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.800+0000 7f4122a00700 1 -- 172.21.15.159:0/488196788 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f411800fab0 con 0x7f4128106a40 2024-02-28T23:20:18.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.801+0000 7f4122a00700 1 --2- 172.21.15.159:0/488196788 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f411006d8a0 0x7f411006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:18.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.801+0000 7f4122a00700 1 -- 172.21.15.159:0/488196788 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f411808e9a0 con 0x7f4128106a40 2024-02-28T23:20:18.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.801+0000 7f412de00700 1 --2- 172.21.15.159:0/488196788 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f411006d8a0 0x7f411006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:18.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.802+0000 7f412de00700 1 --2- 172.21.15.159:0/488196788 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f411006d8a0 0x7f411006fd60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f411c005950 tx=0x7f411c00a400 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:18.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:18.810+0000 7f4122a00700 1 -- 172.21.15.159:0/488196788 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f411805bcc0 con 0x7f4128106a40 2024-02-28T23:20:19.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.128+0000 7f412f200700 1 -- 172.21.15.159:0/488196788 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f4128199180 con 0x7f4128106a40 2024-02-28T23:20:19.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.129+0000 7f4122a00700 1 -- 172.21.15.159:0/488196788 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f411805b850 con 0x7f4128106a40 2024-02-28T23:20:19.129 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:20:19.129 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:20:19.129 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:20:19.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:20:19.129 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:20:19.129 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:20:19.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:20:19.129 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:20:19.129 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T23:20:19.129 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:20:19.129 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:20:19.130 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T23:20:19.130 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:20:19.130 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:20:19.130 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T23:20:19.130 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:20:19.130 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:20:19.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.132+0000 7f412f200700 1 -- 172.21.15.159:0/488196788 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f411006d8a0 msgr2=0x7f411006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.132+0000 7f412f200700 1 --2- 172.21.15.159:0/488196788 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f411006d8a0 0x7f411006fd60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f411c005950 tx=0x7f411c00a400 comp rx=0 tx=0).stop 2024-02-28T23:20:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.132+0000 7f412f200700 1 -- 172.21.15.159:0/488196788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4128106a40 msgr2=0x7f412819ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.132+0000 7f412f200700 1 --2- 172.21.15.159:0/488196788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4128106a40 0x7f412819ea80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f4118009910 tx=0x7f411800bd70 comp rx=0 tx=0).stop 2024-02-28T23:20:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.132+0000 7f412f200700 1 -- 172.21.15.159:0/488196788 shutdown_connections 2024-02-28T23:20:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.132+0000 7f412f200700 1 --2- 172.21.15.159:0/488196788 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4128068410 0x7f412819e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.132+0000 7f412f200700 1 --2- 172.21.15.159:0/488196788 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f411006d8a0 0x7f411006fd60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.132+0000 7f412f200700 1 --2- 172.21.15.159:0/488196788 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4128106a40 0x7f412819ea80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.132+0000 7f412f200700 1 -- 172.21.15.159:0/488196788 >> 172.21.15.159:0/488196788 conn(0x7f4128075330 msgr2=0x7f41280fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:19.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.132+0000 7f412f200700 1 -- 172.21.15.159:0/488196788 shutdown_connections 2024-02-28T23:20:19.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.133+0000 7f412f200700 1 -- 172.21.15.159:0/488196788 wait complete. 2024-02-28T23:20:19.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.310+0000 7fe1e5400700 1 -- 172.21.15.159:0/3611171119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e0105b50 msgr2=0x7fe1e0068410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:19.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.310+0000 7fe1e5400700 1 --2- 172.21.15.159:0/3611171119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e0105b50 0x7fe1e0068410 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe1d0009910 tx=0x7fe1d0009c20 comp rx=0 tx=0).stop 2024-02-28T23:20:19.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.310+0000 7fe1e5400700 1 -- 172.21.15.159:0/3611171119 shutdown_connections 2024-02-28T23:20:19.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.310+0000 7fe1e5400700 1 --2- 172.21.15.159:0/3611171119 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1e0068950 0x7fe1e0068dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.310+0000 7fe1e5400700 1 --2- 172.21.15.159:0/3611171119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e0105b50 0x7fe1e0068410 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.310+0000 7fe1e5400700 1 -- 172.21.15.159:0/3611171119 >> 172.21.15.159:0/3611171119 conn(0x7fe1e00755a0 msgr2=0x7fe1e00759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:19.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.311+0000 7fe1e5400700 1 -- 172.21.15.159:0/3611171119 shutdown_connections 2024-02-28T23:20:19.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.311+0000 7fe1e5400700 1 -- 172.21.15.159:0/3611171119 wait complete. 2024-02-28T23:20:19.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.312+0000 7fe1e5400700 1 Processor -- start 2024-02-28T23:20:19.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.313+0000 7fe1e5400700 1 -- start start 2024-02-28T23:20:19.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.313+0000 7fe1e5400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e0068950 0x7fe1e01a2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:19.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.313+0000 7fe1e5400700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1e0105b50 0x7fe1e01a2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:19.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.313+0000 7fe1e5400700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e01a3680 con 0x7fe1e0068950 2024-02-28T23:20:19.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.313+0000 7fe1e5400700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e019cb30 con 0x7fe1e0105b50 2024-02-28T23:20:19.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.314+0000 7fe1de800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e0068950 0x7fe1e01a2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:19.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.314+0000 7fe1de800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e0068950 0x7fe1e01a2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35420/0 (socket says 172.21.15.159:35420) 2024-02-28T23:20:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.314+0000 7fe1dde00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1e0105b50 0x7fe1e01a2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.314+0000 7fe1de800700 1 -- 172.21.15.159:0/1209689734 learned_addr learned my addr 172.21.15.159:0/1209689734 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:20:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.315+0000 7fe1de800700 1 -- 172.21.15.159:0/1209689734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1e0105b50 msgr2=0x7fe1e01a2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.315+0000 7fe1de800700 1 --2- 172.21.15.159:0/1209689734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1e0105b50 0x7fe1e01a2ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.315+0000 7fe1de800700 1 -- 172.21.15.159:0/1209689734 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d00095f0 con 0x7fe1e0068950 2024-02-28T23:20:19.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.315+0000 7fe1de800700 1 --2- 172.21.15.159:0/1209689734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e0068950 0x7fe1e01a2ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000bda0 tx=0x7fe1d000bdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.315+0000 7fe1d7400700 1 -- 172.21.15.159:0/1209689734 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d001d070 con 0x7fe1e0068950 2024-02-28T23:20:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.315+0000 7fe1d7400700 1 -- 172.21.15.159:0/1209689734 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fe1d0005dc0 con 0x7fe1e0068950 2024-02-28T23:20:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.315+0000 7fe1d7400700 1 -- 172.21.15.159:0/1209689734 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1d0017400 con 0x7fe1e0068950 2024-02-28T23:20:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.315+0000 7fe1e5400700 1 -- 172.21.15.159:0/1209689734 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e019cdb0 con 0x7fe1e0068950 2024-02-28T23:20:19.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.316+0000 7fe1e5400700 1 -- 172.21.15.159:0/1209689734 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e019d320 con 0x7fe1e0068950 2024-02-28T23:20:19.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.317+0000 7fe1e5400700 1 -- 172.21.15.159:0/1209689734 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e004ea90 con 0x7fe1e0068950 2024-02-28T23:20:19.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.318+0000 7fe1d7400700 1 -- 172.21.15.159:0/1209689734 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fe1d000f460 con 0x7fe1e0068950 2024-02-28T23:20:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.319+0000 7fe1d7400700 1 --2- 172.21.15.159:0/1209689734 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe1c406d8a0 0x7fe1c406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.319+0000 7fe1d7400700 1 -- 172.21.15.159:0/1209689734 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fe1d008e9d0 con 0x7fe1e0068950 2024-02-28T23:20:19.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.320+0000 7fe1dde00700 1 --2- 172.21.15.159:0/1209689734 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe1c406d8a0 0x7fe1c406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:19.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.321+0000 7fe1dde00700 1 --2- 172.21.15.159:0/1209689734 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe1c406d8a0 0x7fe1c406fd60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0075bd0 tx=0x7fe1cc00b410 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:19.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.325+0000 7fe1d7400700 1 -- 172.21.15.159:0/1209689734 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fe1d005bb90 con 0x7fe1e0068950 2024-02-28T23:20:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:19 smithi184 ceph-mon[86482]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:19 smithi184 ceph-mon[86482]: Upgrade: Setting container_image for all rgw 2024-02-28T23:20:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:19 smithi184 ceph-mon[86482]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T23:20:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:19 smithi184 ceph-mon[86482]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:19.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:19 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/488196788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:19.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.654+0000 7fe1e5400700 1 -- 172.21.15.159:0/1209689734 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe1e019d6f0 con 0x7fe1e0068950 2024-02-28T23:20:19.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.654+0000 7fe1d7400700 1 -- 172.21.15.159:0/1209689734 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 39 v39) v1 ==== 76+0+1903 (secure 0 0 0) 0x7fe1d005b720 con 0x7fe1e0068950 2024-02-28T23:20:19.654 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:19 smithi159 ceph-mon[113833]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:19.654 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:19 smithi159 ceph-mon[113833]: Upgrade: Setting container_image for all rgw 2024-02-28T23:20:19.654 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:19 smithi159 ceph-mon[113833]: Upgrade: Setting container_image for all rbd-mirror 2024-02-28T23:20:19.654 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:19 smithi159 ceph-mon[113833]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:19.655 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:19 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/488196788' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:19.655 INFO:teuthology.orchestra.run.smithi159.stdout:e39 2024-02-28T23:20:19.655 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:20:19.655 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:20:19.655 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:20:19.655 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:20:19.655 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:20:19.655 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 39 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:20:17.750020+0000 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:20:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 102 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=34440} 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:20:19.657 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:20:19.658 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:20:19.658 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:34440} state up:active seq 25 join_fscid=1 addr [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:20:19.658 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:34476} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6828/1030084771,v1:172.21.15.159:6829/1030084771] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:20:19.658 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:20:19.658 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:20:19.658 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:20:19.658 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:20:19.658 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:44283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2221421248,v1:172.21.15.184:6825/2221421248] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:20:19.658 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:44311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6826/146669833,v1:172.21.15.184:6827/146669833] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:20:19.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.658+0000 7fe1e5400700 1 -- 172.21.15.159:0/1209689734 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe1c406d8a0 msgr2=0x7fe1c406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:19.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.658+0000 7fe1e5400700 1 --2- 172.21.15.159:0/1209689734 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe1c406d8a0 0x7fe1c406fd60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe1e0075bd0 tx=0x7fe1cc00b410 comp rx=0 tx=0).stop 2024-02-28T23:20:19.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.658+0000 7fe1e5400700 1 -- 172.21.15.159:0/1209689734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e0068950 msgr2=0x7fe1e01a2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:19.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.658+0000 7fe1e5400700 1 --2- 172.21.15.159:0/1209689734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e0068950 0x7fe1e01a2ab0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe1d000bda0 tx=0x7fe1d000bdd0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.658+0000 7fe1e5400700 1 -- 172.21.15.159:0/1209689734 shutdown_connections 2024-02-28T23:20:19.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.658+0000 7fe1e5400700 1 --2- 172.21.15.159:0/1209689734 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fe1c406d8a0 0x7fe1c406fd60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.658+0000 7fe1e5400700 1 --2- 172.21.15.159:0/1209689734 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe1e0068950 0x7fe1e01a2ab0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.658+0000 7fe1e5400700 1 --2- 172.21.15.159:0/1209689734 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fe1e0105b50 0x7fe1e01a2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.658+0000 7fe1e5400700 1 -- 172.21.15.159:0/1209689734 >> 172.21.15.159:0/1209689734 conn(0x7fe1e00755a0 msgr2=0x7fe1e01014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:19.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.658+0000 7fe1e5400700 1 -- 172.21.15.159:0/1209689734 shutdown_connections 2024-02-28T23:20:19.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.658+0000 7fe1e5400700 1 -- 172.21.15.159:0/1209689734 wait complete. 2024-02-28T23:20:19.660 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 39 2024-02-28T23:20:19.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.810+0000 7f952b800700 1 -- 172.21.15.159:0/3301443272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9524105b50 msgr2=0x7f9524068410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:19.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.810+0000 7f952b800700 1 --2- 172.21.15.159:0/3301443272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9524105b50 0x7f9524068410 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9518009910 tx=0x7f9518009c20 comp rx=0 tx=0).stop 2024-02-28T23:20:19.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.810+0000 7f952b800700 1 -- 172.21.15.159:0/3301443272 shutdown_connections 2024-02-28T23:20:19.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.810+0000 7f952b800700 1 --2- 172.21.15.159:0/3301443272 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524068950 0x7f9524068dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.810+0000 7f952b800700 1 --2- 172.21.15.159:0/3301443272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9524105b50 0x7f9524068410 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.810+0000 7f952b800700 1 -- 172.21.15.159:0/3301443272 >> 172.21.15.159:0/3301443272 conn(0x7f95240755a0 msgr2=0x7f95240759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:19.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.811+0000 7f952b800700 1 -- 172.21.15.159:0/3301443272 shutdown_connections 2024-02-28T23:20:19.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.811+0000 7f952b800700 1 -- 172.21.15.159:0/3301443272 wait complete. 2024-02-28T23:20:19.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.812+0000 7f952b800700 1 Processor -- start 2024-02-28T23:20:19.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.812+0000 7f952b800700 1 -- start start 2024-02-28T23:20:19.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.813+0000 7f952b800700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524068950 0x7f952419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:19.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.813+0000 7f952b800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9524105b50 0x7f952419d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:19.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.813+0000 7f952b800700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952419da70 con 0x7f9524105b50 2024-02-28T23:20:19.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.813+0000 7f952b800700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95241a1800 con 0x7f9524068950 2024-02-28T23:20:19.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.813+0000 7f9523e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9524105b50 0x7f952419d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:19.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.813+0000 7f9523e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9524105b50 0x7f952419d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35434/0 (socket says 172.21.15.159:35434) 2024-02-28T23:20:19.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.813+0000 7f9523e00700 1 -- 172.21.15.159:0/1963025307 learned_addr learned my addr 172.21.15.159:0/1963025307 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:20:19.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.814+0000 7f9528e00700 1 --2- 172.21.15.159:0/1963025307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524068950 0x7f952419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:19.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.814+0000 7f9523e00700 1 -- 172.21.15.159:0/1963025307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524068950 msgr2=0x7f952419ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:19.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.814+0000 7f9523e00700 1 --2- 172.21.15.159:0/1963025307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524068950 0x7f952419ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:19.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.814+0000 7f9523e00700 1 -- 172.21.15.159:0/1963025307 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95180095f0 con 0x7f9524105b50 2024-02-28T23:20:19.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.814+0000 7f9523e00700 1 --2- 172.21.15.159:0/1963025307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9524105b50 0x7f952419d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f951000b4b0 tx=0x7f951000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:19.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.814+0000 7f9521600700 1 -- 172.21.15.159:0/1963025307 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9510011800 con 0x7f9524105b50 2024-02-28T23:20:19.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.815+0000 7f952b800700 1 -- 172.21.15.159:0/1963025307 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95241a1ae0 con 0x7f9524105b50 2024-02-28T23:20:19.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.815+0000 7f9521600700 1 -- 172.21.15.159:0/1963025307 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9510011e20 con 0x7f9524105b50 2024-02-28T23:20:19.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.815+0000 7f9521600700 1 -- 172.21.15.159:0/1963025307 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f951000f2e0 con 0x7f9524105b50 2024-02-28T23:20:19.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.815+0000 7f952b800700 1 -- 172.21.15.159:0/1963025307 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95241a2030 con 0x7f9524105b50 2024-02-28T23:20:19.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.816+0000 7f952b800700 1 -- 172.21.15.159:0/1963025307 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95241101a0 con 0x7f9524105b50 2024-02-28T23:20:19.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.818+0000 7f9521600700 1 -- 172.21.15.159:0/1963025307 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f9510010380 con 0x7f9524105b50 2024-02-28T23:20:19.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.819+0000 7f9521600700 1 --2- 172.21.15.159:0/1963025307 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f950c06d8a0 0x7f950c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:19.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.819+0000 7f9521600700 1 -- 172.21.15.159:0/1963025307 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f951008d1d0 con 0x7f9524105b50 2024-02-28T23:20:19.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.819+0000 7f9528e00700 1 --2- 172.21.15.159:0/1963025307 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f950c06d8a0 0x7f950c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:19.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.820+0000 7f9528e00700 1 --2- 172.21.15.159:0/1963025307 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f950c06d8a0 0x7f950c06fd60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9518005f50 tx=0x7f951801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:19.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:19.828+0000 7f9521600700 1 -- 172.21.15.159:0/1963025307 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9510056910 con 0x7f9524105b50 2024-02-28T23:20:20.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.098+0000 7f952b800700 1 -- 172.21.15.159:0/1963025307 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95241a23e0 con 0x7f950c06d8a0 2024-02-28T23:20:20.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.101+0000 7f9521600700 1 -- 172.21.15.159:0/1963025307 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+441 (secure 0 0 0) 0x7f95241a23e0 con 0x7f950c06d8a0 2024-02-28T23:20:20.100 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc", 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": true, 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [ 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "osd", 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr", 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "mds", 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "crash", 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "mon" 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: ], 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": "16/23 daemons upgraded", 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "Currently upgrading ceph-exporter daemons", 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:20:20.101 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:20:20.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.103+0000 7f952b800700 1 -- 172.21.15.159:0/1963025307 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f950c06d8a0 msgr2=0x7f950c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:20.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.103+0000 7f952b800700 1 --2- 172.21.15.159:0/1963025307 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f950c06d8a0 0x7f950c06fd60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9518005f50 tx=0x7f951801a040 comp rx=0 tx=0).stop 2024-02-28T23:20:20.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.103+0000 7f952b800700 1 -- 172.21.15.159:0/1963025307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9524105b50 msgr2=0x7f952419d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:20.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.103+0000 7f952b800700 1 --2- 172.21.15.159:0/1963025307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9524105b50 0x7f952419d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f951000b4b0 tx=0x7f951000b870 comp rx=0 tx=0).stop 2024-02-28T23:20:20.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.103+0000 7f952b800700 1 -- 172.21.15.159:0/1963025307 shutdown_connections 2024-02-28T23:20:20.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.103+0000 7f952b800700 1 --2- 172.21.15.159:0/1963025307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f9524068950 0x7f952419ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:20.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.103+0000 7f952b800700 1 --2- 172.21.15.159:0/1963025307 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f950c06d8a0 0x7f950c06fd60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:20.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.103+0000 7f952b800700 1 --2- 172.21.15.159:0/1963025307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9524105b50 0x7f952419d390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:20.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.103+0000 7f952b800700 1 -- 172.21.15.159:0/1963025307 >> 172.21.15.159:0/1963025307 conn(0x7f95240755a0 msgr2=0x7f95241015b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:20.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.104+0000 7f952b800700 1 -- 172.21.15.159:0/1963025307 shutdown_connections 2024-02-28T23:20:20.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.104+0000 7f952b800700 1 -- 172.21.15.159:0/1963025307 wait complete. 2024-02-28T23:20:20.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.255+0000 7f83d0200700 1 -- 172.21.15.159:0/2002722279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8068670 msgr2=0x7f83c8068a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:20.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.255+0000 7f83d0200700 1 --2- 172.21.15.159:0/2002722279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8068670 0x7f83c8068a50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f83bc009910 tx=0x7f83bc009c20 comp rx=0 tx=0).stop 2024-02-28T23:20:20.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.255+0000 7f83d0200700 1 -- 172.21.15.159:0/2002722279 shutdown_connections 2024-02-28T23:20:20.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.255+0000 7f83d0200700 1 --2- 172.21.15.159:0/2002722279 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83c8069020 0x7f83c8105790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:20.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.255+0000 7f83d0200700 1 --2- 172.21.15.159:0/2002722279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8068670 0x7f83c8068a50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:20.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.255+0000 7f83d0200700 1 -- 172.21.15.159:0/2002722279 >> 172.21.15.159:0/2002722279 conn(0x7f83c80755a0 msgr2=0x7f83c80759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:20.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.255+0000 7f83d0200700 1 -- 172.21.15.159:0/2002722279 shutdown_connections 2024-02-28T23:20:20.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.255+0000 7f83d0200700 1 -- 172.21.15.159:0/2002722279 wait complete. 2024-02-28T23:20:20.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.256+0000 7f83d0200700 1 Processor -- start 2024-02-28T23:20:20.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.256+0000 7f83d0200700 1 -- start start 2024-02-28T23:20:20.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.257+0000 7f83d0200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8068670 0x7f83c819e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:20.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.257+0000 7f83d0200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83c8069020 0x7f83c819ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:20.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.257+0000 7f83d0200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c819f270 con 0x7f83c8068670 2024-02-28T23:20:20.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.257+0000 7f83d0200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8198790 con 0x7f83c8069020 2024-02-28T23:20:20.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.257+0000 7f83cd800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8068670 0x7f83c819e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:20.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.257+0000 7f83cd800700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8068670 0x7f83c819e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35450/0 (socket says 172.21.15.159:35450) 2024-02-28T23:20:20.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.257+0000 7f83cd800700 1 -- 172.21.15.159:0/1195904439 learned_addr learned my addr 172.21.15.159:0/1195904439 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:20:20.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.257+0000 7f83cce00700 1 --2- 172.21.15.159:0/1195904439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83c8069020 0x7f83c819ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:20.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.257+0000 7f83cd800700 1 -- 172.21.15.159:0/1195904439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83c8069020 msgr2=0x7f83c819ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:20.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.257+0000 7f83cd800700 1 --2- 172.21.15.159:0/1195904439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83c8069020 0x7f83c819ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:20.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.258+0000 7f83cd800700 1 -- 172.21.15.159:0/1195904439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc0095f0 con 0x7f83c8068670 2024-02-28T23:20:20.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.258+0000 7f83cd800700 1 --2- 172.21.15.159:0/1195904439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8068670 0x7f83c819e6a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83bc006010 tx=0x7f83bc00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:20.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.258+0000 7f83c6000700 1 -- 172.21.15.159:0/1195904439 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83bc01d070 con 0x7f83c8068670 2024-02-28T23:20:20.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.258+0000 7f83c6000700 1 -- 172.21.15.159:0/1195904439 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f83bc004fb0 con 0x7f83c8068670 2024-02-28T23:20:20.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.258+0000 7f83d0200700 1 -- 172.21.15.159:0/1195904439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c8198a10 con 0x7f83c8068670 2024-02-28T23:20:20.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.258+0000 7f83c6000700 1 -- 172.21.15.159:0/1195904439 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83bc00f690 con 0x7f83c8068670 2024-02-28T23:20:20.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.258+0000 7f83d0200700 1 -- 172.21.15.159:0/1195904439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c8198f00 con 0x7f83c8068670 2024-02-28T23:20:20.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.260+0000 7f83d0200700 1 -- 172.21.15.159:0/1195904439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c804ea90 con 0x7f83c8068670 2024-02-28T23:20:20.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.261+0000 7f83c6000700 1 -- 172.21.15.159:0/1195904439 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f83bc004af0 con 0x7f83c8068670 2024-02-28T23:20:20.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.263+0000 7f83c6000700 1 --2- 172.21.15.159:0/1195904439 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f83b006d8a0 0x7f83b006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:20.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.263+0000 7f83c6000700 1 -- 172.21.15.159:0/1195904439 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f83bc08ef60 con 0x7f83c8068670 2024-02-28T23:20:20.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.263+0000 7f83cce00700 1 --2- 172.21.15.159:0/1195904439 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f83b006d8a0 0x7f83b006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:20.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.264+0000 7f83cce00700 1 --2- 172.21.15.159:0/1195904439 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f83b006d8a0 0x7f83b006fd60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f83b4005fd0 tx=0x7f83b400a560 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:20.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.267+0000 7f83c6000700 1 -- 172.21.15.159:0/1195904439 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f83bc05c0a0 con 0x7f83c8068670 2024-02-28T23:20:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:20 smithi184 ceph-mon[86482]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:20 smithi184 ceph-mon[86482]: pgmap v279: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T23:20:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:20 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1209689734' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:20:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:20 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:20 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:20:20.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:20 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:20.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.623+0000 7f83d0200700 1 -- 172.21.15.159:0/1195904439 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f83c8199ca0 con 0x7f83c8068670 2024-02-28T23:20:20.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:20 smithi159 ceph-mon[113833]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:20.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:20 smithi159 ceph-mon[113833]: pgmap v279: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 3.4 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-02-28T23:20:20.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:20 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1209689734' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:20:20.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:20 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:20.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:20 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi159", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:20:20.624 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:20 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:20.624 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_OK 2024-02-28T23:20:20.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.624+0000 7f83c6000700 1 -- 172.21.15.159:0/1195904439 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f83bc027020 con 0x7f83c8068670 2024-02-28T23:20:20.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.628+0000 7f83d0200700 1 -- 172.21.15.159:0/1195904439 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f83b006d8a0 msgr2=0x7f83b006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:20.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.628+0000 7f83d0200700 1 --2- 172.21.15.159:0/1195904439 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f83b006d8a0 0x7f83b006fd60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f83b4005fd0 tx=0x7f83b400a560 comp rx=0 tx=0).stop 2024-02-28T23:20:20.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.628+0000 7f83d0200700 1 -- 172.21.15.159:0/1195904439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8068670 msgr2=0x7f83c819e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:20.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.628+0000 7f83d0200700 1 --2- 172.21.15.159:0/1195904439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8068670 0x7f83c819e6a0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f83bc006010 tx=0x7f83bc00be20 comp rx=0 tx=0).stop 2024-02-28T23:20:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.629+0000 7f83d0200700 1 -- 172.21.15.159:0/1195904439 shutdown_connections 2024-02-28T23:20:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.629+0000 7f83d0200700 1 --2- 172.21.15.159:0/1195904439 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f83b006d8a0 0x7f83b006fd60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.629+0000 7f83d0200700 1 --2- 172.21.15.159:0/1195904439 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83c8068670 0x7f83c819e6a0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.629+0000 7f83d0200700 1 --2- 172.21.15.159:0/1195904439 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83c8069020 0x7f83c819ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.629+0000 7f83d0200700 1 -- 172.21.15.159:0/1195904439 >> 172.21.15.159:0/1195904439 conn(0x7f83c80755a0 msgr2=0x7f83c80fe7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.630+0000 7f83d0200700 1 -- 172.21.15.159:0/1195904439 shutdown_connections 2024-02-28T23:20:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:20.630+0000 7f83d0200700 1 -- 172.21.15.159:0/1195904439 wait complete. 2024-02-28T23:20:21.597 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:21 smithi159 ceph-mon[113833]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:21.597 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:21 smithi159 ceph-mon[113833]: Upgrade: Updating ceph-exporter.smithi159 (1/2) 2024-02-28T23:20:21.597 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:21 smithi159 ceph-mon[113833]: Deploying daemon ceph-exporter.smithi159 on smithi159 2024-02-28T23:20:21.597 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:21 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1195904439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:20:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:21 smithi184 ceph-mon[86482]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:21 smithi184 ceph-mon[86482]: Upgrade: Updating ceph-exporter.smithi159 (1/2) 2024-02-28T23:20:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:21 smithi184 ceph-mon[86482]: Deploying daemon ceph-exporter.smithi159 on smithi159 2024-02-28T23:20:21.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:21 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1195904439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:20:22.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:22 smithi184 ceph-mon[86482]: pgmap v280: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T23:20:22.615 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:22 smithi159 ceph-mon[113833]: pgmap v280: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 3.5 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-02-28T23:20:24.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:24 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:24.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:24 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:20:24.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:24 smithi159 ceph-mon[113833]: pgmap v281: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 85 B/s wr, 4 op/s 2024-02-28T23:20:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:24 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:24 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:20:24.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:24 smithi184 ceph-mon[86482]: pgmap v281: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 8.8 MiB/s rd, 85 B/s wr, 4 op/s 2024-02-28T23:20:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:26 smithi184 ceph-mon[86482]: pgmap v282: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-02-28T23:20:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:26 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:26.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:26 smithi159 ceph-mon[113833]: pgmap v282: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-02-28T23:20:26.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:26.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:26 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:28 smithi184 ceph-mon[86482]: pgmap v283: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4 op/s 2024-02-28T23:20:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:20:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:28 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:28.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:28 smithi159 ceph-mon[113833]: pgmap v283: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4 op/s 2024-02-28T23:20:28.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:28.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi184", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-02-28T23:20:28.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:28 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:29.531 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:29 smithi184 ceph-mon[86482]: Upgrade: Updating ceph-exporter.smithi184 (2/2) 2024-02-28T23:20:29.531 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:29 smithi184 ceph-mon[86482]: Deploying daemon ceph-exporter.smithi184 on smithi184 2024-02-28T23:20:29.558 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:29 smithi159 ceph-mon[113833]: Upgrade: Updating ceph-exporter.smithi184 (2/2) 2024-02-28T23:20:29.558 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:29 smithi159 ceph-mon[113833]: Deploying daemon ceph-exporter.smithi184 on smithi184 2024-02-28T23:20:30.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:30 smithi184 ceph-mon[86482]: pgmap v284: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4 op/s 2024-02-28T23:20:30.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:30 smithi159 ceph-mon[113833]: pgmap v284: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 4 op/s 2024-02-28T23:20:32.570 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:32 smithi184 ceph-mon[86482]: pgmap v285: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-28T23:20:32.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:32 smithi159 ceph-mon[113833]: pgmap v285: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 5 op/s 2024-02-28T23:20:34.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:34 smithi184 ceph-mon[86482]: pgmap v286: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-02-28T23:20:34.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:34 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:34.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:34 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:34.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:34 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:34 smithi159 ceph-mon[113833]: pgmap v286: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 4 op/s 2024-02-28T23:20:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:34 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:34 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:34.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:34 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:36.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:36 smithi159 ceph-mon[113833]: pgmap v287: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 8.1 MiB/s rd, 2 op/s 2024-02-28T23:20:36.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:36 smithi184 ceph-mon[86482]: pgmap v287: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 8.1 MiB/s rd, 2 op/s 2024-02-28T23:20:38.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:37 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:38.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:37 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:38.223 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:37 smithi159 ceph-mon[113833]: pgmap v288: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 2 op/s 2024-02-28T23:20:38.293 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:37 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:38.293 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:37 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:38.293 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:37 smithi184 ceph-mon[86482]: pgmap v288: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 3.4 MiB/s rd, 2 op/s 2024-02-28T23:20:39.221 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:20:39.349 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:20:40.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:40 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:40.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:40 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:40.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:40 smithi184 ceph-mon[86482]: pgmap v289: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-02-28T23:20:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:40 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:40 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:40.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:40 smithi159 ceph-mon[113833]: pgmap v289: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-02-28T23:20:41.438 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:41 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:41.438 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:41 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:41.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:41 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:41.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:41 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:42.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:42 smithi159 ceph-mon[113833]: pgmap v290: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-02-28T23:20:42.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:42 smithi184 ceph-mon[86482]: pgmap v290: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 342 KiB/s rd, 1 op/s 2024-02-28T23:20:43.303 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:43 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:43.304 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:43 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:43.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:43 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:43.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:43 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:44.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:44 smithi159 ceph-mon[113833]: pgmap v291: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:20:44.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:44 smithi184 ceph-mon[86482]: pgmap v291: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:20:45.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:45 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:45.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:45 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:45 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:45 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:46.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:46 smithi159 ceph-mon[113833]: pgmap v292: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:20:46.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:46 smithi184 ceph-mon[86482]: pgmap v292: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:20:48.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:48 smithi159 ceph-mon[113833]: pgmap v293: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:20:48.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:48.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:48.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:48.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:20:48.473 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:48 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:48 smithi184 ceph-mon[86482]: pgmap v293: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:20:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:20:48.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:48 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:49.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:49 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:49.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:49 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:49.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:49 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:49.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:49 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:49.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:49 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:49.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:49 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:49.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:49 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-28T23:20:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:49 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:49 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:49 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:49 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:49 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:49 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:49.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:49 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-02-28T23:20:50.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: Upgrade: Setting filesystem cephfs Joinable 2024-02-28T23:20:50.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: pgmap v294: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:20:50.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-28T23:20:50.601 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: Upgrade: Setting container_image for all ceph-exporter 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi159"}]: dispatch 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi159"}]': finished 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi184"}]: dispatch 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi184"}]': finished 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: Upgrade: Setting container_image for all iscsi 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.602 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: Upgrade: Setting container_image for all nfs 2024-02-28T23:20:50.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: Upgrade: Setting container_image for all nvmeof 2024-02-28T23:20:50.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T23:20:50.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T23:20:50.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T23:20:50.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T23:20:50.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-28T23:20:50.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T23:20:50.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-28T23:20:50.604 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T23:20:50.605 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:50.606 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:50.607 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:20:50.607 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: Upgrade: Setting filesystem cephfs Joinable 2024-02-28T23:20:50.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: pgmap v294: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:20:50.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-02-28T23:20:50.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: fsmap cephfs:1 {0=cephfs.smithi159.mbaqic=up:active} 1 up:standby-replay 2 up:standby 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: Upgrade: Setting container_image for all ceph-exporter 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi159"}]: dispatch 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi159"}]': finished 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi184"}]: dispatch 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi184"}]': finished 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: Upgrade: Setting container_image for all iscsi 2024-02-28T23:20:50.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: Upgrade: Setting container_image for all nfs 2024-02-28T23:20:50.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: Upgrade: Setting container_image for all nvmeof 2024-02-28T23:20:50.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:20:50.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-28T23:20:50.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-28T23:20:50.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-28T23:20:50.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-28T23:20:50.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-28T23:20:50.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-28T23:20:50.726 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-28T23:20:50.727 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:50.728 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:20:50.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:20:50.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:20:50.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:20:50.729 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:50.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.810+0000 7f50dd000700 1 -- 172.21.15.159:0/1658275910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d8100da0 msgr2=0x7f50d8101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:50.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.810+0000 7f50dd000700 1 --2- 172.21.15.159:0/1658275910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d8100da0 0x7f50d8101180 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f50c8009910 tx=0x7f50c8009c20 comp rx=0 tx=0).stop 2024-02-28T23:20:50.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.811+0000 7f50dd000700 1 -- 172.21.15.159:0/1658275910 shutdown_connections 2024-02-28T23:20:50.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.811+0000 7f50dd000700 1 --2- 172.21.15.159:0/1658275910 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50d8101750 0x7f50d81057a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:50.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.811+0000 7f50dd000700 1 --2- 172.21.15.159:0/1658275910 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d8100da0 0x7f50d8101180 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:50.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.811+0000 7f50dd000700 1 -- 172.21.15.159:0/1658275910 >> 172.21.15.159:0/1658275910 conn(0x7f50d80fc630 msgr2=0x7f50d80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:50.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.811+0000 7f50dd000700 1 -- 172.21.15.159:0/1658275910 shutdown_connections 2024-02-28T23:20:50.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.811+0000 7f50dd000700 1 -- 172.21.15.159:0/1658275910 wait complete. 2024-02-28T23:20:50.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.812+0000 7f50dd000700 1 Processor -- start 2024-02-28T23:20:50.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.812+0000 7f50dd000700 1 -- start start 2024-02-28T23:20:50.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.812+0000 7f50dd000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50d8100da0 0x7f50d8198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:50.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.813+0000 7f50dd000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d8101750 0x7f50d8198ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:50.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.813+0000 7f50dd000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d81994d0 con 0x7f50d8101750 2024-02-28T23:20:50.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.813+0000 7f50dd000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50d8199640 con 0x7f50d8100da0 2024-02-28T23:20:50.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.813+0000 7f50cd400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d8101750 0x7f50d8198ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:50.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.813+0000 7f50cd400700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d8101750 0x7f50d8198ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58176/0 (socket says 172.21.15.159:58176) 2024-02-28T23:20:50.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.813+0000 7f50cd400700 1 -- 172.21.15.159:0/1538957911 learned_addr learned my addr 172.21.15.159:0/1538957911 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:20:50.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.813+0000 7f50d5e00700 1 --2- 172.21.15.159:0/1538957911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50d8100da0 0x7f50d8198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:50.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.813+0000 7f50cd400700 1 -- 172.21.15.159:0/1538957911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50d8100da0 msgr2=0x7f50d8198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:50.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.813+0000 7f50cd400700 1 --2- 172.21.15.159:0/1538957911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50d8100da0 0x7f50d8198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:50.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.813+0000 7f50cd400700 1 -- 172.21.15.159:0/1538957911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c80095f0 con 0x7f50d8101750 2024-02-28T23:20:50.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.814+0000 7f50cd400700 1 --2- 172.21.15.159:0/1538957911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d8101750 0x7f50d8198ed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f50c000c960 tx=0x7f50c000cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:50.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.814+0000 7f50cf400700 1 -- 172.21.15.159:0/1538957911 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c0007a70 con 0x7f50d8101750 2024-02-28T23:20:50.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.814+0000 7f50cf400700 1 -- 172.21.15.159:0/1538957911 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f50c0007bd0 con 0x7f50d8101750 2024-02-28T23:20:50.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.814+0000 7f50dd000700 1 -- 172.21.15.159:0/1538957911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50d819d4c0 con 0x7f50d8101750 2024-02-28T23:20:50.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.814+0000 7f50cf400700 1 -- 172.21.15.159:0/1538957911 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50c00186c0 con 0x7f50d8101750 2024-02-28T23:20:50.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.814+0000 7f50dd000700 1 -- 172.21.15.159:0/1538957911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50d819da10 con 0x7f50d8101750 2024-02-28T23:20:50.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.815+0000 7f50dd000700 1 -- 172.21.15.159:0/1538957911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d8104f20 con 0x7f50d8101750 2024-02-28T23:20:50.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.817+0000 7f50cf400700 1 -- 172.21.15.159:0/1538957911 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f50c000faa0 con 0x7f50d8101750 2024-02-28T23:20:50.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.818+0000 7f50cf400700 1 --2- 172.21.15.159:0/1538957911 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f50bc06d8a0 0x7f50bc06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:50.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.818+0000 7f50cf400700 1 -- 172.21.15.159:0/1538957911 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f50c008d6f0 con 0x7f50d8101750 2024-02-28T23:20:50.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.818+0000 7f50d5e00700 1 --2- 172.21.15.159:0/1538957911 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f50bc06d8a0 0x7f50bc06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:50.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.819+0000 7f50d5e00700 1 --2- 172.21.15.159:0/1538957911 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f50bc06d8a0 0x7f50bc06fd60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f50c8006010 tx=0x7f50c801a040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:50.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:50.823+0000 7f50cf400700 1 -- 172.21.15.159:0/1538957911 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f50c005a5a0 con 0x7f50d8101750 2024-02-28T23:20:51.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.063+0000 7f50dd000700 1 -- 172.21.15.159:0/1538957911 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50d802cd60 con 0x7f50bc06d8a0 2024-02-28T23:20:51.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.065+0000 7f50cf400700 1 -- 172.21.15.159:0/1538957911 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f50d802cd60 con 0x7f50bc06d8a0 2024-02-28T23:20:51.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.068+0000 7f50dd000700 1 -- 172.21.15.159:0/1538957911 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f50bc06d8a0 msgr2=0x7f50bc06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:51.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.068+0000 7f50dd000700 1 --2- 172.21.15.159:0/1538957911 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f50bc06d8a0 0x7f50bc06fd60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f50c8006010 tx=0x7f50c801a040 comp rx=0 tx=0).stop 2024-02-28T23:20:51.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.068+0000 7f50dd000700 1 -- 172.21.15.159:0/1538957911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d8101750 msgr2=0x7f50d8198ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:51.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.068+0000 7f50dd000700 1 --2- 172.21.15.159:0/1538957911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d8101750 0x7f50d8198ed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f50c000c960 tx=0x7f50c000cd20 comp rx=0 tx=0).stop 2024-02-28T23:20:51.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.068+0000 7f50dd000700 1 -- 172.21.15.159:0/1538957911 shutdown_connections 2024-02-28T23:20:51.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.068+0000 7f50dd000700 1 --2- 172.21.15.159:0/1538957911 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f50d8100da0 0x7f50d8198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:51.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.068+0000 7f50dd000700 1 --2- 172.21.15.159:0/1538957911 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f50bc06d8a0 0x7f50bc06fd60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:51.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.068+0000 7f50dd000700 1 --2- 172.21.15.159:0/1538957911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50d8101750 0x7f50d8198ed0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:51.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.068+0000 7f50dd000700 1 -- 172.21.15.159:0/1538957911 >> 172.21.15.159:0/1538957911 conn(0x7f50d80fc630 msgr2=0x7f50d80fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:51.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.069+0000 7f50dd000700 1 -- 172.21.15.159:0/1538957911 shutdown_connections 2024-02-28T23:20:51.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:51.069+0000 7f50dd000700 1 -- 172.21.15.159:0/1538957911 wait complete. 2024-02-28T23:20:51.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:51 smithi184 ceph-mon[86482]: Upgrade: Finalizing container_image settings 2024-02-28T23:20:51.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:51 smithi184 ceph-mon[86482]: Upgrade: Complete! 2024-02-28T23:20:51.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:51 smithi159 ceph-mon[113833]: Upgrade: Finalizing container_image settings 2024-02-28T23:20:51.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:51 smithi159 ceph-mon[113833]: Upgrade: Complete! 2024-02-28T23:20:51.900 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-02-28T23:20:52.372 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:20:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:52 smithi184 ceph-mon[86482]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:52.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:52 smithi184 ceph-mon[86482]: pgmap v295: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:20:52.614 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:52 smithi159 ceph-mon[113833]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:52.614 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:52 smithi159 ceph-mon[113833]: pgmap v295: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:20:53.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:20:53.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:53.626 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:20:53.627 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:20:54.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:54 smithi184 ceph-mon[86482]: pgmap v296: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:20:54.615 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:54 smithi159 ceph-mon[113833]: pgmap v296: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:20:54.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.664+0000 7fc144600700 1 -- 172.21.15.159:0/1125010142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c105a40 msgr2=0x7fc13c105e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:54.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.664+0000 7fc144600700 1 --2- 172.21.15.159:0/1125010142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c105a40 0x7fc13c105e20 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc13000b0a0 tx=0x7fc13000b3b0 comp rx=0 tx=0).stop 2024-02-28T23:20:54.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.664+0000 7fc144600700 1 -- 172.21.15.159:0/1125010142 shutdown_connections 2024-02-28T23:20:54.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.664+0000 7fc144600700 1 --2- 172.21.15.159:0/1125010142 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc13c0ffa40 0x7fc13c0ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:54.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.664+0000 7fc144600700 1 --2- 172.21.15.159:0/1125010142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c105a40 0x7fc13c105e20 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:54.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.664+0000 7fc144600700 1 -- 172.21.15.159:0/1125010142 >> 172.21.15.159:0/1125010142 conn(0x7fc13c0fb570 msgr2=0x7fc13c0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:54.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.664+0000 7fc144600700 1 -- 172.21.15.159:0/1125010142 shutdown_connections 2024-02-28T23:20:54.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.664+0000 7fc144600700 1 -- 172.21.15.159:0/1125010142 wait complete. 2024-02-28T23:20:54.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.665+0000 7fc144600700 1 Processor -- start 2024-02-28T23:20:54.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.666+0000 7fc144600700 1 -- start start 2024-02-28T23:20:54.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.666+0000 7fc144600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0ffa40 0x7fc13c0fbed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:54.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.666+0000 7fc144600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc13c105a40 0x7fc13c0fc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:54.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.666+0000 7fc144600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c0fc9e0 con 0x7fc13c0ffa40 2024-02-28T23:20:54.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.666+0000 7fc144600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc13c0fcb50 con 0x7fc13c105a40 2024-02-28T23:20:54.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.666+0000 7fc141c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0ffa40 0x7fc13c0fbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:54.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.667+0000 7fc141c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0ffa40 0x7fc13c0fbed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58198/0 (socket says 172.21.15.159:58198) 2024-02-28T23:20:54.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.667+0000 7fc141c00700 1 -- 172.21.15.159:0/611942967 learned_addr learned my addr 172.21.15.159:0/611942967 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:20:54.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.667+0000 7fc141200700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc13c105a40 0x7fc13c0fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:54.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.667+0000 7fc141c00700 1 -- 172.21.15.159:0/611942967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc13c105a40 msgr2=0x7fc13c0fc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:54.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.667+0000 7fc141c00700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc13c105a40 0x7fc13c0fc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:54.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.667+0000 7fc141c00700 1 -- 172.21.15.159:0/611942967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc130009d00 con 0x7fc13c0ffa40 2024-02-28T23:20:54.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.667+0000 7fc141200700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc13c105a40 0x7fc13c0fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:20:54.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.667+0000 7fc141c00700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0ffa40 0x7fc13c0fbed0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc13000b070 tx=0x7fc13000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:54.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.668+0000 7fc13a000700 1 -- 172.21.15.159:0/611942967 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc13000e040 con 0x7fc13c0ffa40 2024-02-28T23:20:54.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.668+0000 7fc13a000700 1 -- 172.21.15.159:0/611942967 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc130003de0 con 0x7fc13c0ffa40 2024-02-28T23:20:54.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.668+0000 7fc144600700 1 -- 172.21.15.159:0/611942967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc13c1a2920 con 0x7fc13c0ffa40 2024-02-28T23:20:54.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.668+0000 7fc13a000700 1 -- 172.21.15.159:0/611942967 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc13001d8e0 con 0x7fc13c0ffa40 2024-02-28T23:20:54.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.668+0000 7fc144600700 1 -- 172.21.15.159:0/611942967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc13c1a2cd0 con 0x7fc13c0ffa40 2024-02-28T23:20:54.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.669+0000 7fc144600700 1 -- 172.21.15.159:0/611942967 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc13c109050 con 0x7fc13c0ffa40 2024-02-28T23:20:54.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.670+0000 7fc13a000700 1 -- 172.21.15.159:0/611942967 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc130004040 con 0x7fc13c0ffa40 2024-02-28T23:20:54.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.671+0000 7fc13a000700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc12406d8a0 0x7fc12406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:54.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.671+0000 7fc13a000700 1 -- 172.21.15.159:0/611942967 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fc13008ef30 con 0x7fc13c0ffa40 2024-02-28T23:20:54.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.671+0000 7fc141200700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc12406d8a0 0x7fc12406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:54.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.672+0000 7fc141200700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc12406d8a0 0x7fc12406fd60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc128005fd0 tx=0x7fc128005ee0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:54.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.677+0000 7fc13a000700 1 -- 172.21.15.159:0/611942967 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc130058540 con 0x7fc13c0ffa40 2024-02-28T23:20:54.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.908+0000 7fc144600700 1 -- 172.21.15.159:0/611942967 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc13c02cd50 con 0x7fc12406d8a0 2024-02-28T23:20:54.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.941+0000 7fc13a000700 1 -- 172.21.15.159:0/611942967 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7fc13c02cd50 con 0x7fc12406d8a0 2024-02-28T23:20:54.940 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:20:54.940 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (10m) 14s ago 24m 14.1M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:20:54.940 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (29s) 14s ago 25m 7843k - 19.0.0-1670-g1fb5d106 2272b2c42f9b db05c8896e8e 2024-02-28T23:20:54.940 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (22s) 17s ago 23m 6966k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 36f843e80a6a 2024-02-28T23:20:54.940 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (6m) 14s ago 24m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:20:54.940 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (6m) 17s ago 23m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:20:54.940 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (9m) 14s ago 24m 73.9M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (102s) 14s ago 17m 104M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 8da78eb84d38 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (2m) 14s ago 17m 86.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b aa9a201d4df0 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (75s) 17s ago 17m 12.1M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 27fe678d733e 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (51s) 17s ago 17m 11.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 157b654aead0 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (13m) 14s ago 26m 511M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (12m) 17s ago 23m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (8m) 14s ago 26m 58.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (7m) 17s ago 23m 41.5M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (11m) 14s ago 24m 7910k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (11m) 17s ago 23m 8102k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (5m) 14s ago 22m 120M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (5m) 14s ago 21m 110M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9120e23d80c0 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (4m) 14s ago 20m 103M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 952e59c58165 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (4m) 17s ago 20m 113M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 643ebdb823be 2024-02-28T23:20:54.941 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (3m) 17s ago 19m 104M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b dc8cef678e65 2024-02-28T23:20:54.942 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (2m) 17s ago 19m 110M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 1426063f8d8e 2024-02-28T23:20:54.942 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (10m) 14s ago 23m 65.8M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:20:54.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.943+0000 7fc144600700 1 -- 172.21.15.159:0/611942967 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc12406d8a0 msgr2=0x7fc12406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:54.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.943+0000 7fc144600700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc12406d8a0 0x7fc12406fd60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc128005fd0 tx=0x7fc128005ee0 comp rx=0 tx=0).stop 2024-02-28T23:20:54.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.943+0000 7fc144600700 1 -- 172.21.15.159:0/611942967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0ffa40 msgr2=0x7fc13c0fbed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:54.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.943+0000 7fc144600700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0ffa40 0x7fc13c0fbed0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc13000b070 tx=0x7fc13000cdd0 comp rx=0 tx=0).stop 2024-02-28T23:20:54.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.944+0000 7fc144600700 1 -- 172.21.15.159:0/611942967 shutdown_connections 2024-02-28T23:20:54.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.944+0000 7fc144600700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc12406d8a0 0x7fc12406fd60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:54.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.944+0000 7fc144600700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc13c0ffa40 0x7fc13c0fbed0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:54.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.944+0000 7fc144600700 1 --2- 172.21.15.159:0/611942967 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fc13c105a40 0x7fc13c0fc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:54.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.944+0000 7fc144600700 1 -- 172.21.15.159:0/611942967 >> 172.21.15.159:0/611942967 conn(0x7fc13c0fb570 msgr2=0x7fc13c068f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:54.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.944+0000 7fc144600700 1 -- 172.21.15.159:0/611942967 shutdown_connections 2024-02-28T23:20:54.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:54.944+0000 7fc144600700 1 -- 172.21.15.159:0/611942967 wait complete. 2024-02-28T23:20:55.815 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch upgrade status' 2024-02-28T23:20:56.221 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:20:56.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:56 smithi184 ceph-mon[86482]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:56.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:56 smithi184 ceph-mon[86482]: pgmap v297: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:20:56.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:56 smithi159 ceph-mon[113833]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:20:56.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:56 smithi159 ceph-mon[113833]: pgmap v297: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:20:58.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.374+0000 7ff0b6200700 1 -- 172.21.15.159:0/2733259780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b00ffbd0 msgr2=0x7ff0b0100050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:58.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.374+0000 7ff0b6200700 1 --2- 172.21.15.159:0/2733259780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b00ffbd0 0x7ff0b0100050 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff09c009910 tx=0x7ff09c009c20 comp rx=0 tx=0).stop 2024-02-28T23:20:58.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.375+0000 7ff0b6200700 1 -- 172.21.15.159:0/2733259780 shutdown_connections 2024-02-28T23:20:58.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.375+0000 7ff0b6200700 1 --2- 172.21.15.159:0/2733259780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b00ffbd0 0x7ff0b0100050 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:58.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.375+0000 7ff0b6200700 1 --2- 172.21.15.159:0/2733259780 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b0105a40 0x7ff0b0105e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:58.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.375+0000 7ff0b6200700 1 -- 172.21.15.159:0/2733259780 >> 172.21.15.159:0/2733259780 conn(0x7ff0b00755a0 msgr2=0x7ff0b00759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:58.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.375+0000 7ff0b6200700 1 -- 172.21.15.159:0/2733259780 shutdown_connections 2024-02-28T23:20:58.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.375+0000 7ff0b6200700 1 -- 172.21.15.159:0/2733259780 wait complete. 2024-02-28T23:20:58.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.376+0000 7ff0b6200700 1 Processor -- start 2024-02-28T23:20:58.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.376+0000 7ff0b6200700 1 -- start start 2024-02-28T23:20:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.376+0000 7ff0b6200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b00ffbd0 0x7ff0b019e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.376+0000 7ff0b6200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b0105a40 0x7ff0b019ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.376+0000 7ff0b6200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b019f230 con 0x7ff0b0105a40 2024-02-28T23:20:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.376+0000 7ff0b6200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0b0198770 con 0x7ff0b00ffbd0 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.377+0000 7ff0aea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b0105a40 0x7ff0b019ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.377+0000 7ff0aea00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b0105a40 0x7ff0b019ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57588/0 (socket says 172.21.15.159:57588) 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.377+0000 7ff0aea00700 1 -- 172.21.15.159:0/1331312047 learned_addr learned my addr 172.21.15.159:0/1331312047 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.377+0000 7ff0af400700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b00ffbd0 0x7ff0b019e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.377+0000 7ff0aea00700 1 -- 172.21.15.159:0/1331312047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b00ffbd0 msgr2=0x7ff0b019e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.377+0000 7ff0aea00700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b00ffbd0 0x7ff0b019e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.377+0000 7ff0aea00700 1 -- 172.21.15.159:0/1331312047 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c0095f0 con 0x7ff0b0105a40 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.377+0000 7ff0af400700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b00ffbd0 0x7ff0b019e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.377+0000 7ff0aea00700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b0105a40 0x7ff0b019ec30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff09c006010 tx=0x7ff09c00be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.378+0000 7ff0a7e00700 1 -- 172.21.15.159:0/1331312047 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff09c01d070 con 0x7ff0b0105a40 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.378+0000 7ff0a7e00700 1 -- 172.21.15.159:0/1331312047 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff09c004fb0 con 0x7ff0b0105a40 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.378+0000 7ff0a7e00700 1 -- 172.21.15.159:0/1331312047 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff09c00f690 con 0x7ff0b0105a40 2024-02-28T23:20:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.378+0000 7ff0b6200700 1 -- 172.21.15.159:0/1331312047 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0b01989f0 con 0x7ff0b0105a40 2024-02-28T23:20:58.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.378+0000 7ff0b6200700 1 -- 172.21.15.159:0/1331312047 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0b0198ee0 con 0x7ff0b0105a40 2024-02-28T23:20:58.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.379+0000 7ff0b6200700 1 -- 172.21.15.159:0/1331312047 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0b004ea90 con 0x7ff0b0105a40 2024-02-28T23:20:58.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.380+0000 7ff0a7e00700 1 -- 172.21.15.159:0/1331312047 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ff09c0228a0 con 0x7ff0b0105a40 2024-02-28T23:20:58.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.381+0000 7ff0a7e00700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff09406d8a0 0x7ff09406fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:20:58.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.381+0000 7ff0a7e00700 1 -- 172.21.15.159:0/1331312047 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7ff09c08eee0 con 0x7ff0b0105a40 2024-02-28T23:20:58.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.381+0000 7ff0af400700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff09406d8a0 0x7ff09406fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:20:58.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.382+0000 7ff0af400700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff09406d8a0 0x7ff09406fd60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0005fd0 tx=0x7ff0a0005e20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:20:58.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.386+0000 7ff0a7e00700 1 -- 172.21.15.159:0/1331312047 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff09c05c0a0 con 0x7ff0b0105a40 2024-02-28T23:20:58.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:20:58 smithi159 ceph-mon[113833]: pgmap v298: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:20:58.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:20:58 smithi184 ceph-mon[86482]: pgmap v298: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:20:58.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.632+0000 7ff0b6200700 1 -- 172.21.15.159:0/1331312047 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0b0199280 con 0x7ff09406d8a0 2024-02-28T23:20:58.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.634+0000 7ff0a7e00700 1 -- 172.21.15.159:0/1331312047 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7ff0b0199280 con 0x7ff09406d8a0 2024-02-28T23:20:58.633 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:20:58.633 INFO:teuthology.orchestra.run.smithi159.stdout: "target_image": null, 2024-02-28T23:20:58.633 INFO:teuthology.orchestra.run.smithi159.stdout: "in_progress": false, 2024-02-28T23:20:58.633 INFO:teuthology.orchestra.run.smithi159.stdout: "which": "", 2024-02-28T23:20:58.633 INFO:teuthology.orchestra.run.smithi159.stdout: "services_complete": [], 2024-02-28T23:20:58.633 INFO:teuthology.orchestra.run.smithi159.stdout: "progress": null, 2024-02-28T23:20:58.633 INFO:teuthology.orchestra.run.smithi159.stdout: "message": "", 2024-02-28T23:20:58.633 INFO:teuthology.orchestra.run.smithi159.stdout: "is_paused": false 2024-02-28T23:20:58.633 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:20:58.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.637+0000 7ff0b6200700 1 -- 172.21.15.159:0/1331312047 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff09406d8a0 msgr2=0x7ff09406fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:58.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.637+0000 7ff0b6200700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff09406d8a0 0x7ff09406fd60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff0a0005fd0 tx=0x7ff0a0005e20 comp rx=0 tx=0).stop 2024-02-28T23:20:58.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.637+0000 7ff0b6200700 1 -- 172.21.15.159:0/1331312047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b0105a40 msgr2=0x7ff0b019ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:20:58.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.637+0000 7ff0b6200700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b0105a40 0x7ff0b019ec30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff09c006010 tx=0x7ff09c00be20 comp rx=0 tx=0).stop 2024-02-28T23:20:58.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.637+0000 7ff0b6200700 1 -- 172.21.15.159:0/1331312047 shutdown_connections 2024-02-28T23:20:58.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.637+0000 7ff0b6200700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff0b00ffbd0 0x7ff0b019e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:58.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.637+0000 7ff0b6200700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff09406d8a0 0x7ff09406fd60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:58.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.637+0000 7ff0b6200700 1 --2- 172.21.15.159:0/1331312047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff0b0105a40 0x7ff0b019ec30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:20:58.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.637+0000 7ff0b6200700 1 -- 172.21.15.159:0/1331312047 >> 172.21.15.159:0/1331312047 conn(0x7ff0b00755a0 msgr2=0x7ff0b0068410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:20:58.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.638+0000 7ff0b6200700 1 -- 172.21.15.159:0/1331312047 shutdown_connections 2024-02-28T23:20:58.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:20:58.638+0000 7ff0b6200700 1 -- 172.21.15.159:0/1331312047 wait complete. 2024-02-28T23:20:59.503 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph health detail' 2024-02-28T23:20:59.909 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:21:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:00 smithi159 ceph-mon[113833]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:21:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:00 smithi159 ceph-mon[113833]: pgmap v299: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:00 smithi184 ceph-mon[86482]: from='client.34568 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:21:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:00 smithi184 ceph-mon[86482]: pgmap v299: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:02.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.052+0000 7f4ee8e00700 1 -- 172.21.15.159:0/262469704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee4100dc0 msgr2=0x7f4ee41011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:21:02.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.052+0000 7f4ee8e00700 1 --2- 172.21.15.159:0/262469704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee4100dc0 0x7f4ee41011a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009910 tx=0x7f4ed4009c20 comp rx=0 tx=0).stop 2024-02-28T23:21:02.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.052+0000 7f4ee8e00700 1 -- 172.21.15.159:0/262469704 shutdown_connections 2024-02-28T23:21:02.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.052+0000 7f4ee8e00700 1 --2- 172.21.15.159:0/262469704 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ee4101770 0x7f4ee41057c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:02.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.052+0000 7f4ee8e00700 1 --2- 172.21.15.159:0/262469704 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee4100dc0 0x7f4ee41011a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:02.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.052+0000 7f4ee8e00700 1 -- 172.21.15.159:0/262469704 >> 172.21.15.159:0/262469704 conn(0x7f4ee40fc650 msgr2=0x7f4ee40fea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:21:02.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.052+0000 7f4ee8e00700 1 -- 172.21.15.159:0/262469704 shutdown_connections 2024-02-28T23:21:02.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.052+0000 7f4ee8e00700 1 -- 172.21.15.159:0/262469704 wait complete. 2024-02-28T23:21:02.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.053+0000 7f4ee8e00700 1 Processor -- start 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.053+0000 7f4ee8e00700 1 -- start start 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.053+0000 7f4ee8e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee4100dc0 0x7f4ee419e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.053+0000 7f4ee8e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ee4101770 0x7f4ee419ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.053+0000 7f4ee8e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee419f3b0 con 0x7f4ee4100dc0 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.053+0000 7f4ee8e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee4198860 con 0x7f4ee4101770 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.054+0000 7f4ee1e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee4100dc0 0x7f4ee419e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.054+0000 7f4ee1e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee4100dc0 0x7f4ee419e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57602/0 (socket says 172.21.15.159:57602) 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.054+0000 7f4ee1e00700 1 -- 172.21.15.159:0/933051181 learned_addr learned my addr 172.21.15.159:0/933051181 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.054+0000 7f4ee1400700 1 --2- 172.21.15.159:0/933051181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ee4101770 0x7f4ee419ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.054+0000 7f4ee1e00700 1 -- 172.21.15.159:0/933051181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ee4101770 msgr2=0x7f4ee419ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.054+0000 7f4ee1e00700 1 --2- 172.21.15.159:0/933051181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ee4101770 0x7f4ee419ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:02.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.054+0000 7f4ee1e00700 1 -- 172.21.15.159:0/933051181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed40095f0 con 0x7f4ee4100dc0 2024-02-28T23:21:02.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.055+0000 7f4ee1e00700 1 --2- 172.21.15.159:0/933051181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee4100dc0 0x7f4ee419e7e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400b5c0 tx=0x7f4ed400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:21:02.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.055+0000 7f4edaa00700 1 -- 172.21.15.159:0/933051181 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ed401d070 con 0x7f4ee4100dc0 2024-02-28T23:21:02.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.055+0000 7f4edaa00700 1 -- 172.21.15.159:0/933051181 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f4ed400f460 con 0x7f4ee4100dc0 2024-02-28T23:21:02.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.055+0000 7f4ee8e00700 1 -- 172.21.15.159:0/933051181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee4198ae0 con 0x7f4ee4100dc0 2024-02-28T23:21:02.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.055+0000 7f4edaa00700 1 -- 172.21.15.159:0/933051181 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ed4017610 con 0x7f4ee4100dc0 2024-02-28T23:21:02.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.055+0000 7f4ee8e00700 1 -- 172.21.15.159:0/933051181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee4198fd0 con 0x7f4ee4100dc0 2024-02-28T23:21:02.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.056+0000 7f4ee8e00700 1 -- 172.21.15.159:0/933051181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee4104f40 con 0x7f4ee4100dc0 2024-02-28T23:21:02.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.058+0000 7f4edaa00700 1 -- 172.21.15.159:0/933051181 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f4ed400f5d0 con 0x7f4ee4100dc0 2024-02-28T23:21:02.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.059+0000 7f4edaa00700 1 --2- 172.21.15.159:0/933051181 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4ec806d8a0 0x7f4ec806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:21:02.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.059+0000 7f4edaa00700 1 -- 172.21.15.159:0/933051181 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f4ed408eed0 con 0x7f4ee4100dc0 2024-02-28T23:21:02.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.059+0000 7f4ee1400700 1 --2- 172.21.15.159:0/933051181 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4ec806d8a0 0x7f4ec806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:21:02.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.060+0000 7f4ee1400700 1 --2- 172.21.15.159:0/933051181 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4ec806d8a0 0x7f4ec806fd60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0006fd0 tx=0x7f4ed0008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:21:02.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.063+0000 7f4edaa00700 1 -- 172.21.15.159:0/933051181 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f4ed405c090 con 0x7f4ee4100dc0 2024-02-28T23:21:02.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.370+0000 7f4ee8e00700 1 -- 172.21.15.159:0/933051181 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4ee404ea90 con 0x7f4ee4100dc0 2024-02-28T23:21:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.370+0000 7f4edaa00700 1 -- 172.21.15.159:0/933051181 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f4ed405bc20 con 0x7f4ee4100dc0 2024-02-28T23:21:02.370 INFO:teuthology.orchestra.run.smithi159.stdout:HEALTH_OK 2024-02-28T23:21:02.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.373+0000 7f4ee8e00700 1 -- 172.21.15.159:0/933051181 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4ec806d8a0 msgr2=0x7f4ec806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:21:02.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.373+0000 7f4ee8e00700 1 --2- 172.21.15.159:0/933051181 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4ec806d8a0 0x7f4ec806fd60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0006fd0 tx=0x7f4ed0008040 comp rx=0 tx=0).stop 2024-02-28T23:21:02.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.373+0000 7f4ee8e00700 1 -- 172.21.15.159:0/933051181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee4100dc0 msgr2=0x7f4ee419e7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:21:02.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.373+0000 7f4ee8e00700 1 --2- 172.21.15.159:0/933051181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee4100dc0 0x7f4ee419e7e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4ed400b5c0 tx=0x7f4ed400be00 comp rx=0 tx=0).stop 2024-02-28T23:21:02.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.374+0000 7f4ee8e00700 1 -- 172.21.15.159:0/933051181 shutdown_connections 2024-02-28T23:21:02.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.374+0000 7f4ee8e00700 1 --2- 172.21.15.159:0/933051181 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f4ec806d8a0 0x7f4ec806fd60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:02.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.374+0000 7f4ee8e00700 1 --2- 172.21.15.159:0/933051181 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ee4100dc0 0x7f4ee419e7e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:02.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.374+0000 7f4ee8e00700 1 --2- 172.21.15.159:0/933051181 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f4ee4101770 0x7f4ee419ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:02.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.374+0000 7f4ee8e00700 1 -- 172.21.15.159:0/933051181 >> 172.21.15.159:0/933051181 conn(0x7f4ee40fc650 msgr2=0x7f4ee40fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:21:02.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.374+0000 7f4ee8e00700 1 -- 172.21.15.159:0/933051181 shutdown_connections 2024-02-28T23:21:02.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:02.374+0000 7f4ee8e00700 1 -- 172.21.15.159:0/933051181 wait complete. 2024-02-28T23:21:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:02 smithi159 ceph-mon[113833]: pgmap v300: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:02.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:02 smithi184 ceph-mon[86482]: pgmap v300: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:03.223 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions' 2024-02-28T23:21:03.471 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:03 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/933051181' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:21:03.648 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:21:03.836 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:03 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/933051181' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-02-28T23:21:04.679 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:04 smithi159 ceph-mon[113833]: pgmap v301: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:04.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:04 smithi184 ceph-mon[86482]: pgmap v301: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:05.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.986+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3591940870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a41071d0 msgr2=0x7ff6a4107650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:21:05.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.986+0000 7ff6a9c00700 1 --2- 172.21.15.159:0/3591940870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a41071d0 0x7ff6a4107650 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff690009910 tx=0x7ff690009c20 comp rx=0 tx=0).stop 2024-02-28T23:21:05.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.986+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3591940870 shutdown_connections 2024-02-28T23:21:05.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.986+0000 7ff6a9c00700 1 --2- 172.21.15.159:0/3591940870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a41071d0 0x7ff6a4107650 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:05.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.986+0000 7ff6a9c00700 1 --2- 172.21.15.159:0/3591940870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a410d280 0x7ff6a410d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:05.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.986+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3591940870 >> 172.21.15.159:0/3591940870 conn(0x7ff6a40769e0 msgr2=0x7ff6a4078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:21:05.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.986+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3591940870 shutdown_connections 2024-02-28T23:21:05.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.986+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3591940870 wait complete. 2024-02-28T23:21:05.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.987+0000 7ff6a9c00700 1 Processor -- start 2024-02-28T23:21:05.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.987+0000 7ff6a9c00700 1 -- start start 2024-02-28T23:21:05.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.987+0000 7ff6a9c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a41071d0 0x7ff6a419ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:21:05.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.987+0000 7ff6a9c00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a410d280 0x7ff6a419d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:21:05.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.987+0000 7ff6a9c00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a419d880 con 0x7ff6a41071d0 2024-02-28T23:21:05.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.987+0000 7ff6a9c00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a41a05b0 con 0x7ff6a410d280 2024-02-28T23:21:05.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.988+0000 7ff6a2a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a41071d0 0x7ff6a419ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:21:05.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.988+0000 7ff6a2a00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a41071d0 0x7ff6a419ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:57608/0 (socket says 172.21.15.159:57608) 2024-02-28T23:21:05.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.988+0000 7ff6a2a00700 1 -- 172.21.15.159:0/3722636843 learned_addr learned my addr 172.21.15.159:0/3722636843 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:21:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.988+0000 7ff6a2000700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a410d280 0x7ff6a419d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:21:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.988+0000 7ff6a2a00700 1 -- 172.21.15.159:0/3722636843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a410d280 msgr2=0x7ff6a419d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:21:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.988+0000 7ff6a2a00700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a410d280 0x7ff6a419d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.988+0000 7ff6a2a00700 1 -- 172.21.15.159:0/3722636843 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6900095f0 con 0x7ff6a41071d0 2024-02-28T23:21:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.988+0000 7ff6a2000700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a410d280 0x7ff6a419d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:21:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.989+0000 7ff6a2a00700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a41071d0 0x7ff6a419ccb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff69400d8d0 tx=0x7ff69400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:21:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.989+0000 7ff69b400700 1 -- 172.21.15.159:0/3722636843 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff694009940 con 0x7ff6a41071d0 2024-02-28T23:21:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.989+0000 7ff69b400700 1 -- 172.21.15.159:0/3722636843 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff694010460 con 0x7ff6a41071d0 2024-02-28T23:21:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.989+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3722636843 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a41a0890 con 0x7ff6a41071d0 2024-02-28T23:21:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.989+0000 7ff69b400700 1 -- 172.21.15.159:0/3722636843 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff69400f5f0 con 0x7ff6a41071d0 2024-02-28T23:21:05.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.989+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3722636843 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a41a0e60 con 0x7ff6a41071d0 2024-02-28T23:21:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.990+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3722636843 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a410f6c0 con 0x7ff6a41071d0 2024-02-28T23:21:05.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.991+0000 7ff69b400700 1 -- 172.21.15.159:0/3722636843 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ff6940105d0 con 0x7ff6a41071d0 2024-02-28T23:21:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.992+0000 7ff69b400700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff68806d8a0 0x7ff68806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:21:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.992+0000 7ff69b400700 1 -- 172.21.15.159:0/3722636843 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7ff69408d6d0 con 0x7ff6a41071d0 2024-02-28T23:21:05.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.992+0000 7ff6a2000700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff68806d8a0 0x7ff68806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:21:05.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.993+0000 7ff6a2000700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff68806d8a0 0x7ff68806fd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff690006010 tx=0x7ff69000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:21:05.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:05.997+0000 7ff69b400700 1 -- 172.21.15.159:0/3722636843 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff694056ce0 con 0x7ff6a41071d0 2024-02-28T23:21:06.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.308+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3722636843 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff6a404ea90 con 0x7ff6a41071d0 2024-02-28T23:21:06.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.309+0000 7ff69b400700 1 -- 172.21.15.159:0/3722636843 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7ff69405a3a0 con 0x7ff6a41071d0 2024-02-28T23:21:06.308 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:21:06.308 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:21:06.308 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:21:06.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:21:06.309 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:21:06.309 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:21:06.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:21:06.309 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:21:06.309 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T23:21:06.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:21:06.309 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:21:06.310 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T23:21:06.310 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:21:06.310 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:21:06.310 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T23:21:06.310 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:21:06.310 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:21:06.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.311+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3722636843 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff68806d8a0 msgr2=0x7ff68806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:21:06.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.311+0000 7ff6a9c00700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff68806d8a0 0x7ff68806fd60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff690006010 tx=0x7ff69000b540 comp rx=0 tx=0).stop 2024-02-28T23:21:06.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.311+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3722636843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a41071d0 msgr2=0x7ff6a419ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:21:06.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.311+0000 7ff6a9c00700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a41071d0 0x7ff6a419ccb0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff69400d8d0 tx=0x7ff69400dc90 comp rx=0 tx=0).stop 2024-02-28T23:21:06.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.312+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3722636843 shutdown_connections 2024-02-28T23:21:06.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.312+0000 7ff6a9c00700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff68806d8a0 0x7ff68806fd60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:06.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.312+0000 7ff6a9c00700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff6a41071d0 0x7ff6a419ccb0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:06.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.312+0000 7ff6a9c00700 1 --2- 172.21.15.159:0/3722636843 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff6a410d280 0x7ff6a419d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:21:06.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.312+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3722636843 >> 172.21.15.159:0/3722636843 conn(0x7ff6a40769e0 msgr2=0x7ff6a4078470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:21:06.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.312+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3722636843 shutdown_connections 2024-02-28T23:21:06.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:21:06.312+0000 7ff6a9c00700 1 -- 172.21.15.159:0/3722636843 wait complete. 2024-02-28T23:21:06.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:06 smithi159 ceph-mon[113833]: pgmap v302: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:06.706 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:06 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3722636843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:21:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:06 smithi184 ceph-mon[86482]: pgmap v302: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:06 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3722636843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:21:07.264 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-28T23:21:07.703 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:21:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:08 smithi159 ceph-mon[113833]: pgmap v303: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:21:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:08 smithi184 ceph-mon[86482]: pgmap v303: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:21:10.085 INFO:teuthology.orchestra.run.smithi159.stdout:wait for servicemap items w/ changing names to refresh 2024-02-28T23:21:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:10 smithi159 ceph-mon[113833]: pgmap v304: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:10.800 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'sleep 60' 2024-02-28T23:21:10.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:10 smithi184 ceph-mon[86482]: pgmap v304: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:11.229 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:21:12.672 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:12 smithi159 ceph-mon[113833]: pgmap v305: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:12.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:12 smithi184 ceph-mon[86482]: pgmap v305: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:14 smithi159 ceph-mon[113833]: pgmap v306: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:14.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:14 smithi184 ceph-mon[86482]: pgmap v306: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:16 smithi159 ceph-mon[113833]: pgmap v307: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:16.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:16 smithi184 ceph-mon[86482]: pgmap v307: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:18 smithi159 ceph-mon[113833]: pgmap v308: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:18.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:18 smithi184 ceph-mon[86482]: pgmap v308: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:20 smithi159 ceph-mon[113833]: pgmap v309: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:21:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:20 smithi184 ceph-mon[86482]: pgmap v309: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:21:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:22 smithi159 ceph-mon[113833]: pgmap v310: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:21:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:22 smithi184 ceph-mon[86482]: pgmap v310: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:21:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:21:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:21:24.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:24 smithi159 ceph-mon[113833]: pgmap v311: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:24.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:24 smithi184 ceph-mon[86482]: pgmap v311: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:25.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:25 smithi159 ceph-mon[113833]: pgmap v312: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:21:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:25 smithi184 ceph-mon[86482]: pgmap v312: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:21:28.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:28 smithi184 ceph-mon[86482]: pgmap v313: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:28.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:28 smithi159 ceph-mon[113833]: pgmap v313: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:30.438 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:30 smithi159 ceph-mon[113833]: pgmap v314: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:21:30.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:30 smithi184 ceph-mon[86482]: pgmap v314: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:21:32.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:32 smithi184 ceph-mon[86482]: pgmap v315: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:32.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:32 smithi159 ceph-mon[113833]: pgmap v315: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:34.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:34 smithi184 ceph-mon[86482]: pgmap v316: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:34 smithi159 ceph-mon[113833]: pgmap v316: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:36.603 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:36 smithi184 ceph-mon[86482]: pgmap v317: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:21:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:36 smithi159 ceph-mon[113833]: pgmap v317: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:21:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:38 smithi184 ceph-mon[86482]: pgmap v318: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:21:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:38 smithi159 ceph-mon[113833]: pgmap v318: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:21:40.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:40 smithi184 ceph-mon[86482]: pgmap v319: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:40.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:40 smithi159 ceph-mon[113833]: pgmap v319: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:42 smithi159 ceph-mon[113833]: pgmap v320: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:42.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:42 smithi184 ceph-mon[86482]: pgmap v320: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:44.653 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:44 smithi184 ceph-mon[86482]: pgmap v321: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:44 smithi159 ceph-mon[113833]: pgmap v321: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:46 smithi159 ceph-mon[113833]: pgmap v322: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:46.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:46 smithi184 ceph-mon[86482]: pgmap v322: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:48 smithi159 ceph-mon[113833]: pgmap v323: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:48.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:48 smithi184 ceph-mon[86482]: pgmap v323: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:50 smithi184 ceph-mon[86482]: pgmap v324: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:50 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:21:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:50 smithi159 ceph-mon[113833]: pgmap v324: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:21:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:50 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:21:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:52 smithi159 ceph-mon[113833]: pgmap v325: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:21:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:21:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:21:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:52 smithi184 ceph-mon[86482]: pgmap v325: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:21:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:21:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:21:53.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:21:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:21:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:54 smithi159 ceph-mon[113833]: pgmap v326: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:54.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:54 smithi184 ceph-mon[86482]: pgmap v326: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:56.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:56 smithi159 ceph-mon[113833]: pgmap v327: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:56.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:56 smithi184 ceph-mon[86482]: pgmap v327: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:21:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:21:58 smithi159 ceph-mon[113833]: pgmap v328: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:21:58.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:21:58 smithi184 ceph-mon[86482]: pgmap v328: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:00 smithi159 ceph-mon[113833]: pgmap v329: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:00 smithi184 ceph-mon[86482]: pgmap v329: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:02 smithi159 ceph-mon[113833]: pgmap v330: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:22:02.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:02 smithi184 ceph-mon[86482]: pgmap v330: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:22:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:04 smithi159 ceph-mon[113833]: pgmap v331: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:04.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:04 smithi184 ceph-mon[86482]: pgmap v331: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:06 smithi159 ceph-mon[113833]: pgmap v332: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:06 smithi184 ceph-mon[86482]: pgmap v332: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:08 smithi159 ceph-mon[113833]: pgmap v333: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:08.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:22:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:08 smithi184 ceph-mon[86482]: pgmap v333: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:22:09.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:09 smithi159 ceph-mon[113833]: pgmap v334: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:22:10.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:09 smithi184 ceph-mon[86482]: pgmap v334: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:22:12.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:12 smithi184 ceph-mon[86482]: pgmap v335: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:12 smithi159 ceph-mon[113833]: pgmap v335: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:14.330 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph orch ps' 2024-02-28T23:22:14.413 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:14 smithi159 ceph-mon[113833]: pgmap v336: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:14.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:14 smithi184 ceph-mon[86482]: pgmap v336: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:14.758 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:22:16.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:16 smithi159 ceph-mon[113833]: pgmap v337: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:16.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:16 smithi184 ceph-mon[86482]: pgmap v337: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:17.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.054+0000 7f0fb9000700 1 -- 172.21.15.159:0/4286788565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb4101970 msgr2=0x7f0fb4101d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.054+0000 7f0fb9000700 1 --2- 172.21.15.159:0/4286788565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb4101970 0x7f0fb4101d50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4009910 tx=0x7f0fa4009c20 comp rx=0 tx=0).stop 2024-02-28T23:22:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.054+0000 7f0fb9000700 1 -- 172.21.15.159:0/4286788565 shutdown_connections 2024-02-28T23:22:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.054+0000 7f0fb9000700 1 --2- 172.21.15.159:0/4286788565 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fb40ff2d0 0x7f0fb40ff750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.054+0000 7f0fb9000700 1 --2- 172.21.15.159:0/4286788565 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb4101970 0x7f0fb4101d50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.054+0000 7f0fb9000700 1 -- 172.21.15.159:0/4286788565 >> 172.21.15.159:0/4286788565 conn(0x7f0fb4074d50 msgr2=0x7f0fb4075160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.054+0000 7f0fb9000700 1 -- 172.21.15.159:0/4286788565 shutdown_connections 2024-02-28T23:22:17.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.054+0000 7f0fb9000700 1 -- 172.21.15.159:0/4286788565 wait complete. 2024-02-28T23:22:17.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.055+0000 7f0fb9000700 1 Processor -- start 2024-02-28T23:22:17.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.056+0000 7f0fb9000700 1 -- start start 2024-02-28T23:22:17.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.056+0000 7f0fb9000700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40ff2d0 0x7f0fb419e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:17.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.056+0000 7f0fb9000700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fb4101970 0x7f0fb419ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:17.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.056+0000 7f0fb9000700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb419f1d0 con 0x7f0fb40ff2d0 2024-02-28T23:22:17.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.056+0000 7f0fb9000700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb4198710 con 0x7f0fb4101970 2024-02-28T23:22:17.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.056+0000 7f0fb1e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40ff2d0 0x7f0fb419e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:17.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.056+0000 7f0fb1e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40ff2d0 0x7f0fb419e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51370/0 (socket says 172.21.15.159:51370) 2024-02-28T23:22:17.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.056+0000 7f0fb1e00700 1 -- 172.21.15.159:0/1132047285 learned_addr learned my addr 172.21.15.159:0/1132047285 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:17.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.057+0000 7f0fb1e00700 1 -- 172.21.15.159:0/1132047285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fb4101970 msgr2=0x7f0fb419ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:17.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.057+0000 7f0fb1e00700 1 --2- 172.21.15.159:0/1132047285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fb4101970 0x7f0fb419ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:17.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.057+0000 7f0fb1e00700 1 -- 172.21.15.159:0/1132047285 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40095f0 con 0x7f0fb40ff2d0 2024-02-28T23:22:17.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.057+0000 7f0fb1e00700 1 --2- 172.21.15.159:0/1132047285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40ff2d0 0x7f0fb419e690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400b5c0 tx=0x7f0fa400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:17.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.057+0000 7f0faaa00700 1 -- 172.21.15.159:0/1132047285 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fa401d070 con 0x7f0fb40ff2d0 2024-02-28T23:22:17.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.057+0000 7f0faaa00700 1 -- 172.21.15.159:0/1132047285 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0fa400f460 con 0x7f0fb40ff2d0 2024-02-28T23:22:17.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.057+0000 7f0fb9000700 1 -- 172.21.15.159:0/1132047285 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb4198990 con 0x7f0fb40ff2d0 2024-02-28T23:22:17.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.057+0000 7f0faaa00700 1 -- 172.21.15.159:0/1132047285 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0fa4017610 con 0x7f0fb40ff2d0 2024-02-28T23:22:17.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.058+0000 7f0fb9000700 1 -- 172.21.15.159:0/1132047285 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb4198f00 con 0x7f0fb40ff2d0 2024-02-28T23:22:17.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.059+0000 7f0fb9000700 1 -- 172.21.15.159:0/1132047285 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb404ea90 con 0x7f0fb40ff2d0 2024-02-28T23:22:17.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.060+0000 7f0faaa00700 1 -- 172.21.15.159:0/1132047285 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f0fa400f5d0 con 0x7f0fb40ff2d0 2024-02-28T23:22:17.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.061+0000 7f0faaa00700 1 --2- 172.21.15.159:0/1132047285 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9806d8a0 0x7f0f9806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:17.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.061+0000 7f0faaa00700 1 -- 172.21.15.159:0/1132047285 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f0fa408ec50 con 0x7f0fb40ff2d0 2024-02-28T23:22:17.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.061+0000 7f0fb1400700 1 --2- 172.21.15.159:0/1132047285 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9806d8a0 0x7f0f9806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:17.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.062+0000 7f0fb1400700 1 --2- 172.21.15.159:0/1132047285 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9806d8a0 0x7f0f9806fd60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0005fd0 tx=0x7f0fa0005d00 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:17.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.066+0000 7f0faaa00700 1 -- 172.21.15.159:0/1132047285 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f0fa405be10 con 0x7f0fb40ff2d0 2024-02-28T23:22:17.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.295+0000 7f0fb9000700 1 -- 172.21.15.159:0/1132047285 --> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0fb41992e0 con 0x7f0f9806d8a0 2024-02-28T23:22:17.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.322+0000 7f0faaa00700 1 -- 172.21.15.159:0/1132047285 <== mgr.34102 v2:172.21.15.159:6800/937076031 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3840 (secure 0 0 0) 0x7f0fb41992e0 con 0x7f0f9806d8a0 2024-02-28T23:22:17.321 INFO:teuthology.orchestra.run.smithi159.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-28T23:22:17.321 INFO:teuthology.orchestra.run.smithi159.stdout:alertmanager.smithi159 smithi159 *:9093,9094 running (11m) 97s ago 25m 14.1M - 0.25.0 c8568f914cd2 91a0081018fb 2024-02-28T23:22:17.322 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi159 smithi159 running (112s) 97s ago 26m 7843k - 19.0.0-1670-g1fb5d106 2272b2c42f9b db05c8896e8e 2024-02-28T23:22:17.322 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-exporter.smithi184 smithi184 running (104s) 100s ago 24m 6966k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 36f843e80a6a 2024-02-28T23:22:17.322 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi159 smithi159 running (7m) 97s ago 26m 6660k - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5136610c7537 2024-02-28T23:22:17.322 INFO:teuthology.orchestra.run.smithi159.stdout:crash.smithi184 smithi184 running (7m) 100s ago 24m 6669k - 19.0.0-1670-g1fb5d106 2272b2c42f9b c79f206034a3 2024-02-28T23:22:17.322 INFO:teuthology.orchestra.run.smithi159.stdout:grafana.smithi159 smithi159 *:3000 running (11m) 97s ago 25m 73.9M - 9.4.12 a0ea5e3c46d9 2b27b214231c 2024-02-28T23:22:17.322 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.azxrct smithi159 running (3m) 97s ago 18m 104M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 8da78eb84d38 2024-02-28T23:22:17.323 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi159.mbaqic smithi159 running (3m) 97s ago 18m 86.8M - 19.0.0-1670-g1fb5d106 2272b2c42f9b aa9a201d4df0 2024-02-28T23:22:17.323 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.azwkfx smithi184 running (2m) 100s ago 18m 12.1M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 27fe678d733e 2024-02-28T23:22:17.323 INFO:teuthology.orchestra.run.smithi159.stdout:mds.cephfs.smithi184.pnifob smithi184 running (2m) 100s ago 18m 11.9M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 157b654aead0 2024-02-28T23:22:17.323 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi159.pobewk smithi159 *:8443,9283,8765 running (14m) 97s ago 27m 511M - 19.0.0-1670-g1fb5d106 2272b2c42f9b 5f9932e77227 2024-02-28T23:22:17.323 INFO:teuthology.orchestra.run.smithi159.stdout:mgr.smithi184.quvmnx smithi184 *:8443,9283,8765 running (13m) 100s ago 24m 453M - 19.0.0-1670-g1fb5d106 2272b2c42f9b f93fc37bf4f2 2024-02-28T23:22:17.323 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi159 smithi159 running (9m) 97s ago 28m 58.4M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9657ea46dc51 2024-02-28T23:22:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:mon.smithi184 smithi184 running (8m) 100s ago 24m 41.5M 2048M 19.0.0-1670-g1fb5d106 2272b2c42f9b e57190b5e43e 2024-02-28T23:22:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi159 smithi159 *:9100 running (12m) 97s ago 26m 7910k - 1.5.0 0da6a335fe13 ba836ac0dc06 2024-02-28T23:22:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:node-exporter.smithi184 smithi184 *:9100 running (12m) 100s ago 24m 8102k - 1.5.0 0da6a335fe13 c4e9c2513976 2024-02-28T23:22:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 smithi159 running (7m) 97s ago 23m 120M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b bc355acd3365 2024-02-28T23:22:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 smithi159 running (6m) 97s ago 22m 110M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 9120e23d80c0 2024-02-28T23:22:17.324 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 smithi159 running (5m) 97s ago 22m 103M 1217M 19.0.0-1670-g1fb5d106 2272b2c42f9b 952e59c58165 2024-02-28T23:22:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 smithi184 running (5m) 100s ago 21m 113M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 643ebdb823be 2024-02-28T23:22:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 smithi184 running (4m) 100s ago 21m 104M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b dc8cef678e65 2024-02-28T23:22:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 smithi184 running (4m) 100s ago 20m 110M 2241M 19.0.0-1670-g1fb5d106 2272b2c42f9b 1426063f8d8e 2024-02-28T23:22:17.325 INFO:teuthology.orchestra.run.smithi159.stdout:prometheus.smithi159 smithi159 *:9095 running (12m) 97s ago 25m 65.8M - 2.43.0 a07b618ecd1d c2423d5a2369 2024-02-28T23:22:17.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.324+0000 7f0fb9000700 1 -- 172.21.15.159:0/1132047285 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9806d8a0 msgr2=0x7f0f9806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:17.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.324+0000 7f0fb9000700 1 --2- 172.21.15.159:0/1132047285 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9806d8a0 0x7f0f9806fd60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0fa0005fd0 tx=0x7f0fa0005d00 comp rx=0 tx=0).stop 2024-02-28T23:22:17.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.324+0000 7f0fb9000700 1 -- 172.21.15.159:0/1132047285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40ff2d0 msgr2=0x7f0fb419e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:17.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.324+0000 7f0fb9000700 1 --2- 172.21.15.159:0/1132047285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40ff2d0 0x7f0fb419e690 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0fa400b5c0 tx=0x7f0fa400be00 comp rx=0 tx=0).stop 2024-02-28T23:22:17.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.325+0000 7f0fb9000700 1 -- 172.21.15.159:0/1132047285 shutdown_connections 2024-02-28T23:22:17.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.325+0000 7f0fb9000700 1 --2- 172.21.15.159:0/1132047285 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f0f9806d8a0 0x7f0f9806fd60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:17.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.325+0000 7f0fb9000700 1 --2- 172.21.15.159:0/1132047285 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40ff2d0 0x7f0fb419e690 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:17.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.325+0000 7f0fb9000700 1 --2- 172.21.15.159:0/1132047285 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0fb4101970 0x7f0fb419ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:17.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.325+0000 7f0fb9000700 1 -- 172.21.15.159:0/1132047285 >> 172.21.15.159:0/1132047285 conn(0x7f0fb4074d50 msgr2=0x7f0fb4106aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:17.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.325+0000 7f0fb9000700 1 -- 172.21.15.159:0/1132047285 shutdown_connections 2024-02-28T23:22:17.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:17.325+0000 7f0fb9000700 1 -- 172.21.15.159:0/1132047285 wait complete. 2024-02-28T23:22:18.117 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions' 2024-02-28T23:22:18.535 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:22:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:18 smithi184 ceph-mon[86482]: pgmap v338: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:18.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:18 smithi184 ceph-mon[86482]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:22:18.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:18 smithi159 ceph-mon[113833]: pgmap v338: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:18.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:18 smithi159 ceph-mon[113833]: from='client.34580 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-28T23:22:20.642 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:20 smithi159 ceph-mon[113833]: pgmap v339: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:22:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:20 smithi184 ceph-mon[86482]: pgmap v339: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:22:20.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.949+0000 7fd133600700 1 -- 172.21.15.159:0/724856656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd12c10d280 msgr2=0x7fd12c10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:20.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.949+0000 7fd133600700 1 --2- 172.21.15.159:0/724856656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd12c10d280 0x7fd12c10d660 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd114009910 tx=0x7fd114009c20 comp rx=0 tx=0).stop 2024-02-28T23:22:20.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.949+0000 7fd133600700 1 -- 172.21.15.159:0/724856656 shutdown_connections 2024-02-28T23:22:20.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.949+0000 7fd133600700 1 --2- 172.21.15.159:0/724856656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd12c1071d0 0x7fd12c107650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:20.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.949+0000 7fd133600700 1 --2- 172.21.15.159:0/724856656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd12c10d280 0x7fd12c10d660 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:20.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.949+0000 7fd133600700 1 -- 172.21.15.159:0/724856656 >> 172.21.15.159:0/724856656 conn(0x7fd12c0769e0 msgr2=0x7fd12c078e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:20.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.949+0000 7fd133600700 1 -- 172.21.15.159:0/724856656 shutdown_connections 2024-02-28T23:22:20.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.949+0000 7fd133600700 1 -- 172.21.15.159:0/724856656 wait complete. 2024-02-28T23:22:20.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.950+0000 7fd133600700 1 Processor -- start 2024-02-28T23:22:20.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.951+0000 7fd133600700 1 -- start start 2024-02-28T23:22:20.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.951+0000 7fd133600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd12c1071d0 0x7fd12c19ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:20.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.951+0000 7fd133600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd12c10d280 0x7fd12c19d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:20.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.951+0000 7fd133600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c19d8a0 con 0x7fd12c1071d0 2024-02-28T23:22:20.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.951+0000 7fd133600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12c1a05d0 con 0x7fd12c10d280 2024-02-28T23:22:20.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.951+0000 7fd130c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd12c1071d0 0x7fd12c19ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:20.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.951+0000 7fd130c00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd12c1071d0 0x7fd12c19ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52602/0 (socket says 172.21.15.159:52602) 2024-02-28T23:22:20.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.951+0000 7fd130c00700 1 -- 172.21.15.159:0/647780865 learned_addr learned my addr 172.21.15.159:0/647780865 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:20.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.952+0000 7fd130c00700 1 -- 172.21.15.159:0/647780865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd12c10d280 msgr2=0x7fd12c19d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:20.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.952+0000 7fd130c00700 1 --2- 172.21.15.159:0/647780865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd12c10d280 0x7fd12c19d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:20.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.952+0000 7fd130c00700 1 -- 172.21.15.159:0/647780865 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1140095f0 con 0x7fd12c1071d0 2024-02-28T23:22:20.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.952+0000 7fd130c00700 1 --2- 172.21.15.159:0/647780865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd12c1071d0 0x7fd12c19ccd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd11400b5c0 tx=0x7fd11400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:20.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.952+0000 7fd12a000700 1 -- 172.21.15.159:0/647780865 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd11401d070 con 0x7fd12c1071d0 2024-02-28T23:22:20.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.952+0000 7fd12a000700 1 -- 172.21.15.159:0/647780865 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd11400f460 con 0x7fd12c1071d0 2024-02-28T23:22:20.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.952+0000 7fd133600700 1 -- 172.21.15.159:0/647780865 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12c1a0850 con 0x7fd12c1071d0 2024-02-28T23:22:20.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.952+0000 7fd12a000700 1 -- 172.21.15.159:0/647780865 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd114017610 con 0x7fd12c1071d0 2024-02-28T23:22:20.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.953+0000 7fd133600700 1 -- 172.21.15.159:0/647780865 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd12c1a0dc0 con 0x7fd12c1071d0 2024-02-28T23:22:20.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.954+0000 7fd133600700 1 -- 172.21.15.159:0/647780865 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd12c04ea90 con 0x7fd12c1071d0 2024-02-28T23:22:20.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.955+0000 7fd12a000700 1 -- 172.21.15.159:0/647780865 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd11400f5d0 con 0x7fd12c1071d0 2024-02-28T23:22:20.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.956+0000 7fd12a000700 1 --2- 172.21.15.159:0/647780865 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd10c06d8a0 0x7fd10c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:20.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.956+0000 7fd12a000700 1 -- 172.21.15.159:0/647780865 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fd11408ec50 con 0x7fd12c1071d0 2024-02-28T23:22:20.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.956+0000 7fd123e00700 1 --2- 172.21.15.159:0/647780865 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd10c06d8a0 0x7fd10c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:20.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.957+0000 7fd123e00700 1 --2- 172.21.15.159:0/647780865 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd10c06d8a0 0x7fd10c06fd60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd12c19e2b0 tx=0x7fd11c005c80 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:20.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:20.961+0000 7fd12a000700 1 -- 172.21.15.159:0/647780865 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd1140582e0 con 0x7fd12c1071d0 2024-02-28T23:22:21.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.270+0000 7fd133600700 1 -- 172.21.15.159:0/647780865 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd12c19dff0 con 0x7fd12c1071d0 2024-02-28T23:22:21.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.271+0000 7fd12a000700 1 -- 172.21.15.159:0/647780865 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7fd11405b9a0 con 0x7fd12c1071d0 2024-02-28T23:22:21.270 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-02-28T23:22:21.270 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": { 2024-02-28T23:22:21.270 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:22:21.270 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": { 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 2 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": { 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 6 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": { 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 4 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: "overall": { 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)": 14 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-02-28T23:22:21.271 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-02-28T23:22:21.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.274+0000 7fd133600700 1 -- 172.21.15.159:0/647780865 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd10c06d8a0 msgr2=0x7fd10c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:21.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.274+0000 7fd133600700 1 --2- 172.21.15.159:0/647780865 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd10c06d8a0 0x7fd10c06fd60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd12c19e2b0 tx=0x7fd11c005c80 comp rx=0 tx=0).stop 2024-02-28T23:22:21.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.274+0000 7fd133600700 1 -- 172.21.15.159:0/647780865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd12c1071d0 msgr2=0x7fd12c19ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:21.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.274+0000 7fd133600700 1 --2- 172.21.15.159:0/647780865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd12c1071d0 0x7fd12c19ccd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd11400b5c0 tx=0x7fd11400be00 comp rx=0 tx=0).stop 2024-02-28T23:22:21.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.274+0000 7fd133600700 1 -- 172.21.15.159:0/647780865 shutdown_connections 2024-02-28T23:22:21.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.274+0000 7fd133600700 1 --2- 172.21.15.159:0/647780865 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd10c06d8a0 0x7fd10c06fd60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:21.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.274+0000 7fd133600700 1 --2- 172.21.15.159:0/647780865 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd12c1071d0 0x7fd12c19ccd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:21.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.274+0000 7fd133600700 1 --2- 172.21.15.159:0/647780865 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd12c10d280 0x7fd12c19d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:21.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.274+0000 7fd133600700 1 -- 172.21.15.159:0/647780865 >> 172.21.15.159:0/647780865 conn(0x7fd12c0769e0 msgr2=0x7fd12c078320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:21.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.275+0000 7fd133600700 1 -- 172.21.15.159:0/647780865 shutdown_connections 2024-02-28T23:22:21.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:21.275+0000 7fd133600700 1 -- 172.21.15.159:0/647780865 wait complete. 2024-02-28T23:22:21.686 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:21 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/647780865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:22:21.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:21 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/647780865' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:22:22.125 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-28T23:22:22.537 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:22:22.682 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:22 smithi159 ceph-mon[113833]: pgmap v340: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:22 smithi184 ceph-mon[86482]: pgmap v340: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:23.711 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:22:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:22:24.445 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:24 smithi159 ceph-mon[113833]: pgmap v341: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:24.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.715+0000 7f6940200700 1 -- 172.21.15.159:0/1954676931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6938068950 msgr2=0x7f6938068dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:24.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.715+0000 7f6940200700 1 --2- 172.21.15.159:0/1954676931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6938068950 0x7f6938068dd0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6924009910 tx=0x7f6924009c20 comp rx=0 tx=0).stop 2024-02-28T23:22:24.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.716+0000 7f6940200700 1 -- 172.21.15.159:0/1954676931 shutdown_connections 2024-02-28T23:22:24.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.716+0000 7f6940200700 1 --2- 172.21.15.159:0/1954676931 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6938068950 0x7f6938068dd0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:24.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.716+0000 7f6940200700 1 --2- 172.21.15.159:0/1954676931 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6938105b50 0x7f6938068410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:24.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.716+0000 7f6940200700 1 -- 172.21.15.159:0/1954676931 >> 172.21.15.159:0/1954676931 conn(0x7f69380755a0 msgr2=0x7f69380759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:24.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.716+0000 7f6940200700 1 -- 172.21.15.159:0/1954676931 shutdown_connections 2024-02-28T23:22:24.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.716+0000 7f6940200700 1 -- 172.21.15.159:0/1954676931 wait complete. 2024-02-28T23:22:24.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.717+0000 7f6940200700 1 Processor -- start 2024-02-28T23:22:24.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.717+0000 7f6940200700 1 -- start start 2024-02-28T23:22:24.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.718+0000 7f6940200700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6938068950 0x7f693819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:24.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.718+0000 7f6940200700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6938105b50 0x7f693819d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:24.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.718+0000 7f6940200700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693819d9f0 con 0x7f6938105b50 2024-02-28T23:22:24.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.718+0000 7f6940200700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69381a1780 con 0x7f6938068950 2024-02-28T23:22:24.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.718+0000 7f693ce00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6938105b50 0x7f693819d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:24.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.718+0000 7f693ce00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6938105b50 0x7f693819d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52614/0 (socket says 172.21.15.159:52614) 2024-02-28T23:22:24.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.718+0000 7f693ce00700 1 -- 172.21.15.159:0/1507150851 learned_addr learned my addr 172.21.15.159:0/1507150851 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:24.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.718+0000 7f693d800700 1 --2- 172.21.15.159:0/1507150851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6938068950 0x7f693819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:24.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.718+0000 7f693ce00700 1 -- 172.21.15.159:0/1507150851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6938068950 msgr2=0x7f693819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:24.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.718+0000 7f693ce00700 1 --2- 172.21.15.159:0/1507150851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6938068950 0x7f693819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:24.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.718+0000 7f693ce00700 1 -- 172.21.15.159:0/1507150851 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240095f0 con 0x7f6938105b50 2024-02-28T23:22:24.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.719+0000 7f693ce00700 1 --2- 172.21.15.159:0/1507150851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6938105b50 0x7f693819d310 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f692400b5c0 tx=0x7f692400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:24.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.719+0000 7f6936000700 1 -- 172.21.15.159:0/1507150851 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f692401d070 con 0x7f6938105b50 2024-02-28T23:22:24.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.719+0000 7f6936000700 1 -- 172.21.15.159:0/1507150851 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f692400f460 con 0x7f6938105b50 2024-02-28T23:22:24.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.719+0000 7f6936000700 1 -- 172.21.15.159:0/1507150851 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6924017610 con 0x7f6938105b50 2024-02-28T23:22:24.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.719+0000 7f6940200700 1 -- 172.21.15.159:0/1507150851 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69381a1a00 con 0x7f6938105b50 2024-02-28T23:22:24.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.719+0000 7f6940200700 1 -- 172.21.15.159:0/1507150851 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69381a1f70 con 0x7f6938105b50 2024-02-28T23:22:24.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.720+0000 7f6940200700 1 -- 172.21.15.159:0/1507150851 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693804ea90 con 0x7f6938105b50 2024-02-28T23:22:24.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.721+0000 7f6936000700 1 -- 172.21.15.159:0/1507150851 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f692400f5d0 con 0x7f6938105b50 2024-02-28T23:22:24.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.722+0000 7f6936000700 1 --2- 172.21.15.159:0/1507150851 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f692006d8a0 0x7f692006fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:24.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.722+0000 7f6936000700 1 -- 172.21.15.159:0/1507150851 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f692408ebb0 con 0x7f6938105b50 2024-02-28T23:22:24.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.723+0000 7f693d800700 1 --2- 172.21.15.159:0/1507150851 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f692006d8a0 0x7f692006fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:24.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.723+0000 7f693d800700 1 --2- 172.21.15.159:0/1507150851 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f692006d8a0 0x7f692006fd60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f692c006fd0 tx=0x7f692c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:24.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:24.727+0000 7f6936000700 1 -- 172.21.15.159:0/1507150851 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f6924095080 con 0x7f6938105b50 2024-02-28T23:22:24.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:24 smithi184 ceph-mon[86482]: pgmap v341: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:25.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.032+0000 7f6940200700 1 -- 172.21.15.159:0/1507150851 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f693819e130 con 0x7f6938105b50 2024-02-28T23:22:25.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.033+0000 7f6936000700 1 -- 172.21.15.159:0/1507150851 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7f69240582e0 con 0x7f6938105b50 2024-02-28T23:22:25.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.035+0000 7f6940200700 1 -- 172.21.15.159:0/1507150851 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f692006d8a0 msgr2=0x7f692006fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:25.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.035+0000 7f6940200700 1 --2- 172.21.15.159:0/1507150851 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f692006d8a0 0x7f692006fd60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f692c006fd0 tx=0x7f692c008040 comp rx=0 tx=0).stop 2024-02-28T23:22:25.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.036+0000 7f6940200700 1 -- 172.21.15.159:0/1507150851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6938105b50 msgr2=0x7f693819d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:25.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.036+0000 7f6940200700 1 --2- 172.21.15.159:0/1507150851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6938105b50 0x7f693819d310 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f692400b5c0 tx=0x7f692400be00 comp rx=0 tx=0).stop 2024-02-28T23:22:25.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.036+0000 7f6940200700 1 -- 172.21.15.159:0/1507150851 shutdown_connections 2024-02-28T23:22:25.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.036+0000 7f6940200700 1 --2- 172.21.15.159:0/1507150851 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f6938068950 0x7f693819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:25.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.036+0000 7f6940200700 1 --2- 172.21.15.159:0/1507150851 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f692006d8a0 0x7f692006fd60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:25.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.036+0000 7f6940200700 1 --2- 172.21.15.159:0/1507150851 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6938105b50 0x7f693819d310 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:25.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.036+0000 7f6940200700 1 -- 172.21.15.159:0/1507150851 >> 172.21.15.159:0/1507150851 conn(0x7f69380755a0 msgr2=0x7f6938101510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:25.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.036+0000 7f6940200700 1 -- 172.21.15.159:0/1507150851 shutdown_connections 2024-02-28T23:22:25.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:25.036+0000 7f6940200700 1 -- 172.21.15.159:0/1507150851 wait complete. 2024-02-28T23:22:25.051 INFO:teuthology.orchestra.run.smithi159.stdout:true 2024-02-28T23:22:25.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:25 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1507150851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:22:25.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:25 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1507150851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:22:25.971 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -e sha1=1fb5d10608dccee73edd6ef8a2c7b804a097c324 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-28T23:22:26.385 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:22:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:26 smithi184 ceph-mon[86482]: pgmap v342: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:26.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:26 smithi159 ceph-mon[113833]: pgmap v342: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:28.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.647+0000 7feb58e00700 1 -- 172.21.15.159:0/2298417034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54069020 msgr2=0x7feb54105790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:28.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.647+0000 7feb58e00700 1 --2- 172.21.15.159:0/2298417034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54069020 0x7feb54105790 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7feb40009910 tx=0x7feb40009c20 comp rx=0 tx=0).stop 2024-02-28T23:22:28.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.647+0000 7feb58e00700 1 -- 172.21.15.159:0/2298417034 shutdown_connections 2024-02-28T23:22:28.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.647+0000 7feb58e00700 1 --2- 172.21.15.159:0/2298417034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54069020 0x7feb54105790 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:28.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.647+0000 7feb58e00700 1 --2- 172.21.15.159:0/2298417034 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb54068670 0x7feb54068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:28.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.647+0000 7feb58e00700 1 -- 172.21.15.159:0/2298417034 >> 172.21.15.159:0/2298417034 conn(0x7feb540755a0 msgr2=0x7feb540759b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:28.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.647+0000 7feb58e00700 1 -- 172.21.15.159:0/2298417034 shutdown_connections 2024-02-28T23:22:28.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.647+0000 7feb58e00700 1 -- 172.21.15.159:0/2298417034 wait complete. 2024-02-28T23:22:28.647 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:28 smithi159 ceph-mon[113833]: pgmap v343: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:28.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.648+0000 7feb58e00700 1 Processor -- start 2024-02-28T23:22:28.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.648+0000 7feb58e00700 1 -- start start 2024-02-28T23:22:28.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb58e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54068670 0x7feb5419e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:28.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb58e00700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb54069020 0x7feb5419ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:28.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb58e00700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5419f420 con 0x7feb54068670 2024-02-28T23:22:28.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb58e00700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb541988d0 con 0x7feb54069020 2024-02-28T23:22:28.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb51e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54068670 0x7feb5419e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:28.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb51e00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54068670 0x7feb5419e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38926/0 (socket says 172.21.15.159:38926) 2024-02-28T23:22:28.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb51e00700 1 -- 172.21.15.159:0/386638986 learned_addr learned my addr 172.21.15.159:0/386638986 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:28.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb51400700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb54069020 0x7feb5419ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:28.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb51e00700 1 -- 172.21.15.159:0/386638986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb54069020 msgr2=0x7feb5419ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:28.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb51e00700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb54069020 0x7feb5419ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:28.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb51e00700 1 -- 172.21.15.159:0/386638986 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb400095f0 con 0x7feb54068670 2024-02-28T23:22:28.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.649+0000 7feb51400700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb54069020 0x7feb5419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:22:28.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.650+0000 7feb51e00700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54068670 0x7feb5419e850 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feb4400b4b0 tx=0x7feb4400b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:28.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.650+0000 7feb4aa00700 1 -- 172.21.15.159:0/386638986 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb44011800 con 0x7feb54068670 2024-02-28T23:22:28.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.650+0000 7feb4aa00700 1 -- 172.21.15.159:0/386638986 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7feb44011e20 con 0x7feb54068670 2024-02-28T23:22:28.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.650+0000 7feb58e00700 1 -- 172.21.15.159:0/386638986 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb54198bb0 con 0x7feb54068670 2024-02-28T23:22:28.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.650+0000 7feb58e00700 1 -- 172.21.15.159:0/386638986 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb54199100 con 0x7feb54068670 2024-02-28T23:22:28.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.651+0000 7feb4aa00700 1 -- 172.21.15.159:0/386638986 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb4400f2e0 con 0x7feb54068670 2024-02-28T23:22:28.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.652+0000 7feb58e00700 1 -- 172.21.15.159:0/386638986 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5404ea90 con 0x7feb54068670 2024-02-28T23:22:28.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.653+0000 7feb4aa00700 1 -- 172.21.15.159:0/386638986 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7feb44010380 con 0x7feb54068670 2024-02-28T23:22:28.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.655+0000 7feb4aa00700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feb3806d8a0 0x7feb3806fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:28.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.655+0000 7feb4aa00700 1 -- 172.21.15.159:0/386638986 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7feb4408d610 con 0x7feb54068670 2024-02-28T23:22:28.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.655+0000 7feb51400700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feb3806d8a0 0x7feb3806fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:28.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.656+0000 7feb51400700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feb3806d8a0 0x7feb3806fd60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feb40006010 tx=0x7feb4000b540 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:28.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.658+0000 7feb4aa00700 1 -- 172.21.15.159:0/386638986 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7feb4405a870 con 0x7feb54068670 2024-02-28T23:22:28.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:28 smithi184 ceph-mon[86482]: pgmap v343: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:28.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.970+0000 7feb58e00700 1 -- 172.21.15.159:0/386638986 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feb54198d40 con 0x7feb54068670 2024-02-28T23:22:28.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.971+0000 7feb4aa00700 1 -- 172.21.15.159:0/386638986 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+623 (secure 0 0 0) 0x7feb54198d40 con 0x7feb54068670 2024-02-28T23:22:28.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.973+0000 7feb58e00700 1 -- 172.21.15.159:0/386638986 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feb3806d8a0 msgr2=0x7feb3806fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:28.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.973+0000 7feb58e00700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feb3806d8a0 0x7feb3806fd60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7feb40006010 tx=0x7feb4000b540 comp rx=0 tx=0).stop 2024-02-28T23:22:28.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.973+0000 7feb58e00700 1 -- 172.21.15.159:0/386638986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54068670 msgr2=0x7feb5419e850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:28.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.973+0000 7feb58e00700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54068670 0x7feb5419e850 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feb4400b4b0 tx=0x7feb4400b870 comp rx=0 tx=0).stop 2024-02-28T23:22:28.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.974+0000 7feb58e00700 1 -- 172.21.15.159:0/386638986 shutdown_connections 2024-02-28T23:22:28.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.974+0000 7feb58e00700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7feb3806d8a0 0x7feb3806fd60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:28.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.974+0000 7feb58e00700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb54068670 0x7feb5419e850 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:28.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.974+0000 7feb58e00700 1 --2- 172.21.15.159:0/386638986 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7feb54069020 0x7feb5419ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:28.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.974+0000 7feb58e00700 1 -- 172.21.15.159:0/386638986 >> 172.21.15.159:0/386638986 conn(0x7feb540755a0 msgr2=0x7feb540fe870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:28.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.974+0000 7feb58e00700 1 -- 172.21.15.159:0/386638986 shutdown_connections 2024-02-28T23:22:28.973 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:28.974+0000 7feb58e00700 1 -- 172.21.15.159:0/386638986 wait complete. 2024-02-28T23:22:28.987 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph version 19.0.0-1670-g1fb5d106 (1fb5d10608dccee73edd6ef8a2c7b804a097c324) squid (dev)" 2024-02-28T23:22:29.644 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:29 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/386638986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:22:29.803 DEBUG:teuthology.parallel:result is None 2024-02-28T23:22:29.803 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-28T23:22:29.814 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:22:29.814 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v18.2.1 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 -- bash -c 'ceph fs dump' 2024-02-28T23:22:29.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:29 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/386638986' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-28T23:22:30.214 INFO:teuthology.orchestra.run.smithi159.stderr:Inferring config /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/mon.smithi159/config 2024-02-28T23:22:30.612 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:30 smithi159 ceph-mon[113833]: pgmap v344: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:22:30.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:30 smithi184 ceph-mon[86482]: pgmap v344: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:22:32.463 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:32 smithi159 ceph-mon[113833]: pgmap v345: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:22:32.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.519+0000 7f014d600700 1 -- 172.21.15.159:0/32196644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0148103000 msgr2=0x7f01481033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:32.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.519+0000 7f014d600700 1 --2- 172.21.15.159:0/32196644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0148103000 0x7f01481033e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0138009910 tx=0x7f0138009c20 comp rx=0 tx=0).stop 2024-02-28T23:22:32.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.519+0000 7f014d600700 1 -- 172.21.15.159:0/32196644 shutdown_connections 2024-02-28T23:22:32.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.519+0000 7f014d600700 1 --2- 172.21.15.159:0/32196644 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f01481039b0 0x7f0148107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:32.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.519+0000 7f014d600700 1 --2- 172.21.15.159:0/32196644 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0148103000 0x7f01481033e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:32.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.519+0000 7f014d600700 1 -- 172.21.15.159:0/32196644 >> 172.21.15.159:0/32196644 conn(0x7f01480fe8d0 msgr2=0x7f0148100cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:32.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.519+0000 7f014d600700 1 -- 172.21.15.159:0/32196644 shutdown_connections 2024-02-28T23:22:32.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.519+0000 7f014d600700 1 -- 172.21.15.159:0/32196644 wait complete. 2024-02-28T23:22:32.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.520+0000 7f014d600700 1 Processor -- start 2024-02-28T23:22:32.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.520+0000 7f014d600700 1 -- start start 2024-02-28T23:22:32.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.521+0000 7f014d600700 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0148103000 0x7f014819e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:32.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.521+0000 7f014d600700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01481039b0 0x7f014819ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:32.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.521+0000 7f014d600700 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014819f3c0 con 0x7f01481039b0 2024-02-28T23:22:32.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.521+0000 7f014d600700 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0148198870 con 0x7f0148103000 2024-02-28T23:22:32.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.521+0000 7f013fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01481039b0 0x7f014819ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:32.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.521+0000 7f013fe00700 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01481039b0 0x7f014819ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38946/0 (socket says 172.21.15.159:38946) 2024-02-28T23:22:32.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.521+0000 7f013fe00700 1 -- 172.21.15.159:0/15387932 learned_addr learned my addr 172.21.15.159:0/15387932 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:32.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.521+0000 7f0146a00700 1 --2- 172.21.15.159:0/15387932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0148103000 0x7f014819e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:32.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.522+0000 7f013fe00700 1 -- 172.21.15.159:0/15387932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0148103000 msgr2=0x7f014819e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:32.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.522+0000 7f013fe00700 1 --2- 172.21.15.159:0/15387932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0148103000 0x7f014819e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:32.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.522+0000 7f013fe00700 1 -- 172.21.15.159:0/15387932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01380095f0 con 0x7f01481039b0 2024-02-28T23:22:32.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.522+0000 7f013fe00700 1 --2- 172.21.15.159:0/15387932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01481039b0 0x7f014819ed30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f013000e8f0 tx=0x7f013000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:32.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.522+0000 7f013f400700 1 -- 172.21.15.159:0/15387932 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0130009790 con 0x7f01481039b0 2024-02-28T23:22:32.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.522+0000 7f013f400700 1 -- 172.21.15.159:0/15387932 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f0130004cf0 con 0x7f01481039b0 2024-02-28T23:22:32.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.522+0000 7f014d600700 1 -- 172.21.15.159:0/15387932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0148198b50 con 0x7f01481039b0 2024-02-28T23:22:32.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.522+0000 7f013f400700 1 -- 172.21.15.159:0/15387932 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0130005690 con 0x7f01481039b0 2024-02-28T23:22:32.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.523+0000 7f014d600700 1 -- 172.21.15.159:0/15387932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01481990a0 con 0x7f01481039b0 2024-02-28T23:22:32.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.524+0000 7f014d600700 1 -- 172.21.15.159:0/15387932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014810b3a0 con 0x7f01481039b0 2024-02-28T23:22:32.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.525+0000 7f013f400700 1 -- 172.21.15.159:0/15387932 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f0130004750 con 0x7f01481039b0 2024-02-28T23:22:32.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.526+0000 7f013f400700 1 --2- 172.21.15.159:0/15387932 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f012c06d8a0 0x7f012c06fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:32.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.526+0000 7f013f400700 1 -- 172.21.15.159:0/15387932 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f0130014070 con 0x7f01481039b0 2024-02-28T23:22:32.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.526+0000 7f0146a00700 1 --2- 172.21.15.159:0/15387932 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f012c06d8a0 0x7f012c06fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:32.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.527+0000 7f0146a00700 1 --2- 172.21.15.159:0/15387932 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f012c06d8a0 0x7f012c06fd60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f013800b760 tx=0x7f0138009f90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:32.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.530+0000 7f013f400700 1 -- 172.21.15.159:0/15387932 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f013005ac20 con 0x7f01481039b0 2024-02-28T23:22:32.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.795+0000 7f014d600700 1 -- 172.21.15.159:0/15387932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f014804ea90 con 0x7f01481039b0 2024-02-28T23:22:32.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.796+0000 7f013f400700 1 -- 172.21.15.159:0/15387932 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 40 v40) v1 ==== 76+0+1903 (secure 0 0 0) 0x7f013005a7b0 con 0x7f01481039b0 2024-02-28T23:22:32.795 INFO:teuthology.orchestra.run.smithi159.stdout:e40 2024-02-28T23:22:32.795 INFO:teuthology.orchestra.run.smithi159.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-02-28T23:22:32.795 INFO:teuthology.orchestra.run.smithi159.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-28T23:22:32.795 INFO:teuthology.orchestra.run.smithi159.stdout:legacy client fscid: 1 2024-02-28T23:22:32.795 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:32.795 INFO:teuthology.orchestra.run.smithi159.stdout:Filesystem 'cephfs' (1) 2024-02-28T23:22:32.795 INFO:teuthology.orchestra.run.smithi159.stdout:fs_name cephfs 2024-02-28T23:22:32.795 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 40 2024-02-28T23:22:32.795 INFO:teuthology.orchestra.run.smithi159.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-02-28T23:22:32.795 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-02-28T23:03:22.377936+0000 2024-02-28T23:22:32.795 INFO:teuthology.orchestra.run.smithi159.stdout:modified 2024-02-28T23:20:48.644416+0000 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:tableserver 0 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:root 0 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:session_timeout 60 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:session_autoclose 300 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:max_file_size 1099511627776 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:max_xattr_size 65536 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:required_client_features {} 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure 0 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:last_failure_osd_epoch 102 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:max_mds 1 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:in 0 2024-02-28T23:22:32.796 INFO:teuthology.orchestra.run.smithi159.stdout:up {0=34440} 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:failed 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:damaged 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:stopped 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:data_pools [3] 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:metadata_pool 2 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:inline_data disabled 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:balancer 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:bal_rank_mask -1 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:standby_count_wanted 1 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.mbaqic{0:34440} state up:active seq 25 join_fscid=1 addr [v2:172.21.15.159:6826/3438650790,v1:172.21.15.159:6827/3438650790] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi159.azxrct{0:34476} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.159:6828/1030084771,v1:172.21.15.159:6829/1030084771] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:32.797 INFO:teuthology.orchestra.run.smithi159.stdout:Standby daemons: 2024-02-28T23:22:32.798 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:32.798 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.azwkfx{-1:44283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6824/2221421248,v1:172.21.15.184:6825/2221421248] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:22:32.798 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.cephfs.smithi184.pnifob{-1:44311} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.184:6826/146669833,v1:172.21.15.184:6827/146669833] compat {c=[1],r=[1],i=[fff]}] 2024-02-28T23:22:32.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.798+0000 7f014d600700 1 -- 172.21.15.159:0/15387932 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f012c06d8a0 msgr2=0x7f012c06fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:32.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.798+0000 7f014d600700 1 --2- 172.21.15.159:0/15387932 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f012c06d8a0 0x7f012c06fd60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f013800b760 tx=0x7f0138009f90 comp rx=0 tx=0).stop 2024-02-28T23:22:32.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.798+0000 7f014d600700 1 -- 172.21.15.159:0/15387932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01481039b0 msgr2=0x7f014819ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:32.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.798+0000 7f014d600700 1 --2- 172.21.15.159:0/15387932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01481039b0 0x7f014819ed30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f013000e8f0 tx=0x7f013000ecb0 comp rx=0 tx=0).stop 2024-02-28T23:22:32.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.799+0000 7f014d600700 1 -- 172.21.15.159:0/15387932 shutdown_connections 2024-02-28T23:22:32.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.799+0000 7f014d600700 1 --2- 172.21.15.159:0/15387932 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f0148103000 0x7f014819e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:32.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.799+0000 7f014d600700 1 --2- 172.21.15.159:0/15387932 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f012c06d8a0 0x7f012c06fd60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:32.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.799+0000 7f014d600700 1 --2- 172.21.15.159:0/15387932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01481039b0 0x7f014819ed30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:32.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.799+0000 7f014d600700 1 -- 172.21.15.159:0/15387932 >> 172.21.15.159:0/15387932 conn(0x7f01480fe8d0 msgr2=0x7f01480ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:32.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.799+0000 7f014d600700 1 -- 172.21.15.159:0/15387932 shutdown_connections 2024-02-28T23:22:32.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:32.799+0000 7f014d600700 1 -- 172.21.15.159:0/15387932 wait complete. 2024-02-28T23:22:32.799 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 40 2024-02-28T23:22:32.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:32 smithi184 ceph-mon[86482]: pgmap v345: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:22:33.615 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-02-28T23:22:33.625 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T23:22:33.719 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:33 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/15387932' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:22:33.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:33 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/15387932' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-02-28T23:22:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.855+0000 7f7635000640 1 -- 172.21.15.159:0/2329357782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7630102e90 msgr2=0x7f7630106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.855+0000 7f7635000640 1 --2- 172.21.15.159:0/2329357782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7630102e90 0x7f7630106ed0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7618009880 tx=0x7f761802bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.855+0000 7f7635000640 1 -- 172.21.15.159:0/2329357782 shutdown_connections 2024-02-28T23:22:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.855+0000 7f7635000640 1 --2- 172.21.15.159:0/2329357782 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7630102e90 0x7f7630106ed0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.855+0000 7f7635000640 1 --2- 172.21.15.159:0/2329357782 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f76301024e0 0x7f76301028c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.855+0000 7f7635000640 1 -- 172.21.15.159:0/2329357782 >> 172.21.15.159:0/2329357782 conn(0x7f76300fdd00 msgr2=0x7f7630100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.855+0000 7f7635000640 1 -- 172.21.15.159:0/2329357782 shutdown_connections 2024-02-28T23:22:33.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.855+0000 7f7635000640 1 -- 172.21.15.159:0/2329357782 wait complete. 2024-02-28T23:22:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.856+0000 7f7635000640 1 Processor -- start 2024-02-28T23:22:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.856+0000 7f7635000640 1 -- start start 2024-02-28T23:22:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.857+0000 7f7635000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76301024e0 0x7f7630197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.857+0000 7f7635000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7630198410 0x7f763019c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.857+0000 7f7635000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7630198a10 con 0x7f76301024e0 2024-02-28T23:22:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.857+0000 7f7635000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7630198b80 con 0x7f7630198410 2024-02-28T23:22:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.857+0000 7f762de00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76301024e0 0x7f7630197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.857+0000 7f762de00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76301024e0 0x7f7630197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38958/0 (socket says 172.21.15.159:38958) 2024-02-28T23:22:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.857+0000 7f762de00640 1 -- 172.21.15.159:0/1760001900 learned_addr learned my addr 172.21.15.159:0/1760001900 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:33.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.857+0000 7f7625400640 1 --2- 172.21.15.159:0/1760001900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7630198410 0x7f763019c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.858+0000 7f762de00640 1 -- 172.21.15.159:0/1760001900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7630198410 msgr2=0x7f763019c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.858+0000 7f762de00640 1 --2- 172.21.15.159:0/1760001900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7630198410 0x7f763019c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.858+0000 7f762de00640 1 -- 172.21.15.159:0/1760001900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7618009560 con 0x7f76301024e0 2024-02-28T23:22:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.858+0000 7f762de00640 1 --2- 172.21.15.159:0/1760001900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76301024e0 0x7f7630197ed0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f762000d720 tx=0x7f762000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:33.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.858+0000 7f7627400640 1 -- 172.21.15.159:0/1760001900 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76200051f0 con 0x7f76301024e0 2024-02-28T23:22:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.858+0000 7f7627400640 1 -- 172.21.15.159:0/1760001900 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7620009ce0 con 0x7f76301024e0 2024-02-28T23:22:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.858+0000 7f7627400640 1 -- 172.21.15.159:0/1760001900 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7620010460 con 0x7f76301024e0 2024-02-28T23:22:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.858+0000 7f7635000640 1 -- 172.21.15.159:0/1760001900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763019ce70 con 0x7f76301024e0 2024-02-28T23:22:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.858+0000 7f7635000640 1 -- 172.21.15.159:0/1760001900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763019d3d0 con 0x7f76301024e0 2024-02-28T23:22:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.859+0000 7f7635000640 1 -- 172.21.15.159:0/1760001900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f763019d6a0 con 0x7f76301024e0 2024-02-28T23:22:33.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.860+0000 7f7627400640 1 -- 172.21.15.159:0/1760001900 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f7620005350 con 0x7f76301024e0 2024-02-28T23:22:33.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.861+0000 7f7627400640 1 --2- 172.21.15.159:0/1760001900 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f761406d8d0 0x7f761406fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:33.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.861+0000 7f7627400640 1 -- 172.21.15.159:0/1760001900 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f762008d1f0 con 0x7f76301024e0 2024-02-28T23:22:33.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.861+0000 7f7625400640 1 --2- 172.21.15.159:0/1760001900 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f761406d8d0 0x7f761406fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:33.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.862+0000 7f7625400640 1 --2- 172.21.15.159:0/1760001900 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f761406d8d0 0x7f761406fd90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7618036040 tx=0x7f7618005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:33.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:33.866+0000 7f7627400640 1 -- 172.21.15.159:0/1760001900 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7620056880 con 0x7f76301024e0 2024-02-28T23:22:34.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.063+0000 7f7635000640 1 -- 172.21.15.159:0/1760001900 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7630199250 con 0x7f76301024e0 2024-02-28T23:22:34.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.066+0000 7f7627400640 1 -- 172.21.15.159:0/1760001900 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+17259 (secure 0 0 0) 0x7f7620059f40 con 0x7f76301024e0 2024-02-28T23:22:34.064 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:34.064 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":102,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","created":"2024-02-28T22:54:07.259600+0000","modified":"2024-02-28T23:19:57.396295+0000","last_up_change":"2024-02-28T23:18:21.299156+0000","last_in_change":"2024-02-28T23:01:21.082396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T23:00:05.643400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T23:03:21.113072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T23:03:21.891379+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"12a358ec-2348-437f-a587-c75299c13814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":64,"up_thru":95,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6803","nonce":3232134603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6805","nonce":3232134603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6809","nonce":3232134603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6807","nonce":3232134603}]},"public_addr":"172.21.15.159:6803/3232134603","cluster_addr":"172.21.15.159:6805/3232134603","heartbeat_back_addr":"172.21.15.159:6809/3232134603","heartbeat_front_addr":"172.21.15.159:6807/3232134603","state":["exists","up"]},{"osd":1,"uuid":"34a65dc7-3bd8-4cb5-b61b-e04166f115c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":71,"up_from":75,"up_thru":95,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6811","nonce":3750692109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6813","nonce":3750692109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6817","nonce":3750692109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6815","nonce":3750692109}]},"public_addr":"172.21.15.159:6811/3750692109","cluster_addr":"172.21.15.159:6813/3750692109","heartbeat_back_addr":"172.21.15.159:6817/3750692109","heartbeat_front_addr":"172.21.15.159:6815/3750692109","state":["exists","up"]},{"osd":2,"uuid":"a712ee56-f8b8-43c4-9f38-33ebe33b7977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":76,"up_from":80,"up_thru":95,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6819","nonce":1285075477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6821","nonce":1285075477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6825","nonce":1285075477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6823","nonce":1285075477}]},"public_addr":"172.21.15.159:6819/1285075477","cluster_addr":"172.21.15.159:6821/1285075477","heartbeat_back_addr":"172.21.15.159:6825/1285075477","heartbeat_front_addr":"172.21.15.159:6823/1285075477","state":["exists","up"]},{"osd":3,"uuid":"bb2d95db-29e3-4e8d-bcea-ed52ae538c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":81,"up_from":85,"up_thru":95,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6801","nonce":29498664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6803","nonce":29498664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6807","nonce":29498664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6805","nonce":29498664}]},"public_addr":"172.21.15.184:6801/29498664","cluster_addr":"172.21.15.184:6803/29498664","heartbeat_back_addr":"172.21.15.184:6807/29498664","heartbeat_front_addr":"172.21.15.184:6805/29498664","state":["exists","up"]},{"osd":4,"uuid":"55d22d45-549c-4a55-8a36-7aa785561068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":86,"up_from":90,"up_thru":95,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6809","nonce":1173196285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6811","nonce":1173196285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6815","nonce":1173196285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6813","nonce":1173196285}]},"public_addr":"172.21.15.184:6809/1173196285","cluster_addr":"172.21.15.184:6811/1173196285","heartbeat_back_addr":"172.21.15.184:6815/1173196285","heartbeat_front_addr":"172.21.15.184:6813/1173196285","state":["exists","up"]},{"osd":5,"uuid":"eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":91,"up_from":95,"up_thru":95,"down_at":92,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6817","nonce":1609921388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6819","nonce":1609921388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6823","nonce":1609921388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6821","nonce":1609921388}]},"public_addr":"172.21.15.184:6817/1609921388","cluster_addr":"172.21.15.184:6819/1609921388","heartbeat_back_addr":"172.21.15.184:6823/1609921388","heartbeat_front_addr":"172.21.15.184:6821/1609921388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:58:47.192772+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:59:24.679857+0000","dead_epoch":71},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:03.155438+0000","dead_epoch":76},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:35.629938+0000","dead_epoch":81},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:09.895470+0000","dead_epoch":86},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:43.528444+0000","dead_epoch":91}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":3,"to":2}]},{"pgid":"2.6","mappings":[{"from":3,"to":0}]},{"pgid":"2.7","mappings":[{"from":3,"to":0}]},{"pgid":"3.0","mappings":[{"from":4,"to":5}]},{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.b","mappings":[{"from":1,"to":2}]},{"pgid":"3.12","mappings":[{"from":3,"to":5}]},{"pgid":"3.1c","mappings":[{"from":4,"to":0}]},{"pgid":"3.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6827/3142391154":"2024-02-29T23:19:57.396251+0000","172.21.15.184:6826/3142391154":"2024-02-29T23:19:57.396251+0000","172.21.15.159:6829/455979918":"2024-02-29T23:18:59.875868+0000","172.21.15.159:0/2648380137":"2024-02-29T23:12:53.028717+0000","172.21.15.159:0/1337780901":"2024-02-29T22:57:04.937279+0000","172.21.15.184:6829/2879526003":"2024-02-29T23:07:58.913608+0000","172.21.15.159:0/74577353":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/3426997920":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6827/1702728557":"2024-02-29T23:03:41.473671+0000","172.21.15.159:0/2943793350":"2024-02-29T23:12:53.028717+0000","172.21.15.184:0/1788579887":"2024-02-29T23:07:58.913608+0000","172.21.15.184:0/3999545682":"2024-02-29T23:07:58.913608+0000","172.21.15.159:0/3798912796":"2024-02-29T23:06:27.595745+0000","172.21.15.159:6826/1702728557":"2024-02-29T23:03:41.473671+0000","172.21.15.159:0/3945263774":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/2053056032":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6801/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:0/528876824":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6800/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:0/1021838933":"2024-02-29T23:12:53.028717+0000","172.21.15.159:0/2242263974":"2024-02-29T22:57:04.937279+0000","172.21.15.159:6800/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.159:6801/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.184:6828/2879526003":"2024-02-29T23:07:58.913608+0000","172.21.15.184:0/862687661":"2024-02-29T23:07:58.913608+0000","172.21.15.184:0/419508658":"2024-02-29T23:07:58.913608+0000","172.21.15.159:6800/3612719472":"2024-02-29T23:12:53.028717+0000","172.21.15.159:6828/455979918":"2024-02-29T23:18:59.875868+0000","172.21.15.159:6801/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/2466956559":"2024-02-29T23:06:27.595745+0000","172.21.15.159:0/656297432":"2024-02-29T23:06:27.595745+0000","172.21.15.159:0/423942112":"2024-02-29T22:54:49.969159+0000","172.21.15.184:0/4231789812":"2024-02-29T23:07:58.913608+0000","172.21.15.159:0/3397973227":"2024-02-29T23:06:27.595745+0000","172.21.15.159:0/3456040694":"2024-02-29T22:54:49.969159+0000","172.21.15.184:0/2145262352":"2024-02-29T23:07:58.913608+0000","172.21.15.159:6800/1861094655":"2024-02-29T23:06:27.595745+0000","172.21.15.159:6801/1861094655":"2024-02-29T23:06:27.595745+0000","172.21.15.159:6801/3612719472":"2024-02-29T23:12:53.028717+0000","172.21.15.159:6800/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/844515011":"2024-02-29T23:12:53.028717+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T23:22:34.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.068+0000 7f7635000640 1 -- 172.21.15.159:0/1760001900 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f761406d8d0 msgr2=0x7f761406fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:34.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.068+0000 7f7635000640 1 --2- 172.21.15.159:0/1760001900 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f761406d8d0 0x7f761406fd90 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7618036040 tx=0x7f7618005fd0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.068+0000 7f7635000640 1 -- 172.21.15.159:0/1760001900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76301024e0 msgr2=0x7f7630197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:34.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.068+0000 7f7635000640 1 --2- 172.21.15.159:0/1760001900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76301024e0 0x7f7630197ed0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f762000d720 tx=0x7f762000dbe0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.068+0000 7f7635000640 1 -- 172.21.15.159:0/1760001900 shutdown_connections 2024-02-28T23:22:34.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.068+0000 7f7635000640 1 --2- 172.21.15.159:0/1760001900 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f761406d8d0 0x7f761406fd90 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.068+0000 7f7635000640 1 --2- 172.21.15.159:0/1760001900 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7630198410 0x7f763019c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.068+0000 7f7635000640 1 --2- 172.21.15.159:0/1760001900 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76301024e0 0x7f7630197ed0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.068+0000 7f7635000640 1 -- 172.21.15.159:0/1760001900 >> 172.21.15.159:0/1760001900 conn(0x7f76300fdd00 msgr2=0x7f76300ff390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:34.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.069+0000 7f7635000640 1 -- 172.21.15.159:0/1760001900 shutdown_connections 2024-02-28T23:22:34.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.069+0000 7f7635000640 1 -- 172.21.15.159:0/1760001900 wait complete. 2024-02-28T23:22:34.088 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T23:00:05.643400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T23:03:21.113072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T23:03:21.891379+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T23:22:34.088 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T23:22:34.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.309+0000 7f7fe6e00640 1 -- 172.21.15.159:0/21100275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe01024a0 msgr2=0x7f7fe0102880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:34.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.309+0000 7f7fe6e00640 1 --2- 172.21.15.159:0/21100275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe01024a0 0x7f7fe0102880 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009880 tx=0x7f7fd002bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.309+0000 7f7fe6e00640 1 -- 172.21.15.159:0/21100275 shutdown_connections 2024-02-28T23:22:34.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.309+0000 7f7fe6e00640 1 --2- 172.21.15.159:0/21100275 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe0102e50 0x7f7fe0106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.309+0000 7f7fe6e00640 1 --2- 172.21.15.159:0/21100275 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe01024a0 0x7f7fe0102880 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.309+0000 7f7fe6e00640 1 -- 172.21.15.159:0/21100275 >> 172.21.15.159:0/21100275 conn(0x7f7fe00fdd00 msgr2=0x7f7fe0100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:34.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.309+0000 7f7fe6e00640 1 -- 172.21.15.159:0/21100275 shutdown_connections 2024-02-28T23:22:34.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.309+0000 7f7fe6e00640 1 -- 172.21.15.159:0/21100275 wait complete. 2024-02-28T23:22:34.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.310+0000 7f7fe6e00640 1 Processor -- start 2024-02-28T23:22:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.310+0000 7f7fe6e00640 1 -- start start 2024-02-28T23:22:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.310+0000 7f7fe6e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe01024a0 0x7f7fe0198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.311+0000 7f7fe6e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe01985a0 0x7f7fe019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.311+0000 7f7fe6e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe0198b10 con 0x7f7fe01985a0 2024-02-28T23:22:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.311+0000 7f7fe6e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fe0198c80 con 0x7f7fe01024a0 2024-02-28T23:22:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.311+0000 7f7fdf400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe01985a0 0x7f7fe019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.311+0000 7f7fdf400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe01985a0 0x7f7fe019ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38966/0 (socket says 172.21.15.159:38966) 2024-02-28T23:22:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.311+0000 7f7fdf400640 1 -- 172.21.15.159:0/3245501264 learned_addr learned my addr 172.21.15.159:0/3245501264 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.311+0000 7f7fdfe00640 1 --2- 172.21.15.159:0/3245501264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe01024a0 0x7f7fe0198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.311+0000 7f7fdf400640 1 -- 172.21.15.159:0/3245501264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe01024a0 msgr2=0x7f7fe0198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:34.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.311+0000 7f7fdf400640 1 --2- 172.21.15.159:0/3245501264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe01024a0 0x7f7fe0198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.311+0000 7f7fdf400640 1 -- 172.21.15.159:0/3245501264 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd0009560 con 0x7f7fe01985a0 2024-02-28T23:22:34.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.312+0000 7f7fdf400640 1 --2- 172.21.15.159:0/3245501264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe01985a0 0x7f7fe019ca00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c8f0 tx=0x7f7fcc00cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:34.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.312+0000 7f7fdcc00640 1 -- 172.21.15.159:0/3245501264 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fcc004410 con 0x7f7fe01985a0 2024-02-28T23:22:34.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.312+0000 7f7fdcc00640 1 -- 172.21.15.159:0/3245501264 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f7fcc007c60 con 0x7f7fe01985a0 2024-02-28T23:22:34.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.312+0000 7f7fe6e00640 1 -- 172.21.15.159:0/3245501264 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fe019cfa0 con 0x7f7fe01985a0 2024-02-28T23:22:34.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.312+0000 7f7fdcc00640 1 -- 172.21.15.159:0/3245501264 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fcc00f450 con 0x7f7fe01985a0 2024-02-28T23:22:34.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.312+0000 7f7fe6e00640 1 -- 172.21.15.159:0/3245501264 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fe019d4b0 con 0x7f7fe01985a0 2024-02-28T23:22:34.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.313+0000 7f7fe6e00640 1 -- 172.21.15.159:0/3245501264 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fe004e040 con 0x7f7fe01985a0 2024-02-28T23:22:34.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.314+0000 7f7fdcc00640 1 -- 172.21.15.159:0/3245501264 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f7fcc0077a0 con 0x7f7fe01985a0 2024-02-28T23:22:34.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.315+0000 7f7fdcc00640 1 --2- 172.21.15.159:0/3245501264 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fc406d810 0x7f7fc406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:34.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.315+0000 7f7fdcc00640 1 -- 172.21.15.159:0/3245501264 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f7fcc08d700 con 0x7f7fe01985a0 2024-02-28T23:22:34.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.315+0000 7f7fdfe00640 1 --2- 172.21.15.159:0/3245501264 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fc406d810 0x7f7fc406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:34.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.316+0000 7f7fdfe00640 1 --2- 172.21.15.159:0/3245501264 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fc406d810 0x7f7fc406fcd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0006010 tx=0x7f7fd0000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:34.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.320+0000 7f7fdcc00640 1 -- 172.21.15.159:0/3245501264 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f7fcc056d10 con 0x7f7fe01985a0 2024-02-28T23:22:34.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.518+0000 7f7fe6e00640 1 -- 172.21.15.159:0/3245501264 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fe01993b0 con 0x7f7fe01985a0 2024-02-28T23:22:34.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.519+0000 7f7fdcc00640 1 -- 172.21.15.159:0/3245501264 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fcc05a3d0 con 0x7f7fe01985a0 2024-02-28T23:22:34.517 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 1 2024-02-28T23:22:34.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.522+0000 7f7fe6e00640 1 -- 172.21.15.159:0/3245501264 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fc406d810 msgr2=0x7f7fc406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:34.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.522+0000 7f7fe6e00640 1 --2- 172.21.15.159:0/3245501264 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fc406d810 0x7f7fc406fcd0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0006010 tx=0x7f7fd0000bc0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.522+0000 7f7fe6e00640 1 -- 172.21.15.159:0/3245501264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe01985a0 msgr2=0x7f7fe019ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:34.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.522+0000 7f7fe6e00640 1 --2- 172.21.15.159:0/3245501264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe01985a0 0x7f7fe019ca00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00c8f0 tx=0x7f7fcc00cdb0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.522+0000 7f7fe6e00640 1 -- 172.21.15.159:0/3245501264 shutdown_connections 2024-02-28T23:22:34.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.522+0000 7f7fe6e00640 1 --2- 172.21.15.159:0/3245501264 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f7fc406d810 0x7f7fc406fcd0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.522+0000 7f7fe6e00640 1 --2- 172.21.15.159:0/3245501264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7fe01985a0 0x7f7fe019ca00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.522+0000 7f7fe6e00640 1 --2- 172.21.15.159:0/3245501264 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f7fe01024a0 0x7f7fe0198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.522+0000 7f7fe6e00640 1 -- 172.21.15.159:0/3245501264 >> 172.21.15.159:0/3245501264 conn(0x7f7fe00fdd00 msgr2=0x7f7fe00ff430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:34.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.522+0000 7f7fe6e00640 1 -- 172.21.15.159:0/3245501264 shutdown_connections 2024-02-28T23:22:34.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.522+0000 7f7fe6e00640 1 -- 172.21.15.159:0/3245501264 wait complete. 2024-02-28T23:22:34.539 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T23:22:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:34 smithi159 ceph-mon[113833]: pgmap v346: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:34 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1760001900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:22:34.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.758+0000 7f9770a00640 1 -- 172.21.15.159:0/4172213194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c1022c0 msgr2=0x7f976c1026a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:34.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.758+0000 7f9770a00640 1 --2- 172.21.15.159:0/4172213194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c1022c0 0x7f976c1026a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f975c009880 tx=0x7f975c02bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.759+0000 7f9770a00640 1 -- 172.21.15.159:0/4172213194 shutdown_connections 2024-02-28T23:22:34.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.759+0000 7f9770a00640 1 --2- 172.21.15.159:0/4172213194 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f976c102c70 0x7f976c106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.759+0000 7f9770a00640 1 --2- 172.21.15.159:0/4172213194 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c1022c0 0x7f976c1026a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.759+0000 7f9770a00640 1 -- 172.21.15.159:0/4172213194 >> 172.21.15.159:0/4172213194 conn(0x7f976c0fdb20 msgr2=0x7f976c0fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:34.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.759+0000 7f9770a00640 1 -- 172.21.15.159:0/4172213194 shutdown_connections 2024-02-28T23:22:34.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.759+0000 7f9770a00640 1 -- 172.21.15.159:0/4172213194 wait complete. 2024-02-28T23:22:34.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.760+0000 7f9770a00640 1 Processor -- start 2024-02-28T23:22:34.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.760+0000 7f9770a00640 1 -- start start 2024-02-28T23:22:34.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.760+0000 7f9770a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f976c1022c0 0x7f976c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:34.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.760+0000 7f9770a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c198310 0x7f976c19c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:34.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.760+0000 7f9770a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c198880 con 0x7f976c198310 2024-02-28T23:22:34.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.760+0000 7f9770a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976c1989f0 con 0x7f976c1022c0 2024-02-28T23:22:34.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.760+0000 7f976aa00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c198310 0x7f976c19c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:34.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.760+0000 7f976aa00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c198310 0x7f976c19c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:38984/0 (socket says 172.21.15.159:38984) 2024-02-28T23:22:34.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.760+0000 7f976aa00640 1 -- 172.21.15.159:0/215582490 learned_addr learned my addr 172.21.15.159:0/215582490 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:34.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.761+0000 7f976aa00640 1 -- 172.21.15.159:0/215582490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f976c1022c0 msgr2=0x7f976c197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:34.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.761+0000 7f976aa00640 1 --2- 172.21.15.159:0/215582490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f976c1022c0 0x7f976c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.761+0000 7f976aa00640 1 -- 172.21.15.159:0/215582490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975c009560 con 0x7f976c198310 2024-02-28T23:22:34.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.761+0000 7f976aa00640 1 --2- 172.21.15.159:0/215582490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c198310 0x7f976c19c770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f975800c8f0 tx=0x7f975800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:34.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.761+0000 7f9763e00640 1 -- 172.21.15.159:0/215582490 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9758004410 con 0x7f976c198310 2024-02-28T23:22:34.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.761+0000 7f9763e00640 1 -- 172.21.15.159:0/215582490 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f9758007c60 con 0x7f976c198310 2024-02-28T23:22:34.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.761+0000 7f9770a00640 1 -- 172.21.15.159:0/215582490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976c19cd10 con 0x7f976c198310 2024-02-28T23:22:34.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.761+0000 7f9763e00640 1 -- 172.21.15.159:0/215582490 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f975800f450 con 0x7f976c198310 2024-02-28T23:22:34.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.762+0000 7f9770a00640 1 -- 172.21.15.159:0/215582490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976c19d220 con 0x7f976c198310 2024-02-28T23:22:34.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.763+0000 7f9770a00640 1 -- 172.21.15.159:0/215582490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f976c04e040 con 0x7f976c198310 2024-02-28T23:22:34.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.764+0000 7f9763e00640 1 -- 172.21.15.159:0/215582490 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f97580077a0 con 0x7f976c198310 2024-02-28T23:22:34.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.765+0000 7f9763e00640 1 --2- 172.21.15.159:0/215582490 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f975006d810 0x7f975006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:34.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.766+0000 7f9763e00640 1 -- 172.21.15.159:0/215582490 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f975808d700 con 0x7f976c198310 2024-02-28T23:22:34.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.766+0000 7f976b400640 1 --2- 172.21.15.159:0/215582490 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f975006d810 0x7f975006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:34.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.766+0000 7f976b400640 1 --2- 172.21.15.159:0/215582490 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f975006d810 0x7f975006fcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f975c036040 tx=0x7f975c000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:34.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.770+0000 7f9763e00640 1 -- 172.21.15.159:0/215582490 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f9758056d10 con 0x7f976c198310 2024-02-28T23:22:34.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:34 smithi184 ceph-mon[86482]: pgmap v346: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:34.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:34 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1760001900' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:22:34.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.976+0000 7f9770a00640 1 -- 172.21.15.159:0/215582490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f976c10a5c0 con 0x7f976c198310 2024-02-28T23:22:34.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.977+0000 7f9763e00640 1 -- 172.21.15.159:0/215582490 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v102) v1 ==== 107+0+11 (secure 0 0 0) 0x7f975805a3d0 con 0x7f976c198310 2024-02-28T23:22:34.976 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-02-28T23:22:34.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.980+0000 7f9770a00640 1 -- 172.21.15.159:0/215582490 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f975006d810 msgr2=0x7f975006fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:34.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.980+0000 7f9770a00640 1 --2- 172.21.15.159:0/215582490 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f975006d810 0x7f975006fcd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f975c036040 tx=0x7f975c000bc0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.980+0000 7f9770a00640 1 -- 172.21.15.159:0/215582490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c198310 msgr2=0x7f976c19c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:34.978 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.980+0000 7f9770a00640 1 --2- 172.21.15.159:0/215582490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c198310 0x7f976c19c770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f975800c8f0 tx=0x7f975800cdb0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.980+0000 7f9770a00640 1 -- 172.21.15.159:0/215582490 shutdown_connections 2024-02-28T23:22:34.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.980+0000 7f9770a00640 1 --2- 172.21.15.159:0/215582490 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f975006d810 0x7f975006fcd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.980+0000 7f9770a00640 1 --2- 172.21.15.159:0/215582490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f976c198310 0x7f976c19c770 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.980+0000 7f9770a00640 1 --2- 172.21.15.159:0/215582490 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f976c1022c0 0x7f976c197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:34.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.980+0000 7f9770a00640 1 -- 172.21.15.159:0/215582490 >> 172.21.15.159:0/215582490 conn(0x7f976c0fdb20 msgr2=0x7f976c0ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:34.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.980+0000 7f9770a00640 1 -- 172.21.15.159:0/215582490 shutdown_connections 2024-02-28T23:22:34.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:34.980+0000 7f9770a00640 1 -- 172.21.15.159:0/215582490 wait complete. 2024-02-28T23:22:34.996 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T23:22:35.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.214+0000 7fbc1a400640 1 -- 172.21.15.159:0/2421931518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc14100a70 msgr2=0x7fbc14104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:35.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.214+0000 7fbc1a400640 1 --2- 172.21.15.159:0/2421931518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc14100a70 0x7fbc14104ab0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009880 tx=0x7fbc0402bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.214+0000 7fbc1a400640 1 -- 172.21.15.159:0/2421931518 shutdown_connections 2024-02-28T23:22:35.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.214+0000 7fbc1a400640 1 --2- 172.21.15.159:0/2421931518 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc14100a70 0x7fbc14104ab0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.214+0000 7fbc1a400640 1 --2- 172.21.15.159:0/2421931518 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc141000c0 0x7fbc141004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.214+0000 7fbc1a400640 1 -- 172.21.15.159:0/2421931518 >> 172.21.15.159:0/2421931518 conn(0x7fbc140fb920 msgr2=0x7fbc140fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:35.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.214+0000 7fbc1a400640 1 -- 172.21.15.159:0/2421931518 shutdown_connections 2024-02-28T23:22:35.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.214+0000 7fbc1a400640 1 -- 172.21.15.159:0/2421931518 wait complete. 2024-02-28T23:22:35.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.215+0000 7fbc1a400640 1 Processor -- start 2024-02-28T23:22:35.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.215+0000 7fbc1a400640 1 -- start start 2024-02-28T23:22:35.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.215+0000 7fbc1a400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc141000c0 0x7fbc14197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:35.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.215+0000 7fbc1a400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc14198310 0x7fbc1419c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:35.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.215+0000 7fbc1a400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc14198910 con 0x7fbc141000c0 2024-02-28T23:22:35.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.215+0000 7fbc1a400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc14198a80 con 0x7fbc14198310 2024-02-28T23:22:35.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.216+0000 7fbc19000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc141000c0 0x7fbc14197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:35.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.216+0000 7fbc19000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc141000c0 0x7fbc14197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39008/0 (socket says 172.21.15.159:39008) 2024-02-28T23:22:35.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.216+0000 7fbc19000640 1 -- 172.21.15.159:0/1558815324 learned_addr learned my addr 172.21.15.159:0/1558815324 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:35.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.216+0000 7fbc13e00640 1 --2- 172.21.15.159:0/1558815324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc14198310 0x7fbc1419c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:35.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.216+0000 7fbc19000640 1 -- 172.21.15.159:0/1558815324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc14198310 msgr2=0x7fbc1419c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:35.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.216+0000 7fbc19000640 1 --2- 172.21.15.159:0/1558815324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc14198310 0x7fbc1419c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.216+0000 7fbc19000640 1 -- 172.21.15.159:0/1558815324 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc04009560 con 0x7fbc141000c0 2024-02-28T23:22:35.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.216+0000 7fbc19000640 1 --2- 172.21.15.159:0/1558815324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc141000c0 0x7fbc14197dd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800d720 tx=0x7fbc0800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:35.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.217+0000 7fbc11600640 1 -- 172.21.15.159:0/1558815324 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc080051f0 con 0x7fbc141000c0 2024-02-28T23:22:35.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.217+0000 7fbc11600640 1 -- 172.21.15.159:0/1558815324 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbc08009ce0 con 0x7fbc141000c0 2024-02-28T23:22:35.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.217+0000 7fbc1a400640 1 -- 172.21.15.159:0/1558815324 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc1419cd70 con 0x7fbc141000c0 2024-02-28T23:22:35.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.217+0000 7fbc11600640 1 -- 172.21.15.159:0/1558815324 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc08010460 con 0x7fbc141000c0 2024-02-28T23:22:35.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.217+0000 7fbc1a400640 1 -- 172.21.15.159:0/1558815324 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc1419d2d0 con 0x7fbc141000c0 2024-02-28T23:22:35.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.218+0000 7fbc1a400640 1 -- 172.21.15.159:0/1558815324 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc1419d5a0 con 0x7fbc141000c0 2024-02-28T23:22:35.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.219+0000 7fbc11600640 1 -- 172.21.15.159:0/1558815324 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fbc08005350 con 0x7fbc141000c0 2024-02-28T23:22:35.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.220+0000 7fbc11600640 1 --2- 172.21.15.159:0/1558815324 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbbfc06d810 0x7fbbfc06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:35.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.220+0000 7fbc11600640 1 -- 172.21.15.159:0/1558815324 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fbc0808d150 con 0x7fbc141000c0 2024-02-28T23:22:35.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.220+0000 7fbc13e00640 1 --2- 172.21.15.159:0/1558815324 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbbfc06d810 0x7fbbfc06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:35.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.221+0000 7fbc13e00640 1 --2- 172.21.15.159:0/1558815324 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbbfc06d810 0x7fbbfc06fcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbc04036040 tx=0x7fbc0402cf90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:35.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.224+0000 7fbc11600640 1 -- 172.21.15.159:0/1558815324 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbc08056880 con 0x7fbc141000c0 2024-02-28T23:22:35.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.421+0000 7fbc1a400640 1 -- 172.21.15.159:0/1558815324 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7fbc1404e040 con 0x7fbc141000c0 2024-02-28T23:22:35.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.422+0000 7fbc11600640 1 -- 172.21.15.159:0/1558815324 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v102) v1 ==== 107+0+11 (secure 0 0 0) 0x7fbc08017020 con 0x7fbc141000c0 2024-02-28T23:22:35.421 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-02-28T23:22:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.425+0000 7fbc1a400640 1 -- 172.21.15.159:0/1558815324 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbbfc06d810 msgr2=0x7fbbfc06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.425+0000 7fbc1a400640 1 --2- 172.21.15.159:0/1558815324 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbbfc06d810 0x7fbbfc06fcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbc04036040 tx=0x7fbc0402cf90 comp rx=0 tx=0).stop 2024-02-28T23:22:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.425+0000 7fbc1a400640 1 -- 172.21.15.159:0/1558815324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc141000c0 msgr2=0x7fbc14197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.425+0000 7fbc1a400640 1 --2- 172.21.15.159:0/1558815324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc141000c0 0x7fbc14197dd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fbc0800d720 tx=0x7fbc0800dbe0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.425+0000 7fbc1a400640 1 -- 172.21.15.159:0/1558815324 shutdown_connections 2024-02-28T23:22:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.425+0000 7fbc1a400640 1 --2- 172.21.15.159:0/1558815324 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbbfc06d810 0x7fbbfc06fcd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.425+0000 7fbc1a400640 1 --2- 172.21.15.159:0/1558815324 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbc14198310 0x7fbc1419c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.425+0000 7fbc1a400640 1 --2- 172.21.15.159:0/1558815324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc141000c0 0x7fbc14197dd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.425+0000 7fbc1a400640 1 -- 172.21.15.159:0/1558815324 >> 172.21.15.159:0/1558815324 conn(0x7fbc140fb920 msgr2=0x7fbc140fd060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.425+0000 7fbc1a400640 1 -- 172.21.15.159:0/1558815324 shutdown_connections 2024-02-28T23:22:35.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.426+0000 7fbc1a400640 1 -- 172.21.15.159:0/1558815324 wait complete. 2024-02-28T23:22:35.445 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-02-28T23:22:35.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.646+0000 7f2b53a00640 1 -- 172.21.15.159:0/922925291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b4c1066a0 msgr2=0x7f2b4c106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:35.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.646+0000 7f2b53a00640 1 --2- 172.21.15.159:0/922925291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b4c1066a0 0x7f2b4c106b20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009880 tx=0x7f2b3802bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.646+0000 7f2b53a00640 1 -- 172.21.15.159:0/922925291 shutdown_connections 2024-02-28T23:22:35.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.646+0000 7f2b53a00640 1 --2- 172.21.15.159:0/922925291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b4c1066a0 0x7f2b4c106b20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.646+0000 7f2b53a00640 1 --2- 172.21.15.159:0/922925291 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b4c10c660 0x7f2b4c10ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.646+0000 7f2b53a00640 1 -- 172.21.15.159:0/922925291 >> 172.21.15.159:0/922925291 conn(0x7f2b4c075e80 msgr2=0x7f2b4c0782a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:35.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.646+0000 7f2b53a00640 1 -- 172.21.15.159:0/922925291 shutdown_connections 2024-02-28T23:22:35.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.647+0000 7f2b53a00640 1 -- 172.21.15.159:0/922925291 wait complete. 2024-02-28T23:22:35.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.647+0000 7f2b53a00640 1 Processor -- start 2024-02-28T23:22:35.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.647+0000 7f2b53a00640 1 -- start start 2024-02-28T23:22:35.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.648+0000 7f2b53a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b4c1066a0 0x7f2b4c19c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:35.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.648+0000 7f2b53a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b4c10c660 0x7f2b4c19c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:35.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.648+0000 7f2b53a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c19ced0 con 0x7f2b4c1066a0 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.648+0000 7f2b53a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b4c1a0ca0 con 0x7f2b4c10c660 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.648+0000 7f2b51000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b4c1066a0 0x7f2b4c19c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.648+0000 7f2b51000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b4c1066a0 0x7f2b4c19c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39034/0 (socket says 172.21.15.159:39034) 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.648+0000 7f2b51000640 1 -- 172.21.15.159:0/1199064445 learned_addr learned my addr 172.21.15.159:0/1199064445 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.648+0000 7f2b51000640 1 -- 172.21.15.159:0/1199064445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b4c10c660 msgr2=0x7f2b4c19c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.648+0000 7f2b51000640 1 --2- 172.21.15.159:0/1199064445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b4c10c660 0x7f2b4c19c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.648+0000 7f2b51000640 1 -- 172.21.15.159:0/1199064445 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b38009560 con 0x7f2b4c1066a0 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.649+0000 7f2b51000640 1 --2- 172.21.15.159:0/1199064445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b4c1066a0 0x7f2b4c19c300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000ea00 tx=0x7f2b4000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.649+0000 7f2b49600640 1 -- 172.21.15.159:0/1199064445 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b4000cd50 con 0x7f2b4c1066a0 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.649+0000 7f2b49600640 1 -- 172.21.15.159:0/1199064445 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f2b40005020 con 0x7f2b4c1066a0 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.649+0000 7f2b49600640 1 -- 172.21.15.159:0/1199064445 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b400116a0 con 0x7f2b4c1066a0 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.649+0000 7f2b53a00640 1 -- 172.21.15.159:0/1199064445 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b4c1a0f80 con 0x7f2b4c1066a0 2024-02-28T23:22:35.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.649+0000 7f2b53a00640 1 -- 172.21.15.159:0/1199064445 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b4c1a14e0 con 0x7f2b4c1066a0 2024-02-28T23:22:35.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.650+0000 7f2b53a00640 1 -- 172.21.15.159:0/1199064445 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b4c04e040 con 0x7f2b4c1066a0 2024-02-28T23:22:35.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.651+0000 7f2b49600640 1 -- 172.21.15.159:0/1199064445 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f2b40005190 con 0x7f2b4c1066a0 2024-02-28T23:22:35.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.652+0000 7f2b49600640 1 --2- 172.21.15.159:0/1199064445 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2b3406d8d0 0x7f2b3406fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:35.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.652+0000 7f2b49600640 1 -- 172.21.15.159:0/1199064445 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f2b4008da70 con 0x7f2b4c1066a0 2024-02-28T23:22:35.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.652+0000 7f2b4be00640 1 --2- 172.21.15.159:0/1199064445 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2b3406d8d0 0x7f2b3406fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:35.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.653+0000 7f2b4be00640 1 --2- 172.21.15.159:0/1199064445 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2b3406d8d0 0x7f2b3406fd90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2b3802efd0 tx=0x7f2b38000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:35.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.656+0000 7f2b49600640 1 -- 172.21.15.159:0/1199064445 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f2b40057080 con 0x7f2b4c1066a0 2024-02-28T23:22:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:35 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3245501264' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T23:22:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:35 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/215582490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T23:22:35.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:35 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1558815324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T23:22:35.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:35 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3245501264' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T23:22:35.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:35 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/215582490' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T23:22:35.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:35 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1558815324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T23:22:35.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.896+0000 7f2b53a00640 1 -- 172.21.15.159:0/1199064445 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b4c10ebc0 con 0x7f2b4c1066a0 2024-02-28T23:22:35.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.897+0000 7f2b49600640 1 -- 172.21.15.159:0/1199064445 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+5014 (secure 0 0 0) 0x7f2b4c10ebc0 con 0x7f2b4c1066a0 2024-02-28T23:22:35.896 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:35.896 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":40,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2221421248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2221421248},{"type":"v1","addr":"172.21.15.184:6825","nonce":2221421248}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44311,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6827/146669833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":146669833},{"type":"v1","addr":"172.21.15.184:6827","nonce":146669833}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":40,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:20:48.644416+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34440":{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":0,"incarnation":32,"state":"up:active","state_seq":25,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34476":{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:35.896 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 40 2024-02-28T23:22:35.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.900+0000 7f2b53a00640 1 -- 172.21.15.159:0/1199064445 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2b3406d8d0 msgr2=0x7f2b3406fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:35.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.900+0000 7f2b53a00640 1 --2- 172.21.15.159:0/1199064445 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2b3406d8d0 0x7f2b3406fd90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2b3802efd0 tx=0x7f2b38000bc0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.900+0000 7f2b53a00640 1 -- 172.21.15.159:0/1199064445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b4c1066a0 msgr2=0x7f2b4c19c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:35.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.900+0000 7f2b53a00640 1 --2- 172.21.15.159:0/1199064445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b4c1066a0 0x7f2b4c19c300 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000ea00 tx=0x7f2b4000eec0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.900+0000 7f2b53a00640 1 -- 172.21.15.159:0/1199064445 shutdown_connections 2024-02-28T23:22:35.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.900+0000 7f2b53a00640 1 --2- 172.21.15.159:0/1199064445 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f2b3406d8d0 0x7f2b3406fd90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.900+0000 7f2b53a00640 1 --2- 172.21.15.159:0/1199064445 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f2b4c10c660 0x7f2b4c19c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.900+0000 7f2b53a00640 1 --2- 172.21.15.159:0/1199064445 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b4c1066a0 0x7f2b4c19c300 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:35.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.900+0000 7f2b53a00640 1 -- 172.21.15.159:0/1199064445 >> 172.21.15.159:0/1199064445 conn(0x7f2b4c075e80 msgr2=0x7f2b4c076880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:35.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.900+0000 7f2b53a00640 1 -- 172.21.15.159:0/1199064445 shutdown_connections 2024-02-28T23:22:35.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:35.900+0000 7f2b53a00640 1 -- 172.21.15.159:0/1199064445 wait complete. 2024-02-28T23:22:35.915 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 18, 'max_mds': 1, 'flags': 50} 2024-02-28T23:22:35.915 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-02-28T23:22:36.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.121+0000 7faa1f800640 1 -- 172.21.15.159:0/3454860561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180747d0 msgr2=0x7faa18074bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:36.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.121+0000 7faa1f800640 1 --2- 172.21.15.159:0/3454860561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180747d0 0x7faa18074bb0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7faa0c009880 tx=0x7faa0c02bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.121+0000 7faa1f800640 1 -- 172.21.15.159:0/3454860561 shutdown_connections 2024-02-28T23:22:36.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.121+0000 7faa1f800640 1 --2- 172.21.15.159:0/3454860561 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa180750f0 0x7faa181109b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.121+0000 7faa1f800640 1 --2- 172.21.15.159:0/3454860561 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180747d0 0x7faa18074bb0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.121+0000 7faa1f800640 1 -- 172.21.15.159:0/3454860561 >> 172.21.15.159:0/3454860561 conn(0x7faa180fdce0 msgr2=0x7faa18100100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:36.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.121+0000 7faa1f800640 1 -- 172.21.15.159:0/3454860561 shutdown_connections 2024-02-28T23:22:36.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.121+0000 7faa1f800640 1 -- 172.21.15.159:0/3454860561 wait complete. 2024-02-28T23:22:36.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.122+0000 7faa1f800640 1 Processor -- start 2024-02-28T23:22:36.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.122+0000 7faa1f800640 1 -- start start 2024-02-28T23:22:36.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.122+0000 7faa1f800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa180747d0 0x7faa1819c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:36.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.122+0000 7faa1f800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180750f0 0x7faa1819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:36.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.122+0000 7faa1f800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1819cec0 con 0x7faa180750f0 2024-02-28T23:22:36.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.122+0000 7faa1f800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa181a0c90 con 0x7faa180747d0 2024-02-28T23:22:36.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.123+0000 7faa17e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180750f0 0x7faa1819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:36.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.123+0000 7faa17e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180750f0 0x7faa1819c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39048/0 (socket says 172.21.15.159:39048) 2024-02-28T23:22:36.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.123+0000 7faa17e00640 1 -- 172.21.15.159:0/3816647585 learned_addr learned my addr 172.21.15.159:0/3816647585 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:36.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.123+0000 7faa1ce00640 1 --2- 172.21.15.159:0/3816647585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa180747d0 0x7faa1819c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:36.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.123+0000 7faa17e00640 1 -- 172.21.15.159:0/3816647585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa180747d0 msgr2=0x7faa1819c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:36.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.123+0000 7faa17e00640 1 --2- 172.21.15.159:0/3816647585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa180747d0 0x7faa1819c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.123+0000 7faa17e00640 1 -- 172.21.15.159:0/3816647585 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa0c009560 con 0x7faa180750f0 2024-02-28T23:22:36.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.123+0000 7faa17e00640 1 --2- 172.21.15.159:0/3816647585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180750f0 0x7faa1819c830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faa0400e970 tx=0x7faa0400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:36.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.124+0000 7faa15600640 1 -- 172.21.15.159:0/3816647585 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa0400cc90 con 0x7faa180750f0 2024-02-28T23:22:36.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.124+0000 7faa15600640 1 -- 172.21.15.159:0/3816647585 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faa0400cdf0 con 0x7faa180750f0 2024-02-28T23:22:36.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.124+0000 7faa1f800640 1 -- 172.21.15.159:0/3816647585 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa181a0f70 con 0x7faa180750f0 2024-02-28T23:22:36.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.124+0000 7faa15600640 1 -- 172.21.15.159:0/3816647585 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa04010430 con 0x7faa180750f0 2024-02-28T23:22:36.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.124+0000 7faa1f800640 1 -- 172.21.15.159:0/3816647585 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa181a14d0 con 0x7faa180750f0 2024-02-28T23:22:36.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.125+0000 7faa1f800640 1 -- 172.21.15.159:0/3816647585 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa1804e040 con 0x7faa180750f0 2024-02-28T23:22:36.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.126+0000 7faa15600640 1 -- 172.21.15.159:0/3816647585 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7faa040046c0 con 0x7faa180750f0 2024-02-28T23:22:36.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.127+0000 7faa15600640 1 --2- 172.21.15.159:0/3816647585 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faa0006d810 0x7faa0006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:36.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.128+0000 7faa15600640 1 -- 172.21.15.159:0/3816647585 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7faa04014070 con 0x7faa180750f0 2024-02-28T23:22:36.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.128+0000 7faa1ce00640 1 --2- 172.21.15.159:0/3816647585 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faa0006d810 0x7faa0006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:36.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.128+0000 7faa1ce00640 1 --2- 172.21.15.159:0/3816647585 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faa0006d810 0x7faa0006fcd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faa0c000c00 tx=0x7faa0c005d70 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:36.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.132+0000 7faa15600640 1 -- 172.21.15.159:0/3816647585 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faa040572a0 con 0x7faa180750f0 2024-02-28T23:22:36.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.366+0000 7faa1f800640 1 -- 172.21.15.159:0/3816647585 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7faa1810e090 con 0x7faa180750f0 2024-02-28T23:22:36.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.368+0000 7faa15600640 1 -- 172.21.15.159:0/3816647585 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v40) v1 ==== 107+0+4053 (secure 0 0 0) 0x7faa0405a960 con 0x7faa180750f0 2024-02-28T23:22:36.366 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:36.366 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24269,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2280748719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2280748719},{"type":"v1","addr":"172.21.15.184:6825","nonce":2280748719}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:18:27.005585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi159.azxrct","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.159:6829/455979918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":455979918},{"type":"v1","addr":"172.21.15.159:6829","nonce":455979918}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:36.366 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 19 2024-02-28T23:22:36.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.370+0000 7faa1f800640 1 -- 172.21.15.159:0/3816647585 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faa0006d810 msgr2=0x7faa0006fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:36.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.370+0000 7faa1f800640 1 --2- 172.21.15.159:0/3816647585 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faa0006d810 0x7faa0006fcd0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faa0c000c00 tx=0x7faa0c005d70 comp rx=0 tx=0).stop 2024-02-28T23:22:36.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.370+0000 7faa1f800640 1 -- 172.21.15.159:0/3816647585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180750f0 msgr2=0x7faa1819c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:36.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.370+0000 7faa1f800640 1 --2- 172.21.15.159:0/3816647585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180750f0 0x7faa1819c830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7faa0400e970 tx=0x7faa0400ed70 comp rx=0 tx=0).stop 2024-02-28T23:22:36.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.370+0000 7faa1f800640 1 -- 172.21.15.159:0/3816647585 shutdown_connections 2024-02-28T23:22:36.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.370+0000 7faa1f800640 1 --2- 172.21.15.159:0/3816647585 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faa0006d810 0x7faa0006fcd0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.370+0000 7faa1f800640 1 --2- 172.21.15.159:0/3816647585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faa180750f0 0x7faa1819c830 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.370+0000 7faa1f800640 1 --2- 172.21.15.159:0/3816647585 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7faa180747d0 0x7faa1819c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.370+0000 7faa1f800640 1 -- 172.21.15.159:0/3816647585 >> 172.21.15.159:0/3816647585 conn(0x7faa180fdce0 msgr2=0x7faa180fe950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:36.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.370+0000 7faa1f800640 1 -- 172.21.15.159:0/3816647585 shutdown_connections 2024-02-28T23:22:36.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.370+0000 7faa1f800640 1 -- 172.21.15.159:0/3816647585 wait complete. 2024-02-28T23:22:36.386 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 19 2024-02-28T23:22:36.386 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-02-28T23:22:36.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.600+0000 7fd83f800640 1 -- 172.21.15.159:0/283882303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd838102480 msgr2=0x7fd838102860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:36.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.600+0000 7fd83f800640 1 --2- 172.21.15.159:0/283882303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd838102480 0x7fd838102860 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fd830009880 tx=0x7fd83002bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.601+0000 7fd83f800640 1 -- 172.21.15.159:0/283882303 shutdown_connections 2024-02-28T23:22:36.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.601+0000 7fd83f800640 1 --2- 172.21.15.159:0/283882303 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd838102e30 0x7fd838106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.601+0000 7fd83f800640 1 --2- 172.21.15.159:0/283882303 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd838102480 0x7fd838102860 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.601+0000 7fd83f800640 1 -- 172.21.15.159:0/283882303 >> 172.21.15.159:0/283882303 conn(0x7fd8380fdd00 msgr2=0x7fd838100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:36.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.601+0000 7fd83f800640 1 -- 172.21.15.159:0/283882303 shutdown_connections 2024-02-28T23:22:36.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.601+0000 7fd83f800640 1 -- 172.21.15.159:0/283882303 wait complete. 2024-02-28T23:22:36.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.602+0000 7fd83f800640 1 Processor -- start 2024-02-28T23:22:36.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.602+0000 7fd83f800640 1 -- start start 2024-02-28T23:22:36.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.602+0000 7fd83f800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd838102480 0x7fd838197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:36.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.602+0000 7fd83f800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd838198360 0x7fd83819c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:36.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.603+0000 7fd83f800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8381988d0 con 0x7fd838198360 2024-02-28T23:22:36.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.603+0000 7fd83f800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd838198a40 con 0x7fd838102480 2024-02-28T23:22:36.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.603+0000 7fd837e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd838198360 0x7fd83819c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:36.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.603+0000 7fd837e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd838198360 0x7fd83819c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39074/0 (socket says 172.21.15.159:39074) 2024-02-28T23:22:36.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.603+0000 7fd837e00640 1 -- 172.21.15.159:0/3414807599 learned_addr learned my addr 172.21.15.159:0/3414807599 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:36.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.603+0000 7fd83ce00640 1 --2- 172.21.15.159:0/3414807599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd838102480 0x7fd838197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:36.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.603+0000 7fd837e00640 1 -- 172.21.15.159:0/3414807599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd838102480 msgr2=0x7fd838197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:36.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.603+0000 7fd837e00640 1 --2- 172.21.15.159:0/3414807599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd838102480 0x7fd838197e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.603+0000 7fd837e00640 1 -- 172.21.15.159:0/3414807599 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd830009560 con 0x7fd838198360 2024-02-28T23:22:36.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.604+0000 7fd837e00640 1 --2- 172.21.15.159:0/3414807599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd838198360 0x7fd83819c7c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd82400cc30 tx=0x7fd82400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:36.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.604+0000 7fd835600640 1 -- 172.21.15.159:0/3414807599 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd82400f450 con 0x7fd838198360 2024-02-28T23:22:36.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.604+0000 7fd835600640 1 -- 172.21.15.159:0/3414807599 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fd82400fa70 con 0x7fd838198360 2024-02-28T23:22:36.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.604+0000 7fd835600640 1 -- 172.21.15.159:0/3414807599 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd824018b50 con 0x7fd838198360 2024-02-28T23:22:36.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.604+0000 7fd83f800640 1 -- 172.21.15.159:0/3414807599 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83819cd60 con 0x7fd838198360 2024-02-28T23:22:36.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.604+0000 7fd83f800640 1 -- 172.21.15.159:0/3414807599 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83819d270 con 0x7fd838198360 2024-02-28T23:22:36.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.605+0000 7fd83f800640 1 -- 172.21.15.159:0/3414807599 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83804e040 con 0x7fd838198360 2024-02-28T23:22:36.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.607+0000 7fd835600640 1 -- 172.21.15.159:0/3414807599 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fd824018cd0 con 0x7fd838198360 2024-02-28T23:22:36.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.607+0000 7fd835600640 1 --2- 172.21.15.159:0/3414807599 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd81c06d8d0 0x7fd81c06fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:36.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.608+0000 7fd835600640 1 -- 172.21.15.159:0/3414807599 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fd82408dc60 con 0x7fd838198360 2024-02-28T23:22:36.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.608+0000 7fd83ce00640 1 --2- 172.21.15.159:0/3414807599 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd81c06d8d0 0x7fd81c06fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:36.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.608+0000 7fd83ce00640 1 --2- 172.21.15.159:0/3414807599 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd81c06d8d0 0x7fd81c06fd90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd830006010 tx=0x7fd830000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:36.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.612+0000 7fd835600640 1 -- 172.21.15.159:0/3414807599 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fd824057270 con 0x7fd838198360 2024-02-28T23:22:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:36 smithi159 ceph-mon[113833]: pgmap v347: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:36 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1199064445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T23:22:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:36 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3816647585' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-28T23:22:36.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.849+0000 7fd83f800640 1 -- 172.21.15.159:0/3414807599 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fd838199170 con 0x7fd838198360 2024-02-28T23:22:36.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.851+0000 7fd835600640 1 -- 172.21.15.159:0/3414807599 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v40) v1 ==== 107+0+4832 (secure 0 0 0) 0x7fd82405a930 con 0x7fd838198360 2024-02-28T23:22:36.849 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:36.850 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24269,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2280748719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2280748719},{"type":"v1","addr":"172.21.15.184:6825","nonce":2280748719}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34428,"name":"cephfs.smithi159.mbaqic","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/675860228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":675860228},{"type":"v1","addr":"172.21.15.159:6827","nonce":675860228}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:18:27.005585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi159.azxrct","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.159:6829/455979918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":455979918},{"type":"v1","addr":"172.21.15.159:6829","nonce":455979918}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:36.850 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 20 2024-02-28T23:22:36.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:36 smithi184 ceph-mon[86482]: pgmap v347: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:22:36.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:36 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1199064445' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-02-28T23:22:36.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:36 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3816647585' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-02-28T23:22:36.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.854+0000 7fd83f800640 1 -- 172.21.15.159:0/3414807599 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd81c06d8d0 msgr2=0x7fd81c06fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:36.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.854+0000 7fd83f800640 1 --2- 172.21.15.159:0/3414807599 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd81c06d8d0 0x7fd81c06fd90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd830006010 tx=0x7fd830000bc0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.854+0000 7fd83f800640 1 -- 172.21.15.159:0/3414807599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd838198360 msgr2=0x7fd83819c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:36.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.854+0000 7fd83f800640 1 --2- 172.21.15.159:0/3414807599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd838198360 0x7fd83819c7c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fd82400cc30 tx=0x7fd82400a620 comp rx=0 tx=0).stop 2024-02-28T23:22:36.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.854+0000 7fd83f800640 1 -- 172.21.15.159:0/3414807599 shutdown_connections 2024-02-28T23:22:36.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.854+0000 7fd83f800640 1 --2- 172.21.15.159:0/3414807599 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fd81c06d8d0 0x7fd81c06fd90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.854+0000 7fd83f800640 1 --2- 172.21.15.159:0/3414807599 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd838198360 0x7fd83819c7c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.854+0000 7fd83f800640 1 --2- 172.21.15.159:0/3414807599 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fd838102480 0x7fd838197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:36.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.854+0000 7fd83f800640 1 -- 172.21.15.159:0/3414807599 >> 172.21.15.159:0/3414807599 conn(0x7fd8380fdd00 msgr2=0x7fd8380ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:36.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.854+0000 7fd83f800640 1 -- 172.21.15.159:0/3414807599 shutdown_connections 2024-02-28T23:22:36.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:36.854+0000 7fd83f800640 1 -- 172.21.15.159:0/3414807599 wait complete. 2024-02-28T23:22:36.873 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 20 2024-02-28T23:22:36.873 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-02-28T23:22:37.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.072+0000 7f1085e00640 1 -- 172.21.15.159:0/3172197616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f108010c660 msgr2=0x7f108010ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:37.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.072+0000 7f1085e00640 1 --2- 172.21.15.159:0/3172197616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f108010c660 0x7f108010ca40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1070009880 tx=0x7f107002bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.072+0000 7f1085e00640 1 -- 172.21.15.159:0/3172197616 shutdown_connections 2024-02-28T23:22:37.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.072+0000 7f1085e00640 1 --2- 172.21.15.159:0/3172197616 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10801066a0 0x7f1080106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.072+0000 7f1085e00640 1 --2- 172.21.15.159:0/3172197616 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f108010c660 0x7f108010ca40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.072+0000 7f1085e00640 1 -- 172.21.15.159:0/3172197616 >> 172.21.15.159:0/3172197616 conn(0x7f1080075e80 msgr2=0x7f10800782a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:37.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.072+0000 7f1085e00640 1 -- 172.21.15.159:0/3172197616 shutdown_connections 2024-02-28T23:22:37.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.072+0000 7f1085e00640 1 -- 172.21.15.159:0/3172197616 wait complete. 2024-02-28T23:22:37.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.073+0000 7f1085e00640 1 Processor -- start 2024-02-28T23:22:37.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.073+0000 7f1085e00640 1 -- start start 2024-02-28T23:22:37.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f1085e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10801066a0 0x7f108019c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:37.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f1085e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f108010c660 0x7f108019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:37.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f1085e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108019d090 con 0x7f108010c660 2024-02-28T23:22:37.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f1085e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10801a0e60 con 0x7f10801066a0 2024-02-28T23:22:37.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f1076000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f108010c660 0x7f108019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:37.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f1076000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f108010c660 0x7f108019ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39098/0 (socket says 172.21.15.159:39098) 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f1076000640 1 -- 172.21.15.159:0/317705322 learned_addr learned my addr 172.21.15.159:0/317705322 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f107ea00640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10801066a0 0x7f108019c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f1076000640 1 -- 172.21.15.159:0/317705322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10801066a0 msgr2=0x7f108019c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f1076000640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10801066a0 0x7f108019c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f1076000640 1 -- 172.21.15.159:0/317705322 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1070009560 con 0x7f108010c660 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f107ea00640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10801066a0 0x7f108019c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.074+0000 7f1076000640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f108010c660 0x7f108019ca00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f106800b420 tx=0x7f106800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.075+0000 7f1084a00640 1 -- 172.21.15.159:0/317705322 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1068011800 con 0x7f108010c660 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.075+0000 7f1084a00640 1 -- 172.21.15.159:0/317705322 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1068011e20 con 0x7f108010c660 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.075+0000 7f1085e00640 1 -- 172.21.15.159:0/317705322 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10801a1140 con 0x7f108010c660 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.075+0000 7f1084a00640 1 -- 172.21.15.159:0/317705322 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f106800f2e0 con 0x7f108010c660 2024-02-28T23:22:37.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.075+0000 7f1085e00640 1 -- 172.21.15.159:0/317705322 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10801a16a0 con 0x7f108010c660 2024-02-28T23:22:37.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.076+0000 7f1085e00640 1 -- 172.21.15.159:0/317705322 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108004e040 con 0x7f108010c660 2024-02-28T23:22:37.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.077+0000 7f1084a00640 1 -- 172.21.15.159:0/317705322 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f1068010380 con 0x7f108010c660 2024-02-28T23:22:37.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.078+0000 7f1084a00640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f106406d810 0x7f106406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:37.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.078+0000 7f1084a00640 1 -- 172.21.15.159:0/317705322 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f106808cff0 con 0x7f108010c660 2024-02-28T23:22:37.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.078+0000 7f107ea00640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f106406d810 0x7f106406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:37.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.079+0000 7f107ea00640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f106406d810 0x7f106406fcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1070036040 tx=0x7f1070005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:37.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.083+0000 7f1084a00640 1 -- 172.21.15.159:0/317705322 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1068056660 con 0x7f108010c660 2024-02-28T23:22:37.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.317+0000 7f1085e00640 1 -- 172.21.15.159:0/317705322 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f1080113940 con 0x7f108010c660 2024-02-28T23:22:37.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.319+0000 7f1084a00640 1 -- 172.21.15.159:0/317705322 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v40) v1 ==== 107+0+4053 (secure 0 0 0) 0x7f1068059d20 con 0x7f108010c660 2024-02-28T23:22:37.317 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:37.318 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24269,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2280748719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2280748719},{"type":"v1","addr":"172.21.15.184:6825","nonce":2280748719}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:18:27.005585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi159.azxrct","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.159:6829/455979918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":455979918},{"type":"v1","addr":"172.21.15.159:6829","nonce":455979918}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:37.318 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 21 2024-02-28T23:22:37.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.321+0000 7f1085e00640 1 -- 172.21.15.159:0/317705322 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f106406d810 msgr2=0x7f106406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:37.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.321+0000 7f1085e00640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f106406d810 0x7f106406fcd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1070036040 tx=0x7f1070005fd0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.321+0000 7f1085e00640 1 -- 172.21.15.159:0/317705322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f108010c660 msgr2=0x7f108019ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:37.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.321+0000 7f1085e00640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f108010c660 0x7f108019ca00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f106800b420 tx=0x7f106800b8e0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.322+0000 7f1085e00640 1 -- 172.21.15.159:0/317705322 shutdown_connections 2024-02-28T23:22:37.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.322+0000 7f1085e00640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f106406d810 0x7f106406fcd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.322+0000 7f1085e00640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f108010c660 0x7f108019ca00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.322+0000 7f1085e00640 1 --2- 172.21.15.159:0/317705322 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f10801066a0 0x7f108019c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.322+0000 7f1085e00640 1 -- 172.21.15.159:0/317705322 >> 172.21.15.159:0/317705322 conn(0x7f1080075e80 msgr2=0x7f1080076c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:37.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.322+0000 7f1085e00640 1 -- 172.21.15.159:0/317705322 shutdown_connections 2024-02-28T23:22:37.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.322+0000 7f1085e00640 1 -- 172.21.15.159:0/317705322 wait complete. 2024-02-28T23:22:37.339 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 21 2024-02-28T23:22:37.339 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-02-28T23:22:37.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.559+0000 7fca0c200640 1 -- 172.21.15.159:0/1683981971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca041024d0 msgr2=0x7fca041028b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:37.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.559+0000 7fca0c200640 1 --2- 172.21.15.159:0/1683981971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca041024d0 0x7fca041028b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4009880 tx=0x7fc9f402bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.559+0000 7fca0c200640 1 -- 172.21.15.159:0/1683981971 shutdown_connections 2024-02-28T23:22:37.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.559+0000 7fca0c200640 1 --2- 172.21.15.159:0/1683981971 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca04102e80 0x7fca04106ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.559+0000 7fca0c200640 1 --2- 172.21.15.159:0/1683981971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca041024d0 0x7fca041028b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.559+0000 7fca0c200640 1 -- 172.21.15.159:0/1683981971 >> 172.21.15.159:0/1683981971 conn(0x7fca040fdd10 msgr2=0x7fca04100130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:37.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.559+0000 7fca0c200640 1 -- 172.21.15.159:0/1683981971 shutdown_connections 2024-02-28T23:22:37.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.560+0000 7fca0c200640 1 -- 172.21.15.159:0/1683981971 wait complete. 2024-02-28T23:22:37.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.561+0000 7fca0c200640 1 Processor -- start 2024-02-28T23:22:37.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.561+0000 7fca0c200640 1 -- start start 2024-02-28T23:22:37.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.561+0000 7fca0c200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca041024d0 0x7fca04197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:37.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.561+0000 7fca0c200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca041983a0 0x7fca0419c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:37.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.561+0000 7fca0c200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca04198910 con 0x7fca041983a0 2024-02-28T23:22:37.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.561+0000 7fca0c200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca04198a80 con 0x7fca041024d0 2024-02-28T23:22:37.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.562+0000 7fca08e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca041983a0 0x7fca0419c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:37.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.562+0000 7fca08e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca041983a0 0x7fca0419c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:39120/0 (socket says 172.21.15.159:39120) 2024-02-28T23:22:37.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.562+0000 7fca08e00640 1 -- 172.21.15.159:0/407179199 learned_addr learned my addr 172.21.15.159:0/407179199 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:37.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.562+0000 7fca09800640 1 --2- 172.21.15.159:0/407179199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca041024d0 0x7fca04197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:37.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.562+0000 7fca08e00640 1 -- 172.21.15.159:0/407179199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca041024d0 msgr2=0x7fca04197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:37.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.562+0000 7fca08e00640 1 --2- 172.21.15.159:0/407179199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca041024d0 0x7fca04197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.562+0000 7fca08e00640 1 -- 172.21.15.159:0/407179199 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4009560 con 0x7fca041983a0 2024-02-28T23:22:37.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.562+0000 7fca08e00640 1 --2- 172.21.15.159:0/407179199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca041983a0 0x7fca0419c800 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000cc30 tx=0x7fc9f000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:37.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.563+0000 7fca02000640 1 -- 172.21.15.159:0/407179199 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f000f450 con 0x7fca041983a0 2024-02-28T23:22:37.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.563+0000 7fca02000640 1 -- 172.21.15.159:0/407179199 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fc9f000fa70 con 0x7fca041983a0 2024-02-28T23:22:37.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.563+0000 7fca02000640 1 -- 172.21.15.159:0/407179199 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9f0018b50 con 0x7fca041983a0 2024-02-28T23:22:37.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.563+0000 7fca0c200640 1 -- 172.21.15.159:0/407179199 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca0419cda0 con 0x7fca041983a0 2024-02-28T23:22:37.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.563+0000 7fca0c200640 1 -- 172.21.15.159:0/407179199 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0419d2b0 con 0x7fca041983a0 2024-02-28T23:22:37.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.564+0000 7fca0c200640 1 -- 172.21.15.159:0/407179199 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0404e040 con 0x7fca041983a0 2024-02-28T23:22:37.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.565+0000 7fca02000640 1 -- 172.21.15.159:0/407179199 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fc9f0018cb0 con 0x7fca041983a0 2024-02-28T23:22:37.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.567+0000 7fca02000640 1 --2- 172.21.15.159:0/407179199 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9e806d8d0 0x7fc9e806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:37.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.567+0000 7fca02000640 1 -- 172.21.15.159:0/407179199 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fc9f008daf0 con 0x7fca041983a0 2024-02-28T23:22:37.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.567+0000 7fca09800640 1 --2- 172.21.15.159:0/407179199 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9e806d8d0 0x7fc9e806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:37.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.568+0000 7fca09800640 1 --2- 172.21.15.159:0/407179199 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9e806d8d0 0x7fc9e806fd90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4006010 tx=0x7fc9f4000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:37.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.572+0000 7fca02000640 1 -- 172.21.15.159:0/407179199 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fc9f0057220 con 0x7fca041983a0 2024-02-28T23:22:37.724 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:37 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3414807599' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-28T23:22:37.725 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:37 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/317705322' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-28T23:22:37.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.813+0000 7fca0c200640 1 -- 172.21.15.159:0/407179199 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7fca041991b0 con 0x7fca041983a0 2024-02-28T23:22:37.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.814+0000 7fca02000640 1 -- 172.21.15.159:0/407179199 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v40) v1 ==== 107+0+4869 (secure 0 0 0) 0x7fc9f005a8e0 con 0x7fca041983a0 2024-02-28T23:22:37.813 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:37.813 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24269,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2280748719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2280748719},{"type":"v1","addr":"172.21.15.184:6825","nonce":2280748719}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:18:27.005585+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14472":{"gid":14472,"name":"cephfs.smithi159.azxrct","rank":0,"incarnation":14,"state":"up:active","state_seq":5,"addr":"172.21.15.159:6829/455979918","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":455979918},{"type":"v1","addr":"172.21.15.159:6829","nonce":455979918}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:37.814 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 22 2024-02-28T23:22:37.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.817+0000 7fca0c200640 1 -- 172.21.15.159:0/407179199 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9e806d8d0 msgr2=0x7fc9e806fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:37.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.817+0000 7fca0c200640 1 --2- 172.21.15.159:0/407179199 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9e806d8d0 0x7fc9e806fd90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc9f4006010 tx=0x7fc9f4000bc0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.817+0000 7fca0c200640 1 -- 172.21.15.159:0/407179199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca041983a0 msgr2=0x7fca0419c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:37.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.818+0000 7fca0c200640 1 --2- 172.21.15.159:0/407179199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca041983a0 0x7fca0419c800 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000cc30 tx=0x7fc9f000a620 comp rx=0 tx=0).stop 2024-02-28T23:22:37.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.818+0000 7fca0c200640 1 -- 172.21.15.159:0/407179199 shutdown_connections 2024-02-28T23:22:37.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.818+0000 7fca0c200640 1 --2- 172.21.15.159:0/407179199 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fc9e806d8d0 0x7fc9e806fd90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.818+0000 7fca0c200640 1 --2- 172.21.15.159:0/407179199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fca041983a0 0x7fca0419c800 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.818+0000 7fca0c200640 1 --2- 172.21.15.159:0/407179199 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fca041024d0 0x7fca04197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:37.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.818+0000 7fca0c200640 1 -- 172.21.15.159:0/407179199 >> 172.21.15.159:0/407179199 conn(0x7fca040fdd10 msgr2=0x7fca041000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:37.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.818+0000 7fca0c200640 1 -- 172.21.15.159:0/407179199 shutdown_connections 2024-02-28T23:22:37.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:37.818+0000 7fca0c200640 1 -- 172.21.15.159:0/407179199 wait complete. 2024-02-28T23:22:37.836 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 22 2024-02-28T23:22:37.837 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-02-28T23:22:37.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:37 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3414807599' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-02-28T23:22:37.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:37 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/317705322' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-02-28T23:22:38.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.053+0000 7f38c2c00640 1 -- 172.21.15.159:0/1087379927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc102e50 msgr2=0x7f38bc106e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:38.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.053+0000 7f38c2c00640 1 --2- 172.21.15.159:0/1087379927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc102e50 0x7f38bc106e90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f38a4009c20 tx=0x7f38a402c1b0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.053+0000 7f38c2c00640 1 -- 172.21.15.159:0/1087379927 shutdown_connections 2024-02-28T23:22:38.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.053+0000 7f38c2c00640 1 --2- 172.21.15.159:0/1087379927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc102e50 0x7f38bc106e90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.053+0000 7f38c2c00640 1 --2- 172.21.15.159:0/1087379927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38bc1024a0 0x7f38bc102880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.053+0000 7f38c2c00640 1 -- 172.21.15.159:0/1087379927 >> 172.21.15.159:0/1087379927 conn(0x7f38bc0fdd00 msgr2=0x7f38bc100120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:38.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.053+0000 7f38c2c00640 1 -- 172.21.15.159:0/1087379927 shutdown_connections 2024-02-28T23:22:38.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.053+0000 7f38c2c00640 1 -- 172.21.15.159:0/1087379927 wait complete. 2024-02-28T23:22:38.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.054+0000 7f38c2c00640 1 Processor -- start 2024-02-28T23:22:38.054 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.054+0000 7f38c2c00640 1 -- start start 2024-02-28T23:22:38.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.055+0000 7f38c2c00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38bc1024a0 0x7f38bc197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:38.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.055+0000 7f38c2c00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc1983a0 0x7f38bc19c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:38.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.055+0000 7f38c2c00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc1989a0 con 0x7f38bc1983a0 2024-02-28T23:22:38.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.055+0000 7f38c2c00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc198b10 con 0x7f38bc1024a0 2024-02-28T23:22:38.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.055+0000 7f38bb400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc1983a0 0x7f38bc19c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:38.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.055+0000 7f38bb400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc1983a0 0x7f38bc19c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41582/0 (socket says 172.21.15.159:41582) 2024-02-28T23:22:38.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.055+0000 7f38bb400640 1 -- 172.21.15.159:0/1145024299 learned_addr learned my addr 172.21.15.159:0/1145024299 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:38.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.055+0000 7f38bbe00640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38bc1024a0 0x7f38bc197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:38.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.055+0000 7f38bb400640 1 -- 172.21.15.159:0/1145024299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38bc1024a0 msgr2=0x7f38bc197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:38.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.056+0000 7f38bb400640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38bc1024a0 0x7f38bc197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.056+0000 7f38bb400640 1 -- 172.21.15.159:0/1145024299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a4009900 con 0x7f38bc1983a0 2024-02-28T23:22:38.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.056+0000 7f38bbe00640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38bc1024a0 0x7f38bc197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:22:38.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.056+0000 7f38bb400640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc1983a0 0x7f38bc19c800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f38a402c6f0 tx=0x7f38a4032b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:38.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.056+0000 7f38b8c00640 1 -- 172.21.15.159:0/1145024299 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38a4034820 con 0x7f38bc1983a0 2024-02-28T23:22:38.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.056+0000 7f38b8c00640 1 -- 172.21.15.159:0/1145024299 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f38a4003e30 con 0x7f38bc1983a0 2024-02-28T23:22:38.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.056+0000 7f38b8c00640 1 -- 172.21.15.159:0/1145024299 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38a403f440 con 0x7f38bc1983a0 2024-02-28T23:22:38.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.056+0000 7f38c2c00640 1 -- 172.21.15.159:0/1145024299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38bc19cda0 con 0x7f38bc1983a0 2024-02-28T23:22:38.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.056+0000 7f38c2c00640 1 -- 172.21.15.159:0/1145024299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc19d300 con 0x7f38bc1983a0 2024-02-28T23:22:38.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.057+0000 7f38c2c00640 1 -- 172.21.15.159:0/1145024299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc04e040 con 0x7f38bc1983a0 2024-02-28T23:22:38.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.058+0000 7f38b8c00640 1 -- 172.21.15.159:0/1145024299 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f38a403b040 con 0x7f38bc1983a0 2024-02-28T23:22:38.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.059+0000 7f38b8c00640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f38a006d8d0 0x7f38a006fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:38.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.059+0000 7f38b8c00640 1 -- 172.21.15.159:0/1145024299 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f38a40b03f0 con 0x7f38bc1983a0 2024-02-28T23:22:38.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.059+0000 7f38bbe00640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f38a006d8d0 0x7f38a006fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:38.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.060+0000 7f38bbe00640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f38a006d8d0 0x7f38a006fd90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009b40 tx=0x7f38b4005e50 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:38.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.064+0000 7f38b8c00640 1 -- 172.21.15.159:0/1145024299 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f38a4079a80 con 0x7f38bc1983a0 2024-02-28T23:22:38.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.300+0000 7f38c2c00640 1 -- 172.21.15.159:0/1145024299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f38bc102e50 con 0x7f38bc1983a0 2024-02-28T23:22:38.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.302+0000 7f38b8c00640 1 -- 172.21.15.159:0/1145024299 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v40) v1 ==== 107+0+4081 (secure 0 0 0) 0x7f38a407d140 con 0x7f38bc1983a0 2024-02-28T23:22:38.300 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:38.300 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":17},{"gid":24269,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2280748719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2280748719},{"type":"v1","addr":"172.21.15.184:6825","nonce":2280748719}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:18:59.875896+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:38.301 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 23 2024-02-28T23:22:38.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.304+0000 7f38c2c00640 1 -- 172.21.15.159:0/1145024299 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f38a006d8d0 msgr2=0x7f38a006fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:38.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.304+0000 7f38c2c00640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f38a006d8d0 0x7f38a006fd90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009b40 tx=0x7f38b4005e50 comp rx=0 tx=0).stop 2024-02-28T23:22:38.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.304+0000 7f38c2c00640 1 -- 172.21.15.159:0/1145024299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc1983a0 msgr2=0x7f38bc19c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:38.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.304+0000 7f38c2c00640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc1983a0 0x7f38bc19c800 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f38a402c6f0 tx=0x7f38a4032b60 comp rx=0 tx=0).stop 2024-02-28T23:22:38.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.304+0000 7f38c2c00640 1 -- 172.21.15.159:0/1145024299 shutdown_connections 2024-02-28T23:22:38.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.304+0000 7f38c2c00640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f38a006d8d0 0x7f38a006fd90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.304+0000 7f38c2c00640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f38bc1983a0 0x7f38bc19c800 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.304+0000 7f38c2c00640 1 --2- 172.21.15.159:0/1145024299 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f38bc1024a0 0x7f38bc197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.304+0000 7f38c2c00640 1 -- 172.21.15.159:0/1145024299 >> 172.21.15.159:0/1145024299 conn(0x7f38bc0fdd00 msgr2=0x7f38bc100110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:38.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.305+0000 7f38c2c00640 1 -- 172.21.15.159:0/1145024299 shutdown_connections 2024-02-28T23:22:38.304 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.305+0000 7f38c2c00640 1 -- 172.21.15.159:0/1145024299 wait complete. 2024-02-28T23:22:38.323 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 23 2024-02-28T23:22:38.324 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-02-28T23:22:38.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.532+0000 7f5aa6400640 1 -- 172.21.15.159:0/3386664134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5aa0100c50 msgr2=0x7f5aa0104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:38.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.532+0000 7f5aa6400640 1 --2- 172.21.15.159:0/3386664134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5aa0100c50 0x7f5aa0104c90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c009880 tx=0x7f5a8c02bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.532+0000 7f5aa6400640 1 -- 172.21.15.159:0/3386664134 shutdown_connections 2024-02-28T23:22:38.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.532+0000 7f5aa6400640 1 --2- 172.21.15.159:0/3386664134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5aa0100c50 0x7f5aa0104c90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.532+0000 7f5aa6400640 1 --2- 172.21.15.159:0/3386664134 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa01002a0 0x7f5aa0100680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.532+0000 7f5aa6400640 1 -- 172.21.15.159:0/3386664134 >> 172.21.15.159:0/3386664134 conn(0x7f5aa00fbb20 msgr2=0x7f5aa00fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:38.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.532+0000 7f5aa6400640 1 -- 172.21.15.159:0/3386664134 shutdown_connections 2024-02-28T23:22:38.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.532+0000 7f5aa6400640 1 -- 172.21.15.159:0/3386664134 wait complete. 2024-02-28T23:22:38.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.533+0000 7f5aa6400640 1 Processor -- start 2024-02-28T23:22:38.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.533+0000 7f5aa6400640 1 -- start start 2024-02-28T23:22:38.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.533+0000 7f5aa6400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5aa01002a0 0x7f5aa00725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:38.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.533+0000 7f5aa6400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa0072ae0 0x7f5aa0072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:38.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.533+0000 7f5aa6400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa01a1f40 con 0x7f5aa01002a0 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.533+0000 7f5aa6400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa01a2080 con 0x7f5aa0072ae0 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.533+0000 7f5a9f400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5aa01002a0 0x7f5aa00725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.533+0000 7f5a9f400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5aa01002a0 0x7f5aa00725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41604/0 (socket says 172.21.15.159:41604) 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.533+0000 7f5a9f400640 1 -- 172.21.15.159:0/3968970548 learned_addr learned my addr 172.21.15.159:0/3968970548 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.534+0000 7f5a9f400640 1 -- 172.21.15.159:0/3968970548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa0072ae0 msgr2=0x7f5aa0072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.534+0000 7f5a9f400640 1 --2- 172.21.15.159:0/3968970548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa0072ae0 0x7f5aa0072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.534+0000 7f5a9f400640 1 -- 172.21.15.159:0/3968970548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c009560 con 0x7f5aa01002a0 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.534+0000 7f5a9f400640 1 --2- 172.21.15.159:0/3968970548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5aa01002a0 0x7f5aa00725a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5a9000d720 tx=0x7f5a9000dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.534+0000 7f5a97e00640 1 -- 172.21.15.159:0/3968970548 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a900051f0 con 0x7f5aa01002a0 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.534+0000 7f5a97e00640 1 -- 172.21.15.159:0/3968970548 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5a90009ce0 con 0x7f5aa01002a0 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.534+0000 7f5aa6400640 1 -- 172.21.15.159:0/3968970548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa01a21c0 con 0x7f5aa01002a0 2024-02-28T23:22:38.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.534+0000 7f5a97e00640 1 -- 172.21.15.159:0/3968970548 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a90010460 con 0x7f5aa01002a0 2024-02-28T23:22:38.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.534+0000 7f5aa6400640 1 -- 172.21.15.159:0/3968970548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa01a2720 con 0x7f5aa01002a0 2024-02-28T23:22:38.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.536+0000 7f5aa6400640 1 -- 172.21.15.159:0/3968970548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5aa004e040 con 0x7f5aa01002a0 2024-02-28T23:22:38.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.537+0000 7f5a97e00640 1 -- 172.21.15.159:0/3968970548 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f5a90005350 con 0x7f5aa01002a0 2024-02-28T23:22:38.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.537+0000 7f5a97e00640 1 --2- 172.21.15.159:0/3968970548 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5a8406d810 0x7f5a8406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:38.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.538+0000 7f5a97e00640 1 -- 172.21.15.159:0/3968970548 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f5a9008d1f0 con 0x7f5aa01002a0 2024-02-28T23:22:38.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.538+0000 7f5a9ea00640 1 --2- 172.21.15.159:0/3968970548 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5a8406d810 0x7f5a8406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:38.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.538+0000 7f5a9ea00640 1 --2- 172.21.15.159:0/3968970548 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5a8406d810 0x7f5a8406fcd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c02efd0 tx=0x7f5a8c000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:38.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.542+0000 7f5a97e00640 1 -- 172.21.15.159:0/3968970548 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5a90056880 con 0x7f5aa01002a0 2024-02-28T23:22:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:38 smithi159 ceph-mon[113833]: pgmap v348: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:38 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/407179199' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-28T23:22:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:22:38.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:38 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1145024299' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-28T23:22:38.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.775+0000 7f5aa6400640 1 -- 172.21.15.159:0/3968970548 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7f5aa01085a0 con 0x7f5aa01002a0 2024-02-28T23:22:38.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.776+0000 7f5a97e00640 1 -- 172.21.15.159:0/3968970548 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v40) v1 ==== 107+0+4092 (secure 0 0 0) 0x7f5a90059f40 con 0x7f5aa01002a0 2024-02-28T23:22:38.775 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:38.775 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2280748719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2280748719},{"type":"v1","addr":"172.21.15.184:6825","nonce":2280748719}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:18:59.887310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24265":{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":0,"incarnation":24,"state":"up:replay","state_seq":2,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:38.775 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-02-28T23:22:38.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.779+0000 7f5aa6400640 1 -- 172.21.15.159:0/3968970548 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5a8406d810 msgr2=0x7f5a8406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:38.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.779+0000 7f5aa6400640 1 --2- 172.21.15.159:0/3968970548 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5a8406d810 0x7f5a8406fcd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c02efd0 tx=0x7f5a8c000bc0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.779+0000 7f5aa6400640 1 -- 172.21.15.159:0/3968970548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5aa01002a0 msgr2=0x7f5aa00725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:38.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.779+0000 7f5aa6400640 1 --2- 172.21.15.159:0/3968970548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5aa01002a0 0x7f5aa00725a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f5a9000d720 tx=0x7f5a9000dbe0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.780+0000 7f5aa6400640 1 -- 172.21.15.159:0/3968970548 shutdown_connections 2024-02-28T23:22:38.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.780+0000 7f5aa6400640 1 --2- 172.21.15.159:0/3968970548 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f5a8406d810 0x7f5a8406fcd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.780+0000 7f5aa6400640 1 --2- 172.21.15.159:0/3968970548 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5aa0072ae0 0x7f5aa0072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.780+0000 7f5aa6400640 1 --2- 172.21.15.159:0/3968970548 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5aa01002a0 0x7f5aa00725a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:38.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.780+0000 7f5aa6400640 1 -- 172.21.15.159:0/3968970548 >> 172.21.15.159:0/3968970548 conn(0x7f5aa00fbb20 msgr2=0x7f5aa00fd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:38.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.780+0000 7f5aa6400640 1 -- 172.21.15.159:0/3968970548 shutdown_connections 2024-02-28T23:22:38.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:38.780+0000 7f5aa6400640 1 -- 172.21.15.159:0/3968970548 wait complete. 2024-02-28T23:22:38.794 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-02-28T23:22:38.794 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-02-28T23:22:38.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:38 smithi184 ceph-mon[86482]: pgmap v348: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:38.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:38 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/407179199' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-02-28T23:22:38.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:22:38.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:38 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1145024299' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-02-28T23:22:39.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.002+0000 7fcfed400640 1 -- 172.21.15.159:0/2879916602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80ff8e0 msgr2=0x7fcfe8103da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:39.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.002+0000 7fcfed400640 1 --2- 172.21.15.159:0/2879916602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80ff8e0 0x7fcfe8103da0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4009c20 tx=0x7fcfd402c230 comp rx=0 tx=0).stop 2024-02-28T23:22:39.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.002+0000 7fcfed400640 1 -- 172.21.15.159:0/2879916602 shutdown_connections 2024-02-28T23:22:39.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.002+0000 7fcfed400640 1 --2- 172.21.15.159:0/2879916602 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80ff8e0 0x7fcfe8103da0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.002+0000 7fcfed400640 1 --2- 172.21.15.159:0/2879916602 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfe80fefc0 0x7fcfe80ff3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.002+0000 7fcfed400640 1 -- 172.21.15.159:0/2879916602 >> 172.21.15.159:0/2879916602 conn(0x7fcfe80fa9f0 msgr2=0x7fcfe80fce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:39.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.002+0000 7fcfed400640 1 -- 172.21.15.159:0/2879916602 shutdown_connections 2024-02-28T23:22:39.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.002+0000 7fcfed400640 1 -- 172.21.15.159:0/2879916602 wait complete. 2024-02-28T23:22:39.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.003+0000 7fcfed400640 1 Processor -- start 2024-02-28T23:22:39.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.004+0000 7fcfed400640 1 -- start start 2024-02-28T23:22:39.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.004+0000 7fcfed400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80fefc0 0x7fcfe819c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:39.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.004+0000 7fcfed400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfe80ff8e0 0x7fcfe819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:39.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.004+0000 7fcfed400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe819ceb0 con 0x7fcfe80fefc0 2024-02-28T23:22:39.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.004+0000 7fcfed400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81a0c80 con 0x7fcfe80ff8e0 2024-02-28T23:22:39.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.004+0000 7fcfe6800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80fefc0 0x7fcfe819c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:39.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.004+0000 7fcfe6800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80fefc0 0x7fcfe819c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41620/0 (socket says 172.21.15.159:41620) 2024-02-28T23:22:39.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.004+0000 7fcfe6800640 1 -- 172.21.15.159:0/3087704893 learned_addr learned my addr 172.21.15.159:0/3087704893 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:39.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.005+0000 7fcfe6800640 1 -- 172.21.15.159:0/3087704893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfe80ff8e0 msgr2=0x7fcfe819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:39.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.005+0000 7fcfe6800640 1 --2- 172.21.15.159:0/3087704893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfe80ff8e0 0x7fcfe819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.005+0000 7fcfe6800640 1 -- 172.21.15.159:0/3087704893 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd4009900 con 0x7fcfe80fefc0 2024-02-28T23:22:39.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.005+0000 7fcfe6800640 1 --2- 172.21.15.159:0/3087704893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80fefc0 0x7fcfe819c2e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800d8d0 tx=0x7fcfd800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:39.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.005+0000 7fcfdf400640 1 -- 172.21.15.159:0/3087704893 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd800bea0 con 0x7fcfe80fefc0 2024-02-28T23:22:39.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.005+0000 7fcfdf400640 1 -- 172.21.15.159:0/3087704893 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fcfd8009c00 con 0x7fcfe80fefc0 2024-02-28T23:22:39.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.005+0000 7fcfed400640 1 -- 172.21.15.159:0/3087704893 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe81a0f60 con 0x7fcfe80fefc0 2024-02-28T23:22:39.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.006+0000 7fcfdf400640 1 -- 172.21.15.159:0/3087704893 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcfd800f710 con 0x7fcfe80fefc0 2024-02-28T23:22:39.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.006+0000 7fcfed400640 1 -- 172.21.15.159:0/3087704893 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe81a14c0 con 0x7fcfe80fefc0 2024-02-28T23:22:39.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.007+0000 7fcfed400640 1 -- 172.21.15.159:0/3087704893 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe804e040 con 0x7fcfe80fefc0 2024-02-28T23:22:39.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.008+0000 7fcfdf400640 1 -- 172.21.15.159:0/3087704893 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fcfd800f990 con 0x7fcfe80fefc0 2024-02-28T23:22:39.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.009+0000 7fcfdf400640 1 --2- 172.21.15.159:0/3087704893 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcfcc06d810 0x7fcfcc06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:39.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.009+0000 7fcfdf400640 1 -- 172.21.15.159:0/3087704893 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fcfd808d380 con 0x7fcfe80fefc0 2024-02-28T23:22:39.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.009+0000 7fcfe5e00640 1 --2- 172.21.15.159:0/3087704893 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcfcc06d810 0x7fcfcc06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:39.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.010+0000 7fcfe5e00640 1 --2- 172.21.15.159:0/3087704893 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcfcc06d810 0x7fcfcc06fcd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4006010 tx=0x7fcfd4009360 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:39.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.014+0000 7fcfdf400640 1 -- 172.21.15.159:0/3087704893 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fcfd8056a30 con 0x7fcfe80fefc0 2024-02-28T23:22:39.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.254+0000 7fcfed400640 1 -- 172.21.15.159:0/3087704893 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7fcfe8101470 con 0x7fcfe80fefc0 2024-02-28T23:22:39.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.255+0000 7fcfdf400640 1 -- 172.21.15.159:0/3087704893 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v40) v1 ==== 107+0+4097 (secure 0 0 0) 0x7fcfd805a0f0 con 0x7fcfe80fefc0 2024-02-28T23:22:39.253 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:39.253 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2280748719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2280748719},{"type":"v1","addr":"172.21.15.184:6825","nonce":2280748719}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:19:08.288910+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24265":{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":0,"incarnation":24,"state":"up:reconnect","state_seq":233,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:39.254 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 25 2024-02-28T23:22:39.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.258+0000 7fcfed400640 1 -- 172.21.15.159:0/3087704893 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcfcc06d810 msgr2=0x7fcfcc06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:39.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.258+0000 7fcfed400640 1 --2- 172.21.15.159:0/3087704893 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcfcc06d810 0x7fcfcc06fcd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fcfd4006010 tx=0x7fcfd4009360 comp rx=0 tx=0).stop 2024-02-28T23:22:39.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.258+0000 7fcfed400640 1 -- 172.21.15.159:0/3087704893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80fefc0 msgr2=0x7fcfe819c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:39.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.258+0000 7fcfed400640 1 --2- 172.21.15.159:0/3087704893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80fefc0 0x7fcfe819c2e0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800d8d0 tx=0x7fcfd800dd90 comp rx=0 tx=0).stop 2024-02-28T23:22:39.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.258+0000 7fcfed400640 1 -- 172.21.15.159:0/3087704893 shutdown_connections 2024-02-28T23:22:39.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.258+0000 7fcfed400640 1 --2- 172.21.15.159:0/3087704893 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fcfcc06d810 0x7fcfcc06fcd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.258+0000 7fcfed400640 1 --2- 172.21.15.159:0/3087704893 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fcfe80ff8e0 0x7fcfe819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.258+0000 7fcfed400640 1 --2- 172.21.15.159:0/3087704893 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcfe80fefc0 0x7fcfe819c2e0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.258+0000 7fcfed400640 1 -- 172.21.15.159:0/3087704893 >> 172.21.15.159:0/3087704893 conn(0x7fcfe80fa9f0 msgr2=0x7fcfe8110420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:39.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.258+0000 7fcfed400640 1 -- 172.21.15.159:0/3087704893 shutdown_connections 2024-02-28T23:22:39.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.258+0000 7fcfed400640 1 -- 172.21.15.159:0/3087704893 wait complete. 2024-02-28T23:22:39.275 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-02-28T23:22:39.275 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-02-28T23:22:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:39 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3968970548' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-28T23:22:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:39 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3087704893' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-28T23:22:39.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:39 smithi159 ceph-mon[113833]: pgmap v349: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:39.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.484+0000 7f20f1800640 1 -- 172.21.15.159:0/2634271245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec10c660 msgr2=0x7f20ec10ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:39.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.484+0000 7f20f1800640 1 --2- 172.21.15.159:0/2634271245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec10c660 0x7f20ec10ca40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f20dc009880 tx=0x7f20dc02bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.485+0000 7f20f1800640 1 -- 172.21.15.159:0/2634271245 shutdown_connections 2024-02-28T23:22:39.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.485+0000 7f20f1800640 1 --2- 172.21.15.159:0/2634271245 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec1066a0 0x7f20ec106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.485+0000 7f20f1800640 1 --2- 172.21.15.159:0/2634271245 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec10c660 0x7f20ec10ca40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.485+0000 7f20f1800640 1 -- 172.21.15.159:0/2634271245 >> 172.21.15.159:0/2634271245 conn(0x7f20ec075e80 msgr2=0x7f20ec0782a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:39.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.485+0000 7f20f1800640 1 -- 172.21.15.159:0/2634271245 shutdown_connections 2024-02-28T23:22:39.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.485+0000 7f20f1800640 1 -- 172.21.15.159:0/2634271245 wait complete. 2024-02-28T23:22:39.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.486+0000 7f20f1800640 1 Processor -- start 2024-02-28T23:22:39.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.486+0000 7f20f1800640 1 -- start start 2024-02-28T23:22:39.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.486+0000 7f20f1800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec1066a0 0x7f20ec19c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:39.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.486+0000 7f20f1800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec10c660 0x7f20ec19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:39.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.486+0000 7f20f1800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec19cf70 con 0x7f20ec1066a0 2024-02-28T23:22:39.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.486+0000 7f20f1800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ec1a0d40 con 0x7f20ec10c660 2024-02-28T23:22:39.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.486+0000 7f20eaa00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec1066a0 0x7f20ec19c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:39.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.487+0000 7f20eaa00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec1066a0 0x7f20ec19c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41638/0 (socket says 172.21.15.159:41638) 2024-02-28T23:22:39.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.487+0000 7f20eaa00640 1 -- 172.21.15.159:0/3303042587 learned_addr learned my addr 172.21.15.159:0/3303042587 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:39.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.487+0000 7f20eaa00640 1 -- 172.21.15.159:0/3303042587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec10c660 msgr2=0x7f20ec19c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:39.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.487+0000 7f20ea000640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec10c660 0x7f20ec19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:39.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.487+0000 7f20eaa00640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec10c660 0x7f20ec19c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.487+0000 7f20eaa00640 1 -- 172.21.15.159:0/3303042587 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20dc009560 con 0x7f20ec1066a0 2024-02-28T23:22:39.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.487+0000 7f20ea000640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec10c660 0x7f20ec19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:22:39.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.487+0000 7f20eaa00640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec1066a0 0x7f20ec19c3a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f20dc000c00 tx=0x7f20dc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:39.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.488+0000 7f20e3400640 1 -- 172.21.15.159:0/3303042587 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20dc0037c0 con 0x7f20ec1066a0 2024-02-28T23:22:39.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.488+0000 7f20e3400640 1 -- 172.21.15.159:0/3303042587 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f20dc003de0 con 0x7f20ec1066a0 2024-02-28T23:22:39.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.488+0000 7f20e3400640 1 -- 172.21.15.159:0/3303042587 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20dc034460 con 0x7f20ec1066a0 2024-02-28T23:22:39.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.488+0000 7f20f1800640 1 -- 172.21.15.159:0/3303042587 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ec1a0fc0 con 0x7f20ec1066a0 2024-02-28T23:22:39.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.488+0000 7f20f1800640 1 -- 172.21.15.159:0/3303042587 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ec1a14c0 con 0x7f20ec1066a0 2024-02-28T23:22:39.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.489+0000 7f20f1800640 1 -- 172.21.15.159:0/3303042587 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ec04e040 con 0x7f20ec1066a0 2024-02-28T23:22:39.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.490+0000 7f20e3400640 1 -- 172.21.15.159:0/3303042587 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f20dc003920 con 0x7f20ec1066a0 2024-02-28T23:22:39.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.491+0000 7f20e3400640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f20d006d810 0x7f20d006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:39.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.491+0000 7f20e3400640 1 -- 172.21.15.159:0/3303042587 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f20dc0afb50 con 0x7f20ec1066a0 2024-02-28T23:22:39.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.491+0000 7f20ea000640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f20d006d810 0x7f20d006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:39.490 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.492+0000 7f20ea000640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f20d006d810 0x7f20d006fcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f20ec19d9b0 tx=0x7f20d8005d30 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:39.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.495+0000 7f20e3400640 1 -- 172.21.15.159:0/3303042587 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f20dc0792c0 con 0x7f20ec1066a0 2024-02-28T23:22:39.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.730+0000 7f20f1800640 1 -- 172.21.15.159:0/3303042587 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f20ec10ebc0 con 0x7f20ec1066a0 2024-02-28T23:22:39.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.731+0000 7f20e3400640 1 -- 172.21.15.159:0/3303042587 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v40) v1 ==== 107+0+4094 (secure 0 0 0) 0x7f20dc07c980 con 0x7f20ec1066a0 2024-02-28T23:22:39.729 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:39.729 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2280748719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2280748719},{"type":"v1","addr":"172.21.15.184:6825","nonce":2280748719}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:19:09.294904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24265":{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":0,"incarnation":24,"state":"up:rejoin","state_seq":234,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:39.729 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 26 2024-02-28T23:22:39.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.733+0000 7f20f1800640 1 -- 172.21.15.159:0/3303042587 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f20d006d810 msgr2=0x7f20d006fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:39.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.733+0000 7f20f1800640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f20d006d810 0x7f20d006fcd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f20ec19d9b0 tx=0x7f20d8005d30 comp rx=0 tx=0).stop 2024-02-28T23:22:39.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.734+0000 7f20f1800640 1 -- 172.21.15.159:0/3303042587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec1066a0 msgr2=0x7f20ec19c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:39.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.734+0000 7f20f1800640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec1066a0 0x7f20ec19c3a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f20dc000c00 tx=0x7f20dc004270 comp rx=0 tx=0).stop 2024-02-28T23:22:39.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.734+0000 7f20f1800640 1 -- 172.21.15.159:0/3303042587 shutdown_connections 2024-02-28T23:22:39.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.734+0000 7f20f1800640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f20d006d810 0x7f20d006fcd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.734+0000 7f20f1800640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f20ec10c660 0x7f20ec19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.734+0000 7f20f1800640 1 --2- 172.21.15.159:0/3303042587 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f20ec1066a0 0x7f20ec19c3a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.734+0000 7f20f1800640 1 -- 172.21.15.159:0/3303042587 >> 172.21.15.159:0/3303042587 conn(0x7f20ec075e80 msgr2=0x7f20ec076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:39.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.734+0000 7f20f1800640 1 -- 172.21.15.159:0/3303042587 shutdown_connections 2024-02-28T23:22:39.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.734+0000 7f20f1800640 1 -- 172.21.15.159:0/3303042587 wait complete. 2024-02-28T23:22:39.751 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-02-28T23:22:39.751 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-02-28T23:22:39.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:39 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3968970548' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-02-28T23:22:39.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:39 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3087704893' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-02-28T23:22:39.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:39 smithi184 ceph-mon[86482]: pgmap v349: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:39.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.962+0000 7ff957400640 1 -- 172.21.15.159:0/2622264563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff950067350 msgr2=0x7ff9500677b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:39.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.962+0000 7ff957400640 1 --2- 172.21.15.159:0/2622264563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff950067350 0x7ff9500677b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7ff944009880 tx=0x7ff94402bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.962+0000 7ff957400640 1 -- 172.21.15.159:0/2622264563 shutdown_connections 2024-02-28T23:22:39.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.962+0000 7ff957400640 1 --2- 172.21.15.159:0/2622264563 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff950067350 0x7ff9500677b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.962+0000 7ff957400640 1 --2- 172.21.15.159:0/2622264563 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9501061b0 0x7ff950106590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.962+0000 7ff957400640 1 -- 172.21.15.159:0/2622264563 >> 172.21.15.159:0/2622264563 conn(0x7ff950075b40 msgr2=0x7ff950075f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:39.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.962+0000 7ff957400640 1 -- 172.21.15.159:0/2622264563 shutdown_connections 2024-02-28T23:22:39.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.962+0000 7ff957400640 1 -- 172.21.15.159:0/2622264563 wait complete. 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.963+0000 7ff957400640 1 Processor -- start 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.963+0000 7ff957400640 1 -- start start 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.963+0000 7ff957400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff950067350 0x7ff950197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.963+0000 7ff957400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9501061b0 0x7ff9501983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.963+0000 7ff957400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff950198a70 con 0x7ff950067350 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.963+0000 7ff957400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff95019c840 con 0x7ff9501061b0 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.963+0000 7ff954a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff950067350 0x7ff950197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.964+0000 7ff954a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff950067350 0x7ff950197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41658/0 (socket says 172.21.15.159:41658) 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.964+0000 7ff954a00640 1 -- 172.21.15.159:0/3735369656 learned_addr learned my addr 172.21.15.159:0/3735369656 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.964+0000 7ff94fe00640 1 --2- 172.21.15.159:0/3735369656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9501061b0 0x7ff9501983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.964+0000 7ff954a00640 1 -- 172.21.15.159:0/3735369656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9501061b0 msgr2=0x7ff9501983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:39.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.964+0000 7ff954a00640 1 --2- 172.21.15.159:0/3735369656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9501061b0 0x7ff9501983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:39.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.964+0000 7ff954a00640 1 -- 172.21.15.159:0/3735369656 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff944009560 con 0x7ff950067350 2024-02-28T23:22:39.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.964+0000 7ff954a00640 1 --2- 172.21.15.159:0/3735369656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff950067350 0x7ff950197ea0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff94000c8f0 tx=0x7ff94000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:39.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.964+0000 7ff94d600640 1 -- 172.21.15.159:0/3735369656 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff940007b80 con 0x7ff950067350 2024-02-28T23:22:39.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.965+0000 7ff957400640 1 -- 172.21.15.159:0/3735369656 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff95019cb20 con 0x7ff950067350 2024-02-28T23:22:39.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.965+0000 7ff94d600640 1 -- 172.21.15.159:0/3735369656 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7ff9400054e0 con 0x7ff950067350 2024-02-28T23:22:39.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.965+0000 7ff94d600640 1 -- 172.21.15.159:0/3735369656 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff94000f450 con 0x7ff950067350 2024-02-28T23:22:39.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.965+0000 7ff957400640 1 -- 172.21.15.159:0/3735369656 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff95019d080 con 0x7ff950067350 2024-02-28T23:22:39.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.966+0000 7ff957400640 1 -- 172.21.15.159:0/3735369656 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff95004e040 con 0x7ff950067350 2024-02-28T23:22:39.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.967+0000 7ff94d600640 1 -- 172.21.15.159:0/3735369656 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7ff940004f00 con 0x7ff950067350 2024-02-28T23:22:39.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.968+0000 7ff94d600640 1 --2- 172.21.15.159:0/3735369656 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff93806d8d0 0x7ff93806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:39.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.968+0000 7ff94d600640 1 -- 172.21.15.159:0/3735369656 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7ff94008d7e0 con 0x7ff950067350 2024-02-28T23:22:39.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.968+0000 7ff94fe00640 1 --2- 172.21.15.159:0/3735369656 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff93806d8d0 0x7ff93806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:39.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.969+0000 7ff94fe00640 1 --2- 172.21.15.159:0/3735369656 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff93806d8d0 0x7ff93806fd90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff944036040 tx=0x7ff944005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:39.971 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:39.973+0000 7ff94d600640 1 -- 172.21.15.159:0/3735369656 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7ff940056e90 con 0x7ff950067350 2024-02-28T23:22:40.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.212+0000 7ff957400640 1 -- 172.21.15.159:0/3735369656 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7ff95010d440 con 0x7ff950067350 2024-02-28T23:22:40.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.213+0000 7ff94d600640 1 -- 172.21.15.159:0/3735369656 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v40) v1 ==== 107+0+4094 (secure 0 0 0) 0x7ff94005a550 con 0x7ff950067350 2024-02-28T23:22:40.211 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:40.211 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2280748719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2280748719},{"type":"v1","addr":"172.21.15.184:6825","nonce":2280748719}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:19:10.445722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24265":{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":0,"incarnation":24,"state":"up:active","state_seq":235,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:40.212 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 27 2024-02-28T23:22:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.215+0000 7ff957400640 1 -- 172.21.15.159:0/3735369656 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff93806d8d0 msgr2=0x7ff93806fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.215+0000 7ff957400640 1 --2- 172.21.15.159:0/3735369656 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff93806d8d0 0x7ff93806fd90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff944036040 tx=0x7ff944005fd0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.215+0000 7ff957400640 1 -- 172.21.15.159:0/3735369656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff950067350 msgr2=0x7ff950197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.215+0000 7ff957400640 1 --2- 172.21.15.159:0/3735369656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff950067350 0x7ff950197ea0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7ff94000c8f0 tx=0x7ff94000cdb0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.215+0000 7ff957400640 1 -- 172.21.15.159:0/3735369656 shutdown_connections 2024-02-28T23:22:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.215+0000 7ff957400640 1 --2- 172.21.15.159:0/3735369656 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7ff93806d8d0 0x7ff93806fd90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.215+0000 7ff957400640 1 --2- 172.21.15.159:0/3735369656 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7ff9501061b0 0x7ff9501983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.215+0000 7ff957400640 1 --2- 172.21.15.159:0/3735369656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff950067350 0x7ff950197ea0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.215+0000 7ff957400640 1 -- 172.21.15.159:0/3735369656 >> 172.21.15.159:0/3735369656 conn(0x7ff950075b40 msgr2=0x7ff9500fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.216+0000 7ff957400640 1 -- 172.21.15.159:0/3735369656 shutdown_connections 2024-02-28T23:22:40.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.216+0000 7ff957400640 1 -- 172.21.15.159:0/3735369656 wait complete. 2024-02-28T23:22:40.231 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-02-28T23:22:40.232 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-02-28T23:22:40.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.442+0000 7f571b200640 1 -- 172.21.15.159:0/191179307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57141024c0 msgr2=0x7f57141028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:40.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.442+0000 7f571b200640 1 --2- 172.21.15.159:0/191179307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57141024c0 0x7f57141028a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5704009c20 tx=0x7f570402c1b0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.443+0000 7f571b200640 1 -- 172.21.15.159:0/191179307 shutdown_connections 2024-02-28T23:22:40.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.443+0000 7f571b200640 1 --2- 172.21.15.159:0/191179307 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f5714102e70 0x7f5714106eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.443+0000 7f571b200640 1 --2- 172.21.15.159:0/191179307 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57141024c0 0x7f57141028a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.443+0000 7f571b200640 1 -- 172.21.15.159:0/191179307 >> 172.21.15.159:0/191179307 conn(0x7f57140fdd40 msgr2=0x7f5714100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:40.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.443+0000 7f571b200640 1 -- 172.21.15.159:0/191179307 shutdown_connections 2024-02-28T23:22:40.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.443+0000 7f571b200640 1 -- 172.21.15.159:0/191179307 wait complete. 2024-02-28T23:22:40.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.444+0000 7f571b200640 1 Processor -- start 2024-02-28T23:22:40.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.444+0000 7f571b200640 1 -- start start 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.444+0000 7f571b200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57141024c0 0x7f5714198050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.444+0000 7f571b200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5714198590 0x7f571419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.444+0000 7f571b200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5714198b90 con 0x7f5714198590 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.444+0000 7f571b200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5714198d00 con 0x7f57141024c0 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.444+0000 7f5713400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5714198590 0x7f571419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.444+0000 7f5713400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5714198590 0x7f571419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41678/0 (socket says 172.21.15.159:41678) 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.444+0000 7f5713400640 1 -- 172.21.15.159:0/2233144595 learned_addr learned my addr 172.21.15.159:0/2233144595 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.445+0000 7f5713400640 1 -- 172.21.15.159:0/2233144595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57141024c0 msgr2=0x7f5714198050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.445+0000 7f5713400640 1 --2- 172.21.15.159:0/2233144595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57141024c0 0x7f5714198050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.445+0000 7f5713400640 1 -- 172.21.15.159:0/2233144595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704009900 con 0x7f5714198590 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.445+0000 7f5713400640 1 --2- 172.21.15.159:0/2233144595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5714198590 0x7f571419c9f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f56fc00d6f0 tx=0x7f56fc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:40.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.445+0000 7f5710c00640 1 -- 172.21.15.159:0/2233144595 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56fc0051f0 con 0x7f5714198590 2024-02-28T23:22:40.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.445+0000 7f5710c00640 1 -- 172.21.15.159:0/2233144595 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f56fc009ce0 con 0x7f5714198590 2024-02-28T23:22:40.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.445+0000 7f5710c00640 1 -- 172.21.15.159:0/2233144595 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56fc004e80 con 0x7f5714198590 2024-02-28T23:22:40.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.445+0000 7f571b200640 1 -- 172.21.15.159:0/2233144595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f571419cff0 con 0x7f5714198590 2024-02-28T23:22:40.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.445+0000 7f571b200640 1 -- 172.21.15.159:0/2233144595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f571419d550 con 0x7f5714198590 2024-02-28T23:22:40.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.447+0000 7f571b200640 1 -- 172.21.15.159:0/2233144595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571419d820 con 0x7f5714198590 2024-02-28T23:22:40.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.448+0000 7f5710c00640 1 -- 172.21.15.159:0/2233144595 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f56fc0046c0 con 0x7f5714198590 2024-02-28T23:22:40.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.448+0000 7f5710c00640 1 --2- 172.21.15.159:0/2233144595 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f56f806d7c0 0x7f56f806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:40.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.449+0000 7f5710c00640 1 -- 172.21.15.159:0/2233144595 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f56fc08d0c0 con 0x7f5714198590 2024-02-28T23:22:40.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.449+0000 7f5713e00640 1 --2- 172.21.15.159:0/2233144595 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f56f806d7c0 0x7f56f806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:40.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.449+0000 7f5713e00640 1 --2- 172.21.15.159:0/2233144595 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f56f806d7c0 0x7f56f806fc80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5704006010 tx=0x7f5704004a40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:40.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.453+0000 7f5710c00640 1 -- 172.21.15.159:0/2233144595 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f56fc056770 con 0x7f5714198590 2024-02-28T23:22:40.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.686+0000 7f571b200640 1 -- 172.21.15.159:0/2233144595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f57141993a0 con 0x7f5714198590 2024-02-28T23:22:40.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.687+0000 7f5710c00640 1 -- 172.21.15.159:0/2233144595 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v40) v1 ==== 107+0+4910 (secure 0 0 0) 0x7f56fc059e30 con 0x7f5714198590 2024-02-28T23:22:40.686 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:40.686 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24269,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2280748719","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2280748719},{"type":"v1","addr":"172.21.15.184:6825","nonce":2280748719}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15},{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:19:10.445722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24265":{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":0,"incarnation":24,"state":"up:active","state_seq":235,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:40.686 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 28 2024-02-28T23:22:40.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.690+0000 7f571b200640 1 -- 172.21.15.159:0/2233144595 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f56f806d7c0 msgr2=0x7f56f806fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:40.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.690+0000 7f571b200640 1 --2- 172.21.15.159:0/2233144595 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f56f806d7c0 0x7f56f806fc80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5704006010 tx=0x7f5704004a40 comp rx=0 tx=0).stop 2024-02-28T23:22:40.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.690+0000 7f571b200640 1 -- 172.21.15.159:0/2233144595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5714198590 msgr2=0x7f571419c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:40.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.690+0000 7f571b200640 1 --2- 172.21.15.159:0/2233144595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5714198590 0x7f571419c9f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f56fc00d6f0 tx=0x7f56fc00dbb0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.690+0000 7f571b200640 1 -- 172.21.15.159:0/2233144595 shutdown_connections 2024-02-28T23:22:40.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.690+0000 7f571b200640 1 --2- 172.21.15.159:0/2233144595 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f56f806d7c0 0x7f56f806fc80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.690+0000 7f571b200640 1 --2- 172.21.15.159:0/2233144595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5714198590 0x7f571419c9f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.690+0000 7f571b200640 1 --2- 172.21.15.159:0/2233144595 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f57141024c0 0x7f5714198050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.690+0000 7f571b200640 1 -- 172.21.15.159:0/2233144595 >> 172.21.15.159:0/2233144595 conn(0x7f57140fdd40 msgr2=0x7f57140ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:40.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.690+0000 7f571b200640 1 -- 172.21.15.159:0/2233144595 shutdown_connections 2024-02-28T23:22:40.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.690+0000 7f571b200640 1 -- 172.21.15.159:0/2233144595 wait complete. 2024-02-28T23:22:40.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:40 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3303042587' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-28T23:22:40.703 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:40 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3735369656' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-28T23:22:40.708 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-02-28T23:22:40.708 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-02-28T23:22:40.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:40 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3303042587' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-02-28T23:22:40.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:40 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3735369656' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-02-28T23:22:40.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.910+0000 7f57a2400640 1 -- 172.21.15.159:0/1172593638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f579c0fedc0 msgr2=0x7f579c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:40.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.910+0000 7f57a2400640 1 --2- 172.21.15.159:0/1172593638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f579c0fedc0 0x7f579c102e90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f5784009880 tx=0x7f578402bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.910+0000 7f57a2400640 1 -- 172.21.15.159:0/1172593638 shutdown_connections 2024-02-28T23:22:40.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.910+0000 7f57a2400640 1 --2- 172.21.15.159:0/1172593638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f579c0fedc0 0x7f579c102e90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.910+0000 7f57a2400640 1 --2- 172.21.15.159:0/1172593638 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c0fe4a0 0x7f579c0fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.910+0000 7f57a2400640 1 -- 172.21.15.159:0/1172593638 >> 172.21.15.159:0/1172593638 conn(0x7f579c0f9d00 msgr2=0x7f579c0fc120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:40.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.910+0000 7f57a2400640 1 -- 172.21.15.159:0/1172593638 shutdown_connections 2024-02-28T23:22:40.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.910+0000 7f57a2400640 1 -- 172.21.15.159:0/1172593638 wait complete. 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.911+0000 7f57a2400640 1 Processor -- start 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.912+0000 7f57a2400640 1 -- start start 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.912+0000 7f57a2400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c0fe4a0 0x7f579c197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.912+0000 7f57a2400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f579c0fedc0 0x7f579c1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.912+0000 7f57a2400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c198b40 con 0x7f579c0fedc0 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.912+0000 7f57a2400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c19c910 con 0x7f579c0fe4a0 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.912+0000 7f579aa00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f579c0fedc0 0x7f579c1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.912+0000 7f579aa00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f579c0fedc0 0x7f579c1984b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41694/0 (socket says 172.21.15.159:41694) 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.912+0000 7f579aa00640 1 -- 172.21.15.159:0/2814827776 learned_addr learned my addr 172.21.15.159:0/2814827776 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.912+0000 7f579b400640 1 --2- 172.21.15.159:0/2814827776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c0fe4a0 0x7f579c197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.913+0000 7f579aa00640 1 -- 172.21.15.159:0/2814827776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c0fe4a0 msgr2=0x7f579c197f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:40.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.913+0000 7f579aa00640 1 --2- 172.21.15.159:0/2814827776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c0fe4a0 0x7f579c197f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:40.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.913+0000 7f579aa00640 1 -- 172.21.15.159:0/2814827776 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5784009560 con 0x7f579c0fedc0 2024-02-28T23:22:40.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.913+0000 7f579aa00640 1 --2- 172.21.15.159:0/2814827776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f579c0fedc0 0x7f579c1984b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5784036040 tx=0x7f5784004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.913+0000 7f5793e00640 1 -- 172.21.15.159:0/2814827776 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f57840035f0 con 0x7f579c0fedc0 2024-02-28T23:22:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.913+0000 7f5793e00640 1 -- 172.21.15.159:0/2814827776 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f5784003c10 con 0x7f579c0fedc0 2024-02-28T23:22:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.913+0000 7f57a2400640 1 -- 172.21.15.159:0/2814827776 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579c19cb90 con 0x7f579c0fedc0 2024-02-28T23:22:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.913+0000 7f5793e00640 1 -- 172.21.15.159:0/2814827776 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5784034440 con 0x7f579c0fedc0 2024-02-28T23:22:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.913+0000 7f57a2400640 1 -- 172.21.15.159:0/2814827776 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c19d0f0 con 0x7f579c0fedc0 2024-02-28T23:22:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.915+0000 7f57a2400640 1 -- 172.21.15.159:0/2814827776 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c04e040 con 0x7f579c0fedc0 2024-02-28T23:22:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.915+0000 7f5793e00640 1 -- 172.21.15.159:0/2814827776 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f5784005060 con 0x7f579c0fedc0 2024-02-28T23:22:40.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.916+0000 7f5793e00640 1 --2- 172.21.15.159:0/2814827776 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f578006d8d0 0x7f578006fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:40.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.916+0000 7f5793e00640 1 -- 172.21.15.159:0/2814827776 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f57840afaa0 con 0x7f579c0fedc0 2024-02-28T23:22:40.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.916+0000 7f579b400640 1 --2- 172.21.15.159:0/2814827776 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f578006d8d0 0x7f578006fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:40.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.917+0000 7f579b400640 1 --2- 172.21.15.159:0/2814827776 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f578006d8d0 0x7f578006fd90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f578c009890 tx=0x7f578c008040 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:40.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:40.921+0000 7f5793e00640 1 -- 172.21.15.159:0/2814827776 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f5784079150 con 0x7f579c0fedc0 2024-02-28T23:22:41.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.163+0000 7f57a2400640 1 -- 172.21.15.159:0/2814827776 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f579c105e70 con 0x7f579c0fedc0 2024-02-28T23:22:41.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.165+0000 7f5793e00640 1 -- 172.21.15.159:0/2814827776 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v40) v1 ==== 107+0+4128 (secure 0 0 0) 0x7f578407c810 con 0x7f579c0fedc0 2024-02-28T23:22:41.164 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:41.164 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:19:10.445722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24265":{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":0,"incarnation":24,"state":"up:active","state_seq":235,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:41.164 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 29 2024-02-28T23:22:41.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.168+0000 7f57a2400640 1 -- 172.21.15.159:0/2814827776 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f578006d8d0 msgr2=0x7f578006fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:41.166 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.168+0000 7f57a2400640 1 --2- 172.21.15.159:0/2814827776 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f578006d8d0 0x7f578006fd90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f578c009890 tx=0x7f578c008040 comp rx=0 tx=0).stop 2024-02-28T23:22:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.168+0000 7f57a2400640 1 -- 172.21.15.159:0/2814827776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f579c0fedc0 msgr2=0x7f579c1984b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.168+0000 7f57a2400640 1 --2- 172.21.15.159:0/2814827776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f579c0fedc0 0x7f579c1984b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5784036040 tx=0x7f5784004270 comp rx=0 tx=0).stop 2024-02-28T23:22:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.168+0000 7f57a2400640 1 -- 172.21.15.159:0/2814827776 shutdown_connections 2024-02-28T23:22:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.168+0000 7f57a2400640 1 --2- 172.21.15.159:0/2814827776 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f578006d8d0 0x7f578006fd90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.168+0000 7f57a2400640 1 --2- 172.21.15.159:0/2814827776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f579c0fedc0 0x7f579c1984b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.168+0000 7f57a2400640 1 --2- 172.21.15.159:0/2814827776 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f579c0fe4a0 0x7f579c197f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.168+0000 7f57a2400640 1 -- 172.21.15.159:0/2814827776 >> 172.21.15.159:0/2814827776 conn(0x7f579c0f9d00 msgr2=0x7f579c0fb280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.168+0000 7f57a2400640 1 -- 172.21.15.159:0/2814827776 shutdown_connections 2024-02-28T23:22:41.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.168+0000 7f57a2400640 1 -- 172.21.15.159:0/2814827776 wait complete. 2024-02-28T23:22:41.185 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-02-28T23:22:41.185 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-02-28T23:22:41.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.394+0000 7fafaa400640 1 -- 172.21.15.159:0/2311349938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa4102e70 msgr2=0x7fafa4106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:41.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.394+0000 7fafaa400640 1 --2- 172.21.15.159:0/2311349938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa4102e70 0x7fafa4106eb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7faf90009880 tx=0x7faf9002bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.394+0000 7fafaa400640 1 -- 172.21.15.159:0/2311349938 shutdown_connections 2024-02-28T23:22:41.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.394+0000 7fafaa400640 1 --2- 172.21.15.159:0/2311349938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa4102e70 0x7fafa4106eb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.394+0000 7fafaa400640 1 --2- 172.21.15.159:0/2311349938 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafa41024c0 0x7fafa41028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.394+0000 7fafaa400640 1 -- 172.21.15.159:0/2311349938 >> 172.21.15.159:0/2311349938 conn(0x7fafa40fdce0 msgr2=0x7fafa4100100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:41.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.394+0000 7fafaa400640 1 -- 172.21.15.159:0/2311349938 shutdown_connections 2024-02-28T23:22:41.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.394+0000 7fafaa400640 1 -- 172.21.15.159:0/2311349938 wait complete. 2024-02-28T23:22:41.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.395+0000 7fafaa400640 1 Processor -- start 2024-02-28T23:22:41.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.395+0000 7fafaa400640 1 -- start start 2024-02-28T23:22:41.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.395+0000 7fafaa400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41024c0 0x7fafa4197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:41.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.395+0000 7fafaa400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafa41984a0 0x7fafa419c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:41.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.395+0000 7fafaa400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4198aa0 con 0x7fafa41024c0 2024-02-28T23:22:41.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.395+0000 7fafaa400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa4198c10 con 0x7fafa41984a0 2024-02-28T23:22:41.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.396+0000 7fafa3400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41024c0 0x7fafa4197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:41.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.396+0000 7fafa3400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41024c0 0x7fafa4197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41714/0 (socket says 172.21.15.159:41714) 2024-02-28T23:22:41.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.396+0000 7fafa3400640 1 -- 172.21.15.159:0/2210803425 learned_addr learned my addr 172.21.15.159:0/2210803425 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:41.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.396+0000 7fafa2a00640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafa41984a0 0x7fafa419c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:41.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.396+0000 7fafa3400640 1 -- 172.21.15.159:0/2210803425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafa41984a0 msgr2=0x7fafa419c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:41.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.396+0000 7fafa3400640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafa41984a0 0x7fafa419c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.396+0000 7fafa3400640 1 -- 172.21.15.159:0/2210803425 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90009560 con 0x7fafa41024c0 2024-02-28T23:22:41.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.396+0000 7fafa2a00640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafa41984a0 0x7fafa419c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:22:41.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.396+0000 7fafa3400640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41024c0 0x7fafa4197f60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faf9400d720 tx=0x7faf9400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:41.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.397+0000 7faf9be00640 1 -- 172.21.15.159:0/2210803425 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf940051f0 con 0x7fafa41024c0 2024-02-28T23:22:41.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.397+0000 7faf9be00640 1 -- 172.21.15.159:0/2210803425 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7faf94009ce0 con 0x7fafa41024c0 2024-02-28T23:22:41.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.397+0000 7faf9be00640 1 -- 172.21.15.159:0/2210803425 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faf94010460 con 0x7fafa41024c0 2024-02-28T23:22:41.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.397+0000 7fafaa400640 1 -- 172.21.15.159:0/2210803425 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa419cf00 con 0x7fafa41024c0 2024-02-28T23:22:41.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.397+0000 7fafaa400640 1 -- 172.21.15.159:0/2210803425 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa419d460 con 0x7fafa41024c0 2024-02-28T23:22:41.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.398+0000 7fafaa400640 1 -- 172.21.15.159:0/2210803425 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa404e040 con 0x7fafa41024c0 2024-02-28T23:22:41.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.399+0000 7faf9be00640 1 -- 172.21.15.159:0/2210803425 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7faf94005350 con 0x7fafa41024c0 2024-02-28T23:22:41.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.400+0000 7faf9be00640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faf8806d810 0x7faf8806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:41.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.400+0000 7faf9be00640 1 -- 172.21.15.159:0/2210803425 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7faf9408d190 con 0x7fafa41024c0 2024-02-28T23:22:41.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.400+0000 7fafa2a00640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faf8806d810 0x7faf8806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:41.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.401+0000 7fafa2a00640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faf8806d810 0x7faf8806fcd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf90036040 tx=0x7faf9002cf90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:41.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.405+0000 7faf9be00640 1 -- 172.21.15.159:0/2210803425 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7faf94056840 con 0x7fafa41024c0 2024-02-28T23:22:41.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.642+0000 7fafaa400640 1 -- 172.21.15.159:0/2210803425 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fafa41992b0 con 0x7fafa41024c0 2024-02-28T23:22:41.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.644+0000 7faf9be00640 1 -- 172.21.15.159:0/2210803425 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v40) v1 ==== 107+0+4944 (secure 0 0 0) 0x7faf94059f00 con 0x7fafa41024c0 2024-02-28T23:22:41.642 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:41.642 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44283,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2221421248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2221421248},{"type":"v1","addr":"172.21.15.184:6825","nonce":2221421248}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:19:10.445722+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":100,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":24265},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24265":{"gid":24265,"name":"cephfs.smithi184.pnifob","rank":0,"incarnation":24,"state":"up:active","state_seq":235,"addr":"172.21.15.184:6827/3142391154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":3142391154},{"type":"v1","addr":"172.21.15.184:6827","nonce":3142391154}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:41.643 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 30 2024-02-28T23:22:41.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.647+0000 7fafaa400640 1 -- 172.21.15.159:0/2210803425 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faf8806d810 msgr2=0x7faf8806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:41.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.647+0000 7fafaa400640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faf8806d810 0x7faf8806fcd0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7faf90036040 tx=0x7faf9002cf90 comp rx=0 tx=0).stop 2024-02-28T23:22:41.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.647+0000 7fafaa400640 1 -- 172.21.15.159:0/2210803425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41024c0 msgr2=0x7fafa4197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:41.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.647+0000 7fafaa400640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41024c0 0x7fafa4197f60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7faf9400d720 tx=0x7faf9400dbe0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.647+0000 7fafaa400640 1 -- 172.21.15.159:0/2210803425 shutdown_connections 2024-02-28T23:22:41.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.647+0000 7fafaa400640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7faf8806d810 0x7faf8806fcd0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.647+0000 7fafaa400640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fafa41984a0 0x7fafa419c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.647+0000 7fafaa400640 1 --2- 172.21.15.159:0/2210803425 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fafa41024c0 0x7fafa4197f60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.647+0000 7fafaa400640 1 -- 172.21.15.159:0/2210803425 >> 172.21.15.159:0/2210803425 conn(0x7fafa40fdce0 msgr2=0x7fafa40ff3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:41.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.647+0000 7fafaa400640 1 -- 172.21.15.159:0/2210803425 shutdown_connections 2024-02-28T23:22:41.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.647+0000 7fafaa400640 1 -- 172.21.15.159:0/2210803425 wait complete. 2024-02-28T23:22:41.665 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-02-28T23:22:41.665 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-02-28T23:22:41.740 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:41 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2233144595' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-28T23:22:41.741 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:41 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2814827776' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-28T23:22:41.741 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:41 smithi159 ceph-mon[113833]: pgmap v350: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:22:41.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:41 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2233144595' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-02-28T23:22:41.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:41 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2814827776' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-02-28T23:22:41.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:41 smithi184 ceph-mon[86482]: pgmap v350: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:22:41.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.871+0000 7fea94000640 1 -- 172.21.15.159:0/2587189927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea8c102e70 msgr2=0x7fea8c106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:41.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.871+0000 7fea94000640 1 --2- 172.21.15.159:0/2587189927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea8c102e70 0x7fea8c106eb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fea78009880 tx=0x7fea7802bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.871+0000 7fea94000640 1 -- 172.21.15.159:0/2587189927 shutdown_connections 2024-02-28T23:22:41.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.871+0000 7fea94000640 1 --2- 172.21.15.159:0/2587189927 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea8c102e70 0x7fea8c106eb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.871+0000 7fea94000640 1 --2- 172.21.15.159:0/2587189927 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea8c1024c0 0x7fea8c1028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.871+0000 7fea94000640 1 -- 172.21.15.159:0/2587189927 >> 172.21.15.159:0/2587189927 conn(0x7fea8c0fdd40 msgr2=0x7fea8c100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:41.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.871+0000 7fea94000640 1 -- 172.21.15.159:0/2587189927 shutdown_connections 2024-02-28T23:22:41.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.871+0000 7fea94000640 1 -- 172.21.15.159:0/2587189927 wait complete. 2024-02-28T23:22:41.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.872+0000 7fea94000640 1 Processor -- start 2024-02-28T23:22:41.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.872+0000 7fea94000640 1 -- start start 2024-02-28T23:22:41.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.872+0000 7fea94000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea8c1024c0 0x7fea8c198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:41.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.872+0000 7fea94000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea8c198640 0x7fea8c19caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:41.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.872+0000 7fea94000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c198c40 con 0x7fea8c1024c0 2024-02-28T23:22:41.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.872+0000 7fea94000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea8c198db0 con 0x7fea8c198640 2024-02-28T23:22:41.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.873+0000 7fea91600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea8c1024c0 0x7fea8c198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:41.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.873+0000 7fea91600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea8c1024c0 0x7fea8c198100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41724/0 (socket says 172.21.15.159:41724) 2024-02-28T23:22:41.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.873+0000 7fea91600640 1 -- 172.21.15.159:0/222830489 learned_addr learned my addr 172.21.15.159:0/222830489 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:41.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.873+0000 7fea90c00640 1 --2- 172.21.15.159:0/222830489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea8c198640 0x7fea8c19caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:41.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.873+0000 7fea91600640 1 -- 172.21.15.159:0/222830489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea8c198640 msgr2=0x7fea8c19caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:41.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.873+0000 7fea91600640 1 --2- 172.21.15.159:0/222830489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea8c198640 0x7fea8c19caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:41.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.873+0000 7fea91600640 1 -- 172.21.15.159:0/222830489 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78009560 con 0x7fea8c1024c0 2024-02-28T23:22:41.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.874+0000 7fea91600640 1 --2- 172.21.15.159:0/222830489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea8c1024c0 0x7fea8c198100 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fea8400b450 tx=0x7fea8400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:41.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.874+0000 7fea8a000640 1 -- 172.21.15.159:0/222830489 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea84011860 con 0x7fea8c1024c0 2024-02-28T23:22:41.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.874+0000 7fea8a000640 1 -- 172.21.15.159:0/222830489 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fea84011e80 con 0x7fea8c1024c0 2024-02-28T23:22:41.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.874+0000 7fea94000640 1 -- 172.21.15.159:0/222830489 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea8c19d0a0 con 0x7fea8c1024c0 2024-02-28T23:22:41.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.874+0000 7fea8a000640 1 -- 172.21.15.159:0/222830489 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea8400f570 con 0x7fea8c1024c0 2024-02-28T23:22:41.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.874+0000 7fea94000640 1 -- 172.21.15.159:0/222830489 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea8c19d600 con 0x7fea8c1024c0 2024-02-28T23:22:41.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.875+0000 7fea94000640 1 -- 172.21.15.159:0/222830489 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8c04e040 con 0x7fea8c1024c0 2024-02-28T23:22:41.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.876+0000 7fea8a000640 1 -- 172.21.15.159:0/222830489 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fea840103e0 con 0x7fea8c1024c0 2024-02-28T23:22:41.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.877+0000 7fea8a000640 1 --2- 172.21.15.159:0/222830489 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fea7006d810 0x7fea7006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:41.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.878+0000 7fea8a000640 1 -- 172.21.15.159:0/222830489 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fea8408d560 con 0x7fea8c1024c0 2024-02-28T23:22:41.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.878+0000 7fea90c00640 1 --2- 172.21.15.159:0/222830489 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fea7006d810 0x7fea7006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:41.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.879+0000 7fea90c00640 1 --2- 172.21.15.159:0/222830489 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fea7006d810 0x7fea7006fcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea78006010 tx=0x7fea78000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:41.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:41.883+0000 7fea8a000640 1 -- 172.21.15.159:0/222830489 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fea84056c10 con 0x7fea8c1024c0 2024-02-28T23:22:42.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.121+0000 7fea94000640 1 -- 172.21.15.159:0/222830489 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7fea8c199450 con 0x7fea8c1024c0 2024-02-28T23:22:42.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.122+0000 7fea8a000640 1 -- 172.21.15.159:0/222830489 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v40) v1 ==== 107+0+4149 (secure 0 0 0) 0x7fea8405a2d0 con 0x7fea8c1024c0 2024-02-28T23:22:42.122 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:42.122 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":22},{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44283,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2221421248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2221421248},{"type":"v1","addr":"172.21.15.184:6825","nonce":2221421248}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:19:57.396272+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:42.122 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 31 2024-02-28T23:22:42.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.125+0000 7fea94000640 1 -- 172.21.15.159:0/222830489 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fea7006d810 msgr2=0x7fea7006fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:42.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.125+0000 7fea94000640 1 --2- 172.21.15.159:0/222830489 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fea7006d810 0x7fea7006fcd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fea78006010 tx=0x7fea78000bc0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.125+0000 7fea94000640 1 -- 172.21.15.159:0/222830489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea8c1024c0 msgr2=0x7fea8c198100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:42.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.125+0000 7fea94000640 1 --2- 172.21.15.159:0/222830489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea8c1024c0 0x7fea8c198100 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fea8400b450 tx=0x7fea8400b910 comp rx=0 tx=0).stop 2024-02-28T23:22:42.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.125+0000 7fea94000640 1 -- 172.21.15.159:0/222830489 shutdown_connections 2024-02-28T23:22:42.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.125+0000 7fea94000640 1 --2- 172.21.15.159:0/222830489 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fea7006d810 0x7fea7006fcd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.125+0000 7fea94000640 1 --2- 172.21.15.159:0/222830489 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fea8c198640 0x7fea8c19caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.125+0000 7fea94000640 1 --2- 172.21.15.159:0/222830489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea8c1024c0 0x7fea8c198100 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.125+0000 7fea94000640 1 -- 172.21.15.159:0/222830489 >> 172.21.15.159:0/222830489 conn(0x7fea8c0fdd40 msgr2=0x7fea8c0ff5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:42.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.125+0000 7fea94000640 1 -- 172.21.15.159:0/222830489 shutdown_connections 2024-02-28T23:22:42.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.125+0000 7fea94000640 1 -- 172.21.15.159:0/222830489 wait complete. 2024-02-28T23:22:42.143 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-02-28T23:22:42.143 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-02-28T23:22:42.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.357+0000 7f59e8e00640 1 -- 172.21.15.159:0/2196952018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e410b400 msgr2=0x7f59e410b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:42.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.357+0000 7f59e8e00640 1 --2- 172.21.15.159:0/2196952018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e410b400 0x7f59e410b7e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009880 tx=0x7f59d402bd70 comp rx=0 tx=0).stop 2024-02-28T23:22:42.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.357+0000 7f59e8e00640 1 -- 172.21.15.159:0/2196952018 shutdown_connections 2024-02-28T23:22:42.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.357+0000 7f59e8e00640 1 --2- 172.21.15.159:0/2196952018 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e4106490 0x7f59e41068f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.357+0000 7f59e8e00640 1 --2- 172.21.15.159:0/2196952018 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e410b400 0x7f59e410b7e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.357+0000 7f59e8e00640 1 -- 172.21.15.159:0/2196952018 >> 172.21.15.159:0/2196952018 conn(0x7f59e4075c50 msgr2=0x7f59e4078070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:42.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.357+0000 7f59e8e00640 1 -- 172.21.15.159:0/2196952018 shutdown_connections 2024-02-28T23:22:42.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.357+0000 7f59e8e00640 1 -- 172.21.15.159:0/2196952018 wait complete. 2024-02-28T23:22:42.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.358+0000 7f59e8e00640 1 Processor -- start 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.358+0000 7f59e8e00640 1 -- start start 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.359+0000 7f59e8e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e4106490 0x7f59e419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.359+0000 7f59e8e00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e410b400 0x7f59e419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.359+0000 7f59e8e00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e419cdd0 con 0x7f59e4106490 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.359+0000 7f59e8e00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59e41a0ba0 con 0x7f59e410b400 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.359+0000 7f59e3400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e4106490 0x7f59e419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.359+0000 7f59e3400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e4106490 0x7f59e419c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41736/0 (socket says 172.21.15.159:41736) 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.359+0000 7f59e3400640 1 -- 172.21.15.159:0/1925665334 learned_addr learned my addr 172.21.15.159:0/1925665334 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.359+0000 7f59e3400640 1 -- 172.21.15.159:0/1925665334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e410b400 msgr2=0x7f59e419c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.359+0000 7f59e2a00640 1 --2- 172.21.15.159:0/1925665334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e410b400 0x7f59e419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.359+0000 7f59e3400640 1 --2- 172.21.15.159:0/1925665334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e410b400 0x7f59e419c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.359+0000 7f59e3400640 1 -- 172.21.15.159:0/1925665334 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59d4009560 con 0x7f59e4106490 2024-02-28T23:22:42.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.360+0000 7f59e3400640 1 --2- 172.21.15.159:0/1925665334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e4106490 0x7f59e419c200 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009230 tx=0x7f59d4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:42.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.360+0000 7f59dbe00640 1 -- 172.21.15.159:0/1925665334 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59d40035f0 con 0x7f59e4106490 2024-02-28T23:22:42.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.360+0000 7f59dbe00640 1 -- 172.21.15.159:0/1925665334 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f59d4003c10 con 0x7f59e4106490 2024-02-28T23:22:42.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.360+0000 7f59e8e00640 1 -- 172.21.15.159:0/1925665334 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59e41a0e20 con 0x7f59e4106490 2024-02-28T23:22:42.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.360+0000 7f59dbe00640 1 -- 172.21.15.159:0/1925665334 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f59d403e450 con 0x7f59e4106490 2024-02-28T23:22:42.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.360+0000 7f59e8e00640 1 -- 172.21.15.159:0/1925665334 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59e41a1380 con 0x7f59e4106490 2024-02-28T23:22:42.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.361+0000 7f59e8e00640 1 -- 172.21.15.159:0/1925665334 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59e404e040 con 0x7f59e4106490 2024-02-28T23:22:42.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.362+0000 7f59dbe00640 1 -- 172.21.15.159:0/1925665334 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f59d4004f60 con 0x7f59e4106490 2024-02-28T23:22:42.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.363+0000 7f59dbe00640 1 --2- 172.21.15.159:0/1925665334 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f59c806d810 0x7f59c806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:42.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.363+0000 7f59dbe00640 1 -- 172.21.15.159:0/1925665334 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f59d40b0170 con 0x7f59e4106490 2024-02-28T23:22:42.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.363+0000 7f59e2a00640 1 --2- 172.21.15.159:0/1925665334 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f59c806d810 0x7f59c806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:42.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.364+0000 7f59e2a00640 1 --2- 172.21.15.159:0/1925665334 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f59c806d810 0x7f59c806fcd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f59cc005fd0 tx=0x7f59cc005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:42.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.368+0000 7f59dbe00640 1 -- 172.21.15.159:0/1925665334 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f59d40799c0 con 0x7f59e4106490 2024-02-28T23:22:42.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.589+0000 7f59e8e00640 1 -- 172.21.15.159:0/1925665334 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f59e410e940 con 0x7f59e4106490 2024-02-28T23:22:42.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.591+0000 7f59dbe00640 1 -- 172.21.15.159:0/1925665334 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v40) v1 ==== 107+0+4194 (secure 0 0 0) 0x7f59d407d080 con 0x7f59e4106490 2024-02-28T23:22:42.590 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:42.590 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44283,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2221421248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2221421248},{"type":"v1","addr":"172.21.15.184:6825","nonce":2221421248}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:19:57.409039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34440":{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:42.590 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 32 2024-02-28T23:22:42.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.593+0000 7f59e8e00640 1 -- 172.21.15.159:0/1925665334 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f59c806d810 msgr2=0x7f59c806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.593+0000 7f59e8e00640 1 --2- 172.21.15.159:0/1925665334 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f59c806d810 0x7f59c806fcd0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f59cc005fd0 tx=0x7f59cc005850 comp rx=0 tx=0).stop 2024-02-28T23:22:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.593+0000 7f59e8e00640 1 -- 172.21.15.159:0/1925665334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e4106490 msgr2=0x7f59e419c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.593+0000 7f59e8e00640 1 --2- 172.21.15.159:0/1925665334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e4106490 0x7f59e419c200 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f59d4009230 tx=0x7f59d4004040 comp rx=0 tx=0).stop 2024-02-28T23:22:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.593+0000 7f59e8e00640 1 -- 172.21.15.159:0/1925665334 shutdown_connections 2024-02-28T23:22:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.593+0000 7f59e8e00640 1 --2- 172.21.15.159:0/1925665334 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f59c806d810 0x7f59c806fcd0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.593+0000 7f59e8e00640 1 --2- 172.21.15.159:0/1925665334 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f59e410b400 0x7f59e419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.593+0000 7f59e8e00640 1 --2- 172.21.15.159:0/1925665334 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f59e4106490 0x7f59e419c200 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.593+0000 7f59e8e00640 1 -- 172.21.15.159:0/1925665334 >> 172.21.15.159:0/1925665334 conn(0x7f59e4075c50 msgr2=0x7f59e40767b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.593+0000 7f59e8e00640 1 -- 172.21.15.159:0/1925665334 shutdown_connections 2024-02-28T23:22:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.593+0000 7f59e8e00640 1 -- 172.21.15.159:0/1925665334 wait complete. 2024-02-28T23:22:42.611 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-02-28T23:22:42.611 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 33 2024-02-28T23:22:42.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.821+0000 7f1d99a00640 1 -- 172.21.15.159:0/1431529121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d9410c660 msgr2=0x7f1d9410ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:42.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.821+0000 7f1d99a00640 1 --2- 172.21.15.159:0/1431529121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d9410c660 0x7f1d9410ca40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009880 tx=0x7f1d8402bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.821+0000 7f1d99a00640 1 -- 172.21.15.159:0/1431529121 shutdown_connections 2024-02-28T23:22:42.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.821+0000 7f1d99a00640 1 --2- 172.21.15.159:0/1431529121 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d941066a0 0x7f1d94106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.821+0000 7f1d99a00640 1 --2- 172.21.15.159:0/1431529121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d9410c660 0x7f1d9410ca40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.821+0000 7f1d99a00640 1 -- 172.21.15.159:0/1431529121 >> 172.21.15.159:0/1431529121 conn(0x7f1d94075e80 msgr2=0x7f1d940782a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:42.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.822+0000 7f1d99a00640 1 -- 172.21.15.159:0/1431529121 shutdown_connections 2024-02-28T23:22:42.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.822+0000 7f1d99a00640 1 -- 172.21.15.159:0/1431529121 wait complete. 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.822+0000 7f1d99a00640 1 Processor -- start 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.823+0000 7f1d99a00640 1 -- start start 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.823+0000 7f1d99a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d941066a0 0x7f1d9419c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.823+0000 7f1d99a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d9410c660 0x7f1d9419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.823+0000 7f1d99a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9419cf70 con 0x7f1d941066a0 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.823+0000 7f1d99a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d941a0d40 con 0x7f1d9410c660 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.823+0000 7f1d92a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d941066a0 0x7f1d9419c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.823+0000 7f1d92a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d941066a0 0x7f1d9419c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41754/0 (socket says 172.21.15.159:41754) 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.823+0000 7f1d92a00640 1 -- 172.21.15.159:0/2316560104 learned_addr learned my addr 172.21.15.159:0/2316560104 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.824+0000 7f1d92000640 1 --2- 172.21.15.159:0/2316560104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d9410c660 0x7f1d9419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.824+0000 7f1d92a00640 1 -- 172.21.15.159:0/2316560104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d9410c660 msgr2=0x7f1d9419c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:42.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.824+0000 7f1d92a00640 1 --2- 172.21.15.159:0/2316560104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d9410c660 0x7f1d9419c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:42.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.824+0000 7f1d92a00640 1 -- 172.21.15.159:0/2316560104 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d84009560 con 0x7f1d941066a0 2024-02-28T23:22:42.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.824+0000 7f1d92a00640 1 --2- 172.21.15.159:0/2316560104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d941066a0 0x7f1d9419c3a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009230 tx=0x7f1d84004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:42.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.824+0000 7f1d8b400640 1 -- 172.21.15.159:0/2316560104 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d840035f0 con 0x7f1d941066a0 2024-02-28T23:22:42.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.824+0000 7f1d99a00640 1 -- 172.21.15.159:0/2316560104 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d941a0fc0 con 0x7f1d941066a0 2024-02-28T23:22:42.824 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.824+0000 7f1d8b400640 1 -- 172.21.15.159:0/2316560104 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1d84003c10 con 0x7f1d941066a0 2024-02-28T23:22:42.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.825+0000 7f1d8b400640 1 -- 172.21.15.159:0/2316560104 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d84005630 con 0x7f1d941066a0 2024-02-28T23:22:42.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.825+0000 7f1d99a00640 1 -- 172.21.15.159:0/2316560104 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d941a14c0 con 0x7f1d941066a0 2024-02-28T23:22:42.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.826+0000 7f1d99a00640 1 -- 172.21.15.159:0/2316560104 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d9404e040 con 0x7f1d941066a0 2024-02-28T23:22:42.826 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.827+0000 7f1d8b400640 1 -- 172.21.15.159:0/2316560104 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f1d84004dd0 con 0x7f1d941066a0 2024-02-28T23:22:42.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.827+0000 7f1d8b400640 1 --2- 172.21.15.159:0/2316560104 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1d7806d810 0x7f1d7806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:42.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.828+0000 7f1d8b400640 1 -- 172.21.15.159:0/2316560104 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f1d840afd60 con 0x7f1d941066a0 2024-02-28T23:22:42.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.828+0000 7f1d92000640 1 --2- 172.21.15.159:0/2316560104 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1d7806d810 0x7f1d7806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:42.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.828+0000 7f1d92000640 1 --2- 172.21.15.159:0/2316560104 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1d7806d810 0x7f1d7806fcd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c005c40 tx=0x7f1d7c005bd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:42.831 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:42.832+0000 7f1d8b400640 1 -- 172.21.15.159:0/2316560104 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1d84079410 con 0x7f1d941066a0 2024-02-28T23:22:42.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:42 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2210803425' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-28T23:22:42.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:42 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/222830489' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-28T23:22:42.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:42 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2210803425' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-02-28T23:22:42.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:42 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/222830489' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-02-28T23:22:43.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.068+0000 7f1d99a00640 1 -- 172.21.15.159:0/2316560104 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7f1d941138e0 con 0x7f1d941066a0 2024-02-28T23:22:43.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.069+0000 7f1d8b400640 1 -- 172.21.15.159:0/2316560104 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v40) v1 ==== 107+0+5007 (secure 0 0 0) 0x7f1d8407cad0 con 0x7f1d941066a0 2024-02-28T23:22:43.068 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:43.068 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44283,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2221421248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2221421248},{"type":"v1","addr":"172.21.15.184:6825","nonce":2221421248}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44311,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6827/146669833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":146669833},{"type":"v1","addr":"172.21.15.184:6827","nonce":146669833}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:19:57.409039+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34440":{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:43.068 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 33 2024-02-28T23:22:43.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.071+0000 7f1d99a00640 1 -- 172.21.15.159:0/2316560104 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1d7806d810 msgr2=0x7f1d7806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:43.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.071+0000 7f1d99a00640 1 --2- 172.21.15.159:0/2316560104 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1d7806d810 0x7f1d7806fcd0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c005c40 tx=0x7f1d7c005bd0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.071+0000 7f1d99a00640 1 -- 172.21.15.159:0/2316560104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d941066a0 msgr2=0x7f1d9419c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:43.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.071+0000 7f1d99a00640 1 --2- 172.21.15.159:0/2316560104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d941066a0 0x7f1d9419c3a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1d84009230 tx=0x7f1d84004040 comp rx=0 tx=0).stop 2024-02-28T23:22:43.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.071+0000 7f1d99a00640 1 -- 172.21.15.159:0/2316560104 shutdown_connections 2024-02-28T23:22:43.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.071+0000 7f1d99a00640 1 --2- 172.21.15.159:0/2316560104 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1d7806d810 0x7f1d7806fcd0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.071+0000 7f1d99a00640 1 --2- 172.21.15.159:0/2316560104 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1d9410c660 0x7f1d9419c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.071+0000 7f1d99a00640 1 --2- 172.21.15.159:0/2316560104 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d941066a0 0x7f1d9419c3a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.071+0000 7f1d99a00640 1 -- 172.21.15.159:0/2316560104 >> 172.21.15.159:0/2316560104 conn(0x7f1d94075e80 msgr2=0x7f1d94076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:43.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.072+0000 7f1d99a00640 1 -- 172.21.15.159:0/2316560104 shutdown_connections 2024-02-28T23:22:43.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.072+0000 7f1d99a00640 1 -- 172.21.15.159:0/2316560104 wait complete. 2024-02-28T23:22:43.090 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-02-28T23:22:43.090 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 34 2024-02-28T23:22:43.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.307+0000 7fdfe5a00640 1 -- 172.21.15.159:0/843426080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfe0102e70 msgr2=0x7fdfe0106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:43.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.307+0000 7fdfe5a00640 1 --2- 172.21.15.159:0/843426080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfe0102e70 0x7fdfe0106eb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc009880 tx=0x7fdfcc02bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.307+0000 7fdfe5a00640 1 -- 172.21.15.159:0/843426080 shutdown_connections 2024-02-28T23:22:43.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.307+0000 7fdfe5a00640 1 --2- 172.21.15.159:0/843426080 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfe0102e70 0x7fdfe0106eb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.307+0000 7fdfe5a00640 1 --2- 172.21.15.159:0/843426080 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfe01024c0 0x7fdfe01028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.307+0000 7fdfe5a00640 1 -- 172.21.15.159:0/843426080 >> 172.21.15.159:0/843426080 conn(0x7fdfe00fdd40 msgr2=0x7fdfe0100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:43.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.307+0000 7fdfe5a00640 1 -- 172.21.15.159:0/843426080 shutdown_connections 2024-02-28T23:22:43.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.307+0000 7fdfe5a00640 1 -- 172.21.15.159:0/843426080 wait complete. 2024-02-28T23:22:43.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.308+0000 7fdfe5a00640 1 Processor -- start 2024-02-28T23:22:43.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.308+0000 7fdfe5a00640 1 -- start start 2024-02-28T23:22:43.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.308+0000 7fdfe5a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfe01024c0 0x7fdfe0198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:43.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.309+0000 7fdfe5a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfe0198540 0x7fdfe019c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:43.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.309+0000 7fdfe5a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe0198ab0 con 0x7fdfe0198540 2024-02-28T23:22:43.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.309+0000 7fdfe5a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfe0198c20 con 0x7fdfe01024c0 2024-02-28T23:22:43.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.309+0000 7fdfde000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfe0198540 0x7fdfe019c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:43.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.309+0000 7fdfde000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfe0198540 0x7fdfe019c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41780/0 (socket says 172.21.15.159:41780) 2024-02-28T23:22:43.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.309+0000 7fdfde000640 1 -- 172.21.15.159:0/2893990547 learned_addr learned my addr 172.21.15.159:0/2893990547 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:43.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.309+0000 7fdfdea00640 1 --2- 172.21.15.159:0/2893990547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfe01024c0 0x7fdfe0198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:43.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.309+0000 7fdfde000640 1 -- 172.21.15.159:0/2893990547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfe01024c0 msgr2=0x7fdfe0198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:43.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.309+0000 7fdfde000640 1 --2- 172.21.15.159:0/2893990547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfe01024c0 0x7fdfe0198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.309+0000 7fdfde000640 1 -- 172.21.15.159:0/2893990547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc009560 con 0x7fdfe0198540 2024-02-28T23:22:43.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.310+0000 7fdfde000640 1 --2- 172.21.15.159:0/2893990547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfe0198540 0x7fdfe019c9a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc036040 tx=0x7fdfcc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:43.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.310+0000 7fdfd7400640 1 -- 172.21.15.159:0/2893990547 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfcc0035f0 con 0x7fdfe0198540 2024-02-28T23:22:43.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.310+0000 7fdfd7400640 1 -- 172.21.15.159:0/2893990547 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fdfcc003c10 con 0x7fdfe0198540 2024-02-28T23:22:43.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.310+0000 7fdfe5a00640 1 -- 172.21.15.159:0/2893990547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfe019cf40 con 0x7fdfe0198540 2024-02-28T23:22:43.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.310+0000 7fdfd7400640 1 -- 172.21.15.159:0/2893990547 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdfcc034440 con 0x7fdfe0198540 2024-02-28T23:22:43.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.310+0000 7fdfe5a00640 1 -- 172.21.15.159:0/2893990547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfe019d450 con 0x7fdfe0198540 2024-02-28T23:22:43.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.311+0000 7fdfe5a00640 1 -- 172.21.15.159:0/2893990547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfe004e040 con 0x7fdfe0198540 2024-02-28T23:22:43.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.312+0000 7fdfd7400640 1 -- 172.21.15.159:0/2893990547 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fdfcc003750 con 0x7fdfe0198540 2024-02-28T23:22:43.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.313+0000 7fdfd7400640 1 --2- 172.21.15.159:0/2893990547 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fdfc406d810 0x7fdfc406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:43.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.313+0000 7fdfd7400640 1 -- 172.21.15.159:0/2893990547 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fdfcc0af9f0 con 0x7fdfe0198540 2024-02-28T23:22:43.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.314+0000 7fdfdea00640 1 --2- 172.21.15.159:0/2893990547 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fdfc406d810 0x7fdfc406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:43.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.314+0000 7fdfdea00640 1 --2- 172.21.15.159:0/2893990547 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fdfc406d810 0x7fdfc406fcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0005e10 tx=0x7fdfd0005da0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:43.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.318+0000 7fdfd7400640 1 -- 172.21.15.159:0/2893990547 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fdfcc0b1e60 con 0x7fdfe0198540 2024-02-28T23:22:43.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.558+0000 7fdfe5a00640 1 -- 172.21.15.159:0/2893990547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fdfe010a7c0 con 0x7fdfe0198540 2024-02-28T23:22:43.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.559+0000 7fdfd7400640 1 -- 172.21.15.159:0/2893990547 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v40) v1 ==== 107+0+5011 (secure 0 0 0) 0x7fdfcc079120 con 0x7fdfe0198540 2024-02-28T23:22:43.558 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:43.559 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44283,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2221421248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2221421248},{"type":"v1","addr":"172.21.15.184:6825","nonce":2221421248}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44311,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6827/146669833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":146669833},{"type":"v1","addr":"172.21.15.184:6827","nonce":146669833}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:20:06.247833+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34440":{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":23,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:43.559 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 34 2024-02-28T23:22:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.562+0000 7fdfe5a00640 1 -- 172.21.15.159:0/2893990547 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fdfc406d810 msgr2=0x7fdfc406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.562+0000 7fdfe5a00640 1 --2- 172.21.15.159:0/2893990547 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fdfc406d810 0x7fdfc406fcd0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fdfd0005e10 tx=0x7fdfd0005da0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.562+0000 7fdfe5a00640 1 -- 172.21.15.159:0/2893990547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfe0198540 msgr2=0x7fdfe019c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.562+0000 7fdfe5a00640 1 --2- 172.21.15.159:0/2893990547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfe0198540 0x7fdfe019c9a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdfcc036040 tx=0x7fdfcc004040 comp rx=0 tx=0).stop 2024-02-28T23:22:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.562+0000 7fdfe5a00640 1 -- 172.21.15.159:0/2893990547 shutdown_connections 2024-02-28T23:22:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.562+0000 7fdfe5a00640 1 --2- 172.21.15.159:0/2893990547 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fdfc406d810 0x7fdfc406fcd0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.562+0000 7fdfe5a00640 1 --2- 172.21.15.159:0/2893990547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdfe0198540 0x7fdfe019c9a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.562+0000 7fdfe5a00640 1 --2- 172.21.15.159:0/2893990547 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fdfe01024c0 0x7fdfe0198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.562+0000 7fdfe5a00640 1 -- 172.21.15.159:0/2893990547 >> 172.21.15.159:0/2893990547 conn(0x7fdfe00fdd40 msgr2=0x7fdfe00ff3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.563+0000 7fdfe5a00640 1 -- 172.21.15.159:0/2893990547 shutdown_connections 2024-02-28T23:22:43.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.563+0000 7fdfe5a00640 1 -- 172.21.15.159:0/2893990547 wait complete. 2024-02-28T23:22:43.581 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-02-28T23:22:43.582 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 35 2024-02-28T23:22:43.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.797+0000 7f838bc00640 1 -- 172.21.15.159:0/3681830609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f838410c6a0 msgr2=0x7f838410ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:43.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.797+0000 7f838bc00640 1 --2- 172.21.15.159:0/3681830609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f838410c6a0 0x7f838410ca80 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8374009880 tx=0x7f837402bd90 comp rx=0 tx=0).stop 2024-02-28T23:22:43.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.797+0000 7f838bc00640 1 -- 172.21.15.159:0/3681830609 shutdown_connections 2024-02-28T23:22:43.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.797+0000 7f838bc00640 1 --2- 172.21.15.159:0/3681830609 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83841066a0 0x7f8384106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.797+0000 7f838bc00640 1 --2- 172.21.15.159:0/3681830609 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f838410c6a0 0x7f838410ca80 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.797+0000 7f838bc00640 1 -- 172.21.15.159:0/3681830609 >> 172.21.15.159:0/3681830609 conn(0x7f8384075e50 msgr2=0x7f8384078270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:43.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.797+0000 7f838bc00640 1 -- 172.21.15.159:0/3681830609 shutdown_connections 2024-02-28T23:22:43.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.797+0000 7f838bc00640 1 -- 172.21.15.159:0/3681830609 wait complete. 2024-02-28T23:22:43.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.798+0000 7f838bc00640 1 Processor -- start 2024-02-28T23:22:43.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.798+0000 7f838bc00640 1 -- start start 2024-02-28T23:22:43.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.798+0000 7f838bc00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83841066a0 0x7f838419c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:43.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.798+0000 7f838bc00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f838410c6a0 0x7f838419c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:43.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.798+0000 7f838bc00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838419cde0 con 0x7f838410c6a0 2024-02-28T23:22:43.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.798+0000 7f838bc00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841a0bb0 con 0x7f83841066a0 2024-02-28T23:22:43.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.799+0000 7f837be00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f838410c6a0 0x7f838419c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:43.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.799+0000 7f837be00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f838410c6a0 0x7f838419c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41790/0 (socket says 172.21.15.159:41790) 2024-02-28T23:22:43.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.799+0000 7f837be00640 1 -- 172.21.15.159:0/2725847946 learned_addr learned my addr 172.21.15.159:0/2725847946 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:43.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.799+0000 7f8389200640 1 --2- 172.21.15.159:0/2725847946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83841066a0 0x7f838419c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:43.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.799+0000 7f837be00640 1 -- 172.21.15.159:0/2725847946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83841066a0 msgr2=0x7f838419c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:43.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.799+0000 7f837be00640 1 --2- 172.21.15.159:0/2725847946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83841066a0 0x7f838419c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:43.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.799+0000 7f837be00640 1 -- 172.21.15.159:0/2725847946 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8374009560 con 0x7f838410c6a0 2024-02-28T23:22:43.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.800+0000 7f837be00640 1 --2- 172.21.15.159:0/2725847946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f838410c6a0 0x7f838419c750 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f836c00d6f0 tx=0x7f836c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:43.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.800+0000 7f8382000640 1 -- 172.21.15.159:0/2725847946 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f836c009a30 con 0x7f838410c6a0 2024-02-28T23:22:43.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.800+0000 7f8382000640 1 -- 172.21.15.159:0/2725847946 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f836c0054e0 con 0x7f838410c6a0 2024-02-28T23:22:43.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.800+0000 7f8382000640 1 -- 172.21.15.159:0/2725847946 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f836c010460 con 0x7f838410c6a0 2024-02-28T23:22:43.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.800+0000 7f838bc00640 1 -- 172.21.15.159:0/2725847946 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83841a0e90 con 0x7f838410c6a0 2024-02-28T23:22:43.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.800+0000 7f838bc00640 1 -- 172.21.15.159:0/2725847946 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83841a13f0 con 0x7f838410c6a0 2024-02-28T23:22:43.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.801+0000 7f838bc00640 1 -- 172.21.15.159:0/2725847946 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838404e040 con 0x7f838410c6a0 2024-02-28T23:22:43.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.802+0000 7f8382000640 1 -- 172.21.15.159:0/2725847946 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f836c009b90 con 0x7f838410c6a0 2024-02-28T23:22:43.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.803+0000 7f8382000640 1 --2- 172.21.15.159:0/2725847946 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f836806d8d0 0x7f836806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:43.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.803+0000 7f8382000640 1 -- 172.21.15.159:0/2725847946 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f836c08d250 con 0x7f838410c6a0 2024-02-28T23:22:43.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.803+0000 7f8389200640 1 --2- 172.21.15.159:0/2725847946 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f836806d8d0 0x7f836806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:43.803 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.804+0000 7f8389200640 1 --2- 172.21.15.159:0/2725847946 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f836806d8d0 0x7f836806fd90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8374005ab0 tx=0x7f8374005a40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:43.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:43.808+0000 7f8382000640 1 -- 172.21.15.159:0/2725847946 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f836c056860 con 0x7f838410c6a0 2024-02-28T23:22:43.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:43 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1925665334' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-28T23:22:43.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:43 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2316560104' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-28T23:22:43.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:43 smithi184 ceph-mon[86482]: pgmap v351: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:43 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1925665334' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-02-28T23:22:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:43 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2316560104' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-02-28T23:22:43.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:43 smithi159 ceph-mon[113833]: pgmap v351: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:44.047 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.047+0000 7f838bc00640 1 -- 172.21.15.159:0/2725847946 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f838419d560 con 0x7f838410c6a0 2024-02-28T23:22:44.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.049+0000 7f8382000640 1 -- 172.21.15.159:0/2725847946 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v40) v1 ==== 107+0+5008 (secure 0 0 0) 0x7f836c059f20 con 0x7f838410c6a0 2024-02-28T23:22:44.048 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:44.048 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44283,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2221421248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2221421248},{"type":"v1","addr":"172.21.15.184:6825","nonce":2221421248}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44311,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6827/146669833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":146669833},{"type":"v1","addr":"172.21.15.184:6827","nonce":146669833}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:20:06.335634+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34440":{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":24,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:44.049 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 35 2024-02-28T23:22:44.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.051+0000 7f838bc00640 1 -- 172.21.15.159:0/2725847946 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f836806d8d0 msgr2=0x7f836806fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:44.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.051+0000 7f838bc00640 1 --2- 172.21.15.159:0/2725847946 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f836806d8d0 0x7f836806fd90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8374005ab0 tx=0x7f8374005a40 comp rx=0 tx=0).stop 2024-02-28T23:22:44.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.052+0000 7f838bc00640 1 -- 172.21.15.159:0/2725847946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f838410c6a0 msgr2=0x7f838419c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:44.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.052+0000 7f838bc00640 1 --2- 172.21.15.159:0/2725847946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f838410c6a0 0x7f838419c750 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f836c00d6f0 tx=0x7f836c00dbb0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.052+0000 7f838bc00640 1 -- 172.21.15.159:0/2725847946 shutdown_connections 2024-02-28T23:22:44.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.052+0000 7f838bc00640 1 --2- 172.21.15.159:0/2725847946 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f836806d8d0 0x7f836806fd90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.052+0000 7f838bc00640 1 --2- 172.21.15.159:0/2725847946 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f838410c6a0 0x7f838419c750 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.052+0000 7f838bc00640 1 --2- 172.21.15.159:0/2725847946 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f83841066a0 0x7f838419c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.052+0000 7f838bc00640 1 -- 172.21.15.159:0/2725847946 >> 172.21.15.159:0/2725847946 conn(0x7f8384075e50 msgr2=0x7f83840777a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:44.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.052+0000 7f838bc00640 1 -- 172.21.15.159:0/2725847946 shutdown_connections 2024-02-28T23:22:44.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.052+0000 7f838bc00640 1 -- 172.21.15.159:0/2725847946 wait complete. 2024-02-28T23:22:44.070 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-02-28T23:22:44.071 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 36 2024-02-28T23:22:44.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.280+0000 7f817c800640 1 -- 172.21.15.159:0/4019581375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f817410c660 msgr2=0x7f817410ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:44.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.280+0000 7f817c800640 1 --2- 172.21.15.159:0/4019581375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f817410c660 0x7f817410ca40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8168009880 tx=0x7f816802bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.280+0000 7f817c800640 1 -- 172.21.15.159:0/4019581375 shutdown_connections 2024-02-28T23:22:44.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.280+0000 7f817c800640 1 --2- 172.21.15.159:0/4019581375 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81741066a0 0x7f8174106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.280+0000 7f817c800640 1 --2- 172.21.15.159:0/4019581375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f817410c660 0x7f817410ca40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.280+0000 7f817c800640 1 -- 172.21.15.159:0/4019581375 >> 172.21.15.159:0/4019581375 conn(0x7f8174075e80 msgr2=0x7f81740782a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:44.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.280+0000 7f817c800640 1 -- 172.21.15.159:0/4019581375 shutdown_connections 2024-02-28T23:22:44.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.280+0000 7f817c800640 1 -- 172.21.15.159:0/4019581375 wait complete. 2024-02-28T23:22:44.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.281+0000 7f817c800640 1 Processor -- start 2024-02-28T23:22:44.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.281+0000 7f817c800640 1 -- start start 2024-02-28T23:22:44.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.281+0000 7f817c800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81741066a0 0x7f817419c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:44.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.282+0000 7f817c800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f817419caa0 0x7f81741a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:44.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.282+0000 7f817c800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817419d0a0 con 0x7f817419caa0 2024-02-28T23:22:44.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.282+0000 7f817c800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817419d210 con 0x7f81741066a0 2024-02-28T23:22:44.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.282+0000 7f8179400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f817419caa0 0x7f81741a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.282+0000 7f8179400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f817419caa0 0x7f81741a0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41806/0 (socket says 172.21.15.159:41806) 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.282+0000 7f8179400640 1 -- 172.21.15.159:0/3986469513 learned_addr learned my addr 172.21.15.159:0/3986469513 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.282+0000 7f8179e00640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81741066a0 0x7f817419c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.282+0000 7f8179400640 1 -- 172.21.15.159:0/3986469513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81741066a0 msgr2=0x7f817419c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.282+0000 7f8179400640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81741066a0 0x7f817419c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.282+0000 7f8179400640 1 -- 172.21.15.159:0/3986469513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8168009560 con 0x7f817419caa0 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.282+0000 7f8179e00640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81741066a0 0x7f817419c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.283+0000 7f8179400640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f817419caa0 0x7f81741a0f00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f816400d720 tx=0x7f816400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.283+0000 7f816ea00640 1 -- 172.21.15.159:0/3986469513 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81640051f0 con 0x7f817419caa0 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.283+0000 7f816ea00640 1 -- 172.21.15.159:0/3986469513 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f8164009ce0 con 0x7f817419caa0 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.283+0000 7f817c800640 1 -- 172.21.15.159:0/3986469513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81741a1500 con 0x7f817419caa0 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.283+0000 7f816ea00640 1 -- 172.21.15.159:0/3986469513 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8164010460 con 0x7f817419caa0 2024-02-28T23:22:44.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.283+0000 7f817c800640 1 -- 172.21.15.159:0/3986469513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81741a1a60 con 0x7f817419caa0 2024-02-28T23:22:44.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.284+0000 7f817c800640 1 -- 172.21.15.159:0/3986469513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81741a1d30 con 0x7f817419caa0 2024-02-28T23:22:44.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.285+0000 7f816ea00640 1 -- 172.21.15.159:0/3986469513 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f8164005350 con 0x7f817419caa0 2024-02-28T23:22:44.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.286+0000 7f816ea00640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f815c06d810 0x7f815c06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:44.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.286+0000 7f816ea00640 1 -- 172.21.15.159:0/3986469513 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f816408d1f0 con 0x7f817419caa0 2024-02-28T23:22:44.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.286+0000 7f8179e00640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f815c06d810 0x7f815c06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:44.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.287+0000 7f8179e00640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f815c06d810 0x7f815c06fcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8168036040 tx=0x7f8168000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:44.290 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.291+0000 7f816ea00640 1 -- 172.21.15.159:0/3986469513 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f8164056880 con 0x7f817419caa0 2024-02-28T23:22:44.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.528+0000 7f817c800640 1 -- 172.21.15.159:0/3986469513 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f817419d8e0 con 0x7f817419caa0 2024-02-28T23:22:44.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.529+0000 7f816ea00640 1 -- 172.21.15.159:0/3986469513 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v40) v1 ==== 107+0+5008 (secure 0 0 0) 0x7f8164059f40 con 0x7f817419caa0 2024-02-28T23:22:44.529 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:44.529 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":36,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44283,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2221421248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2221421248},{"type":"v1","addr":"172.21.15.184:6825","nonce":2221421248}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44311,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6827/146669833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":146669833},{"type":"v1","addr":"172.21.15.184:6827","nonce":146669833}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":36,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:20:07.478463+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34440":{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":0,"incarnation":32,"state":"up:active","state_seq":25,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:44.529 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 36 2024-02-28T23:22:44.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.532+0000 7f817c800640 1 -- 172.21.15.159:0/3986469513 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f815c06d810 msgr2=0x7f815c06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:44.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.532+0000 7f817c800640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f815c06d810 0x7f815c06fcd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8168036040 tx=0x7f8168000bc0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.532+0000 7f817c800640 1 -- 172.21.15.159:0/3986469513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f817419caa0 msgr2=0x7f81741a0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:44.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.532+0000 7f817c800640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f817419caa0 0x7f81741a0f00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f816400d720 tx=0x7f816400dbe0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.532+0000 7f817c800640 1 -- 172.21.15.159:0/3986469513 shutdown_connections 2024-02-28T23:22:44.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.532+0000 7f817c800640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f815c06d810 0x7f815c06fcd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.532+0000 7f817c800640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f817419caa0 0x7f81741a0f00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.532+0000 7f817c800640 1 --2- 172.21.15.159:0/3986469513 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f81741066a0 0x7f817419c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.532+0000 7f817c800640 1 -- 172.21.15.159:0/3986469513 >> 172.21.15.159:0/3986469513 conn(0x7f8174075e80 msgr2=0x7f8174077170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:44.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.532+0000 7f817c800640 1 -- 172.21.15.159:0/3986469513 shutdown_connections 2024-02-28T23:22:44.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.532+0000 7f817c800640 1 -- 172.21.15.159:0/3986469513 wait complete. 2024-02-28T23:22:44.548 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-02-28T23:22:44.548 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 37 2024-02-28T23:22:44.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.752+0000 7f1c18800640 1 -- 172.21.15.159:0/3909077013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c10102e70 msgr2=0x7f1c10106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:44.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.752+0000 7f1c18800640 1 --2- 172.21.15.159:0/3909077013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c10102e70 0x7f1c10106eb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f1c00009880 tx=0x7f1c0002bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.752+0000 7f1c18800640 1 -- 172.21.15.159:0/3909077013 shutdown_connections 2024-02-28T23:22:44.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.752+0000 7f1c18800640 1 --2- 172.21.15.159:0/3909077013 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c10102e70 0x7f1c10106eb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.752+0000 7f1c18800640 1 --2- 172.21.15.159:0/3909077013 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c101024c0 0x7f1c101028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.752+0000 7f1c18800640 1 -- 172.21.15.159:0/3909077013 >> 172.21.15.159:0/3909077013 conn(0x7f1c100fdd40 msgr2=0x7f1c10100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:44.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.752+0000 7f1c18800640 1 -- 172.21.15.159:0/3909077013 shutdown_connections 2024-02-28T23:22:44.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.752+0000 7f1c18800640 1 -- 172.21.15.159:0/3909077013 wait complete. 2024-02-28T23:22:44.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.753+0000 7f1c18800640 1 Processor -- start 2024-02-28T23:22:44.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.753+0000 7f1c18800640 1 -- start start 2024-02-28T23:22:44.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.753+0000 7f1c18800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c101024c0 0x7f1c10197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:44.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.753+0000 7f1c18800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c101984b0 0x7f1c1019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:44.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.753+0000 7f1c18800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10198ab0 con 0x7f1c101024c0 2024-02-28T23:22:44.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.753+0000 7f1c18800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c10198c20 con 0x7f1c101984b0 2024-02-28T23:22:44.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.754+0000 7f1c15e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c101024c0 0x7f1c10197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:44.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.754+0000 7f1c15e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c101024c0 0x7f1c10197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41824/0 (socket says 172.21.15.159:41824) 2024-02-28T23:22:44.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.754+0000 7f1c15e00640 1 -- 172.21.15.159:0/3492339112 learned_addr learned my addr 172.21.15.159:0/3492339112 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:44.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.754+0000 7f1c15400640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c101984b0 0x7f1c1019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:44.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.754+0000 7f1c15e00640 1 -- 172.21.15.159:0/3492339112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c101984b0 msgr2=0x7f1c1019c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:44.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.754+0000 7f1c15e00640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c101984b0 0x7f1c1019c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:44.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.754+0000 7f1c15e00640 1 -- 172.21.15.159:0/3492339112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c00009560 con 0x7f1c101024c0 2024-02-28T23:22:44.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.754+0000 7f1c15400640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c101984b0 0x7f1c1019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:22:44.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.754+0000 7f1c15e00640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c101024c0 0x7f1c10197f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800ea30 tx=0x7f1c0800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:44.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.754+0000 7f1c06a00640 1 -- 172.21.15.159:0/3492339112 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c0800cdb0 con 0x7f1c101024c0 2024-02-28T23:22:44.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.755+0000 7f1c06a00640 1 -- 172.21.15.159:0/3492339112 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f1c08005020 con 0x7f1c101024c0 2024-02-28T23:22:44.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.755+0000 7f1c06a00640 1 -- 172.21.15.159:0/3492339112 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c080116a0 con 0x7f1c101024c0 2024-02-28T23:22:44.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.755+0000 7f1c18800640 1 -- 172.21.15.159:0/3492339112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1019cf10 con 0x7f1c101024c0 2024-02-28T23:22:44.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.755+0000 7f1c18800640 1 -- 172.21.15.159:0/3492339112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1019d420 con 0x7f1c101024c0 2024-02-28T23:22:44.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.756+0000 7f1c18800640 1 -- 172.21.15.159:0/3492339112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1019d750 con 0x7f1c101024c0 2024-02-28T23:22:44.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.757+0000 7f1c06a00640 1 -- 172.21.15.159:0/3492339112 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f1c08005190 con 0x7f1c101024c0 2024-02-28T23:22:44.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.758+0000 7f1c06a00640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1bfc06d810 0x7f1bfc06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:44.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.758+0000 7f1c06a00640 1 -- 172.21.15.159:0/3492339112 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f1c0808db70 con 0x7f1c101024c0 2024-02-28T23:22:44.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.758+0000 7f1c15400640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1bfc06d810 0x7f1bfc06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:44.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.759+0000 7f1c15400640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1bfc06d810 0x7f1bfc06fcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1c00005ec0 tx=0x7f1c00005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:44.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.762+0000 7f1c06a00640 1 -- 172.21.15.159:0/3492339112 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f1c08057180 con 0x7f1c101024c0 2024-02-28T23:22:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:44 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2893990547' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-28T23:22:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:44 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/2725847946' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-28T23:22:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:44 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2893990547' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-02-28T23:22:44.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:44 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/2725847946' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-02-28T23:22:44.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:44.999+0000 7f1c18800640 1 -- 172.21.15.159:0/3492339112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f1c1004e040 con 0x7f1c101024c0 2024-02-28T23:22:45.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.001+0000 7f1c06a00640 1 -- 172.21.15.159:0/3492339112 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v40) v1 ==== 107+0+5008 (secure 0 0 0) 0x7f1c0805a840 con 0x7f1c101024c0 2024-02-28T23:22:45.001 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:45.001 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":37,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44283,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2221421248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2221421248},{"type":"v1","addr":"172.21.15.184:6825","nonce":2221421248}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44311,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6827/146669833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":146669833},{"type":"v1","addr":"172.21.15.184:6827","nonce":146669833}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:20:15.740775+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34440":{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":0,"incarnation":32,"state":"up:active","state_seq":25,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:45.001 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 37 2024-02-28T23:22:45.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.004+0000 7f1c18800640 1 -- 172.21.15.159:0/3492339112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1bfc06d810 msgr2=0x7f1bfc06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:45.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.004+0000 7f1c18800640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1bfc06d810 0x7f1bfc06fcd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f1c00005ec0 tx=0x7f1c00005fd0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.004+0000 7f1c18800640 1 -- 172.21.15.159:0/3492339112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c101024c0 msgr2=0x7f1c10197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:45.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.004+0000 7f1c18800640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c101024c0 0x7f1c10197f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1c0800ea30 tx=0x7f1c0800eef0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.004+0000 7f1c18800640 1 -- 172.21.15.159:0/3492339112 shutdown_connections 2024-02-28T23:22:45.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.004+0000 7f1c18800640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f1bfc06d810 0x7f1bfc06fcd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.004+0000 7f1c18800640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f1c101984b0 0x7f1c1019c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.004+0000 7f1c18800640 1 --2- 172.21.15.159:0/3492339112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1c101024c0 0x7f1c10197f70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.004+0000 7f1c18800640 1 -- 172.21.15.159:0/3492339112 >> 172.21.15.159:0/3492339112 conn(0x7f1c100fdd40 msgr2=0x7f1c100ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:45.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.005+0000 7f1c18800640 1 -- 172.21.15.159:0/3492339112 shutdown_connections 2024-02-28T23:22:45.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.005+0000 7f1c18800640 1 -- 172.21.15.159:0/3492339112 wait complete. 2024-02-28T23:22:45.022 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-02-28T23:22:45.022 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 38 2024-02-28T23:22:45.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.213+0000 7f335d800640 1 -- 172.21.15.159:0/2189500479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f335810c660 msgr2=0x7f335810ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:45.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.213+0000 7f335d800640 1 --2- 172.21.15.159:0/2189500479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f335810c660 0x7f335810ca40 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3348009880 tx=0x7f334802bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.213+0000 7f335d800640 1 -- 172.21.15.159:0/2189500479 shutdown_connections 2024-02-28T23:22:45.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.213+0000 7f335d800640 1 --2- 172.21.15.159:0/2189500479 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f33581066a0 0x7f3358106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.213+0000 7f335d800640 1 --2- 172.21.15.159:0/2189500479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f335810c660 0x7f335810ca40 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.213+0000 7f335d800640 1 -- 172.21.15.159:0/2189500479 >> 172.21.15.159:0/2189500479 conn(0x7f3358075e80 msgr2=0x7f33580782a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:45.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.213+0000 7f335d800640 1 -- 172.21.15.159:0/2189500479 shutdown_connections 2024-02-28T23:22:45.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.213+0000 7f335d800640 1 -- 172.21.15.159:0/2189500479 wait complete. 2024-02-28T23:22:45.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.214+0000 7f335d800640 1 Processor -- start 2024-02-28T23:22:45.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.214+0000 7f335d800640 1 -- start start 2024-02-28T23:22:45.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.214+0000 7f335d800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33581066a0 0x7f335819c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:45.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.214+0000 7f335d800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f335810c660 0x7f335819c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:45.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.214+0000 7f335d800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f335819cf70 con 0x7f33581066a0 2024-02-28T23:22:45.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.214+0000 7f335d800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33581a0d40 con 0x7f335810c660 2024-02-28T23:22:45.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.214+0000 7f3356a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33581066a0 0x7f335819c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:45.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.215+0000 7f3356a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33581066a0 0x7f335819c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41844/0 (socket says 172.21.15.159:41844) 2024-02-28T23:22:45.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.215+0000 7f3356a00640 1 -- 172.21.15.159:0/3321931193 learned_addr learned my addr 172.21.15.159:0/3321931193 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:45.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.215+0000 7f334e000640 1 --2- 172.21.15.159:0/3321931193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f335810c660 0x7f335819c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:45.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.215+0000 7f3356a00640 1 -- 172.21.15.159:0/3321931193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f335810c660 msgr2=0x7f335819c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:45.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.215+0000 7f3356a00640 1 --2- 172.21.15.159:0/3321931193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f335810c660 0x7f335819c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.215+0000 7f3356a00640 1 -- 172.21.15.159:0/3321931193 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3348009560 con 0x7f33581066a0 2024-02-28T23:22:45.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.215+0000 7f3356a00640 1 --2- 172.21.15.159:0/3321931193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33581066a0 0x7f335819c3a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3348009230 tx=0x7f3348004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:45.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.215+0000 7f334fe00640 1 -- 172.21.15.159:0/3321931193 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33480035f0 con 0x7f33581066a0 2024-02-28T23:22:45.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.215+0000 7f334fe00640 1 -- 172.21.15.159:0/3321931193 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f3348003c10 con 0x7f33581066a0 2024-02-28T23:22:45.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.216+0000 7f335d800640 1 -- 172.21.15.159:0/3321931193 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33581a0fc0 con 0x7f33581066a0 2024-02-28T23:22:45.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.216+0000 7f334fe00640 1 -- 172.21.15.159:0/3321931193 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3348005670 con 0x7f33581066a0 2024-02-28T23:22:45.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.216+0000 7f335d800640 1 -- 172.21.15.159:0/3321931193 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33581a14c0 con 0x7f33581066a0 2024-02-28T23:22:45.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.217+0000 7f335d800640 1 -- 172.21.15.159:0/3321931193 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f335804e040 con 0x7f33581066a0 2024-02-28T23:22:45.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.217+0000 7f334fe00640 1 -- 172.21.15.159:0/3321931193 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f3348004dd0 con 0x7f33581066a0 2024-02-28T23:22:45.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.218+0000 7f334fe00640 1 --2- 172.21.15.159:0/3321931193 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f333c06d810 0x7f333c06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:45.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.218+0000 7f334fe00640 1 -- 172.21.15.159:0/3321931193 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f33480afa00 con 0x7f33581066a0 2024-02-28T23:22:45.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.219+0000 7f334e000640 1 --2- 172.21.15.159:0/3321931193 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f333c06d810 0x7f333c06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:45.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.219+0000 7f334e000640 1 --2- 172.21.15.159:0/3321931193 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f333c06d810 0x7f333c06fcd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3340005fd0 tx=0x7f3340005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:45.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.223+0000 7f334fe00640 1 -- 172.21.15.159:0/3321931193 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f3348079090 con 0x7f33581066a0 2024-02-28T23:22:45.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.441+0000 7f335d800640 1 -- 172.21.15.159:0/3321931193 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7f335810ebc0 con 0x7f33581066a0 2024-02-28T23:22:45.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.442+0000 7f334fe00640 1 -- 172.21.15.159:0/3321931193 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v40) v1 ==== 107+0+5007 (secure 0 0 0) 0x7f3348081e60 con 0x7f33581066a0 2024-02-28T23:22:45.442 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:45.442 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":38,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":28},{"gid":44283,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2221421248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2221421248},{"type":"v1","addr":"172.21.15.184:6825","nonce":2221421248}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44311,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6827/146669833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":146669833},{"type":"v1","addr":"172.21.15.184:6827","nonce":146669833}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":38,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:20:16.743298+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34440":{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":0,"incarnation":32,"state":"up:active","state_seq":25,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:45.442 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 38 2024-02-28T23:22:45.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.445+0000 7f335d800640 1 -- 172.21.15.159:0/3321931193 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f333c06d810 msgr2=0x7f333c06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:45.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.445+0000 7f335d800640 1 --2- 172.21.15.159:0/3321931193 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f333c06d810 0x7f333c06fcd0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3340005fd0 tx=0x7f3340005850 comp rx=0 tx=0).stop 2024-02-28T23:22:45.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.445+0000 7f335d800640 1 -- 172.21.15.159:0/3321931193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33581066a0 msgr2=0x7f335819c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.445+0000 7f335d800640 1 --2- 172.21.15.159:0/3321931193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33581066a0 0x7f335819c3a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f3348009230 tx=0x7f3348004040 comp rx=0 tx=0).stop 2024-02-28T23:22:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.445+0000 7f335d800640 1 -- 172.21.15.159:0/3321931193 shutdown_connections 2024-02-28T23:22:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.445+0000 7f335d800640 1 --2- 172.21.15.159:0/3321931193 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f333c06d810 0x7f333c06fcd0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.445+0000 7f335d800640 1 --2- 172.21.15.159:0/3321931193 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f335810c660 0x7f335819c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.445+0000 7f335d800640 1 --2- 172.21.15.159:0/3321931193 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f33581066a0 0x7f335819c3a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.445+0000 7f335d800640 1 -- 172.21.15.159:0/3321931193 >> 172.21.15.159:0/3321931193 conn(0x7f3358075e80 msgr2=0x7f3358076b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.445+0000 7f335d800640 1 -- 172.21.15.159:0/3321931193 shutdown_connections 2024-02-28T23:22:45.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.445+0000 7f335d800640 1 -- 172.21.15.159:0/3321931193 wait complete. 2024-02-28T23:22:45.462 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 39 2024-02-28T23:22:45.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.675+0000 7fabf4a00640 1 -- 172.21.15.159:0/4096678432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf01022e0 msgr2=0x7fabf01026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:45.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.675+0000 7fabf4a00640 1 --2- 172.21.15.159:0/4096678432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf01022e0 0x7fabf01026c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fabe0009880 tx=0x7fabe002bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.675+0000 7fabf4a00640 1 -- 172.21.15.159:0/4096678432 shutdown_connections 2024-02-28T23:22:45.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.675+0000 7fabf4a00640 1 --2- 172.21.15.159:0/4096678432 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabf0102c90 0x7fabf0106cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.675+0000 7fabf4a00640 1 --2- 172.21.15.159:0/4096678432 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf01022e0 0x7fabf01026c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.675+0000 7fabf4a00640 1 -- 172.21.15.159:0/4096678432 >> 172.21.15.159:0/4096678432 conn(0x7fabf00fdb20 msgr2=0x7fabf00fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:45.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.675+0000 7fabf4a00640 1 -- 172.21.15.159:0/4096678432 shutdown_connections 2024-02-28T23:22:45.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.675+0000 7fabf4a00640 1 -- 172.21.15.159:0/4096678432 wait complete. 2024-02-28T23:22:45.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.676+0000 7fabf4a00640 1 Processor -- start 2024-02-28T23:22:45.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.676+0000 7fabf4a00640 1 -- start start 2024-02-28T23:22:45.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.676+0000 7fabf4a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabf01022e0 0x7fabf0197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:45.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.676+0000 7fabf4a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf01983c0 0x7fabf019c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:45.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.676+0000 7fabf4a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf01989c0 con 0x7fabf01983c0 2024-02-28T23:22:45.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.676+0000 7fabf4a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabf0198b30 con 0x7fabf01022e0 2024-02-28T23:22:45.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.677+0000 7fabede00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf01983c0 0x7fabf019c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:45.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.677+0000 7fabede00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf01983c0 0x7fabf019c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41848/0 (socket says 172.21.15.159:41848) 2024-02-28T23:22:45.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.677+0000 7fabede00640 1 -- 172.21.15.159:0/588383798 learned_addr learned my addr 172.21.15.159:0/588383798 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:45.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.677+0000 7fabee800640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabf01022e0 0x7fabf0197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:45.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.677+0000 7fabede00640 1 -- 172.21.15.159:0/588383798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabf01022e0 msgr2=0x7fabf0197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:45.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.677+0000 7fabede00640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabf01022e0 0x7fabf0197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.677+0000 7fabede00640 1 -- 172.21.15.159:0/588383798 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabe0009560 con 0x7fabf01983c0 2024-02-28T23:22:45.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.677+0000 7fabee800640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabf01022e0 0x7fabf0197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-02-28T23:22:45.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.678+0000 7fabede00640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf01983c0 0x7fabf019c820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00c920 tx=0x7fabdc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:45.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.678+0000 7fabe7400640 1 -- 172.21.15.159:0/588383798 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabdc007b80 con 0x7fabf01983c0 2024-02-28T23:22:45.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.678+0000 7fabe7400640 1 -- 172.21.15.159:0/588383798 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fabdc007ce0 con 0x7fabf01983c0 2024-02-28T23:22:45.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.678+0000 7fabf4a00640 1 -- 172.21.15.159:0/588383798 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabf019ce20 con 0x7fabf01983c0 2024-02-28T23:22:45.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.678+0000 7fabe7400640 1 -- 172.21.15.159:0/588383798 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fabdc0187d0 con 0x7fabf01983c0 2024-02-28T23:22:45.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.678+0000 7fabf4a00640 1 -- 172.21.15.159:0/588383798 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabf019d380 con 0x7fabf01983c0 2024-02-28T23:22:45.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.680+0000 7fabf4a00640 1 -- 172.21.15.159:0/588383798 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabf004e040 con 0x7fabf01983c0 2024-02-28T23:22:45.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.681+0000 7fabe7400640 1 -- 172.21.15.159:0/588383798 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fabdc00f450 con 0x7fabf01983c0 2024-02-28T23:22:45.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.682+0000 7fabe7400640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fabd406d810 0x7fabd406fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:45.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.682+0000 7fabe7400640 1 -- 172.21.15.159:0/588383798 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fabdc08d6e0 con 0x7fabf01983c0 2024-02-28T23:22:45.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.682+0000 7fabee800640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fabd406d810 0x7fabd406fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:45.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.683+0000 7fabee800640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fabd406d810 0x7fabd406fcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fabe002c8b0 tx=0x7fabe0000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:45.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.687+0000 7fabe7400640 1 -- 172.21.15.159:0/588383798 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fabdc056e10 con 0x7fabf01983c0 2024-02-28T23:22:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:45 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3986469513' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-28T23:22:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:45 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3492339112' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-28T23:22:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:45 smithi159 ceph-mon[113833]: pgmap v352: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:45.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:45 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3321931193' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-28T23:22:45.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:45 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3986469513' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-02-28T23:22:45.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:45 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3492339112' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-02-28T23:22:45.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:45 smithi184 ceph-mon[86482]: pgmap v352: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:45.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:45 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3321931193' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-02-28T23:22:45.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.923+0000 7fabf4a00640 1 -- 172.21.15.159:0/588383798 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7fabf01991d0 con 0x7fabf01983c0 2024-02-28T23:22:45.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.924+0000 7fabe7400640 1 -- 172.21.15.159:0/588383798 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v40) v1 ==== 107+0+5014 (secure 0 0 0) 0x7fabdc05a4d0 con 0x7fabf01983c0 2024-02-28T23:22:45.924 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:45.924 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44283,"name":"cephfs.smithi184.azwkfx","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6825/2221421248","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6824","nonce":2221421248},{"type":"v1","addr":"172.21.15.184:6825","nonce":2221421248}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":30},{"gid":44311,"name":"cephfs.smithi184.pnifob","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.184:6827/146669833","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6826","nonce":146669833},{"type":"v1","addr":"172.21.15.184:6827","nonce":146669833}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-02-28T23:03:22.377936+0000","modified":"2024-02-28T23:20:17.750020+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":102,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":34440},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34440":{"gid":34440,"name":"cephfs.smithi159.mbaqic","rank":0,"incarnation":32,"state":"up:active","state_seq":25,"addr":"172.21.15.159:6827/3438650790","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3438650790},{"type":"v1","addr":"172.21.15.159:6827","nonce":3438650790}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_34476":{"gid":34476,"name":"cephfs.smithi159.azxrct","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.159:6829/1030084771","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6828","nonce":1030084771},{"type":"v1","addr":"172.21.15.159:6829","nonce":1030084771}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-02-28T23:22:45.924 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 39 2024-02-28T23:22:45.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.927+0000 7fabf4a00640 1 -- 172.21.15.159:0/588383798 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fabd406d810 msgr2=0x7fabd406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:45.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.927+0000 7fabf4a00640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fabd406d810 0x7fabd406fcd0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fabe002c8b0 tx=0x7fabe0000bc0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.927+0000 7fabf4a00640 1 -- 172.21.15.159:0/588383798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf01983c0 msgr2=0x7fabf019c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:45.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.927+0000 7fabf4a00640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf01983c0 0x7fabf019c820 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fabdc00c920 tx=0x7fabdc00cde0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.927+0000 7fabf4a00640 1 -- 172.21.15.159:0/588383798 shutdown_connections 2024-02-28T23:22:45.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.927+0000 7fabf4a00640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fabd406d810 0x7fabd406fcd0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.927+0000 7fabf4a00640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fabf01983c0 0x7fabf019c820 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.927+0000 7fabf4a00640 1 --2- 172.21.15.159:0/588383798 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fabf01022e0 0x7fabf0197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:45.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.927+0000 7fabf4a00640 1 -- 172.21.15.159:0/588383798 >> 172.21.15.159:0/588383798 conn(0x7fabf00fdb20 msgr2=0x7fabf00ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:45.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.928+0000 7fabf4a00640 1 -- 172.21.15.159:0/588383798 shutdown_connections 2024-02-28T23:22:45.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:45.928+0000 7fabf4a00640 1 -- 172.21.15.159:0/588383798 wait complete. 2024-02-28T23:22:45.943 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-02-28T23:22:45.954 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-02-28T23:22:45.955 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T23:22:45.955 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T23:22:46.007 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T23:22:46.007 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T23:22:46.056 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T23:22:46.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.317+0000 7fde7b800640 1 -- 172.21.15.159:0/835263577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde74072f60 msgr2=0x7fde74110ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:46.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.317+0000 7fde7b800640 1 --2- 172.21.15.159:0/835263577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde74072f60 0x7fde74110ad0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fde60009880 tx=0x7fde6002bd70 comp rx=0 tx=0).stop 2024-02-28T23:22:46.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.317+0000 7fde7b800640 1 -- 172.21.15.159:0/835263577 shutdown_connections 2024-02-28T23:22:46.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.317+0000 7fde7b800640 1 --2- 172.21.15.159:0/835263577 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde74072f60 0x7fde74110ad0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.317+0000 7fde7b800640 1 --2- 172.21.15.159:0/835263577 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde74072640 0x7fde74072a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.317+0000 7fde7b800640 1 -- 172.21.15.159:0/835263577 >> 172.21.15.159:0/835263577 conn(0x7fde740fbad0 msgr2=0x7fde740fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:46.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.317+0000 7fde7b800640 1 -- 172.21.15.159:0/835263577 shutdown_connections 2024-02-28T23:22:46.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.317+0000 7fde7b800640 1 -- 172.21.15.159:0/835263577 wait complete. 2024-02-28T23:22:46.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.318+0000 7fde7b800640 1 Processor -- start 2024-02-28T23:22:46.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.318+0000 7fde7b800640 1 -- start start 2024-02-28T23:22:46.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.319+0000 7fde7b800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde74072640 0x7fde7419c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:46.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.319+0000 7fde7b800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde74072f60 0x7fde7419c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:46.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.319+0000 7fde7b800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7419cde0 con 0x7fde74072640 2024-02-28T23:22:46.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.319+0000 7fde7b800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde741a0bb0 con 0x7fde74072f60 2024-02-28T23:22:46.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.319+0000 7fde78e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde74072640 0x7fde7419c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:46.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.319+0000 7fde78e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde74072640 0x7fde7419c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41862/0 (socket says 172.21.15.159:41862) 2024-02-28T23:22:46.319 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.319+0000 7fde78e00640 1 -- 172.21.15.159:0/3041723863 learned_addr learned my addr 172.21.15.159:0/3041723863 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:46.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.319+0000 7fde73e00640 1 --2- 172.21.15.159:0/3041723863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde74072f60 0x7fde7419c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:46.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.319+0000 7fde78e00640 1 -- 172.21.15.159:0/3041723863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde74072f60 msgr2=0x7fde7419c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:46.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.319+0000 7fde78e00640 1 --2- 172.21.15.159:0/3041723863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde74072f60 0x7fde7419c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.319+0000 7fde78e00640 1 -- 172.21.15.159:0/3041723863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde60009560 con 0x7fde74072640 2024-02-28T23:22:46.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.320+0000 7fde78e00640 1 --2- 172.21.15.159:0/3041723863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde74072640 0x7fde7419c210 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fde6800d8d0 tx=0x7fde6800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:46.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.320+0000 7fde71600640 1 -- 172.21.15.159:0/3041723863 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde6800bea0 con 0x7fde74072640 2024-02-28T23:22:46.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.320+0000 7fde71600640 1 -- 172.21.15.159:0/3041723863 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fde68009c00 con 0x7fde74072640 2024-02-28T23:22:46.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.320+0000 7fde71600640 1 -- 172.21.15.159:0/3041723863 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fde6800f710 con 0x7fde74072640 2024-02-28T23:22:46.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.320+0000 7fde7b800640 1 -- 172.21.15.159:0/3041723863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde741a0e90 con 0x7fde74072640 2024-02-28T23:22:46.320 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.320+0000 7fde7b800640 1 -- 172.21.15.159:0/3041723863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde741a13c0 con 0x7fde74072640 2024-02-28T23:22:46.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.321+0000 7fde7b800640 1 -- 172.21.15.159:0/3041723863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde7404e040 con 0x7fde74072640 2024-02-28T23:22:46.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.323+0000 7fde71600640 1 -- 172.21.15.159:0/3041723863 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fde68010460 con 0x7fde74072640 2024-02-28T23:22:46.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.324+0000 7fde71600640 1 --2- 172.21.15.159:0/3041723863 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5c06d8d0 0x7fde5c06fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:46.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.324+0000 7fde71600640 1 -- 172.21.15.159:0/3041723863 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fde6808d2c0 con 0x7fde74072640 2024-02-28T23:22:46.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.324+0000 7fde73e00640 1 --2- 172.21.15.159:0/3041723863 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5c06d8d0 0x7fde5c06fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:46.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.325+0000 7fde73e00640 1 --2- 172.21.15.159:0/3041723863 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5c06d8d0 0x7fde5c06fd90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde60000c00 tx=0x7fde60005a20 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:46.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.329+0000 7fde71600640 1 -- 172.21.15.159:0/3041723863 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fde680569f0 con 0x7fde74072640 2024-02-28T23:22:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.532+0000 7fde7b800640 1 -- 172.21.15.159:0/3041723863 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde7410e1c0 con 0x7fde74072640 2024-02-28T23:22:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.535+0000 7fde71600640 1 -- 172.21.15.159:0/3041723863 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+17259 (secure 0 0 0) 0x7fde6805a0b0 con 0x7fde74072640 2024-02-28T23:22:46.535 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:46.535 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":102,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","created":"2024-02-28T22:54:07.259600+0000","modified":"2024-02-28T23:19:57.396295+0000","last_up_change":"2024-02-28T23:18:21.299156+0000","last_in_change":"2024-02-28T23:01:21.082396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T23:00:05.643400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T23:03:21.113072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T23:03:21.891379+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"12a358ec-2348-437f-a587-c75299c13814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":64,"up_thru":95,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6803","nonce":3232134603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6805","nonce":3232134603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6809","nonce":3232134603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6807","nonce":3232134603}]},"public_addr":"172.21.15.159:6803/3232134603","cluster_addr":"172.21.15.159:6805/3232134603","heartbeat_back_addr":"172.21.15.159:6809/3232134603","heartbeat_front_addr":"172.21.15.159:6807/3232134603","state":["exists","up"]},{"osd":1,"uuid":"34a65dc7-3bd8-4cb5-b61b-e04166f115c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":71,"up_from":75,"up_thru":95,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6811","nonce":3750692109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6813","nonce":3750692109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6817","nonce":3750692109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6815","nonce":3750692109}]},"public_addr":"172.21.15.159:6811/3750692109","cluster_addr":"172.21.15.159:6813/3750692109","heartbeat_back_addr":"172.21.15.159:6817/3750692109","heartbeat_front_addr":"172.21.15.159:6815/3750692109","state":["exists","up"]},{"osd":2,"uuid":"a712ee56-f8b8-43c4-9f38-33ebe33b7977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":76,"up_from":80,"up_thru":95,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6819","nonce":1285075477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6821","nonce":1285075477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6825","nonce":1285075477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6823","nonce":1285075477}]},"public_addr":"172.21.15.159:6819/1285075477","cluster_addr":"172.21.15.159:6821/1285075477","heartbeat_back_addr":"172.21.15.159:6825/1285075477","heartbeat_front_addr":"172.21.15.159:6823/1285075477","state":["exists","up"]},{"osd":3,"uuid":"bb2d95db-29e3-4e8d-bcea-ed52ae538c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":81,"up_from":85,"up_thru":95,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6801","nonce":29498664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6803","nonce":29498664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6807","nonce":29498664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6805","nonce":29498664}]},"public_addr":"172.21.15.184:6801/29498664","cluster_addr":"172.21.15.184:6803/29498664","heartbeat_back_addr":"172.21.15.184:6807/29498664","heartbeat_front_addr":"172.21.15.184:6805/29498664","state":["exists","up"]},{"osd":4,"uuid":"55d22d45-549c-4a55-8a36-7aa785561068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":86,"up_from":90,"up_thru":95,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6809","nonce":1173196285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6811","nonce":1173196285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6815","nonce":1173196285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6813","nonce":1173196285}]},"public_addr":"172.21.15.184:6809/1173196285","cluster_addr":"172.21.15.184:6811/1173196285","heartbeat_back_addr":"172.21.15.184:6815/1173196285","heartbeat_front_addr":"172.21.15.184:6813/1173196285","state":["exists","up"]},{"osd":5,"uuid":"eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":91,"up_from":95,"up_thru":95,"down_at":92,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6817","nonce":1609921388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6819","nonce":1609921388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6823","nonce":1609921388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6821","nonce":1609921388}]},"public_addr":"172.21.15.184:6817/1609921388","cluster_addr":"172.21.15.184:6819/1609921388","heartbeat_back_addr":"172.21.15.184:6823/1609921388","heartbeat_front_addr":"172.21.15.184:6821/1609921388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:58:47.192772+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:59:24.679857+0000","dead_epoch":71},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:03.155438+0000","dead_epoch":76},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:35.629938+0000","dead_epoch":81},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:09.895470+0000","dead_epoch":86},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:43.528444+0000","dead_epoch":91}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":3,"to":2}]},{"pgid":"2.6","mappings":[{"from":3,"to":0}]},{"pgid":"2.7","mappings":[{"from":3,"to":0}]},{"pgid":"3.0","mappings":[{"from":4,"to":5}]},{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.b","mappings":[{"from":1,"to":2}]},{"pgid":"3.12","mappings":[{"from":3,"to":5}]},{"pgid":"3.1c","mappings":[{"from":4,"to":0}]},{"pgid":"3.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6827/3142391154":"2024-02-29T23:19:57.396251+0000","172.21.15.184:6826/3142391154":"2024-02-29T23:19:57.396251+0000","172.21.15.159:6829/455979918":"2024-02-29T23:18:59.875868+0000","172.21.15.159:0/2648380137":"2024-02-29T23:12:53.028717+0000","172.21.15.159:0/1337780901":"2024-02-29T22:57:04.937279+0000","172.21.15.184:6829/2879526003":"2024-02-29T23:07:58.913608+0000","172.21.15.159:0/74577353":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/3426997920":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6827/1702728557":"2024-02-29T23:03:41.473671+0000","172.21.15.159:0/2943793350":"2024-02-29T23:12:53.028717+0000","172.21.15.184:0/1788579887":"2024-02-29T23:07:58.913608+0000","172.21.15.184:0/3999545682":"2024-02-29T23:07:58.913608+0000","172.21.15.159:0/3798912796":"2024-02-29T23:06:27.595745+0000","172.21.15.159:6826/1702728557":"2024-02-29T23:03:41.473671+0000","172.21.15.159:0/3945263774":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/2053056032":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6801/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:0/528876824":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6800/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:0/1021838933":"2024-02-29T23:12:53.028717+0000","172.21.15.159:0/2242263974":"2024-02-29T22:57:04.937279+0000","172.21.15.159:6800/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.159:6801/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.184:6828/2879526003":"2024-02-29T23:07:58.913608+0000","172.21.15.184:0/862687661":"2024-02-29T23:07:58.913608+0000","172.21.15.184:0/419508658":"2024-02-29T23:07:58.913608+0000","172.21.15.159:6800/3612719472":"2024-02-29T23:12:53.028717+0000","172.21.15.159:6828/455979918":"2024-02-29T23:18:59.875868+0000","172.21.15.159:6801/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/2466956559":"2024-02-29T23:06:27.595745+0000","172.21.15.159:0/656297432":"2024-02-29T23:06:27.595745+0000","172.21.15.159:0/423942112":"2024-02-29T22:54:49.969159+0000","172.21.15.184:0/4231789812":"2024-02-29T23:07:58.913608+0000","172.21.15.159:0/3397973227":"2024-02-29T23:06:27.595745+0000","172.21.15.159:0/3456040694":"2024-02-29T22:54:49.969159+0000","172.21.15.184:0/2145262352":"2024-02-29T23:07:58.913608+0000","172.21.15.159:6800/1861094655":"2024-02-29T23:06:27.595745+0000","172.21.15.159:6801/1861094655":"2024-02-29T23:06:27.595745+0000","172.21.15.159:6801/3612719472":"2024-02-29T23:12:53.028717+0000","172.21.15.159:6800/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/844515011":"2024-02-29T23:12:53.028717+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T23:22:46.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.538+0000 7fde7b800640 1 -- 172.21.15.159:0/3041723863 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5c06d8d0 msgr2=0x7fde5c06fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:46.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.538+0000 7fde7b800640 1 --2- 172.21.15.159:0/3041723863 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5c06d8d0 0x7fde5c06fd90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fde60000c00 tx=0x7fde60005a20 comp rx=0 tx=0).stop 2024-02-28T23:22:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.538+0000 7fde7b800640 1 -- 172.21.15.159:0/3041723863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde74072640 msgr2=0x7fde7419c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.538+0000 7fde7b800640 1 --2- 172.21.15.159:0/3041723863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde74072640 0x7fde7419c210 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fde6800d8d0 tx=0x7fde6800dd90 comp rx=0 tx=0).stop 2024-02-28T23:22:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.538+0000 7fde7b800640 1 -- 172.21.15.159:0/3041723863 shutdown_connections 2024-02-28T23:22:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.538+0000 7fde7b800640 1 --2- 172.21.15.159:0/3041723863 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fde5c06d8d0 0x7fde5c06fd90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.538+0000 7fde7b800640 1 --2- 172.21.15.159:0/3041723863 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fde74072f60 0x7fde7419c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.538+0000 7fde7b800640 1 --2- 172.21.15.159:0/3041723863 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fde74072640 0x7fde7419c210 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.538+0000 7fde7b800640 1 -- 172.21.15.159:0/3041723863 >> 172.21.15.159:0/3041723863 conn(0x7fde740fbad0 msgr2=0x7fde741025e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.539+0000 7fde7b800640 1 -- 172.21.15.159:0/3041723863 shutdown_connections 2024-02-28T23:22:46.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.539+0000 7fde7b800640 1 -- 172.21.15.159:0/3041723863 wait complete. 2024-02-28T23:22:46.556 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T23:00:05.643400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T23:03:21.113072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T23:03:21.891379+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T23:22:46.556 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T23:22:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.767+0000 7f2698600640 1 -- 172.21.15.159:0/111998870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2690102e70 msgr2=0x7f2690106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.767+0000 7f2698600640 1 --2- 172.21.15.159:0/111998870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2690102e70 0x7f2690106eb0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f267c009880 tx=0x7f267c02bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.767+0000 7f2698600640 1 -- 172.21.15.159:0/111998870 shutdown_connections 2024-02-28T23:22:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.767+0000 7f2698600640 1 --2- 172.21.15.159:0/111998870 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2690102e70 0x7f2690106eb0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.767+0000 7f2698600640 1 --2- 172.21.15.159:0/111998870 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26901024c0 0x7f26901028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.767+0000 7f2698600640 1 -- 172.21.15.159:0/111998870 >> 172.21.15.159:0/111998870 conn(0x7f26900fdd40 msgr2=0x7f2690100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.767+0000 7f2698600640 1 -- 172.21.15.159:0/111998870 shutdown_connections 2024-02-28T23:22:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.767+0000 7f2698600640 1 -- 172.21.15.159:0/111998870 wait complete. 2024-02-28T23:22:46.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.768+0000 7f2698600640 1 Processor -- start 2024-02-28T23:22:46.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.768+0000 7f2698600640 1 -- start start 2024-02-28T23:22:46.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.769+0000 7f2698600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26901024c0 0x7f2690198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:46.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.769+0000 7f2698600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2690198560 0x7f269019c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:46.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.769+0000 7f2698600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2690198ad0 con 0x7f2690198560 2024-02-28T23:22:46.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.769+0000 7f2698600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2690198c40 con 0x7f26901024c0 2024-02-28T23:22:46.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.769+0000 7f2695200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2690198560 0x7f269019c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:46.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.769+0000 7f2695200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2690198560 0x7f269019c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41878/0 (socket says 172.21.15.159:41878) 2024-02-28T23:22:46.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.769+0000 7f2695200640 1 -- 172.21.15.159:0/1542317834 learned_addr learned my addr 172.21.15.159:0/1542317834 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:46.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.769+0000 7f2695c00640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26901024c0 0x7f2690198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:46.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.769+0000 7f2695200640 1 -- 172.21.15.159:0/1542317834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26901024c0 msgr2=0x7f2690198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:46.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.770+0000 7f2695200640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26901024c0 0x7f2690198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.770+0000 7f2695200640 1 -- 172.21.15.159:0/1542317834 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f267c009560 con 0x7f2690198560 2024-02-28T23:22:46.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.770+0000 7f2695c00640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26901024c0 0x7f2690198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-02-28T23:22:46.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.770+0000 7f2695200640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2690198560 0x7f269019c9c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f267c036040 tx=0x7f267c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.770+0000 7f268e000640 1 -- 172.21.15.159:0/1542317834 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f267c0035f0 con 0x7f2690198560 2024-02-28T23:22:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.770+0000 7f268e000640 1 -- 172.21.15.159:0/1542317834 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f267c003c10 con 0x7f2690198560 2024-02-28T23:22:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.770+0000 7f2698600640 1 -- 172.21.15.159:0/1542317834 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f269019cf60 con 0x7f2690198560 2024-02-28T23:22:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.770+0000 7f268e000640 1 -- 172.21.15.159:0/1542317834 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f267c034440 con 0x7f2690198560 2024-02-28T23:22:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.770+0000 7f2698600640 1 -- 172.21.15.159:0/1542317834 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f269019d470 con 0x7f2690198560 2024-02-28T23:22:46.771 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:46 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/588383798' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-28T23:22:46.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.772+0000 7f2698600640 1 -- 172.21.15.159:0/1542317834 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f269004e040 con 0x7f2690198560 2024-02-28T23:22:46.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.772+0000 7f268e000640 1 -- 172.21.15.159:0/1542317834 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f267c003750 con 0x7f2690198560 2024-02-28T23:22:46.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.773+0000 7f268e000640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f267806d810 0x7f267806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:46.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.773+0000 7f268e000640 1 -- 172.21.15.159:0/1542317834 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f267c0afb00 con 0x7f2690198560 2024-02-28T23:22:46.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.774+0000 7f2695c00640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f267806d810 0x7f267806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:46.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.774+0000 7f2695c00640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f267806d810 0x7f267806fcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f268400baa0 tx=0x7f2684005d90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:46.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.778+0000 7f268e000640 1 -- 172.21.15.159:0/1542317834 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f267c0791b0 con 0x7f2690198560 2024-02-28T23:22:46.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:46 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/588383798' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-02-28T23:22:46.975 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.976+0000 7f2698600640 1 -- 172.21.15.159:0/1542317834 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2690199370 con 0x7f2690198560 2024-02-28T23:22:46.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.977+0000 7f268e000640 1 -- 172.21.15.159:0/1542317834 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7f267c07c870 con 0x7f2690198560 2024-02-28T23:22:46.976 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 1 2024-02-28T23:22:46.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.979+0000 7f2698600640 1 -- 172.21.15.159:0/1542317834 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f267806d810 msgr2=0x7f267806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:46.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.979+0000 7f2698600640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f267806d810 0x7f267806fcd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f268400baa0 tx=0x7f2684005d90 comp rx=0 tx=0).stop 2024-02-28T23:22:46.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.979+0000 7f2698600640 1 -- 172.21.15.159:0/1542317834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2690198560 msgr2=0x7f269019c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:46.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.979+0000 7f2698600640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2690198560 0x7f269019c9c0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f267c036040 tx=0x7f267c004040 comp rx=0 tx=0).stop 2024-02-28T23:22:46.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.980+0000 7f2698600640 1 -- 172.21.15.159:0/1542317834 shutdown_connections 2024-02-28T23:22:46.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.980+0000 7f2698600640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f267806d810 0x7f267806fcd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.980+0000 7f2698600640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2690198560 0x7f269019c9c0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.980+0000 7f2698600640 1 --2- 172.21.15.159:0/1542317834 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f26901024c0 0x7f2690198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:46.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.980+0000 7f2698600640 1 -- 172.21.15.159:0/1542317834 >> 172.21.15.159:0/1542317834 conn(0x7f26900fdd40 msgr2=0x7f26900ff410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:46.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.980+0000 7f2698600640 1 -- 172.21.15.159:0/1542317834 shutdown_connections 2024-02-28T23:22:46.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:46.980+0000 7f2698600640 1 -- 172.21.15.159:0/1542317834 wait complete. 2024-02-28T23:22:46.998 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T23:22:47.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.214+0000 7fbd97600640 1 -- 172.21.15.159:0/4093093492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd901066a0 msgr2=0x7fbd90106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:47.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.214+0000 7fbd97600640 1 --2- 172.21.15.159:0/4093093492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd901066a0 0x7fbd90106b20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009880 tx=0x7fbd7c02bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.215+0000 7fbd97600640 1 -- 172.21.15.159:0/4093093492 shutdown_connections 2024-02-28T23:22:47.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.215+0000 7fbd97600640 1 --2- 172.21.15.159:0/4093093492 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd901066a0 0x7fbd90106b20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.215+0000 7fbd97600640 1 --2- 172.21.15.159:0/4093093492 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd9010c660 0x7fbd9010ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.215+0000 7fbd97600640 1 -- 172.21.15.159:0/4093093492 >> 172.21.15.159:0/4093093492 conn(0x7fbd90075e80 msgr2=0x7fbd900782a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:47.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.215+0000 7fbd97600640 1 -- 172.21.15.159:0/4093093492 shutdown_connections 2024-02-28T23:22:47.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.215+0000 7fbd97600640 1 -- 172.21.15.159:0/4093093492 wait complete. 2024-02-28T23:22:47.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.216+0000 7fbd97600640 1 Processor -- start 2024-02-28T23:22:47.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.216+0000 7fbd97600640 1 -- start start 2024-02-28T23:22:47.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.216+0000 7fbd97600640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd901066a0 0x7fbd9019c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:47.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.216+0000 7fbd97600640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9010c660 0x7fbd9019c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:47.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.216+0000 7fbd97600640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9019cf10 con 0x7fbd9010c660 2024-02-28T23:22:47.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.216+0000 7fbd97600640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd901a0ce0 con 0x7fbd901066a0 2024-02-28T23:22:47.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.216+0000 7fbd8fe00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9010c660 0x7fbd9019c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:47.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.216+0000 7fbd8fe00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9010c660 0x7fbd9019c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41900/0 (socket says 172.21.15.159:41900) 2024-02-28T23:22:47.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.216+0000 7fbd8fe00640 1 -- 172.21.15.159:0/3286160423 learned_addr learned my addr 172.21.15.159:0/3286160423 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:47.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.217+0000 7fbd94c00640 1 --2- 172.21.15.159:0/3286160423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd901066a0 0x7fbd9019c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:47.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.217+0000 7fbd8fe00640 1 -- 172.21.15.159:0/3286160423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd901066a0 msgr2=0x7fbd9019c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:47.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.217+0000 7fbd8fe00640 1 --2- 172.21.15.159:0/3286160423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd901066a0 0x7fbd9019c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.217+0000 7fbd8fe00640 1 -- 172.21.15.159:0/3286160423 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7c009560 con 0x7fbd9010c660 2024-02-28T23:22:47.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.217+0000 7fbd8fe00640 1 --2- 172.21.15.159:0/3286160423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9010c660 0x7fbd9019c880 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009230 tx=0x7fbd7c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:47.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.217+0000 7fbd8d600640 1 -- 172.21.15.159:0/3286160423 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd7c0035f0 con 0x7fbd9010c660 2024-02-28T23:22:47.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.217+0000 7fbd8d600640 1 -- 172.21.15.159:0/3286160423 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fbd7c003c10 con 0x7fbd9010c660 2024-02-28T23:22:47.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.217+0000 7fbd97600640 1 -- 172.21.15.159:0/3286160423 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd901a0f60 con 0x7fbd9010c660 2024-02-28T23:22:47.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.218+0000 7fbd8d600640 1 -- 172.21.15.159:0/3286160423 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbd7c005670 con 0x7fbd9010c660 2024-02-28T23:22:47.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.218+0000 7fbd97600640 1 -- 172.21.15.159:0/3286160423 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd901a1460 con 0x7fbd9010c660 2024-02-28T23:22:47.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.219+0000 7fbd97600640 1 -- 172.21.15.159:0/3286160423 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9004e040 con 0x7fbd9010c660 2024-02-28T23:22:47.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.220+0000 7fbd8d600640 1 -- 172.21.15.159:0/3286160423 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fbd7c004dd0 con 0x7fbd9010c660 2024-02-28T23:22:47.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.221+0000 7fbd8d600640 1 --2- 172.21.15.159:0/3286160423 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbd7806d810 0x7fbd7806fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:47.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.221+0000 7fbd8d600640 1 -- 172.21.15.159:0/3286160423 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fbd7c0af910 con 0x7fbd9010c660 2024-02-28T23:22:47.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.221+0000 7fbd94c00640 1 --2- 172.21.15.159:0/3286160423 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbd7806d810 0x7fbd7806fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:47.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.222+0000 7fbd94c00640 1 --2- 172.21.15.159:0/3286160423 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbd7806d810 0x7fbd7806fcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbd84005fd0 tx=0x7fbd84005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:47.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.226+0000 7fbd8d600640 1 -- 172.21.15.159:0/3286160423 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fbd7c079040 con 0x7fbd9010c660 2024-02-28T23:22:47.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.423+0000 7fbd97600640 1 -- 172.21.15.159:0/3286160423 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fbd901138e0 con 0x7fbd9010c660 2024-02-28T23:22:47.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.424+0000 7fbd8d600640 1 -- 172.21.15.159:0/3286160423 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v102) v1 ==== 107+0+11 (secure 0 0 0) 0x7fbd7c07c700 con 0x7fbd9010c660 2024-02-28T23:22:47.424 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-02-28T23:22:47.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.427+0000 7fbd97600640 1 -- 172.21.15.159:0/3286160423 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbd7806d810 msgr2=0x7fbd7806fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:47.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.427+0000 7fbd97600640 1 --2- 172.21.15.159:0/3286160423 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbd7806d810 0x7fbd7806fcd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbd84005fd0 tx=0x7fbd84005850 comp rx=0 tx=0).stop 2024-02-28T23:22:47.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.427+0000 7fbd97600640 1 -- 172.21.15.159:0/3286160423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9010c660 msgr2=0x7fbd9019c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:47.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.427+0000 7fbd97600640 1 --2- 172.21.15.159:0/3286160423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9010c660 0x7fbd9019c880 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbd7c009230 tx=0x7fbd7c004040 comp rx=0 tx=0).stop 2024-02-28T23:22:47.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.427+0000 7fbd97600640 1 -- 172.21.15.159:0/3286160423 shutdown_connections 2024-02-28T23:22:47.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.427+0000 7fbd97600640 1 --2- 172.21.15.159:0/3286160423 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fbd7806d810 0x7fbd7806fcd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.427+0000 7fbd97600640 1 --2- 172.21.15.159:0/3286160423 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd9010c660 0x7fbd9019c880 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.427+0000 7fbd97600640 1 --2- 172.21.15.159:0/3286160423 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fbd901066a0 0x7fbd9019c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.427+0000 7fbd97600640 1 -- 172.21.15.159:0/3286160423 >> 172.21.15.159:0/3286160423 conn(0x7fbd90075e80 msgr2=0x7fbd90076aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:47.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.427+0000 7fbd97600640 1 -- 172.21.15.159:0/3286160423 shutdown_connections 2024-02-28T23:22:47.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.427+0000 7fbd97600640 1 -- 172.21.15.159:0/3286160423 wait complete. 2024-02-28T23:22:47.443 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T23:22:47.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.642+0000 7f007b200640 1 -- 172.21.15.159:0/929360570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c100a70 msgr2=0x7f007c104ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:47.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.642+0000 7f007b200640 1 --2- 172.21.15.159:0/929360570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c100a70 0x7f007c104ab0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f0068009880 tx=0x7f006802bcf0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.642+0000 7f007b200640 1 -- 172.21.15.159:0/929360570 shutdown_connections 2024-02-28T23:22:47.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.642+0000 7f007b200640 1 --2- 172.21.15.159:0/929360570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c100a70 0x7f007c104ab0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.642+0000 7f007b200640 1 --2- 172.21.15.159:0/929360570 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c1000c0 0x7f007c1004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.642+0000 7f007b200640 1 -- 172.21.15.159:0/929360570 >> 172.21.15.159:0/929360570 conn(0x7f007c0fb920 msgr2=0x7f007c0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:47.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.642+0000 7f007b200640 1 -- 172.21.15.159:0/929360570 shutdown_connections 2024-02-28T23:22:47.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.643+0000 7f007b200640 1 -- 172.21.15.159:0/929360570 wait complete. 2024-02-28T23:22:47.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.643+0000 7f007b200640 1 Processor -- start 2024-02-28T23:22:47.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.643+0000 7f007b200640 1 -- start start 2024-02-28T23:22:47.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.644+0000 7f007b200640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c1000c0 0x7f007c0725a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.644+0000 7f007b200640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c072ae0 0x7f007c072f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.644+0000 7f007b200640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c1a1d90 con 0x7f007c1000c0 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.644+0000 7f007b200640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c1a1ed0 con 0x7f007c072ae0 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.644+0000 7f0079e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c1000c0 0x7f007c0725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.644+0000 7f0079e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c1000c0 0x7f007c0725a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:41926/0 (socket says 172.21.15.159:41926) 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.644+0000 7f0079e00640 1 -- 172.21.15.159:0/899793701 learned_addr learned my addr 172.21.15.159:0/899793701 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.644+0000 7f0079400640 1 --2- 172.21.15.159:0/899793701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c072ae0 0x7f007c072f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.644+0000 7f0079e00640 1 -- 172.21.15.159:0/899793701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c072ae0 msgr2=0x7f007c072f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.644+0000 7f0079e00640 1 --2- 172.21.15.159:0/899793701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c072ae0 0x7f007c072f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.644+0000 7f0079e00640 1 -- 172.21.15.159:0/899793701 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0068009560 con 0x7f007c1000c0 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.645+0000 7f0079e00640 1 --2- 172.21.15.159:0/899793701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c1000c0 0x7f007c0725a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c840 tx=0x7f006c00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.645+0000 7f0072a00640 1 -- 172.21.15.159:0/899793701 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006c0041f0 con 0x7f007c1000c0 2024-02-28T23:22:47.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.645+0000 7f0072a00640 1 -- 172.21.15.159:0/899793701 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f006c007e70 con 0x7f007c1000c0 2024-02-28T23:22:47.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.645+0000 7f0072a00640 1 -- 172.21.15.159:0/899793701 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f006c0049d0 con 0x7f007c1000c0 2024-02-28T23:22:47.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.645+0000 7f007b200640 1 -- 172.21.15.159:0/899793701 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c1a2010 con 0x7f007c1000c0 2024-02-28T23:22:47.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.645+0000 7f007b200640 1 -- 172.21.15.159:0/899793701 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c1a2520 con 0x7f007c1000c0 2024-02-28T23:22:47.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.646+0000 7f007b200640 1 -- 172.21.15.159:0/899793701 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c04e040 con 0x7f007c1000c0 2024-02-28T23:22:47.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.647+0000 7f0072a00640 1 -- 172.21.15.159:0/899793701 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f006c0079b0 con 0x7f007c1000c0 2024-02-28T23:22:47.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.648+0000 7f0072a00640 1 --2- 172.21.15.159:0/899793701 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f006006d810 0x7f006006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:47.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.648+0000 7f0072a00640 1 -- 172.21.15.159:0/899793701 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f006c08d500 con 0x7f007c1000c0 2024-02-28T23:22:47.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.648+0000 7f0079400640 1 --2- 172.21.15.159:0/899793701 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f006006d810 0x7f006006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:47.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.649+0000 7f0079400640 1 --2- 172.21.15.159:0/899793701 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f006006d810 0x7f006006fcd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f006802c8b0 tx=0x7f0068005fd0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:47.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.653+0000 7f0072a00640 1 -- 172.21.15.159:0/899793701 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f006c056b10 con 0x7f007c1000c0 2024-02-28T23:22:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:47 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3041723863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:22:47.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:47 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1542317834' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T23:22:47.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:47 smithi159 ceph-mon[113833]: pgmap v353: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:22:47.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:47 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3286160423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T23:22:47.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.847+0000 7f007b200640 1 -- 172.21.15.159:0/899793701 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f007c1083c0 con 0x7f007c1000c0 2024-02-28T23:22:47.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.848+0000 7f0072a00640 1 -- 172.21.15.159:0/899793701 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v102) v1 ==== 107+0+11 (secure 0 0 0) 0x7f006c05a1d0 con 0x7f007c1000c0 2024-02-28T23:22:47.847 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-02-28T23:22:47.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.850+0000 7f007b200640 1 -- 172.21.15.159:0/899793701 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f006006d810 msgr2=0x7f006006fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:47.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.850+0000 7f007b200640 1 --2- 172.21.15.159:0/899793701 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f006006d810 0x7f006006fcd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f006802c8b0 tx=0x7f0068005fd0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.850+0000 7f007b200640 1 -- 172.21.15.159:0/899793701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c1000c0 msgr2=0x7f007c0725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:47.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.850+0000 7f007b200640 1 --2- 172.21.15.159:0/899793701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c1000c0 0x7f007c0725a0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f006c00c840 tx=0x7f006c00cd00 comp rx=0 tx=0).stop 2024-02-28T23:22:47.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.850+0000 7f007b200640 1 -- 172.21.15.159:0/899793701 shutdown_connections 2024-02-28T23:22:47.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.850+0000 7f007b200640 1 --2- 172.21.15.159:0/899793701 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f006006d810 0x7f006006fcd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.850+0000 7f007b200640 1 --2- 172.21.15.159:0/899793701 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f007c072ae0 0x7f007c072f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.850+0000 7f007b200640 1 --2- 172.21.15.159:0/899793701 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f007c1000c0 0x7f007c0725a0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:47.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.850+0000 7f007b200640 1 -- 172.21.15.159:0/899793701 >> 172.21.15.159:0/899793701 conn(0x7f007c0fb920 msgr2=0x7f007c0fd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:47.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.851+0000 7f007b200640 1 -- 172.21.15.159:0/899793701 shutdown_connections 2024-02-28T23:22:47.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:47.851+0000 7f007b200640 1 -- 172.21.15.159:0/899793701 wait complete. 2024-02-28T23:22:47.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:47 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3041723863' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:22:47.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:47 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1542317834' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T23:22:47.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:47 smithi184 ceph-mon[86482]: pgmap v353: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:22:47.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:47 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3286160423' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T23:22:47.869 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-28T23:22:48.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.080+0000 7fb0c7400640 1 -- 172.21.15.159:0/172047220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c0072670 msgr2=0x7fb0c0072a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:48.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.080+0000 7fb0c7400640 1 --2- 172.21.15.159:0/172047220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c0072670 0x7fb0c0072a50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4009880 tx=0x7fb0b402bdc0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.080+0000 7fb0c7400640 1 -- 172.21.15.159:0/172047220 shutdown_connections 2024-02-28T23:22:48.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.080+0000 7fb0c7400640 1 --2- 172.21.15.159:0/172047220 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0072f90 0x7fb0c010c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.080+0000 7fb0c7400640 1 --2- 172.21.15.159:0/172047220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c0072670 0x7fb0c0072a50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.080+0000 7fb0c7400640 1 -- 172.21.15.159:0/172047220 >> 172.21.15.159:0/172047220 conn(0x7fb0c00fbad0 msgr2=0x7fb0c00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:48.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.080+0000 7fb0c7400640 1 -- 172.21.15.159:0/172047220 shutdown_connections 2024-02-28T23:22:48.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.080+0000 7fb0c7400640 1 -- 172.21.15.159:0/172047220 wait complete. 2024-02-28T23:22:48.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.081+0000 7fb0c7400640 1 Processor -- start 2024-02-28T23:22:48.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.081+0000 7fb0c7400640 1 -- start start 2024-02-28T23:22:48.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.082+0000 7fb0c7400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c0072670 0x7fb0c0197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:48.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.082+0000 7fb0c7400640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0072f90 0x7fb0c0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:48.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.082+0000 7fb0c7400640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c01989b0 con 0x7fb0c0072670 2024-02-28T23:22:48.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.082+0000 7fb0c7400640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c019c780 con 0x7fb0c0072f90 2024-02-28T23:22:48.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.082+0000 7fb0c4a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c0072670 0x7fb0c0197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:48.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.082+0000 7fb0c4a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c0072670 0x7fb0c0197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43904/0 (socket says 172.21.15.159:43904) 2024-02-28T23:22:48.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.082+0000 7fb0c4a00640 1 -- 172.21.15.159:0/596980225 learned_addr learned my addr 172.21.15.159:0/596980225 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:48.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.083+0000 7fb0bfe00640 1 --2- 172.21.15.159:0/596980225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0072f90 0x7fb0c0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:48.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.083+0000 7fb0c4a00640 1 -- 172.21.15.159:0/596980225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0072f90 msgr2=0x7fb0c0198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:48.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.083+0000 7fb0c4a00640 1 --2- 172.21.15.159:0/596980225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0072f90 0x7fb0c0198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.083+0000 7fb0c4a00640 1 -- 172.21.15.159:0/596980225 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b4009560 con 0x7fb0c0072670 2024-02-28T23:22:48.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.083+0000 7fb0c4a00640 1 --2- 172.21.15.159:0/596980225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c0072670 0x7fb0c0197de0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40099a0 tx=0x7fb0b4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:48.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.083+0000 7fb0bd600640 1 -- 172.21.15.159:0/596980225 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0b40035f0 con 0x7fb0c0072670 2024-02-28T23:22:48.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.083+0000 7fb0bd600640 1 -- 172.21.15.159:0/596980225 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fb0b4003c10 con 0x7fb0c0072670 2024-02-28T23:22:48.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.083+0000 7fb0bd600640 1 -- 172.21.15.159:0/596980225 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0b4005690 con 0x7fb0c0072670 2024-02-28T23:22:48.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.083+0000 7fb0c7400640 1 -- 172.21.15.159:0/596980225 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c019ca00 con 0x7fb0c0072670 2024-02-28T23:22:48.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.084+0000 7fb0c7400640 1 -- 172.21.15.159:0/596980225 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c019cf60 con 0x7fb0c0072670 2024-02-28T23:22:48.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.085+0000 7fb0c7400640 1 -- 172.21.15.159:0/596980225 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0c004e040 con 0x7fb0c0072670 2024-02-28T23:22:48.084 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.086+0000 7fb0bd600640 1 -- 172.21.15.159:0/596980225 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fb0b4004ed0 con 0x7fb0c0072670 2024-02-28T23:22:48.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.087+0000 7fb0bd600640 1 --2- 172.21.15.159:0/596980225 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb0a806d8d0 0x7fb0a806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:48.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.087+0000 7fb0bd600640 1 -- 172.21.15.159:0/596980225 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fb0b40b0120 con 0x7fb0c0072670 2024-02-28T23:22:48.086 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.087+0000 7fb0bfe00640 1 --2- 172.21.15.159:0/596980225 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb0a806d8d0 0x7fb0a806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:48.087 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.088+0000 7fb0bfe00640 1 --2- 172.21.15.159:0/596980225 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb0a806d8d0 0x7fb0a806fd90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005fd0 tx=0x7fb0b0005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:48.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.092+0000 7fb0bd600640 1 -- 172.21.15.159:0/596980225 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fb0b4079970 con 0x7fb0c0072670 2024-02-28T23:22:48.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.300+0000 7fb0c7400640 1 -- 172.21.15.159:0/596980225 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb0c010f450 con 0x7fb0c0072670 2024-02-28T23:22:48.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.302+0000 7fb0bd600640 1 -- 172.21.15.159:0/596980225 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v102) v1 ==== 81+0+2463 (secure 0 0 0) 0x7fb0b407d030 con 0x7fb0c0072670 2024-02-28T23:22:48.301 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:6827/3142391154 2024-02-29T23:19:57.396251+0000 2024-02-28T23:22:48.301 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:6826/3142391154 2024-02-29T23:19:57.396251+0000 2024-02-28T23:22:48.301 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6829/455979918 2024-02-29T23:18:59.875868+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2648380137 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/1337780901 2024-02-29T22:57:04.937279+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:6829/2879526003 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/74577353 2024-02-29T22:54:49.969159+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3426997920 2024-02-29T22:55:32.103959+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6827/1702728557 2024-02-29T23:03:41.473671+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2943793350 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/1788579887 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/3999545682 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3798912796 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6826/1702728557 2024-02-29T23:03:41.473671+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3945263774 2024-02-29T22:57:04.937279+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2053056032 2024-02-29T22:55:32.103959+0000 2024-02-28T23:22:48.302 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/2133007913 2024-02-29T22:55:32.103959+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/528876824 2024-02-29T22:55:32.103959+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/2133007913 2024-02-29T22:55:32.103959+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/1021838933 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2242263974 2024-02-29T22:57:04.937279+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/1882871978 2024-02-29T22:54:49.969159+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/1882871978 2024-02-29T22:54:49.969159+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:6828/2879526003 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/862687661 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/419508658 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/3612719472 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6828/455979918 2024-02-29T23:18:59.875868+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/2559284946 2024-02-29T22:57:04.937279+0000 2024-02-28T23:22:48.303 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2466956559 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:48.304 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/656297432 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:48.304 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/423942112 2024-02-29T22:54:49.969159+0000 2024-02-28T23:22:48.304 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/4231789812 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:48.304 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3397973227 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:48.304 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3456040694 2024-02-29T22:54:49.969159+0000 2024-02-28T23:22:48.304 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/2145262352 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:48.304 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/1861094655 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:48.304 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/1861094655 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:48.304 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/3612719472 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:48.304 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/2559284946 2024-02-29T22:57:04.937279+0000 2024-02-28T23:22:48.304 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/844515011 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:48.305 INFO:teuthology.orchestra.run.smithi159.stderr:listed 41 entries 2024-02-28T23:22:48.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.304+0000 7fb0c7400640 1 -- 172.21.15.159:0/596980225 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb0a806d8d0 msgr2=0x7fb0a806fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:48.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.304+0000 7fb0c7400640 1 --2- 172.21.15.159:0/596980225 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb0a806d8d0 0x7fb0a806fd90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0005fd0 tx=0x7fb0b0005850 comp rx=0 tx=0).stop 2024-02-28T23:22:48.305 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.304+0000 7fb0c7400640 1 -- 172.21.15.159:0/596980225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c0072670 msgr2=0x7fb0c0197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:48.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.304+0000 7fb0c7400640 1 --2- 172.21.15.159:0/596980225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c0072670 0x7fb0c0197de0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb0b40099a0 tx=0x7fb0b4004270 comp rx=0 tx=0).stop 2024-02-28T23:22:48.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.305+0000 7fb0c7400640 1 -- 172.21.15.159:0/596980225 shutdown_connections 2024-02-28T23:22:48.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.305+0000 7fb0c7400640 1 --2- 172.21.15.159:0/596980225 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fb0a806d8d0 0x7fb0a806fd90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.305+0000 7fb0c7400640 1 --2- 172.21.15.159:0/596980225 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fb0c0072f90 0x7fb0c0198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.305+0000 7fb0c7400640 1 --2- 172.21.15.159:0/596980225 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c0072670 0x7fb0c0197de0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.305+0000 7fb0c7400640 1 -- 172.21.15.159:0/596980225 >> 172.21.15.159:0/596980225 conn(0x7fb0c00fbad0 msgr2=0x7fb0c0106ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:48.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.305+0000 7fb0c7400640 1 -- 172.21.15.159:0/596980225 shutdown_connections 2024-02-28T23:22:48.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.305+0000 7fb0c7400640 1 -- 172.21.15.159:0/596980225 wait complete. 2024-02-28T23:22:48.322 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-02-28T23:22:48.323 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-02-28T23:22:48.372 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-02-28T23:22:48.631 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.632+0000 7f4306000640 1 -- 172.21.15.159:0/649541302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f430010c660 msgr2=0x7f430010ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:48.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.632+0000 7f4306000640 1 --2- 172.21.15.159:0/649541302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f430010c660 0x7f430010ca40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f42f0009880 tx=0x7f42f002bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.632+0000 7f4306000640 1 -- 172.21.15.159:0/649541302 shutdown_connections 2024-02-28T23:22:48.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.632+0000 7f4306000640 1 --2- 172.21.15.159:0/649541302 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f43001066a0 0x7f4300106b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.632+0000 7f4306000640 1 --2- 172.21.15.159:0/649541302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f430010c660 0x7f430010ca40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.632+0000 7f4306000640 1 -- 172.21.15.159:0/649541302 >> 172.21.15.159:0/649541302 conn(0x7f4300075e80 msgr2=0x7f43000782a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:48.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.632+0000 7f4306000640 1 -- 172.21.15.159:0/649541302 shutdown_connections 2024-02-28T23:22:48.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.632+0000 7f4306000640 1 -- 172.21.15.159:0/649541302 wait complete. 2024-02-28T23:22:48.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.633+0000 7f4306000640 1 Processor -- start 2024-02-28T23:22:48.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.633+0000 7f4306000640 1 -- start start 2024-02-28T23:22:48.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.633+0000 7f4306000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43001066a0 0x7f430019c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:48.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.633+0000 7f4306000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f430010c660 0x7f430019c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:48.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.633+0000 7f4306000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f430019cf30 con 0x7f43001066a0 2024-02-28T23:22:48.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.633+0000 7f4306000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43001a0d00 con 0x7f430010c660 2024-02-28T23:22:48.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.634+0000 7f42ff400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43001066a0 0x7f430019c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:48.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.634+0000 7f42ff400640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43001066a0 0x7f430019c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43928/0 (socket says 172.21.15.159:43928) 2024-02-28T23:22:48.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.634+0000 7f42ff400640 1 -- 172.21.15.159:0/4243950572 learned_addr learned my addr 172.21.15.159:0/4243950572 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:48.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.634+0000 7f42ff400640 1 -- 172.21.15.159:0/4243950572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f430010c660 msgr2=0x7f430019c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:48.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.634+0000 7f42ff400640 1 --2- 172.21.15.159:0/4243950572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f430010c660 0x7f430019c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.634+0000 7f42ff400640 1 -- 172.21.15.159:0/4243950572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f0009560 con 0x7f43001066a0 2024-02-28T23:22:48.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.634+0000 7f42ff400640 1 --2- 172.21.15.159:0/4243950572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43001066a0 0x7f430019c360 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000c00 tx=0x7f42f002c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:48.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.635+0000 7f42f7e00640 1 -- 172.21.15.159:0/4243950572 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f0004520 con 0x7f43001066a0 2024-02-28T23:22:48.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.635+0000 7f42f7e00640 1 -- 172.21.15.159:0/4243950572 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f42f0003ab0 con 0x7f43001066a0 2024-02-28T23:22:48.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.635+0000 7f42f7e00640 1 -- 172.21.15.159:0/4243950572 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42f0034440 con 0x7f43001066a0 2024-02-28T23:22:48.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.635+0000 7f4306000640 1 -- 172.21.15.159:0/4243950572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43001a0f80 con 0x7f43001066a0 2024-02-28T23:22:48.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.635+0000 7f4306000640 1 -- 172.21.15.159:0/4243950572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43001a1480 con 0x7f43001066a0 2024-02-28T23:22:48.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.636+0000 7f4306000640 1 -- 172.21.15.159:0/4243950572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430004e040 con 0x7f43001066a0 2024-02-28T23:22:48.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.637+0000 7f42f7e00640 1 -- 172.21.15.159:0/4243950572 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f42f0003c20 con 0x7f43001066a0 2024-02-28T23:22:48.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.638+0000 7f42f7e00640 1 --2- 172.21.15.159:0/4243950572 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f42e406d8d0 0x7f42e406fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:48.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.638+0000 7f42f7e00640 1 -- 172.21.15.159:0/4243950572 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f42f00af910 con 0x7f43001066a0 2024-02-28T23:22:48.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.638+0000 7f42fea00640 1 --2- 172.21.15.159:0/4243950572 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f42e406d8d0 0x7f42e406fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:48.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.639+0000 7f42fea00640 1 --2- 172.21.15.159:0/4243950572 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f42e406d8d0 0x7f42e406fd90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42ec005fd0 tx=0x7f42ec005850 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:48.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.642+0000 7f42f7e00640 1 -- 172.21.15.159:0/4243950572 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f42f0079040 con 0x7f43001066a0 2024-02-28T23:22:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:48 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/899793701' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T23:22:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:48 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/596980225' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T23:22:48.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.841+0000 7f4306000640 1 -- 172.21.15.159:0/4243950572 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f430019d6b0 con 0x7f43001066a0 2024-02-28T23:22:48.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.843+0000 7f42f7e00640 1 -- 172.21.15.159:0/4243950572 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+17259 (secure 0 0 0) 0x7f42f007c700 con 0x7f43001066a0 2024-02-28T23:22:48.843 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-02-28T23:22:48.843 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":102,"fsid":"24bd0fca-d68c-11ee-95c3-87774f69a715","created":"2024-02-28T22:54:07.259600+0000","modified":"2024-02-28T23:19:57.396295+0000","last_up_change":"2024-02-28T23:18:21.299156+0000","last_in_change":"2024-02-28T23:01:21.082396+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-02-28T23:00:05.643400+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-02-28T23:03:21.113072+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.309999942779541,"score_stable":1.309999942779541,"optimal_score":1,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-02-28T23:03:21.891379+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"12a358ec-2348-437f-a587-c75299c13814","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":64,"up_thru":95,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6803","nonce":3232134603}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6805","nonce":3232134603}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6809","nonce":3232134603}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":3232134603},{"type":"v1","addr":"172.21.15.159:6807","nonce":3232134603}]},"public_addr":"172.21.15.159:6803/3232134603","cluster_addr":"172.21.15.159:6805/3232134603","heartbeat_back_addr":"172.21.15.159:6809/3232134603","heartbeat_front_addr":"172.21.15.159:6807/3232134603","state":["exists","up"]},{"osd":1,"uuid":"34a65dc7-3bd8-4cb5-b61b-e04166f115c9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":71,"up_from":75,"up_thru":95,"down_at":72,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6811","nonce":3750692109}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6812","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6813","nonce":3750692109}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6817","nonce":3750692109}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6814","nonce":3750692109},{"type":"v1","addr":"172.21.15.159:6815","nonce":3750692109}]},"public_addr":"172.21.15.159:6811/3750692109","cluster_addr":"172.21.15.159:6813/3750692109","heartbeat_back_addr":"172.21.15.159:6817/3750692109","heartbeat_front_addr":"172.21.15.159:6815/3750692109","state":["exists","up"]},{"osd":2,"uuid":"a712ee56-f8b8-43c4-9f38-33ebe33b7977","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":76,"up_from":80,"up_thru":95,"down_at":77,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6818","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6819","nonce":1285075477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6820","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6821","nonce":1285075477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6824","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6825","nonce":1285075477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6822","nonce":1285075477},{"type":"v1","addr":"172.21.15.159:6823","nonce":1285075477}]},"public_addr":"172.21.15.159:6819/1285075477","cluster_addr":"172.21.15.159:6821/1285075477","heartbeat_back_addr":"172.21.15.159:6825/1285075477","heartbeat_front_addr":"172.21.15.159:6823/1285075477","state":["exists","up"]},{"osd":3,"uuid":"bb2d95db-29e3-4e8d-bcea-ed52ae538c48","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":81,"up_from":85,"up_thru":95,"down_at":82,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6800","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6801","nonce":29498664}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6802","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6803","nonce":29498664}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6806","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6807","nonce":29498664}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6804","nonce":29498664},{"type":"v1","addr":"172.21.15.184:6805","nonce":29498664}]},"public_addr":"172.21.15.184:6801/29498664","cluster_addr":"172.21.15.184:6803/29498664","heartbeat_back_addr":"172.21.15.184:6807/29498664","heartbeat_front_addr":"172.21.15.184:6805/29498664","state":["exists","up"]},{"osd":4,"uuid":"55d22d45-549c-4a55-8a36-7aa785561068","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":34,"last_clean_end":86,"up_from":90,"up_thru":95,"down_at":87,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6808","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6809","nonce":1173196285}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6810","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6811","nonce":1173196285}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6814","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6815","nonce":1173196285}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6812","nonce":1173196285},{"type":"v1","addr":"172.21.15.184:6813","nonce":1173196285}]},"public_addr":"172.21.15.184:6809/1173196285","cluster_addr":"172.21.15.184:6811/1173196285","heartbeat_back_addr":"172.21.15.184:6815/1173196285","heartbeat_front_addr":"172.21.15.184:6813/1173196285","state":["exists","up"]},{"osd":5,"uuid":"eb1fbfd2-cb5d-474f-ae38-60a8e42b7af7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":39,"last_clean_end":91,"up_from":95,"up_thru":95,"down_at":92,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6816","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6817","nonce":1609921388}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6818","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6819","nonce":1609921388}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6822","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6823","nonce":1609921388}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.184:6820","nonce":1609921388},{"type":"v1","addr":"172.21.15.184:6821","nonce":1609921388}]},"public_addr":"172.21.15.184:6817/1609921388","cluster_addr":"172.21.15.184:6819/1609921388","heartbeat_back_addr":"172.21.15.184:6823/1609921388","heartbeat_front_addr":"172.21.15.184:6821/1609921388","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:58:47.192772+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T22:59:24.679857+0000","dead_epoch":71},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:03.155438+0000","dead_epoch":76},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:00:35.629938+0000","dead_epoch":81},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:09.895470+0000","dead_epoch":86},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-02-28T23:01:43.528444+0000","dead_epoch":91}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.5","mappings":[{"from":3,"to":2}]},{"pgid":"2.6","mappings":[{"from":3,"to":0}]},{"pgid":"2.7","mappings":[{"from":3,"to":0}]},{"pgid":"3.0","mappings":[{"from":4,"to":5}]},{"pgid":"3.2","mappings":[{"from":3,"to":2}]},{"pgid":"3.b","mappings":[{"from":1,"to":2}]},{"pgid":"3.12","mappings":[{"from":3,"to":5}]},{"pgid":"3.1c","mappings":[{"from":4,"to":0}]},{"pgid":"3.1e","mappings":[{"from":1,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.184:6827/3142391154":"2024-02-29T23:19:57.396251+0000","172.21.15.184:6826/3142391154":"2024-02-29T23:19:57.396251+0000","172.21.15.159:6829/455979918":"2024-02-29T23:18:59.875868+0000","172.21.15.159:0/2648380137":"2024-02-29T23:12:53.028717+0000","172.21.15.159:0/1337780901":"2024-02-29T22:57:04.937279+0000","172.21.15.184:6829/2879526003":"2024-02-29T23:07:58.913608+0000","172.21.15.159:0/74577353":"2024-02-29T22:54:49.969159+0000","172.21.15.159:0/3426997920":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6827/1702728557":"2024-02-29T23:03:41.473671+0000","172.21.15.159:0/2943793350":"2024-02-29T23:12:53.028717+0000","172.21.15.184:0/1788579887":"2024-02-29T23:07:58.913608+0000","172.21.15.184:0/3999545682":"2024-02-29T23:07:58.913608+0000","172.21.15.159:0/3798912796":"2024-02-29T23:06:27.595745+0000","172.21.15.159:6826/1702728557":"2024-02-29T23:03:41.473671+0000","172.21.15.159:0/3945263774":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/2053056032":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6801/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:0/528876824":"2024-02-29T22:55:32.103959+0000","172.21.15.159:6800/2133007913":"2024-02-29T22:55:32.103959+0000","172.21.15.159:0/1021838933":"2024-02-29T23:12:53.028717+0000","172.21.15.159:0/2242263974":"2024-02-29T22:57:04.937279+0000","172.21.15.159:6800/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.159:6801/1882871978":"2024-02-29T22:54:49.969159+0000","172.21.15.184:6828/2879526003":"2024-02-29T23:07:58.913608+0000","172.21.15.184:0/862687661":"2024-02-29T23:07:58.913608+0000","172.21.15.184:0/419508658":"2024-02-29T23:07:58.913608+0000","172.21.15.159:6800/3612719472":"2024-02-29T23:12:53.028717+0000","172.21.15.159:6828/455979918":"2024-02-29T23:18:59.875868+0000","172.21.15.159:6801/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/2466956559":"2024-02-29T23:06:27.595745+0000","172.21.15.159:0/656297432":"2024-02-29T23:06:27.595745+0000","172.21.15.159:0/423942112":"2024-02-29T22:54:49.969159+0000","172.21.15.184:0/4231789812":"2024-02-29T23:07:58.913608+0000","172.21.15.159:0/3397973227":"2024-02-29T23:06:27.595745+0000","172.21.15.159:0/3456040694":"2024-02-29T22:54:49.969159+0000","172.21.15.184:0/2145262352":"2024-02-29T23:07:58.913608+0000","172.21.15.159:6800/1861094655":"2024-02-29T23:06:27.595745+0000","172.21.15.159:6801/1861094655":"2024-02-29T23:06:27.595745+0000","172.21.15.159:6801/3612719472":"2024-02-29T23:12:53.028717+0000","172.21.15.159:6800/2559284946":"2024-02-29T22:57:04.937279+0000","172.21.15.159:0/844515011":"2024-02-29T23:12:53.028717+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-02-28T23:22:48.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.846+0000 7f4306000640 1 -- 172.21.15.159:0/4243950572 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f42e406d8d0 msgr2=0x7f42e406fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:48.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.846+0000 7f4306000640 1 --2- 172.21.15.159:0/4243950572 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f42e406d8d0 0x7f42e406fd90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f42ec005fd0 tx=0x7f42ec005850 comp rx=0 tx=0).stop 2024-02-28T23:22:48.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.846+0000 7f4306000640 1 -- 172.21.15.159:0/4243950572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43001066a0 msgr2=0x7f430019c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:48.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.846+0000 7f4306000640 1 --2- 172.21.15.159:0/4243950572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43001066a0 0x7f430019c360 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f42f0000c00 tx=0x7f42f002c850 comp rx=0 tx=0).stop 2024-02-28T23:22:48.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.846+0000 7f4306000640 1 -- 172.21.15.159:0/4243950572 shutdown_connections 2024-02-28T23:22:48.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.846+0000 7f4306000640 1 --2- 172.21.15.159:0/4243950572 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f42e406d8d0 0x7f42e406fd90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.846+0000 7f4306000640 1 --2- 172.21.15.159:0/4243950572 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f430010c660 0x7f430019c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.846+0000 7f4306000640 1 --2- 172.21.15.159:0/4243950572 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43001066a0 0x7f430019c360 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:48.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.846+0000 7f4306000640 1 -- 172.21.15.159:0/4243950572 >> 172.21.15.159:0/4243950572 conn(0x7f4300075e80 msgr2=0x7f4300076780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:48.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.846+0000 7f4306000640 1 -- 172.21.15.159:0/4243950572 shutdown_connections 2024-02-28T23:22:48.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:48.846+0000 7f4306000640 1 -- 172.21.15.159:0/4243950572 wait complete. 2024-02-28T23:22:48.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:48 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/899793701' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T23:22:48.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:48 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/596980225' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T23:22:48.862 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-02-28T23:00:05.643400+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-02-28T23:03:21.113072+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '44', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.309999942779541, 'score_stable': 1.309999942779541, 'optimal_score': 1, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-02-28T23:03:21.891379+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-02-28T23:22:48.862 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-02-28T23:22:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.065+0000 7fa9fd800640 1 -- 172.21.15.159:0/202393173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f81066a0 msgr2=0x7fa9f8106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.065+0000 7fa9fd800640 1 --2- 172.21.15.159:0/202393173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f81066a0 0x7fa9f8106b20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0009880 tx=0x7fa9e002bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.065+0000 7fa9fd800640 1 -- 172.21.15.159:0/202393173 shutdown_connections 2024-02-28T23:22:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.065+0000 7fa9fd800640 1 --2- 172.21.15.159:0/202393173 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f81066a0 0x7fa9f8106b20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.065+0000 7fa9fd800640 1 --2- 172.21.15.159:0/202393173 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9f810c660 0x7fa9f810ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.065+0000 7fa9fd800640 1 -- 172.21.15.159:0/202393173 >> 172.21.15.159:0/202393173 conn(0x7fa9f8075e80 msgr2=0x7fa9f80782a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.066+0000 7fa9fd800640 1 -- 172.21.15.159:0/202393173 shutdown_connections 2024-02-28T23:22:49.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.066+0000 7fa9fd800640 1 -- 172.21.15.159:0/202393173 wait complete. 2024-02-28T23:22:49.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.067+0000 7fa9fd800640 1 Processor -- start 2024-02-28T23:22:49.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.067+0000 7fa9fd800640 1 -- start start 2024-02-28T23:22:49.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.067+0000 7fa9fd800640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f81066a0 0x7fa9f819c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:49.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.067+0000 7fa9fd800640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9f810c660 0x7fa9f819c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:49.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.068+0000 7fa9fd800640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f819ced0 con 0x7fa9f81066a0 2024-02-28T23:22:49.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.068+0000 7fa9fd800640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81a0ca0 con 0x7fa9f810c660 2024-02-28T23:22:49.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.068+0000 7fa9f6a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f81066a0 0x7fa9f819c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:49.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.068+0000 7fa9f6a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f81066a0 0x7fa9f819c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43952/0 (socket says 172.21.15.159:43952) 2024-02-28T23:22:49.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.068+0000 7fa9f6a00640 1 -- 172.21.15.159:0/4164260235 learned_addr learned my addr 172.21.15.159:0/4164260235 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:49.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.068+0000 7fa9efe00640 1 --2- 172.21.15.159:0/4164260235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9f810c660 0x7fa9f819c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:49.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.068+0000 7fa9f6a00640 1 -- 172.21.15.159:0/4164260235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9f810c660 msgr2=0x7fa9f819c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:49.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.068+0000 7fa9f6a00640 1 --2- 172.21.15.159:0/4164260235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9f810c660 0x7fa9f819c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.068+0000 7fa9f6a00640 1 -- 172.21.15.159:0/4164260235 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e0009560 con 0x7fa9f81066a0 2024-02-28T23:22:49.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.069+0000 7fa9f6a00640 1 --2- 172.21.15.159:0/4164260235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f81066a0 0x7fa9f819c300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800d8d0 tx=0x7fa9e800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:49.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.069+0000 7fa9ef400640 1 -- 172.21.15.159:0/4164260235 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e800bea0 con 0x7fa9f81066a0 2024-02-28T23:22:49.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.069+0000 7fa9ef400640 1 -- 172.21.15.159:0/4164260235 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7fa9e8009c00 con 0x7fa9f81066a0 2024-02-28T23:22:49.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.069+0000 7fa9ef400640 1 -- 172.21.15.159:0/4164260235 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa9e800f710 con 0x7fa9f81066a0 2024-02-28T23:22:49.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.069+0000 7fa9fd800640 1 -- 172.21.15.159:0/4164260235 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f81a0f80 con 0x7fa9f81066a0 2024-02-28T23:22:49.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.069+0000 7fa9fd800640 1 -- 172.21.15.159:0/4164260235 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f81a14e0 con 0x7fa9f81066a0 2024-02-28T23:22:49.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.070+0000 7fa9fd800640 1 -- 172.21.15.159:0/4164260235 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f804e040 con 0x7fa9f81066a0 2024-02-28T23:22:49.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.071+0000 7fa9ef400640 1 -- 172.21.15.159:0/4164260235 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7fa9e8010460 con 0x7fa9f81066a0 2024-02-28T23:22:49.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.073+0000 7fa9ef400640 1 --2- 172.21.15.159:0/4164260235 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa9dc06d810 0x7fa9dc06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:49.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.073+0000 7fa9ef400640 1 -- 172.21.15.159:0/4164260235 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7fa9e808d360 con 0x7fa9f81066a0 2024-02-28T23:22:49.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.073+0000 7fa9efe00640 1 --2- 172.21.15.159:0/4164260235 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa9dc06d810 0x7fa9dc06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:49.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.074+0000 7fa9efe00640 1 --2- 172.21.15.159:0/4164260235 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa9dc06d810 0x7fa9dc06fcd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa9f819d910 tx=0x7fa9e002cf90 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:49.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.078+0000 7fa9ef400640 1 -- 172.21.15.159:0/4164260235 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7fa9e80569f0 con 0x7fa9f81066a0 2024-02-28T23:22:49.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.275+0000 7fa9fd800640 1 -- 172.21.15.159:0/4164260235 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa9f8113910 con 0x7fa9f81066a0 2024-02-28T23:22:49.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.276+0000 7fa9ef400640 1 -- 172.21.15.159:0/4164260235 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v102) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa9e805a0b0 con 0x7fa9f81066a0 2024-02-28T23:22:49.275 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 1 2024-02-28T23:22:49.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.279+0000 7fa9fd800640 1 -- 172.21.15.159:0/4164260235 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa9dc06d810 msgr2=0x7fa9dc06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:49.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.279+0000 7fa9fd800640 1 --2- 172.21.15.159:0/4164260235 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa9dc06d810 0x7fa9dc06fcd0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa9f819d910 tx=0x7fa9e002cf90 comp rx=0 tx=0).stop 2024-02-28T23:22:49.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.279+0000 7fa9fd800640 1 -- 172.21.15.159:0/4164260235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f81066a0 msgr2=0x7fa9f819c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:49.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.279+0000 7fa9fd800640 1 --2- 172.21.15.159:0/4164260235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f81066a0 0x7fa9f819c300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa9e800d8d0 tx=0x7fa9e800dd90 comp rx=0 tx=0).stop 2024-02-28T23:22:49.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.279+0000 7fa9fd800640 1 -- 172.21.15.159:0/4164260235 shutdown_connections 2024-02-28T23:22:49.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.279+0000 7fa9fd800640 1 --2- 172.21.15.159:0/4164260235 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7fa9dc06d810 0x7fa9dc06fcd0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.279+0000 7fa9fd800640 1 --2- 172.21.15.159:0/4164260235 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7fa9f810c660 0x7fa9f819c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.279+0000 7fa9fd800640 1 --2- 172.21.15.159:0/4164260235 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9f81066a0 0x7fa9f819c300 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.279+0000 7fa9fd800640 1 -- 172.21.15.159:0/4164260235 >> 172.21.15.159:0/4164260235 conn(0x7fa9f8075e80 msgr2=0x7fa9f8076a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:49.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.279+0000 7fa9fd800640 1 -- 172.21.15.159:0/4164260235 shutdown_connections 2024-02-28T23:22:49.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.279+0000 7fa9fd800640 1 -- 172.21.15.159:0/4164260235 wait complete. 2024-02-28T23:22:49.297 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-02-28T23:22:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.506+0000 7f9613000640 1 -- 172.21.15.159:0/2539631372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f960c102e70 msgr2=0x7f960c106eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.506+0000 7f9613000640 1 --2- 172.21.15.159:0/2539631372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f960c102e70 0x7f960c106eb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f95f4009c20 tx=0x7f95f402c1b0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.506+0000 7f9613000640 1 -- 172.21.15.159:0/2539631372 shutdown_connections 2024-02-28T23:22:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.506+0000 7f9613000640 1 --2- 172.21.15.159:0/2539631372 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f960c102e70 0x7f960c106eb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.506+0000 7f9613000640 1 --2- 172.21.15.159:0/2539631372 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f960c1024c0 0x7f960c1028a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.506+0000 7f9613000640 1 -- 172.21.15.159:0/2539631372 >> 172.21.15.159:0/2539631372 conn(0x7f960c0fdd40 msgr2=0x7f960c100160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.506+0000 7f9613000640 1 -- 172.21.15.159:0/2539631372 shutdown_connections 2024-02-28T23:22:49.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.506+0000 7f9613000640 1 -- 172.21.15.159:0/2539631372 wait complete. 2024-02-28T23:22:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.507+0000 7f9613000640 1 Processor -- start 2024-02-28T23:22:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.507+0000 7f9613000640 1 -- start start 2024-02-28T23:22:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.508+0000 7f9613000640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f960c1024c0 0x7f960c197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:49.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.508+0000 7f9613000640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f960c198490 0x7f960c19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.508+0000 7f9613000640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c198a90 con 0x7f960c1024c0 2024-02-28T23:22:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.508+0000 7f9613000640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c198c00 con 0x7f960c198490 2024-02-28T23:22:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.508+0000 7f960be00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f960c1024c0 0x7f960c197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.508+0000 7f960be00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f960c1024c0 0x7f960c197f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43978/0 (socket says 172.21.15.159:43978) 2024-02-28T23:22:49.508 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.508+0000 7f960be00640 1 -- 172.21.15.159:0/3308458557 learned_addr learned my addr 172.21.15.159:0/3308458557 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.508+0000 7f960be00640 1 -- 172.21.15.159:0/3308458557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f960c198490 msgr2=0x7f960c19c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.508+0000 7f960b400640 1 --2- 172.21.15.159:0/3308458557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f960c198490 0x7f960c19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.508+0000 7f960be00640 1 --2- 172.21.15.159:0/3308458557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f960c198490 0x7f960c19c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.509+0000 7f960be00640 1 -- 172.21.15.159:0/3308458557 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4009900 con 0x7f960c1024c0 2024-02-28T23:22:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.509+0000 7f960be00640 1 --2- 172.21.15.159:0/3308458557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f960c1024c0 0x7f960c197f50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c840 tx=0x7f95fc00cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.509+0000 7f9608c00640 1 -- 172.21.15.159:0/3308458557 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95fc0041f0 con 0x7f960c1024c0 2024-02-28T23:22:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.509+0000 7f9608c00640 1 -- 172.21.15.159:0/3308458557 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f95fc007e70 con 0x7f960c1024c0 2024-02-28T23:22:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.509+0000 7f9613000640 1 -- 172.21.15.159:0/3308458557 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c19cef0 con 0x7f960c1024c0 2024-02-28T23:22:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.509+0000 7f9608c00640 1 -- 172.21.15.159:0/3308458557 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95fc0049d0 con 0x7f960c1024c0 2024-02-28T23:22:49.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.509+0000 7f9613000640 1 -- 172.21.15.159:0/3308458557 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c19d450 con 0x7f960c1024c0 2024-02-28T23:22:49.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.510+0000 7f9613000640 1 -- 172.21.15.159:0/3308458557 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c19d730 con 0x7f960c1024c0 2024-02-28T23:22:49.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.511+0000 7f9608c00640 1 -- 172.21.15.159:0/3308458557 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f95fc0079b0 con 0x7f960c1024c0 2024-02-28T23:22:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.512+0000 7f9608c00640 1 --2- 172.21.15.159:0/3308458557 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f95ec06d810 0x7f95ec06fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.512+0000 7f9608c00640 1 -- 172.21.15.159:0/3308458557 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f95fc08d4a0 con 0x7f960c1024c0 2024-02-28T23:22:49.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.512+0000 7f960b400640 1 --2- 172.21.15.159:0/3308458557 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f95ec06d810 0x7f95ec06fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:49.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.513+0000 7f960b400640 1 --2- 172.21.15.159:0/3308458557 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f95ec06d810 0x7f95ec06fcd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95f4006010 tx=0x7f95f4000f40 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:49.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.517+0000 7f9608c00640 1 -- 172.21.15.159:0/3308458557 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f95fc056b50 con 0x7f960c1024c0 2024-02-28T23:22:49.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.717+0000 7f9613000640 1 -- 172.21.15.159:0/3308458557 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f960c10a7c0 con 0x7f960c1024c0 2024-02-28T23:22:49.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.718+0000 7f9608c00640 1 -- 172.21.15.159:0/3308458557 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v102) v1 ==== 107+0+11 (secure 0 0 0) 0x7f95fc05a210 con 0x7f960c1024c0 2024-02-28T23:22:49.718 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-02-28T23:22:49.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.722+0000 7f9613000640 1 -- 172.21.15.159:0/3308458557 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f95ec06d810 msgr2=0x7f95ec06fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:49.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.722+0000 7f9613000640 1 --2- 172.21.15.159:0/3308458557 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f95ec06d810 0x7f95ec06fcd0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f95f4006010 tx=0x7f95f4000f40 comp rx=0 tx=0).stop 2024-02-28T23:22:49.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.722+0000 7f9613000640 1 -- 172.21.15.159:0/3308458557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f960c1024c0 msgr2=0x7f960c197f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:49.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.722+0000 7f9613000640 1 --2- 172.21.15.159:0/3308458557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f960c1024c0 0x7f960c197f50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c840 tx=0x7f95fc00cd00 comp rx=0 tx=0).stop 2024-02-28T23:22:49.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.722+0000 7f9613000640 1 -- 172.21.15.159:0/3308458557 shutdown_connections 2024-02-28T23:22:49.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.722+0000 7f9613000640 1 --2- 172.21.15.159:0/3308458557 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f95ec06d810 0x7f95ec06fcd0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.722+0000 7f9613000640 1 --2- 172.21.15.159:0/3308458557 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f960c198490 0x7f960c19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.722+0000 7f9613000640 1 --2- 172.21.15.159:0/3308458557 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f960c1024c0 0x7f960c197f50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.722+0000 7f9613000640 1 -- 172.21.15.159:0/3308458557 >> 172.21.15.159:0/3308458557 conn(0x7f960c0fdd40 msgr2=0x7f960c0ff4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:49.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.722+0000 7f9613000640 1 -- 172.21.15.159:0/3308458557 shutdown_connections 2024-02-28T23:22:49.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.722+0000 7f9613000640 1 -- 172.21.15.159:0/3308458557 wait complete. 2024-02-28T23:22:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:49 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/4243950572' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:22:49.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:49 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/4164260235' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T23:22:49.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:49 smithi159 ceph-mon[113833]: pgmap v354: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:49.739 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-02-28T23:22:49.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:49 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/4243950572' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-28T23:22:49.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:49 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/4164260235' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-02-28T23:22:49.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:49 smithi184 ceph-mon[86482]: pgmap v354: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:49.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.948+0000 7f895ec00640 1 -- 172.21.15.159:0/2740800873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580747d0 msgr2=0x7f8958074bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:49.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.948+0000 7f895ec00640 1 --2- 172.21.15.159:0/2740800873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580747d0 0x7f8958074bb0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8948009880 tx=0x7f894802bce0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.948+0000 7f895ec00640 1 -- 172.21.15.159:0/2740800873 shutdown_connections 2024-02-28T23:22:49.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.948+0000 7f895ec00640 1 --2- 172.21.15.159:0/2740800873 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89580750f0 0x7f89581107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.947 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.948+0000 7f895ec00640 1 --2- 172.21.15.159:0/2740800873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580747d0 0x7f8958074bb0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.948+0000 7f895ec00640 1 -- 172.21.15.159:0/2740800873 >> 172.21.15.159:0/2740800873 conn(0x7f89580fdb20 msgr2=0x7f89580fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:49.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.948+0000 7f895ec00640 1 -- 172.21.15.159:0/2740800873 shutdown_connections 2024-02-28T23:22:49.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.948+0000 7f895ec00640 1 -- 172.21.15.159:0/2740800873 wait complete. 2024-02-28T23:22:49.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.949+0000 7f895ec00640 1 Processor -- start 2024-02-28T23:22:49.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.949+0000 7f895ec00640 1 -- start start 2024-02-28T23:22:49.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.949+0000 7f895ec00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89580747d0 0x7f895819c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:49.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.949+0000 7f895ec00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580750f0 0x7f895819c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:49.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.949+0000 7f895ec00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895819ce50 con 0x7f89580750f0 2024-02-28T23:22:49.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.949+0000 7f895ec00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89581a0c20 con 0x7f89580747d0 2024-02-28T23:22:49.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.950+0000 7f895ce00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580750f0 0x7f895819c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:49.949 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.950+0000 7f895ce00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580750f0 0x7f895819c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44004/0 (socket says 172.21.15.159:44004) 2024-02-28T23:22:49.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.950+0000 7f895ce00640 1 -- 172.21.15.159:0/342609812 learned_addr learned my addr 172.21.15.159:0/342609812 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:49.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.950+0000 7f895ce00640 1 -- 172.21.15.159:0/342609812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89580747d0 msgr2=0x7f895819c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:49.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.950+0000 7f895ce00640 1 --2- 172.21.15.159:0/342609812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89580747d0 0x7f895819c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:49.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.950+0000 7f895ce00640 1 -- 172.21.15.159:0/342609812 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8948009560 con 0x7f89580750f0 2024-02-28T23:22:49.950 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.950+0000 7f895ce00640 1 --2- 172.21.15.159:0/342609812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580750f0 0x7f895819c7c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f894c00d6f0 tx=0x7f894c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:49.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.951+0000 7f8956000640 1 -- 172.21.15.159:0/342609812 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f894c009a30 con 0x7f89580750f0 2024-02-28T23:22:49.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.951+0000 7f8956000640 1 -- 172.21.15.159:0/342609812 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f894c0054e0 con 0x7f89580750f0 2024-02-28T23:22:49.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.951+0000 7f8956000640 1 -- 172.21.15.159:0/342609812 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f894c010460 con 0x7f89580750f0 2024-02-28T23:22:49.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.951+0000 7f895ec00640 1 -- 172.21.15.159:0/342609812 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89581a0f00 con 0x7f89580750f0 2024-02-28T23:22:49.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.951+0000 7f895ec00640 1 -- 172.21.15.159:0/342609812 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89581a1460 con 0x7f89580750f0 2024-02-28T23:22:49.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.952+0000 7f895ec00640 1 -- 172.21.15.159:0/342609812 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895804e040 con 0x7f89580750f0 2024-02-28T23:22:49.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.953+0000 7f8956000640 1 -- 172.21.15.159:0/342609812 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f894c009b90 con 0x7f89580750f0 2024-02-28T23:22:49.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.954+0000 7f8956000640 1 --2- 172.21.15.159:0/342609812 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f894006d810 0x7f894006fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:49.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.954+0000 7f8956000640 1 -- 172.21.15.159:0/342609812 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f894c08d0c0 con 0x7f89580750f0 2024-02-28T23:22:49.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.954+0000 7f895d800640 1 --2- 172.21.15.159:0/342609812 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f894006d810 0x7f894006fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:49.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.955+0000 7f895d800640 1 --2- 172.21.15.159:0/342609812 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f894006d810 0x7f894006fcd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f894802efd0 tx=0x7f8948000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:49.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:49.959+0000 7f8956000640 1 -- 172.21.15.159:0/342609812 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f894c0567f0 con 0x7f89580750f0 2024-02-28T23:22:50.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.163+0000 7f895ec00640 1 -- 172.21.15.159:0/342609812 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f895819d6a0 con 0x7f89580750f0 2024-02-28T23:22:50.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.164+0000 7f8956000640 1 -- 172.21.15.159:0/342609812 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v102) v1 ==== 107+0+11 (secure 0 0 0) 0x7f894c0200b0 con 0x7f89580750f0 2024-02-28T23:22:50.163 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-02-28T23:22:50.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.167+0000 7f895ec00640 1 -- 172.21.15.159:0/342609812 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f894006d810 msgr2=0x7f894006fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:50.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.167+0000 7f895ec00640 1 --2- 172.21.15.159:0/342609812 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f894006d810 0x7f894006fcd0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f894802efd0 tx=0x7f8948000bc0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.167+0000 7f895ec00640 1 -- 172.21.15.159:0/342609812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580750f0 msgr2=0x7f895819c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:50.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.167+0000 7f895ec00640 1 --2- 172.21.15.159:0/342609812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580750f0 0x7f895819c7c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f894c00d6f0 tx=0x7f894c00dbb0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.167+0000 7f895ec00640 1 -- 172.21.15.159:0/342609812 shutdown_connections 2024-02-28T23:22:50.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.167+0000 7f895ec00640 1 --2- 172.21.15.159:0/342609812 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f894006d810 0x7f894006fcd0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.167+0000 7f895ec00640 1 --2- 172.21.15.159:0/342609812 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f89580750f0 0x7f895819c7c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.167+0000 7f895ec00640 1 --2- 172.21.15.159:0/342609812 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f89580747d0 0x7f895819c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.167+0000 7f895ec00640 1 -- 172.21.15.159:0/342609812 >> 172.21.15.159:0/342609812 conn(0x7f89580fdb20 msgr2=0x7f89580fe790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:50.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.168+0000 7f895ec00640 1 -- 172.21.15.159:0/342609812 shutdown_connections 2024-02-28T23:22:50.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.168+0000 7f895ec00640 1 -- 172.21.15.159:0/342609812 wait complete. 2024-02-28T23:22:50.184 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-02-28T23:22:50.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.379+0000 7f3608a00640 1 -- 172.21.15.159:0/1744704540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36041066a0 msgr2=0x7f3604106b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:50.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.379+0000 7f3608a00640 1 --2- 172.21.15.159:0/1744704540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36041066a0 0x7f3604106b00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009880 tx=0x7f35f002bd90 comp rx=0 tx=0).stop 2024-02-28T23:22:50.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.379+0000 7f3608a00640 1 -- 172.21.15.159:0/1744704540 shutdown_connections 2024-02-28T23:22:50.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.379+0000 7f3608a00640 1 --2- 172.21.15.159:0/1744704540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36041066a0 0x7f3604106b00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.379+0000 7f3608a00640 1 --2- 172.21.15.159:0/1744704540 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f360410c6a0 0x7f360410ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.379+0000 7f3608a00640 1 -- 172.21.15.159:0/1744704540 >> 172.21.15.159:0/1744704540 conn(0x7f3604075e50 msgr2=0x7f3604078270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:50.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.379+0000 7f3608a00640 1 -- 172.21.15.159:0/1744704540 shutdown_connections 2024-02-28T23:22:50.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.379+0000 7f3608a00640 1 -- 172.21.15.159:0/1744704540 wait complete. 2024-02-28T23:22:50.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.380+0000 7f3608a00640 1 Processor -- start 2024-02-28T23:22:50.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.380+0000 7f3608a00640 1 -- start start 2024-02-28T23:22:50.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.380+0000 7f3608a00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36041066a0 0x7f360419c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:50.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.380+0000 7f3608a00640 1 --2- >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f360410c6a0 0x7f360419c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:50.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.380+0000 7f3608a00640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360419ce20 con 0x7f36041066a0 2024-02-28T23:22:50.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.380+0000 7f3608a00640 1 -- --> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36041a0bf0 con 0x7f360410c6a0 2024-02-28T23:22:50.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.381+0000 7f3601e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36041066a0 0x7f360419c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:50.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.381+0000 7f3601e00640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36041066a0 0x7f360419c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44032/0 (socket says 172.21.15.159:44032) 2024-02-28T23:22:50.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.381+0000 7f3601e00640 1 -- 172.21.15.159:0/1750244861 learned_addr learned my addr 172.21.15.159:0/1750244861 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-02-28T23:22:50.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.381+0000 7f3601e00640 1 -- 172.21.15.159:0/1750244861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f360410c6a0 msgr2=0x7f360419c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:50.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.381+0000 7f3601e00640 1 --2- 172.21.15.159:0/1750244861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f360410c6a0 0x7f360419c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.381+0000 7f3601e00640 1 -- 172.21.15.159:0/1750244861 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f0009560 con 0x7f36041066a0 2024-02-28T23:22:50.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.381+0000 7f3601e00640 1 --2- 172.21.15.159:0/1750244861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36041066a0 0x7f360419c250 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f35f400d6f0 tx=0x7f35f400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:50.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.382+0000 7f35faa00640 1 -- 172.21.15.159:0/1750244861 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f4009a30 con 0x7f36041066a0 2024-02-28T23:22:50.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.382+0000 7f3608a00640 1 -- 172.21.15.159:0/1750244861 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36041a0ed0 con 0x7f36041066a0 2024-02-28T23:22:50.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.382+0000 7f35faa00640 1 -- 172.21.15.159:0/1750244861 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(27 keys) v1 ==== 1109+0+0 (secure 0 0 0) 0x7f35f40054e0 con 0x7f36041066a0 2024-02-28T23:22:50.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.382+0000 7f35faa00640 1 -- 172.21.15.159:0/1750244861 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f35f4004e60 con 0x7f36041066a0 2024-02-28T23:22:50.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.382+0000 7f3608a00640 1 -- 172.21.15.159:0/1750244861 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36041a1430 con 0x7f36041066a0 2024-02-28T23:22:50.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.383+0000 7f3608a00640 1 -- 172.21.15.159:0/1750244861 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f360404e040 con 0x7f36041066a0 2024-02-28T23:22:50.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.384+0000 7f35faa00640 1 -- 172.21.15.159:0/1750244861 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 39) v1 ==== 91487+0+0 (secure 0 0 0) 0x7f35f4009b90 con 0x7f36041066a0 2024-02-28T23:22:50.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.385+0000 7f35faa00640 1 --2- 172.21.15.159:0/1750244861 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f35e806d8d0 0x7f35e806fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-02-28T23:22:50.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.385+0000 7f35faa00640 1 -- 172.21.15.159:0/1750244861 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f35f408d610 con 0x7f36041066a0 2024-02-28T23:22:50.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.385+0000 7f3601400640 1 --2- 172.21.15.159:0/1750244861 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f35e806d8d0 0x7f35e806fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-02-28T23:22:50.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.386+0000 7f3601400640 1 --2- 172.21.15.159:0/1750244861 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f35e806d8d0 0x7f35e806fd90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35f0036040 tx=0x7f35f0000bc0 comp rx=0 tx=0).ready entity=mgr.34102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-02-28T23:22:50.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.389+0000 7f35faa00640 1 -- 172.21.15.159:0/1750244861 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+183564 (secure 0 0 0) 0x7f35f4056c20 con 0x7f36041066a0 2024-02-28T23:22:50.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.602+0000 7f3608a00640 1 -- 172.21.15.159:0/1750244861 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f360419d5a0 con 0x7f36041066a0 2024-02-28T23:22:50.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.603+0000 7f35faa00640 1 -- 172.21.15.159:0/1750244861 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v102) v1 ==== 81+0+2463 (secure 0 0 0) 0x7f35f40209b0 con 0x7f36041066a0 2024-02-28T23:22:50.603 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:6827/3142391154 2024-02-29T23:19:57.396251+0000 2024-02-28T23:22:50.603 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:6826/3142391154 2024-02-29T23:19:57.396251+0000 2024-02-28T23:22:50.603 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6829/455979918 2024-02-29T23:18:59.875868+0000 2024-02-28T23:22:50.603 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2648380137 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:50.603 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/1337780901 2024-02-29T22:57:04.937279+0000 2024-02-28T23:22:50.603 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:6829/2879526003 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:50.603 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/74577353 2024-02-29T22:54:49.969159+0000 2024-02-28T23:22:50.603 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3426997920 2024-02-29T22:55:32.103959+0000 2024-02-28T23:22:50.603 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6827/1702728557 2024-02-29T23:03:41.473671+0000 2024-02-28T23:22:50.603 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2943793350 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:50.603 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/1788579887 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/3999545682 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3798912796 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6826/1702728557 2024-02-29T23:03:41.473671+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3945263774 2024-02-29T22:57:04.937279+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2053056032 2024-02-29T22:55:32.103959+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/2133007913 2024-02-29T22:55:32.103959+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/528876824 2024-02-29T22:55:32.103959+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/2133007913 2024-02-29T22:55:32.103959+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/1021838933 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2242263974 2024-02-29T22:57:04.937279+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/1882871978 2024-02-29T22:54:49.969159+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/1882871978 2024-02-29T22:54:49.969159+0000 2024-02-28T23:22:50.604 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:6828/2879526003 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/862687661 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/419508658 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/3612719472 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6828/455979918 2024-02-29T23:18:59.875868+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/2559284946 2024-02-29T22:57:04.937279+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/2466956559 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/656297432 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/423942112 2024-02-29T22:54:49.969159+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/4231789812 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3397973227 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/3456040694 2024-02-29T22:54:49.969159+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.184:0/2145262352 2024-02-29T23:07:58.913608+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/1861094655 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/1861094655 2024-02-29T23:06:27.595745+0000 2024-02-28T23:22:50.605 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6801/3612719472 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:50.606 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:6800/2559284946 2024-02-29T22:57:04.937279+0000 2024-02-28T23:22:50.606 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.159:0/844515011 2024-02-29T23:12:53.028717+0000 2024-02-28T23:22:50.606 INFO:teuthology.orchestra.run.smithi159.stderr:listed 41 entries 2024-02-28T23:22:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.606+0000 7f3608a00640 1 -- 172.21.15.159:0/1750244861 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f35e806d8d0 msgr2=0x7f35e806fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.606+0000 7f3608a00640 1 --2- 172.21.15.159:0/1750244861 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f35e806d8d0 0x7f35e806fd90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35f0036040 tx=0x7f35f0000bc0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.606+0000 7f3608a00640 1 -- 172.21.15.159:0/1750244861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36041066a0 msgr2=0x7f360419c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-28T23:22:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.606+0000 7f3608a00640 1 --2- 172.21.15.159:0/1750244861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36041066a0 0x7f360419c250 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f35f400d6f0 tx=0x7f35f400dbb0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.606+0000 7f3608a00640 1 -- 172.21.15.159:0/1750244861 shutdown_connections 2024-02-28T23:22:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.606+0000 7f3608a00640 1 --2- 172.21.15.159:0/1750244861 >> [v2:172.21.15.159:6800/937076031,v1:172.21.15.159:6801/937076031] conn(0x7f35e806d8d0 0x7f35e806fd90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.606+0000 7f3608a00640 1 --2- 172.21.15.159:0/1750244861 >> [v2:172.21.15.184:3300/0,v1:172.21.15.184:6789/0] conn(0x7f360410c6a0 0x7f360419c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.606+0000 7f3608a00640 1 --2- 172.21.15.159:0/1750244861 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f36041066a0 0x7f360419c250 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-02-28T23:22:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.606+0000 7f3608a00640 1 -- 172.21.15.159:0/1750244861 >> 172.21.15.159:0/1750244861 conn(0x7f3604075e50 msgr2=0x7f36040777d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-02-28T23:22:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.606+0000 7f3608a00640 1 -- 172.21.15.159:0/1750244861 shutdown_connections 2024-02-28T23:22:50.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-02-28T23:22:50.607+0000 7f3608a00640 1 -- 172.21.15.159:0/1750244861 wait complete. 2024-02-28T23:22:50.625 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi159.front.sepia.ceph.com... 2024-02-28T23:22:50.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-02-28T23:22:50.625 DEBUG:teuthology.orchestra.run.smithi159:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-02-28T23:22:50.714 INFO:teuthology.orchestra.run:waiting for 300 2024-02-28T23:22:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:50 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/3308458557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T23:22:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:50 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/342609812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T23:22:50.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:50 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/3308458557' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-02-28T23:22:50.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:50 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/342609812' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-02-28T23:22:51.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:51 smithi184 ceph-mon[86482]: from='client.? 172.21.15.159:0/1750244861' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T23:22:51.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:51 smithi184 ceph-mon[86482]: pgmap v355: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:51.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:51 smithi159 ceph-mon[113833]: from='client.? 172.21.15.159:0/1750244861' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-02-28T23:22:51.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:51 smithi159 ceph-mon[113833]: pgmap v355: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:52 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:22:52.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:52 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:22:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:22:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:53 smithi184 ceph-mon[86482]: pgmap v356: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:22:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:22:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:22:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:22:53.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:22:53.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:53 smithi159 ceph-mon[113833]: pgmap v356: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:22:53.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:22:53.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:22:53.973 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:22:56.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:56 smithi184 ceph-mon[86482]: pgmap v357: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:56.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:56 smithi159 ceph-mon[113833]: pgmap v357: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:22:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:22:58 smithi159 ceph-mon[113833]: pgmap v358: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:22:58.852 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:22:58 smithi184 ceph-mon[86482]: pgmap v358: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:00 smithi159 ceph-mon[113833]: pgmap v359: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:23:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:00 smithi184 ceph-mon[86482]: pgmap v359: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:23:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:02 smithi184 ceph-mon[86482]: pgmap v360: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:02 smithi159 ceph-mon[113833]: pgmap v360: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:04 smithi159 ceph-mon[113833]: pgmap v361: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:04.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:04 smithi184 ceph-mon[86482]: pgmap v361: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:06 smithi159 ceph-mon[113833]: pgmap v362: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:06 smithi184 ceph-mon[86482]: pgmap v362: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:08 smithi159 ceph-mon[113833]: pgmap v363: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:23:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:08 smithi184 ceph-mon[86482]: pgmap v363: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:23:10.472 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:10 smithi159 ceph-mon[113833]: pgmap v364: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:23:10.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:10 smithi184 ceph-mon[86482]: pgmap v364: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:23:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:12 smithi159 ceph-mon[113833]: pgmap v365: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:12.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:12 smithi184 ceph-mon[86482]: pgmap v365: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:14.653 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:14 smithi184 ceph-mon[86482]: pgmap v366: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:14 smithi159 ceph-mon[113833]: pgmap v366: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:16 smithi159 ceph-mon[113833]: pgmap v367: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:16.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:16 smithi184 ceph-mon[86482]: pgmap v367: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:18 smithi159 ceph-mon[113833]: pgmap v368: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:18.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:18 smithi184 ceph-mon[86482]: pgmap v368: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:20 smithi159 ceph-mon[113833]: pgmap v369: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:23:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:20 smithi184 ceph-mon[86482]: pgmap v369: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:23:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:22 smithi159 ceph-mon[113833]: pgmap v370: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:22.789 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:22 smithi184 ceph-mon[86482]: pgmap v370: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:23:23.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:23:24.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:24 smithi159 ceph-mon[113833]: pgmap v371: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:24.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:24 smithi184 ceph-mon[86482]: pgmap v371: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:26.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:26 smithi159 ceph-mon[113833]: pgmap v372: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:23:26.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:26 smithi184 ceph-mon[86482]: pgmap v372: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:23:28.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:28 smithi159 ceph-mon[113833]: pgmap v373: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:28.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:28 smithi184 ceph-mon[86482]: pgmap v373: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:29.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:29 smithi184 ceph-mon[86482]: pgmap v374: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:23:29.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:29 smithi159 ceph-mon[113833]: pgmap v374: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:23:32.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:32 smithi159 ceph-mon[113833]: pgmap v375: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:32.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:32 smithi184 ceph-mon[86482]: pgmap v375: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:34 smithi159 ceph-mon[113833]: pgmap v376: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:34.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:34 smithi184 ceph-mon[86482]: pgmap v376: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:36.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:36 smithi159 ceph-mon[113833]: pgmap v377: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:23:36.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:36 smithi184 ceph-mon[86482]: pgmap v377: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:23:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:38 smithi184 ceph-mon[86482]: pgmap v378: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:23:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:38 smithi159 ceph-mon[113833]: pgmap v378: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:23:40.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:40 smithi159 ceph-mon[113833]: pgmap v379: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:23:40.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:40 smithi184 ceph-mon[86482]: pgmap v379: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:23:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:42 smithi159 ceph-mon[113833]: pgmap v380: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:23:42.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:42 smithi184 ceph-mon[86482]: pgmap v380: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:23:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:44 smithi159 ceph-mon[113833]: pgmap v381: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:44.751 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:44 smithi184 ceph-mon[86482]: pgmap v381: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:46 smithi159 ceph-mon[113833]: pgmap v382: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:23:46.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:46 smithi184 ceph-mon[86482]: pgmap v382: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:23:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:48 smithi159 ceph-mon[113833]: pgmap v383: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:48.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:48 smithi184 ceph-mon[86482]: pgmap v383: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:50 smithi159 ceph-mon[113833]: pgmap v384: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:23:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:50 smithi184 ceph-mon[86482]: pgmap v384: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:23:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:52 smithi159 ceph-mon[113833]: pgmap v385: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:52 smithi184 ceph-mon[86482]: pgmap v385: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:23:53.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:23:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:23:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:54 smithi159 ceph-mon[113833]: pgmap v386: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:54 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:23:54.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:54 smithi184 ceph-mon[86482]: pgmap v386: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:54.919 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:54 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:23:55.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:23:55.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:23:55.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:55 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:23:55.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:23:55.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:23:55.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:55 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:23:56.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:56 smithi159 ceph-mon[113833]: pgmap v387: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:23:56.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:56 smithi184 ceph-mon[86482]: pgmap v387: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:23:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:23:58 smithi159 ceph-mon[113833]: pgmap v388: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:23:58.813 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:23:58 smithi184 ceph-mon[86482]: pgmap v388: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:00 smithi159 ceph-mon[113833]: pgmap v389: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:00 smithi184 ceph-mon[86482]: pgmap v389: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:02 smithi159 ceph-mon[113833]: pgmap v390: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:02.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:02 smithi184 ceph-mon[86482]: pgmap v390: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:03.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:03 smithi184 ceph-mon[86482]: pgmap v391: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:03.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:03 smithi159 ceph-mon[113833]: pgmap v391: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:06 smithi159 ceph-mon[113833]: pgmap v392: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:06 smithi184 ceph-mon[86482]: pgmap v392: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:08 smithi159 ceph-mon[113833]: pgmap v393: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:24:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:08 smithi184 ceph-mon[86482]: pgmap v393: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:24:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:10 smithi159 ceph-mon[113833]: pgmap v394: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:10.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:10 smithi184 ceph-mon[86482]: pgmap v394: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:12 smithi159 ceph-mon[113833]: pgmap v395: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:24:12.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:12 smithi184 ceph-mon[86482]: pgmap v395: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:24:14.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:14 smithi184 ceph-mon[86482]: pgmap v396: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:14 smithi159 ceph-mon[113833]: pgmap v396: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:16 smithi159 ceph-mon[113833]: pgmap v397: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:16.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:16 smithi184 ceph-mon[86482]: pgmap v397: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:18 smithi159 ceph-mon[113833]: pgmap v398: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:18.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:18 smithi184 ceph-mon[86482]: pgmap v398: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:20 smithi159 ceph-mon[113833]: pgmap v399: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:20 smithi184 ceph-mon[86482]: pgmap v399: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:22 smithi159 ceph-mon[113833]: pgmap v400: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:22 smithi184 ceph-mon[86482]: pgmap v400: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:24:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:24:24.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:24 smithi159 ceph-mon[113833]: pgmap v401: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:24.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:24 smithi184 ceph-mon[86482]: pgmap v401: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:26.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:26 smithi159 ceph-mon[113833]: pgmap v402: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:26.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:26 smithi184 ceph-mon[86482]: pgmap v402: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:28.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:28 smithi159 ceph-mon[113833]: pgmap v403: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:28.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:28 smithi184 ceph-mon[86482]: pgmap v403: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:30.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:30 smithi159 ceph-mon[113833]: pgmap v404: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:30.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:30 smithi184 ceph-mon[86482]: pgmap v404: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:32.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:32 smithi159 ceph-mon[113833]: pgmap v405: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:32.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:32 smithi184 ceph-mon[86482]: pgmap v405: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:34 smithi159 ceph-mon[113833]: pgmap v406: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:34.818 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:34 smithi184 ceph-mon[86482]: pgmap v406: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:35.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:35 smithi184 ceph-mon[86482]: pgmap v407: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:35.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:35 smithi159 ceph-mon[113833]: pgmap v407: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:38.640 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:38 smithi159 ceph-mon[113833]: pgmap v408: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:38.641 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:24:38.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:38 smithi184 ceph-mon[86482]: pgmap v408: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:38.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:24:40.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:40 smithi159 ceph-mon[113833]: pgmap v409: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:40.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:40 smithi184 ceph-mon[86482]: pgmap v409: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:42 smithi159 ceph-mon[113833]: pgmap v410: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:42.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:42 smithi184 ceph-mon[86482]: pgmap v410: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:44 smithi159 ceph-mon[113833]: pgmap v411: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:44 smithi184 ceph-mon[86482]: pgmap v411: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:46 smithi159 ceph-mon[113833]: pgmap v412: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:46.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:46 smithi184 ceph-mon[86482]: pgmap v412: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:48 smithi159 ceph-mon[113833]: pgmap v413: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:48.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:48 smithi184 ceph-mon[86482]: pgmap v413: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:50.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:50 smithi184 ceph-mon[86482]: pgmap v414: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:50 smithi159 ceph-mon[113833]: pgmap v414: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:24:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:52 smithi159 ceph-mon[113833]: pgmap v415: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:52 smithi184 ceph-mon[86482]: pgmap v415: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:53.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:24:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:24:54.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:54 smithi159 ceph-mon[113833]: pgmap v416: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:54.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:54 smithi184 ceph-mon[86482]: pgmap v416: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:56.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:56 smithi159 ceph-mon[113833]: pgmap v417: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:56.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:56 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:24:56.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:56 smithi184 ceph-mon[86482]: pgmap v417: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:24:56.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:56 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:24:57.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:57 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:24:57.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:57 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:24:57.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:57 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:24:57.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:57 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:24:57.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:57 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:24:57.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:57 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:24:58.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:24:58 smithi159 ceph-mon[113833]: pgmap v418: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:24:58.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:24:58 smithi184 ceph-mon[86482]: pgmap v418: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:00 smithi159 ceph-mon[113833]: pgmap v419: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:25:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:00 smithi184 ceph-mon[86482]: pgmap v419: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:25:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:02 smithi159 ceph-mon[113833]: pgmap v420: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:02.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:02 smithi184 ceph-mon[86482]: pgmap v420: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:04.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:04 smithi184 ceph-mon[86482]: pgmap v421: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:04.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:04 smithi159 ceph-mon[113833]: pgmap v421: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:05.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:05 smithi184 ceph-mon[86482]: pgmap v422: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:05.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:05 smithi159 ceph-mon[113833]: pgmap v422: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:08 smithi159 ceph-mon[113833]: pgmap v423: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:25:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:08 smithi184 ceph-mon[86482]: pgmap v423: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:25:10.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:10 smithi159 ceph-mon[113833]: pgmap v424: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:25:10.844 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:10 smithi184 ceph-mon[86482]: pgmap v424: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:25:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:12 smithi159 ceph-mon[113833]: pgmap v425: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:12.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:12 smithi184 ceph-mon[86482]: pgmap v425: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:14 smithi159 ceph-mon[113833]: pgmap v426: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:14.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:14 smithi184 ceph-mon[86482]: pgmap v426: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:16 smithi159 ceph-mon[113833]: pgmap v427: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:16.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:16 smithi184 ceph-mon[86482]: pgmap v427: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:18 smithi159 ceph-mon[113833]: pgmap v428: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:25:18.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:18 smithi184 ceph-mon[86482]: pgmap v428: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:25:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:20 smithi159 ceph-mon[113833]: pgmap v429: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:25:20.851 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:20 smithi184 ceph-mon[86482]: pgmap v429: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:25:22.723 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:22 smithi159 ceph-mon[113833]: pgmap v430: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:25:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:22 smithi184 ceph-mon[86482]: pgmap v430: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:25:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:25:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:25:24.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:24 smithi159 ceph-mon[113833]: pgmap v431: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:25:24.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:24 smithi184 ceph-mon[86482]: pgmap v431: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:25:26.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:26 smithi184 ceph-mon[86482]: pgmap v432: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:25:26.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:26 smithi159 ceph-mon[113833]: pgmap v432: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 767 B/s rd, 1 op/s 2024-02-28T23:25:28.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:28 smithi159 ceph-mon[113833]: pgmap v433: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:25:28.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:28 smithi184 ceph-mon[86482]: pgmap v433: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-28T23:25:30.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:30 smithi159 ceph-mon[113833]: pgmap v434: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:25:30.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:30 smithi184 ceph-mon[86482]: pgmap v434: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:25:32.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:32 smithi184 ceph-mon[86482]: pgmap v435: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:32.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:32 smithi159 ceph-mon[113833]: pgmap v435: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:33.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:33 smithi184 ceph-mon[86482]: pgmap v436: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:33.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:33 smithi159 ceph-mon[113833]: pgmap v436: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:36 smithi159 ceph-mon[113833]: pgmap v437: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:36.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:36 smithi184 ceph-mon[86482]: pgmap v437: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:38 smithi159 ceph-mon[113833]: pgmap v438: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:25:38.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:38 smithi184 ceph-mon[86482]: pgmap v438: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:38.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:25:40.711 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:40 smithi159 ceph-mon[113833]: pgmap v439: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:25:40.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:40 smithi184 ceph-mon[86482]: pgmap v439: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:25:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:42 smithi159 ceph-mon[113833]: pgmap v440: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:42.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:42 smithi184 ceph-mon[86482]: pgmap v440: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:44 smithi159 ceph-mon[113833]: pgmap v441: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:44 smithi184 ceph-mon[86482]: pgmap v441: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:46.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:46 smithi159 ceph-mon[113833]: pgmap v442: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:46.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:46 smithi184 ceph-mon[86482]: pgmap v442: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:48.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:48 smithi159 ceph-mon[113833]: pgmap v443: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:48.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:48 smithi184 ceph-mon[86482]: pgmap v443: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:50 smithi159 ceph-mon[113833]: pgmap v444: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:25:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:50 smithi184 ceph-mon[86482]: pgmap v444: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:25:52.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:52 smithi159 ceph-mon[113833]: pgmap v445: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:52 smithi184 ceph-mon[86482]: pgmap v445: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:25:53.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:25:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:25:54.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:54 smithi184 ceph-mon[86482]: pgmap v446: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:54.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:54 smithi159 ceph-mon[113833]: pgmap v446: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:56.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:56 smithi184 ceph-mon[86482]: pgmap v447: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:25:56.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:56 smithi159 ceph-mon[113833]: pgmap v447: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:25:57.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:57 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:25:57.971 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:57 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:25:58.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:58 smithi184 ceph-mon[86482]: pgmap v448: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:58.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:58 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:25:58.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:58 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:25:58.873 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:58 smithi159 ceph-mon[113833]: pgmap v448: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:25:58.873 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:58 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:25:58.873 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:58 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:25:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:59 smithi184 ceph-mon[86482]: pgmap v449: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:25:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:59 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:25:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:59 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:25:59.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:25:59 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:25:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:59 smithi159 ceph-mon[113833]: pgmap v449: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:25:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:59 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:25:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:59 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:25:59.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:25:59 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:26:02.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:02 smithi184 ceph-mon[86482]: pgmap v450: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:26:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:02 smithi159 ceph-mon[113833]: pgmap v450: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:26:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:04 smithi159 ceph-mon[113833]: pgmap v451: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:04.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:04 smithi184 ceph-mon[86482]: pgmap v451: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:06 smithi159 ceph-mon[113833]: pgmap v452: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:26:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:06 smithi184 ceph-mon[86482]: pgmap v452: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:26:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:08 smithi159 ceph-mon[113833]: pgmap v453: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:08.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:26:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:08 smithi184 ceph-mon[86482]: pgmap v453: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:26:10.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:09 smithi184 ceph-mon[86482]: pgmap v454: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:26:10.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:09 smithi159 ceph-mon[113833]: pgmap v454: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:26:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:12 smithi159 ceph-mon[113833]: pgmap v455: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:12.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:12 smithi184 ceph-mon[86482]: pgmap v455: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:14 smithi159 ceph-mon[113833]: pgmap v456: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:14.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:14 smithi184 ceph-mon[86482]: pgmap v456: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:16 smithi159 ceph-mon[113833]: pgmap v457: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:16.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:16 smithi184 ceph-mon[86482]: pgmap v457: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:18 smithi159 ceph-mon[113833]: pgmap v458: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:18.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:18 smithi184 ceph-mon[86482]: pgmap v458: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:20.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:20 smithi159 ceph-mon[113833]: pgmap v459: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:26:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:20 smithi184 ceph-mon[86482]: pgmap v459: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:26:22.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:22 smithi159 ceph-mon[113833]: pgmap v460: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:26:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:22 smithi184 ceph-mon[86482]: pgmap v460: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:26:23.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:26:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:26:24.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:24 smithi159 ceph-mon[113833]: pgmap v461: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:24.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:24 smithi184 ceph-mon[86482]: pgmap v461: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:26.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:26 smithi184 ceph-mon[86482]: pgmap v462: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:26:26.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:26 smithi159 ceph-mon[113833]: pgmap v462: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:26:28.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:28 smithi184 ceph-mon[86482]: pgmap v463: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:28.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:28 smithi159 ceph-mon[113833]: pgmap v463: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:29.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:29 smithi184 ceph-mon[86482]: pgmap v464: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:26:29.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:29 smithi159 ceph-mon[113833]: pgmap v464: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:26:32.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:32 smithi159 ceph-mon[113833]: pgmap v465: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:32.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:32 smithi184 ceph-mon[86482]: pgmap v465: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:34 smithi159 ceph-mon[113833]: pgmap v466: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:34.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:34 smithi184 ceph-mon[86482]: pgmap v466: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:36.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:36 smithi159 ceph-mon[113833]: pgmap v467: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:36.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:36 smithi184 ceph-mon[86482]: pgmap v467: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:38 smithi184 ceph-mon[86482]: pgmap v468: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:38.600 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:26:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:38 smithi159 ceph-mon[113833]: pgmap v468: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:38.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:26:40.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:40 smithi159 ceph-mon[113833]: pgmap v469: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:26:40.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:40 smithi184 ceph-mon[86482]: pgmap v469: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:26:42.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:42 smithi159 ceph-mon[113833]: pgmap v470: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:42.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:42 smithi184 ceph-mon[86482]: pgmap v470: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:44.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:44 smithi159 ceph-mon[113833]: pgmap v471: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:44.751 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:44 smithi184 ceph-mon[86482]: pgmap v471: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:46.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:46 smithi184 ceph-mon[86482]: pgmap v472: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:46.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:46 smithi159 ceph-mon[113833]: pgmap v472: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:48.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:48 smithi184 ceph-mon[86482]: pgmap v473: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:48.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:48 smithi159 ceph-mon[113833]: pgmap v473: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:50 smithi184 ceph-mon[86482]: pgmap v474: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:26:50.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:50 smithi159 ceph-mon[113833]: pgmap v474: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:26:52.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:52 smithi184 ceph-mon[86482]: pgmap v475: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:52.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:52 smithi159 ceph-mon[113833]: pgmap v475: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:53.774 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:53 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:26:53.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:53 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:26:54.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:54 smithi184 ceph-mon[86482]: pgmap v476: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:54.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:54 smithi159 ceph-mon[113833]: pgmap v476: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:55.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:55 smithi184 ceph-mon[86482]: pgmap v477: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:55.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:55 smithi159 ceph-mon[113833]: pgmap v477: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:26:58.676 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:26:58 smithi159 ceph-mon[113833]: pgmap v478: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:26:58.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:26:58 smithi184 ceph-mon[86482]: pgmap v478: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:00 smithi159 ceph-mon[113833]: pgmap v479: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:27:00.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:00 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:27:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:00 smithi184 ceph-mon[86482]: pgmap v479: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:27:00.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:00 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-28T23:27:01.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:01 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:27:01.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:01 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:27:01.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:01 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:27:01.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:01 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-28T23:27:01.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:01 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-02-28T23:27:01.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:01 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' 2024-02-28T23:27:02.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:02 smithi159 ceph-mon[113833]: pgmap v480: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:02.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:02 smithi184 ceph-mon[86482]: pgmap v480: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:04.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:04 smithi159 ceph-mon[113833]: pgmap v481: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:04.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:04 smithi184 ceph-mon[86482]: pgmap v481: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:06.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:06 smithi159 ceph-mon[113833]: pgmap v482: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:06.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:06 smithi184 ceph-mon[86482]: pgmap v482: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:08 smithi184 ceph-mon[86482]: pgmap v483: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:08.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:08 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:27:08.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:08 smithi159 ceph-mon[113833]: pgmap v483: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:08.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:08 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:27:10.100 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:09 smithi184 ceph-mon[86482]: pgmap v484: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:27:10.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:09 smithi159 ceph-mon[113833]: pgmap v484: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:27:12.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:12 smithi159 ceph-mon[113833]: pgmap v485: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:12.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:12 smithi184 ceph-mon[86482]: pgmap v485: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:14.653 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:14 smithi184 ceph-mon[86482]: pgmap v486: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:14.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:14 smithi159 ceph-mon[113833]: pgmap v486: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:16.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:16 smithi159 ceph-mon[113833]: pgmap v487: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:27:16.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:16 smithi184 ceph-mon[86482]: pgmap v487: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:27:18.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:18 smithi159 ceph-mon[113833]: pgmap v488: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:18.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:18 smithi184 ceph-mon[86482]: pgmap v488: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:20.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:20 smithi184 ceph-mon[86482]: pgmap v489: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:27:20.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:20 smithi159 ceph-mon[113833]: pgmap v489: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:27:22.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:22 smithi184 ceph-mon[86482]: pgmap v490: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:27:22.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:22 smithi159 ceph-mon[113833]: pgmap v490: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:27:23.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:23 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:27:23.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:23 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:27:24.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:24 smithi184 ceph-mon[86482]: pgmap v491: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:24.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:24 smithi159 ceph-mon[113833]: pgmap v491: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:26.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:26 smithi184 ceph-mon[86482]: pgmap v492: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:27:26.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:26 smithi159 ceph-mon[113833]: pgmap v492: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 2 op/s 2024-02-28T23:27:27.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:27 smithi184 ceph-mon[86482]: pgmap v493: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:27.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:27 smithi159 ceph-mon[113833]: pgmap v493: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:30.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:30 smithi159 ceph-mon[113833]: pgmap v494: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:27:30.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:30 smithi184 ceph-mon[86482]: pgmap v494: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 853 B/s rd, 1 op/s 2024-02-28T23:27:32.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:32 smithi159 ceph-mon[113833]: pgmap v495: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:32.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:32 smithi184 ceph-mon[86482]: pgmap v495: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:34.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:34 smithi159 ceph-mon[113833]: pgmap v496: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:34.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:34 smithi184 ceph-mon[86482]: pgmap v496: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:36.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:36 smithi184 ceph-mon[86482]: pgmap v497: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:36.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:36 smithi159 ceph-mon[113833]: pgmap v497: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:38.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:38 smithi184 ceph-mon[86482]: pgmap v498: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:38.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:38 smithi184 ceph-mon[86482]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:27:38.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:38 smithi159 ceph-mon[113833]: pgmap v498: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:38.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:38 smithi159 ceph-mon[113833]: from='mgr.34102 172.21.15.159:0/3642322052' entity='mgr.smithi159.pobewk' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-02-28T23:27:40.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:40 smithi184 ceph-mon[86482]: pgmap v499: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:27:40.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:40 smithi159 ceph-mon[113833]: pgmap v499: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:27:42.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:42 smithi184 ceph-mon[86482]: pgmap v500: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:42.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:42 smithi159 ceph-mon[113833]: pgmap v500: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:44.820 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:44 smithi159 ceph-mon[113833]: pgmap v501: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:44.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:44 smithi184 ceph-mon[86482]: pgmap v501: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:46.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:46 smithi184 ceph-mon[86482]: pgmap v502: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:46.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:46 smithi159 ceph-mon[113833]: pgmap v502: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 2 op/s 2024-02-28T23:27:47.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:47 smithi184 ceph-mon[86482]: pgmap v503: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:47.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:47 smithi159 ceph-mon[113833]: pgmap v503: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-02-28T23:27:49.784 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-02-28T23:27:49.785 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T23:27:49.787 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-28T23:27:49.799 INFO:tasks.cephadm:Teardown begin 2024-02-28T23:27:49.799 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephadm.py", line 1807, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T23:27:49.801 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T23:27:49.905 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T23:27:50.006 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-28T23:27:50.007 DEBUG:teuthology.orchestra.run.smithi159:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-28T23:27:50.063 DEBUG:teuthology.orchestra.run.smithi184:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-28T23:27:50.120 INFO:tasks.cephadm:Stopping all daemons... 2024-02-28T23:27:50.120 INFO:tasks.cephadm.mon.smithi159:Stopping mon.smithi159... 2024-02-28T23:27:50.120 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi159 2024-02-28T23:27:50.465 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:50 smithi159 systemd[1]: Stopping Ceph mon.smithi159 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:27:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:50 smithi159 ceph-mon[113833]: pgmap v504: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:27:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:50 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159[113829]: 2024-02-28T23:27:50.710+0000 7f1cd3800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi159 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:27:50.722 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:50 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159[113829]: 2024-02-28T23:27:50.710+0000 7f1cd3800700 -1 mon.smithi159@0(leader) e3 *** Got Signal Terminated *** 2024-02-28T23:27:50.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:50 smithi184 ceph-mon[86482]: pgmap v504: 65 pgs: 65 active+clean; 209 MiB data, 887 MiB used, 536 GiB / 536 GiB avail; 852 B/s rd, 1 op/s 2024-02-28T23:27:51.222 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:50 smithi159 podman[160864]: 2024-02-28 23:27:50.957619268 +0000 UTC m=+0.401663149 container died 9657ea46dc51b69b3e341d958de79e44f3de16d8a361218608fcc4930aed4b04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0) 2024-02-28T23:27:51.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:51 smithi159 podman[160864]: 2024-02-28 23:27:51.512061924 +0000 UTC m=+0.956105831 container cleanup 9657ea46dc51b69b3e341d958de79e44f3de16d8a361218608fcc4930aed4b04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-02-28T23:27:51.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:51 smithi159 bash[160864]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159 2024-02-28T23:27:51.972 INFO:journalctl@ceph.mon.smithi159.smithi159.stdout:Feb 28 23:27:51 smithi159 podman[160889]: 2024-02-28 23:27:51.738696672 +0000 UTC m=+0.770734151 container remove 9657ea46dc51b69b3e341d958de79e44f3de16d8a361218608fcc4930aed4b04 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi159, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-02-28T23:27:52.258 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi159.service' 2024-02-28T23:27:52.397 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T23:27:52.397 INFO:tasks.cephadm.mon.smithi159:Stopped mon.smithi159 2024-02-28T23:27:52.397 INFO:tasks.cephadm.mon.smithi184:Stopping mon.smithi184... 2024-02-28T23:27:52.398 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi184 2024-02-28T23:27:52.849 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:52 smithi184 systemd[1]: Stopping Ceph mon.smithi184 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:27:53.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:52 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184[86478]: 2024-02-28T23:27:52.985+0000 7f9631e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi184 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:27:53.350 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:52 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184[86478]: 2024-02-28T23:27:52.985+0000 7f9631e00700 -1 mon.smithi184@1(peon) e3 *** Got Signal Terminated *** 2024-02-28T23:27:53.351 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:53 smithi184 podman[123249]: 2024-02-28 23:27:53.191291963 +0000 UTC m=+0.364570194 container died e57190b5e43e8f82af1b51a08af0fba994c530b2e15de615ae5a549fd0e4564d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:27:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:53 smithi184 podman[123249]: 2024-02-28 23:27:53.678381789 +0000 UTC m=+0.851660033 container cleanup e57190b5e43e8f82af1b51a08af0fba994c530b2e15de615ae5a549fd0e4564d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=main-1fb5d10, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-28T23:27:53.850 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:53 smithi184 bash[123249]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184 2024-02-28T23:27:54.329 INFO:journalctl@ceph.mon.smithi184.smithi184.stdout:Feb 28 23:27:53 smithi184 podman[123263]: 2024-02-28 23:27:53.874802882 +0000 UTC m=+0.669280165 container remove e57190b5e43e8f82af1b51a08af0fba994c530b2e15de615ae5a549fd0e4564d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-mon-smithi184, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=main-1fb5d10) 2024-02-28T23:27:54.359 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@mon.smithi184.service' 2024-02-28T23:27:54.497 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T23:27:54.497 INFO:tasks.cephadm.mon.smithi184:Stopped mon.smithi184 2024-02-28T23:27:54.498 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-28T23:27:54.498 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.0 2024-02-28T23:27:54.972 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:27:54 smithi159 systemd[1]: Stopping Ceph osd.0 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:27:55.472 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:27:55 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0[125708]: 2024-02-28T23:27:55.031+0000 7fc82da00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:27:55.472 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:27:55 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0[125708]: 2024-02-28T23:27:55.032+0000 7fc82da00700 -1 osd.0 102 *** Got signal Terminated *** 2024-02-28T23:27:55.472 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:27:55 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0[125708]: 2024-02-28T23:27:55.032+0000 7fc82da00700 -1 osd.0 102 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:28:00.722 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:28:00 smithi159 podman[161010]: 2024-02-28 23:28:00.485760958 +0000 UTC m=+5.588714067 container died bc355acd33650046fcd9db4b379f429383407b8919e4a5098e512434f98ab2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-02-28T23:28:01.325 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:28:01 smithi159 podman[161010]: 2024-02-28 23:28:01.000312852 +0000 UTC m=+6.103266031 container cleanup bc355acd33650046fcd9db4b379f429383407b8919e4a5098e512434f98ab2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240222) 2024-02-28T23:28:01.326 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:28:01 smithi159 bash[161010]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0 2024-02-28T23:28:01.722 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:28:01 smithi159 podman[161029]: 2024-02-28 23:28:01.326992485 +0000 UTC m=+0.831883066 container remove bc355acd33650046fcd9db4b379f429383407b8919e4a5098e512434f98ab2b8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-02-28T23:28:02.421 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:28:02 smithi159 podman[161120]: 2024-02-28 23:28:02.062613127 +0000 UTC m=+0.037025132 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:28:02.421 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:28:02 smithi159 podman[161120]: 2024-02-28 23:28:02.244642125 +0000 UTC m=+0.219054147 container create 0fc4dd68a9ed307ac78138d1cf20cc689dcd03f791f07c500cf41b86a56e3701 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True) 2024-02-28T23:28:02.687 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:28:02 smithi159 podman[161120]: 2024-02-28 23:28:02.531991324 +0000 UTC m=+0.506403353 container init 0fc4dd68a9ed307ac78138d1cf20cc689dcd03f791f07c500cf41b86a56e3701 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-deactivate, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0) 2024-02-28T23:28:02.687 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:28:02 smithi159 podman[161120]: 2024-02-28 23:28:02.543203065 +0000 UTC m=+0.517615072 container start 0fc4dd68a9ed307ac78138d1cf20cc689dcd03f791f07c500cf41b86a56e3701 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:28:02.687 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:28:02 smithi159 podman[161120]: 2024-02-28 23:28:02.688900952 +0000 UTC m=+0.663312954 container attach 0fc4dd68a9ed307ac78138d1cf20cc689dcd03f791f07c500cf41b86a56e3701 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-28T23:28:03.389 INFO:journalctl@ceph.osd.0.smithi159.stdout:Feb 28 23:28:02 smithi159 podman[161120]: 2024-02-28 23:28:02.986248367 +0000 UTC m=+0.960660396 container died 0fc4dd68a9ed307ac78138d1cf20cc689dcd03f791f07c500cf41b86a56e3701 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-0-deactivate, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-02-28T23:28:03.798 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.0.service' 2024-02-28T23:28:03.919 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T23:28:03.920 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-28T23:28:03.920 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-28T23:28:03.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.1 2024-02-28T23:28:04.472 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:04 smithi159 systemd[1]: Stopping Ceph osd.1 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:28:04.972 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:04 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1[131266]: 2024-02-28T23:28:04.610+0000 7f03e9200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:28:04.972 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:04 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1[131266]: 2024-02-28T23:28:04.610+0000 7f03e9200700 -1 osd.1 102 *** Got signal Terminated *** 2024-02-28T23:28:04.973 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:04 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1[131266]: 2024-02-28T23:28:04.610+0000 7f03e9200700 -1 osd.1 102 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:28:10.458 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:10 smithi159 podman[161226]: 2024-02-28 23:28:10.110471308 +0000 UTC m=+5.686531839 container died 9120e23d80c04a18f729568efc6a8f0a94e42f3b4d439d1f27a1907087d81e0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:28:10.722 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:10 smithi159 podman[161226]: 2024-02-28 23:28:10.637871904 +0000 UTC m=+6.213932443 container cleanup 9120e23d80c04a18f729568efc6a8f0a94e42f3b4d439d1f27a1907087d81e0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-02-28T23:28:10.722 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:10 smithi159 bash[161226]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1 2024-02-28T23:28:11.472 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:11 smithi159 podman[161245]: 2024-02-28 23:28:11.097925938 +0000 UTC m=+0.974112314 container remove 9120e23d80c04a18f729568efc6a8f0a94e42f3b4d439d1f27a1907087d81e0d (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:28:12.102 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:11 smithi159 podman[161334]: 2024-02-28 23:28:11.725092165 +0000 UTC m=+0.037017300 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:28:12.103 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:11 smithi159 podman[161334]: 2024-02-28 23:28:11.823649853 +0000 UTC m=+0.135574995 container create 4a7bb7b3fa39118e1da465df0f3a55941593d0a23225105631133b44260794f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS) 2024-02-28T23:28:12.103 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:12 smithi159 podman[161334]: 2024-02-28 23:28:12.103054008 +0000 UTC m=+0.414979179 container init 4a7bb7b3fa39118e1da465df0f3a55941593d0a23225105631133b44260794f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-deactivate, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-02-28T23:28:12.472 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:12 smithi159 podman[161334]: 2024-02-28 23:28:12.114670163 +0000 UTC m=+0.426595294 container start 4a7bb7b3fa39118e1da465df0f3a55941593d0a23225105631133b44260794f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-02-28T23:28:12.472 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:12 smithi159 podman[161334]: 2024-02-28 23:28:12.218259529 +0000 UTC m=+0.530184744 container attach 4a7bb7b3fa39118e1da465df0f3a55941593d0a23225105631133b44260794f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-02-28T23:28:12.893 INFO:journalctl@ceph.osd.1.smithi159.stdout:Feb 28 23:28:12 smithi159 podman[161334]: 2024-02-28 23:28:12.53029344 +0000 UTC m=+0.842218625 container died 4a7bb7b3fa39118e1da465df0f3a55941593d0a23225105631133b44260794f0 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, ceph=True, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-02-28T23:28:13.283 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.1.service' 2024-02-28T23:28:13.399 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T23:28:13.399 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-28T23:28:13.399 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-28T23:28:13.399 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.2 2024-02-28T23:28:13.947 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:13 smithi159 systemd[1]: Stopping Ceph osd.2 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:28:14.222 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:13 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2[137223]: 2024-02-28T23:28:13.948+0000 7fdea5e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:28:14.222 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:13 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2[137223]: 2024-02-28T23:28:13.948+0000 7fdea5e00700 -1 osd.2 102 *** Got signal Terminated *** 2024-02-28T23:28:14.222 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:13 smithi159 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2[137223]: 2024-02-28T23:28:13.948+0000 7fdea5e00700 -1 osd.2 102 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:28:19.687 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:19 smithi159 podman[161441]: 2024-02-28 23:28:19.328601681 +0000 UTC m=+5.520435719 container died 952e59c5816586830b12094096d35f3b65c2a7bbfb27028ddefe6030934c6221 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-02-28T23:28:19.972 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:19 smithi159 podman[161441]: 2024-02-28 23:28:19.808687265 +0000 UTC m=+6.000521316 container cleanup 952e59c5816586830b12094096d35f3b65c2a7bbfb27028ddefe6030934c6221 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10) 2024-02-28T23:28:19.972 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:19 smithi159 bash[161441]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2 2024-02-28T23:28:20.472 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:20 smithi159 podman[161459]: 2024-02-28 23:28:20.060004232 +0000 UTC m=+0.716109242 container remove 952e59c5816586830b12094096d35f3b65c2a7bbfb27028ddefe6030934c6221 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-02-28T23:28:21.104 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:20 smithi159 podman[161549]: 2024-02-28 23:28:20.79083183 +0000 UTC m=+0.034957567 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:28:21.104 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:20 smithi159 podman[161549]: 2024-02-28 23:28:20.935781464 +0000 UTC m=+0.179907232 container create fd6726fdc0e8f4c552dd423e6f8bca124dfa467d1b00f816da45ca19b1bb6ce5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-deactivate, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:28:21.472 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:21 smithi159 podman[161549]: 2024-02-28 23:28:21.231193135 +0000 UTC m=+0.475318895 container init fd6726fdc0e8f4c552dd423e6f8bca124dfa467d1b00f816da45ca19b1bb6ce5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True) 2024-02-28T23:28:21.472 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:21 smithi159 podman[161549]: 2024-02-28 23:28:21.244443045 +0000 UTC m=+0.488568806 container start fd6726fdc0e8f4c552dd423e6f8bca124dfa467d1b00f816da45ca19b1bb6ce5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=main-1fb5d10, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222) 2024-02-28T23:28:21.472 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:21 smithi159 podman[161549]: 2024-02-28 23:28:21.321597116 +0000 UTC m=+0.565722893 container attach fd6726fdc0e8f4c552dd423e6f8bca124dfa467d1b00f816da45ca19b1bb6ce5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-02-28T23:28:21.972 INFO:journalctl@ceph.osd.2.smithi159.stdout:Feb 28 23:28:21 smithi159 podman[161549]: 2024-02-28 23:28:21.675879403 +0000 UTC m=+0.920005183 container died fd6726fdc0e8f4c552dd423e6f8bca124dfa467d1b00f816da45ca19b1bb6ce5 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, ceph=True, org.label-schema.schema-version=1.0) 2024-02-28T23:28:22.481 DEBUG:teuthology.orchestra.run.smithi159:> sudo pkill -f 'journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.2.service' 2024-02-28T23:28:22.603 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T23:28:22.603 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-28T23:28:22.603 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-28T23:28:22.603 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.3 2024-02-28T23:28:23.042 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:22 smithi184 systemd[1]: Stopping Ceph osd.3 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:28:23.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:23 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:23.042+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:23.350 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:23 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[96050]: 2024-02-28T23:28:23.153+0000 7f6179000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:28:23.350 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:23 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[96050]: 2024-02-28T23:28:23.153+0000 7f6179000700 -1 osd.3 102 *** Got signal Terminated *** 2024-02-28T23:28:23.350 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:23 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[96050]: 2024-02-28T23:28:23.153+0000 7f6179000700 -1 osd.3 102 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:28:24.350 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:24 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[96050]: 2024-02-28T23:28:24.136+0000 7f6175200700 -1 osd.3 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.365127+0000 front 2024-02-28T23:27:58.365238+0000 (oldest deadline 2024-02-28T23:28:23.664668+0000) 2024-02-28T23:28:24.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:24 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:24.006+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:24.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:24 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:24.515+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:25.350 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:25 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[96050]: 2024-02-28T23:28:25.175+0000 7f6175200700 -1 osd.3 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.365127+0000 front 2024-02-28T23:27:58.365238+0000 (oldest deadline 2024-02-28T23:28:23.664668+0000) 2024-02-28T23:28:25.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:24 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:24.988+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:25.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:25 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:25.502+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:26.316 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:26 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[96050]: 2024-02-28T23:28:26.160+0000 7f6175200700 -1 osd.3 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.365127+0000 front 2024-02-28T23:27:58.365238+0000 (oldest deadline 2024-02-28T23:28:23.664668+0000) 2024-02-28T23:28:26.316 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:26 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:26.001+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:26.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:26 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:26.486+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:27.350 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:27 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3[96050]: 2024-02-28T23:28:27.174+0000 7f6175200700 -1 osd.3 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.365127+0000 front 2024-02-28T23:27:58.365238+0000 (oldest deadline 2024-02-28T23:28:23.664668+0000) 2024-02-28T23:28:27.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:27 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:27.035+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:27.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:27 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:27.479+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:28.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:28 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:28.026+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:28.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:28 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:28.497+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:28.850 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:28 smithi184 podman[123386]: 2024-02-28 23:28:28.746013896 +0000 UTC m=+5.739831462 container died 643ebdb823be81e7270f147c1af59cb7cb4a9056406d761ed0588ef55c827fa8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240222, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:28:29.351 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:29 smithi184 podman[123386]: 2024-02-28 23:28:29.21440885 +0000 UTC m=+6.208226452 container cleanup 643ebdb823be81e7270f147c1af59cb7cb4a9056406d761ed0588ef55c827fa8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-02-28T23:28:29.351 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:29 smithi184 bash[123386]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3 2024-02-28T23:28:29.351 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:29 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:29.009+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:29.850 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:29 smithi184 podman[123405]: 2024-02-28 23:28:29.39915798 +0000 UTC m=+0.631776565 container remove 643ebdb823be81e7270f147c1af59cb7cb4a9056406d761ed0588ef55c827fa8 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:28:29.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:29 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:29.460+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:30.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:30 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:30.055+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:30.350 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:30 smithi184 podman[123495]: 2024-02-28 23:28:30.099850581 +0000 UTC m=+0.040961337 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:28:30.350 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:30 smithi184 podman[123495]: 2024-02-28 23:28:30.266830158 +0000 UTC m=+0.207940950 container create ba60c887886e495803de3e050b71fdc9fe257cbf92e4233fd47f62a491cd0ce1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd) 2024-02-28T23:28:30.737 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:30 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:30.431+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:30.738 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:30 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:30.431+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:30.738 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:30 smithi184 podman[123495]: 2024-02-28 23:28:30.536976597 +0000 UTC m=+0.478087412 container init ba60c887886e495803de3e050b71fdc9fe257cbf92e4233fd47f62a491cd0ce1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, GIT_CLEAN=True) 2024-02-28T23:28:30.738 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:30 smithi184 podman[123495]: 2024-02-28 23:28:30.547831506 +0000 UTC m=+0.488942248 container start ba60c887886e495803de3e050b71fdc9fe257cbf92e4233fd47f62a491cd0ce1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-02-28T23:28:30.738 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:30 smithi184 podman[123495]: 2024-02-28 23:28:30.627607298 +0000 UTC m=+0.568718056 container attach ba60c887886e495803de3e050b71fdc9fe257cbf92e4233fd47f62a491cd0ce1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-deactivate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10) 2024-02-28T23:28:31.012 INFO:journalctl@ceph.osd.3.smithi184.stdout:Feb 28 23:28:30 smithi184 podman[123495]: 2024-02-28 23:28:30.986755553 +0000 UTC m=+0.927866338 container died ba60c887886e495803de3e050b71fdc9fe257cbf92e4233fd47f62a491cd0ce1 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-3-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240222, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-02-28T23:28:31.346 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:31 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:31.014+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:31.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:31 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:31.428+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:31.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:31 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:31.428+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:31.723 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.3.service' 2024-02-28T23:28:31.836 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T23:28:31.836 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-28T23:28:31.836 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-28T23:28:31.836 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.4 2024-02-28T23:28:32.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:31 smithi184 systemd[1]: Stopping Ceph osd.4 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:28:32.351 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:32 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:32.030+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:32.351 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:32 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:32.030+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:07.359560+0000 front 2024-02-28T23:28:07.359603+0000 (oldest deadline 2024-02-28T23:28:31.458906+0000) 2024-02-28T23:28:32.850 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:32 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:32.388+0000 7f450a000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:28:32.850 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:32 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:32.388+0000 7f450a000700 -1 osd.4 102 *** Got signal Terminated *** 2024-02-28T23:28:32.850 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:32 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:32.388+0000 7f450a000700 -1 osd.4 102 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:28:32.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:32 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:32.409+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:32.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:32 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:32.409+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:33.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:33 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:33.063+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:33.350 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:33 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:33.063+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:07.359560+0000 front 2024-02-28T23:28:07.359603+0000 (oldest deadline 2024-02-28T23:28:31.458906+0000) 2024-02-28T23:28:33.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:33 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:33.390+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:33.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:33 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:33.390+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:34.426 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:34 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:34.106+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:34.426 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:34 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:34.106+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:07.359560+0000 front 2024-02-28T23:28:07.359603+0000 (oldest deadline 2024-02-28T23:28:31.458906+0000) 2024-02-28T23:28:34.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:34 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:34.427+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:34.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:34 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:34.427+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:35.438 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:35 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:35.147+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:35.438 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:35 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:35.147+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:07.359560+0000 front 2024-02-28T23:28:07.359603+0000 (oldest deadline 2024-02-28T23:28:31.458906+0000) 2024-02-28T23:28:35.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:35 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:35.438+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:35.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:35 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:35.439+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:36.530 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:36 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:36.160+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:36.530 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:36 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:36.160+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:07.359560+0000 front 2024-02-28T23:28:07.359603+0000 (oldest deadline 2024-02-28T23:28:31.458906+0000) 2024-02-28T23:28:36.531 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:36 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:36.394+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:36.531 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:36 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:36.394+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:37.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:37 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:37.375+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:37.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:37 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:37.375+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:37.600 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:37 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:37.127+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:57.457270+0000 front 2024-02-28T23:27:57.457232+0000 (oldest deadline 2024-02-28T23:28:22.657476+0000) 2024-02-28T23:28:37.600 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:37 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4[100960]: 2024-02-28T23:28:37.127+0000 7f4501200700 -1 osd.4 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:07.359560+0000 front 2024-02-28T23:28:07.359603+0000 (oldest deadline 2024-02-28T23:28:31.458906+0000) 2024-02-28T23:28:38.130 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:37 smithi184 podman[123612]: 2024-02-28 23:28:37.861121093 +0000 UTC m=+5.638763147 container died dc8cef678e653fd60ec6533aa4734dba0e3d7d1a08c9b31c144cb3dcf5247888 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4, GIT_BRANCH=HEAD, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0) 2024-02-28T23:28:38.443 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:38 smithi184 podman[123612]: 2024-02-28 23:28:38.250921117 +0000 UTC m=+6.028563141 container cleanup dc8cef678e653fd60ec6533aa4734dba0e3d7d1a08c9b31c144cb3dcf5247888 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4, GIT_CLEAN=True, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image) 2024-02-28T23:28:38.443 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:38 smithi184 bash[123612]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4 2024-02-28T23:28:38.443 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:38 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:38.337+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:38.443 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:38 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:38.337+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:38.850 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:38 smithi184 podman[123631]: 2024-02-28 23:28:38.443960893 +0000 UTC m=+0.564187469 container remove dc8cef678e653fd60ec6533aa4734dba0e3d7d1a08c9b31c144cb3dcf5247888 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-02-28T23:28:39.547 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:39 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:39.358+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:39.547 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:39 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:39.358+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:39.547 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:39 smithi184 podman[123718]: 2024-02-28 23:28:39.144653394 +0000 UTC m=+0.035217644 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:28:39.547 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:39 smithi184 podman[123718]: 2024-02-28 23:28:39.269902699 +0000 UTC m=+0.160466985 container create d5c42af18a76f5f9d9f5da618372a68211c4bd93268a2982b8922cf960e6d1f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0) 2024-02-28T23:28:39.547 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:39 smithi184 podman[123718]: 2024-02-28 23:28:39.548833884 +0000 UTC m=+0.439398174 container init d5c42af18a76f5f9d9f5da618372a68211c4bd93268a2982b8922cf960e6d1f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-deactivate, io.buildah.version=1.33.5, RELEASE=main-1fb5d10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-02-28T23:28:39.850 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:39 smithi184 podman[123718]: 2024-02-28 23:28:39.559800662 +0000 UTC m=+0.450364922 container start d5c42af18a76f5f9d9f5da618372a68211c4bd93268a2982b8922cf960e6d1f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-deactivate, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, RELEASE=main-1fb5d10, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-02-28T23:28:39.850 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:39 smithi184 podman[123718]: 2024-02-28 23:28:39.647646975 +0000 UTC m=+0.538211261 container attach d5c42af18a76f5f9d9f5da618372a68211c4bd93268a2982b8922cf960e6d1f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-deactivate, RELEASE=main-1fb5d10, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240222, ceph=True) 2024-02-28T23:28:40.320 INFO:journalctl@ceph.osd.4.smithi184.stdout:Feb 28 23:28:40 smithi184 podman[123744]: 2024-02-28 23:28:40.041061024 +0000 UTC m=+0.034906358 container died d5c42af18a76f5f9d9f5da618372a68211c4bd93268a2982b8922cf960e6d1f3 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240222, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, RELEASE=main-1fb5d10, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-02-28T23:28:40.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:40 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:40.328+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:40.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:40 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:40.328+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:40.689 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.4.service' 2024-02-28T23:28:40.811 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T23:28:40.811 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-28T23:28:40.811 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-28T23:28:40.811 DEBUG:teuthology.orchestra.run.smithi184:> sudo systemctl stop ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.5 2024-02-28T23:28:41.284 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:40 smithi184 systemd[1]: Stopping Ceph osd.5 for 24bd0fca-d68c-11ee-95c3-87774f69a715... 2024-02-28T23:28:41.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:41 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:41.285+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:41.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:41 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:41.285+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:41.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:41 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:41.378+0000 7f272e800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-02-28T23:28:41.601 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:41 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:41.378+0000 7f272e800700 -1 osd.5 102 *** Got signal Terminated *** 2024-02-28T23:28:41.601 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:41 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:41.378+0000 7f272e800700 -1 osd.5 102 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-28T23:28:42.351 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:42 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:42.272+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:42.351 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:42 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:42.272+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:43.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:43 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:43.266+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:43.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:43 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:43.266+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:44.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:44 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:44.234+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:44.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:44 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:44.234+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:45.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:45 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:45.254+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:45.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:45 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:45.254+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:45.600 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:45 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:45.254+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6822 osd.2 since back 2024-02-28T23:28:13.768229+0000 front 2024-02-28T23:28:13.768173+0000 (oldest deadline 2024-02-28T23:28:44.368709+0000) 2024-02-28T23:28:46.501 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:46 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:46.212+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6806 osd.0 since back 2024-02-28T23:27:58.064458+0000 front 2024-02-28T23:27:58.064673+0000 (oldest deadline 2024-02-28T23:28:23.964341+0000) 2024-02-28T23:28:46.501 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:46 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:46.212+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6814 osd.1 since back 2024-02-28T23:28:06.767087+0000 front 2024-02-28T23:28:06.766617+0000 (oldest deadline 2024-02-28T23:28:30.266625+0000) 2024-02-28T23:28:46.501 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:46 smithi184 ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5[106332]: 2024-02-28T23:28:46.212+0000 7f2725a00700 -1 osd.5 102 heartbeat_check: no reply from 172.21.15.159:6822 osd.2 since back 2024-02-28T23:28:13.768229+0000 front 2024-02-28T23:28:13.768173+0000 (oldest deadline 2024-02-28T23:28:44.368709+0000) 2024-02-28T23:28:47.161 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:46 smithi184 podman[123823]: 2024-02-28 23:28:46.949885834 +0000 UTC m=+5.694803337 container died 1426063f8d8e0724c566f4d48840ff8c11884bde799d7e6e782438df28590038 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-02-28T23:28:47.486 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:47 smithi184 podman[123823]: 2024-02-28 23:28:47.29526418 +0000 UTC m=+6.040181743 container cleanup 1426063f8d8e0724c566f4d48840ff8c11884bde799d7e6e782438df28590038 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240222, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=main-1fb5d10) 2024-02-28T23:28:47.486 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:47 smithi184 bash[123823]: ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5 2024-02-28T23:28:47.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:47 smithi184 podman[123845]: 2024-02-28 23:28:47.487680716 +0000 UTC m=+0.523742621 container remove 1426063f8d8e0724c566f4d48840ff8c11884bde799d7e6e782438df28590038 (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-02-28T23:28:48.350 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:48 smithi184 podman[123940]: 2024-02-28 23:28:48.085107411 +0000 UTC m=+0.031301381 image pull 2272b2c42f9babde922baaabf6efc9b50088cc9d3a128524b9d525dcb1eddc6e quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc 2024-02-28T23:28:48.350 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:48 smithi184 podman[123940]: 2024-02-28 23:28:48.213773658 +0000 UTC m=+0.159967658 container create 1c55f7ba7e1747624aea7b460e1097461ac3409f73293e72864aac014361f67f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-deactivate, ceph=True, GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240222, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=main-1fb5d10) 2024-02-28T23:28:48.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:48 smithi184 podman[123940]: 2024-02-28 23:28:48.459007301 +0000 UTC m=+0.405201308 container init 1c55f7ba7e1747624aea7b460e1097461ac3409f73293e72864aac014361f67f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=main-1fb5d10, ceph=True) 2024-02-28T23:28:48.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:48 smithi184 podman[123940]: 2024-02-28 23:28:48.469875167 +0000 UTC m=+0.416069174 container start 1c55f7ba7e1747624aea7b460e1097461ac3409f73293e72864aac014361f67f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=main-1fb5d10, org.label-schema.build-date=20240222) 2024-02-28T23:28:48.850 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:48 smithi184 podman[123940]: 2024-02-28 23:28:48.55786139 +0000 UTC m=+0.504055437 container attach 1c55f7ba7e1747624aea7b460e1097461ac3409f73293e72864aac014361f67f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-deactivate, RELEASE=main-1fb5d10, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240222, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-02-28T23:28:49.209 INFO:journalctl@ceph.osd.5.smithi184.stdout:Feb 28 23:28:48 smithi184 podman[123940]: 2024-02-28 23:28:48.899606352 +0000 UTC m=+0.845800362 container died 1c55f7ba7e1747624aea7b460e1097461ac3409f73293e72864aac014361f67f (image=quay.ceph.io/ceph-ci/ceph@sha256:7051beed95d8dfc8c2b1de37206abb8f79d596c447bea39002f2bbaf581330cc, name=ceph-24bd0fca-d68c-11ee-95c3-87774f69a715-osd-5-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=1617517b9622744995c4661989e3c30d036a7cfd, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240222, RELEASE=main-1fb5d10, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-02-28T23:28:49.560 DEBUG:teuthology.orchestra.run.smithi184:> sudo pkill -f 'journalctl -f -n 0 -u ceph-24bd0fca-d68c-11ee-95c3-87774f69a715@osd.5.service' 2024-02-28T23:28:49.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-28T23:28:49.681 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-28T23:28:49.681 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 --force --keep-logs 2024-02-28T23:28:49.971 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T23:28:57.015 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi159.stderr:ceph-fuse[77101]: fuse finished with error 0 and tester_r 0 2024-02-28T23:29:19.296 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 --force --keep-logs 2024-02-28T23:29:19.580 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T23:29:37.984 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T23:29:38.084 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-28T23:29:38.186 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-28T23:29:38.188 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601/remote/smithi159/crash 2024-02-28T23:29:38.189 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/crash -- . 2024-02-28T23:29:38.273 INFO:teuthology.orchestra.run.smithi159.stderr:tar: /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/crash: Cannot open: No such file or directory 2024-02-28T23:29:38.273 INFO:teuthology.orchestra.run.smithi159.stderr:tar: Error is not recoverable: exiting now 2024-02-28T23:29:38.277 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/crash to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601/remote/smithi184/crash 2024-02-28T23:29:38.278 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/crash -- . 2024-02-28T23:29:38.372 INFO:teuthology.orchestra.run.smithi184.stderr:tar: /var/lib/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/crash: Cannot open: No such file or directory 2024-02-28T23:29:38.372 INFO:teuthology.orchestra.run.smithi184.stderr:tar: Error is not recoverable: exiting now 2024-02-28T23:29:38.376 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-28T23:29:38.376 DEBUG:teuthology.orchestra.run.smithi159:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-02-28T23:29:38.482 INFO:tasks.cephadm:Compressing logs... 2024-02-28T23:29:38.482 DEBUG:teuthology.orchestra.run.smithi159:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-28T23:29:38.486 DEBUG:teuthology.orchestra.run.smithi184:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-28T23:29:38.551 INFO:teuthology.orchestra.run.smithi159.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-28T23:29:38.551 INFO:teuthology.orchestra.run.smithi159.stderr:: No such file or directory 2024-02-28T23:29:38.552 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-02-28T23:29:38.553 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi159.log 2024-02-28T23:29:38.555 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi159.mbaqic.log 2024-02-28T23:29:38.556 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.audit.log 2024-02-28T23:29:38.557 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi159.log: /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi159.mbaqic.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.1.log 2024-02-28T23:29:38.559 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi159.azxrct.log 2024-02-28T23:29:38.561 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.1.log: /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi159.azxrct.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.0.log 2024-02-28T23:29:38.564 INFO:teuthology.orchestra.run.smithi159.stderr: 92.5% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi159.log.gz 2024-02-28T23:29:38.564 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.0.log: 91.4% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.audit.log.gz 2024-02-28T23:29:38.567 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.cephadm.log 2024-02-28T23:29:38.569 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.log 2024-02-28T23:29:38.571 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.2.log 2024-02-28T23:29:38.571 INFO:teuthology.orchestra.run.smithi159.stderr: 89.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-28T23:29:38.571 INFO:teuthology.orchestra.run.smithi159.stderr: 85.6% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.cephadm.log.gz 2024-02-28T23:29:38.573 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.log: /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-volume.log 2024-02-28T23:29:38.576 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mgr.smithi159.pobewk.log 2024-02-28T23:29:38.577 INFO:teuthology.orchestra.run.smithi184.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-02-28T23:29:38.577 INFO:teuthology.orchestra.run.smithi159.stderr: 88.7% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.log.gz 2024-02-28T23:29:38.579 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-28T23:29:38.580 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi184.pnifob.log 2024-02-28T23:29:38.581 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi184.log 2024-02-28T23:29:38.582 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mgr.smithi159.pobewk.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mon.smithi159.log 2024-02-28T23:29:38.582 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi184.pnifob.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi184.azwkfx.log 2024-02-28T23:29:38.583 INFO:teuthology.orchestra.run.smithi184.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-28T23:29:38.583 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi184.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.audit.log 2024-02-28T23:29:38.585 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi184.azwkfx.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.4.log 2024-02-28T23:29:38.586 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mgr.smithi184.quvmnx.log 2024-02-28T23:29:38.587 INFO:teuthology.orchestra.run.smithi184.stderr: 94.3% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-client.ceph-exporter.smithi184.log.gz 2024-02-28T23:29:38.588 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.5.log 2024-02-28T23:29:38.589 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mgr.smithi184.quvmnx.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mon.smithi184.log 2024-02-28T23:29:38.590 INFO:teuthology.orchestra.run.smithi184.stderr: 91.6% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.audit.log.gz 2024-02-28T23:29:38.590 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.3.log 2024-02-28T23:29:38.592 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.5.log: /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mon.smithi184.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.cephadm.log 2024-02-28T23:29:38.595 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.3.log: /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.cephadm.log: 85.6% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.cephadm.log.gz 2024-02-28T23:29:38.596 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.log 2024-02-28T23:29:38.597 INFO:teuthology.orchestra.run.smithi184.stderr: 92.6% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi184.azwkfx.log.gz 2024-02-28T23:29:38.600 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-volume.log 2024-02-28T23:29:38.603 INFO:teuthology.orchestra.run.smithi184.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-02-28T23:29:38.604 INFO:teuthology.orchestra.run.smithi184.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-volume.log: /var/log/ceph/ceph-client.1.log: 88.7% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph.log.gz 2024-02-28T23:29:38.624 INFO:teuthology.orchestra.run.smithi184.stderr: 90.8% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-volume.log.gz 2024-02-28T23:29:38.625 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mon.smithi159.log: 90.8% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-volume.log.gz 2024-02-28T23:29:38.640 INFO:teuthology.orchestra.run.smithi184.stderr: 89.2% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mgr.smithi184.quvmnx.log.gz 2024-02-28T23:29:39.001 INFO:teuthology.orchestra.run.smithi184.stderr: 92.5% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mon.smithi184.log.gz 2024-02-28T23:29:39.204 INFO:teuthology.orchestra.run.smithi159.stderr: 88.4% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mgr.smithi159.pobewk.log.gz 2024-02-28T23:29:40.153 INFO:teuthology.orchestra.run.smithi159.stderr: 90.4% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mon.smithi159.log.gz 2024-02-28T23:29:43.304 INFO:teuthology.orchestra.run.smithi184.stderr: 93.4% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.4.log.gz 2024-02-28T23:29:45.029 INFO:teuthology.orchestra.run.smithi184.stderr: 93.4% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.5.log.gz 2024-02-28T23:29:45.668 INFO:teuthology.orchestra.run.smithi184.stderr: 93.6% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.3.log.gz 2024-02-28T23:29:46.240 INFO:teuthology.orchestra.run.smithi159.stderr: 93.5% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.0.log.gz 2024-02-28T23:29:46.285 INFO:teuthology.orchestra.run.smithi184.stderr: 94.7% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi184.pnifob.log.gz 2024-02-28T23:29:46.836 INFO:teuthology.orchestra.run.smithi159.stderr: 92.8% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.1.log.gz 2024-02-28T23:29:46.932 INFO:teuthology.orchestra.run.smithi159.stderr: 93.3% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-osd.2.log.gz 2024-02-28T23:29:54.404 INFO:teuthology.orchestra.run.smithi184.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-02-28T23:29:54.404 INFO:teuthology.orchestra.run.smithi184.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-02-28T23:29:54.409 INFO:teuthology.orchestra.run.smithi184.stderr: 2024-02-28T23:29:54.409 INFO:teuthology.orchestra.run.smithi184.stderr:real 0m15.869s 2024-02-28T23:29:54.409 INFO:teuthology.orchestra.run.smithi184.stderr:user 0m39.688s 2024-02-28T23:29:54.409 INFO:teuthology.orchestra.run.smithi184.stderr:sys 0m2.666s 2024-02-28T23:29:54.710 INFO:teuthology.orchestra.run.smithi159.stderr: 94.7% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi159.mbaqic.log.gz 2024-02-28T23:29:56.551 INFO:teuthology.orchestra.run.smithi159.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-02-28T23:31:14.787 INFO:teuthology.orchestra.run.smithi159.stderr: 92.9% -- replaced with /var/log/ceph/24bd0fca-d68c-11ee-95c3-87774f69a715/ceph-mds.cephfs.smithi159.azxrct.log.gz 2024-02-28T23:31:14.791 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-02-28T23:31:14.792 INFO:teuthology.orchestra.run.smithi159.stderr:real 1m36.273s 2024-02-28T23:31:14.792 INFO:teuthology.orchestra.run.smithi159.stderr:user 2m25.034s 2024-02-28T23:31:14.792 INFO:teuthology.orchestra.run.smithi159.stderr:sys 0m11.286s 2024-02-28T23:31:14.793 INFO:tasks.cephadm:Archiving logs... 2024-02-28T23:31:14.793 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601/remote/smithi159/log 2024-02-28T23:31:14.795 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-28T23:31:36.326 DEBUG:teuthology.misc:Transferring archived files from smithi184:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601/remote/smithi184/log 2024-02-28T23:31:36.327 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-28T23:31:41.459 INFO:tasks.cephadm:Removing cluster... 2024-02-28T23:31:41.459 DEBUG:teuthology.orchestra.run.smithi159:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 --force 2024-02-28T23:31:41.728 INFO:teuthology.orchestra.run.smithi159.stdout:Deleting cluster with fsid: 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T23:31:42.856 DEBUG:teuthology.orchestra.run.smithi184:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 24bd0fca-d68c-11ee-95c3-87774f69a715 --force 2024-02-28T23:31:43.133 INFO:teuthology.orchestra.run.smithi184.stdout:Deleting cluster with fsid: 24bd0fca-d68c-11ee-95c3-87774f69a715 2024-02-28T23:31:43.864 INFO:tasks.cephadm:Removing cephadm ... 2024-02-28T23:31:43.864 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-28T23:31:43.922 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-28T23:31:43.980 INFO:tasks.cephadm:Teardown complete 2024-02-28T23:31:43.980 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-02-28T23:31:43.991 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T23:31:43.992 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-02-28T23:31:43.992 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-28T23:31:44.000 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-02-28T23:31:44.147 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-28T23:31:44.157 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-28T23:31:44.157 DEBUG:teuthology.orchestra.run.smithi159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T23:31:44.165 DEBUG:teuthology.orchestra.run.smithi184:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-28T23:31:44.209 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-02-28T23:31:44.218 INFO:teuthology.orchestra.run.smithi184.stderr:bash: line 1: ntpq: command not found 2024-02-28T23:31:44.219 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T23:31:44.219 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-02-28T23:31:44.219 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 39 +1586us[+1586us] +/- 130ms 2024-02-28T23:31:44.219 INFO:teuthology.orchestra.run.smithi159.stdout:^* hv02.front.sepia.ceph.com 3 6 377 45 -1548us[-1541us] +/- 62ms 2024-02-28T23:31:44.219 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv03.front.sepia.ceph.com 3 8 377 110 +1077us[+1090us] +/- 72ms 2024-02-28T23:31:44.219 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T23:31:44.227 INFO:teuthology.orchestra.run.smithi184.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-28T23:31:44.227 INFO:teuthology.orchestra.run.smithi184.stdout:=============================================================================== 2024-02-28T23:31:44.227 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 43 +1568us[+1568us] +/- 130ms 2024-02-28T23:31:44.227 INFO:teuthology.orchestra.run.smithi184.stdout:^* hv02.front.sepia.ceph.com 3 6 377 46 -1598us[-1594us] +/- 62ms 2024-02-28T23:31:44.227 INFO:teuthology.orchestra.run.smithi184.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 +998us[+1002us] +/- 73ms 2024-02-28T23:31:44.227 INFO:teuthology.orchestra.run.smithi184.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-28T23:31:44.228 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-28T23:31:44.238 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-28T23:31:44.239 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-28T23:31:44.249 DEBUG:teuthology.orchestra.run.smithi159:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-28T23:31:44.491 DEBUG:teuthology.orchestra.run.smithi184:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-28T23:31:44.722 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T23:31:44.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T23:31:44.826 DEBUG:teuthology.orchestra.run.smithi184:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-28T23:31:44.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T23:31:44.931 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-28T23:31:44.942 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-28T23:31:44.989 INFO:teuthology.task.internal:Duration was 2872.667987 seconds 2024-02-28T23:31:44.990 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-28T23:31:45.000 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-28T23:31:45.000 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-28T23:31:45.008 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-28T23:31:45.164 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T23:31:45.170 INFO:teuthology.orchestra.run.smithi184.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-28T23:31:45.533 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-28T23:31:45.533 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi159.front.sepia.ceph.com 2024-02-28T23:31:45.534 DEBUG:teuthology.orchestra.run.smithi159:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-28T23:31:45.590 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi184.front.sepia.ceph.com 2024-02-28T23:31:45.590 DEBUG:teuthology.orchestra.run.smithi184:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-28T23:31:45.666 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-28T23:31:45.666 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-28T23:31:45.673 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-28T23:31:45.759 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-28T23:31:45.759 DEBUG:teuthology.orchestra.run.smithi159:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-28T23:31:45.763 DEBUG:teuthology.orchestra.run.smithi184:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-28T23:31:46.565 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-28T23:31:46.576 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-28T23:31:46.577 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-28T23:31:46.661 DEBUG:teuthology.orchestra.run.smithi184:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-28T23:31:46.759 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-28T23:31:46.771 DEBUG:teuthology.orchestra.run.smithi159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-28T23:31:46.778 DEBUG:teuthology.orchestra.run.smithi184:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-28T23:31:46.875 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = core 2024-02-28T23:31:46.887 INFO:teuthology.orchestra.run.smithi184.stdout:kernel.core_pattern = core 2024-02-28T23:31:46.947 DEBUG:teuthology.orchestra.run.smithi159:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-28T23:31:46.998 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T23:31:46.998 DEBUG:teuthology.orchestra.run.smithi184:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-28T23:31:47.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T23:31:47.053 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-28T23:31:47.065 INFO:teuthology.task.internal:Transferring archived files... 2024-02-28T23:31:47.066 DEBUG:teuthology.misc:Transferring archived files from smithi159:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601/remote/smithi159 2024-02-28T23:31:47.066 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-28T23:31:47.196 DEBUG:teuthology.misc:Transferring archived files from smithi184:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601/remote/smithi184 2024-02-28T23:31:47.196 DEBUG:teuthology.orchestra.run.smithi184:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-28T23:31:47.315 INFO:teuthology.task.internal:Removing archive directory... 2024-02-28T23:31:47.315 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-28T23:31:47.323 DEBUG:teuthology.orchestra.run.smithi184:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-28T23:31:47.380 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-28T23:31:47.393 INFO:teuthology.task.internal:Not uploading archives. 2024-02-28T23:31:47.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-28T23:31:47.405 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-28T23:31:47.405 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-28T23:31:47.413 DEBUG:teuthology.orchestra.run.smithi184:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-28T23:31:47.462 INFO:teuthology.orchestra.run.smithi159.stdout: 524940 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Feb 28 23:31 /home/ubuntu/cephtest 2024-02-28T23:31:47.462 INFO:teuthology.orchestra.run.smithi159.stdout: 918666 4 d--------- 2 ubuntu ubuntu 4096 Feb 28 23:04 /home/ubuntu/cephtest/mnt.0 2024-02-28T23:31:47.462 INFO:teuthology.orchestra.run.smithi159.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-02-28T23:31:47.464 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-28T23:31:47.465 INFO:teuthology.orchestra.run.smithi159.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-02-28T23:31:47.465 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_1fb5d10608dccee73edd6ef8a2c7b804a097c324/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_b1dac5519c57c269ea98a22fb7729016a1d0e4d2/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi159 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-02-28T23:31:47.466 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-28T23:31:47.479 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-28T23:31:47.492 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-02-28T23:31:47.492 INFO:teuthology.nuke:Checking targets against current locks 2024-02-28T23:31:47.520 DEBUG:teuthology.nuke:shortname: smithi159 2024-02-28T23:31:47.520 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T23:31:47.544 DEBUG:teuthology.nuke:shortname: smithi184 2024-02-28T23:31:47.545 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-28T23:31:47.548 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 22:33:06.082633', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCyNgqg2EfgR5hFy1wTG8CwC0tZQlzjb5wJpxmohpCzQIDKFZ9yg1Gj+suDYePj9NXbHUMJW47Slj/oO5uHlSgQ='} 2024-02-28T23:31:47.567 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi184.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-02-28_15:21:56-fs:upgrade:mds_upgrade_sequence-main-testing-default-smithi/7575601', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-28 22:33:06.081341', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKsVCWnA0iw2FiTVB3UaJyQAby3Nusou4fNkVynGlTFjtnFP1eqU4G7jdttWKjKD6tfUGIRwpMBMwHgNZgvsRp4='} 2024-02-28T23:31:47.598 INFO:teuthology.orchestra.console.smithi159:Power off 2024-02-28T23:31:47.598 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T23:31:47.625 DEBUG:teuthology.orchestra.console.smithi159:power off output: Chassis Power Control: Down/Off 2024-02-28T23:31:47.625 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T23:31:47.640 INFO:teuthology.orchestra.console.smithi184:Power off 2024-02-28T23:31:47.641 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-28T23:31:47.651 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2024-02-28T23:31:47.665 DEBUG:teuthology.orchestra.console.smithi184:power off output: Chassis Power Control: Down/Off 2024-02-28T23:31:48.407 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T23:31:48.434 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-02-28T23:31:51.653 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T23:31:51.762 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is on 2024-02-28T23:31:52.436 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T23:31:52.545 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is on 2024-02-28T23:31:55.767 DEBUG:teuthology.orchestra.console.smithi159:pexpect command: ipmitool -H smithi159.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T23:31:55.876 DEBUG:teuthology.orchestra.console.smithi159:check power output: Chassis Power is off 2024-02-28T23:31:55.976 INFO:teuthology.orchestra.console.smithi159:Power off completed 2024-02-28T23:31:56.547 DEBUG:teuthology.orchestra.console.smithi184:pexpect command: ipmitool -H smithi184.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-28T23:31:56.655 DEBUG:teuthology.orchestra.console.smithi184:check power output: Chassis Power is off 2024-02-28T23:31:56.756 INFO:teuthology.orchestra.console.smithi184:Power off completed 2024-02-28T23:31:56.861 INFO:teuthology.run:Summary data: description: fs:upgrade:mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/reef/{v18.2.1} 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2872.667987346649 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default host.a-kernel-sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 host.b-kernel-sha1: bd7d00fb724897dda560070d01bc6e5c80881f15 owner: scheduled_vshankar@teuthology status: fail success: false 2024-02-28T23:31:56.861 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-28T23:31:56.948 INFO:teuthology.run:FAIL